ImageModelSettings.GradientAccumulationStep Property

Definition

Gradient accumulation means running a configured number of "GradAccumulationStep" steps without updating the model weights while accumulating the gradients of those steps, and then using the accumulated gradients to compute the weight updates. Must be a positive integer.

public int? GradientAccumulationStep { get; set; }
member this.GradientAccumulationStep : Nullable<int> with get, set
Public Property GradientAccumulationStep As Nullable(Of Integer)

Property Value

Applies to