ImageModelSettings.GradientAccumulationStep Property
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Gradient accumulation means running a configured number of "GradAccumulationStep" steps without updating the model weights while accumulating the gradients of those steps, and then using the accumulated gradients to compute the weight updates. Must be a positive integer.
public int? GradientAccumulationStep { get; set; }member this.GradientAccumulationStep : Nullable<int> with get, setPublic Property GradientAccumulationStep As Nullable(Of Integer)