Dela via


NlpParameterSubspace Class

Definition

Stringified search spaces for each parameter. See below examples.

public class NlpParameterSubspace
type NlpParameterSubspace = class
Public Class NlpParameterSubspace
Inheritance
NlpParameterSubspace

Constructors

NlpParameterSubspace()

Initializes a new instance of NlpParameterSubspace.

Properties

GradientAccumulationSteps

Number of steps to accumulate gradients over before running a backward pass.

LearningRate

The learning rate for the training procedure.

LearningRateScheduler

The type of learning rate schedule to use during the training procedure.

ModelName

The name of the model to train.

NumberOfEpochs

Number of training epochs.

TrainingBatchSize

The batch size for the training procedure.

ValidationBatchSize

The batch size to be used during evaluation.

WarmupRatio

The warmup ratio, used alongside LrSchedulerType.

WeightDecay

The weight decay for the training procedure.

Applies to