NlpParameterSubspace Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Stringified search spaces for each parameter. See below examples.
public class NlpParameterSubspace
type NlpParameterSubspace = class
Public Class NlpParameterSubspace
- Inheritance
-
NlpParameterSubspace
Constructors
NlpParameterSubspace() |
Initializes a new instance of NlpParameterSubspace. |
Properties
GradientAccumulationSteps |
Number of steps to accumulate gradients over before running a backward pass. |
LearningRate |
The learning rate for the training procedure. |
LearningRateScheduler |
The type of learning rate schedule to use during the training procedure. |
ModelName |
The name of the model to train. |
NumberOfEpochs |
Number of training epochs. |
TrainingBatchSize |
The batch size for the training procedure. |
ValidationBatchSize |
The batch size to be used during evaluation. |
WarmupRatio |
The warmup ratio, used alongside LrSchedulerType. |
WeightDecay |
The weight decay for the training procedure. |