SentenceSimilarityTrainer.SentenceSimilarityOptions Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
public class SentenceSimilarityTrainer.SentenceSimilarityOptions : Microsoft.ML.TorchSharp.NasBert.NasBertTrainer.NasBertOptionstype SentenceSimilarityTrainer.SentenceSimilarityOptions = class
inherit NasBertTrainer.NasBertOptionsPublic Class SentenceSimilarityTrainer.SentenceSimilarityOptions
Inherits NasBertTrainer.NasBertOptions- Inheritance
-
SentenceSimilarityTrainer.SentenceSimilarityOptions
Constructors
| SentenceSimilarityTrainer.SentenceSimilarityOptions() |
Fields
| ActivationDropout |
Dropout rate after activation functions in FFN layers. Should be within [0, 1). (Inherited from NasBertTrainer.NasBertOptions) |
| AdamBetas |
Betas for Adam optimizer. (Inherited from NasBertTrainer.NasBertOptions) |
| AdamEps |
Epsilon for Adam optimizer. (Inherited from NasBertTrainer.NasBertOptions) |
| AttentionDropout |
Dropout rate for attention weights. Should be within [0, 1). (Inherited from NasBertTrainer.NasBertOptions) |
| BatchSize |
Number of samples to use for mini-batch training. (Inherited from TorchSharpBaseTrainer.Options) |
| ClipNorm |
The clipping threshold of gradients. Should be within [0, +Inf). 0 means not to clip norm. (Inherited from NasBertTrainer.NasBertOptions) |
| Dropout |
Dropout rate for general situations. Should be within [0, 1). (Inherited from NasBertTrainer.NasBertOptions) |
| DynamicDropout |
Whether to use dynamic dropout. (Inherited from NasBertTrainer.NasBertOptions) |
| EncoderNormalizeBefore |
Whether to apply layer normalization before each encoder block. (Inherited from NasBertTrainer.NasBertOptions) |
| FinalLearningRateRatio |
The final learning rate for polynomial decay scheduler. (Inherited from TorchSharpBaseTrainer.Options) |
| FreezeEncoder |
Whether to freeze encoder parameters. (Inherited from NasBertTrainer.NasBertOptions) |
| FreezeTransfer |
Whether to freeze transfer module parameters. (Inherited from NasBertTrainer.NasBertOptions) |
| LabelColumnName |
The label column name. (Inherited from TorchSharpBaseTrainer.Options) |
| LayerNormTraining |
Whether to train layer norm parameters. (Inherited from NasBertTrainer.NasBertOptions) |
| LearningRate |
Learning rate for the first N epochs; all epochs >N using LR_N. Note: this may be interpreted differently depending on the scheduler. (Inherited from NasBertTrainer.NasBertOptions) |
| MaxEpoch |
Stop training when reaching this number of epochs. (Inherited from TorchSharpBaseTrainer.Options) |
| PoolerDropout |
Dropout rate in the masked language model pooler layers. Should be within [0, 1). (Inherited from NasBertTrainer.NasBertOptions) |
| PredictionColumnName |
The Prediction column name. (Inherited from TorchSharpBaseTrainer.Options) |
| ScoreColumnName |
The Score column name. (Inherited from TorchSharpBaseTrainer.Options) |
| Sentence1ColumnName |
The first sentence column. (Inherited from NasBertTrainer.NasBertOptions) |
| Sentence2ColumnName |
The second sentence column. (Inherited from NasBertTrainer.NasBertOptions) |
| StartLearningRateRatio |
The start learning rate for polynomial decay scheduler. (Inherited from TorchSharpBaseTrainer.Options) |
| TaskType |
Task type, which is related to the model head. (Inherited from NasBertTrainer.NasBertOptions) |
| ValidationSet |
The validation set used while training to improve model quality. (Inherited from TorchSharpBaseTrainer.Options) |
| WarmupRatio |
Proportion of warmup steps for polynomial decay scheduler. (Inherited from NasBertTrainer.NasBertOptions) |
| WeightDecay |
Coefficiency of weight decay. Should be within [0, +Inf). (Inherited from TorchSharpBaseTrainer.Options) |