Attention(Int32, Int32, Int32, Int32, List<Int32>) Constructor
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Initializes a new instance of the Attention class.
public Attention (int inChannels, int keyChannels, int numHeads = 8, int attnRatio = 4, System.Collections.Generic.List<int> windowResolution = default);
new Microsoft.ML.TorchSharp.AutoFormerV2.Attention : int * int * int * int * System.Collections.Generic.List<int> -> Microsoft.ML.TorchSharp.AutoFormerV2.Attention
Public Sub New (inChannels As Integer, keyChannels As Integer, Optional numHeads As Integer = 8, Optional attnRatio As Integer = 4, Optional windowResolution As List(Of Integer) = Nothing)
Parameters
- inChannels
- Int32
The input channels.
- keyChannels
- Int32
The key channels.
- numHeads
- Int32
The number of blocks.
- attnRatio
- Int32
The ratio of attention.