Share via


Attention(Int32, Int32, Int32, Int32, List<Int32>) Constructor

Definition

Initializes a new instance of the Attention class.

public Attention (int inChannels, int keyChannels, int numHeads = 8, int attnRatio = 4, System.Collections.Generic.List<int> windowResolution = default);
new Microsoft.ML.TorchSharp.AutoFormerV2.Attention : int * int * int * int * System.Collections.Generic.List<int> -> Microsoft.ML.TorchSharp.AutoFormerV2.Attention
Public Sub New (inChannels As Integer, keyChannels As Integer, Optional numHeads As Integer = 8, Optional attnRatio As Integer = 4, Optional windowResolution As List(Of Integer) = Nothing)

Parameters

inChannels
Int32

The input channels.

keyChannels
Int32

The key channels.

numHeads
Int32

The number of blocks.

attnRatio
Int32

The ratio of attention.

windowResolution
List<Int32>

The resolution of window.

Applies to