Tokenizer<TSymbol,TSymbolType> Class

Definition

Namespace:

Microsoft.AspNetCore.Razor.Tokenizer

Assembly:

Microsoft.AspNetCore.Razor.dll

Package:

Microsoft.AspNetCore.Razor v1.1.0

generic <typename TSymbol, typename TSymbolType>
 where TSymbol : SymbolBase<TSymbolType> where TSymbolType : value classpublic ref class Tokenizer abstract : Microsoft::AspNetCore::Razor::Tokenizer::ITokenizer

public abstract class Tokenizer<TSymbol,TSymbolType> : Microsoft.AspNetCore.Razor.Tokenizer.ITokenizer where TSymbol : SymbolBase<TSymbolType> where TSymbolType : struct

type Tokenizer<'Symbol, 'SymbolType (requires 'Symbol :> SymbolBase<'SymbolType> and 'SymbolType : struct)> = class
    interface ITokenizer

Public MustInherit Class Tokenizer(Of TSymbol, TSymbolType)
Implements ITokenizer

Type Parameters

TSymbol

TSymbolType

Inheritance

Object

Tokenizer<TSymbol,TSymbolType>

Implements

ITokenizer

Constructors

Tokenizer<TSymbol,TSymbolType>(ITextDocument)

Properties

Buffer

CurrentCharacter

CurrentErrors

CurrentLocation

CurrentStart

CurrentState

CurrentSymbol

EndOfFile

HaveContent

RazorCommentStarType

RazorCommentTransitionType

RazorCommentType

Source

StartState

Methods

AfterRazorCommentTransition()
AtSymbolAfterRazorCommentBody()
CreateSymbol(SourceLocation, String, TSymbolType, IReadOnlyList<RazorError>)
Dispatch()
EndSymbol(SourceLocation, TSymbolType)
EndSymbol(TSymbolType)
MoveNext()
NextSymbol()
Peek()
RazorCommentBody()
Reset()
Single(TSymbolType)
StarAfterRazorCommentBody()
StartSymbol()
Stay()	Returns a result indicating that this state has no output and the machine should remain in this state
Stay(TSymbol)	Returns a result containing the specified output and indicating that the next call to Turn() should re-invoke the current state.
Stop()	Returns a result indicating that the machine should stop executing and return null output.
TakeAll(String, Boolean)
TakeCurrent()
TakeUntil(Func<Char,Boolean>)
Transition(Int32, TSymbol)	Returns a result containing the specified output and indicating that the next call to Turn() should invoke the provided state.
Transition(Int32)	Returns a result indicating that this state has no output and the machine should immediately invoke the specified state
Transition(Tokenizer<TSymbol,TSymbolType>.RazorCommentTokenizerState, TSymbol)
Transition(Tokenizer<TSymbol,TSymbolType>.RazorCommentTokenizerState)
Turn()

Explicit Interface Implementations

ITokenizer.NextSymbol()