LexicalTokenizerName Enum

Definieert de namen van alle tokenizers die worden ondersteund door de zoekmachine.

Overname

builtins.str

LexicalTokenizerName

Enum

LexicalTokenizerName

Constructor

LexicalTokenizerName(value, names=None, *, module=None, qualname=None, type=None, start=1, boundary=None)

Velden

CLASSIC

EDGE_N_GRAM

KEYWORD

LETTER

LOWERCASE

MICROSOFT_LANGUAGE_STEMMING_TOKENIZER

MICROSOFT_LANGUAGE_TOKENIZER

N_GRAM

PATH_HIERARCHY

PATTERN

STANDARD

UAX_URL_EMAIL

WHITESPACE