LexicalTokenizerName Enum

Defines the names of all tokenizers supported by the search engine.

Inheritance

builtins.str

LexicalTokenizerName

Enum

LexicalTokenizerName

Constructor

LexicalTokenizerName(value, names=None, *, module=None, qualname=None, type=None, start=1, boundary=None)

Fields

CLASSIC

EDGE_N_GRAM

KEYWORD

LETTER

LOWERCASE

MICROSOFT_LANGUAGE_STEMMING_TOKENIZER

MICROSOFT_LANGUAGE_TOKENIZER

N_GRAM

PATH_HIERARCHY

PATTERN

STANDARD

UAX_URL_EMAIL

WHITESPACE