Uses of Package
se.l4.lect.tokens

Packages that use se.l4.lect.tokens

Package	Description
se.l4.lect
se.l4.lect.handlers
se.l4.lect.internal.tokens
se.l4.lect.tokens

Classes in se.l4.lect.tokens used by se.l4.lect

Class and Description
Token Token containing some text that is either words, symbols or whitespace.
TokenizerFactory Factory for instances of Tokenizer working on CharSequences.
TokenProperty Extended language data for a Token that a LanguageParser or Handler may enhance a token with.
TokenType Enumeration for the different types of tokens extracted from text.

Classes in se.l4.lect.tokens used by se.l4.lect.handlers

Class and Description
Token Token containing some text that is either words, symbols or whitespace.
TokenProperty Extended language data for a Token that a LanguageParser or Handler may enhance a token with.

Classes in se.l4.lect.tokens used by se.l4.lect.internal.tokens

Class and Description
Token Token containing some text that is either words, symbols or whitespace.
TokenMatcher Matcher created from a TokenPattern that will match the sequence the pattern describes.
TokenPattern Pattern for matching a sequence of tokens.
TokenType Enumeration for the different types of tokens extracted from text.

Classes in se.l4.lect.tokens used by se.l4.lect.tokens

Class and Description
MutableToken Implementation of Token that is mutable.
Token Token containing some text that is either words, symbols or whitespace.
Tokenizer Tokenizer used to tokenize input into Tokens.
TokenMatcher Matcher created from a TokenPattern that will match the sequence the pattern describes.
TokenPattern Pattern for matching a sequence of tokens.
TokenProperty Extended language data for a Token that a LanguageParser or Handler may enhance a token with.
TokenType Enumeration for the different types of tokens extracted from text.