Uses of Interface
se.l4.lect.tokens.Tokenizer

Packages that use Tokenizer

Package	Description
se.l4.lect.tokens

Uses of Tokenizer in se.l4.lect.tokens

Classes in se.l4.lect.tokens that implement Tokenizer

Modifier and Type	Class and Description
class	OffsetTokenizer Tokenizer that tokenizes using OffsetLocations.

Methods in se.l4.lect.tokens that return Tokenizer

Modifier and Type	Method and Description
Tokenizer	TokenizerFactory.create(CharSequence text) Create a new Tokenizer for the given input text.
default Tokenizer	TokenizerFactory.create(Token token) Create a new Tokenizer for the given input token.