| Package | Description |
|---|---|
| se.l4.lect | |
| se.l4.lect.internal.tokens | |
| se.l4.lect.tokens |
| Modifier and Type | Method and Description |
|---|---|
protected void |
ChunkedLanguageParser.emitToken(int offset,
TokenType type,
int length) |
protected void |
ChunkedLanguageParser.emitToken(int offset,
TokenType type,
int length,
Map<String,Object> properties) |
protected void |
ChunkedLanguageParser.emitToken(int offset,
TokenType type,
String value) |
| Constructor and Description |
|---|
TokenNode(TokenType type,
Map<String,Object> properties) |
| Modifier and Type | Method and Description |
|---|---|
static TokenType |
TextTokenization.findBestTokenType(CharSequence text)
Find the best token type for the given text.
|
TokenType |
Token.getType()
Get the type of token.
|
TokenType |
MutableToken.getType() |
TokenType |
ImmutableToken.getType() |
static TokenType |
TokenType.valueOf(String name)
Returns the enum constant of this type with the specified name.
|
static TokenType[] |
TokenType.values()
Returns an array containing the constants of this enum type, in
the order they are declared.
|
| Modifier and Type | Method and Description |
|---|---|
static MutableToken |
MutableToken.ofType(TokenType type) |
protected void |
OffsetTokenizer.setNextToken(TokenType type,
int start,
CharSequence text)
Set the next token.
|
MutableToken |
MutableToken.setType(TokenType type) |
void |
MutableToken.update(TokenType type,
Location start,
Location end,
CharSequence text)
Update the data within the token.
|
void |
MutableToken.update(TokenType type,
Location start,
Location end,
CharSequence text,
Map<String,Object> otherProperties)
Update the data within the token including properties.
|
| Constructor and Description |
|---|
ImmutableToken(TokenType type,
Location start,
Location end,
CharSequence text,
Map<String,Object> properties) |
MutableToken(TokenType type,
Location start,
Location end,
CharSequence text)
Create a new token with a given type, location and text.
|
Copyright © 2018. All rights reserved.