se.l4.lect.tokens

Enum TokenType

java.lang.Object

java.lang.Enum<TokenType>

se.l4.lect.tokens.TokenType

All Implemented Interfaces:

Serializable, Comparable<TokenType>

public enum TokenType
extends Enum<TokenType>

Enumeration for the different types of tokens extracted from text. These are limited to four categories, white space, symbols, words and special tokens.

Author:

Andreas Holstenson

Enum Constant Summary

Enum Constants

Enum Constant and Description
SPECIAL The token represents special tokens, such as URLs, e-mails and phone numbers.
SYMBOL The token represents one or more symbols.
UNKNOWN The type of token is unknown.
WHITESPACE The token represents white space.
WORD The token represents a word.

Method Summary

Modifier and Type	Method and Description
static TokenType	valueOf(String name) Returns the enum constant of this type with the specified name.
static TokenType[]	values() Returns an array containing the constants of this enum type, in the order they are declared.

Methods inherited from class java.lang.Enum

clone, compareTo, equals, finalize, getDeclaringClass, hashCode, name, ordinal, toString, valueOf

Methods inherited from class java.lang.Object

getClass, notify, notifyAll, wait, wait, wait

Enum Constant Detail

UNKNOWN

public static final TokenType UNKNOWN

The type of token is unknown. Usually used with a Tokenizer where the consumer should handle the resolving the type of token.

WORD

public static final TokenType WORD

The token represents a word.

SYMBOL

public static final TokenType SYMBOL

The token represents one or more symbols.

WHITESPACE

public static final TokenType WHITESPACE

The token represents white space.

SPECIAL

public static final TokenType SPECIAL

The token represents special tokens, such as URLs, e-mails and phone numbers.

Method Detail

values

public static TokenType[] values()

Returns an array containing the constants of this enum type, in the order they are declared. This method may be used to iterate over the constants as follows:

for (TokenType c : TokenType.values())
    System.out.println(c);

Returns:

an array containing the constants of this enum type, in the order they are declared

valueOf

public static TokenType valueOf(String name)

Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)

Parameters:

name - the name of the enum constant to be returned.

Returns:

the enum constant with the specified name

Throws:

IllegalArgumentException - if this enum type has no constant with the specified name

NullPointerException - if the argument is null