public class ICULanguage extends ChunkedLanguageParser
LanguageParser that uses BreakIterator from ICU4J to split
text into sentences and tokens.encounter| Constructor and Description |
|---|
ICULanguage(Locale locale,
LanguageEncounter encounter) |
| Modifier and Type | Method and Description |
|---|---|
static LanguageFactory |
forLocale(Locale locale)
Get a factory that will create a language parser for the given
Locale. |
protected void |
handleChunk(CharSequence sequence)
Handle the given sequence of characters.
|
Locale |
locale()
Get the locale of this parser.
|
emitToken, emitToken, emitToken, endSentence, flush, startSentence, text, textpublic ICULanguage(Locale locale, LanguageEncounter encounter)
public static LanguageFactory forLocale(Locale locale)
Locale.locale - public Locale locale()
LanguageParserprotected void handleChunk(CharSequence sequence)
ChunkedLanguageParserChunkedLanguageParser.startSentence(int), #emitToken(int, se.l4.lect.Token.TokenType, String) and
ChunkedLanguageParser.endSentence(int).handleChunk in class ChunkedLanguageParserCopyright © 2018. All rights reserved.