se.l4.lect

Class ChunkedLanguageParser

java.lang.Object

se.l4.lect.ChunkedLanguageParser

All Implemented Interfaces:

LanguageParser

Direct Known Subclasses:

ICULanguage, TokenizingLanguage

public abstract class ChunkedLanguageParser
extends Object
implements LanguageParser

Abstract implementation of LanguageParser that allows an implementation to handle a single CharSequence without worrying about mapping to the correct location or original text in the source.

Author:

Andreas Holstenson

Field Summary

Fields

Modifier and Type	Field and Description
protected LanguageEncounter	encounter

Constructor Summary

Constructors

Constructor and Description
ChunkedLanguageParser(LanguageEncounter encounter)

Method Summary

Modifier and Type	Method and Description
protected void	emitToken(int offset, TokenType type, int length)
protected void	emitToken(int offset, TokenType type, int length, Map<String,Object> properties)
protected void	emitToken(int offset, TokenType type, String value)
protected void	endSentence(int offset) End a sentence at the given offset.
void	flush() Indicate that the current paragraph-level content is finished and that parsed sentences and words need to be flushed.
protected abstract void	handleChunk(CharSequence sequence) Handle the given sequence of characters.
protected void	startSentence(int offset) Start a sentence at the given offset.
void	text(CharSequence text, Location start, Location end) Add some text that should be parsed.
void	text(String text, String original, Location start)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface se.l4.lect.LanguageParser

locale

Field Detail

encounter

protected final LanguageEncounter encounter

Constructor Detail

ChunkedLanguageParser

public ChunkedLanguageParser(LanguageEncounter encounter)

Method Detail

text

public void text(CharSequence text,
                 Location start,
                 Location end)

Description copied from interface: LanguageParser

Add some text that should be parsed.

Specified by:

text in interface LanguageParser

Parameters:

text - the text that should be parsed

start - start of the text

end - end of the text

text

public void text(String text,
                 String original,
                 Location start)

flush

public void flush()

Description copied from interface: LanguageParser

Indicate that the current paragraph-level content is finished and that parsed sentences and words need to be flushed.

Specified by:

flush in interface LanguageParser

startSentence

protected void startSentence(int offset)

Start a sentence at the given offset.

Parameters:

offset -

endSentence

protected void endSentence(int offset)

End a sentence at the given offset.

Parameters:

offset -

emitToken

protected void emitToken(int offset,
                         TokenType type,
                         String value)

emitToken

protected void emitToken(int offset,
                         TokenType type,
                         int length)

emitToken

protected void emitToken(int offset,
                         TokenType type,
                         int length,
                         Map<String,Object> properties)

handleChunk

protected abstract void handleChunk(CharSequence sequence)

Handle the given sequence of characters. This method should go through the sequence and in order emit events via startSentence(int), #emitToken(int, se.l4.lect.Token.TokenType, String) and endSentence(int).

Parameters:

sequence -