org.apache.uima.lucas.indexer
Class Tokenizer
java.lang.Object
org.apache.uima.lucas.indexer.Tokenizer
public class Tokenizer
- extends Object
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
TOKENIZER_WHITESPACE
public static final String TOKENIZER_WHITESPACE
- See Also:
- Constant Field Values
TOKENIZER_CAS
public static final String TOKENIZER_CAS
- See Also:
- Constant Field Values
TOKENIZER_STANDARD
public static final String TOKENIZER_STANDARD
- See Also:
- Constant Field Values
Tokenizer
public Tokenizer()
needsTokenization
public boolean needsTokenization(AnnotationDescription annotationDescription)
tokenize
public org.apache.lucene.analysis.TokenStream tokenize(org.apache.lucene.analysis.TokenStream tokenStream,
AnnotationDescription description)
throws IOException
- Throws:
IOException
Copyright © 2006-2011 The Apache Software Foundation. All Rights Reserved.