Uses of Class
opennlp.tools.tokenize.TokenizerModel
-
Packages that use TokenizerModel Package Description opennlp.tools.cmdline.tokenizer opennlp.tools.formats.brat opennlp.tools.tokenize Contains classes related to finding token or words in a string. -
-
Uses of TokenizerModel in opennlp.tools.cmdline.tokenizer
Methods in opennlp.tools.cmdline.tokenizer that return TokenizerModel Modifier and Type Method Description protected TokenizerModel
TokenizerModelLoader. loadModel(InputStream modelIn)
-
Uses of TokenizerModel in opennlp.tools.formats.brat
Constructors in opennlp.tools.formats.brat with parameters of type TokenizerModel Constructor Description BratNameSampleStream(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples)
Creates a newBratNameSampleStream
.BratNameSampleStream(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples, Set<String> nameTypes)
Creates a newBratNameSampleStream
. -
Uses of TokenizerModel in opennlp.tools.tokenize
Methods in opennlp.tools.tokenize that return TokenizerModel Modifier and Type Method Description static TokenizerModel
TokenizerME. train(ObjectStream<TokenSample> samples, TokenizerFactory factory, TrainingParameters mlParams)
Trains a model for theTokenizerME
.Constructors in opennlp.tools.tokenize with parameters of type TokenizerModel Constructor Description TokenizerME(TokenizerModel model)
TokenizerME(TokenizerModel model, Factory factory)
Deprecated.useTokenizerFactory
to extend the Tokenizer functionality
-