Uses of Interface
opennlp.tools.util.ObjectStream
-
Packages that use ObjectStream Package Description opennlp.tools.chunker Package related to finding non-recursive syntactic annotation such as noun phrase chunks.opennlp.tools.cmdline.namefind opennlp.tools.cmdline.parser opennlp.tools.doccat Package for classifying a document into a category.opennlp.tools.formats Experimental package related to converting various corpora to OpenNLP Format.opennlp.tools.formats.ad Experimental package related to theArvores Deitadas corpus
format.opennlp.tools.formats.brat Experimental package related to the corpus format used by the "brat rapid annotation tool" (brat).opennlp.tools.formats.conllu Experimental package related to the CoNNL-U format.opennlp.tools.formats.convert opennlp.tools.formats.frenchtreebank Experimental package related to the French Treebank format.opennlp.tools.formats.irishsentencebank Experimental package related to the Irish Sentence Bank format.opennlp.tools.formats.leipzig Experimental package related to theLeipzig
corpus format.opennlp.tools.formats.letsmt Experimental package related to theletsmt
corpus format.opennlp.tools.formats.masc Experimental package related to theMASC
corpus format.opennlp.tools.formats.moses opennlp.tools.formats.muc Experimental package related to theMUC
corpus format.opennlp.tools.formats.nkjp Experimental package related to the National corpus of PolishNKJP
format.opennlp.tools.formats.ontonotes Experimental package related to the OntoNotes 4.0 format.opennlp.tools.langdetect Package related to predicting languages from samples of text.opennlp.tools.lemmatizer Package related to the lemmatizer functionality.opennlp.tools.ml Package related to Machine Learning (ML) features of OpenNLP, the related ML models, and trainers.opennlp.tools.ml.maxent Package related to ML by means of the Maximum Entropy (ME) algorithm.opennlp.tools.ml.model Package related to ML models and feature selection techniques.opennlp.tools.namefind Package related to finding proper names and numeric amounts.opennlp.tools.parser Package containing common code for performing full syntactic parsing.opennlp.tools.parser.chunking Package containing code for performing full syntactic parsing using shift/reduce-style decisions.opennlp.tools.parser.treeinsert Package containing experimental code for performing full syntactic parsing using attachment decisions.opennlp.tools.postag Package related to part-of-speech tagging.opennlp.tools.sentdetect Package related to identifying sentence boundaries.opennlp.tools.tokenize Contains classes related to finding token or words in a string.opennlp.tools.util Package containing utility data structures and algorithms used by multiple other packages.opennlp.tools.util.eval -
-
Uses of ObjectStream in opennlp.tools.chunker
Classes in opennlp.tools.chunker that implement ObjectStream Modifier and Type Class Description class
ChunkerEventStream
Class for creating an event stream out of data files for training aChunker
.class
ChunkSampleSequenceStream
ASequenceStream
implementation encapsulatingsamples
.class
ChunkSampleStream
Parses the conll 2000 shared task shallow parser training data.Methods in opennlp.tools.chunker with parameters of type ObjectStream Modifier and Type Method Description void
ChunkerCrossValidator. evaluate(ObjectStream<ChunkSample> samples, int nFolds)
Starts the evaluation.static ChunkerModel
ChunkerME. train(String lang, ObjectStream<ChunkSample> in, TrainingParameters mlParams, ChunkerFactory factory)
Starts a training of aChunkerModel
with the given parameters.Constructors in opennlp.tools.chunker with parameters of type ObjectStream Constructor Description ChunkerEventStream(ObjectStream<ChunkSample> d, ChunkerContextGenerator cg)
Creates a new event stream based on the specified data stream using the given context generator.ChunkSampleSequenceStream(ObjectStream<ChunkSample> samples, ChunkerContextGenerator generator)
ChunkSampleStream(ObjectStream<String> samples)
Initializes ainstance
. -
Uses of ObjectStream in opennlp.tools.cmdline.namefind
Classes in opennlp.tools.cmdline.namefind that implement ObjectStream Modifier and Type Class Description class
NameSampleCountersStream
Counts tokens, sentences and names by type.Methods in opennlp.tools.cmdline.namefind with parameters of type ObjectStream Modifier and Type Method Description static Dictionary
CensusDictionaryCreatorTool. createDictionary(ObjectStream<StringList> sampleStream)
Creates a dictionary.Constructors in opennlp.tools.cmdline.namefind with parameters of type ObjectStream Constructor Description NameSampleCountersStream(ObjectStream<NameSample> samples)
-
Uses of ObjectStream in opennlp.tools.cmdline.parser
Methods in opennlp.tools.cmdline.parser with parameters of type ObjectStream Modifier and Type Method Description protected ParserModel
BuildModelUpdaterTool. trainAndUpdate(ParserModel originalModel, ObjectStream<Parse> parseSamples, opennlp.tools.cmdline.parser.ModelUpdaterTool.ModelUpdaterParams parameters)
protected ParserModel
CheckModelUpdaterTool. trainAndUpdate(ParserModel originalModel, ObjectStream<Parse> parseSamples, opennlp.tools.cmdline.parser.ModelUpdaterTool.ModelUpdaterParams parameters)
-
Uses of ObjectStream in opennlp.tools.doccat
Classes in opennlp.tools.doccat that implement ObjectStream Modifier and Type Class Description class
DocumentCategorizerEventStream
Iterator-like class for modeling document classification events.class
DocumentSampleStream
Reads in string encoded training samples, parses them and outputsDocumentSample
objects.Methods in opennlp.tools.doccat with parameters of type ObjectStream Modifier and Type Method Description void
DoccatCrossValidator. evaluate(ObjectStream<DocumentSample> samples, int nFolds)
Starts the evaluation.static DoccatModel
DocumentCategorizerME. train(String lang, ObjectStream<DocumentSample> samples, TrainingParameters mlParams, DoccatFactory factory)
Starts a training of aDoccatModel
with the given parameters.Constructors in opennlp.tools.doccat with parameters of type ObjectStream Constructor Description DocumentCategorizerEventStream(ObjectStream<DocumentSample> samples)
Initializes aDocumentCategorizerEventStream
via samples.DocumentCategorizerEventStream(ObjectStream<DocumentSample> samples, FeatureGenerator... featureGenerators)
Initializes aDocumentCategorizerEventStream
via samples andfeature generators
.DocumentSampleStream(ObjectStream<String> samples)
Initializes ainstance
. -
Uses of ObjectStream in opennlp.tools.formats
Classes in opennlp.tools.formats that implement ObjectStream Modifier and Type Class Description class
BioNLP2004NameSampleStream
Asample stream
for the training files of the BioNLP/NLPBA 2004 shared task.class
Conll02NameSampleStream
Parser for the Dutch and Spanish ner training files of the CONLL 2002 shared task.class
Conll03NameSampleStream
An import stream which can parse the CONLL03 data.class
ConllXPOSSampleStream
Parses the data from the CONLL 06 shared task into POS Samples.class
DirectorySampleStream
The directory sample stream allows for creating anObjectStream
from a directory listing of files.class
EvalitaNameSampleStream
Parser for the Italian NER training files of the Evalita 2007 and 2009 NER shared tasks.class
NameFinderCensus90NameStream
This class helps to read the US Census data from the files to build a StringList for each dictionary entry in the name-finder dictionary.class
TwentyNewsgroupSampleStream
Methods in opennlp.tools.formats that return ObjectStream Modifier and Type Method Description ObjectStream<NameSample>
BioNLP2004NameSampleStreamFactory. create(String[] args)
ObjectStream<ChunkSample>
ChunkerSampleStreamFactory. create(String[] args)
ObjectStream<NameSample>
Conll02NameSampleStreamFactory. create(String[] args)
ObjectStream<NameSample>
Conll03NameSampleStreamFactory. create(String[] args)
ObjectStream<POSSample>
ConllXPOSSampleStreamFactory. create(String[] args)
ObjectStream<SentenceSample>
ConllXSentenceSampleStreamFactory. create(String[] args)
ObjectStream<TokenSample>
ConllXTokenSampleStreamFactory. create(String[] args)
ObjectStream<DocumentSample>
DocumentSampleStreamFactory. create(String[] args)
ObjectStream<NameSample>
EvalitaNameSampleStreamFactory. create(String[] args)
ObjectStream<LanguageSample>
LanguageDetectorSampleStreamFactory. create(String[] args)
ObjectStream<LemmaSample>
LemmatizerSampleStreamFactory. create(String[] args)
ObjectStream<NameSample>
NameSampleDataStreamFactory. create(String[] args)
ObjectStream<Parse>
ParseSampleStreamFactory. create(String[] args)
ObjectStream<SentenceSample>
SentenceSampleStreamFactory. create(String[] args)
ObjectStream<TokenSample>
TokenSampleStreamFactory. create(String[] args)
ObjectStream<DocumentSample>
TwentyNewsgroupSampleStreamFactory. create(String[] args)
ObjectStream<POSSample>
WordTagSampleStreamFactory. create(String[] args)
Constructors in opennlp.tools.formats with parameters of type ObjectStream Constructor Description Conll02NameSampleStream(Conll02NameSampleStream.LANGUAGE lang, ObjectStream<String> lineStream, int types)
Initializes aConll02NameSampleStream
.Conll03NameSampleStream(Conll03NameSampleStream.LANGUAGE lang, ObjectStream<String> lineStream, int types)
Initializes aConll03NameSampleStream
.ConllXPOSSampleStream(ObjectStream<String> lineStream)
Initializes aConllXPOSSampleStream
.EvalitaNameSampleStream(EvalitaNameSampleStream.LANGUAGE lang, ObjectStream<String> lineStream, int types)
NameFinderCensus90NameStream(ObjectStream<String> lineStream)
Initializes aNameFinderCensus90NameStream
viaObjectStream
. -
Uses of ObjectStream in opennlp.tools.formats.ad
Classes in opennlp.tools.formats.ad that implement ObjectStream Modifier and Type Class Description class
ADChunkSampleStream
Parser for Floresta Sita(c)tica Arvores Deitadas corpus, output to for the Portuguese Chunker training.class
ADNameSampleStream
Parser for Floresta Sita(c)tica Arvores Deitadas corpus, output to for the Portuguese NER training.class
ADPOSSampleStream
Note: Do not use this class, internal use only!class
ADSentenceSampleStream
Note: Do not use this class, internal use only!class
ADSentenceStream
Stream filter which merges text lines into sentences, following the Arvores Deitadas syntax.Fields in opennlp.tools.formats.ad declared as ObjectStream Modifier and Type Field Description protected ObjectStream<ADSentenceStream.Sentence>
ADChunkSampleStream. adSentenceStream
Methods in opennlp.tools.formats.ad that return ObjectStream Modifier and Type Method Description ObjectStream<ChunkSample>
ADChunkSampleStreamFactory. create(String[] args)
ObjectStream<NameSample>
ADNameSampleStreamFactory. create(String[] args)
ObjectStream<POSSample>
ADPOSSampleStreamFactory. create(String[] args)
ObjectStream<SentenceSample>
ADSentenceSampleStreamFactory. create(String[] args)
ObjectStream<TokenSample>
ADTokenSampleStreamFactory. create(String[] args)
Constructors in opennlp.tools.formats.ad with parameters of type ObjectStream Constructor Description ADChunkSampleStream(ObjectStream<String> lineStream)
Instantiates aADChunkSampleStream
stream fromObjectStream
, that could be aPlainTextByLineStream
object.ADNameSampleStream(ObjectStream<String> lineStream, boolean splitHyphenatedTokens)
Initializes a newADNameSampleStream
stream from aObjectStream
, that could be aPlainTextByLineStream
object.ADPOSSampleStream(ObjectStream<String> lineStream, boolean expandME, boolean includeFeatures)
Creates a newADPOSSampleStream
stream from aObjectStream
, that could be aPlainTextByLineStream
object.ADSentenceSampleStream(ObjectStream<String> lineStream, boolean includeHeadlines)
Initializes a newADSentenceSampleStream
from aObjectStream
, that could be aPlainTextByLineStream
object.ADSentenceStream(ObjectStream<String> lineStream)
-
Uses of ObjectStream in opennlp.tools.formats.brat
Classes in opennlp.tools.formats.brat that implement ObjectStream Modifier and Type Class Description class
BratAnnotationStream
Reads the annotations from the brat.ann
annotation file.class
BratDocumentStream
class
BratNameSampleStream
Generates Name Sample objects for a Brat Document object.class
SegmenterObjectStream<S,T>
Methods in opennlp.tools.formats.brat that return ObjectStream Modifier and Type Method Description ObjectStream<NameSample>
BratNameSampleStreamFactory. create(String[] args)
Constructors in opennlp.tools.formats.brat with parameters of type ObjectStream Constructor Description BratNameSampleStream(SentenceDetector sentDetector, Tokenizer tokenizer, ObjectStream<BratDocument> samples)
Creates a newBratNameSampleStream
.BratNameSampleStream(SentenceDetector sentDetector, Tokenizer tokenizer, ObjectStream<BratDocument> samples, Set<String> nameTypes)
Creates a newBratNameSampleStream
.BratNameSampleStream(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples)
Creates a newBratNameSampleStream
.BratNameSampleStream(SentenceModel sentModel, TokenizerModel tokenModel, ObjectStream<BratDocument> samples, Set<String> nameTypes)
Creates a newBratNameSampleStream
.SegmenterObjectStream(ObjectStream<S> in)
-
Uses of ObjectStream in opennlp.tools.formats.conllu
Classes in opennlp.tools.formats.conllu that implement ObjectStream Modifier and Type Class Description class
ConlluLemmaSampleStream
class
ConlluPOSSampleStream
class
ConlluSentenceSampleStream
class
ConlluStream
The CoNNL-U Format is specified here.class
ConlluTokenSampleStream
Methods in opennlp.tools.formats.conllu that return ObjectStream Modifier and Type Method Description ObjectStream<LemmaSample>
ConlluLemmaSampleStreamFactory. create(String[] args)
ObjectStream<POSSample>
ConlluPOSSampleStreamFactory. create(String[] args)
ObjectStream<SentenceSample>
ConlluSentenceSampleStreamFactory. create(String[] args)
ObjectStream<TokenSample>
ConlluTokenSampleStreamFactory. create(String[] args)
Constructors in opennlp.tools.formats.conllu with parameters of type ObjectStream Constructor Description ConlluLemmaSampleStream(ObjectStream<ConlluSentence> samples, ConlluTagset tagset)
Initializes aConlluLemmaSampleStream
.ConlluPOSSampleStream(ObjectStream<ConlluSentence> samples, ConlluTagset tagset)
Initializes aConlluPOSSampleStream
.ConlluSentenceSampleStream(ObjectStream<ConlluSentence> samples, int sentencesPerSample)
Initializes aConlluSentenceSampleStream
.ConlluTokenSampleStream(ObjectStream<ConlluSentence> samples)
Initializes aConlluTokenSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.convert
Classes in opennlp.tools.formats.convert that implement ObjectStream Modifier and Type Class Description class
AbstractToSentenceSampleStream<T>
class
FileToByteArraySampleStream
Note: Do not use this class, internal use only!class
FileToStringSampleStream
Provides the ability to read the contents of files contained in an object stream of files.class
NameToSentenceSampleStream
Note: Do not use this class, internal use only!class
NameToTokenSampleStream
Note: Do not use this class, internal use only!class
ParseToPOSSampleStream
Note: Do not use this class, internal use only!class
POSToSentenceSampleStream
Note: Do not use this class, internal use only!class
POSToTokenSampleStream
Note: Do not use this class, internal use only!Methods in opennlp.tools.formats.convert that return ObjectStream Modifier and Type Method Description ObjectStream<SentenceSample>
NameToSentenceSampleStreamFactory. create(String[] args)
ObjectStream<TokenSample>
NameToTokenSampleStreamFactory. create(String[] args)
ObjectStream<POSSample>
ParseToPOSSampleStreamFactory. create(String[] args)
ObjectStream<SentenceSample>
ParseToSentenceSampleStreamFactory. create(String[] args)
ObjectStream<TokenSample>
ParseToTokenSampleStreamFactory. create(String[] args)
ObjectStream<SentenceSample>
POSToSentenceSampleStreamFactory. create(String[] args)
ObjectStream<TokenSample>
POSToTokenSampleStreamFactory. create(String[] args)
Constructors in opennlp.tools.formats.convert with parameters of type ObjectStream Constructor Description FileToByteArraySampleStream(ObjectStream<File> samples)
Initializes aFileToByteArraySampleStream
.FileToStringSampleStream(ObjectStream<File> samples, Charset encoding)
Initializes aFileToStringSampleStream
.NameToSentenceSampleStream(Detokenizer detokenizer, ObjectStream<NameSample> samples, int chunkSize)
Initializes aNameToSentenceSampleStream
.NameToTokenSampleStream(Detokenizer detokenizer, ObjectStream<NameSample> samples)
Initializes aNameToTokenSampleStream
.ParseToPOSSampleStream(ObjectStream<Parse> samples)
Initializes aParseToPOSSampleStream
.POSToSentenceSampleStream(Detokenizer detokenizer, ObjectStream<POSSample> samples, int chunkSize)
Initializes aPOSToSentenceSampleStream
.POSToTokenSampleStream(Detokenizer detokenizer, ObjectStream<POSSample> samples)
Initializes aPOSToTokenSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.frenchtreebank
Classes in opennlp.tools.formats.frenchtreebank that implement ObjectStream Modifier and Type Class Description class
ConstitParseSampleStream
Methods in opennlp.tools.formats.frenchtreebank that return ObjectStream Modifier and Type Method Description ObjectStream<Parse>
ConstitParseSampleStreamFactory. create(String[] args)
Constructors in opennlp.tools.formats.frenchtreebank with parameters of type ObjectStream Constructor Description ConstitParseSampleStream(ObjectStream<byte[]> samples)
Initializes aConstitParseSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.irishsentencebank
Methods in opennlp.tools.formats.irishsentencebank that return ObjectStream Modifier and Type Method Description ObjectStream<SentenceSample>
IrishSentenceBankSentenceStreamFactory. create(String[] args)
ObjectStream<TokenSample>
IrishSentenceBankTokenSampleStreamFactory. create(String[] args)
-
Uses of ObjectStream in opennlp.tools.formats.leipzig
Classes in opennlp.tools.formats.leipzig that implement ObjectStream Modifier and Type Class Description class
LeipzigLanguageSampleStream
Methods in opennlp.tools.formats.leipzig that return ObjectStream Modifier and Type Method Description ObjectStream<LanguageSample>
LeipzigLanguageSampleStreamFactory. create(String[] args)
-
Uses of ObjectStream in opennlp.tools.formats.letsmt
Classes in opennlp.tools.formats.letsmt that implement ObjectStream Modifier and Type Class Description class
DetokenizeSentenceSampleStream
Methods in opennlp.tools.formats.letsmt that return ObjectStream Modifier and Type Method Description ObjectStream<SentenceSample>
LetsmtSentenceStreamFactory. create(String[] args)
Constructors in opennlp.tools.formats.letsmt with parameters of type ObjectStream Constructor Description DetokenizeSentenceSampleStream(Detokenizer detokenizer, ObjectStream<SentenceSample> samples)
Initializes aDetokenizeSentenceSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.masc
Classes in opennlp.tools.formats.masc that implement ObjectStream Modifier and Type Class Description class
MascDocumentStream
class
MascNamedEntitySampleStream
class
MascPOSSampleStream
class
MascSentenceSampleStream
class
MascTokenSampleStream
Methods in opennlp.tools.formats.masc that return ObjectStream Modifier and Type Method Description ObjectStream<NameSample>
MascNamedEntitySampleStreamFactory. create(String[] args)
ObjectStream<POSSample>
MascPOSSampleStreamFactory. create(String[] args)
ObjectStream<SentenceSample>
MascSentenceSampleStreamFactory. create(String[] args)
ObjectStream<TokenSample>
MascTokenSampleStreamFactory. create(String[] args)
Constructors in opennlp.tools.formats.masc with parameters of type ObjectStream Constructor Description MascNamedEntitySampleStream(ObjectStream<MascDocument> samples)
InitializesMascNamedEntitySampleStream
from a stream ofdocuments
.MascPOSSampleStream(ObjectStream<MascDocument> samples)
InitializesMascPOSSampleStream
from a stream ofdocuments
.MascSentenceSampleStream(ObjectStream<MascDocument> samples, int sentencesPerSample)
MascTokenSampleStream(ObjectStream<MascDocument> samples)
Initializes aMascTokenSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.moses
Classes in opennlp.tools.formats.moses that implement ObjectStream Modifier and Type Class Description class
MosesSentenceSampleStream
Methods in opennlp.tools.formats.moses that return ObjectStream Modifier and Type Method Description ObjectStream<SentenceSample>
MosesSentenceSampleStreamFactory. create(String[] args)
Constructors in opennlp.tools.formats.moses with parameters of type ObjectStream Constructor Description MosesSentenceSampleStream(ObjectStream<String> sentences)
Initializes aMosesSentenceSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.muc
Classes in opennlp.tools.formats.muc that implement ObjectStream Modifier and Type Class Description class
MucNameSampleStream
Methods in opennlp.tools.formats.muc that return ObjectStream Modifier and Type Method Description ObjectStream<NameSample>
Muc6NameSampleStreamFactory. create(String[] args)
Constructors in opennlp.tools.formats.muc with parameters of type ObjectStream Constructor Description MucNameSampleStream(Tokenizer tokenizer, ObjectStream<String> samples)
Initializes aMucNameSampleStream
. -
Uses of ObjectStream in opennlp.tools.formats.nkjp
Classes in opennlp.tools.formats.nkjp that implement ObjectStream Modifier and Type Class Description class
NKJPSentenceSampleStream
Methods in opennlp.tools.formats.nkjp that return ObjectStream Modifier and Type Method Description ObjectStream<SentenceSample>
NKJPSentenceSampleStreamFactory. create(String[] args)
-
Uses of ObjectStream in opennlp.tools.formats.ontonotes
Classes in opennlp.tools.formats.ontonotes that implement ObjectStream Modifier and Type Class Description class
DocumentToLineStream
Reads a plain text file and return each line as aString
object.class
OntoNotesNameSampleStream
Name Sample Stream parser for the OntoNotes 4.0 corpus.class
OntoNotesParseSampleStream
Methods in opennlp.tools.formats.ontonotes that return ObjectStream Modifier and Type Method Description ObjectStream<NameSample>
OntoNotesNameSampleStreamFactory. create(String[] args)
ObjectStream<Parse>
OntoNotesParseSampleStreamFactory. create(String[] args)
ObjectStream<POSSample>
OntoNotesPOSSampleStreamFactory. create(String[] args)
Constructors in opennlp.tools.formats.ontonotes with parameters of type ObjectStream Constructor Description DocumentToLineStream(ObjectStream<String> samples)
Initializes aDocumentToLineStream
.OntoNotesNameSampleStream(ObjectStream<String> samples)
Initializes aOntoNotesNameSampleStream
.OntoNotesParseSampleStream(ObjectStream<String> samples)
Initializes aOntoNotesParseSampleStream
. -
Uses of ObjectStream in opennlp.tools.langdetect
Classes in opennlp.tools.langdetect that implement ObjectStream Modifier and Type Class Description class
LanguageDetectorEventStream
Iterator-like class for modeling an event stream ofsamples
.class
LanguageDetectorSampleStream
This class reads in string encodedtraining samples
, parses them and outputsLanguageSample
objects.Methods in opennlp.tools.langdetect with parameters of type ObjectStream Modifier and Type Method Description void
LanguageDetectorCrossValidator. evaluate(ObjectStream<LanguageSample> samples, int nFolds)
Starts the evaluation.static LanguageDetectorModel
LanguageDetectorME. train(ObjectStream<LanguageSample> samples, TrainingParameters mlParams, LanguageDetectorFactory factory)
Starts a training of aLanguageDetectorModel
with the given parameters.Constructors in opennlp.tools.langdetect with parameters of type ObjectStream Constructor Description LanguageDetectorEventStream(ObjectStream<LanguageSample> data, LanguageDetectorContextGenerator cg)
Initializes an instance via samples and feature generators.LanguageDetectorSampleStream(ObjectStream<String> samples)
Initializes ainstance
. -
Uses of ObjectStream in opennlp.tools.lemmatizer
Classes in opennlp.tools.lemmatizer that implement ObjectStream Modifier and Type Class Description class
LemmaSampleEventStream
Class for creating an event stream out of data files for training a probabilisticLemmatizer
.class
LemmaSampleSequenceStream
ASequenceStream
implementation encapsulatingsamples
.class
LemmaSampleStream
Reads data for training and testing theLemmatizer
.Methods in opennlp.tools.lemmatizer with parameters of type ObjectStream Modifier and Type Method Description static LemmatizerModel
LemmatizerME. train(String languageCode, ObjectStream<LemmaSample> samples, TrainingParameters params, LemmatizerFactory factory)
Starts a training of aLemmatizerModel
with the given parameters.Constructors in opennlp.tools.lemmatizer with parameters of type ObjectStream Constructor Description LemmaSampleEventStream(ObjectStream<LemmaSample> d, LemmatizerContextGenerator cg)
Creates a new event stream based on the specified data stream using aLemmatizerContextGenerator
.LemmaSampleSequenceStream(ObjectStream<LemmaSample> samples, LemmatizerContextGenerator contextGenerator)
LemmaSampleStream(ObjectStream<String> samples)
Initializes ainstance
. -
Uses of ObjectStream in opennlp.tools.ml
Methods in opennlp.tools.ml with parameters of type ObjectStream Modifier and Type Method Description DataIndexer
AbstractEventTrainer. getDataIndexer(ObjectStream<Event> events)
MaxentModel
AbstractEventTrainer. train(ObjectStream<Event> events)
MaxentModel
EventTrainer. train(ObjectStream<Event> events)
Trains aMaxentModel
for givenevents
. -
Uses of ObjectStream in opennlp.tools.ml.maxent
Classes in opennlp.tools.ml.maxent that implement ObjectStream Modifier and Type Class Description class
RealBasicEventStream
Class for real-valuedevents
as anevent stream
.Methods in opennlp.tools.ml.maxent with parameters of type ObjectStream Modifier and Type Method Description GISModel
GISTrainer. trainModel(ObjectStream<Event> eventStream)
Trains a model using the GIS algorithm, assuming 100 iterations and no cutoff.GISModel
GISTrainer. trainModel(ObjectStream<Event> eventStream, int iterations, int cutoff)
Trains a GIS model on the event in the specified event stream, using the specified number of iterations and the specified count cutoff.Constructors in opennlp.tools.ml.maxent with parameters of type ObjectStream Constructor Description RealBasicEventStream(ObjectStream<String> ds)
-
Uses of ObjectStream in opennlp.tools.ml.model
Subinterfaces of ObjectStream in opennlp.tools.ml.model Modifier and Type Interface Description interface
SequenceStream<S>
Interface for streams ofsequences
used to train sequence models.Classes in opennlp.tools.ml.model that implement ObjectStream Modifier and Type Class Description class
FileEventStream
Class for using a file ofevents
as anevent stream
.class
HashSumEventStream
A hash sum basedAbstractObjectStream
implementation.class
RealValueFileEventStream
Class for using a file of real-valuedevents
as anevent stream
.class
SequenceStreamEventStream
Class which turns aSequenceStream
into an event stream.Methods in opennlp.tools.ml.model with parameters of type ObjectStream Modifier and Type Method Description protected List<ComparableEvent>
AbstractDataIndexer. index(ObjectStream<Event> events, Map<String,Integer> predicateIndex)
Performs the data indexing.void
DataIndexer. index(ObjectStream<Event> eventStream)
Performs the data indexing.void
OnePassDataIndexer. index(ObjectStream<Event> eventStream)
Performs the data indexing.void
TwoPassDataIndexer. index(ObjectStream<Event> eventStream)
Performs the data indexing.Constructors in opennlp.tools.ml.model with parameters of type ObjectStream Constructor Description HashSumEventStream(ObjectStream<Event> eventStream)
-
Uses of ObjectStream in opennlp.tools.namefind
Classes in opennlp.tools.namefind that implement ObjectStream Modifier and Type Class Description class
NameFinderEventStream
Class for creating an event stream out of data files for training anTokenNameFinder
.class
NameSampleDataStream
TheNameSampleDataStream
class converts taggedstrings
provided by aDataStream
toNameSample
objects.class
NameSampleSequenceStream
ASequenceStream
implementation encapsulatingsamples
.class
NameSampleTypeFilter
Astream
which removesname samples
which do not have a certain type.Methods in opennlp.tools.namefind with parameters of type ObjectStream Modifier and Type Method Description void
TokenNameFinderCrossValidator. evaluate(ObjectStream<NameSample> samples, int nFolds)
Starts the evaluation.static TokenNameFinderModel
NameFinderME. train(String languageCode, String type, ObjectStream<NameSample> samples, TrainingParameters params, TokenNameFinderFactory factory)
Starts a training of aTokenNameFinderModel
with the given parameters. -
Uses of ObjectStream in opennlp.tools.parser
Classes in opennlp.tools.parser that implement ObjectStream Modifier and Type Class Description class
AbstractParserEventStream
Abstract class extended by parser event streams which perform tagging and chunking.class
ChunkSampleStream
class
ParseSampleStream
class
PosSampleStream
Methods in opennlp.tools.parser with parameters of type ObjectStream Modifier and Type Method Description static Dictionary
AbstractBottomUpParser. buildDictionary(ObjectStream<Parse> data, HeadRules rules, int cutoff)
Creates a n-gramDictionary
from the specified data stream usingHeadRules
and specified cut-off.static Dictionary
AbstractBottomUpParser. buildDictionary(ObjectStream<Parse> data, HeadRules rules, TrainingParameters params)
Creates a n-gramDictionary
from the specified data stream using the specified head rule and specified cut-off.void
ParserCrossValidator. evaluate(ObjectStream<Parse> samples, int nFolds)
Starts the evaluation.Constructors in opennlp.tools.parser with parameters of type ObjectStream Constructor Description AbstractParserEventStream(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype)
AbstractParserEventStream(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype, Dictionary dict)
ChunkSampleStream(ObjectStream<Parse> in)
Initializes ainstance
.ParseSampleStream(ObjectStream<String> in)
Initializes ainstance
.PosSampleStream(ObjectStream<Parse> in)
Initializes ainstance
. -
Uses of ObjectStream in opennlp.tools.parser.chunking
Classes in opennlp.tools.parser.chunking that implement ObjectStream Modifier and Type Class Description class
ParserEventStream
Wrapper class for one of fourshift-reduce parser
event streams.Methods in opennlp.tools.parser.chunking with parameters of type ObjectStream Modifier and Type Method Description static ParserModel
Parser. train(String languageCode, ObjectStream<Parse> parseSamples, HeadRules rules, TrainingParameters mlParams)
Starts a training of aParserModel
.Constructors in opennlp.tools.parser.chunking with parameters of type ObjectStream Constructor Description ParserEventStream(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype)
ParserEventStream(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype, Dictionary dict)
-
Uses of ObjectStream in opennlp.tools.parser.treeinsert
Classes in opennlp.tools.parser.treeinsert that implement ObjectStream Modifier and Type Class Description class
ParserEventStream
Wrapper class for one of fourbuilt-attach parser
event streams.Methods in opennlp.tools.parser.treeinsert with parameters of type ObjectStream Modifier and Type Method Description static ParserModel
Parser. train(String languageCode, ObjectStream<Parse> parseSamples, HeadRules rules, int iterations, int cutoff)
Starts a training of aParserModel
.static ParserModel
Parser. train(String languageCode, ObjectStream<Parse> parseSamples, HeadRules rules, TrainingParameters mlParams)
Starts a training of aParserModel
.Constructors in opennlp.tools.parser.treeinsert with parameters of type ObjectStream Constructor Description ParserEventStream(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype)
ParserEventStream(ObjectStream<Parse> d, HeadRules rules, ParserEventTypeEnum etype, Dictionary dict)
-
Uses of ObjectStream in opennlp.tools.postag
Classes in opennlp.tools.postag that implement ObjectStream Modifier and Type Class Description class
POSSampleEventStream
class
POSSampleSequenceStream
ASequenceStream
implementation encapsulatingsamples
.class
WordTagSampleStream
A stream filter which reads a sentence per line which contains words and tags inword_tag
format and outputs aPOSSample
objects.Methods in opennlp.tools.postag with parameters of type ObjectStream Modifier and Type Method Description static Dictionary
POSTaggerME. buildNGramDictionary(ObjectStream<POSSample> samples, int cutoff)
Constructs anGram dictionary
from anObjectStream
of samples.void
POSTaggerCrossValidator. evaluate(ObjectStream<POSSample> samples, int nFolds)
Starts the evaluation.static void
POSTaggerME. populatePOSDictionary(ObjectStream<POSSample> samples, MutableTagDictionary dict, int cutoff)
Populates aPOSDictionary
from anObjectStream
of samples.static POSModel
POSTaggerME. train(String languageCode, ObjectStream<POSSample> samples, TrainingParameters trainParams, POSTaggerFactory posFactory)
Constructors in opennlp.tools.postag with parameters of type ObjectStream Constructor Description POSSampleEventStream(ObjectStream<POSSample> samples)
Initializes the current instance with given samples and aDefaultPOSContextGenerator
.POSSampleEventStream(ObjectStream<POSSample> samples, POSContextGenerator cg)
Initializes the current instance with the given samples and aPOSContextGenerator
.POSSampleSequenceStream(ObjectStream<POSSample> psi)
POSSampleSequenceStream(ObjectStream<POSSample> psi, POSContextGenerator pcg)
WordTagSampleStream(ObjectStream<String> sentences)
Initializes aPOSSample
instance. -
Uses of ObjectStream in opennlp.tools.sentdetect
Classes in opennlp.tools.sentdetect that implement ObjectStream Modifier and Type Class Description class
EmptyLinePreprocessorStream
ObjectStream
to clean up empty lines for empty line separated document streams.
- Skips empty line at training data start
- Transforms multiple empty lines in a row into one
- Replaces white space lines with empty lines
- TODO: Terminates last document with empty line if it is missing
This stream should be used by the components that mark empty lines to mark document boundaries.class
SDEventStream
class
SentenceSampleStream
This class is a stream filter which reads a sentence by line samples from anObjectStream
and converts them intoSentenceSample
objects.Methods in opennlp.tools.sentdetect with parameters of type ObjectStream Modifier and Type Method Description void
SDCrossValidator. evaluate(ObjectStream<SentenceSample> samples, int nFolds)
Starts the evaluation.static SentenceModel
SentenceDetectorME. train(String languageCode, ObjectStream<SentenceSample> samples, boolean useTokenEnd, Dictionary abbreviations)
Deprecated.static SentenceModel
SentenceDetectorME. train(String languageCode, ObjectStream<SentenceSample> samples, boolean useTokenEnd, Dictionary abbreviations, TrainingParameters mlParams)
Deprecated.static SentenceModel
SentenceDetectorME. train(String languageCode, ObjectStream<SentenceSample> samples, SentenceDetectorFactory sdFactory, TrainingParameters mlParams)
Constructors in opennlp.tools.sentdetect with parameters of type ObjectStream Constructor Description EmptyLinePreprocessorStream(ObjectStream<String> in)
SDEventStream(ObjectStream<SentenceSample> samples, SDContextGenerator cg, EndOfSentenceScanner scanner)
Initializes the current instance.SentenceSampleStream(ObjectStream<String> sentences)
-
Uses of ObjectStream in opennlp.tools.tokenize
Classes in opennlp.tools.tokenize that implement ObjectStream Modifier and Type Class Description class
TokenizerStream
class
TokenSampleStream
This class is astream filter
which reads in string encoded samples and createssamples
out of them.class
TokSpanEventStream
class
WhitespaceTokenStream
This stream formatsObjectStream
ofsamples
into whitespace separated token strings.Methods in opennlp.tools.tokenize with parameters of type ObjectStream Modifier and Type Method Description void
TokenizerCrossValidator. evaluate(ObjectStream<TokenSample> samples, int nFolds)
Starts the evaluation.static TokenizerModel
TokenizerME. train(ObjectStream<TokenSample> samples, TokenizerFactory factory, TrainingParameters mlParams)
Trains a model for theTokenizerME
.Constructors in opennlp.tools.tokenize with parameters of type ObjectStream Constructor Description TokenizerStream(Tokenizer tokenizer, ObjectStream<String> input)
Initializes ainstance
.TokenSampleStream(ObjectStream<String> sentences)
Initializes ainstance
.TokenSampleStream(ObjectStream<String> samples, String separatorChars)
Initializes ainstance
.TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics)
Initializes a new event stream based on the data stream using aTokenContextGenerator
that relies on aDefaultTokenContextGenerator
.TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, Pattern alphaNumeric, TokenContextGenerator cg)
Initializes a new event stream based on the data stream using aTokenContextGenerator
.TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, TokenContextGenerator cg)
Initializes a new event stream based on the data stream using aTokenContextGenerator
.WhitespaceTokenStream(ObjectStream<TokenSample> tokens)
Initializes aWhitespaceTokenStream
. -
Uses of ObjectStream in opennlp.tools.util
Classes in opennlp.tools.util that implement ObjectStream Modifier and Type Class Description class
AbstractEventStream<T>
A baseObjectStream
implementation for events.class
AbstractObjectStream<T>
A baseObjectStream
implementation.class
CollectionObjectStream<E>
AnObjectStream
implementation that works on aCollection
ofCollectionObjectStream
as source for elements.class
EventTraceStream
class
FilterObjectStream<S,T>
Abstract base class for filteringstreams
.class
ParagraphStream
AFilterObjectStream
which merges text lines into paragraphs.class
PlainTextByLineStream
Reads a plain text file and returns each line as aString
object.Fields in opennlp.tools.util declared as ObjectStream Modifier and Type Field Description protected ObjectStream<S>
FilterObjectStream. samples
Methods in opennlp.tools.util that return ObjectStream Modifier and Type Method Description static <T> ObjectStream<T>
ObjectStreamUtils. concatenateObjectStream(Collection<ObjectStream<T>> streams)
Creates a single concatenatedObjectStream
from multiple individualstreams
with the same typeObjectStreamUtils
.static <T> ObjectStream<T>
ObjectStreamUtils. concatenateObjectStream(ObjectStream<T>... streams)
Creates a single concatenatedObjectStream
from multiple individualstreams
with the same type.static <T> ObjectStream<T>
ObjectStreamUtils. createObjectStream(Collection<T> collection)
Creates anObjectStream
form aCollection
.static <T> ObjectStream<T>
ObjectStreamUtils. createObjectStream(T... array)
Creates anObjectStream
form an array ofObjectStreamUtils
.Methods in opennlp.tools.util with parameters of type ObjectStream Modifier and Type Method Description static <T> ObjectStream<T>
ObjectStreamUtils. concatenateObjectStream(ObjectStream<T>... streams)
Creates a single concatenatedObjectStream
from multiple individualstreams
with the same type.Method parameters in opennlp.tools.util with type arguments of type ObjectStream Modifier and Type Method Description static <T> ObjectStream<T>
ObjectStreamUtils. concatenateObjectStream(Collection<ObjectStream<T>> streams)
Creates a single concatenatedObjectStream
from multiple individualstreams
with the same typeObjectStreamUtils
.Constructors in opennlp.tools.util with parameters of type ObjectStream Constructor Description AbstractEventStream(ObjectStream<T> samples)
Initializes anAbstractEventStream
with a sampleIterator
.AbstractObjectStream(ObjectStream<T> stream)
Initializes anAbstractObjectStream
.EventTraceStream(ObjectStream<Event> stream, Writer writer)
Initializes anEventTraceStream
.FilterObjectStream(ObjectStream<S> samples)
Initializes anFilterObjectStream
.ParagraphStream(ObjectStream<String> lineStream)
Initializes anFilterObjectStream
. -
Uses of ObjectStream in opennlp.tools.util.eval
Classes in opennlp.tools.util.eval that implement ObjectStream Modifier and Type Class Description static class
CrossValidationPartitioner.TrainingSampleStream<E>
TheCrossValidationPartitioner.TrainingSampleStream
which iterates over all training elements.Methods in opennlp.tools.util.eval that return ObjectStream Modifier and Type Method Description ObjectStream<E>
CrossValidationPartitioner.TrainingSampleStream. getTestSampleStream()
Retrieves theObjectStream
over the test/evaluations elements and poisons thisCrossValidationPartitioner.TrainingSampleStream
.Methods in opennlp.tools.util.eval with parameters of type ObjectStream Modifier and Type Method Description void
Evaluator. evaluate(ObjectStream<T> samples)
Reads allsample objects
and evaluates each instance via theEvaluator.evaluateSample(Object)
method.Constructors in opennlp.tools.util.eval with parameters of type ObjectStream Constructor Description CrossValidationPartitioner(ObjectStream<E> inElements, int numberOfPartitions)
InitializesCrossValidationPartitioner
instance.
-