org.apache.lucene.analysis
Class TokenStream
public abstract class TokenStream
A TokenStream enumerates the sequence of tokens, either from
fields of a document or from query text.
This is an abstract class. Concrete subclasses are:
Tokenizer
, a TokenStream
whose input is a Reader; and
TokenFilter
, a TokenStream
whose input is another TokenStream.
void | close() - Releases resources associated with this stream.
|
abstract Token | next() - Returns the next token in the stream, or null at EOS.
|
close
public void close()
throws IOException
Releases resources associated with this stream.
next
public abstract Token next()
throws IOException
Returns the next token in the stream, or null at EOS.
Copyright © 2000-2007 Apache Software Foundation. All Rights Reserved.