org.apache.lucene.analysis
Class Tokenizer

java.lang.Object
  |
  +--org.apache.lucene.analysis.TokenStream
        |
        +--org.apache.lucene.analysis.Tokenizer

Direct Known Subclasses:

CharTokenizer, StandardTokenizer

public abstract class Tokenizer

extends TokenStream

A Tokenizer is a TokenStream whose input is a Reader.

This is an abstract class.

Field Summary

protected Reader

input The text source for this Tokenizer.

Constructor Summary

Tokenizer()

Method Summary

void	close() By default, closes the input Reader.

Methods inherited from class org.apache.lucene.analysis.TokenStream

next

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

input

protected Reader input

The text source for this Tokenizer.

Constructor Detail

Tokenizer

public Tokenizer()

Method Detail

close

public void close()
           throws IOException

By default, closes the input Reader.

Overrides:

close in class TokenStream