Package org.apache.lucene.analysis.standard

A grammar-based tokenizer constructed with JavaCC.

See:
          Description

Interface Summary
CharStream This interface describes a character stream that maintains line and column number positions of the characters.
StandardTokenizerConstants  
 

Class Summary
FastCharStream An efficient implementation of JavaCC's CharStream interface.
StandardAnalyzer Filters StandardTokenizer with StandardFilter, LowerCaseFilter and StopFilter.
StandardFilter Normalizes tokens extracted with StandardTokenizer.
StandardTokenizer A grammar-based tokenizer constructed with JavaCC.
StandardTokenizerTokenManager  
Token Describes the input token stream.
 

Exception Summary
ParseException This exception is thrown when parse errors are encountered.
 

Error Summary
TokenMgrError  
 

Package org.apache.lucene.analysis.standard Description

A grammar-based tokenizer constructed with JavaCC.

Note that JavaCC defines lots of public, classes, methods and fields that do not need to be public.  These clutter the documentation.  Sorry.

Note that because JavaCC defines a class named Token, org.apache.lucene.analysis.Token must always be fully qualified in sourced code in this package.



Copyright © 2000-2002 Apache Software Foundation. All Rights Reserved.