|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||
| Packages that use Token | |
| org.apache.lucene.analysis.standard | A grammar-based tokenizer constructed with JavaCC. |
| Uses of Token in org.apache.lucene.analysis.standard |
| Fields in org.apache.lucene.analysis.standard declared as Token | |
Token |
StandardTokenizer.token
|
Token |
StandardTokenizer.jj_nt
|
Token |
ParseException.currentToken
This is the last token that has been consumed successfully. |
Token |
Token.next
A reference to the next regular (non-special) token from the input stream. |
Token |
Token.specialToken
This field is used to access special tokens that occur prior to this token, but after the immediately preceding regular (non-special) token. |
| Methods in org.apache.lucene.analysis.standard that return Token | |
Token |
StandardTokenizer.getNextToken()
|
Token |
StandardTokenizer.getToken(int index)
|
Token |
StandardTokenizerTokenManager.getNextToken()
|
static Token |
Token.newToken(int ofKind)
Returns a new Token object, by default. |
| Constructors in org.apache.lucene.analysis.standard with parameters of type Token | |
ParseException(Token currentTokenVal,
int[][] expectedTokenSequencesVal,
String[] tokenImageVal)
This constructor is used by the method "generateParseException" in the generated parser. |
|
|
||||||||||
| PREV NEXT | FRAMES NO FRAMES | |||||||||