Lines Matching defs:token
119 * push back the lookahead token and restore the lookahead token
120 * to the previous token.
128 * retrieve the next token, placing the token value in the lookahead
140 * match one of the token values in the given set of key words
141 * token is assumed to be of type TT_WORD, and the set is assumed
155 * match a token with TT_TYPE=type, and the token value is a given sequence
158 private void match(int ttype, String token)
160 if (lookahead.ttype == ttype && lookahead.sval.compareTo(token) == 0) {
163 throw new SyntaxException(st.lineno(), new Token(ttype, token),
169 * match a token with TT_TYPE=type
180 * match a token with TT_TYPE=char, where the token value is the given char.
193 * match a token with TT_TYPE='"', where the token value is a sequence
201 * match a TT_NUMBER token that matches a parsed number value
208 * match a TT_WORD token that matches an arbitrary, not quoted token.
215 * match a TT_WORD token that matches the given string
217 private void match(String token) throws ParserException, IOException {
218 match(StreamTokenizer.TT_WORD, token);