Searched defs:tokens (Results 1 - 1 of 1) sorted by relevance

/pkg/src/modules/
H A Dquery_parser.py55 # These are the types of tokens that the lexer can produce.
56 tokens = ("FTERM", "TERM", "LPAREN", "RPAREN", "AND", "OR", "QUOTE1", variable in class:QueryLexer
66 # This rule causes spaces to break tokens, but the space itself is not
75 # tokens.
181 shows the user exactly which tokens are produced from the input
193 """This class defines the parser which converts a stream of tokens into
197 # Use the same set of tokens as the lexer.
198 tokens = QueryLexer.tokens variable in class:QueryParser
200 # Define the precendence and associativity of certain tokens t
[all...]

Completed in 11 milliseconds