Lines Matching refs:token
142 // token style names. correspond to css classes
144 * token style for a string literal
149 * token style for a keyword
154 * token style for a comment
159 * token style for a type
164 * token style for a literal value. e.g. 1, null, true.
169 * token style for a punctuation string.
174 * token style for plain text.
180 * token style for an sgml tag.
185 * token style for a markup declaration such as a DOCTYPE.
190 * token style for embedded source.
195 * token style for an sgml attribute name.
200 * token style for an sgml attribute value.
625 * The lexing function interprets the patterns to find token boundaries and
637 * language of the portion of the token in $1 after pattern executes.
639 * '(hello (world))', then that portion of the token will be passed to the
654 * match is considered a token with the same style.
656 * Context is applied to the last non-whitespace, non-comment token
722 var token = tokens[ti];
723 var style = styleCache[token];
730 var patternParts = shortcuts[token.charAt(0)];
732 match = token.match(patternParts[1]);
737 match = token.match(patternParts[1]);
755 if (!isEmbedded) { styleCache[token] = style; }
759 pos += token.length;
765 var embeddedSourceStart = token.indexOf(embeddedSource);
770 // entire token, so we catch the right context in match[2].
771 embeddedSourceEnd = token.length - match[2].length;
778 token.substring(0, embeddedSourceStart),
789 token.substring(embeddedSourceEnd),