Searched refs:subTokens (Results 1 - 1 of 1) sorted by relevance

/opengrok-jel/src/org/opensolaris/opengrok/analysis/
H A DList2TokenStream.java33 private String[] subTokens; field in class:List2TokenStream
48 if (subTokens == null || subTokens.length == si) {
54 subTokens = tok.split("[^a-z0-9A-Z_]+");
56 subTokens = null;
63 if (si < subTokens.length) {
65 termAtt.append(subTokens[si++]);

Completed in 6 milliseconds