Lines Matching refs:token
219 # Each line begins with a urllib quoted search token. It's followed by
224 # matched the token. It's separated from its sublist by a '#'. The
225 # next token (579) is the fmri id. The subsequent comma separated
227 # that token.
299 """Pulls the token out of a line from a main dictionary file.
309 def transform_main_dict_line(token, entries):
310 """Paired with parse_main_dict_line above. Transforms a token
314 The "token" parameter is the token whose index line is being
318 It contains information about where and how "token" was seen in
325 res = "{0}".format(quote(str(token)))
576 token, offset = line.split(" ")
577 if token[0] == "1":
578 token = unquote(token[1:])
580 token = token[1:]
582 self._dict[token] = offset