211c638d81d382517d196ad47565e0d85012c927 |
|
19-Feb-2017 |
klemens <ka7@github.com> |
spelling fixes |
8b1a9a4d63b0abccdf7cb1acb8359d5396dd657b |
|
09-May-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Changed fts_tokenizer_next/final() to return error string.
The current tokenizers can't fail, but if we're doing tokenization via
external services they could fail. |
16dd1fd16f0c6dbd4a057327370b432684e301ec |
|
09-May-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Added fts_tokenizer_final() as a convenience wrapper. |
2bb1ef0b669901fb91ff961e7fb074439ef769ab |
|
09-May-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Minor code cleanups |
f5c0d5cada4da23a167c38426d0c481a3e1d5583 |
|
09-May-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Removed tokenizer name macros from fts-tokenizer.h
The tokenizers can be directly accessed via their class structs. |
2730605833442b5ddcb261f90b8375fc98201e35 |
|
09-May-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Added fts_tokenizer_reset() |
3dc5a231160859c9627157dc53a94d5e4494fe9f |
|
09-May-2015 |
Teemu Huovila <teemu.huovila@dovecot.fi> |
fts: Change tokenizer API to be able to return errors
Modify fts_tokenizer_next() to return integer status codes. It returns
1 if a token was returned in *token_r, 0 if more input is needed and -1
on error. |
4ef1f9f3293965734e6e3c38c191ceb2246a721f |
|
09-May-2015 |
Teemu Huovila <teemu.huovila@dovecot.fi> |
fts: Create tokenizers differently
Create tokenizers earlier. Create separate tokenizers for search
and indexing. Enable configuration of tokenizers. Add some helpers
in fts-tokenizer.h api. Change tokenizer unit tests to match
those changes.
lib-fts: Refactor lib-fts settings a bit
Turned address tokenizer settings into "boolean" values. Changed
have_parent to "no_parent" and added "search" setting. Added
documentation in fts-tokenizer.h. Change unit tests accordingly. |
c865b0e9c65fd77f7b2ab6f8616d3def5501ecb3 |
|
20-Apr-2015 |
Timo Sirainen <tss@iki.fi> |
Initial import for lib-fts.
Parts of what this code does was already implemented internally by
fts-lucene. lib-fts is intended to be usable for all the FTS backends. The
APIs are still going to change a bit, but hopefully not after v2.2.17
release.
Mostly written by Teemu Huovila. |