History log of /dovecot/src/lib-fts/fts-tokenizer.h
Revision Date Author Comments Expand
211c638d81d382517d196ad47565e0d85012c927 19-Feb-2017 klemens <ka7@github.com>

spelling fixes

/dovecot/NEWS /dovecot/doc/example-config/conf.d/auth-system.conf.ext /dovecot/doc/example-config/dovecot-sql.conf.ext /dovecot/doc/man/doveadm-exec.1.in /dovecot/doc/securecoding.txt /dovecot/m4/dovecot.m4 /dovecot/m4/endian.m4 /dovecot/src/auth/password-scheme.h /dovecot/src/config/config-filter.c /dovecot/src/doveadm/client-connection-http.c /dovecot/src/imap-urlauth/imap-urlauth.c /dovecot/src/imap/cmd-append.c /dovecot/src/imap/cmd-thread.c /dovecot/src/imap/main.c /dovecot/src/lib-dcrypt/ostream-encrypt.c fts-tokenizer-generic.c fts-tokenizer.h /dovecot/src/lib-http/http-client-queue.c /dovecot/src/lib-imap/imap-base-subject.c /dovecot/src/lib-index/mail-cache.c /dovecot/src/lib-mail/message-part-data.h /dovecot/src/lib-program-client/program-client-remote.c /dovecot/src/lib-sasl/dsasl-client.h /dovecot/src/lib-ssl-iostream/istream-openssl.c /dovecot/src/lib-storage/index/index-sort-string.c /dovecot/src/lib-storage/index/maildir/maildir-storage.c /dovecot/src/lib-storage/index/maildir/maildir-uidlist.c /dovecot/src/lib-storage/list/mailbox-list-fs-iter.c /dovecot/src/lib-storage/mailbox-attribute.h /dovecot/src/lib/fdatasync-path.c /dovecot/src/lib/sha1.h /dovecot/src/lib/sha3.c /dovecot/src/lib/test-data-stack.c /dovecot/src/log/log-connection.c
8b1a9a4d63b0abccdf7cb1acb8359d5396dd657b 09-May-2015 Timo Sirainen <tss@iki.fi>

lib-fts: Changed fts_tokenizer_next/final() to return error string. The current tokenizers can't fail, but if we're doing tokenization via external services they could fail.

16dd1fd16f0c6dbd4a057327370b432684e301ec 09-May-2015 Timo Sirainen <tss@iki.fi>

lib-fts: Added fts_tokenizer_final() as a convenience wrapper.

2bb1ef0b669901fb91ff961e7fb074439ef769ab 09-May-2015 Timo Sirainen <tss@iki.fi>

lib-fts: Minor code cleanups

f5c0d5cada4da23a167c38426d0c481a3e1d5583 09-May-2015 Timo Sirainen <tss@iki.fi>

lib-fts: Removed tokenizer name macros from fts-tokenizer.h The tokenizers can be directly accessed via their class structs.

2730605833442b5ddcb261f90b8375fc98201e35 09-May-2015 Timo Sirainen <tss@iki.fi>

lib-fts: Added fts_tokenizer_reset()

3dc5a231160859c9627157dc53a94d5e4494fe9f 09-May-2015 Teemu Huovila <teemu.huovila@dovecot.fi>

fts: Change tokenizer API to be able to return errors Modify fts_tokenizer_next() to return integer status codes. It returns 1 if a token was returned in *token_r, 0 if more input is needed and -1 on error.

4ef1f9f3293965734e6e3c38c191ceb2246a721f 09-May-2015 Teemu Huovila <teemu.huovila@dovecot.fi>

fts: Create tokenizers differently Create tokenizers earlier. Create separate tokenizers for search and indexing. Enable configuration of tokenizers. Add some helpers in fts-tokenizer.h api. Change tokenizer unit tests to match those changes. lib-fts: Refactor lib-fts settings a bit Turned address tokenizer settings into "boolean" values. Changed have_parent to "no_parent" and added "search" setting. Added documentation in fts-tokenizer.h. Change unit tests accordingly.

c865b0e9c65fd77f7b2ab6f8616d3def5501ecb3 20-Apr-2015 Timo Sirainen <tss@iki.fi>

Initial import for lib-fts. Parts of what this code does was already implemented internally by fts-lucene. lib-fts is intended to be usable for all the FTS backends. The APIs are still going to change a bit, but hopefully not after v2.2.17 release. Mostly written by Teemu Huovila.