fts: Don't reindex FTS mails if .cache file is deleted This means that if fts is enabled, "doveadm index" no longer adds mails to dovecot.index.cache if it's deleted. However, it was rarely used for that purpose. More likely due to a corrupted cache file all the mails were unnecessarily being opened and reindexed.

fts: Contexts are now required or checked Satisfied static analyzer

Updated copyright notices to include the year 2018.

global: Use mail_set_critical() and mailbox_set_critical() if possible Replace calls to mail_storage_set_critical() with mail_set_critical() or mailbox_set_critical() in places where mailbox or mail are easily available.

lib-storage: Add reason to mailbox.transaction_begin()

fts: Log when indexing requires adding more mails to index than requested This should mainly happen when FTS indexing is requested for a virtual mailbox.

fts: Do not attempt to deinitialize backend if it's not set If FTS backend initialization fails or does not happen, flist->backend might end up being NULL, and attempt to deinitialize NULL won't end well.

fts: Initialize fts after namespaces have been added This way paths are correctly set, and fts indexes are written to correct place. This affects mbox with lucene. Fixes Panic: file mailbox-list.c: line 1158 (mailbox_list_try_mkdir_root): assertion failed (strncmp(root_dir, path, strlen(root_dir)) == 0)

fts: Remove indentation from fts_mailbox_list_created Preparation for next commit

fts: Fix crash using fts_autoexpunge_exclude = \Special-use crash It crashed whenever seeing a mailbox that didn't have any special-use flags.

fts: Use mailbox_list_created hook Otherwise the deinit hook might get lost and fts would not be deinitialized. Reverts 11f12ca1c97583b551a4286fa6cd1ab33aa67680 which seems to have been unnecessary Fixes indexer-worker signal 11 crash

Updated copyright notices to include the year 2017.

plugins/fts - make storage errors more informative There are 3 different ways to fail ending a transaction (one of which is itself just a record that something now unknown previously failed). Identify which one in the logs. Signed-off-by: Phil Carmody <phil@dovecot.fi>

fts: Fixed fts_autoindex when no fts_autoindex_exclude settings existed.

fts plugin: Added fts_autoindex_exclude settings. fts_autoindex_exclude setting specifies special-use flag or mailbox name to be excluded. - If a name starts with '\', it's treated as a case-insensitive special-use flag. - Multiple names can be specified with serial numbers, for example: plugin { fts_autoindex_exclude = \Junk fts_autoindex_exclude2 = \Trash fts_autoindex_exclude3 = DUMPSTER fts_autoindex_exclude4 = New folder }

global: unsigned int:1 -> bool:1 perl -i -pe 's/unsigned int ([^,:;]+):1;/bool $1:1;/' **/*.[ch]

lib-storage: add no_fts in struct mail_search_arg When flag is set, FTS will not be performed. fts plugin: handle no_fts flag No fts will be performed once flag is set. Original patch from Timo Sirainen <timo.sirainen@dovecot.fi>

virtual: Moved virtual_mailbox_vfuncs to lib-storage. This allows implementing other virtual storage backends.

global: Use mail_user_plugin_getenv_bool() wherever possible New API is used to check boolean setting OR exsitence of an env variable.

fts: Empty "fts" setting should be same as nonexistent.

global: freshen copyright git ls-files | xargs perl -p -i -e 's/(\d+)-201[0-5]/$1-2016/g;s/ (201[0-5]) Dovecot/ $1-2016 Dovecot/'

Remove now-unnecessary direct stdlib.h #includes.

fts: Send session ID to indexer and indexer-worker for logging purposes.

fts: lib-fts search arg expansion wasn't done for non-TEXT/BODY searches when fts_enforced=no

fts: If mail indexing fails, don't log a "BUG: Unknown internal error"

fts: If precaching fails, stop precaching the rest of the mails. If there are a lot of mails to be precached, this could mean that the precaching is attempted for a long time and every one of them fails the same way.

fts: If last-uid lookup fails, return "Internal error" instead of "BUG" to client.

fts: Fixed fts_enforced=yes when it has to wait for indexing to finish

fts: Added fts_enforced setting to disable fallbacking to slow search on errors.

fts: Create tokenizers differently Create tokenizers earlier. Create separate tokenizers for search and indexing. Enable configuration of tokenizers. Add some helpers in fts-tokenizer.h api. Change tokenizer unit tests to match those changes. lib-fts: Refactor lib-fts settings a bit Turned address tokenizer settings into "boolean" values. Changed have_parent to "no_parent" and added "search" setting. Added documentation in fts-tokenizer.h. Change unit tests accordingly.

fts: Initialize fts backend in mail_namespaces_added(), not in mailbox_list_created() This way the storage has already been created by the time fts initialization starts, which simplifies things.

fts: Added FTS_BACKEND_FLAG_TOKENIZED_INPUT, which is implemented via lib-fts.

fts: Added missing error logging/setting.

global: freshen copyright Robomatically: git ls-files | xargs perl -p -i -e 's/(\d+)-201[0-4]/$1-2015/g;s/ (201[0-4]) Dovecot/ $1-2015 Dovecot/' Happy 2015 everyone! Signed-off-by: Phil Carmody <phil@dovecot.fi>

fts: fts_no_autofuzzy shouldn't disable fuzzying when FUZZY search parameter is set.

fts: Added fts_no_autofuzzy setting to require exact matches for found results. This is done by using the FTS search results as only filters on which the regular non-FTS search is done.

Updated copyright notices to include year 2014.

fts: Renamed fts_autoindex_on_save to fts_autoindex

fts: Added plugin { fts_autoindex_on_save } setting. When enabled and a mail is saved/copied, the indexer process is requested to index the changed mailbox. fts_autoindex_max_recent_msgs setting can also be used to skip indexing mailboxes that have too many \Recent messages (implying that the mailbox is never actually accessed). This corresponds to doveadm index -n parameter.

Oops :) Update copyrights to 2013 without breaking all .c files.

Updated copyright notices to include year 2013.