lib-storage: Add mail_search_arg_one_deinit()

lib-storage: Fix searching when search query has invalid keywords. For example "SEARCH KEYWORD ]" was returning all mails instead of nothing.

Partially implemented IMAP SEARCH=X-MIMEPART capability. This capability is currently Dovecot-specific.

lib-storage: Renamed MAIL_SEARCH_ARG_FLAG_USE_TZ to _FLAG_UTC_TIMES

lib-storage: Updated MAIL_SEARCH_ARG_FLAG_USE_TZ comment.

global: Require comparisons to be strict boolean expressions * No implicit integer -> boolean or pointer -> boolean conversions * !expr can be used only if expr is boolean type These were checked with a patched clang. It found various actual bugs, which were fixed by the previous commits.

global: unsigned int:1 -> bool:1 perl -i -pe 's/unsigned int ([^,:;]+):1;/bool $1:1;/' **/*.[ch]

lib-storage: add no_fts in struct mail_search_arg When flag is set, FTS will not be performed. fts plugin: handle no_fts flag No fts will be performed once flag is set. Original patch from Timo Sirainen <timo.sirainen@dovecot.fi>

lib-storage: Made mail_search_arg_[one_]equals() public.

fts: Avoid expanding mail_search_args multiple times (for optimization & crash-avoidance) Primarily this fixes the crash: index-search-result.c: line 132 (index_search_result_update_flags): assertion failed: (result->search_args->args == &search_arg) It could be triggered by: a search return (update) body body seen b store 1 +flags \seen c store 1 -flags \seen

lib-storage: Added mail_search_args_to_cmdline() This isn't entirely correct yet, but it's only going to be used for debugging for now.

lib-storage: Added mail_search_init/deinit_arg() For forcibly initializing/deinitializing search args.

lib-storage: Cleanup - separate search arg values that are set by mail_search_init()

lib-storage: mail_search_arg_dup() is now a public function.

lib-storage: Added mail_search_args_to_imap() Useful for writing IMAP SEARCH parameters from struct mail_search_arg.

lib-storage: Added "oldestonly" search arg to stop searching after the first non-match. This parameter works only for doveadm search queries. It's not fully exact currently, because if mailbox.search_next_update_seq() skips over non-matching messages we don't stop if the next message matches. So this parameter is mainly useful for optimization of commands like: doveadm expunge -u user@domain mailbox inbox savedsince 30d oldestonly Where the timestamps should be ascending all the time anyway and there's no point in continuing to search for more mails after the first timestamp is too high.

lib-storage: Added X-REAL-UID search parameter.

Removed CONTEXT_TYPE_SAFETY macro and reimplemented its functionality better. gcc/clang now gives a compiler error in many places if callback isn't exactly what was expected. It's also now much easier to add more of these checks.

Marked functions parameters that are allowed to be NULL. Some APIs were also changed. The non-obvious APIs where NULL parameter was changed to "" are master_service_init() and auth_master_user_list_init(). These checks can currently be enabled only on a patched clang: http://llvm.org/bugs/show_bug.cgi?id=6786

lib-storage: Added FUZZY search key that adds fuzzy=TRUE to its child args.

lib-storage: Renamed mail_search_arg.not to match_not. C++ compilers don't like the "not".

fts: Removed the separation of "substring" and "fast" fts backends and search keys. No one wants to use two separate backends and it just makes the code more difficult.

lib-storage: Added mail prefetching support for searching.

Changed header/body searching to do search key charset translation earlier. This cleans up and simplifies error handling.

lib-storage: Fixes/optimizations to SEARCH_MAILBOX*. --HG-- branch : HEAD

lib-storage: Added support for searching with mailbox GUID. --HG-- branch : HEAD

lib-storage: Added mail_search_args_match_mailbox() --HG-- branch : HEAD

lib-storage: Added MAILBOX_GLOB search arg. Query builders now use it instead of MAILBOX. --HG-- branch : HEAD

lib-storage: Added support for searching save date. --HG-- branch : HEAD

Added mail_search_args_dup(). --HG-- branch : HEAD

mail_search_args_[de]init() calls stack now. Last unref is still allowed without deiniting. --HG-- branch : HEAD

mail-storage API: Added some function description comments. --HG-- branch : HEAD

Added mail_search_args_equal(). --HG-- branch : HEAD

Added the concept of Global UIDs that are preserved across copies. They can be fetched, searched and specified for the save API. dbox format supports them correctly, but with maildir the base filename is used so maildir_copy_preserve_filename=yes is required to preserve GUIDs when copying. --HG-- branch : HEAD

FETCH X-MAILBOX and SEARCH X-MAILBOX can be used with virtual mailboxes to find out the original mailbox. In non-virtual mailboxes they always just use the current mailbox name. --HG-- branch : HEAD

Added non-optimized support for SEARCH INTHREAD. --HG-- branch : HEAD

Search code cleanups and minor optimizations. --HG-- branch : HEAD

SEARCH UPDATE: Convert seqsets in saved results to uidsets so that they can be matched correctly later if messages are expunged. --HG-- branch : HEAD

Make mail_search_args an independent structure that can be used for multiple separate searches. --HG-- branch : HEAD

Implemented WITHIN extension. --HG-- branch : HEAD

Moved IMAP messageset handling to lib-imap/ and searching to lib-storage/. Rewrote messageset handling to use struct seq_range instead. --HG-- branch : HEAD

Added support for SEARCH_UIDSET. --HG-- branch : HEAD

Initial CONDSTORE support. --HG-- branch : HEAD

Moved IMAP messageset handling to lib-imap/ and searching to lib-storage/. Rewrote messageset handling to use struct seq_range instead. --HG-- branch : HEAD

Added support for SEARCH_UIDSET. --HG-- branch : HEAD

SEARCH SUBJECT now changes LWSP to spaces to match ENVELOPE's subject field. --HG-- branch : HEAD

SEARCH SUBJECT now changes LWSP to spaces to match ENVELOPE's subject field. --HG-- branch : HEAD

SEARCH_KEYWORDS now uses struct mail_keywords instead of a string array. --HG-- branch : HEAD

Replaced SEARCH_<flag> with a generic SEARCH_FLAGS. Use value.size for SEARCH_LARGER and SEARCH_SMALLER and give an error if it's not a valid number. --HG-- branch : HEAD

Simplify search arguments immediately when calling mailbox_search_init(). --HG-- branch : HEAD

Changed .h ifdef/defines to use <NAME>_H format. --HG-- branch : HEAD

Parse search dates already in IMAP code. --HG-- branch : HEAD

Added support for X-BODY-FAST and X-TEXT-FAST SEARCH arguments. FTS plugin now allows loading two backends: exact and fast. Fast backend (Lucene) can be used to optimize only those searches, while exact backend (Squat) can be used to optimize normal BODY and TEXT searches as well. --HG-- branch : HEAD

Type safe callbacks weren't as easy as I thought. Only callback(void *context) can be handled generically. Others can be handled specially, but only if all the parameters are pointers, otherwise eg. int parameter can be replaced with long without compiler giving any warnings. --HG-- branch : HEAD

Added context parameter type safety checks for most callback APIs. --HG-- branch : HEAD

Added "bool" type and changed all ints that were used as booleans to bool. --HG-- branch : HEAD

importing new index code. mbox still broken. --HG-- branch : HEAD

Some optimizations to messageset handling in search. --HG-- branch : HEAD

Index cache file rewrite. It's not finished yet and mbox support is completely broken. But it's getting difficult to maintain outside cvs :) --HG-- branch : HEAD

Several search fixes, mostly related to matching multiple conditions. --HG-- branch : HEAD

mail-storage.h interface changes, affects pretty much everything. FETCH, SEARCH, SORT and THREAD handling were pretty much moved from lib-storage/ to imap/ so adding non-index storages would be much easier now. Also POP3 server can now be easily implemented with lib-storage. Not too well tested, and at least one major problem: partial fetching is _slow_. --HG-- branch : HEAD

Naming change for function typedefs. --HG-- branch : HEAD

Naming style changes, finally got tired of most of the typedefs. Also the previous enum -> macro change reverted so that we don't use the highest bit anymore, that's incompatible with old indexes so they will be rebuilt. --HG-- branch : HEAD

SEARCH CHARSET support. Currently we do it through iconv() and only ASCII characters are compared case-insensitively. --HG-- branch : HEAD

ImapArgList changed from linked list to array. easier to handle that way. --HG-- branch : HEAD

Dropped sent_time and alignment from MailIndexRecord. SEARCH can now use cached ENVELOPE data to search FROM, TO, CC, BCC, SUBJECT, HEADER MESSAGE-ID and HEADER IN-REPLY-TO. They're never cached anymore now. Also SEARCH SENT* had to be changed to use ENVELOPE (or fallback to Date-header parsing) because sent_time was removed. --HG-- branch : HEAD

s/user_data/context/ and some s/Data/Context/ --HG-- branch : HEAD

Initial revision --HG-- branch : HEAD