lib-storage: Replace mail_transaction_commit_changes.changed with changes_mask This allows better finding out what changed in the transaction.

lib-storage: Include mail-index.h from mail-storage.h This makes it a bit more acceptable to use mail-index.h API, without having to go through the lib-storage layer. This is also needed by the next patch to avoid duplicating the same enum in both lib-index and lib-storage layer.

lib-storage: Set keyword based on attachment presence when saving If attachment is detected, use $HasAttachment, if not use $HasNoAttachment

lib-storage: Add mail.event

lib-storage: Created mailbox_alloc_delivery(), which initializes a mailbox for message delivery.

lib-storage: Implemented new mailbox flag MAILBOX_FLAG_AUTO_SUBSCRIBE. When this flag is enabled, the mailbox is implicitly subscribed to when it is created automatically.

lib-storage: Implemented new mailbox flag MAILBOX_FLAG_AUTO_CREATE. When this flag is enabled, the mailbox is automatically created when it is opened (if possible and appropriate).

lib-storage: Remove obsolete mailbox_save_set_dest_mail()

lib-storage: Add reason to mailbox_transaction_begin() Remove mailbox_transaction_set_reason().

lib-storage: Add mailbox_transaction_set_reason()

lib-storage: Add mailbox_set_reason() Use it to log a debug message when mailbox is being opened.

lib-storage: Add mail_storage_get_last_internal_error() This returns the error given to mail_storage_set_critical().

lib-storage: Add mail.access_type

lib-storage: Add mail.mail_stream_opened and .mail_metadata_accessed These allow determining after mail_*() calls how efficiently they were performed.

lib-storage: Clarify what MAIL_LOOKUP_ABORT_READ_MAIL means. It should maybe even be renamed to something clearer.

lib-storage: Add mailbox_save_get_dest_mail() This marks mailbox_save_set_dest_mail deprecated. It's not efficient to use since it frees the already-created dest_mail.

lib-storage: Add struct mailbox_status.flags This is similar to permanent_flags, except it tells which flags can be changed at all in the session. Mainly it allows plugins to make changes to IMAP's untagged FLAGS reply.

lib-storage: Update mail_get_headers() API comment The API was changed by 990d55ce3fc461eeacce3ef830b1c5dde5c3f150

lib-storage: Add support for storing "mail stubs" These allow treating a storage backend as a cache where the mail bodies don't necessarily exist.

lib-storage: Fix doveadm search query parsing to use timezones correctly. When using a date string, e.g. "senton 25-Mar-2007" it should work the same way as IMAP does and show all mails whose sent date is on 25th, ignoring whatever the timezone is in the Date header (or in case of received/saved-date it would be using the timestamps in server's local timezone, again just like IMAP). When search with an exact UNIX timestamp or a time interval (e.g. "3 days"), it should be using UTC times for doing all comparisons.

lib-storage: rename get_real_mail to get_backend_mail Also change the function signature so that it returns an int to indicate success or failure.

lib-storage: remove set_cache_corrupted_reason from mail_vfuncs Change set_cache_corrupted signature to what set_cache_corrupted_reason used to be.

lib-storage: remove obsolete MAIL_FETCH_UIDL_FILE_NAME

lib-storage: Added mail_get_stream_because() and mail_get_hdr_stream_because() With mail_debug=yes each mail access is now logged with a reason. This can be helpful when figuring out why something isn't in dovecot.index.cache.

global: unsigned int:1 -> bool:1 perl -i -pe 's/unsigned int ([^,:;]+):1;/bool $1:1;/' **/*.[ch]

lib-storage: Added MAILBOX_FLAG_DELETE_UNSAFE

lib-storage: Added mail_set_cache_corrupted_reason()

dsync: Don't restrict what mailbox names can be created (except basic sanity checks) The mailbox names already exist on the other side, so we don't want to add arbitrary limits to them.

Added mailbox { autoexpunge } setting. This can be used to automatically expunge mails from specified mailboxes after they're old enough. The expunges are done when the user is being deinitialized. mailbox_list_index=yes should be enabled to have the best performance with this setting. Example: namespace inbox { mailbox Spam { auto = create special_use = \Junk autoexpunge = 30d } }

lib-storage/notify: Added MAILBOX_TRANSACTION_FLAG_NO_NOTIFY This flag could potentially apply for other things as well, not just notify plugin. In general anything that could do external notifications shouldn't do anything for transactions with this flag.

lib-storage: Renamed MAIL_FETCH_UIDL_FILE_NAME to MAIL_FETCH_STORAGE_ID. Keep MAIL_FETCH_UIDL_FILE_NAME for backwards compatibility for now.

lib-storage: Added MAILBOX_METADATA_PHYSICAL_SIZE If backend always uses the same virtual and physical sizes, this is implemented via the MAILBOX_METADATA_VIRTUAL_SIZE code. Otherwise it searches all the messages and sums up their physical sizes.

mail-storage: Moved mailbox attributes API to separate module.

lib-storage: Added mail_parse_human_timestamp() to parse human-writable timestamps. This isn't really the ideal location for the function, but since it uses both lib-settings and lib-imap, there's not any good location for it that I can think of..

lib-storage: Added MAIL_FETCH_BODY_SNIPPET.

lib-storage: Small comment update

lib-storage: Added mail_storage_last_error_push/pop()

lib-storage: mailbox_settings_find() now takes namespace parameter instead of user. This fixes an infinite (until stack gets full) loop with shared mailboxes: mail_namespace_find() -> mailbox_list_get_storage() -> mailbox_settings_find() -> mail_namespace_find() -> ...

lib-storage: Replaced mail_get_real_mail() with mail_get_backend_mail() that can fail. For now the mail_get_real_mail() can still be used for backwards compatibility.

imap: Don't send [NOMODSEQ] on SELECT/EXAMINE reply when condstore hasn't been enabled yet. This is definitely the better behavior and was also clearly intended by the CONDSTORE RFC, although with some mixed language.

dsync: Support syncing storages with 128bit GUIDs <-> string GUIDs.

lib-storage: API comment update

lib-storage: Added a separate prefix for server metadata that aren't deleted with INBOX.

Moved "INBOX can't be deleted" check from lib-storage to IMAP-specific code. Especially "doveadm backup" should be able to delete the INBOX if needed.

lib-storage: Added support for multiple storages per namespace.

lib-storage: Added mailbox_status.have_save_guids.

lib-storage: mailbox_get_status() no longer forces mailbox to be synced. This fixes copying messages with keywords to a virtual mailbox, where syncing happened too late and caused assert-crash (status was only used to lookup list of keywords). The crash could have been solved another way too, but it's probably better if automatic syncing isn't always performed. doveadm index -n parameter handling also relies on this behavior.

lib-storage: Mailbox attributes can now be accessed via istreams. The idea is to use istreams for larger values.

lib-storage: Allow mailbox_attribute_set() to also unset values. This allows giving the last_change timestamp also when unsetting.

lib-storage: mailbox_attribute_set() now uses struct mail_attribute_value. This allows settig the last_change value, as well as using streams and setting other flags in future.

lib-storage: Changed mailbox_attribute_get/set() APIs to have a transaction and update index. The _get() doesn't currently actually use the transaction. It was mainly put there for future use where it could be useful. It's also possible that _iter() will need a transaction also. For now these decisions seem good enough.

lib-storage: Added MAIL_FETCH_REFCOUNT for getting mail's reference count. This is useful only for backends where mailbox_copy() increases the refcount. With maildir&sdbox it can be looked up from the file's link count. With mdbox the refcount is stored in the map index. Other formats don't currently implement this.

lib-storage: Make sure mailbox_get_open_status() can't be used with items that can fail.

lib-storage: Fixed assert-crash when saving mails if UIDs weren't assigned.

lib-storage: Added MAILBOX_ATTRIBUTE_DOVECOT_PREFIX macro.

lib-storage: Added mailbox_status.have_guids flag

lib-storage: Changed mailbox_attribute_get() to return a struct for value. This allows returning flags for the values in future. Mainly readonly-flag for internal attributes and when restricted by ACL plugin.

lib-storage: Added support for "private modseqs" for INDEXPVT index. Used by dsync (next commit).

imap: If mailbox doesn't have read ACL, hide APPENDUID/COPYUID resp-codes.

lib-storage: Don't require mailbox to be synced for MAILBOX_METADATA_GUID lookup None of the mailbox formats currently require it, and lib-lda code assert-crashes with it since syncing is done with a transaction already open.

lib-storage: Make sure mailbox was synced at least once when getting status/metadata.

imap: URLFETCH BINARY BODYPARTSTRUCTURE returns binary-decoded line counts.

lib-storage: Added support to get/set/iterate mailbox attributes. The attributes are stored in a dict specified by mail_attribute_dict setting. The idea is to use this as storage for extensions that require per-mailbox key=value pairs, such as METADATA.

lib-storage: Added STATUS_CHECK_OVER_QUOTA for checking if user is over quota.

Various cleanups to checking if mailbox name is valid.

lib-storage: Removed rename_children parameter from mailbox_rename() The children are now always renamed. The only reason this feature was added in the first place was to make dsync's job easier, but this is no longer needed.

lib-storage: Added mailbox_is_subscribed()

lib-storage: Added MAILBOX_METADATA_BACKEND_NAMESPACE

Comment update.

Moved mailbox_equals() to lib-storage.

Removed CONTEXT_TYPE_SAFETY macro and reimplemented its functionality better. gcc/clang now gives a compiler error in many places if callback isn't exactly what was expected. It's also now much easier to add more of these checks.

lib-storage: MAX_SORT_PROGRAM_SIZE was too small

IMAP BINARY extension supports now FETCH BINARY command.

Avoid using (void)s by adding ATTR_NOWARN_UNUSED_RESULT attributes and other ways.

Marked functions parameters that are allowed to be NULL. Some APIs were also changed. The non-obvious APIs where NULL parameter was changed to "" are master_service_init() and auth_master_user_list_init(). These checks can currently be enabled only on a patched clang: http://llvm.org/bugs/show_bug.cgi?id=6786

lib-storage: Added mailbox_move(), which is basically copy+expunge.

lib-storage: Added MAILBOX_TRANSACTION_FLAG_SYNC flag

lib-storage: Added mailbox_delete_empty().

lib-storage: Added mailbox_save_set_pop3_order() and implemented for Maildir.

lib-storage: mail_transaction_commit_changes.changed=TRUE only when something actually changed.

lib-storage: Removed min_timeout parameter from mailbox_notify_changes() It's now internally taken from mailbox_idle_check_interval setting.

lib-storage: Added mailbox_save_using_mail()

dsync: Update cache fields' decision and last_used fields explicitly. This makes v2.1's dsync incompatible with v2.0's when used in different servers.

Implemented IMAP SPECIAL-USE extension.

lib-storage: Added mail_log_update_wanted_fields()

lib-storage: Added mail_get_hdr_stream() and use it where possible. This makes it clearer for backends when it needs a message body instead of only message header.

Redesigned mail precaching APIs. There's no longer a one monolithic mailbox_sync(MAILBOX_SYNC_FLAG_PRECACHE) call, but rather one mail_precache() call for each mail to be precached. This allows the callers to show the progress and in general is cleaner.

lib-storage: Added MAILBOX_TRANSACTION_FLAG_NO_CACHE_DEC and use it when precaching. The result is that "doveadm index" no longer changes caching decisions.

lib-storage: Added MAILBOX_TRANSACTION_FLAG_NO_CACHE_DEC and use it when precaching. The result is that "doveadm index" no longer changes caching decisions.

lib-storage: Replaced MAILBOX_FLAG_KEEP_RECENT flag with reverse MAILBOX_FLAG_DROP_RECENT. Very few places actually want to drop recent flags, so this way is easier.

Moved GUID code to liblib. Use guid_128_t type consistently everywhere.

lib-storage: Added MAILBOX_SYNC_FLAG_OPTIMIZE flag for triggering fts optimize. This is a pretty ugly kludge, since it does nothing when FTS isn't enabled..

lib-storage: Added mail_guid_128_hash/cmp()

lib-storage: Added mailbox_alloc_guid() for opening mailbox by its GUID.

lib-storage: Added auto_boxes parameter to mailbox_exists().

s/search score/search relevancy/

Moved the main functionality from "doveadm index" to MAILBOX_SYNC_FLAG_PRECACHE This also allows plugins to hook into the sync and implement their own precaching easily. fts indexing is now done this way rather than kludging.

lib-storage: Export a list of permanent flags via mailbox_status(). Removed mailbox_allow_new_keywords(), since it's now included in the status structure. ACL plugin may limit what flags are permanent according to ACLs.

lib-storage: Added mail_parse().

lib-storage: Added mail_is_cached()

lib-storage: Added MAIL_SORT_POP3_ORDER

lib-storage: Added MAIL_FETCH_POP3_ORDER special field and implemented for Maildir. The idea is that this specifies the order of messages when accessing via POP3. This is useful when migrating both POP3 and IMAP users from servers where their message ordering differes and they still want to be preserved.

Changed header/body searching to do search key charset translation earlier. This cleans up and simplifies error handling.

lib-storage: Changed mailbox_search_*() API to return pointer struct mail. This reduces the flexibility, because now different mailbox_search_next() calls can't have different mail parameters with possibly different wanted_fields settings. This flexibility was never used though, and removing it gives a couple of benefits: * it's now easier for backends to implement prefetch and parallel search * usage is easier since mail_alloc()/mail_free() is no longer needed

lib-storage: Fixed mailbox_get_expunges() to return GUIDs with all mailbox formats. Also added mailbox_get_expunged_uids() for use cases that don't really need GUIDs.

lib-storage: Added min_first_recent_uid to struct mailbox_update. Implemented for dbox. Maildir/mbox needs some more code to make this work correctly.

lib-storage: Added first_recent_uid to struct mailbox_status.

lib-storage: mailbox_exists() can now return if it's selectable or non-selectable.

lib-storage: mailbox_alloc() now takes a virtual mailbox name and other related API changes. All storage_name <-> vname conversions now go through the same two mailbox_list methods. This has many benefits, such as: * listescape plugin is now much simpler and bugfree * allows changing lib-storage API to use UTF-8 mailbox names in future * allows creation of "mailbox aliases" plugin

lib-storage: Added mailbox_get_last_*error() wrappers and use them.

lib-storage: Replaced mailbox_list_get_name_status() with mailbox_exists().

lib-storage: Added mailbox_save_get_transaction().

lib-storage: Moved some items from mailbox_get_status() to a new mailbox_get_metadata(). The idea is now that all status items are tracked all the time after mailbox is opened and they can always be looked up without failure. The metadata items are looked up lazily and the lookups may fail at any time. mailbox_get_status() can be used after mailbox_alloc() to indicate that the mailbox doesn't necessarily have to be opened, just that the status fields get returned. If mailbox is already known to be open, mailbox_get_open_status() can be used. It never fails.

lib-storage: Added warning comments about mail_get_*header*utf8().

lib-storage: mailbox_get_status() can now fail. It might have failed earlier also, but the errors were hidden from caller.

Moved fts/virtual plugin communication functions away from lib-storage.

lib-storage: Simplified mailbox_keyword*() APIs. They are no longer struct mailbox methods, because they're always implemented as being wrappers to lib-index APIs anyway. Also mailbox_keywords_ref/unref() no longer take mailbox parameter.

lib-storage: Moved box->private_flags_mask to mailbox_get_private_flags_mask() This allows getting it lazily only when it's actually needed.

lib-storage: Comment update to mail_get_stream()

lib-storage: Added MAIL_STORAGE_FLAG_NO_AUTOVERIFY to skip checking storage root dir existence.

mail-storage.h comments updated.

Fixing my english: s/non-?existing/nonexistent/

Removed mail_update_uid() / mail_index_update_uid(). It was working properly only with mdbox and there wasn't really a need for it. --HG-- branch : HEAD

lib-storage: Fixed accessing uncommitted saved mails with dsync dsync preserves uids, so uid==0 check won't work for detecting such mails. --HG-- branch : HEAD

lib-storage: Added mail_get_real_mail() that returns physical mail in a virtual mailbox. --HG-- branch : HEAD

lib-storage: Added support for quickly getting mailbox's virtual size. --HG-- branch : HEAD

lib-storage: Panic if deiniting storage before closing its mailboxes. --HG-- branch : HEAD

lib-storage: mail_get_parts() no longer returns const pointer. The struct message_part contained context-pointer and other APIs were using it, so the pointer really couldn't be const without casting it away sometimes. --HG-- branch : HEAD

Added mail_guid_128_to_string(). Used it in several places. --HG-- branch : HEAD

lib-storage: Mailbox renaming API changed. --HG-- branch : HEAD

lib-storage: Removed input parameter from mailbox_alloc(), added mailbox_open_stream() --HG-- branch : HEAD

lib-storage: STATUS_GUID moved to mailbox_get_guid() that can fail. --HG-- branch : HEAD

lib-storage: Mailbox deletion API changed. Mailbox deletion should now be free of race conditions. The actual file deletion code is now responsibility of mailbox_list backend. --HG-- branch : HEAD

lib-storage: Added mail_storage_get_user(). --HG-- branch : HEAD

lib-storage: Split mailbox_close() and mailbox_free() functionality. --HG-- branch : HEAD

mail-storage.h: Another comment update. --HG-- branch : HEAD

mail-storage.h: Updated comments, moved around functions. --HG-- branch : HEAD

lib-storage: Changed mailbox_sync() and mailbox_sync_deinit() APIs. Although we're already in beta stage, this is simple enough of a change that it shouldn't matter much. Having syncing also return status information made the API ugly and the status information wasn't even wanted all that often. --HG-- branch : HEAD

Removed MAILBOX_SYNC_AUTO_STOP sync flag. It wasn't used anywhere. --HG-- branch : HEAD

Transaction commits can now track how many uid/modseq updates were ignored. --HG-- branch : HEAD

mailbox_search_next*() API changed to return bool. If search fails, it'll be noticed anyway by mailbox_search_deinit(). --HG-- branch : HEAD

lib-storage: Added support for listing/adding cache fields. --HG-- branch : HEAD

lib-storage: Moved mail_generate_*() to be public functions. --HG-- branch : HEAD

imap: Implemented SORT=DISPLAY extension (draft-ietf-morg-sortdisplay-02). --HG-- branch : HEAD

Added pop3_save_uidl setting. When UIDLs are sent to client, save them to dovecot-uidlist. This allows changing pop3_uidl_format without messages getting re-downloaded. It's also useful with virtual POP3 INBOX when UIDLs are based on IMAP UIDs that may not be as stable as in non-virtual INBOX. --HG-- branch : HEAD

Removed MAILBOX_GUID_SIZE macro, use MAIL_GUID_128_SIZE everywhere. They were required to be the same size anyway. --HG-- branch : HEAD

Added ability to specify message's minimum modseq value. --HG-- branch : HEAD

Added ability to change existing messages' UIDs with mail_[index_]update_uid(). --HG-- branch : HEAD

Added mailbox_backends_equal(). --HG-- branch : HEAD

mailbox_transaction_commit_get_uids() changed to _get_changes() with more generic API. Saved UIDs are no longer necessarily in a simple x:y range. --HG-- branch : HEAD

mail_guid_128_is_empty() is now a public function. --HG-- branch : HEAD

mail_generate_guid_128_hash() is now a public function. --HG-- branch : HEAD

Keep track of expunged messages' GUIDs and expose them via mailbox_get_expunges(). The message GUIDs are stored in expunge records to transaction log. Before doing the final expunge, Maildir and dbox verify that the GUID in expunge request matches the current actual GUID. The GUID is stored in 128 bit field. If the real GUID isn't 128 bit, the bits are taken from SHA1 of the GUID. --HG-- branch : HEAD

lib-storage: Added mailbox_get_vname(). --HG-- branch : HEAD

Mailbox saving: Allow setting IMAP UID, POP3 UIDL and save date. Most of them aren't yet implemented by backends. --HG-- branch : HEAD

Added support for creating/updating mailboxes with given metadata (guid, uid validity, etc). --HG-- branch : HEAD

Added mailbox_save_copy_flags(). Use it wherever possible. --HG-- branch : HEAD

Added reference counting to struct mail_keywords and related APIs. --HG-- branch : HEAD

Added support for mailbox GUIDs. --HG-- branch : HEAD

Mailbox opening and closing APIs changed. --HG-- branch : HEAD

Added mailbox_keywords_create_from_indexes(). --HG-- branch : HEAD

mail storages can now be shared between namespaces. --HG-- branch : HEAD

Initial commit for making mail_storage:mailbox_list to be from 1:1 to n:n. This will allow namespaces to share the same storage and a single namespace to have multiple storages (multiple mailbox formats). Neither works currently, and this commit probably breaks some things. --HG-- branch : HEAD

Added struct mail.lookup_abort, which can be used to abort lookups that can't be done using cache. --HG-- branch : HEAD

Changed MAILBOX_OPEN_FAST meaning a bit. Don't use it where it's unnecessary. --HG-- branch : HEAD

doveadm: Implemented force-resync functionality. --HG-- branch : HEAD

Added mail_storage_purge() for dbox. dbox no longer calls it automatically at logout. --HG-- branch : HEAD

Added mail_user_get_temp_prefix() and mail_storage_get_temp_prefix(). --HG-- branch : HEAD

Mail copying API changed to be based on save API. This allows extending it easily in future. --HG-- branch : HEAD

Initial commit for config rewrite. --HG-- branch : HEAD

fts: Added support for handling multiple namespaces. --HG-- branch : HEAD

Finished making full text search indexes work fast with virtual mailboxes. --HG-- branch : HEAD

Initial support for getting full text search working nicely with virtual mailboxes. --HG-- branch : HEAD

mailbox_open() now takes struct mail_storage ** so it can be changed. --HG-- branch : HEAD

mail_get_headers_utf8() and mail_get_first_header_utf8() return headers unfolded now. --HG-- branch : HEAD

ACLs: Initial support for "post" right. --HG-- branch : HEAD

IGNORE_ACLS should have been mailbox_open_flags, not mail_storage_flag. --HG-- branch : HEAD

Made CRITICAL_MSG* public to MAIL_ERRSTR_CRITICAL_MSG* in mail-error.h. --HG-- branch : HEAD

Implemented imap-response-codes draft. --HG-- branch : HEAD

pop3+maildir: Make sure virtual sizes always get written to dovecot-uidlist file. --HG-- branch : HEAD

Added initial support for shared mailboxes. Listing isn't supported yet. Each user gets their own hidden namespace created automatically when they're accessed the first time. --HG-- branch : HEAD

Typofix in comment. --HG-- branch : HEAD

Added struct mail_user and fixed the code to support multiple users per process. --HG-- branch : HEAD

Added the concept of Global UIDs that are preserved across copies. They can be fetched, searched and specified for the save API. dbox format supports them correctly, but with maildir the base filename is used so maildir_copy_preserve_filename=yes is required to preserve GUIDs when copying. --HG-- branch : HEAD

mailbox_save_init() API was split to multiple functions. This allows adding more parameters easily in future. --HG-- branch : HEAD

Added mailbox_keyword_is_valid(). --HG-- branch : HEAD

struct mailbox_header_lookup_ctx can now be referenced/unreferenced so it can be shared among multiple struct mails. --HG-- branch : HEAD

Added support for sorting by X-SCORE. Currently it's only set by fts-solr. --HG-- branch : HEAD

CONDSTORE: Return HIGHESTMODSEQ correctly even if indexes are in memory. --HG-- branch : HEAD

CONDSTORE: STORE UNCHANGEDSINCE conflicts are now checked atomically. --HG-- branch : HEAD

Added more consts, ATTR_CONSTs and ATTR_PUREs. --HG-- branch : HEAD

FETCH X-MAILBOX and SEARCH X-MAILBOX can be used with virtual mailboxes to find out the original mailbox. In non-virtual mailboxes they always just use the current mailbox name. --HG-- branch : HEAD

Added mailbox_search_result_build(). --HG-- branch : HEAD

QRESYNC: If MODSEQs were returned in FETCH replies but there are pending expunges, send a low enough HIGHESTMODSEQ reply to make sure the client will later see the expunges. --HG-- branch : HEAD

Maildir: If POP3 UIDL extra field is found from dovecot-uidlist, it's used instead of the default UIDL format (or X-UIDL: header). Patch by Nicholas Von Hollen @ Mailtrust. --HG-- branch : HEAD

Added mailbox_get_uid_range(). --HG-- branch : HEAD

Renamed mailbox_get_uids() to mailbox_get_seq_range(). --HG-- branch : HEAD

Implemented CONTEXT=SEARCH extension. --HG-- branch : HEAD

Make mail_search_args an independent structure that can be used for multiple separate searches. --HG-- branch : HEAD

Added MAILBOX_TRANSACTION_FLAG_REFRESH. Use it with STORE UNCHANGEDSINCE. --HG-- branch : HEAD

Added QRESYNC support. --HG-- branch : HEAD

Added MAILBOX_SYNC_FLAG_EXPUNGE. --HG-- branch : HEAD

Initial CONDSTORE support. --HG-- branch : HEAD

Added mailbox_transaction_get_mailbox() --HG-- branch : HEAD

Added mailbox_transaction_get_mailbox() --HG-- branch : HEAD

Added mail_set_cache_corrupted() to rebuild the cache file and force recalculating the given field. --HG-- branch : HEAD

Added mail_set_cache_corrupted() to rebuild the cache file and force recalculating the given field. --HG-- branch : HEAD

When syncing a mailbox, sync the view internally first completely and just get a list of messages that have changed. Then just have mailbox_sync_next() return flag updates from that list. This avoids duplicate notifications and also fixes some bugs in previous implementation. MAILBOX_SYNC_TYPE_KEYWORDS no longer exists, keyword changes are included in MAILBOX_SYNC_TYPE_FLAGS. --HG-- branch : HEAD

mail_get_physical_size() returns now the message stream's size and not the physical size on disk that varies. This fixes mbox issues and it's also more correct conceptually, because it doesn't return metadata size with other formats either. --HG-- branch : HEAD

Added mail_get_keyword_indexes() --HG-- branch : HEAD

Removed MAILBOX_OPEN_MBOX_ONE_MSG_ONLY flag and handling. Raw storage replaced its functionality. --HG-- branch : HEAD

Added MAILBOX_SYNC_FLAG_FIX_INCONSISTENT flag. mailbox_sync() uses it always. If view is invalid or view syncing causes the view to become invalid, the view is reopened. --HG-- branch : HEAD

mailbox_transaction_commit*() doesn't sync the mailbox anymore, so it shouldn't take mailbox_sync_flags parameter either. --HG-- branch : HEAD

Compiler warning fix --HG-- branch : HEAD

Added mailbox_sync() to easily synchronize a mailbox. --HG-- branch : HEAD

Changed .h ifdef/defines to use <NAME>_H format. --HG-- branch : HEAD

Changed mail_keywords creation APIs to take mailbox/index instead of transaction. --HG-- branch : HEAD

mailbox_keywords_create() checks keyword validity now and returns failure if any of them are invalid. Added mailbox_keywords_create_valid() that only drops invalid keywords. Removed mbox and IMAP-specific keyword checks, they all use the same checking now. --HG-- branch : HEAD

mail_*() APIs changed to return int and return the actual data as pointer. Changed some code to do error handling a bit better. --HG-- branch : HEAD

mail_index_view_sync_next() and mailbox_sync_next() returns now bool. Renamed void mailbox_index_view_sync_end() to int mailbox_index_view_sync_commit(). --HG-- branch : HEAD

mail_index_lookup*() can't fail anymore. Changed several APIs not to return failure anymore. --HG-- branch : HEAD

Removed explicit locking from views and maps. They were already locked all the time when they were used. Because of this change several functions can no longer fail, so they were changed to return void, and a lot of pointless error handling was removed. --HG-- branch : HEAD

mailbox_transaction_commit_get_uids() now returns also UIDVALIDITY. It's the only usable way to get it returned correctly. Removed maildir-specific mailbox_get_status() handling, it's supposed to return the current state of the mailbox, not the latest state. It was useful only for returning non-zero UIDVALIDITY for newly created mailboxes, and that's no longer needed. --HG-- branch : HEAD

Added mail_get_first_header_utf8() and mail_get_headers_utf8(). --HG-- branch : HEAD

mail_storage.create() now returns error message string. Also fixed handling "/" and empty root paths. --HG-- branch : HEAD

Added MAIL_STORAGE_FLAG_FSYNC_DISABLE and moved FSYNC_DISABLE environment handling elsewhere. --HG-- branch : HEAD

Added MAIL_STORAGE_FLAG_NFS_FLUSH_STORAGE and MAIL_STORAGE_FLAG_NFS_FLUSH_INDEX flags. Pass FLUSH_INDEX to index open flags. --HG-- branch : HEAD

Added MAIL_FETCH_NUL_STATE. Don't try to fetch cached flags now unless it's needed. --HG-- branch : HEAD

Removed MAILBOX_SYNC_FLAG_NO_NEWMAIL handling. --HG-- branch : HEAD

Error handling rewrite. --HG-- branch : HEAD

Removed mail_storage_set_list_error(). Handle the errors directly. --HG-- branch : HEAD

Removed alert_no_diskspace callback. It wasn't used anywhere. --HG-- branch : HEAD

lib-storage doesn't need the ability to return syntax errors. They should be checked before lib-storage is called. --HG-- branch : HEAD

Added mailbox_transaction_commit_get_uids() which returns the UID range for saved/copied messages. --HG-- branch : HEAD

Removed HAS_INBOX and SHARED_NAMESPACE flags from mail storage and mailbox list flags. They can be directly taken from struct mail_namespace. --HG-- branch : HEAD

Moved namespace handling to lib-storage. Beginnings of namespace support for non-IMAP parts of Dovecot. --HG-- branch : HEAD

Removed mail_storage_create_with_data(). mail_storage_create() with driver=NULL behaves the same way. Removed parameters from mail_storage.create(), they're now put into the storage structure before calling create(). --HG-- branch : HEAD

Moved delete/rename operations to mailbox_list API. Fixed mbox/maildir to work with either fs/maildir++ directory layout. They can be changed by appending :LAYOUT=fs|maildir++ to mail_location. --HG-- branch : HEAD

When copying/syncing a lot of mails, send "* OK Hang in there" replies to client every 15 seconds so it doesn't just timeout the connection. --HG-- branch : HEAD

Removed mail_read_mmaped setting. It's a pretty useless setting and apparently it can also be buggy. --HG-- branch : HEAD

Added dotlock_use_excl setting. --HG-- branch : HEAD

Dovecot is now able to execute multiple commands at the same time. Practically this means commands: FETCH, LIST, SEARCH and syncing output for all commands. For example it's possible that doing two FETCH commands at the same time makes their output mixed together. Non-blocking SEARCH is done by doing search for 20 mails at a time, and then checking if another command is pending. Also added X-CANCEL <tag> command to cancel running commands. --HG-- branch : HEAD

Replaced void *context from a lot of callbacks with the actual context type. Also added/fixed some context type checks. --HG-- branch : HEAD

Lock handling changes. Everything goes through file-lock API now and there's only a single enum listing the different lock methods. This change exposed some unneeded (or possibly even wrong?) unlock calls in index file handling which were fixed. --HG-- branch : HEAD

Added MAIL_STORAGE_FLAG_NO_AUTOCREATE flag which silently fails storage creation if the root directory doesn't exist. Otherwise the root dir is created. --HG-- branch : HEAD

Mailbox list indexing and related changes. Currently works only with maildir and mmap_disable=no. This allows doing STATUS to synced mailboxes without opening their index files at all. --HG-- branch : HEAD

Initial code for separation of mailbox accessing and directory layout handling. It's not yet possible to change the default layouts though. --HG-- branch : HEAD

If the mail environment data contains mail format prefix, don't do any kind of autodetection. Practically this means that mbox:/var/mail/user doesn't work anymore. --HG-- branch : HEAD

mail_set_uid() now returns 0 = expunged, 1 = ok. --HG-- branch : HEAD

Added mail_storage_get_mailbox_index_dir(). --HG-- branch : HEAD

Added MAILBOX_OPEN_MBOX_ONE_MSG_ONLY flag for mailbox_open() which makes it ignore all but the first From-line in a mbox. This kludge is required for deliver which builds a temporary mbox stream from the input. Later it should be fixed to use some plain-mailbox format instead of mbox. --HG-- branch : HEAD

MAILBOX_LIST_INBOX flag conflicted with MAILBOX_LIST_CHILDREN flag, causing problems. --HG-- branch : HEAD

Added mail_get_save_date() and some cleanups. --HG-- branch : HEAD

Array API redesigned to work using unions. It now provides type safety without having to enable DEBUG, as long as the compiler supports typeof(). Its API changed a bit. It now allows directly accessing the array contents, although that's not necessarily recommended. Changed existing array usage to be type safe in a bit more places. Removed array_t completely. Also did s/modifyable/modifiable/. --HG-- branch : HEAD

Changed mail-storage API to do the mail sorting internally. Optimized it internally to keep a 32bit sort_id field in index for each used primary sort condition. Practically this should mean less disk I/O, memory and CPU usage when SORT command is used. --HG-- branch : HEAD

Added mail_set_uid() to select a mail by UID. --HG-- branch : HEAD

Changed mailbox_save_*() API a bit: Moved the struct mail *dest_mail to save_init() instead of being in save_finish(). This way you can request wanted fields from the mail while it's being saved. With maildir the message is being parsed at the same time as it's being saved, and the results are stored into cache file. --HG-- branch : HEAD

Added MAILBOX_OPEN_KEEP_LOCKED flag to mailbox opening and implemented it for mbox and maildir. It keeps the mailbox locked the whole time until mailbox_close() is called. --HG-- branch : HEAD

Moved mailbox_list_flags to struct mailbox_list_context so plugins can see the flags more easily. --HG-- branch : HEAD

mailbox_save_init() supports now returning failure. Quota plugin now checks if mail is too large in mailbox_save_init() hook. APPEND fails before giving "+ OK" reply if mailbox_save_init() failed. Also fixed some APPEND failure cases where the next command was eaten away. --HG-- branch : HEAD

Make life easier for plugins: - Added MAILBOX_OPEN_SAVEONLY flag for mailbox_open(), which is set when mailbox is opened only for append/copy - Added a couple of MAIL_STORAGE_ERR_* string defines that should be used when giving visible errors to clients - Added failed-flag for mailbox_list_context, which plugins can directly set to make mail_storage_mailbox_list_deinit() return failure - Added mail_storage_get_mailbox_path() and mail_storage_get_mailbox_control_dir() to return locations for mailbox directories Also be more strict when validating mailbox names. --HG-- branch : HEAD

Moved mailbox flag and lock method parsing to lib-storage. --HG-- branch : HEAD

deinit, unref, destroy, close, free, etc. functions now take a pointer to their data pointer, and set it to NULL. This makes double-frees less likely to cause security holes. --HG-- branch : HEAD

Added "bool" type and changed all ints that were used as booleans to bool. --HG-- branch : HEAD