lib-storage: convert mbox to use container_of

global: unsigned int:1 -> bool:1 perl -i -pe 's/unsigned int ([^,:;]+):1;/bool $1:1;/' **/*.[ch]

mbox: Fixed mailbox_list_index=yes to work with non-Dovecot mbox changes.

Replaced *_INDEX_PREFIX macros with a common MAIL_INDEX_PREFIX.

mbox: Added support for copy/move/catenate within same mailbox.

Make sure we check all the functions' return values. Minor API changes to simplify this. Checked using a patched clang that adds attribute(warn_unused_result) to all functions. This commit fixes several error handling mistakes.

mbox: Make sure each mailbox creation generates a different UIDVALIDITY.

mbox: Added mbox_md5 setting to select headers for MD5 generation.

Moved GUID code to liblib. Use guid_128_t type consistently everywhere.

lib-storage: Removed mailbox.backend_readonly. Backends set it internally lazily now.

lib-storage: Removed struct index_transaction_context. All of its contents are now in struct mailbox_transaction_context.

Avoid including mailbox-list-private.h everywhere. --HG-- branch : HEAD

lib-storage: *_mailboxes don't descend from index_mailbox anymore, it's now a context. --HG-- branch : HEAD

lib-storage: Removed mailbox_list_get_guid(). Directory GUIDs are pretty pointless. --HG-- branch : HEAD

Transaction commits can now track how many uid/modseq updates were ignored. --HG-- branch : HEAD

mbox: Added support for mailbox directory GUIDs. --HG-- branch : HEAD

index-storage: Simplified the way transactions are are created/finished. Removed also mail_storage.class_init/deinit since they're no longer used for anything. --HG-- branch : HEAD

index-storage: Moved mail MD5 calculation code to mbox-specific code. Nothing else used it. --HG-- branch : HEAD

Removed MAILBOX_GUID_SIZE macro, use MAIL_GUID_128_SIZE everywhere. They were required to be the same size anyway. --HG-- branch : HEAD

Added support for creating/updating mailboxes with given metadata (guid, uid validity, etc). --HG-- branch : HEAD

Added support for mailbox GUIDs. --HG-- branch : HEAD

Mailbox opening and closing APIs changed. --HG-- branch : HEAD

Initial commit for making mail_storage:mailbox_list to be from 1:1 to n:n. This will allow namespaces to share the same storage and a single namespace to have multiple storages (multiple mailbox formats). Neither works currently, and this commit probably breaks some things. --HG-- branch : HEAD

Initial commit for config rewrite. --HG-- branch : HEAD

Cleaned up read-only mailbox handling. Fixes a bug with Maildir syncing. If Maildir was opened read-only (STATUS, EXAMINE) then all flag changes were saved to index as dirty. --HG-- branch : HEAD

mbox: Added a new index header where dirtyness state is stored. This also fixes a bug where sync_size wasn't updated in header when mbox was marked dirty, causing other parts of code to assume wrong file size and return wrong size for the last message and/or cause "Next message unexpectedly lost" errors. --HG-- branch : HEAD

mbox: If mailbox isn't a valid mbox, don't try to sync it when closing. --HG-- branch : HEAD

mailbox_save_init() API was split to multiple functions. This allows adding more parameters easily in future. --HG-- branch : HEAD

mailbox.save_init() API now takes ** pointer to dest_mail, so multiple plugins can safely specify it. ctx->dest_mail also gets updated then. --HG-- branch : HEAD

Replaced mail_extra_groups setting with mail_privileged_group and mail_access_groups settings. mail_privileged_group allows temporary access to the group when creating mbox INBOX dotlocks. --HG-- branch : HEAD

Replaced mail_extra_groups setting with mail_privileged_group and mail_access_groups settings. mail_privileged_group allows temporary access to the group when creating mbox INBOX dotlocks. --HG-- branch : HEAD

Sync mbox when committing transaction only when saving messages to update last-uid. --HG-- branch : HEAD

Changed .h ifdef/defines to use <NAME>_H format. --HG-- branch : HEAD

Call sync_notify() once at the end of syncing. Allow accessing mails even while syncing, as long as it's safe to do so. --HG-- branch : HEAD

Changed *_transaction_created() to static. --HG-- branch : HEAD

Removed unused macros --HG-- branch : HEAD

Removed struct index_storage abstraction. It's pointless. --HG-- branch : HEAD

Better type safety to module_contexts arrays. Already fixed some bugs. --HG-- branch : HEAD

KEEP_LOCK: When using dotlock, touch it every 10 seconds. --HG-- branch : HEAD

Drop X-Delivery-ID header when saving the message. --HG-- branch : HEAD

Removed get_mailbox_control_dir and get_mailbox_index_dir virtual functions from mail_storage, since they're already in mailbox_list.get_path(). Updated mbox to override that function to return index/control dirs with the ".imap/" in the middle. --HG-- branch : HEAD

Initial code for separation of mailbox accessing and directory layout handling. It's not yet possible to change the default layouts though. --HG-- branch : HEAD

Beginnings of joining mail-storage API more closely to mail-index, so that mail-index could be directly used if needed. Currently only transactions are joined. --HG-- branch : HEAD

Changed mailbox_save_*() API a bit: Moved the struct mail *dest_mail to save_init() instead of being in save_finish(). This way you can request wanted fields from the mail while it's being saved. With maildir the message is being parsed at the same time as it's being saved, and the results are stored into cache file. --HG-- branch : HEAD

Added MAILBOX_OPEN_KEEP_LOCKED flag to mailbox opening and implemented it for mbox and maildir. It keeps the mailbox locked the whole time until mailbox_close() is called. --HG-- branch : HEAD

Don't hide all .files when listing mboxes, only .imap and .subscriptions. Moved the hardcoded ".imap" strings into a define. --HG-- branch : HEAD

mailbox_save_init() supports now returning failure. Quota plugin now checks if mail is too large in mailbox_save_init() hook. APPEND fails before giving "+ OK" reply if mailbox_save_init() failed. Also fixed some APPEND failure cases where the next command was eaten away. --HG-- branch : HEAD

Added "bool" type and changed all ints that were used as booleans to bool. --HG-- branch : HEAD

Don't try to check for notifications when mbox was opened from input stream. --HG-- branch : HEAD

Created mbox_storage and maildir_storage. --HG-- branch : HEAD

Moved mbox/maildir-specific variables from struct index_mailbox to mbox_mailbox and maildir_mailbox. --HG-- branch : HEAD

Several size_t -> unsigned int changes. Try to keep "unsigned int" for counters, size_t for actual memory range sizes. --HG-- branch : HEAD

Major mail-storage API changes. It's now a bit cleaner and much more plugin friendly. Removed proxy_mailbox* stuff, they were difficult to use and there's now much easier way to replace them. --HG-- branch : HEAD

Keyword fixes. --HG-- branch : HEAD

Added mail_debug setting. Moved full_filesystem_access from global variable to flag in mail_create*() functions. --HG-- branch : HEAD

Initial support for keywords. Syncing to mbox/maildir doesn't work yet. --HG-- branch : HEAD

Changed mbox header padding back to 50. It was 5 for debugging (probably shouldn't have been committed). --HG-- branch : HEAD

oops --HG-- branch : HEAD

Added sync flags parameter to mailbox_transaction_commit(), so EXPUNGE can do a full sync with dirty syncing enabled. --HG-- branch : HEAD

Changed mail saving API to be nonblocking. --HG-- branch : HEAD

Don't write Content-Length unless it's value is larger than 1024 bytes. --HG-- branch : HEAD

Moved namespace and hierarchy separator handling to imap-specific code. LIST now shows non-hidden namespaces in the LIST reply. --HG-- branch : HEAD

Broke mailbox_sync() into iterator. --HG-- branch : HEAD

Updated comment about how syncing is done, and s/extra space/padding/ --HG-- branch : HEAD

Dropped MBOX_HEADER_EXTRA_SPACE from 100 to 50. It should be enough. --HG-- branch : HEAD

We didn't specify full path for .subscriptions file, and it was named without the leading dot.. --HG-- branch : HEAD

Filter internal headers from user visible input stream. Make mailbox_save() use the same header list. --HG-- branch : HEAD

mailbox_save() and mailbox_copy() functions can now return the saved mail so it can be immediately queried. Implemented UIDPLUS extension using it. Maildir implementation missing, so it crashes with it for now.. APPEND with mbox now doesn't require resyncing the mailbox since it updates indexes directly. --HG-- branch : HEAD

mbox code compiles again, but syncing is only partially implemented so accessing mboxes fails.. Also some cleanups to index-storage and maildir code. --HG-- branch : HEAD

Mail storages support now configurable namespace prefix and hierarchy separator. Subscription file handling needs some more thought. --HG-- branch : HEAD

API change: Mailbox list sorting must now always done by storage itself if it's needed. Maildir listing rewritten. --HG-- branch : HEAD

API change for expunging messages. Not exactly what I wanted, but good enough. --HG-- branch : HEAD

Rewrote LIST, LSUB and subscription file handling. LIST replies aren't sorted anymore by default, it can be enabled with client_workarounds = list-sort. --HG-- branch : HEAD

Support for MULTIAPPEND extension. COPY now behaves like spec says - if it fails, none of the messages are copied. maildir_copy_with_hardlinks didn't actually work. --HG-- branch : HEAD

mail-storage.h interface changes, affects pretty much everything. FETCH, SEARCH, SORT and THREAD handling were pretty much moved from lib-storage/ to imap/ so adding non-index storages would be much easier now. Also POP3 server can now be easily implemented with lib-storage. Not too well tested, and at least one major problem: partial fetching is _slow_. --HG-- branch : HEAD

Naming change for function typedefs. --HG-- branch : HEAD

Naming style changes, finally got tired of most of the typedefs. Also the previous enum -> macro change reverted so that we don't use the highest bit anymore, that's incompatible with old indexes so they will be rebuilt. --HG-- branch : HEAD

Renamed IBuffer and OBuffer to IStream and OStream which describes their functionality better. I tried to keep the variable names and comments also sensible. --HG-- branch : HEAD

Forgot to commit. --HG-- branch : HEAD

Mostly mbox locking/syncing fixes. Still some problems though. --HG-- branch : HEAD

mbox locking fixes / changes. we now read-lock the mbox file before syncing so we can be sure no-one corrupts our reads by expunging mailbox. mbox file is kept open all the time, but re-opened when device/inode for file has changed (ie. someone overwrote it). File is also kept mmap()ed until lock is dropped. we currently create .lock file even when reading the file (ie. being effectively write-lock), but that'll be made configurable later. --HG-- branch : HEAD

Fixes to timezone handling which were handling quite badly. added ioloop_timezone which gets updated with ioloop_time. Changed some GMT references to UTC. Timezone offsets are in minutes now everywhere instead of seconds. Fixes for unsigned time_t. --HG-- branch : HEAD

MailStorage interface change. We now let storage call several sync-functions whenever it wants instead of forcing it through sync() function. This now allows us to send client FLAGS and PERMANENTFLAGS messages whenever new custom flags are added. Also EXPUNGE command now goes nicely through expunge() function (which CLOSE used) instead of through flag in sync(). "Out of disk space" alert is also sent now whenever it happens, before it was sent only when opening mailbox. Message set parser now complains when referencing mail sequences outside the possible range. Modify log before sent flags/expunges changes to client even if it didn't know about those messages yet. Also some other smaller cleanups. Beginnings of fixing APPEND and COPY when trying to store mails into selected mailbox. Before this didn't work too well or simply broke things. Still broken, needs a bit more changes.. --HG-- branch : HEAD

Split IOBuffer into mmaped IBuffer, file IBuffer, memory data IBuffer and file OBuffer. --HG-- branch : HEAD

move size_t fixes --HG-- branch : HEAD

s/user_data/context/ and some s/Data/Context/ --HG-- branch : HEAD

Initial revision --HG-- branch : HEAD