lib-storage: mail_storage_lock_create() - add support for dotlocks

lib-storage: Change mail_user_lock_file_create() to use mail_storage_lock_create()

Updated copyright notices to include the year 2018.

lib-storage: Add mail_user.event and give parent event in mail_user_alloc*()

lib-storage: mail-user: Changed mail_user_set_vars() to accept struct mail_user_connection_data, rather than individual fields.

lib-storage: Moved connection information in struct mail_user into separate struct mail_user_connection_data.

lib-storage: Add VOLATILEDIR setting to mail_location This is useful for creating temporary locks that could exist in tmpfs. Currently this is used for .vsize.lock and dovecot.autoexpunge.lock.

lib-storage: Move autoexpunge lock creation to a generic mail_user_lock_file_create()

lib-storage: add a mail user pre-deinit vfunc This allows plugins to perform checks right before the deinit call.

lib-storage: Replace MAIL_STORAGE_SERVICE_FLAG_AUTOEXPUNGE with explicit mail_user_autoexpunge() This allows better control of which users are being autoexpunged. This patch changes behavior at least in two ways now: 1) After shared folder access, the owner user isn't autoexpunged at deinit. Although this is a bit questionable of whether it should be or not. 2) LMTP's quota check at RCPT TO stage doesn't trigger autoexpunging.

lib-storage: Use refcounting for mail_storage_service_user doveadm import was freeing the user too early, which resulted mail_user._service_user pointing to freed memory. More importantly, after 34512eaad8b1b2f929e6d6e3a2f7252c29fba97b user->set was pointing to already freed memory.

lib-storage: Added mail_user_init_ssl_client_settings().

lib-storage: Don't duplicate service user's settings into mail_user The mail_storage_service_user.user_set isn't used afterwards, so it can be directly used to avoid wasting memory.

lib-storage: Don't unnecessarily duplicate user's all setting strings user->unexpanded_set and user->set have the same life-time, so they can point to same strings.

lib-storage: If namespaces weren't successfully created, don't autoexpunge at deinit.

Updated copyright notices to include the year 2017.

global: Replaced all instances of memset(p, 0, sizeof(*p)) with the new i_zero() macro. Used the following script: C_FILES=`git ls-files *.c` H_FILES=`git ls-files *.h` for F in "$C_FILES $H_FILES"; do echo "$F" perl -p -i -e 's/safe_memset\(&\(?([^,]*)\)?,\s*0,\s*sizeof\(\g1\)\)/i_zero_safe(&$1)/g' $F perl -p -i -e 's/safe_memset\(([^,]*),\s*0,\s*sizeof\(\*\g1\)\)/i_zero_safe($1)/g' $F perl -p -i -e 's/memset\(&\(?([^,]*)\)?,\s*0,\s*sizeof\(\g1\)\)/i_zero(&$1)/g' $F perl -p -i -e 's/memset\(([^,]*),\s*0,\s*sizeof\(\*\g1\)\)/i_zero($1)/g' $F done

global: Change string position/length from unsigned int to size_t Mainly to avoid truncating >4GB strings, which might potentially cause some security holes. Normally there are other limits, which prevent such excessive strings from being created in the first place. I'm sure this didn't find everything. Maybe everything could be found with compiler warnings. -Wconversion kind of does it, but it gives way too many unnecessary warnings. These were mainly found with: grep " = strlen" egrep "unsigned int.*(size|len)"

lib: API change - var_expand_func_table.func() can now return error. None of the existing functions were changed to return errors (yet).

lib: API change - var_expand*() now returns error string. This allows callers to fail properly if the format string is invalid.

global: Try to initialize var_expand_tab[] directly. This avoids accidents with the array numbering being wrong.

global: Use i_strchr_to_next() wherever useful.

%{auth_domain} shouldn't include the leading '@'

lib-storage: Added mail_user.session_create_time and .session_restored

lib-storage: mail_user_dup() should duplicate also userdb_fields.

lib-storage: Added mail_user_set_plugin_getenv_bool()

lib-dict: Changed dict_wait() to return void. If it encounters any failures, it should just make sure to abort any pending async requests before returning.

lib-storage: add mail_user_plugin_getenv_bool New API will check boolean-like env setting OR its exsitence. Function returns FALSE when: * Read out a null string, "Or" * String starts with any letter in set {'N', 'n', 'F','f','0'} To keep downward compatibility, For other cases including an empty string, function returns TRUE.

lib-storage: Changed mail storage initialization. Most importantly require mail_namespaces_init_finish() after mail_storage_create(). This was needed so that mail_namespaces_created/added hook would always have the ns->list set, which is required for several of the hooks to work (e.g. mailbox list index)

lib-storage: Deduplicate %{userdb:*} handling for mail_user and mail_storage_service_user

lib-storage: Enable autoexpunge only when MAIL_STORAGE_SERVICE_FLAG_AUTOEXPUNGE is set.

global: freshen copyright git ls-files | xargs perl -p -i -e 's/(\d+)-201[0-5]/$1-2016/g;s/ (201[0-5]) Dovecot/ $1-2016 Dovecot/'

Added mailbox { autoexpunge } setting. This can be used to automatically expunge mails from specified mailboxes after they're old enough. The expunges are done when the user is being deinitialized. mailbox_list_index=yes should be enabled to have the best performance with this setting. Example: namespace inbox { mailbox Spam { auto = create special_use = \Junk autoexpunge = 30d } }

lib-storage: Support %{userdb:*} variables in mail_home and mail_chroot settings.

Remove now-unnecessary direct stdlib.h #includes.

lib-storage: If stats plugin is enabled, set fs_settings.enable_timings=TRUE.

lib-storage: mail_user_init() wasn't always expanding %h correctly to settings. This mainly affected users autocreated for accessing shared mailboxes.

lib-storage: Store pointer to mail_storage_service_user to mail_user if it exists.

lib-storage: Added %{userdb:*} expansion to mail settings.

Added imap-hibernate process for gathering IDLEing imap processes. imap_hibernate_timeout setting controls how quickly the connection is moved from imap process to imap-hibernate process. Some IMAP extensions like NOTIFY, SEARCH=CONTEXT and COMPRESS aren't supported yet. There's also a new X-STATE command, which can be used to export the current IMAP connection state to a string and later on imported to get back to the original state (a quick resync feature for IMAP clients). However, this command is disabled for now due to the current code being unoptimized for untrusted input.

lib-storage: mail_user_var_expand_table() may not have returned %{auth_username} correctly

Removed mountpoint checking and updating code. After a few years it seems like it has just caused more problems than it has actually fixed. The only thing it's been used for is to make sure that Dovecot can't create empty user directories when the user's mail filesystem isn't mounted. But that's supposed to be normally prevented already if the mount root directory permissions are only writable by root. For now the mountpoint listing code and doveadm mount code still exists just in case people have some scripts using those. Those could be removed in v2.3. If we somehow figured out which mountpoints existed (not so easy because they could be only visible in userdb lookups for different users), we could maybe create some kind of a script that checks the permissions at startup. This would work with Linux at least: mkdir test mount / -o bind test ls -ld test/var/mail # assuming /var/mail mountpoint umount test

stats process/plugin redesign to be more modular. The visible functionality doesn't actually change with this patch yet, but it allows other plugins/services to add their own fields to stats process. For example auth process could send auth success/failures or auth cache hits/misses.

lib-storage: Added mail_user_init_fs_settings() Also changed mailbox_list_init_fs() to use it internally.

global: freshen copyright Robomatically: git ls-files | xargs perl -p -i -e 's/(\d+)-201[0-4]/$1-2015/g;s/ (201[0-4]) Dovecot/ $1-2015 Dovecot/' Happy 2015 everyone! Signed-off-by: Phil Carmody <phil@dovecot.fi>

lib-storage: Added %{session} to mail_user_var_expand_table()

Avoid logging warnings about increasing memory pool/data stack with DEBUG on. These could have a minor effect on memory usage, but shouldn't be much.

lib-storage: Added mail_user_dup()

Updated copyright notices to include year 2014.

auth, login, mail: Added %{auth_user}, %{auth_username} and %{auth_domain} They expand to the SASL authentication ID. So if master user login is done, it expands to the master user. If username changes during authentication, it expands to the original username. Otherwise %{user} and %{auth_user} are equal.

imapc: Don't log unnecessary errors at deinit about aborted hiearchy separator lookup. The lookup is done asynchronously at startup. It doesn't matter if we never get around to finishing it.

lib-storage: Added mail_namespaces_added hook.

lib-storage: Crashfixes for handling shared mailboxes for nonexistent users.

lib-storage: Never auto-remove the auto-created prefix="" namespace.

Oops :) Update copyrights to 2013 without breaking all .c files.