lib: Add o_stream_uncork_flush() to both uncork and flush

lib: ostream: Allow switching to a specific ioloop.

lib: Add o_stream_abort()

lib: Add o_stream_get_last_write_time()

lib: Add o_stream_set_finish_also_parent() and _finish_via_child() These allow controlling on both directions whether o_stream_finish() should be finishing the parent stream. If either one is set to FALSE, the parent stream isn't finished. Which one of these to use depends on the situation.

lib: Automatically flush ostream when it's closed Also verify that it unexpectedly didn't get fully flushed.

lib: Remove o_stream_nfinish()

lib: Add o_stream_finish() This marks the ostream as fully finished, with no further writes coming to it. Otherwise it behaves like o_stream_flush(). The ostream.flush() methods are supposed to write their trailer (if the ostream has one) when they see that ostream.finished is set. These will be implemented by the following commits.

lib: o_stream_flush() - check for send overflows and reset error handling This begins the removal of o_stream_nfinish().

lib: Remove o_stream_nflush() None of its previous callers were calling it correctly, so it's better to remove it entirely to avoid more of such wrong calls.

lib: o_stream_uncork() - call o_stream_nflush() instead of o_stream_flush() Otherwise flush errors may be unintentionally ignored. This change requires that all the o_stream_uncork() callers must call o_stream_nfinish() afterwards, unless the ostream is set to ignore errors.

global: unsigned int:1 -> bool:1 perl -i -pe 's/unsigned int ([^,:;]+):1;/bool $1:1;/' **/*.[ch]

lib: remove autoclose parameter from [io]_stream_create_fd Use [io]_stream_create_fd_autoclose() for autoclose.

o_stream_send_istream() API changed again The new API enforces the caller to correctly handle all the possible situations. It also makes in unambiguous whether to wait for input or output stream.

lib: Added comment to what ostream.offset actually is

lib: Added o_stream_nsend_istream()

lib: Simplified and clarified o_stream_send_istream() API

lib: Added ostream.blocking boolean Similar to istream.blocking.

lib: Don't silently ignore partial writes for o_stream_nsend() Normally o_stream_nsend() should be used only for blocking streams or streams with infinite (or "enough") buffer space.

lib: Removed ostream.last_failed_errno It's been identical to ostream.stream_errno for a while now.

lib: Added o_stream_create_passthrough() for creating simple wrapper ostreams

lib: Added o_stream_add_destroy_callback()

lib: Updated comment to o_stream_send_istream()

lib: Added [io]_stream_create_fd_*autoclose() These make it clearer that the fd parameter will be closed automatically when the stream is closed. Eventually (in v2.3) we'll want to get rid of the autoclose boolean parameter in [io]_stream_create_fd().

lib: Added o_stream_is_corked().

Added o_stream_get_max_buffer_size()

lib: Added [io]_stream_create_error_str()

iostream: Added ability to set/get error strings for streams.

iostreams: Added close_parent flag to close() handler and clarified close/destroy APIs. This makes it unambiguous how things work: Unless you explicitly call [io]_stream_close(), the parent streams won't be closed. This is what most (hopefully all!) of the existing code expects. I was wondering a bit if [io]_stream_destroy() should simply have been removed and replaced with [io]_stream_unref() calls, since they would have worked basically everywhere, but there might be some places where it's better to have explicitly closed the stream (and where closing the parent stream doesn't matter).

Added [io]_stream_create_error() for creating streams that always fail reads/writes.

Removed CONTEXT_TYPE_SAFETY macro and reimplemented its functionality better. gcc/clang now gives a compiler error in many places if callback isn't exactly what was expected. It's also now much easier to add more of these checks.

Added o_stream_get_fd().

o_stream_nsend() comment update

Added o_stream_nsend*() and related functions to make delayed error handling safer. Once o_stream_nsend*() is called, o_stream_nfinish() must be called before stream is destroyed to finish checking if there were any errors. If something failed and the stream is just wanted to be closed, o_stream_ignore_last_errors() can be called. For streams where errors don't really make any difference (network sockets) you can call o_stream_set_no_error_handling() immediately after creating the stream.

Marked functions parameters that are allowed to be NULL. Some APIs were also changed. The non-obvious APIs where NULL parameter was changed to "" are master_service_init() and auth_master_user_list_init(). These checks can currently be enabled only on a patched clang: http://llvm.org/bugs/show_bug.cgi?id=6786

Added o_stream_switch_ioloop() and implemented it to all ostreams.

i/ostreams can now have a name (e.g. file path). --HG-- branch : HEAD

Added o_stream_get_buffer_avail_size(). --HG-- branch : HEAD

Added o_stream_create_buffer() for having output stream write to a buffer. --HG-- branch : HEAD

Added o_stream_pwrite(). --HG-- branch : HEAD

Updated o_stream_flush() comment. --HG-- branch : HEAD

Added more consts, ATTR_CONSTs and ATTR_PUREs. --HG-- branch : HEAD

Added last_failed_errno to ostream to make error handling easier with files. --HG-- branch : HEAD

Renamed struct _[io]stream to struct [io]stream_private. Also removed _ prefix from _[io]stream_*() functions. --HG-- branch : HEAD

Changed .h ifdef/defines to use <NAME>_H format. --HG-- branch : HEAD

Split o_stream_create_file() to _create_fd() and _create_fd_file(). --HG-- branch : HEAD

Removed memory pool parameter from iostreams. Default pool was almost always used, and the stream usually required destroying anyway so it didn't even make freeing memory easier. --HG-- branch : HEAD

Updated o_stream_send_istream() comments --HG-- branch : HEAD

Added context parameter type safety checks for most callback APIs. --HG-- branch : HEAD

Added i_stream_destroy() and o_stream_destroy() and used them instead of *_stream_unref() where possible. Fixes at least one problem with io_remove() being called after socket was closed, which caused problems with epoll. --HG-- branch : HEAD

deinit, unref, destroy, close, free, etc. functions now take a pointer to their data pointer, and set it to NULL. This makes double-frees less likely to cause security holes. --HG-- branch : HEAD

Added "bool" type and changed all ints that were used as booleans to bool. --HG-- branch : HEAD

Changed iov_count to be unsigned int, it's large enough. Added overflow-flag which gets sent if send() failed to both send and buffer the given data. --HG-- branch : HEAD

o_stream_uncork() was previously always setting IO_WRITE handler even if there was no reason for it. This was relied on in imap/pop3 code when a handler could just send as much data as it can without actually buffering anything. So, removed the IO_WRITE handler forcing. It's only set if there's actually data in buffer or if flush_pending is set (via o_stream_set_flush_pending() or by returning 0 from flush callback handler). All in all, a minor optimization. --HG-- branch : HEAD

Changed ostream's flush callback to have return value which can tell if there are more bytes to be sent even if there is none in output buffer itself. Fixes FETCH commands which used o_stream_send_istream() getting stuck. --HG-- branch : HEAD

We never do blocking reads/writes to network anymore. Changed imap and pop3 processes to use a single I/O loop. Not much tested yet, and currently LIST/LSUB may eat too much memory and APPEND eats all CPU. --HG-- branch : HEAD

Allow giving 0 max_buffer_size, in which case "optimal" size is used. --HG-- branch : HEAD

Removed I/O priorities. They were pretty much useless and were just getting in way. --HG-- branch : HEAD

o_stream_send_istream() is now safe to use for moving data within file. --HG-- branch : HEAD

More type safety to i/o streams --HG-- branch : HEAD

Naming change for function typedefs. --HG-- branch : HEAD

Naming style changes, finally got tired of most of the typedefs. Also the previous enum -> macro change reverted so that we don't use the highest bit anymore, that's incompatible with old indexes so they will be rebuilt. --HG-- branch : HEAD

Buffer related cleanups. Use PATH_MAX instead of hardcoded 1024 for paths. Added str_path() and str_ppath() functions. i_snprintf() now returns only -1 or 0 depending on if buffer got full. dec2str() returns the string allocated from data stack. Instead of just casting to (long) or (int), we now use dec2str() with printf-like functions. Added o_stream_send_str(). Added strocpy() and replaced all strcpy()s and strncpy()s with it. Pretty much untested, hope it doesn't break too badly :) --HG-- branch : HEAD

Renamed IBuffer and OBuffer to IStream and OStream which describes their functionality better. I tried to keep the variable names and comments also sensible. --HG-- branch : HEAD