global: Rename timing API to stats-dist API The API wasn't really about timings specifically, but about statistics in general. The new stats service was already using it for tracking statistics for non-timing related numbers.

lib: Add event filter This currently supports matching events by: * name * source file:line * categories * key=value fields

lib: Add event API The events are hierarchical and the child events inherit the parents' fields. The events will be attached to "objects", which gives them some context. For example each mail user, mailbox and mail will have its own event. The events can also have a log prefix, so logging events to e.g. mail will always log a consistent prefix that identifies which mail is being logged about. The events will also be used for statistics. Typically this is done by logging a debug event, which contains fields that are interesting for statistics. The interesting events will have a name, which can be used to identify them when configuring which statistics are wanted to be tracked. It's possible to also track events that have no name, but that requires using the source code's filename:line as the event name. That of course may change between releases, so it's not very reliable.

lib: Add bloom filter support

lib: Add murmurhash3 support Needed for bloom filters

mempool-allocfree: Add linked-list malloc allocation This is useful when you want to actually free memory from pool too

lib: Add memarea API This can be used to create reference counted memory areas where a callback is called once the refcount drops to zero.

lib: Add istream-try This can be used to automatically detect the underlying istream format from a given list of choices.

global: Use check-local in Makefile.am instead of overriding check directly This helps with dependency problems, like running "make check" in lib-storage without "make" first would try to compile the test programs too early and fail.

lib: move fd_set_nonblock() to fd-util.[ch]

lib: move fd-close-on-exec.[ch] code into fd-util.[ch]

lib: always include fd-close-on-exec.h & fd-set-nonblock.h via fd-util.h

lib: Add multiplex stream support This allows having multiple channels of data in single stream.

lib: Replace rand.c with i_rand function Replacement for rand

lib: lib-signals: Removed explicit notification of ioloop change through lib_signals_reset_ioloop() in favor of implicit method. Before, if the ioloop changed, the application had to explicitly notify lib-signals using lib_signals_reset_ioloop(). This is error-prone and requires doing this all over the Dovecot code base. Now, lib-signals registers an ioloop switch callback that deals with this implicitly. The application can detach lib-signals from the ioloop explicitly if delayed signal handling is not required/desired in the new ioloop. Specific delayed signal handlers can be exempt from this automated behavior using a flag, meaning that such signal handlers need to be moved between ioloops explicitly.

var-expand: Add support for conditionals %{if;value-a,op,value-b:true-value:false-value}

lib: Created basic test suite for ostream-buffer.

lib: Add unit test for file_create_locked()

lib: import byte swapping & endian converting functions

lib: Add test-mempool unit test. It verifies that the p_new() and p_realloc_type() handle overflows correctly. test-malloc-overflow already does this for the low-level MALLOC_*() macros, but here we're cheking that the actually used memory allocation macros also work.

lib: Add i_realloc_type() for i_realloc() that checks for overflows

{lib,lib-fts}: fix builds with BSD make Without this change, BSD make doesn't know how to make a couple of the generated files because the BUILT_SOURCES file names don't match exactly the left hand sides of the rules. (GNU make somehow manages to match the rule even though it is not an exact match.)

lib: use full path to unicode data script This is a step toward fixing builds where object dir != source dir.

lib: download unicode data into srcdir This is a step toward fixing builds where object dir != source dir.

lib: Add extension support for var-expand This enables loading new var-expand features using plugins.

lib: Download unicode.org files from dovecot.org

lib,lib-storage: Move hook building code to lib This allows it to be reused elsewhere

lib: Add tests for path-util

lib: Rename abspath to path-util

lib: Add unit test for istream-sized

lib: Add istream-jsonstr unit test.

lib: Add MALLOC_MULTIPLY() and MALLOC_ADD() These can be used for calculating memory allocation sizes. If there's an overflow, the macro panics.

lib: add tests for HMAC-SHA256 from RFC 4231

lib: Add test for iostream-proxy

lib: Add iostream-proxy iostream-proxy proxies data between two pairs of istream/ostream.

lib: Add tests for iostream-pump

lib: Add iostream-pump

lib: Add SHA3 hashing methods for 256 and 512 bits

lib: Move sha context and result size to new header This is to prepare for SHA3 inclusion

lib: uri-util: Implemented API to check generic URI syntax. This allows checking whether something is a valid URI of any type. This change adds a test suite for the generic URI syntax, which is currently the main purpose of the API addition. Apart from a few simple vality checks, the test suite also tests various URI examples from RFCs.

lib: move sort and search from strfuncs.h to sort.h

lib: tests - give the tests names, using the new macros The lists of test function declarations and of test functions to call was basically the same list. Use the new test macros to squash them into one list, and then chose to name all the tests, so that you can select which ones to run. This can simplify the debug cycle when some of the tests are lengthy. e.g.: phil@phil:~/repos/dovecot-core$ src/lib/test-lib --match crc crc32 ................................................................ : ok 0 / 1 tests failed src/lib is clearly the most complicated case, conversions of others where filtering would be useful should be trivial following this example. Signed-off-by: Phil Carmody <phil@dovecot.fi>

lib: Added log throttling API.

lib: Added ostream-unix for writing fd sockets via ostream.

lib: ostream-file: Allow creating derived file output streams.

lib: Add PKCS#5 pbkdf1 and 2

lib: Added ostream-null

lib: Added unit test to iostream-temp.

Makefile: Added missing ostream-escaped.h

lib: Add ostream-escaped filter

lib: When closing istream-chain, make sure parent stream is seeked to correct offset. We were only seeking it earlier if it ended at EOF.

Makefile: Added missing sort.h

lib: Added a simple timing.h API for tracking min/max/avg for events.

lib: Try fixing ec6e672a6e32 (ioloop timeout fixing) Previous code was broken at least when moving a timeout between ioloops. This is now tested and works.

Reverted ec6e672a6e32 for now due to some bugs.

ioloop: Delay actual start of a new normal timeout until the next io_loop_run() cycle. This makes sure that timeouts will not expire before they get a chance to run.

lib: Added io_stream_get_disconnect_reason() to iostream.h

Removed support for dnotify. Everybody should be using inotify by now.

lib: Added o_stream_create_failure_at() to inject EIO at given offset in ostream

lib: Added i_stream_create_failure_at() to inject EIO at given offset in istream.

lib: test-failures - tests get/set handlers and the various log levels Also indirectoy tests the new lib-test test_expect* family. Signed-off-by: Phil Carmody <phil@dovecot.fi>

lib: Added file_create_locked()

Reverted d592417ec815 which added unnecessary code to Makefiles. The original problem it tried to solve was properly fixed by 46969c4cc57e. make will actually wait for processes to finish creating files before it continues to the next program that wants to access the file. As long as the dependencies are correct.

lib: Renamed test-network to test-net Since network.c had been renamed to net.c some time ago.

lib: Added istream-unix for reading fd sockets via istream.

lib: Added json-tree API for parsing JSON input into a tree structure. This makes it easier to access complicated JSON structs that can fit into memory.

Makefile: Avoid make race conditions when generating files that are used as dependencies. The file creation needs to be atomic, otherwise another process can start trying to use an unfinished file. So we first create .tmp file and then mv it into the final one.

Added support for base32 encode/decode.

lib: Added str-table API for keeping reference counted strings in a hash table.

lib: Added unit tests for guid_128_*()

lib: Added unit tests for wildcard_match()

lib: Added istream-callback API

lib: test-data-stack - too important a library not to be thrashed hard OK, it's thrashed a bit by other tests such as aqueue, str, etc., but these tests attempt to probe all corner cases given detailed knowledge of the limits of the block/frame implementation. At the moment, no realloc functionality is tested, as with DEBUG builds they would fail very noisily. Signed-off-by: Phil Carmody <phil@dovecot.fi>

lib: test-lib - add unit tests for str_to_*() helpers This doesn't test all the helpers, but ensures both signed and unsigned are tested, as are 32-bit and 64-bit cases. All the other helpers fall back onto using one of those cases. Unless uintmax_t is larger than 64 bits, in which case this needs a revisit. NOTE: This causes the following make check errors: test-strnum.c:35: Assert(#7) failed: ret == u64tests[i].ret test-strnum.c:35: Assert(#10) failed: ret == u64tests[i].ret test-strnum.c:37: Assert(#10) failed: val == u64tests[i].val str_to_uint64 ........................................................ : FAILED Corresponding to test cases: [7] = INVALID(18446744073709551616), This does not wrap-past-0 (become smaller) on multiply, but wraps-past-0 on addition. [10]= INVALID(20496382304121724020), This wraps-past-n (becomes larger) on multiply. Signed-off-by: Phil Carmody <phil@dovecot.fi>

lib: add rand helper library Initially, just wrap srand() so that we can find out what the last-used seed was. In situations where srand() is called only once (via this helper) this lets us reproduce exactly the same stream of random data again in order to reproduce rare crashes. Signed-off-by: Phil Carmody <phil@dovecot.fi>

lib: test printf_format_fix() Signed-off-by: Phil Carmody <phil@dovecot.fi>

lib: If two istreams share one parent, i_stream_get_data() may have returned corrupted data to another. This happened only for istreams that used parent's buffer directly instead of having their own buffer. For now at least we've solved this by truncating the other stream's buffer so it needs to be read again. Hopefully this is good enough. Added also unit test to check this functionality.

lib: unit tests for lib/bits Signed-off-by: Phil Carmody <phil@dovecot.fi>

lib: bit twiddles bits_requiredXX() gives the number of bits required to store an unsigned integer. Here, XX is 8, 16, 32, 64, reperesenting the size of the operand. It belongs in the same file as nearest_power(), which makes most sense in a separate bit twiddles file. Universal enough to stay in lib.h by inclusion. Signed-off-by: Phil Carmody <phil@dovecot.fi>

lib: Added some kind of a unit test for hash table. Just try out some insert+deletes randomly. Mainly I wrote this to check if there is some obvious problem, but looks like not.

liblib: Added unit test for hash methods to make sure they don't do read access beyond buffer. This currently fails for MD4 and MD5, so they need to be fixed/replaced..

Added istream-timeout, which triggers I/O event and fails with ETIMEDOUT after the timeout.

liblib: Added istream-hash, similar to ostream-hash.

Added ostream-hash for calculating a hash from data going through ostream.

buffer: Always keep +1 byte available for str_c()'s NUL.

uni_utf8_*(): Treat overlong UTF8 sequences as invalid.

JSON parser: Added support for reading string value as istream.

JSON parser supports now nested objects and parsing from non-blocking input stream.

Added iostream-temp for easily creating a temporary istream (to memory/file).

Renamed network.[ch] to net.[ch]. The function prefixes already started with net_ instead of network_. And icecap wants to use network.h for other purpose. :)

lib: Generalize hmac to be hash independent

Added missing hash-decl.h

liblib: Added "number packing" API.

Added istream-base64-decoder.

Added "connection" API for handling client/server connections more easily.

Added "connection" API for handling client/server connections more easily.

Added a simple JSON parser for parsing an object.

Renamed istream-attachment to istream-sized. The code didn't really assume anything about the input being an attachment, so this allows reusing the stream for other purposes.

Replaced (void)close(fd) and close_keep_errno() with i_close_fd(). i_close_fd() preserves the errno and logs an error if the close() fails.

Added chain istream. This is a nephew of the concat stream with the difference that new child streams can be added dynamically.

liblib: Added generic URI parsing functions.

Adds ISO8601/RFC3339 date format parsing and construction support. Interface is somewhat based on message date parser in src/lib-mail, but it also provides access to struct tm.

Makefile: Added UnicodeData.txt dependency to unicodemap.c.

Makefile: Added missing hmac-sha1.h

lib: Add hmac-sha1 adapted from hmac-md5

Added rawlog i/ostreams.

Renamed lib/*-internal.h files to lib/*-private.h for consistency.

Moved GUID code to liblib. Use guid_128_t type consistently everywhere.

Added i_getpw*() and i_getgr*() wrappers for getpw*()/getgr*(). These functions make error handling easier.

Added unit test for istream-base64-encoder.

liblib: Added istream for reading binary data as base64-encoded.

liblib: Added API for easily building hash strings based on given format string and input.

liblib: Added a common API for accessing all hash methods.

ostream-file: Fixed potential crash in write_at() and also fixed attempted optimization.

liblib: Removed unused system-clean and alloconly-clean mempools. They're just making the code messier and slower.

Renamed fsync_disable to mail_fsync=optimized|always|never. --HG-- branch : HEAD

configure: Removed --enable-header-install. It's now always enabled. There didn't seem to be much point in keeping it optional anymore. They're now more useful than before because shared libraries are also installed. --HG-- branch : HEAD

Added str_to_*() for converting strings to numbers, plus a few helper functions. The str_to_*() return failure also if integer is too large or too small to fit into destination. --HG-- branch : HEAD

Added execv_const() and execvp_const() helper functions. --HG-- branch : HEAD

If valgrind exists, run unit tests using it. If valgrind prints any errors, fail the test. --HG-- branch : HEAD

Added wildcard_match*() for matching strings with '*' and '?' wildcards. --HG-- branch : HEAD

crc32*() didn't return a standard CRC32 value. --HG-- branch : HEAD

var_expand(): Added support for built-in host, pid and env:* variables. --HG-- branch : HEAD

Added t_abspath*(). --HG-- branch : HEAD

Added p_strarray_dup(). --HG-- branch : HEAD

Makefile: Added UnicodeData.txt to distribution. --HG-- branch : HEAD

Added DLLIST2_*() functions for doubly linked list with head and tail. --HG-- branch : HEAD

Added unit tests for istream-seekable istream-concat. --HG-- branch : HEAD

Moved askpass() from master/ to lib/. Added t_askpass(). --HG-- branch : HEAD

unicodemap.c now gets recreated if unicodemap.pl changes. --HG-- branch : HEAD

Added unit test for istream-tee. --HG-- branch : HEAD

Renamed test-istream.c to test-istream-crlf.c --HG-- branch : HEAD

Added unit tests for timeval_*(). --HG-- branch : HEAD

Moved all struct timeval comparing/calculation code to lib/time-util. --HG-- branch : HEAD

Makefiles: Changed check-test to depend on all-am to fix build dependency problems. --HG-- branch : HEAD

Added binary_to_hex_append(). --HG-- branch : HEAD

Added o_stream_create_buffer() for having output stream write to a buffer. --HG-- branch : HEAD

Added str_append_tabunescaped(). str_tabescape*() now escapes also CR. Added unit tests. --HG-- branch : HEAD

Compiling fix for Solaris 7. --HG-- branch : HEAD

liblib unit tests are now split to separate files. --HG-- branch : HEAD

Tests are now run on "make check". Added initial tests for lib-index. Moved old tests away from tests/ to libraries' individual directories. --HG-- branch : HEAD

Flattened header namespace on install. --HG-- branch : HEAD

Build libdovecot.so and libdovecot-storage.so. Based on patch by Stephan Bosch. --HG-- branch : HEAD

Moved user-friendly EACCES error message generation to lib/. --HG-- branch : HEAD

Added API for waiting child processes. --HG-- branch : HEAD

Added an alternative hash table implementation. --HG-- branch : HEAD

Uninlined some of the more complex array functions. --HG-- branch : HEAD

Moved fdatasync_path() to a global function. --HG-- branch : HEAD

Moved fdatasync_path() to a global function. --HG-- branch : HEAD

Added macros for handling a doubly linked list. --HG-- branch : HEAD

Added a priority queue implementation. --HG-- branch : HEAD

Renamed queue to aqueue ("array queue") because struct queue already exists in Solaris. --HG-- branch : HEAD

Added queue implementation. --HG-- branch : HEAD

Removed unlink_lockfiles() and replaced it with a simpler unlink_old_files() --HG-- branch : HEAD

Create unicodemap.c to $(srcdir). --HG-- branch : HEAD

Added concatenation input stream. --HG-- branch : HEAD

Removed CRLF/LF output streams. They're no longer needed. --HG-- branch : HEAD

Added input stream filters for reading linefeeds as CRLFs or LFs. --HG-- branch : HEAD

Add unicodemap.pl to tarball, although it's not necessary. --HG-- branch : HEAD

Added uni_ucs4_to_titlecase() and uni_utf8_to_decomposed_titlecase(). They use a unicharmap.c file generated from UnicodeData.txt. --HG-- branch : HEAD

Added support for SHA256. Based on patch by Jasper Slits. --HG-- branch : HEAD

Require C99 compatible vsnprintf(). Removed printf_string_upper_bound() and replaced the code with printf_format_fix*() and vsnprintf(). --HG-- branch : HEAD

Renamed printf_string_fix_format() to printf_format_fix() and moved it to its own file. --HG-- branch : HEAD

Added safe_mkstemp(). --HG-- branch : HEAD

Added Boyer-Moore string searching. --HG-- branch : HEAD

Better type safety to module_contexts arrays. Already fixed some bugs. --HG-- branch : HEAD

Added system_clean_pool. default_pool is now set statically, so it can be changed before calling lib_init(). Use malloc_usable_size() if it's available for asserts and for implementing system_clean_pool. --HG-- branch : HEAD

Various cleanups to ioloop code. --HG-- branch : HEAD

Added --with-headers configure option to install .h files. --HG-- branch : HEAD

Added unichar_t UCS-4 type and some ucs4/utf8 functions. --HG-- branch : HEAD

Since getting core dumps can be sometimes difficult, if we now do abort() ourself, we first log the backtrace. This works at least with Linux and Solaris. --HG-- branch : HEAD

Rewrote much of the kqueue code. It didn't work correctly if there were both input and output I/O handlers added for the same file descriptor. The code works now very much like epoll code. Did also several cleanups. --HG-- branch : HEAD

Added crc32 calculation functions. --HG-- branch : HEAD

Added file_copy(). --HG-- branch : HEAD

Added tee-istream, which can be used to create multiple readable input streams from one input stream. --HG-- branch : HEAD

Added mountpoint_get() for looking up a path's mount point information. --HG-- branch : HEAD

Renamed safe-open.* to nfs-workarounds.*, safe_open() to nfs_safe_open() and added a new global NFS_ESTALE_RETRY_COUNT which everyone uses instead of defining their own. --HG-- branch : HEAD

Try to handle ESTALE NFS errors the best way we can. --HG-- branch : HEAD

Moved dupliated close_save_errno() code to public close_keep_errno() function. --HG-- branch : HEAD

Added kqueue notification support. Patch by Vaclav Haisman --HG-- branch : HEAD

Added bsearch_insert_pos(). Similar to bsearch(), but if value isn't found, returns the position where it would be inserted. --HG-- branch : HEAD

Added kqueue support. Patch by Vaclav Haisman. --HG-- branch : HEAD

Added decimal <-> hex string translation functions. --HG-- branch : HEAD

Moved seq_range_*() functions to more generic ones in lib/. --HG-- branch : HEAD

Added fd_set_nonblock() and changed net_set_nonblock() to use it. --HG-- branch : HEAD

Added inotify patch by Johannes Berg and did some restructuring to ioloop notify internals. --HG-- branch : HEAD

Missing array-decl.h --HG-- branch : HEAD

Added istream-seekable, which allows combining multiple input streams and creating a single seekable stream out of them. --HG-- branch : HEAD

Added pool_get_exp_grown_size(). Use it for buffers, istreams and ostreams when buffer needs to grow. Optimizes memory usage a bit. --HG-- branch : HEAD

Added dynamic array implementation. When compiling with gcc and DEBUG enabled, gcc checks type safety at compile time. --HG-- branch : HEAD

Added unix_socket_create(). --HG-- branch : HEAD

Removed byteorder.* files. They're not used anymore. --HG-- branch : HEAD

Cache file works now with mmap_disable=yes. Still needs a few optimizations. --HG-- branch : HEAD

Added string sanitization functions. --HG-- branch : HEAD

Added epoll support if --with-ioloop=epoll is given. Patch by Andrey Panin. --HG-- branch : HEAD

ostream-crlf.h was missing --HG-- branch : HEAD

Added CRLF/LF output stream converters. --HG-- branch : HEAD

We never do blocking reads/writes to network anymore. Changed imap and pop3 processes to use a single I/O loop. Not much tested yet, and currently LIST/LSUB may eat too much memory and APPEND eats all CPU. --HG-- branch : HEAD

Merged CRAM-MD5 and NTLM hmac-md5 code. Patch by Joshua Goodall --HG-- branch : HEAD

NTLM authentication. Patch by Andrey Panin --HG-- branch : HEAD

Added dovecotpw utility. Patch by Joshua Goodall --HG-- branch : HEAD

importing new index code. mbox still broken. --HG-- branch : HEAD

istream rewrite. instead of directly setting any limits to stream, you now have to use i_stream_create_limit() to existing stream. this should make the istreams much easier to create and understand how they work. --HG-- branch : HEAD

data_stack_pool split into two: unsafe_data_stack_pool which works like before, and a new one which verifies that stack frame stays the same whenever the pool is accessed. --HG-- branch : HEAD

Added IO_DIR_NOTIFY and IO_FILE_NOTIFY conditions to io_add(). IO_DIR_NOTIFY is now implemented for Linux dnotify. --HG-- branch : HEAD

Added some network byte ordering functions and macros --HG-- branch : HEAD

More robust error handling for mbox. --HG-- branch : HEAD

Added support for dynamically loadable imap/pop3 modules. --HG-- branch : HEAD

Locking code cleanups and small fixes --HG-- branch : HEAD

Added mail_full_filesystem_access setting. Some of the setting variable types were declared wrong and caused Dovecot to crash if they were set in config file. --HG-- branch : HEAD

Added var_expand() --HG-- branch : HEAD

Rewrote rfc822-tokenize.c to work one token at a time so it won't uselessly take memory, maybe also a bit faster. This caused pretty large changes all around. Also moved all string (un)escaping code to lib/strescape.c. --HG-- branch : HEAD

String function cleanups. Allocating 0 bytes of memory is treated as error now, it could be an integer overflow. Moved printf_string_upper_bound() to it's own file, so strfuncs.c can be with MIT license. --HG-- branch : HEAD

Replaced TempString with a String which can use any memory pool and uses Buffer internally. --HG-- branch : HEAD

We don't have separate read-write pools, so renamed pool_create(.., FALSE) to pool_alloconly_create(). --HG-- branch : HEAD

If used base/login directories exist already, make sure they're with correct permissions. Always delete contents in login directory at startup. Added safe_mkdir(). changed unlink_directory() behaviour, and fixed a race condition which could have made it follow symlinks to other directories and delete them. Didn't really harm us so far, we never used it for deleting unsafe directories. --HG-- branch : HEAD

Added safe_memset() which guarantees that compiler optimizations don't optimize it away. Not that we really need to clear the passwords from memory, but won't hurt much either :) --HG-- branch : HEAD

Added buffer API. Point is to hide all buffer writing behind this API which verifies that nothing overflows. Much better than doing the same checks all around the code, even if it is slightly slower. Buffer reading is still mostly done directly, that isn't such a big security risk and I can't think of a reasonable API for it anyway. --HG-- branch : HEAD

Renamed IBuffer and OBuffer to IStream and OStream which describes their functionality better. I tried to keep the variable names and comments also sensible. --HG-- branch : HEAD

Login process now changes it's name if verbose_proctitle = yes, and we're running BSD. This is also possible with Linux with a pretty ugly hack, which you can enable by modifying lib/process-title.c if you _really_ want to. And a nasty bugfix - login_process_per_connection setting didn't work with imaps port connections which is exactly where it was mostly wanted. --HG-- branch : HEAD

We use close-on-exec flag now to make sure that master process closes the fds when executing other processes. --HG-- branch : HEAD

Added virtual memory size limits to processes. Default values are pretty high, this is mostly because I want it to prevent accidental infinite loops eating memory or some integer overflows, not to actually restrict anything. --HG-- branch : HEAD

Created env_put() and env_clean() for a bit easier handling of environment variables. --HG-- branch : HEAD

Moved mycrypt() into auth/ dir, so we don't have to link all programs with -lcrypt --HG-- branch : HEAD

Forgot mycrypt.h --HG-- branch : HEAD

Still more crypt() problems. Wrapped it into mycrypt() which should finally put end to this kludgeing. --HG-- branch : HEAD

select() support was broken. Also changed the way it's built. --HG-- branch : HEAD

I/O buffers now use real blocking instead of setting up a sub-ioloop to poll(). alarm() is called every 30 secs to send SIGHUP and break out of the read/write calls, so the given timeout values aren't exact. Also some other cleanups, like not including ioloop.h in [io]buffer.h which broke several other files which hadn't included it itself.. --HG-- branch : HEAD

Fixes to timezone handling which were handling quite badly. added ioloop_timezone which gets updated with ioloop_time. Changed some GMT references to UTC. Timezone offsets are in minutes now everywhere instead of seconds. Fixes for unsigned time_t. --HG-- branch : HEAD

Split IOBuffer into mmaped IBuffer, file IBuffer, memory data IBuffer and file OBuffer. --HG-- branch : HEAD

missing mempool-datastack.c --HG-- branch : HEAD

s/temporary memory pool/data stack/ which is the correct name for it. --HG-- branch : HEAD

lots of cleanups. also index/datafile is now capable of staying in memory, as long as it's noticed while opening the index. --HG-- branch : HEAD

Added extra functions for easier printing of error messages. Moved file_set_size() to generic function in lib. If there's no space to build hash file, it builds itself in anon-mmaped memory and stays there. --HG-- branch : HEAD

sendfile() works now properly with 64bit off_t --HG-- branch : HEAD

Added write_full() which is a simple wrapper around write() meant for writing into files. When there's too much deleted data in index files, they're now compressed when the index is being opened. --HG-- branch : HEAD

Initial revision --HG-- branch : HEAD