Updated copyright notices to include the year 2018.

fts: fts-parser-tika - Add assert to make sure retriable_error_msg is set

plugins/fts: Return back comment about Server Error.

plugins/fts: Retry all 5xx tika http statuses, not only 500

fts: fts_parser_tika replace empty path with "/" indexing doesn't crash if fts_tika = http://host:port setting is missing trailing '/'

fts: Retry indexing for tika backend in case of internal server error

fts: Extend parser's deinit function interface with retriable_err_msg_r parameter the new parameter will be set to a error string in case indexing may need retrying, so it will be logged later when decision about retry will be made.

fts: Parser move try_init arguments to a single structure parser_context.

global: start relying on [io]_stream_unref(NULL) being a no-op Cleanup performed with the following semantic patch: @@ expression E; @@ - if (E != NULL) { - i_stream_unref(&E); - } + i_stream_unref(&E); @@ expression E; @@ - if (E != NULL) { - o_stream_unref(&E); - } + o_stream_unref(&E);

global: start relying on io_remove{,_closed}(NULL) being a no-op Cleanup performed with the following semantic patch: @@ expression E; @@ - if (E != NULL) { - io_remove(&E); - } + io_remove(&E); @@ expression E; @@ - if (E != NULL) { - io_remove_closed(&E); - } + io_remove_closed(&E);

global: Use http_response_get_message() to log HTTP responses.

fts: Don't add NULL content disposition or type to HTTP header

fts-tika: Fixed HTTPS support by properly propagating SSL client settings from mail_user.

Updated copyright notices to include the year 2017.

global: Replaced all instances of memset(p, 0, sizeof(*p)) with the new i_zero() macro. Used the following script: C_FILES=`git ls-files *.c` H_FILES=`git ls-files *.h` for F in "$C_FILES $H_FILES"; do echo "$F" perl -p -i -e 's/safe_memset\(&\(?([^,]*)\)?,\s*0,\s*sizeof\(\g1\)\)/i_zero_safe(&$1)/g' $F perl -p -i -e 's/safe_memset\(([^,]*),\s*0,\s*sizeof\(\*\g1\)\)/i_zero_safe($1)/g' $F perl -p -i -e 's/memset\(&\(?([^,]*)\)?,\s*0,\s*sizeof\(\g1\)\)/i_zero(&$1)/g' $F perl -p -i -e 's/memset\(([^,]*),\s*0,\s*sizeof\(\*\g1\)\)/i_zero($1)/g' $F done

lib: istream - migrate to i_stream_read_more() Scripted to find all the low-hanging-fruit (single line calls), but hand-checked: git grep i_stream_read_data.*,\ 0\) | sed s/:.*// | \ xargs sed -i -e 's/i_stream_read_data(\(.*\), \(.*\), \(.*\), 0)/i_stream_read_more(\1, \2, \3)/' Signed-off-by: Phil Carmody <phil@dovecot.fi>

lib-http: Started using struct uri_host in struct http_url.

fts-tika: Don't crash on 500 errors (caused by 146f6f85d) http_req=NULL here set by http_client_request_send_payload(). Even if it wasn't, the payload wouldn't be there.

global: freshen copyright git ls-files | xargs perl -p -i -e 's/(\d+)-201[0-5]/$1-2016/g;s/ (201[0-5]) Dovecot/ $1-2016 Dovecot/'

fts: If Tika returns 500, retry it a couple of times and then fallback to ignoring the problem.

fts-tika: Fixed crashes when indexing larger attachments with fts-solr. We were mixing ioloops without switching back to the original ioloop in the middle. Also io_remove() at deinit caused another timeout to be added, so this needs to be done while original ioloop is active or we'll just leak the just-added timeout in io_loop_destroy() and crash later.

fts-tika, fts-solr: Added timeouts to requests so they aren't attempted infinitely.

fts: If fts-parser fails, stop indexing instead of ignoring the error and continuing. This is especially important in case there's just some temporary error.

global: freshen copyright Robomatically: git ls-files | xargs perl -p -i -e 's/(\d+)-201[0-4]/$1-2015/g;s/ (201[0-4]) Dovecot/ $1-2015 Dovecot/' Happy 2015 everyone! Signed-off-by: Phil Carmody <phil@dovecot.fi>

fts-tika: Hiden "Unsupported Media Type" errors. Log HTTP status code on errors.

fts-tika: Fixed crash if Tika returned 200 reply without payload.

fts-tika: Removed lib-http kludgy workaround, which is no longer needed.

fts: Added fts-parser support for Tika It can be enabled by setting: plugin { fts_tika = http://localhost:9998/tika/ }