19557f192d37cd54a1a090a8a26d9d47265e4413 |
|
01-Nov-2017 |
Aki Tuomi <aki.tuomi@dovecot.fi> |
global: Fix spelling mistakes in comments
Original work by @andreasschulze and @jsoref |
ea591a86852fb868a7cb9b6e2c80e3446071df8f |
|
29-Jun-2016 |
Timo Sirainen <timo.sirainen@dovecot.fi> |
lib-fts: Added maxlen parameter to icu-normalizer.
This is needed because the normalization can increase the token's length. |
440b625484f3cc9d3ec0a7ba36fe3583aa90172d |
|
31-Aug-2015 |
Teemu Huovila <teemu.huovila@dovecot.fi> |
lib-fts: Add prefixing contraction filter.
Filters away prefixing contracted words, e.g. "l'homme" -> "homme".
Tokens to be filtered must be lower case. Only supports French in
this initial version. |
998e17137dc747de4daf4ab56a12f9a237cf3cb6 |
|
15-Jun-2015 |
Teemu Huovila <teemu.huovila@dovecot.fi> |
lib-fts: Fix comment in fts-filter.h |
471167b9701fcc99b66f7a8bcae07bc4ac0dbbd4 |
|
03-Jun-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Added "english-possessive" filter. |
db451bddb5f7e36d4f3f2448102c032d10afe29a |
|
02-Jun-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Removed unnecessary array.h include from fts-filter.h |
2bb1ef0b669901fb91ff961e7fb074439ef769ab |
|
09-May-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Minor code cleanups |
a7d8afaadae968db20eb979052111d76a3086cd7 |
|
09-May-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Removed filter name macros from fts-filter.h
The filters can be directly accessed via their class structs. |
acfcf88e4dd529e4b2409f43bc9713cbc0169347 |
|
09-May-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Added "lowercase" filter.
For now it handles only ASCII characters, but that's enough for our use. |
eac88e31b791d6a099e0e497ac2a29aa041f05b2 |
|
09-May-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Removed "simple" normalizer.
It translated input to titlecase, which wasn't suitable for snowball
stemming that wanted lowercase input. Since that doesn't work, there's
probably no good for the existence of this (perhaps in future it's replaced
by unicode-aware lowercaser). |
6111370718708a3a966c60a1941ea303a4e0c759 |
|
09-May-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Changed filter's internal APIs to return error_r directly.
It's not very safe to store strings allocated from data stack to any
permanent structs. |
1d0f568e26ce5cbf18cd7bb335c6eea20a7e3770 |
|
09-May-2015 |
Teemu Huovila <teemu.huovila@dovecot.fi> |
fts: Improve filter error handling.
In lib-fts:
Move error storage to the generic filter struct level. Change make_utf8
helper to void also.
In fts:
Add the error argument to _filter() calls. |
db090e2a48bcc5ce162af0c36eef04407421379d |
|
09-May-2015 |
Teemu Huovila <teemu.huovila@dovecot.fi> |
fts: Change filter API to be able to return errors
Modify fts_filter_filter() to return integer status codes. It returns
1 if a token was returned, 0 if it was filtered away and -1 on error. |
ec930ce90b17fb63ff035c1c87d994800de092f1 |
|
21-Apr-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Added normalizer-simple for doing normalization without libicu. |
63713f16bad8b55e74c479adb6b47965b519c29b |
|
21-Apr-2015 |
Timo Sirainen <tss@iki.fi> |
lib-fts: Renamed normalizer to icu-normalizer, including the source code. |
c865b0e9c65fd77f7b2ab6f8616d3def5501ecb3 |
|
20-Apr-2015 |
Timo Sirainen <tss@iki.fi> |
Initial import for lib-fts.
Parts of what this code does was already implemented internally by
fts-lucene. lib-fts is intended to be usable for all the FTS backends. The
APIs are still going to change a bit, but hopefully not after v2.2.17
release.
Mostly written by Teemu Huovila. |