SQLite3, FTS3 and Stop Words

How do you prevent SQLite3 from indexing certain keywords or “stop words” while building an FTS3 virtual table?

Examples that I would like to include in the index include "is", "the", "a", etc.

+3
source share
1 answer

Unfortunately, there is no built-in tokenizer that processes stop words, so you will either need to implement your own tokenizer in C, or filter the stop words from the list manually, insert the pre-selected text / pre-filtered text in the corresponding column of the FTS table, or use a somewhat confusing the scheme in which you insert the text into the FTS column, retrieve it back after it is tokenized, filter it and then update the value of the column.

+3
source

All Articles