Geek asks and answers

Why does solr RemoveDuplicatesTokenFilterFactory not work?

My schema.xml splits the product name and then uses RemoveDuplicate to remove duplicate words after splitting.

    <fieldType name="type_name" class="solr.TextField">
        <analyzer type="index">
            <tokenizer class="solr.PatternTokenizerFactory" pattern="\|| " />
            <filter class="solr.LowerCaseFilterFactory"/>
            <filter class="solr.RemoveDuplicatesTokenFilterFactory"/>

And in the query analyzer, I see that RemoveDuplicatesTokenFilterFactory does nothing to duplicate words. Why?

enter image description here

+3
source share
1 answer

If you read the Wiki , you will see that it only deletes duplicates in the same position, which is not the case here.

+4
source

More articles: