How to index and search in Lucene 4.1

Question

How to index and search in Lucene 4.1

In my 3.6 code, I added a number field to my index as follows:

public void addNumericField(IndexField field, Integer value) {
        addField(field, NumericUtils.intToPrefixCoded(value));
    }

however, now you need to pass the BytesRef argument to it, and it is completely unclear what you are going to do with the next value, so instead I changed it to (work in progress)

public void addNumericField(IndexField field, Integer value) {
        FieldType ft = new FieldType();
        ft.setStored(true);
        ft.setIndexed(true);
        ft.setNumericType(FieldType.NumericType.INT);
        doc.add(new IntField(field.getName(), value, ft));
    }

which seemed tidier

In 3.6, I also add queryparser to override to make it work for finding a number range,

package org.musicbrainz.search.servlet;

import org.apache.lucene.index.Term;
import org.apache.lucene.queryparser.classic.MultiFieldQueryParser;
import org.apache.lucene.search.Query;
import org.apache.lucene.search.TermQuery;
import org.apache.lucene.search.TermRangeQuery;
import org.apache.lucene.util.NumericUtils;
import org.musicbrainz.search.LuceneVersion;
import org.musicbrainz.search.index.LabelIndexField;
import org.musicbrainz.search.servlet.mmd1.LabelType;

public class LabelQueryParser extends MultiFieldQueryParser {

    public LabelQueryParser(java.lang.String[] strings, org.apache.lucene.analysis.Analyzer analyzer)
    {
        super(LuceneVersion.LUCENE_VERSION, strings, analyzer);
    }

     protected Query newTermQuery(Term term) {

        if(
                (term.field() == LabelIndexField.CODE.getName())
                ){
            try {
                int number = Integer.parseInt(term.text());
                TermQuery tq = new TermQuery(new Term(term.field(), NumericUtils.intToPrefixCoded(number)));
                return tq;
            }
            catch (NumberFormatException nfe) {
                //If not provided numeric argument just leave as is, 
                //won't give matches
                return super.newTermQuery(term);
            }
        } else {
            return super.newTermQuery(term);

        }
    }

    /**
     *
     * Convert Numeric Fields
     *
     * @param field
     * @param part1
     * @param part2
     * @param inclusive
     * @return
     */
    @Override
    public Query newRangeQuery(String field,
                               String part1,
                               String part2,
                               boolean inclusive) {

        if (
                (field.equals(LabelIndexField.CODE.getName()))
            )
        {
            part1 = NumericUtils.intToPrefixCoded(Integer.parseInt(part1));
            part2 = NumericUtils.intToPrefixCoded(Integer.parseInt(part2));
        }
        TermRangeQuery query = (TermRangeQuery)
                super.newRangeQuery(field, part1, part2,inclusive);
        return query;
    }

}

So, I understood everything that I no longer need, but, unfortunately, there are no queries in this IntField now.

Reading further, it seems that Intfields are used only for range queries, so I don’t know how you should just perform query matches, and whether NumericRangeQuery will be compiled with the classic Query Parser that I use.

,

public void addNumericField(IndexField field, Integer value) {

    FieldType fieldType = new FieldType();
    fieldType.setStored(true);
    fieldType.setIndexed(true);
    BytesRef bytes = new BytesRef(NumericUtils.BUF_SIZE_INT);
    NumericUtils.intToPrefixCoded(value, 0, bytes);
    doc.add(new Field(field.getName(),bytes, fieldType));
}

!

java.lang.IllegalArgumentException: Fields with BytesRef values cannot be indexed

, , , , 3.6, .

+5

java search lucene

Paul Taylor 25 . '13 13:35

3

, , lucene 4.7:

:

document.add(new IntField("int_field", int_value, Field.Store.YES));

:

public class MyQueryParser extends QueryParser {

public MyQueryParser(Version matchVersion, String field, Analyzer anlayzer) {
    super(matchVersion, field, anlayzer);
}

@Override
protected Query getRangeQuery(String field, String part1, String part2, boolean startInclusive, boolean endInclusive) throws ParseException {
    if ("int_field".equals(field)) {
        return NumericRangeQuery.newIntRange(field, Integer.parseInt(part1), Integer.parseInt(part2), startInclusive, endInclusive);
    } else {
        return super.getRangeQuery(field, part1, part2, startInclusive, endInclusive);
    }
}

@Override
protected Query newTermQuery(Term term)
{
    if ("int_field".equals(term.field())) {
        try {
            int number = Integer.parseInt(term.text());
            BytesRef bytes = new BytesRef(NumericUtils.BUF_SIZE_INT);
            NumericUtils.intToPrefixCoded(number, 0, bytes);
            TermQuery tq = new TermQuery(new Term(term.field(), bytes.utf8ToString()));
            return tq;
        } catch (NumberFormatException nfe) {
            //If not provided numeric argument just leave as is, won't give matches
            return super.newTermQuery(term);
        }
    } else {
        return super.newTermQuery(term);
    }
}

}

, ,

 int_field: 1
 int_field: [1 TO 5]

.

+2

Jonas Arêas 29 . '14 17:22

So, I have this job, be it the best way to do what I do not know.

Adding a number to the index as a string

FieldType fieldType = new FieldType();
fieldType.setStored(true);
fieldType.setIndexed(true);
BytesRef bytes = new BytesRef(NumericUtils.BUF_SIZE_INT);
NumericUtils.intToPrefixCoded(value, 0, bytes);
doc.add(new Field(field.getName(),bytes.utf8ToString(), fieldType));

QueryParser, it is necessary to check the name of the field using equals (), previously == could be used

protected Query newTermQuery(Term term)
{

   if (term.field().equals(LabelIndexField.CODE.getName()))
    {
        try
        {

            int number = Integer.parseInt(term.text());
            BytesRef bytes = new BytesRef(NumericUtils.BUF_SIZE_INT);
            NumericUtils.intToPrefixCoded(number, 0, bytes);
            TermQuery tq = new TermQuery(new Term(term.field(), bytes.utf8ToString()));
            return tq;
        }
        catch (NumberFormatException nfe)
        {
            //If not provided numeric argument just leave as is, won't give matches
            return super.newTermQuery(term);
        }
    }
    else
    {
        return super.newTermQuery(term);

    }
}

The signature of newRangeQuery () has also been changed, there is an additional parameter endInclusive

public Query newRangeQuery(String field,
                           String part1,
                           String part2,
                           boolean startInclusive,
                           boolean endInclusive)
{
    if (
            (field.equals(LabelIndexField.CODE.getName()))
            )
    {
        BytesRef bytes1 = new BytesRef(NumericUtils.BUF_SIZE_INT);
        BytesRef bytes2 = new BytesRef(NumericUtils.BUF_SIZE_INT);
        NumericUtils.intToPrefixCoded(Integer.parseInt(part1), 0, bytes1);
        NumericUtils.intToPrefixCoded(Integer.parseInt(part2), 0, bytes2);
        part1 = bytes1.utf8ToString();
        part2 = bytes2.utf8ToString();
    }
    TermRangeQuery query = (TermRangeQuery)
            super.newRangeQuery(field, part1, part2, startInclusive, endInclusive);
    return query;

}