How does text-rev work?

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

How does text-rev work?

Alexandre Rafalovitch
I am looking at the collection1/techproducts schema and I can't figure
out how the reversed wildcard example is supposed to work.

We define text_general_rev type and text_rev field, but we don't seem
to be populating it at any point. And running the example does not
seem to show any tokens in the field even when the non-inverted text
field does have some.

Apparently, there is some magic in the QueryParser to do something
about this at query time, but I see no explanation of what is supposed
to happen at the index/schema time.

Anybody has the skinny on this one?

Regards,
   Alex.
----
Sign up for my Solr resources newsletter at http://www.solr-start.com/
Reply | Threaded
Open this post in threaded view
|

Re: How does text-rev work?

Alexandre Rafalovitch
Anybody? Otherwise, I guess it is a JIRA to delete the unused field?

Regards,
   Alex.
----
Sign up for my Solr resources newsletter at http://www.solr-start.com/


On 28 December 2014 at 13:16, Alexandre Rafalovitch <[hidden email]> wrote:

> I am looking at the collection1/techproducts schema and I can't figure
> out how the reversed wildcard example is supposed to work.
>
> We define text_general_rev type and text_rev field, but we don't seem
> to be populating it at any point. And running the example does not
> seem to show any tokens in the field even when the non-inverted text
> field does have some.
>
> Apparently, there is some magic in the QueryParser to do something
> about this at query time, but I see no explanation of what is supposed
> to happen at the index/schema time.
>
> Anybody has the skinny on this one?
>
> Regards,
>    Alex.
> ----
> Sign up for my Solr resources newsletter at http://www.solr-start.com/
Reply | Threaded
Open this post in threaded view
|

Re: How does text-rev work?

Jack Krupansky-3
Or a Jira to document it.

The basic idea is that if a normal leading wildcard is too slow, the user
can index a copy of their text fields using the text_rev type, which
indexes terms with their characters reversed and with a special marker.
Then the query parser detects a leading wildcard and that the field type
uses the reversed wildcard filter, and then it generates a wildcard query
that using the reversed query token and wildcard pattern so that the
leading wildcard becomes a trailing wildcard or prefix query


-- Jack Krupansky

On Fri, Jan 9, 2015 at 3:15 PM, Alexandre Rafalovitch <[hidden email]>
wrote:

> Anybody? Otherwise, I guess it is a JIRA to delete the unused field?
>
> Regards,
>    Alex.
> ----
> Sign up for my Solr resources newsletter at http://www.solr-start.com/
>
>
> On 28 December 2014 at 13:16, Alexandre Rafalovitch <[hidden email]>
> wrote:
> > I am looking at the collection1/techproducts schema and I can't figure
> > out how the reversed wildcard example is supposed to work.
> >
> > We define text_general_rev type and text_rev field, but we don't seem
> > to be populating it at any point. And running the example does not
> > seem to show any tokens in the field even when the non-inverted text
> > field does have some.
> >
> > Apparently, there is some magic in the QueryParser to do something
> > about this at query time, but I see no explanation of what is supposed
> > to happen at the index/schema time.
> >
> > Anybody has the skinny on this one?
> >
> > Regards,
> >    Alex.
> > ----
> > Sign up for my Solr resources newsletter at http://www.solr-start.com/
>
Reply | Threaded
Open this post in threaded view
|

Re: How does text-rev work?

Alexandre Rafalovitch
So, Query Parser does some sort of magic and looks for the field with
the same name and _rev suffix?

But what populates that field? In the example schema, it seems to be
standalone and empty. Is there a copyField missing?

Regards,
   Alex.
----
Sign up for my Solr resources newsletter at http://www.solr-start.com/


On 9 January 2015 at 17:07, Jack Krupansky <[hidden email]> wrote:

> Or a Jira to document it.
>
> The basic idea is that if a normal leading wildcard is too slow, the user
> can index a copy of their text fields using the text_rev type, which
> indexes terms with their characters reversed and with a special marker.
> Then the query parser detects a leading wildcard and that the field type
> uses the reversed wildcard filter, and then it generates a wildcard query
> that using the reversed query token and wildcard pattern so that the
> leading wildcard becomes a trailing wildcard or prefix query
>
>
> -- Jack Krupansky
>
> On Fri, Jan 9, 2015 at 3:15 PM, Alexandre Rafalovitch <[hidden email]>
> wrote:
>
>> Anybody? Otherwise, I guess it is a JIRA to delete the unused field?
>>
>> Regards,
>>    Alex.
>> ----
>> Sign up for my Solr resources newsletter at http://www.solr-start.com/
>>
>>
>> On 28 December 2014 at 13:16, Alexandre Rafalovitch <[hidden email]>
>> wrote:
>> > I am looking at the collection1/techproducts schema and I can't figure
>> > out how the reversed wildcard example is supposed to work.
>> >
>> > We define text_general_rev type and text_rev field, but we don't seem
>> > to be populating it at any point. And running the example does not
>> > seem to show any tokens in the field even when the non-inverted text
>> > field does have some.
>> >
>> > Apparently, there is some magic in the QueryParser to do something
>> > about this at query time, but I see no explanation of what is supposed
>> > to happen at the index/schema time.
>> >
>> > Anybody has the skinny on this one?
>> >
>> > Regards,
>> >    Alex.
>> > ----
>> > Sign up for my Solr resources newsletter at http://www.solr-start.com/
>>
Reply | Threaded
Open this post in threaded view
|

Re: How does text-rev work?

Jack Krupansky-3
No, it's just what I said. Read the original Jira (from Solr 1.4!):
https://issues.apache.org/jira/browse/SOLR-1321

You, the user, need to specify and  populate a reversed wildcard field if
that is want you want - it is not magic and not automatic.

This should be documented as an "expert" feature. And there should be doc
on how to use it.

I do have some doc in my e-book, with some examples, but even that does not
show the complete end-to-end config and schema.


-- Jack Krupansky

On Sat, Jan 10, 2015 at 1:13 AM, Alexandre Rafalovitch <[hidden email]>
wrote:

> So, Query Parser does some sort of magic and looks for the field with
> the same name and _rev suffix?
>
> But what populates that field? In the example schema, it seems to be
> standalone and empty. Is there a copyField missing?
>
> Regards,
>    Alex.
> ----
> Sign up for my Solr resources newsletter at http://www.solr-start.com/
>
>
> On 9 January 2015 at 17:07, Jack Krupansky <[hidden email]>
> wrote:
> > Or a Jira to document it.
> >
> > The basic idea is that if a normal leading wildcard is too slow, the user
> > can index a copy of their text fields using the text_rev type, which
> > indexes terms with their characters reversed and with a special marker.
> > Then the query parser detects a leading wildcard and that the field type
> > uses the reversed wildcard filter, and then it generates a wildcard query
> > that using the reversed query token and wildcard pattern so that the
> > leading wildcard becomes a trailing wildcard or prefix query
> >
> >
> > -- Jack Krupansky
> >
> > On Fri, Jan 9, 2015 at 3:15 PM, Alexandre Rafalovitch <
> [hidden email]>
> > wrote:
> >
> >> Anybody? Otherwise, I guess it is a JIRA to delete the unused field?
> >>
> >> Regards,
> >>    Alex.
> >> ----
> >> Sign up for my Solr resources newsletter at http://www.solr-start.com/
> >>
> >>
> >> On 28 December 2014 at 13:16, Alexandre Rafalovitch <[hidden email]
> >
> >> wrote:
> >> > I am looking at the collection1/techproducts schema and I can't figure
> >> > out how the reversed wildcard example is supposed to work.
> >> >
> >> > We define text_general_rev type and text_rev field, but we don't seem
> >> > to be populating it at any point. And running the example does not
> >> > seem to show any tokens in the field even when the non-inverted text
> >> > field does have some.
> >> >
> >> > Apparently, there is some magic in the QueryParser to do something
> >> > about this at query time, but I see no explanation of what is supposed
> >> > to happen at the index/schema time.
> >> >
> >> > Anybody has the skinny on this one?
> >> >
> >> > Regards,
> >> >    Alex.
> >> > ----
> >> > Sign up for my Solr resources newsletter at
> http://www.solr-start.com/
> >>
>