matches missing highlight information

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

matches missing highlight information

Kudrettin Güleryüz
Hi,

For some queries, response object returns matches without any highlight
information. Solr node doesn't report any errors in Solr log.
query term is g12312 number of matches is 7 only 4 of them gets highlight
snippets. Any suggestions?

 "highlighting":{
    ".../sources/test.cpp":{
      "bodync":[" \n\n**************/\n\n\n/* Repro definition problem
*/\n/* %highlightpre%g12312%highlightpost% example of how to"]},
    ".../sources/database.cpp":{
      "bodync":[" 12/01/2017 %highlightpre%g12312%highlightpost%\n
 // was done in here because"]},
    ".../sources/predef.c":{
      "bodync":[" create_definitions(a_boolean inst)\n/*
%highlightpre%g12312%highlightpost% Replace _definitions.h by
built-in"]},
    ".../sources/init.c":{
      "bodync":[") {\n    create_descs();\n  }\n  /*T
%highlightpre%g12312%highlightpost% 13/01/2017. Replace\n
prev_definitions.h by G"]},
    ".../sources/eproc.c":{},
    ".../sources/cro.c":{},
    ".../sources/cmd.c":{}}}

7.3.1 here.

Thank you,
Kudret
Reply | Threaded
Open this post in threaded view
|

Re: matches missing highlight information

Zheng Lin Edwin Yeo
Hi Kudret,

What is your configuration for your /highlight requestHandler in
solrconfig.xml?
And also the query that you used when you get your above output?

Regards,
Edwin

On Fri, 28 Sep 2018 at 07:33, Kudrettin Güleryüz <[hidden email]>
wrote:

> Hi,
>
> For some queries, response object returns matches without any highlight
> information. Solr node doesn't report any errors in Solr log.
> query term is g12312 number of matches is 7 only 4 of them gets highlight
> snippets. Any suggestions?
>
>  "highlighting":{
>     ".../sources/test.cpp":{
>       "bodync":[" \n\n**************/\n\n\n/* Repro definition problem
> */\n/* %highlightpre%g12312%highlightpost% example of how to"]},
>     ".../sources/database.cpp":{
>       "bodync":[" 12/01/2017 %highlightpre%g12312%highlightpost%\n
>  // was done in here because"]},
>     ".../sources/predef.c":{
>       "bodync":[" create_definitions(a_boolean inst)\n/*
> %highlightpre%g12312%highlightpost% Replace _definitions.h by
> built-in"]},
>     ".../sources/init.c":{
>       "bodync":[") {\n    create_descs();\n  }\n  /*T
> %highlightpre%g12312%highlightpost% 13/01/2017. Replace\n
> prev_definitions.h by G"]},
>     ".../sources/eproc.c":{},
>     ".../sources/cro.c":{},
>     ".../sources/cmd.c":{}}}
>
> 7.3.1 here.
>
> Thank you,
> Kudret
>
Reply | Threaded
Open this post in threaded view
|

Re: matches missing highlight information

Kudrettin Güleryüz
Hi Edwin,

I do not have any modifications in solrconfig.xml for highlighting. Here is
the query:
http://test-51:8983/solr/mycollection/select?hl.fl=bodync&hl.simple.post=%25highlightpost%25&hl.simple.pre=%25highlightpre%25&hl=on&q=bodync:g12312

Kudret


On Fri, Sep 28, 2018 at 2:09 AM Zheng Lin Edwin Yeo <[hidden email]>
wrote:

> Hi Kudret,
>
> What is your configuration for your /highlight requestHandler in
> solrconfig.xml?
> And also the query that you used when you get your above output?
>
> Regards,
> Edwin
>
> On Fri, 28 Sep 2018 at 07:33, Kudrettin Güleryüz <[hidden email]>
> wrote:
>
> > Hi,
> >
> > For some queries, response object returns matches without any highlight
> > information. Solr node doesn't report any errors in Solr log.
> > query term is g12312 number of matches is 7 only 4 of them gets highlight
> > snippets. Any suggestions?
> >
> >  "highlighting":{
> >     ".../sources/test.cpp":{
> >       "bodync":[" \n\n**************/\n\n\n/* Repro definition problem
> > */\n/* %highlightpre%g12312%highlightpost% example of how to"]},
> >     ".../sources/database.cpp":{
> >       "bodync":[" 12/01/2017 %highlightpre%g12312%highlightpost%\n
> >  // was done in here because"]},
> >     ".../sources/predef.c":{
> >       "bodync":[" create_definitions(a_boolean inst)\n/*
> > %highlightpre%g12312%highlightpost% Replace _definitions.h by
> > built-in"]},
> >     ".../sources/init.c":{
> >       "bodync":[") {\n    create_descs();\n  }\n  /*T
> > %highlightpre%g12312%highlightpost% 13/01/2017. Replace\n
> > prev_definitions.h by G"]},
> >     ".../sources/eproc.c":{},
> >     ".../sources/cro.c":{},
> >     ".../sources/cmd.c":{}}}
> >
> > 7.3.1 here.
> >
> > Thank you,
> > Kudret
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: matches missing highlight information

Zheng Lin Edwin Yeo
Hi Kudret,

Do you mean there are 7 documents that matches the query term, but the
result only return 4 of them?
Or is it that there are 4 documents that matches the query term, but there
are 7 occurrences of the query term in these 4 documents?

Regards,
Edwin

On Fri, 28 Sep 2018 at 22:47, Kudrettin Güleryüz <[hidden email]>
wrote:

> Hi Edwin,
>
> I do not have any modifications in solrconfig.xml for highlighting. Here is
> the query:
>
> http://test-51:8983/solr/mycollection/select?hl.fl=bodync&hl.simple.post=%25highlightpost%25&hl.simple.pre=%25highlightpre%25&hl=on&q=bodync:g12312
>
> Kudret
>
>
> On Fri, Sep 28, 2018 at 2:09 AM Zheng Lin Edwin Yeo <[hidden email]>
> wrote:
>
> > Hi Kudret,
> >
> > What is your configuration for your /highlight requestHandler in
> > solrconfig.xml?
> > And also the query that you used when you get your above output?
> >
> > Regards,
> > Edwin
> >
> > On Fri, 28 Sep 2018 at 07:33, Kudrettin Güleryüz <[hidden email]>
> > wrote:
> >
> > > Hi,
> > >
> > > For some queries, response object returns matches without any highlight
> > > information. Solr node doesn't report any errors in Solr log.
> > > query term is g12312 number of matches is 7 only 4 of them gets
> highlight
> > > snippets. Any suggestions?
> > >
> > >  "highlighting":{
> > >     ".../sources/test.cpp":{
> > >       "bodync":[" \n\n**************/\n\n\n/* Repro definition problem
> > > */\n/* %highlightpre%g12312%highlightpost% example of how to"]},
> > >     ".../sources/database.cpp":{
> > >       "bodync":[" 12/01/2017 %highlightpre%g12312%highlightpost%\n
> > >  // was done in here because"]},
> > >     ".../sources/predef.c":{
> > >       "bodync":[" create_definitions(a_boolean inst)\n/*
> > > %highlightpre%g12312%highlightpost% Replace _definitions.h by
> > > built-in"]},
> > >     ".../sources/init.c":{
> > >       "bodync":[") {\n    create_descs();\n  }\n  /*T
> > > %highlightpre%g12312%highlightpost% 13/01/2017. Replace\n
> > > prev_definitions.h by G"]},
> > >     ".../sources/eproc.c":{},
> > >     ".../sources/cro.c":{},
> > >     ".../sources/cmd.c":{}}}
> > >
> > > 7.3.1 here.
> > >
> > > Thank you,
> > > Kudret
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: matches missing highlight information

Kudrettin Güleryüz
query "g12312" matches 7 documents. Fields requested are returned for all 7
documents that matches the query mentioned. For three of the matching
documents highlight snippet is not generated. Can you explain why
highlighting snippets could be absent for some of the documents?

    ".../sources/eproc.c":{},
    ".../sources/cro.c":{},
    ".../sources/cmd.c":{}}}


Thank you,
Kudret



On Sun, Sep 30, 2018 at 10:10 PM Zheng Lin Edwin Yeo <[hidden email]>
wrote:

> Hi Kudret,
>
> Do you mean there are 7 documents that matches the query term, but the
> result only return 4 of them?
> Or is it that there are 4 documents that matches the query term, but there
> are 7 occurrences of the query term in these 4 documents?
>
> Regards,
> Edwin
>
> On Fri, 28 Sep 2018 at 22:47, Kudrettin Güleryüz <[hidden email]>
> wrote:
>
> > Hi Edwin,
> >
> > I do not have any modifications in solrconfig.xml for highlighting. Here
> is
> > the query:
> >
> >
> http://test-51:8983/solr/mycollection/select?hl.fl=bodync&hl.simple.post=%25highlightpost%25&hl.simple.pre=%25highlightpre%25&hl=on&q=bodync:g12312
> >
> > Kudret
> >
> >
> > On Fri, Sep 28, 2018 at 2:09 AM Zheng Lin Edwin Yeo <
> [hidden email]>
> > wrote:
> >
> > > Hi Kudret,
> > >
> > > What is your configuration for your /highlight requestHandler in
> > > solrconfig.xml?
> > > And also the query that you used when you get your above output?
> > >
> > > Regards,
> > > Edwin
> > >
> > > On Fri, 28 Sep 2018 at 07:33, Kudrettin Güleryüz <[hidden email]>
> > > wrote:
> > >
> > > > Hi,
> > > >
> > > > For some queries, response object returns matches without any
> highlight
> > > > information. Solr node doesn't report any errors in Solr log.
> > > > query term is g12312 number of matches is 7 only 4 of them gets
> > highlight
> > > > snippets. Any suggestions?
> > > >
> > > >  "highlighting":{
> > > >     ".../sources/test.cpp":{
> > > >       "bodync":[" \n\n**************/\n\n\n/* Repro definition
> problem
> > > > */\n/* %highlightpre%g12312%highlightpost% example of how to"]},
> > > >     ".../sources/database.cpp":{
> > > >       "bodync":[" 12/01/2017 %highlightpre%g12312%highlightpost%\n
> > > >  // was done in here because"]},
> > > >     ".../sources/predef.c":{
> > > >       "bodync":[" create_definitions(a_boolean inst)\n/*
> > > > %highlightpre%g12312%highlightpost% Replace _definitions.h by
> > > > built-in"]},
> > > >     ".../sources/init.c":{
> > > >       "bodync":[") {\n    create_descs();\n  }\n  /*T
> > > > %highlightpre%g12312%highlightpost% 13/01/2017. Replace\n
> > > > prev_definitions.h by G"]},
> > > >     ".../sources/eproc.c":{},
> > > >     ".../sources/cro.c":{},
> > > >     ".../sources/cmd.c":{}}}
> > > >
> > > > 7.3.1 here.
> > > >
> > > > Thank you,
> > > > Kudret
> > > >
> > >
> >
>
Reply | Threaded
Open this post in threaded view
|

Re: matches missing highlight information

Zheng Lin Edwin Yeo
Have you tried to set hl.maxAnalyzedChar? If not, the highlighting will not
look past the first 51,200 characters of the documents for the snippets.

You can check the guide for more information:
https://lucene.apache.org/solr/guide/7_5/highlighting.html

Regards,
Edwin



On Mon, 1 Oct 2018 at 20:43, Kudrettin Güleryüz <[hidden email]> wrote:

> query "g12312" matches 7 documents. Fields requested are returned for all 7
> documents that matches the query mentioned. For three of the matching
> documents highlight snippet is not generated. Can you explain why
> highlighting snippets could be absent for some of the documents?
>
>     ".../sources/eproc.c":{},
>     ".../sources/cro.c":{},
>     ".../sources/cmd.c":{}}}
>
>
> Thank you,
> Kudret
>
>
>
> On Sun, Sep 30, 2018 at 10:10 PM Zheng Lin Edwin Yeo <[hidden email]
> >
> wrote:
>
> > Hi Kudret,
> >
> > Do you mean there are 7 documents that matches the query term, but the
> > result only return 4 of them?
> > Or is it that there are 4 documents that matches the query term, but
> there
> > are 7 occurrences of the query term in these 4 documents?
> >
> > Regards,
> > Edwin
> >
> > On Fri, 28 Sep 2018 at 22:47, Kudrettin Güleryüz <[hidden email]>
> > wrote:
> >
> > > Hi Edwin,
> > >
> > > I do not have any modifications in solrconfig.xml for highlighting.
> Here
> > is
> > > the query:
> > >
> > >
> >
> http://test-51:8983/solr/mycollection/select?hl.fl=bodync&hl.simple.post=%25highlightpost%25&hl.simple.pre=%25highlightpre%25&hl=on&q=bodync:g12312
> > >
> > > Kudret
> > >
> > >
> > > On Fri, Sep 28, 2018 at 2:09 AM Zheng Lin Edwin Yeo <
> > [hidden email]>
> > > wrote:
> > >
> > > > Hi Kudret,
> > > >
> > > > What is your configuration for your /highlight requestHandler in
> > > > solrconfig.xml?
> > > > And also the query that you used when you get your above output?
> > > >
> > > > Regards,
> > > > Edwin
> > > >
> > > > On Fri, 28 Sep 2018 at 07:33, Kudrettin Güleryüz <
> [hidden email]>
> > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > For some queries, response object returns matches without any
> > highlight
> > > > > information. Solr node doesn't report any errors in Solr log.
> > > > > query term is g12312 number of matches is 7 only 4 of them gets
> > > highlight
> > > > > snippets. Any suggestions?
> > > > >
> > > > >  "highlighting":{
> > > > >     ".../sources/test.cpp":{
> > > > >       "bodync":[" \n\n**************/\n\n\n/* Repro definition
> > problem
> > > > > */\n/* %highlightpre%g12312%highlightpost% example of how to"]},
> > > > >     ".../sources/database.cpp":{
> > > > >       "bodync":[" 12/01/2017 %highlightpre%g12312%highlightpost%\n
> > > > >  // was done in here because"]},
> > > > >     ".../sources/predef.c":{
> > > > >       "bodync":[" create_definitions(a_boolean inst)\n/*
> > > > > %highlightpre%g12312%highlightpost% Replace _definitions.h by
> > > > > built-in"]},
> > > > >     ".../sources/init.c":{
> > > > >       "bodync":[") {\n    create_descs();\n  }\n  /*T
> > > > > %highlightpre%g12312%highlightpost% 13/01/2017. Replace\n
> > > > > prev_definitions.h by G"]},
> > > > >     ".../sources/eproc.c":{},
> > > > >     ".../sources/cro.c":{},
> > > > >     ".../sources/cmd.c":{}}}
> > > > >
> > > > > 7.3.1 here.
> > > > >
> > > > > Thank you,
> > > > > Kudret
> > > > >
> > > >
> > >
> >
>