Quepid, the relevance testing tool for Solr, released as open source
We've finally made Quepid, the relevance testing tool, open source.
There's also a free hosted version at www.quepid.com . Looking forward
to contributions driving the project forward! Quepid is a way to record
human relevance judgements, and then to experiment with query tuning and
see the results in real time.
Re: Quepid, the relevance testing tool for Solr, released as open source
Quepid has been really powerful for helping teams bootstsrap on relevance
problems for teams just getting started and allowing the product & tech
teams to collaborate.
Often we start with a dozen or so queries, get some ratings, create a bit
of success criteria and tune in Quepid. You can do this in a 'sprint' like
structure, where the next 'sprint' you tackle the next dozen or so queries,
ensure the stuff you fixed before is still working, and make progress on
the next set of use cases. During the process, you get a lot of feedback
you can give to the product team about 'why' results are ranked the way
they work in a relevance tuning sandbox.
I would contrast this with RRE, that you might have heard of, which has
different strengths. For example, if I wanted to automate or do a bit more
"CI" kinds of relevance evaluation, without the interactive "IDE" that
Quarite is another tool in the genre from Tim Allison. I (think) it also
adds features for genetic optimization of relevance parameters
Very cool to see the ecosystem of relevance tuning tools growing!
> Hi all,
> We've finally made Quepid, the relevance testing tool, open source.
> There's also a free hosted version at www.quepid.com . Looking forward
> to contributions driving the project forward! Quepid is a way to record
> human relevance judgements, and then to experiment with query tuning and
> see the results in real time.
> More details at
> https://opensourceconnections.com/blog/2019/07/25/2019-07-22-quepid-is-now-open-source/ >
> (also particularly pleased to see Luwak, the stored query engine we
> built at Flax become part of Lucene - it's a great day for open source!)
> Charlie Hull
> Flax - Open Source Enterprise Search
> tel/fax: +44 (0)8700 118334
> mobile: +44 (0)7767 825828
> web: www.flax.co.uk
*Doug Turnbull **| CTO* | OpenSource Connections
<http://opensourceconnections.com>, LLC | 240.476.9983
Author: Relevant Search <http://manning.com/turnbull>
This e-mail and all contents, including attachments, is considered to be
Company Confidential unless explicitly stated otherwise, regardless
of whether attachments are marked as such.