Blog

Quepid: Write Tests Against Your Search Results

Quepid: Relevancy Solved
Quepid: Relevancy Solved
Update ( March 20,2021 )!  This function, while very valuable, wasn’t easily used by most Relevance Engineers, and so we’ve made the painful decision to remove it.   We’re looking for ways to add this back in a more intuitive fashion.  Learn more at https://github.com/o19s/quepid/issues/290.

Quepid is our “Test Driven Search Relevancy” workbench product actively used by several clients. What do we mean by test-driven relevancy? We want to give you the ability to iterate quickly when creating a search solution. Sometimes the correctness of search results is fuzzy – based on how users or domain experts grade search results. Quepid has supported this since day one.

But you know what? Many times we just want to just make an assertion about our search results. If I search for “dress shoes” I want to assert that every search result is from the “shoes” department, and not dresses. I want to tweak my relevancy settings boosts and other parameters and be able to visually see what passes and what fails – driving closer and closer to all searches passing my important criteria.

I want to iterate like a speed-chess player. I want to express exactly what a passing or failing search is in a workbench that can tell me exactly what the search engine is thinking.

That’s Quepid.

Quepid now lets write your own Javascript tests against your search results. Observe as we write a really basic test for this query in our Cables-R-Us fake ecommerce website:

writing a test for Quepid asserting there's search results and the 1st item has Cysco in the title.

writing a test for Quepid asserting theres search results and the 1st item has Cysco in the title.

See the documentation to see whats possible.

And that’s not all! Did your test fail? Be sure to check the friendly explain parsing that let’s you know what search matches mattered the most in relevancy ranking:

It Broke! Check out the explain to see what matched to drive search closer to expectations

It Broke! Check out the explain to see what matched to drive search closer to expectations

So check out Quepid and start testing your search today! And contact us if youd like to talk to us about how we can use Quepid to build better search for you! (heres a sample of the kind of work we do).