RAG and search
Scaling Test-Time Compute in Search Mode
Our short summary of Weaviate’s engineering write-up. The full story, with all the detail, is on their blog.
Read the full write-up on weaviate.io (opens in a new tab)Problem
Complex queries needed better search accuracy, but users also cared about speed and cost.
Solution
Added an effort setting that lets the query agent spend more time breaking down queries and reranking results, with three tiers from medium to ultrahigh.
nDCG@10 57.5 vs 13.0
Want the architecture, code and numbers? They’re in the original post.
Read the full write-up on weaviate.io (opens in a new tab)
Vespa