AI engineering glossary · RAG vector search

What is rescoring?

Rescoring (also called Oversampling and rescoring): Re-computing exact or higher-precision similarity for a shortlist found with compressed vectors, then reordering it. It recovers much of the accuracy lost to quantisation while keeping most of the speed benefit.

Level: advancedTopic: RAG vector search

Rescoring: an example

Binary vectors find 200 candidates, and full-precision vectors rescore them to give the final top 10.

Related terms

More RAG vector search terms

Where you learn it

Rescoring is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.