HQANN: Efficient and Robust Similarity Search for Hybrid Queries with Structured and Unstructured Constraints
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:VXQCRFHZrecord.jsonopen to challenge →
read the original abstract
The in-memory approximate nearest neighbor search (ANNS) algorithms have achieved great success for fast high-recall query processing, but are extremely inefficient when handling hybrid queries with unstructured (i.e., feature vectors) and structured (i.e., related attributes) constraints. In this paper, we present HQANN, a simple yet highly efficient hybrid query processing framework which can be easily embedded into existing proximity graph-based ANNS algorithms. We guarantee both low latency and high recall by leveraging navigation sense among attributes and fusing vector similarity search with attribute filtering. Experimental results on both public and in-house datasets demonstrate that HQANN is 10x faster than the state-of-the-art hybrid ANNS solutions to reach the same recall quality and its performance is hardly affected by the complexity of attributes. It can reach 99\% recall@10 in just around 50 microseconds On GLOVE-1.2M with thousands of attribute constraints.
This paper has not been read by Pith yet.
Forward citations
Cited by 1 Pith paper
-
Query-aware Routing for Filtered Approximate Nearest Neighbors Search
A machine-learned router predicts per-query recall for filtered ANN methods and selects the recall-QPS optimal one, outperforming fixed baselines on five unseen datasets.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.