Pith. sign in

REVIEW 5 cited by

SOAR: Improved Indexing for Approximate Nearest Neighbor Search

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2404.00774 v1 pith:4YEJJAL5 submitted 2024-03-31 cs.LG

SOAR: Improved Indexing for Approximate Nearest Neighbor Search

classification cs.LG
keywords searchsoarindexingnearestneighborrepresentationsapproximatedata
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

This paper introduces SOAR: Spilling with Orthogonality-Amplified Residuals, a novel data indexing technique for approximate nearest neighbor (ANN) search. SOAR extends upon previous approaches to ANN search, such as spill trees, that utilize multiple redundant representations while partitioning the data to reduce the probability of missing a nearest neighbor during search. Rather than training and computing these redundant representations independently, however, SOAR uses an orthogonality-amplified residual loss, which optimizes each representation to compensate for cases where other representations perform poorly. This drastically improves the overall index quality, resulting in state-of-the-art ANN benchmark performance while maintaining fast indexing times and low memory consumption.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. A Replicability Study of XTR

    cs.IR 2026-05 accept novelty 6.0

    XTR training does not improve retrieval effectiveness over ColBERT but enhances IVF engine efficiency by flattening token scores to produce more discriminative centroids.

  2. Vectorizing the Trie: Efficient Constrained Decoding for LLM-based Generative Retrieval on Accelerators

    cs.IR 2026-02 conditional novelty 6.0

    Constrained decoding for generative retrieval can be made accelerator-friendly by flattening the trie of valid items into a CSR sparse matrix and doing branch-free vectorized lookups.

  3. RACORN-1: Adaptive Recall-Preserving Speedup for Low-Selectivity Filtered Vector Search

    cs.DB 2026-07 unverdicted novelty 5.0

    RACORN-1 adds adaptive search fallback to ACORN-1 to fix recall collapse at low selectivity in filtered vector search, achieving 9-26x speedups over HNSW with recovered recall on 1M-40M datasets.

  4. Health System Scale Semantic Search Across Unstructured Clinical Notes

    cs.IR 2026-04 conditional novelty 5.0

    Production semantic search over 166M clinical notes achieves sub-second latency at ~$4k/month and recovers 98% of genetic-disease patients versus ≤75% by ICD-10 codes.

  5. Health System Scale Semantic Search Across Unstructured Clinical Notes

    cs.IR 2026-04 unverdicted novelty 4.0

    A semantic search system was deployed at health-system scale across 166 million clinical notes, delivering sub-second latency, ~$4000 monthly cost, and 24-89% faster chart abstraction with maintained agreement.