Pith. sign in

REVIEW 18 cited by

ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2004.12832 v2 pith:EUUBRITO submitted 2020-04-27 cs.IR cs.CL

ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT

classification cs.IR cs.CL
keywords colbertinteractiondocumentmodelsbertdeepqueryranking
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Recent progress in Natural Language Understanding (NLU) is driving fast-paced advances in Information Retrieval (IR), largely owed to fine-tuning deep language models (LMs) for document ranking. While remarkably effective, the ranking models based on these LMs increase computational cost by orders of magnitude over prior approaches, particularly as they must feed each query-document pair through a massive neural network to compute a single relevance score. To tackle this, we present ColBERT, a novel ranking model that adapts deep LMs (in particular, BERT) for efficient retrieval. ColBERT introduces a late interaction architecture that independently encodes the query and the document using BERT and then employs a cheap yet powerful interaction step that models their fine-grained similarity. By delaying and yet retaining this fine-granular interaction, ColBERT can leverage the expressiveness of deep LMs while simultaneously gaining the ability to pre-compute document representations offline, considerably speeding up query processing. Beyond reducing the cost of re-ranking the documents retrieved by a traditional model, ColBERT's pruning-friendly interaction mechanism enables leveraging vector-similarity indexes for end-to-end retrieval directly from a large document collection. We extensively evaluate ColBERT using two recent passage search datasets. Results show that ColBERT's effectiveness is competitive with existing BERT-based models (and outperforms every non-BERT baseline), while executing two orders-of-magnitude faster and requiring four orders-of-magnitude fewer FLOPs per query.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 18 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. BM25 Wins at Scale: A Scaling Study of Retrieval-Augmented Generation Paradigms

    cs.CL 2026-07 conditional novelty 7.0

    On a 28-tier nested enterprise corpus, BM25 becomes the most accurate scalable RAG retriever after ~10M tokens, beating an agentic file-search system by ~20 points at 601M tokens and remaining low-cost.

  2. HAKARI-Bench: A Lightweight Benchmark for Comparing Retrieval Architectures and Efficiency Settings under Unified Conditions

    cs.IR 2026-06 unverdicted novelty 7.0

    HAKARI-Bench reconstructs 35 benchmarks into 551 tasks across 43 languages, reproducing full MTEB, MMTEB, and BEIR rankings with Spearman correlation above 0.97 while supporting efficiency variant comparisons.

  3. Spectral Retrieval: Multi-Scale Sinc Convolution over Token Embeddings for Localized Retrieval in LLM Multi-Agent Systems

    cs.IR 2026-05 unverdicted novelty 7.0

    Spectral Retrieval uses multi-scale sinc convolutions on token embeddings to interpolate between per-token MaxSim and mean-pooling, achieving large gains on synthetic and LIMIT-small benchmarks for localized retrieval.

  4. UnIte: Uncertainty-based Iterative Document Sampling for Domain Adaptation in Information Retrieval

    cs.IR 2026-04 unverdicted novelty 7.0

    UnIte selects target-domain documents for pseudo-query generation by filtering high aleatoric uncertainty and prioritizing high epistemic uncertainty, yielding +2.45 to +3.49 nDCG@10 gains on BEIR with ~4k samples.

  5. BM25 Wins at Scale: A Scaling Study of Retrieval-Augmented Generation Paradigms

    cs.CL 2026-07 conditional novelty 6.0

    On an enterprise corpus scaled from 1.7M to 601M tokens, BM25 beats raw-file agentic search, dense retrieval, and graph RAG at large sizes, crossing near 10M tokens.

  6. AutoIndex: Learning Representation Programs for Retrieval

    cs.IR 2026-07 conditional novelty 6.0

    AutoIndex's agentic search over document-preprocessing programs improves BM25 Recall@100 on all 8 CRUMB tasks by an average of +8.4% relative to full-document indexing.

  7. Semantic Homogenization in Italian Popular Music: A Diachronic Analysis

    cs.CL 2026-07 conditional novelty 6.0

    Sanremo lyrics exhibit rising semantic homogeneity over decades, consistently recovered by full-text, portion, topic and word-level embedding analyses.

  8. Your Embedding Model is SMARTer Than You Think

    cs.IR 2026-05 unverdicted novelty 6.0

    SMART unlocks latent multi-vector capabilities in single-vector embedding models by applying late interaction to frozen hidden states shaped by contrastive training, yielding consistent gains on MMEB-V2 and visual doc...

  9. VLMs Need Words: Vision Language Models Ignore Visual Detail In Favor of Semantic Anchors

    cs.CV 2026-04 unverdicted novelty 6.0

    VLMs bypass visual comparison by recovering semantic labels for nameable entities and hallucinate on unnamable ones, as shown by performance gaps and Logit Lens analysis.

  10. Should We Still Pretrain Encoders with Masked Language Modeling?

    cs.CL 2025-07 accept novelty 6.0

    Controlled ablations of 38 models find MLM superior to CLM on representation benchmarks while CLM offers better data efficiency and stability; a biphasic CLM-then-MLM schedule is optimal under fixed compute and improv...

  11. RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

    cs.CL 2024-01 unverdicted novelty 6.0

    RAPTOR introduces a tree-organized retrieval method using recursive abstractive summaries, achieving a 20% absolute accuracy improvement on the QuALITY benchmark when paired with GPT-4.

  12. Making Mathematical Knowledge Explainable, Accessible and Interoperable Through Large Language Model Integration

    cs.AI 2026-07 conditional novelty 5.0

    An MCP server with vector schema retrieval and Steiner-tree join planning lets LLMs query MathModDB in natural language while staying on curated ontology paths and linking out to Dataverse.

  13. CAMI: Cost-Aware Agent-Guided Multi-Indexing for Semantic Retrieval

    cs.IR 2026-06 unverdicted novelty 5.0

    CAMI frames multi-index construction for semantic retrieval as a budgeted multi-objective portfolio problem and uses agent-guided search plus confidence-aware pruning to find high-recall configurations with reduced ev...

  14. Decision-Aware Memory Cards: Counterfactual-Inspired Context Selection and Compression for Tool-Using LLM Agents

    cs.AI 2026-06 unverdicted novelty 5.0

    CICL scores and compresses context evidence for LLM agents via action-shift and outcome-uplift metrics, lifting hit@1 from 0.58 to 0.78 on 50 SWE-bench retrieval tasks.

  15. SciClaimSeekers at CheckThat! 2026: Retrieving Scientific Sources for Social Media Claims with LLM Reranking

    cs.IR 2026-07 conditional novelty 4.0

    A zero-shot Qwen2.5-14B reranker on top of BM25+E5 hybrid retrieval reaches 64.39 MRR@5 on CLEF-2026 CheckThat! Task 1 English scientific source retrieval, with the LLM contributing most of the gain.

  16. JobMatchAI-An Intelligent Job Matching Platform Using Knowledge Graphs, Semantic Search and Explainable AI

    cs.AI 2026-03 conditional novelty 4.0

    On the new JobSearch-XS benchmark, the hybrid JobMatchAI pipeline reaches NDCG@10 of 0.81 (about 7% over BM25) with a white-box, factor-level reranker and LLM explanations.

  17. The Hitchhiker's Guide to Agentic AI: From Foundations to Systems

    cs.AI 2026-06 unverdicted novelty 2.0

    A comprehensive reference book organizing existing techniques for agentic AI systems across LLM substrate, reasoning, agent design patterns, inter-agent coordination, and production deployment.

  18. The Hitchhiker's Guide to Agentic AI: From Foundations to Systems

    cs.AI 2026-06 unverdicted novelty 1.0

    A survey-style reference book mapping the full agentic-AI stack from transformer internals to production deployment, with no new research result.