REVIEW 3 cited by
Learning Dense Representations for Entity Retrieval
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We show that it is feasible to perform entity linking by training a dual encoder (two-tower) model that encodes mentions and entities in the same dense vector space, where candidate entities are retrieved by approximate nearest neighbor search. Unlike prior work, this setup does not rely on an alias table followed by a re-ranker, and is thus the first fully learned entity retrieval model. We show that our dual encoder, trained using only anchor-text links in Wikipedia, outperforms discrete alias table and BM25 baselines, and is competitive with the best comparable results on the standard TACKBP-2010 dataset. In addition, it can retrieve candidates extremely fast, and generalizes well to a new dataset derived from Wikinews. On the modeling side, we demonstrate the dramatic value of an unsupervised negative mining algorithm for this task.
Forward citations
Cited by 3 Pith papers
-
Real-Time Hard Negative Sampling via LLM-based Clustering for Large-Scale Two-Tower Retrieval
Cluster-based real-time out-of-batch negatives drawn from LLM media embeddings outperform industry-standard negative sampling for two-tower retrieval and cut popularity bias.
-
Locality-Sensitive Hashing for Efficient Hard Negative Sampling in Contrastive Learning
Binary LSH codes found by Hamming distance provide hard negatives for supervised contrastive learning at a fraction of the compute cost of exact pre-epoch sampling, with comparable or better accuracy on six benchmarks.
-
A Hybrid Cross-Stage Coordination Pre-ranking Model for Online Recommendation Systems
A hybrid pre-ranking model that combines ranking-sequence consistency training with margin-based contrastive learning on unexposed items improves recommendation accuracy, especially for long-tail items.
Discussion (0). Continue with ORCID to comment.