Pith. sign in

Paper Citation Record · LEDGER

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks

As of 8 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 5 inbound Pith citation observations for arXiv:2506.21182.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.21182 v1

Coverage vector

measured 24 of 24 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T22:35:13.093148Z

measured 29 of 29 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T05:18:20.949593Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-01T19:26:00.240564Z

Reference resolution

24 of 24 outbound references displayed

  • verified exact2
  • verified fuzzy4
  • unresolved18
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation bc015291-fb3c-4f0c-aea2-a76f91573f7b · outbound

This paper cites write newline.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks write newline

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:11.619868Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:11.619868Z digest=sha256:7b18c9a6b22a5ef0ba7f2e59e6f5af60df7a03920085e3eca16e37f2397a4554

Observation e6954651-7d59-49df-9a64-0400f6dd7706 · outbound

This paper cites Recent advances in text embedding: A Comprehensive Review of Top-Performing Methods on the MTEB Benchmark.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks Recent advances in text embedding: A Comprehensive Review of Top-Performing Methods on the MTEB Benchmark

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:11.703675Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:11.703675Z digest=sha256:023773b8877367a50adbe1e9da5a609ecfe057596f609b378232adcbfff4057e

Observation e7661e68-b4f1-48e1-b046-b8783de12368 · outbound

This paper cites Writing style matters: An examination of bias and fairness in information retrieval systems.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks Writing style matters: An examination of bias and fairness in information retrieval systems

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:11.785148Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:11.785148Z digest=sha256:0b75c5a1b6d6032301019731cee0ff63ecd2790a5c98ea60217ee2e3282223b5

Observation 5730a9c4-46ad-4ad3-b5e8-92b0d06bd75d · outbound

This paper cites How Contaminated Is Your Benchmark? Quantifying Dataset Leakage in Large Language Models with Kernel Divergence.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks How Contaminated Is Your Benchmark? Quantifying Dataset Leakage in Large Language Models with Kernel Divergence

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:11.856700Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:11.856700Z digest=sha256:602da7254548b9c851b5fc9ed843dcdeadea42721f457738c186ae5a950cc9b5

Observation f7e909dd-0cb8-487f-b3aa-e3ae168bc140 · outbound

This paper cites MTEB-French: Resources for French Sentence Embedding Evaluation and Analysis.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks MTEB-French: Resources for French Sentence Embedding Evaluation and Analysis

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:11.919131Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:11.919131Z digest=sha256:c996c15987a9d63dc8697ea2502a96f4f686172b1606d437da85b03c3c605548

Observation b4502e32-97ba-443b-9ba6-7a9c002d969f · outbound

This paper cites The scandinavian embedding benchmarks: Comprehensive assessment of multilingual and monolingual text embedding.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks The scandinavian embedding benchmarks: Comprehensive assessment of multilingual and monolingual text embedding

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:35:15.052288Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T22:35:11.989356Z digest=sha256:8266da4494385f0cf6c5c3196a0282942f9e913d0d877d42a4caab724c7a6540

Observation 50c1ae63-53c1-405a-8c09-d6f91cb3a81c · outbound

This paper cites O . V., Kundu, A., Bernstorff, M., Xiao, S., Sukhlecha, A., Pahwa, B., Po \'s wiata, R., GV, K. K., Ashraf, S., Auras, D., Pl \.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks O . V., Kundu, A., Bernstorff, M., Xiao, S., Sukhlecha, A., Pahwa, B., Po \'s wiata, R., GV, K. K., Ashraf, S., Auras, D., Pl \

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:35:14.746440Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T22:35:12.090246Z digest=sha256:e618ab24989a02b07d7583162885d2feca45580aec2597565a126de82062be4f

Observation 5304ae2b-603c-46f1-b4b9-f9f663c56264 · outbound

This paper cites ChemTEB: Chemical Text Embedding Benchmark, an Overview of Embedding Models Performance & Efficiency on a Specific Domain.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks ChemTEB: Chemical Text Embedding Benchmark, an Overview of Embedding Models Performance & Efficiency on a Specific Domain

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:12.141761Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:12.141761Z digest=sha256:8e80a659c8a6879fa17f41527373051c14037fb25b28f027190c12ad448fb2b4

Observation fa700ec6-1f63-460f-83c2-d873f5117a93 · outbound

This paper cites CLIP \_benchmark: CLIP -like model evaluation.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks CLIP \_benchmark: CLIP -like model evaluation

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:35:14.357560Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T22:35:12.214337Z digest=sha256:56ce0f54314c13bd7622492efd4e70495d4cfc76c7620a25960893d00413f6d5

Observation 1e6a3426-42b0-4155-9b82-17f09ce97eae · outbound

This paper cites CoIR: A Comprehensive Benchmark for Code Information Retrieval Models.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks CoIR: A Comprehensive Benchmark for Code Information Retrieval Models

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:12.266397Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:12.266397Z digest=sha256:7d62c3bc9ca1338ba64778fdea79f2ae852515a1a1f733c2d9688ef3cd408da7

Observation 14bfc31f-030d-4465-86a8-a96b428aff1d · outbound

This paper cites and Schwartz, R.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks and Schwartz, R

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:12.376026Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:12.376026Z digest=sha256:545dd2e8436189a8946a253458e87027eedf168530c6b473a9b9c90f12fe75cd

Observation 437b6af7-f173-4e8b-895e-b1d14eb418da · outbound

This paper cites Contextual Document Embeddings.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks Contextual Document Embeddings

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:12.409301Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:12.409301Z digest=sha256:cb8bd52c1be739ecbd14ded7967ad59ed82c8e686ce6ffc87245d2ab5ad17bd7

Observation 6ea6d98e-3f2a-4bb7-86f7-29287b24072e · outbound

This paper cites MTEB: Massive Text Embedding Benchmark.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks MTEB: Massive Text Embedding Benchmark

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:12.465163Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:12.465163Z digest=sha256:d8677bc4805fa663602c01154fb38699aa217b65783d26b4d79ea0882147873b

Observation a532fab3-af1e-4153-9bfe-f7fb55546d62 · outbound

This paper cites Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Tasks.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Tasks

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:12.500840Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:12.500840Z digest=sha256:4c069888ca4ee4c6f5fd1e6e9a49e311fb54f3c5213f660f3ad357b592b45dbf

Observation 567bf174-d8ae-46ca-872c-51a53b3af4d0 · outbound

This paper cites Bias in Text Embedding Models.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks Bias in Text Embedding Models

Reference 15

Resolution
verified exact
local_arxiv, observed 2026-08-06T22:35:13.727816Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T22:35:12.560297Z digest=sha256:3469fb4182d806d9d5480682c2ee3abda5bfebe1bc8f72194e951c532add2dd9

Observation 7558f8f8-fd61-4ebb-b809-049679d65395 · outbound

This paper cites Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:12.647599Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:12.647599Z digest=sha256:c4fde3478ba1922276ae19b4042da4028241a0c71ae6450b7c31f6c1fde44581

Observation 37ee8bb3-72cc-41b1-bc78-cfdcfdee0b24 · outbound

This paper cites jina-embeddings-v3: Multilingual Embeddings With Task LoRA.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks jina-embeddings-v3: Multilingual Embeddings With Task LoRA

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:12.692894Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:12.692894Z digest=sha256:4abc7f9b6dd6bc9a250437c482c3ce52a8272c809ee231b852b06826212b7612

Observation c77122c4-a349-4b5b-9da2-d1079678cb2e · outbound

This paper cites BEIR : A heterogeneous benchmark for zero-shot evaluation of information retrieval models.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks BEIR : A heterogeneous benchmark for zero-shot evaluation of information retrieval models

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:35:14.152279Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T22:35:12.743642Z digest=sha256:cdcf84da1ae190722aafcf6c82400b618f23e3b1b9d57ffbf313c50ad6458302

Observation 05c19435-d1dd-44f6-b27a-be4591440e32 · outbound

This paper cites Improving Text Embeddings with Large Language Models.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks Improving Text Embeddings with Large Language Models

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:12.790707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:12.790707Z digest=sha256:337c9bc92fe7d5061fa12ef51ef115627b47df61afa2beb2d4b01119bd28e18e

Observation 2a1f702f-92c1-40f5-b859-4c56cd314c0c · outbound

This paper cites Improving text embeddings with large language models.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks Improving text embeddings with large language models

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:12.833857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:12.833857Z digest=sha256:aa760e2590a20746c6695a3665082ae21375075886987baa0dedd8d495c5f562

Observation f0e46fcb-9758-43b5-85c6-4869c635cddb · outbound

This paper cites Multilingual E5 Text Embeddings: A Technical Report.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks Multilingual E5 Text Embeddings: A Technical Report

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:12.933491Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:12.933491Z digest=sha256:af90a3a6bd0decf9584d3384f8ab13fca3a130ad475defbde7d82fb818011077

Observation 16d5d24d-91fb-422f-bcb3-4cd9c48ba5a2 · outbound

This paper cites German Text Embedding Clustering Benchmark.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks German Text Embedding Clustering Benchmark

Reference 22

Resolution
verified exact
local_arxiv, observed 2026-08-06T22:35:13.447689Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T22:35:12.970001Z digest=sha256:2d3f9599d2ab7077ebeb809a0029607ac8c9ba6a5feaed5a4f9cccce5783440c

Observation fd490549-fd35-4e84-b266-936722eb4d88 · outbound

This paper cites MIEB: Massive Image Embedding Benchmark.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks MIEB: Massive Image Embedding Benchmark

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:13.025135Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:13.025135Z digest=sha256:9228507102afa49ba0ed6d7e6ac357660a507ec986eaca8d8590dc41b7608818

Observation 5fcf5076-d0e0-47bd-bd4f-4755d1da03f8 · outbound

This paper cites C-pack: Packed resources for general chinese embeddings.

Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks C-pack: Packed resources for general chinese embeddings

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-06T22:35:13.093148Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T22:35:13.093148Z digest=sha256:021655c7522747b7409354f8c8bcad1a6b70d609a3a8684e165a83686d16b7c9

Pith citing papers

Observation c9f2b535-989e-47b5-be48-684d42a40569 · inbound

Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaning cites this paper.

Position: Text Embeddings Should Capture Implicit Semantics, Not Just Surface Meaning Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T05:18:20.949593Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T05:18:20.949593Z digest=sha256:3ebd8a8e374acbb813d9d1702b2d4c1d9a7a8771956ca6aa50a225c344b27777

Observation 12dd8bdc-8af7-4542-8dc9-ddce17c36247 · inbound

Llama Nemoretriever Colembed: Top-Performing Text-Image Retrieval Model cites this paper.

Llama Nemoretriever Colembed: Top-Performing Text-Image Retrieval Model Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T19:30:14.449163Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:30:14.449163Z digest=sha256:bffc7ea3f42be0305032daf4e61a0fa7fa11af0147152498e649267330baeaed

Observation 68f5622d-02d6-4ac9-8a53-feb31497a7d3 · inbound

Beyond Bag-of-Patches: Learning Global Layout via Textual Supervision for Late-Interaction Visual Document Retrieval cites this paper.

Beyond Bag-of-Patches: Learning Global Layout via Textual Supervision for Late-Interaction Visual Document Retrieval Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks

Reference 37

Resolution
metadata mismatch
arxiv_id, observed 2026-05-12T08:06:35.758964Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-05-12T01:16:05.097254Z digest=sha256:3f89fa9e4a2dca527f16b04818a8e3d9a81bb3681cf43754c557189f29500660

Observation 62b24ec6-f79a-44ef-8c29-2f325e833a4b · inbound

How Hard is it to Rig a Benchmark? A Social Choice Analysis of Leaderboard Robustness cites this paper.

How Hard is it to Rig a Benchmark? A Social Choice Analysis of Leaderboard Robustness Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-05-25T04:40:24.385258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-25T04:37:01.537128Z digest=sha256:9f004f1fe6dfd043f39c5eb063157e61f19ea66a062d857a94d20ec7634c954f

Observation b3f2d665-0f5e-47be-863b-bff874ba7f29 · inbound

On the Robustness of Multilingual Text Embedding Rankings Across Learning Tasks, Languages, and Benchmark Datasets cites this paper.

On the Robustness of Multilingual Text Embedding Rankings Across Learning Tasks, Languages, and Benchmark Datasets Maintaining MTEB: Towards Long Term Usability and Reproducibility of Embedding Benchmarks

Reference 10

Resolution
metadata mismatch
arxiv_id, observed 2026-07-01T19:26:00.242071Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-06-28T22:43:27.232092Z digest=sha256:49ba418a9ada2bee5c2d94bbd19e4cf2b692195c2cb33ed49c1aba81b0ad8dcf