Pith. sign in

Paper Citation Record · LEDGER

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems

As of 7 August 2026, this Paper Citation Record lists 57 of 57 outbound references and 0 inbound Pith citation observations for arXiv:2507.07924.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.07924 v1

Coverage vector

measured 57 of 57 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T18:34:46.191064Z

measured 57 of 57 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

57 of 57 outbound references displayed

  • verified exact1
  • verified fuzzy1
  • unresolved55
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 60b43399-20ac-4854-a4f5-58b9184837a8 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.893727Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.893727Z digest=sha256:e398387b127edac10d63222f68e4ee5c43afa00bca5146ed98b1ecaac7f97df8

Observation 8e1f742d-1d54-4ef5-91b9-8eb7316151c1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.167572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.903920Z digest=sha256:74d9f65390f3c2c0be17f1daf1eb0f99a3d5b190db622cdf450f22b4cd92e739

Observation 4e0fe0b1-70de-4ceb-9362-07412b97b242 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.151628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.908651Z digest=sha256:22012764238f9190ac32a38aa87dc9aa074d37c6e82556574cbfc7d7c59b5a68

Observation fd410787-82a7-47c8-b6a8-db2e38a61add · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.136949Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.913365Z digest=sha256:789e969e4e0a5c5bd1b2c5549cd3f50108fb0fe9372eea4330a95781ae6f5fd0

Observation cea8f4c9-6b31-4f3e-aa80-f43bbc339433 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.121345Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.918336Z digest=sha256:b8c17d24b0b4317b0c53c37a33d3604dbfb1efbb9caf34d6b9a6254da2357a92

Observation 0a558aa9-ab42-4ec2-85be-426ac4f9bd81 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.106776Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.922651Z digest=sha256:b19ff973ce98b386e5c3ff5f9de956f701611a1f0ff49a7c97fbec01db5be9f4

Observation 8f182f2d-c0ec-4ddf-82a4-9d5953c62c10 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.091848Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.928384Z digest=sha256:54f154f455f735a13afe5723a0600eb67b4c4f463471dbd0c7d7ac9ea5137847

Observation c398df54-5182-422d-be8f-e608025c282d · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.076928Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.932813Z digest=sha256:9dac9b123e92757bfb5de54fc24febdd2722823fc9bfbb6edf909d88f83ed896

Observation 9450e197-d373-4499-8ad2-ffd84ec6eac5 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.061751Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.937422Z digest=sha256:e52dd02d2bca17194c598bdb9a82a01b3105e26b2191b40ade18152e981ab9c5

Observation bed375c1-f9b8-4883-95e8-7e84eecd6452 · outbound

This paper cites Overview of the TREC 2020 deep learning track.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Overview of the TREC 2020 deep learning track

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.942093Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.942093Z digest=sha256:c69dc4be5c8ee37b286a2c5bc9abb09a9b8de8e9e9de39eae04629f107dccb2a

Observation d076a121-96bc-4154-9af5-bb263ca68686 · outbound

This paper cites Overview of the TREC 2019 deep learning track.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Overview of the TREC 2019 deep learning track

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.947206Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.947206Z digest=sha256:59b99dd0f6bcaec84f42433a57b782ee2b2acda98b77b59419dd8164c9d9ccbe

Observation 79dd812b-8bf9-46db-8368-582237c87042 · outbound

This paper cites The Llama 3 Herd of Models.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems The Llama 3 Herd of Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.952508Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.952508Z digest=sha256:cc842a77a61fb3e3ad02e265f326da9b93507f217ae15ba7af5eda80c566fe24

Observation 21843c68-a25e-4be1-8ca5-820c1ae3ebc0 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.046893Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.957060Z digest=sha256:a7837be9b42811715d472010971f34d66e1775703ad40a3a58b771bad381a05f

Observation 13ffcf20-c539-4acb-965b-41252026b37a · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.031564Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.961916Z digest=sha256:3cc14ad14af431c201a6288cf27f3cf1c3c014dc70c1f171c33e48b1877cb112

Observation effb50a9-16a5-4f38-9071-7ced31bcc648 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.016488Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.966474Z digest=sha256:d9b22924daacdae96268837c89e60f26dadfc637fb39daf7a243433a136786e4

Observation 4a0500b7-371c-466a-8959-94764f5bd2f1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.001685Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.972546Z digest=sha256:469ce1e58e83dd98518b7627638d6c4da346029a4bcb8d6f18f00d7d56fc1d28

Observation 0135dc01-5db8-4320-9924-00a47b89ceb5 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.986149Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.980893Z digest=sha256:744f72820e192fff13d9a8f934c649041c7c91730e48f2ef3ad69f2143bb0263

Observation 6a6452ff-0022-4355-9dac-e1eb49b49006 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.971089Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.986074Z digest=sha256:6970ebaad1a728bfa3b904ec8c8471859fddc3b35fda3c6058af347e3f3608a9

Observation de26fbdf-850c-40a6-9743-f50cf896668c · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.956709Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.992292Z digest=sha256:dd5d3e2aed69b9c12f73eed76b60586ee0dde502adb2683e00087adeaef1ca0f

Observation b5160d1b-784f-4c3e-b0c3-45c8877def9c · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.940456Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:45.996525Z digest=sha256:f9ff3829e6c61b42db0f610b34f26ce820ec71fa81b079276ddba73b7f570e7b

Observation b3957398-5571-42c6-ae54-2e336a3a7412 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.925362Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.001242Z digest=sha256:8ea0baea4f421f1e45928c773cc61e8f7aff8c78e67992bbe41145170c805503

Observation 653029c3-e2b0-40d8-aec3-cccfcdfd0d96 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.909686Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.006704Z digest=sha256:7b0616dd9cbdd09700cf6f4084ca952de84286402a05daf11e04e5311e01a22a

Observation 3794312d-0135-42c0-b998-953226a0f137 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.893642Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.011130Z digest=sha256:8f8cefd13f18b3fdc46320b2500fd59a81e505838ae3635b6773e44ddc66463e

Observation a1e03fe4-b310-4262-a3b6-3c30d6e3e9bb · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.878593Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.016045Z digest=sha256:111cc62dcfdd830afeedc5c8f6fa3b6bb9d18014c6920030f425acbb8ee9ce11

Observation 905ea6b5-7b93-4808-9c9b-ef92f78cdae9 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.855694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.021235Z digest=sha256:49f91f8c8107bd566ebe07595db6a50988c31c9283cc867397ce68ac1aaeefa9

Observation 6735ae77-267d-4866-9e36-719ff5ed64f9 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.840812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.026633Z digest=sha256:a57a697f9fd58432d0160ad6a3915d00871fb4ef4eb4761afc5713d736a137a2

Observation dc2a996a-ef66-4bf1-a5d1-87044fd8b3c8 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.825911Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.031565Z digest=sha256:13a4c902990843dd195292616d8f594a4e5f3247c86a35b44287f6d7d1505e63

Observation 196ca538-6440-4aa3-9382-8ba33360b024 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.810017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.036421Z digest=sha256:ccf6cbc8ff9e7d108d5614597b75f04d4c65182facc90777ec20e9ce50a12e42

Observation 2c85cfff-5a6f-459f-99be-d818bf3f29e7 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.791705Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.042438Z digest=sha256:1ff81662ef7911eb4c0f1e62aea5cc764fde14aacc44cb2f66be3be9b27a372a

Observation 30b83920-e438-4cf1-a7b2-de8487618587 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.774398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.048248Z digest=sha256:efd99c6182d139367456acb1048731c80873b8f3c2c051b3dcac93e1e7a23d0a

Observation 996e2fc0-529d-447e-89ac-453795c39913 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.756809Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.053406Z digest=sha256:18f337e3f77427be6007f4c46dabc153c733273818ed7d109b6d75f5777fe8a7

Observation bf0da052-c52a-496f-b1d2-36cd9404dcbe · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.741668Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.059729Z digest=sha256:db97e63cb2a1d486840483a6f7539f2d29e4448fa17a676b4363ce3f0e4b2567

Observation cab0368d-b210-4a3e-a510-e886ce9788ef · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 33

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.726722Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.065929Z digest=sha256:efd539765eefcaedf8a8c76593d324de14ecbc9b912f6e8c6f32d069a69a482d

Observation 88a85b88-5bd4-4337-9b21-f37968758b47 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.712123Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.070973Z digest=sha256:25bc2aec386f054199de98cb8f1f918dbda268d91ab221914260b5a01657323a

Observation ea865e4b-7f90-4fd5-b574-1f63fb54ca71 · outbound

This paper cites Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024

Reference 35

Resolution
verified exact
local_arxiv, observed 2026-08-06T18:34:46.279906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.075998Z digest=sha256:4bba7d8d6f68ed462a205dc7b3c074990d7d1eefa4015d9984393e36467f76e1

Observation 168572aa-b0e7-41b4-868e-c1e011346552 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 36

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.694613Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.083229Z digest=sha256:678c86ef7461eb672030b977fa8228eda5c9972214c61ad544b2343de8cc6cf7

Observation 9e6c2a77-622b-4aa4-a505-745b4b6c38b1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 37

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.677118Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.088984Z digest=sha256:226f5ce63d8d090b8198451e7d2679c2d5b6db0418375b37b1cbd19ab6217b48

Observation 3e4fbb3a-291c-421d-88cf-08ae36bf6a49 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 38

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.662151Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.095602Z digest=sha256:d61131f8b690d4d64836ff468c339fca14b148f92b305b24879fa0491e82f9e1

Observation 41d330c8-ee7e-44e9-bb06-a5708d14f262 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 39

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.647977Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.100804Z digest=sha256:8ea46db15a3d1dbdf51390f1631f7bd3650f323fdac5d0a8ea5086056a01e828

Observation 4c966a6d-727e-44bf-b201-0442995eeac9 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 40

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.631305Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.105982Z digest=sha256:c8a456d33b338c10ad93b5635a72dd6ac63ff6893fa7bb8863becec637969b4a

Observation dbdb542d-bde2-4bcf-a7d6-5e6e829da786 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.612603Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.110200Z digest=sha256:670bb493b9cd3010108bb21c7b3df1ef6b5cb96ddcf2b44d9dcffed7521e4b70

Observation b50f9a29-dad3-4bca-9c8a-dea17f915679 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 42

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.594161Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.115687Z digest=sha256:7fe3f71fa10e289bb7b7777a7b8a74ce3b634bddea9869074bc8504c68b85675

Observation 0080b839-196a-46ba-9a5a-2977602f9613 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.577426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.121367Z digest=sha256:e216b33732b068055b8a1a917388d893e7b47127a53cb7196225728054f82df5

Observation 3de9d11f-598d-4a4e-a97a-75d0f43e7bd4 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.561601Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.127742Z digest=sha256:6847834441bd995b185af8b5aedf54bfed63a6346566476952c1c5fb220e6305

Observation 8f9a0ace-ca93-457e-8e4f-39aaa05e8f6d · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.544622Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.134606Z digest=sha256:efb7a0ffebc3c59ecfec65251cac2ff7da5f4d280cbdabc84a9d5735c12e55c9

Observation d8e814c2-b4e8-4ef1-b13b-0dac3413d236 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 46

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.529479Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.140766Z digest=sha256:fe11529b1d1450f2761a565ba818a2829595e959f0c974d67579d843aaf26653

Observation 0a8a785d-1cff-4b54-9d08-b9e6cb8fc049 · outbound

This paper cites LLMs Can Patch Up Missing Relevance Judgments in Evaluation.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems LLMs Can Patch Up Missing Relevance Judgments in Evaluation

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:46.145334Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:46.145334Z digest=sha256:79b056b3216970e5072e673de8b13cca026ef46383160bf9b3d190862fd86a1a

Observation d3952dc7-acb1-43d8-a2b8-0e8420b83035 · outbound

This paper cites UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:46.150987Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:46.150987Z digest=sha256:1c26540ab573cacf9d7491ed2b568c1301836c89443fa3ba252aa9aa48a669e6

Observation cb13201e-0d48-4937-a5d4-2297a140927d · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.511275Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.156529Z digest=sha256:4c0c14345ba564da1b1b2506d39a17a7bb3ab8b0bd22d584625f94dd04ce514f

Observation c1185a08-f397-482e-bce0-f85fce76b9a1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 50

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.491491Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.161502Z digest=sha256:d140f12c436b06cae588edf587dd444ae536cbb3c4009f477a2ddbbf250a383d

Observation e019b683-6d45-4382-851a-e939365ea8b1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.466739Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.166109Z digest=sha256:e93c45e9793f6c6b4f28f11f9a886d6e84c74b60fa636212796796471db0b194

Observation c362450b-c209-4e0c-8894-27c7787a02dc · outbound

This paper cites Voorhees and Donna Harman.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Voorhees and Donna Harman

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T18:34:46.448018Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.170871Z digest=sha256:002f005d33216932905ab576140138395c311b6a345dc1253ef2fecd23c652f5

Observation a90ace5c-135a-491f-899d-c26487fa0896 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.418226Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.176298Z digest=sha256:d11d6110172b86ab083f6ecddb852d47996851b754e38ad01d4025fcf0f0f48d

Observation ad8d292a-ef28-416e-8aeb-ffd787fb7131 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 54

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.401501Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.181643Z digest=sha256:01fcb59acfdce00944005cdd4b656f13ecb8c91198b3ac1a6d2c30915059ee64

Observation 90ad40d0-4116-4f4d-9675-3d20e6c1c198 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.385765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.186693Z digest=sha256:488b20d3e71f6252f5e9de38be85736324d0cf47567b1f1ccca6467ff15be884

Observation 8a209eb6-3dbb-4910-b253-d2b3ba04a310 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.370408Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T18:34:46.191064Z digest=sha256:215bd4ab379dccef6a966f369570d6593f05e45cec1c42d4c4abe3fa87b347ba

Observation 3d61a8f9-4c98-414f-a52b-df08af21d2a5 · outbound

This paper cites Can We Use Large Language Models to Fill Relevance Judgment Holes?.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.899164Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.899164Z digest=sha256:6a9bd4c63d1e27521384ec4c3c6d43762434773a3fa1d83047722450c4c5416b

Pith citing papers

No inbound Pith citation observations are available.