Pith. sign in

Paper Citation Record · LEDGER

Formalized Information Needs Improve Large-Language-Model Relevance Judgments

As of 4 August 2026, this Paper Citation Record lists 53 of 53 outbound references and 1 inbound Pith citation observation for arXiv:2604.04140.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2604.04140 v2

Coverage vector

measured 53 of 53 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-13T16:50:03.181616Z

measured 54 of 54 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-04T06:34:03.388597+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T23:03:14.448696Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

53 of 53 outbound references displayed

  • verified exact19
  • verified fuzzy13
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch21

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation f0aacc3b-25c4-4dc4-89f4-95b4956f2f1b · outbound

This paper cites In: Zamani, H., Dietz, L., Pi- wowarski, B., Bruch, S.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Zamani, H., Dietz, L., Pi- wowarski, B., Bruch, S

Reference 1

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.748007Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:f5b7c22e30e106dc80cfdc33586f4ed0f17dac5df715f0c05fdf1e1f89abf09a

Observation a914e4e8-6532-4a77-b8d5-f184750f3d0d · outbound

This paper cites Can generative llms create query variants for test collections? an exploratory study.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Can generative llms create query variants for test collections? an exploratory study

Reference 2

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.750436Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:e956004a4a109b9edb6dd0d735c86663678ad21d10382e73fdcda485e3b2c370

Observation 2dc05e29-8eca-49e1-820a-51df21424f71 · outbound

This paper cites In: Sakai, T., Ishita, E., Ohshima, H., Hasibi, F., Mao, J., Jose, J.M.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Sakai, T., Ishita, E., Ohshima, H., Hasibi, F., Mao, J., Jose, J.M

Reference 3

Resolution
verified exact
arxiv_id, observed 2026-05-13T16:52:59.755753Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:938b58172db7a87092526f9e70c1b8790e9dbf4b42138b288e14ddf9f727a92e

Observation 3d74a178-2f82-4e61-8699-1729c362d95d · outbound

This paper cites In: Ferro, N., Maistro, M., Pasi, G., Alonso, O., Trotman, A., Verberne, S.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Ferro, N., Maistro, M., Pasi, G., Alonso, O., Trotman, A., Verberne, S

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.700801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:729c43d359d08c38983c74784b478d498afd885c3b6355042f1d864f9637ed7f

Observation 0e258afd-de9e-4561-8064-3a464cee9556 · outbound

This paper cites 3194–3204.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments 3194–3204

Reference 5

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.742875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:2e669e54aff704b09169a010b384acb8bad43aa1ec8b125566ef6c6c162568ae

Observation ee20d698-8db1-4488-ad8a-609bc8afd29e · outbound

This paper cites In: Ferro, N., Maistro, M., Pasi, G., Alonso, O., Trotman, A., Verberne, S.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Ferro, N., Maistro, M., Pasi, G., Alonso, O., Trotman, A., Verberne, S

Reference 6

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.764086Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:faf093575a8394852a420cef88ad01927f26c28ca7c03ac8c2bae12aeee1ecba

Observation b689abb6-3fd9-4825-b511-14df876273d0 · outbound

This paper cites Canadian journal of information science5(1), 133–143 (1980).

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Canadian journal of information science5(1), 133–143 (1980)

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.708244Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:e7e26276bf48f97d5a5fe36d6d11a0851649b036637cf80afce92a7e749589eb

Observation 37aab6ca-04f8-4a96-92ca-1498cf41c344 · outbound

This paper cites In: Koopman, B., Zuccon, G., Carman, M.J.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Koopman, B., Zuccon, G., Carman, M.J

Reference 8

Resolution
verified exact
arxiv_id, observed 2026-05-13T16:52:59.745392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:257e708b0d16d7ba14a5d24884a9c51fa4121fcebd01b9f9aa1bb65c3c029073

Observation 580456cb-6bc9-4148-8bb0-7c0de5f619a7 · outbound

This paper cites In: Balog, K., Setty, V., Lioma, C., Liu, Y., Zhang, M., Berberich, K.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Balog, K., Setty, V., Lioma, C., Liu, Y., Zhang, M., Berberich, K

Reference 9

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.737969Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:e58ae8f5991006de35007e08b2ffd4d518554215c8065b1c218cc0d6287abe8c

Observation be977441-0444-4000-99e7-b95d2e1bada2 · outbound

This paper cites In: Bookstein, A., Chiaramella, Y., Salton, G., Raghavan, V.V.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Bookstein, A., Chiaramella, Y., Salton, G., Raghavan, V.V

Reference 10

Resolution
verified exact
arxiv_id, observed 2026-05-13T16:52:59.761243Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:244e2d70a226e314979e1dd0a414fa57002fe34adb691a1074b86d2a94d73f91

Observation a0d3a974-1d5b-4a08-a4ae-859ea4c9d9f4 · outbound

This paper cites A coefficient of agreement for nominal scales.Educational and Psychological Measurement, 20(1):37–46.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments A coefficient of agreement for nominal scales.Educational and Psychological Measurement, 20(1):37–46

Reference 11

Resolution
verified exact
doi, observed 2026-05-13T16:52:59.730543Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:c7eb5f8c8cf6a1fbe422fea7768e66d6001a256e7c798e545bf100f7011f23a0

Observation 78a244ea-2a9a-4463-ad36-52191bf53c4b · outbound

This paper cites In: Voorhees, E.M., Ellis, A.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Voorhees, E.M., Ellis, A

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.689310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:61f3c29dd36f6884d9ff359709c05f9d88cfe3bda7ea56ed3973180175e7349f

Observation b4f2ea80-362c-4595-98ef-441de6c59292 · outbound

This paper cites Overview of the TREC 2019 deep learning track.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Overview of the TREC 2019 deep learning track

Reference 13

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:53:00.191039Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:b74669cd8fe50dd54f756d47bad473ab247b0d304a9107c2b4eb2e7287a68afd

Observation 94c5219d-3399-47ad-9fcc-9a00b2ac4b3e · outbound

This paper cites Voorhees, and Ian Soboroff.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Voorhees, and Ian Soboroff

Reference 14

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.752850Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:5733c4fa01e15eb5ef0dedd53fbddcec18fa6d142b1dbb9cccafc5e03c4eeda2

Observation 12819bf3-d348-49d8-a4c9-e6fa8ac352ad · outbound

This paper cites In: Soboroff, I., Ellis, A.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Soboroff, I., Ellis, A

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.704504Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:2cb87011221032129625e76a3fdd69de9fef8950226053a17852d75db0f3c04c

Observation e3281401-0807-4eda-a3d6-a74048d7be34 · outbound

This paper cites In: Goharian, N., Tonellotto, N., He, Y., Lipani, A., McDonald, G., Macdonald, C., Ounis, I.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Goharian, N., Tonellotto, N., He, Y., Lipani, A., McDonald, G., Macdonald, C., Ounis, I

Reference 16

Resolution
verified exact
doi, observed 2026-05-13T16:52:59.732329Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:6853e0705301e30952218c20884eaa04433b21f0a0c41b0bfec51539fdf1563f

Observation 4713ae03-6aa6-48f9-aaba-7e3df9b16a76 · outbound

This paper cites In: Proceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Proceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval

Reference 17

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.734789Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:cf0474783d90253510f59f8dd6ec955b533120613971650f8b5a02de5a15edbc

Observation 9ff39fc7-1f9b-4d34-bb5e-f1c9a1f5a443 · outbound

This paper cites Proceedings of the 2025 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval (ICTIR) , pages =.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Proceedings of the 2025 International ACM SIGIR Conference on Innovative Concepts and Theories in Information Retrieval (ICTIR) , pages =

Reference 18

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.740452Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:352508bf139dbce84ef084e1422edd73fe3b291d45a06c374317ddc7e79b26d2

Observation 35541356-c7f9-4e8d-9f6c-b15d23524f21 · outbound

This paper cites (eds.) Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments (eds.) Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2025, Padua, Italy, July 13-18

Reference 19

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.758607Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:f4d5d3477e6a75c8c87a2432ca045196a42a8801a1dcb743b2c5aeb9c0d2e24d

Observation 25770b21-e3f9-46d7-8cbc-bd62082f8bda · outbound

This paper cites Psychological Bulletin76, 378–382 (1971).

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Psychological Bulletin76, 378–382 (1971)

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.681525Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:a0dd72c9131ee8a28aa4072e6828ef8dd24718bcfab896acf949f2f97037518f

Observation 15870c5a-f44d-45d0-8792-3815b01c4eb6 · outbound

This paper cites In: Ferro, N., Maistro, M., Pasi, G., Alonso, O., Trotman, A., Ver- berne, S.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Ferro, N., Maistro, M., Pasi, G., Alonso, O., Trotman, A., Ver- berne, S

Reference 21

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.823284Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:0ad16625367ee3a4d115ecb9c30633c0ca5cb8dab3e442cfe5b523fef079fcdc

Observation 0b7a8066-9229-4dc5-93ed-9804eb8c19d5 · outbound

This paper cites In: Korfhage, R.R., Rasmussen, E.M., Willett, P.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Korfhage, R.R., Rasmussen, E.M., Willett, P

Reference 22

Resolution
verified exact
arxiv_id, observed 2026-05-13T16:52:59.783067Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:6d7230874390dce33258082bff435f9193fdeabe4fd862948423c46928d2ee98

Observation a60c376e-81ee-45d6-85b5-8ea598a513c7 · outbound

This paper cites In: Hauff, C., Macdonald, C., Jannach, D., Kazai, G., Nardini, F.M., Pinelli, F., Silvestri, F., Tonellotto, N.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Hauff, C., Macdonald, C., Jannach, D., Kazai, G., Nardini, F.M., Pinelli, F., Silvestri, F., Tonellotto, N

Reference 23

Resolution
verified exact
doi, observed 2026-05-13T16:52:59.809067Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:c63d259e53914906602a82d9cd7d3c29ffa07e3c496f6d21b68ef0dd8a5e5477

Observation d6c43096-91b3-4ad9-a7bf-a1e47d337da8 · outbound

This paper cites In: Ferro, N., Maistro, M., Pasi, G., Alonso, O., Trotman, A., Verberne, S.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Ferro, N., Maistro, M., Pasi, G., Alonso, O., Trotman, A., Verberne, S

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.685310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:6035d4f001368b1f95ee1574b44a1c1bf108f218cdaa87b21844f42f90145593

Observation 91eeb578-cc1a-4e26-8193-b2cc4b3f0ccd · outbound

This paper cites Echoes in the feed: Evolution- aware prompt-augmented micro-video popularity prediction.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Echoes in the feed: Evolution- aware prompt-augmented micro-video popularity prediction

Reference 25

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.815276Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:c49439c26a6799746d7ae61692e7a1225c3f3d25f95145473271dfbdfde112c3

Observation 88f4f9c7-aa7d-4789-b40f-1e8e104c1cbe · outbound

This paper cites Cluster-based partial dense retrieval fused with sparse text retrieval.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Cluster-based partial dense retrieval fused with sparse text retrieval

Reference 26

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.802478Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:1e3e1d080318edf947f719492435a05116209b3b8c6cf38839987c97c6c39922

Observation da58e3c9-830e-47e0-9dbd-1fa2a698becf · outbound

This paper cites In: Text Sum- marization Branches Out.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Text Sum- marization Branches Out

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.696945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:0f54e7da2eeb8818f83b51a4cd5a9df5fde05a8872d0de441dd956dd112ebdda

Observation dc7e2754-a899-4bfa-90b0-f1cb51af597e · outbound

This paper cites 2025 , issue_date =.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments 2025 , issue_date =

Reference 28

Resolution
verified exact
doi, observed 2026-05-13T16:52:59.824841Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:3ce77b6165b44ca33a1055aded4aee122052ddbd527ea78ec3fd13d12c733bba

Observation 5b8c6936-d299-413d-8d6f-1ef0a4089ca2 · outbound

This paper cites In: Bailey, J., Moffat, A., Aggarwal, C.C., de Rijke, M., Kumar, R., Murdock, V., Sellis, T.K., Yu, J.X.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Bailey, J., Moffat, A., Aggarwal, C.C., de Rijke, M., Kumar, R., Murdock, V., Sellis, T.K., Yu, J.X

Reference 29

Resolution
verified exact
arxiv_id, observed 2026-05-13T16:52:59.785566Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:37c1cf07a383642435e20ed01947a7562cfcbdf34c228512dfdf5ba93b4bf35a

Observation ac628318-63f1-4ab8-a42d-6da55b00423e · outbound

This paper cites In: Besold, T.R., Bordes, A., d’Avila Garcez, A.S., Wayne, G.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Besold, T.R., Bordes, A., d’Avila Garcez, A.S., Wayne, G

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.693304Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:6024c31339236b612fcdc0d4aa24549a33adbb332b7676bffa3ca917ff77dbbf

Observation 01938153-62c1-4f9d-89a9-90573f6e7ff3 · outbound

This paper cites Document Expansion by Query Prediction.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Document Expansion by Query Prediction

Reference 31

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:53:00.193629Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:c5a6a7bdff0dde00975c791d5bf427ba6822a6234ca1aab81e482d9e1aa3a578

Observation aa2d15f1-e29b-4e67-a4e0-f35becf5a875 · outbound

This paper cites gpt-oss-120b & gpt-oss-20b Model Card.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments gpt-oss-120b & gpt-oss-20b Model Card

Reference 32

Resolution
metadata mismatch
local_arxiv, observed 2026-05-13T16:52:59.788102Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:e5265011dd290a1779a54f0251619dc7e14d0a0122308bce6d3c625a0c42231c

Observation 18debfbe-0bc7-4c0d-97d5-ebde17a67496 · outbound

This paper cites In: Yang, G.H., Wang, H., Han, S., Hauff, C., Zuccon, G., Zhang, Y.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Yang, G.H., Wang, H., Han, S., Hauff, C., Zuccon, G., Zhang, Y

Reference 33

Resolution
verified exact
arxiv_id, observed 2026-05-13T16:52:59.807115Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:2a65ca4c18435ccd67cf321be3bfa722f0220d85aca8d1c7c9281df2238e179c

Observation cc275e8b-089b-4352-b523-91f48563d6d8 · outbound

This paper cites emnlp-main.495/.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments emnlp-main.495/

Reference 34

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.791110Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:fc51bc7d491010ec68bf3a33953c7a8892df9b8beb6123a20b0e0b878db40b36

Observation c017d99b-b9ba-49a1-a8af-edd94e0c960c · outbound

This paper cites Amanpreet Singh, Mike D’Arcy, Arman Cohan, Doug Downey, and Sergey Feldman.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Amanpreet Singh, Mike D’Arcy, Arman Cohan, Doug Downey, and Sergey Feldman

Reference 35

Resolution
verified exact
doi, observed 2026-05-13T16:52:59.804410Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:a21876985bb734de119e667a6d6fc1b0e5a7ffe24dc97f79f7c2e6dc32336485

Observation 44bd4404-8a1f-4f42-9112-514e603e1d01 · outbound

This paper cites an unresolved cited work.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Unresolved cited work

Reference 36

Resolution
verified exact
doi, observed 2026-05-13T16:52:59.812915Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:c69d3d9f207e4127647ee73ce33a3547e22c46ee3858a5319606023c02b37352

Observation 2fb46d55-b8ae-43c4-8894-7d4db2d0fc26 · outbound

This paper cites Voorhees, Tetsuya Sakai, and Ian Soboroff.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Voorhees, Tetsuya Sakai, and Ian Soboroff

Reference 37

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.796901Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:9fe3c59887a68e096aedc3205186278ecf4634971eefb6aa194469a4dda9c43e

Observation 9855f163-b9fd-46c3-bda9-f071cb0d2049 · outbound

This paper cites American Documen- tation16(2), 69–72 (1965).

Formalized Information Needs Improve Large-Language-Model Relevance Judgments American Documen- tation16(2), 69–72 (1965)

Reference 38

Resolution
verified exact
doi, observed 2026-05-13T16:52:59.811195Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:4ff46ffcb426c62574b1f3b625f42f40561eea1a8e31ce447ba2d9df3f842bcc

Observation b8440453-90c9-4328-a0b7-6de1a8f8513b · outbound

This paper cites ISBN 9798400704314.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments ISBN 9798400704314

Reference 40

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.793899Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:20ca5e9d7312f1f7eed8188d16e7b3102be51441da8c5f4739b6afd39178e260

Observation e91df2f9-4911-4b2c-807a-45917a90c2f9 · outbound

This paper cites A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look

Reference 41

Resolution
verified exact
arxiv_id, observed 2026-05-13T16:52:59.820659Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:4733bdd3498a09f7ce705d2a19bbb6415f38f75834fe4b493336bb88d7fbe606

Observation f5cad55a-4218-4999-b666-6d32b105d8e3 · outbound

This paper cites UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor

Reference 42

Resolution
verified exact
arxiv_id, observed 2026-05-13T16:52:59.799476Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:821906a0e224df8549db74738bfb92d16b7a0556e632b5ec00cf7c507a2adf66

Observation 88cf60f4-5629-45b9-9eeb-9f4c797cc625 · outbound

This paper cites In: Kamps, J., Kanoulas, E., de Rijke, M., Fang, H., Yilmaz, E.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Kamps, J., Kanoulas, E., de Rijke, M., Fang, H., Yilmaz, E

Reference 43

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.817974Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:21bb04e43dc450637aef5c3562feb380a37280027ccd74ccc4df4c04bea24e9f

Observation a3b447bb-db2b-4b4a-813c-896694eaff8f · outbound

This paper cites In: Voorhees, E.M., Buckland, L.P.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Voorhees, E.M., Buckland, L.P

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.665881Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:781d708ff9d2b5be703b221b15490c6dc400807dd9a5b0f3799910d84e2dcd48

Observation 2c3b7749-f1ba-4e50-b22b-edc5b9ea0af2 · outbound

This paper cites In: Ferro, N., Peters, C.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Ferro, N., Peters, C

Reference 45

Resolution
verified exact
doi, observed 2026-05-13T16:52:59.774587Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:6596a18e67b7e178ee0a179f54e4b9771d2e3d196df79c5ab72c8123f326e9de

Observation 28b1b57b-150e-4e5d-b791-314bc4043511 · outbound

This paper cites (eds.) SIGIR ’22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments (eds.) SIGIR ’22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.669792Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:a09d4149b4c5f9d0f1febc3905e379e02e4a187329bb7dd879ab663845deff84

Observation d2d74a41-f4a2-4500-a1d7-82dc64f928a5 · outbound

This paper cites Zamani, F.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Zamani, F

Reference 47

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T16:52:59.770159Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:85402702981d3c90a7ddcad483f2d795533272e523cdabeabdb5040d8831718f

Observation 3b80de04-e334-4511-a706-bb520658a445 · outbound

This paper cites The MIT Press (2005).

Formalized Information Needs Improve Large-Language-Model Relevance Judgments The MIT Press (2005)

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.678057Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:a0b288720c06c3470da8cc5988484970e43f3e17cad9ac905c8386dacf9c841c

Observation 347703dc-d053-4144-871b-a9baceffb424 · outbound

This paper cites ACM Trans.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments ACM Trans

Reference 49

Resolution
verified exact
arxiv_id, observed 2026-05-13T16:52:59.772917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:bb7c6d16c41eb402ed16ccae14efa284cd557fe639958c17f913c76076654fcb

Observation 34648191-5004-4b27-86f1-aea34f14a943 · outbound

This paper cites Qwen3 Technical Report.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments Qwen3 Technical Report

Reference 50

Resolution
metadata mismatch
local_arxiv, observed 2026-05-13T16:52:59.767340Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:68d9386527f36ae17714097f3d890200ad7d8ea2c7930ad53d1ff97a003bac7e

Observation f85dc4e6-0314-49fe-9679-a9cd562d1afc · outbound

This paper cites In: Myaeng, S., Oard, D.W., Sebastiani, F., Chua, T., Leong, M.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Myaeng, S., Oard, D.W., Sebastiani, F., Chua, T., Leong, M

Reference 51

Resolution
verified exact
arxiv_id, observed 2026-05-13T16:52:59.777839Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:ab42d62bb3850c49e97819b5fa2aaa89cc5e30812020c83a0f83ab064268072b

Observation 7c3b9717-1280-4330-9ca6-3cff87bb06d0 · outbound

This paper cites In: 8th International Conference on Learning Repre- sentations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: 8th International Conference on Learning Repre- sentations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.662215Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:5640cc14c76f4da1121fdd2d8d49aa4ff66fbd727d234cfec9f8572f3e69c5c7

Observation 9206847a-2320-42a5-9885-3158a904bb34 · outbound

This paper cites In: Oh, A., Naumann, T., Glober- son, A., Saenko, K., Hardt, M., Levine, S.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments In: Oh, A., Naumann, T., Glober- son, A., Saenko, K., Hardt, M., Levine, S

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-05-14T05:53:15.674202Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:69e3f97fcc5695873ce61b8384b24e376c9843b5db599c45622dd02c228fcfcf

Observation 227f462b-6d0f-4bc5-927a-6124b956c9d5 · outbound

This paper cites (eds.) SIGIR ’98: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Re- trieval, August 24-28 1998, Melbourne, Australia.

Formalized Information Needs Improve Large-Language-Model Relevance Judgments (eds.) SIGIR ’98: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Re- trieval, August 24-28 1998, Melbourne, Australia

Reference 54

Resolution
verified exact
arxiv_id, observed 2026-05-13T16:52:59.780521Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-04T06:34:03.388597+00:00.

source=pdf_text observed=2026-05-13T16:50:03.181616Z digest=sha256:67e27fec4ae516aba4ef76c6f1fb1b88b6fe9dc11c2680496ea8d3fe7db39b21

Pith citing papers

Observation 17e55da2-4c04-4fd4-aa5f-685fd67a6f5d · inbound

LLMs Encode Relevance as a Layer-Wise Cross-Lingual Signal cites this paper.

LLMs Encode Relevance as a Layer-Wise Cross-Lingual Signal Formalized Information Needs Improve Large-Language-Model Relevance Judgments

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-01T23:03:14.448696Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T23:03:14.448696Z digest=sha256:a8a189c060e3ec5fc7a36b84223012117cd2faa8bb4ab0d7f93151f5f9650a12