Paper Citation Record · LEDGER

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering

As of 9 August 2026, this Paper Citation Record lists 46 of 46 outbound references and 3 inbound Pith citation observations for arXiv:2502.06666.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.06666 v1

Coverage vector

measured 46 of 46 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T14:46:29.739206Z

measured 49 of 49 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T00:24:43.178158Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T05:59:38.023398Z

Reference resolution

46 of 46 outbound references displayed

verified exact2
verified fuzzy0
unresolved44
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 3bbbf59a-aebb-4d4b-820c-079cd9576153 · outbound

This paper cites online" 'onlinestring :=.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering online" 'onlinestring :=

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.518909Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 850463a7-aaa6-48be-9aa6-1c67d836d434 · outbound

This paper cites write newline.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering write newline

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.524615Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1283dea7-4db4-486d-b74a-b7deb8fde1f0 · outbound

This paper cites Creating Trustworthy LLMs: Dealing with Hallucinations in Healthcare AI.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Creating Trustworthy LLMs: Dealing with Hallucinations in Healthcare AI

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.530844Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5ccc4589-99dc-4076-aae0-cc38f0092862 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.803045Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 6aabf32b-0f38-4f7f-9150-377d5b946014 · outbound

This paper cites When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering When Benchmarks are Targets: Revealing the Sensitivity of Large Language Model Leaderboards

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.541762Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1af37629-8959-4fb4-98c3-8911f50eb717 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 6

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.784194Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 3388325f-8e7c-445d-9dc7-db424159e0cb · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.768023Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation fd74d032-ca36-478f-a1cf-dca14b31099b · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 8

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.750939Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 28edeeb4-31ab-4c99-a644-4632cc037651 · outbound

This paper cites Benchmarking large language models for biomedical natural language processing applications and recommendations.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Benchmarking large language models for biomedical natural language processing applications and recommendations

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.562681Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7a4a866f-3a30-487f-8de7-f4156a649dae · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.733748Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 9635c7ba-dacb-4501-b06f-eee813c20d76 · outbound

This paper cites Med42-v2: A Suite of Clinical LLMs.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Med42-v2: A Suite of Clinical LLMs

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.571758Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5c711ba1-461b-444e-8ed5-dfe3a5eded22 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.576417Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 01300569-716a-4cac-824b-8bd5f3a6a6e7 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.714409Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 440f50b2-e9ed-4cfc-b551-49af38c70ebf · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.699053Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 8e935abc-8196-4705-a420-85dbca0cfb18 · outbound

This paper cites What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.589392Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 44131d9a-7334-4e33-8906-33b8c62b6ce9 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.682768Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 20418767-79d8-435c-b263-446c64329612 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.667239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 07faaac9-8b9b-425d-b429-8a96bcfb4bf2 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 18

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.652222Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 1cb332e2-6ba8-4ea8-a7fd-0ac708d83133 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.607256Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9bd9f22d-b078-43da-9ff9-f952e8c3dc0a · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 20

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.627441Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 4423f7ba-ae5a-4110-b5eb-b549d5e66654 · outbound

This paper cites Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.617054Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 392f9416-a4a5-4d90-8580-321bc43a5b50 · outbound

This paper cites OLAPH: Improving Factuality in Biomedical Long-form Question Answering.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering OLAPH: Improving Factuality in Biomedical Long-form Question Answering

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.622140Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 964883e9-d484-40f2-b3b1-59070b34ff6f · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.626947Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0d0431a9-aa5f-40de-ab3f-5a303d3d5f03 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.602584Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 3d3cc3b0-46af-4e9a-9014-4905e879e5b6 · outbound

This paper cites MEDIC: Comprehensive Evaluation of Leading Indicators for LLM Safety and Utility in Clinical Applications.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering MEDIC: Comprehensive Evaluation of Leading Indicators for LLM Safety and Utility in Clinical Applications

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.636932Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5904f9a0-4020-4755-8ee1-a246be78e0f0 · outbound

This paper cites Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.642901Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d478e3f-6162-4489-ac08-11f8185db780 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.649246Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a1f7d08c-4030-4d6a-8592-d22be6238419 · outbound

This paper cites A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.654391Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 06638153-b732-4a2b-b7cd-4d6773385d08 · outbound

This paper cites Can multiple-choice questions really be useful in detecting the abilities of LLMs?.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Can multiple-choice questions really be useful in detecting the abilities of LLMs?

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.659804Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 72b9fa63-f5b0-4111-b76f-2de3e5766a7c · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.665017Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 33493c1d-cef7-4509-a595-612aed3e0b27 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 31

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.567180Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 6d208892-cbb9-4c0b-9ffc-f8b009381b9f · outbound

This paper cites Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questions.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questions

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.674840Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bb731652-7e56-4dad-9ed5-5907e3f4c78f · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 33

Resolution: verified exact; arxiv_id_nonexistent, observed 2026-08-08T14:46:30.129401Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 5acaf2af-1191-46c6-b54f-942db7a0b691 · outbound

This paper cites MedConceptsQA: Open Source Medical Concepts QA Benchmark.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering MedConceptsQA: Open Source Medical Concepts QA Benchmark

Reference 34

Resolution: verified exact; local_arxiv, observed 2026-08-08T14:46:29.912044Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 00f716b3-e7bf-4484-b15f-2057fbb985da · outbound

This paper cites Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.688673Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 46d4251d-b837-4d1d-b415-b098e7988428 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.693191Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dba1cb38-769e-414f-9922-53724a2b5405 · outbound

This paper cites Med-HALT: Medical Domain Hallucination Test for Large Language Models.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Med-HALT: Medical Domain Hallucination Test for Large Language Models

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.697697Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e1bdcd6b-34f9-44d8-ab92-4e53efafbd26 · outbound

This paper cites Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.702216Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b8b97ea0-ae19-4636-9444-e8de7230ceea · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 39

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.550064Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 2dc0e316-f4cc-42ef-acf0-53d56e2330f3 · outbound

This paper cites Chain-of-Thought Reasoning Without Prompting.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Chain-of-Thought Reasoning Without Prompting

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.711348Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 47b87c55-fc5a-49fc-b430-c79d3cf665fb · outbound

This paper cites Qwen2 Technical Report.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Qwen2 Technical Report

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.716103Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b92ceb5f-1482-4682-ad61-0c2c8d846ab5 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 42

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.533821Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 6d6a70cd-7650-4683-b5ac-fc082ea71c30 · outbound

This paper cites Yi: Open Foundation Models by 01.AI.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Yi: Open Foundation Models by 01.AI

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.725457Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 82c598b2-ef86-45c9-97a5-b2c12086f074 · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 44

Resolution: unresolved; raw_fallback, observed 2026-08-08T14:46:30.517346Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 158089a1-6082-4287-ab4b-1ad3f226d83f · outbound

This paper cites an unresolved cited work.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering Unresolved cited work

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.734491Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cd1c6953-d553-4d06-b0cc-25c632d18d78 · outbound

This paper cites A Survey of Large Language Models in Medicine: Progress, Application, and Challenge.

Automatic Evaluation of Healthcare LLMs Beyond Question-Answering A Survey of Large Language Models in Medicine: Progress, Application, and Challenge

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-08T14:46:29.739206Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation a7c90f96-cebf-48a7-badc-0e7119573cee · inbound

Essential-Web v1.0: 24T tokens of organized web data cites this paper.

Essential-Web v1.0: 24T tokens of organized web data Automatic Evaluation of Healthcare LLMs Beyond Question-Answering

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-07T00:24:43.178158Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1c069bbc-05f8-45c3-9434-ccb6027cc855 · inbound

SynapseRoute: An Auto-Route Switching Framework on Dual-State Large Language Model cites this paper.

SynapseRoute: An Auto-Route Switching Framework on Dual-State Large Language Model Automatic Evaluation of Healthcare LLMs Beyond Question-Answering

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-06T20:25:46.816118Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aef5af40-d332-46b6-be89-6e4407f554e4 · inbound

Demystifying Numerical Instability in LLM Inference: Achieving Reproducible Inference for Mission-Critical Tasks with HEAL cites this paper.

Demystifying Numerical Instability in LLM Inference: Achieving Reproducible Inference for Mission-Critical Tasks with HEAL Automatic Evaluation of Healthcare LLMs Beyond Question-Answering

Reference 5

Resolution: verified exact; arxiv_id, observed 2026-07-04T05:59:38.025037Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.