Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-06-26T08:16:51.419186Z
Paper Citation Record · LEDGER
As of 22 August 2026, this Paper Citation Record lists 58 of 58 outbound references and 0 inbound Pith citation observations for arXiv:2606.23403.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-06-26T08:16:51.419186Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
58 of 58 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation b9d634bb-1aa5-4246-b089-d41e889d9839 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems InProceedings of the Thirty-Third International Joint Conference on Artificial Intelligence (IJCAI), pages 8038–8047
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9385460b-5003-428e-a545-8412e7ab3789 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems InIn- ternational Conference on Learning Representations
Reference 2
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fe034b2e-076a-4f39-80f7-6982ff3fc2ce · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems LLM Evaluators Recognize and Favor Their Own Generations
Reference 3
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.
Observation 2082e843-62ca-4684-9400-bb47d41f987e · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computa- tional Linguistics: Human Language Technologies, pages 314–324
Reference 4
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d52e223a-0cb1-4576-a001-5fedc5bd7f90 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems not found
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5244f29b-229b-4513-ae43-3bc6ff95b978 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 6
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 16bee449-ae78-40b0-b9c6-d332c5ab0223 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation afda7c72-b074-479c-8c7a-05c5df708c88 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems PRIORITY ORDER:
Reference 8
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7c1d9e57-2039-4550-8310-ffc1bae4ceac · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 9
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2d0fa759-220c-4de8-ae29-8d6348086d58 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems processing
Reference 10
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation acdfb9c5-657c-42a3-bdb4-9a6bd02725de · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b9c59398-2666-4a3e-9e93-daecf62f81f2 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8695bb48-c448-4057-a74a-b90895b3facf · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Document Retrieval
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 44e922b5-a7c7-4d71-b863-48a1084410be · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f5fc8336-46f6-49d0-9e24-5dc4c33582a1 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 15
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7cb07c13-af5d-4c4b-a489-2a12244b03ea · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems If two groups of files implement different domain pipelines -- different domain vocabulary, inputs/outputs, or end- to-end flow -- they MUST be separate subsystems
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2cd7a54a-3130-4d1c-b125-00506edf373a · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Domain Logic
Reference 17
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1f345420-598f-4004-b90b-e477bc25b15b · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Return ONLY valid JSON matching the schema
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7a79fa0f-8f4b-4cfd-8d8c-97e397e20827 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 807d18ca-9631-486d-bb19-9c6fcc51a60c · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems data_flow: subsystemA.output -> subsystemB.input
Reference 20
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c3e6600b-3916-401b-b08f-bd7229fbf228 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 77c09481-a0d1-4ef2-9722-f26b61a26030 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 22
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5f47d3c7-1e85-4b62-b9bf-0d3c67fef34f · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems No subsystem may be isolated
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b61ac0cd-ed5a-497f-85f6-7e8bebae0ef2 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 24
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e30329ae-cacf-4582-a9ed-ad82cbceba3f · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Return ONLY valid JSON matching the schema
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dd0eee61-2bad-4d2c-a0e8-865a4f56c273 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b763b471-171d-4914-8af5-d333d6f769a7 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4cdd8c16-b7e2-4b1f-984c-7b4eea37028d · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 28
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6472e3f6-b88d-4831-8885-a870903891a7 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems ai_core
Reference 29
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d11d616b-2a2c-4889-8e48-6c96e5b3aa01 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Assume the synthesizer made mistakes
Reference 30
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 00c3e734-0511-4f0c-83ac-39bfce00f771 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a84e660d-0943-4e4f-9503-85d3a24a5251 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems prompt_chain
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0a83fca3-0e48-4852-bf1e-5fff39f07afd · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 652eb75d-37e4-4f85-9157-c65d96496261 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cc617c8b-cdb8-4667-b37f-b08ca2497a5e · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 47ef7195-539e-4717-b8a8-a48b7b4ad0b2 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems evidence_match
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ade26859-77f3-46e9-a01e-6d8147e510cf · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems prompt_chain
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2e7287a5-22c8-41d3-86a6-8e6d930c85eb · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems none" A component's pipelinePattern is INDEPENDENT of its patternStage -- e.g. a RAG retriever has pipelinePattern=
Reference 38
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a5ee1ed8-f3f8-4ab5-9f8c-56df4023070e · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 39
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3253a48f-6c5b-4ed5-b218-0eb828497fcf · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems non-empty retrieval result
Reference 40
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a750804b-411d-462b-bd2c-eb44c578e8e3 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems compare to ground truth
Reference 41
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 76caf7a8-d3b8-4f4b-9cc3-95bb2eca2dbb · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems function call count
Reference 42
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0464f3e4-a418-4e2a-955c-72438513e414 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Deterministic counters/ rates/percentiles already arrive via the PRE-CHOSEN METRICS block (user prompt) and are merged automatically -- do NOT duplicate them
Reference 43
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 335e1cb8-7128-4cce-a660-51e865c93e55 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems accuracy
Reference 44
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2597d384-b023-4bf1-86e2-350e94a0e0b4 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Relevancy and clarity are separate metrics, not one
Reference 45
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0dc9067b-b8f1-4d64-a2ed-3695d6883328 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Use LLM-as-Judge ONLY for semantic quality that cannot be computed deterministically
Reference 46
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e4c9dc26-57a7-4447-ae3c-99ec0fefd729 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 47
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1eee4597-af8c-42f2-b874-a217bd99c790 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 48
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 279ca602-b6e4-482d-8297-0f9d904c0a4c · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 49
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cac67077-871d-49bb-b80b-4e757c05a2bf · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems traceability = citation coverage + link strength + evidence breadth), design a composite metric with weighted sub-metrics and a formula
Reference 50
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ca64771c-3ae1-4a43-98cf-362df3cb83f6 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Unresolved cited work
Reference 51
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 81304400-0d42-4a0a-a09a-ddbea6c588d7 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Accuracy + Latency is NOT a valid composite
Reference 52
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f0ac5948-29d8-4cf0-ada2-4ce706463183 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems X_grounding
Reference 53
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1e8f2ac2-3e51-49d6-b62d-c96be2a3b5d5 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems cost_per_quality
Reference 54
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 206b15f9-735d-4138-bd4c-96a198d45b3a · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Explain how they correlate -- e.g
Reference 55
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5bb85000-6fc1-47c0-be44-ece3227d8ed7 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems For each gap, explain what is missing and suggest how to address it (e
Reference 56
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 683e5bfc-c23e-40b5-ac44-dd93c4e31b55 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems > 500ms for 5 minutes
Reference 57
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f3112069-1aa5-4d8b-8814-4ae6c3e80c31 · outbound
Litmus: Zero-Label, Code-Driven Metric Specification for Evaluating AI Systems Reference actual source files when available
Reference 58
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
No inbound Pith citation observations are available.