Paper Citation Record · LEDGER

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

As of 10 August 2026, this Paper Citation Record lists 21 of 21 outbound references and 9 inbound Pith citation observations for arXiv:2502.05352.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.05352 v1

Coverage vector

measured 21 of 21 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T19:46:29.077278Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 9 of 9 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T07:41:24.219547Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

21 of 21 outbound references displayed

verified exact0
verified fuzzy11
unresolved9
parse uncertain0
malformed identifier1
metadata mismatch0

External citation measurements

1
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation b520474b-66a0-4189-814d-065f8998975c · outbound

This paper cites an unresolved cited work.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-08T19:46:29.497251Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation c889bd70-fa31-40ab-a2fa-37ce087048ef · outbound

This paper cites an unresolved cited work.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work

Reference 2

Resolution: unresolved; raw_fallback, observed 2026-08-08T19:46:29.482665Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation aaac6ff3-c0d8-4503-b018-7d1e1aba76d3 · outbound

This paper cites playground.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks playground

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T19:46:29.468237Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation e325e85d-2de9-4d5f-9002-5fca9ce9247c · outbound

This paper cites (b) Benchmark Runner deploys the scenario’s environ- ment by executing the deploy_scenario function.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks (b) Benchmark Runner deploys the scenario’s environ- ment by executing the deploy_scenario function

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T19:46:29.453209Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 1a10f1a3-76de-4437-9fe3-385fccd199d0 · outbound

This paper cites node failure.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks node failure

Reference 5

Resolution: malformed identifier; raw_fallback, observed 2026-08-08T19:46:29.438610Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 36705693-e0e4-468a-93bd-80e0e613a7d3 · outbound

This paper cites an unresolved cited work.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work

Reference 6

Resolution: unresolved; raw_fallback, observed 2026-08-08T19:46:29.345593Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 39f41ebf-5218-4df1-a208-237a3b5de4f7 · outbound

This paper cites pass" or.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks pass" or

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T19:46:29.329503Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation ef9f8cff-5133-4745-8dd3-c2eadf8fe02a · outbound

This paper cites Kick agent Y with report.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Kick agent Y with report

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T19:46:29.280862Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 4910c503-b40e-449d-9630-68d83db3678f · outbound

This paper cites We group the agents by Agent Types that reflect the IT operations personas, for example CISO, FInOps, or SRE type.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks We group the agents by Agent Types that reflect the IT operations personas, for example CISO, FInOps, or SRE type

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T19:46:29.423396Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 271a0c99-016f-42b9-9770-2269da4593af · outbound

This paper cites Typi- cal tasks for CISO are to collect evidence and assess compliance controls posture.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Typi- cal tasks for CISO are to collect evidence and assess compliance controls posture

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T19:46:29.407414Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 3f4c685f-4084-4291-8963-ec9fc441979c · outbound

This paper cites For CISO, for instance, each Kubernetes CIS-benchmark requirement instantiated on OPA is a unique scenario.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks For CISO, for instance, each Kubernetes CIS-benchmark requirement instantiated on OPA is a unique scenario

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T19:46:29.391966Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 361d25b6-d50e-4bdb-8a2c-4490dbfc7bfd · outbound

This paper cites an unresolved cited work.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-08-08T19:46:29.376752Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation efb97043-9e9b-4379-96ba-48c424d43d33 · outbound

This paper cites an unresolved cited work.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-08-08T19:46:29.361161Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 3d356a79-91fc-446c-9f27-634725a3142c · outbound

This paper cites an unresolved cited work.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-08-08T19:46:29.312564Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 927cc06d-5a49-4738-9248-13ca839ca6ff · outbound

This paper cites deploy_environment.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks deploy_environment

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T19:46:29.296425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 882879e2-8f54-4857-b0f4-cee53f461396 · outbound

This paper cites Clear deployed scenario2.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Clear deployed scenario2

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T19:46:29.265588Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation da5608ce-a675-45f1-b012-5b675355edc1 · outbound

This paper cites mini- mize the admission of containers wishing to share the host network namespace.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks mini- mize the admission of containers wishing to share the host network namespace

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T19:46:29.249324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation b2537391-61d0-4d00-a9fc-cf0f6ec47733 · outbound

This paper cites Exploring LLM-based Agents for Root Cause Analysis.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Exploring LLM-based Agents for Root Cause Analysis

Reference 365

Resolution: unresolved; no resolver link, observed 2026-08-08T19:46:28.986960Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a14c3c13-3df1-4e31-956b-ea1e4feaddc7 · outbound

This paper cites doi: 10.1145/2829988.2787496.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks doi: 10.1145/2829988.2787496

Reference 2015

Resolution: unresolved; no resolver link, observed 2026-08-08T19:46:28.981608Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1f66d25f-b529-403d-b8f0-689eb1e46340 · outbound

This paper cites an unresolved cited work.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks Unresolved cited work

Reference 2022

Resolution: unresolved; raw_fallback, observed 2026-08-08T19:46:29.513270Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 33c4311d-fded-49d5-a82d-ead5ae4a6d64 · outbound

This paper cites the AI revolution hasn’t happened yet.

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks the AI revolution hasn’t happened yet

Reference 2024

Resolution: verified fuzzy; raw_fallback, observed 2026-08-08T19:46:29.529339Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Pith citing papers

Observation ddff6922-1cf3-4055-83be-510cd414c2ca · inbound

LLMs Corrupt Your Documents When You Delegate cites this paper.

LLMs Corrupt Your Documents When You Delegate ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

Reference 36

Resolution: verified exact; arxiv_id, observed 2026-05-10T09:48:47.626847Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 0247fec9-b64b-4ff5-b8d1-8863f7809c47 · inbound

Experiment-as-Code Labs: A Declarative Stack for AI-Driven Scientific Discovery cites this paper.

Experiment-as-Code Labs: A Declarative Stack for AI-Driven Scientific Discovery ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

Reference 136

Resolution: verified exact; arxiv_id, observed 2026-05-08T20:04:06.598794Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation f603da73-d2fd-44f9-b490-51cab57d9fb7 · inbound

Experiment-as-Code Labs: A Declarative Stack for AI-Driven Scientific Discovery cites this paper.

Experiment-as-Code Labs: A Declarative Stack for AI-Driven Scientific Discovery ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

Reference 136

Resolution: verified exact; arxiv_id, observed 2026-05-21T00:13:52.344837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation b341aca9-665d-4d30-a077-6ec02259c301 · inbound

From Assistance to Agency: Rethinking Autonomy and Control in CI/CD Pipelines cites this paper.

From Assistance to Agency: Rethinking Autonomy and Control in CI/CD Pipelines ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

Reference 24

Resolution: verified exact; arxiv_id, observed 2026-05-11T03:55:57.170897Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation df8a5b55-37bf-49a0-8ef3-7ecabce42b99 · inbound

Runtime-Structured Task Decomposition for Agentic Coding Systems cites this paper.

Runtime-Structured Task Decomposition for Agentic Coding Systems ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

Reference 22

Resolution: verified exact; arxiv_id, observed 2026-05-19T14:47:36.175763Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation d0025bab-9094-4305-adcc-ad8f611abf7d · inbound

Auditable Graph-Guided Root Cause Analysis for Kubernetes Incidents cites this paper.

Auditable Graph-Guided Root Cause Analysis for Kubernetes Incidents ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

Reference 3

Resolution: metadata mismatch; arxiv_id, observed 2026-07-02T23:27:28.084149Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation ecaeffc4-54e8-476c-8a4e-e48ca3bdc2a5 · inbound

Pooled Leaderboards Hide System-Specific Winners: A Reporting-Protocol Audit of Offline Root-Cause Analysis Benchmarks cites this paper.

Pooled Leaderboards Hide System-Specific Winners: A Reporting-Protocol Audit of Offline Root-Cause Analysis Benchmarks ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

Reference 11

Resolution: metadata mismatch; arxiv_id, observed 2026-06-30T07:54:21.844748Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 7e62ae76-ef13-4998-bb89-f97064594ab4 · inbound

Synthetic Scenario Generation for Evaluation of Industry 4.0 Agents cites this paper.

Synthetic Scenario Generation for Evaluation of Industry 4.0 Agents ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

Reference 2025

Resolution: unresolved; no resolver link, observed 2026-08-02T12:47:54.895493Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4886e0b6-7834-48f1-94b6-916a93d33fd3 · inbound

Beyond Component Testing: Validating Agentic AI Systems cites this paper.

Beyond Component Testing: Validating Agentic AI Systems ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-03T07:41:24.219547Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.