Paper Citation Record · LEDGER

OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

As of 7 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 11 inbound Pith citation observations for arXiv:2310.07637.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2310.07637 v5

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 11 of 11 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 11 of 11 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T00:23:41.521031Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-06-30T02:44:11.435811Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation fbf3bf20-535a-4935-a195-81c8c45d179d · inbound

AviationLLM: An LLM-based Knowledge System for Aviation Training cites this paper.

AviationLLM: An LLM-based Knowledge System for Aviation Training OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-07T00:23:41.521031Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 465e73db-8c85-484f-bde7-400bdb029460 · inbound

SetupBench: Assessing Software Engineering Agents' Ability to Bootstrap Development Environments cites this paper.

SetupBench: Assessing Software Engineering Agents' Ability to Bootstrap Development Environments OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-06T18:08:49.556866Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 76625ad5-70ef-414b-8d62-6c69d81a27d5 · inbound

A Survey of AIOps in the Era of Large Language Models cites this paper.

A Survey of AIOps in the Era of Large Language Models OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Reference 79

Resolution: unresolved; no resolver link, observed 2026-08-06T23:26:36.786910Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 74b96254-2e39-448f-bc73-9b2fa00af62c · inbound

OpsLLM: Construction of Large Language Model for Software Operations with Multi-stage Learning cites this paper.

OpsLLM: Construction of Large Language Model for Software Operations with Multi-stage Learning OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Reference 25

Resolution: verified exact; arxiv_id, observed 2026-05-10T22:15:48.651505Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 5ecd2eb1-32b2-46ec-b394-5275af059bd7 · inbound

OpsLLM: Construction of Large Language Model for Software Operations with Multi-stage Learning cites this paper.

OpsLLM: Construction of Large Language Model for Software Operations with Multi-stage Learning OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Reference 25

Resolution: verified exact; arxiv_id, observed 2026-05-13T06:27:24.625532Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 61b04163-e2b6-48f3-82ab-7f157bc6ba8e · inbound

OpsLLM: Construction of Large Language Model for Software Operations with Multi-stage Learning cites this paper.

OpsLLM: Construction of Large Language Model for Software Operations with Multi-stage Learning OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-03T02:30:33.221329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4627ea89-cb98-4615-8fe5-83ce38880188 · inbound

SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios cites this paper.

SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Reference 57

Resolution: verified exact; arxiv_id, observed 2026-05-11T02:20:54.800888Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 415face9-d8af-4ef5-8965-40edc8f485c1 · inbound

SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios cites this paper.

SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Reference 55

Resolution: verified exact; arxiv_id, observed 2026-05-14T21:49:29.215706Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation c3cc156d-7930-491c-8130-d71444712d21 · inbound

SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios cites this paper.

SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-03T00:18:42.347258Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dd1f44f0-cf79-43ab-b804-2cbbd711591a · inbound

A Multi-Dataset Benchmark for Evaluating LLM Agents in Microservice Failure Diagnosis cites this paper.

A Multi-Dataset Benchmark for Evaluating LLM Agents in Microservice Failure Diagnosis OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Reference 13

Resolution: verified exact; arxiv_id, observed 2026-06-30T02:44:11.437652Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

Observation 8e90c3c3-167d-410d-9275-2cab651b3349 · inbound

DBA-Bench: A Production-Fidelity Benchmark for LLM-Based Database Operations Agents cites this paper.

DBA-Bench: A Production-Fidelity Benchmark for LLM-Based Database Operations Agents OpsEval: A Comprehensive IT Operations Benchmark Suite for Large Language Models

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-01T05:37:52.821305Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.