Pith. sign in

REVIEW 1 cited by

Towards Automating the AI Operations Lifecycle

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2003.12808 v1 pith:QQG3CC5M submitted 2020-03-28 cs.LG cs.SE

Towards Automating the AI Operations Lifecycle

Matthew Arnold , Jeffrey Boston , Michael Desmond , Evelyn Duesterwald , Benjamin Elder , Anupama Murthi , Jiri Navratil , Darrell Reimer This is my paper
classification cs.LG cs.SE
keywords humanoperationsautomationinvolvementlifecyclemodelperformancestages
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Today's AI deployments often require significant human involvement and skill in the operational stages of the model lifecycle, including pre-release testing, monitoring, problem diagnosis and model improvements. We present a set of enabling technologies that can be used to increase the level of automation in AI operations, thus lowering the human effort required. Since a common source of human involvement is the need to assess the performance of deployed models, we focus on technologies for performance prediction and KPI analysis and show how they can be used to improve automation in the key stages of a typical AI operations pipeline.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. CITRUS: Candidate Inference and Temporal-tracking for Reliable, Unobtrusive Sensing of Wearable Heart Rate under Motion

    cs.HC 2026-07 conditional novelty 5.0

    A candidate-based causal Viterbi estimator with a learned accept/hold/reject reporting policy reduces motion-window heart-rate MAE from ≈10.8 to 6.2 BPM at 50% coverage on ring PPG and improves reported-window accurac...