Pith. sign in

REVIEW

TonY: An Orchestrator for Distributed Machine Learning Jobs

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1904.01631 v1 pith:DSN7CWML submitted 2019-03-24 cs.DC cs.LGstat.ML

classification cs.DCcs.LGstat.ML
keywords distributedtrainingjobslearningmachineorchestratorrequirestony
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Training machine learning (ML) models on large datasets requires considerable computing power. To speed up training, it is typical to distribute training across several machines, often with specialized hardware like GPUs or TPUs. Managing a distributed training job is complex and requires dealing with resource contention, distributed configurations, monitoring, and fault tolerance. In this paper, we describe TonY, an open-source orchestrator for distributed ML jobs built at LinkedIn to address these challenges.

Discussion (0). Continue with ORCID to comment.

Pith tools