Pith. sign in

REVIEW

A Bespoke Workflow Management System for Data-Driven Urgent HPC

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2010.12328 v1 pith:36SDPJTP submitted 2020-10-23 cs.DC

A Bespoke Workflow Management System for Data-Driven Urgent HPC

Gordon P. S. Gibb , Nick Brown , Rupert W , Nash , Miguel Mendes , Santiago Monedero , Humberto D\'iaz Fidalgo , Joaqu\'in Ram\'irez Cisneros
show 2 more authors
Adri\'an Cardil Max Kontak
This is my paper
classification cs.DC
keywords workflowsystemmanagementdataprojecturgentvestecdata-driven
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

In this paper we present a workflow management system which permits the kinds of data-driven workflows required by urgent computing, namely where new data is integrated into the workflow as a disaster progresses in order refine the predictions as time goes on. This allows the workflow to adapt to new data at runtime, a capability that most workflow management systems do not possess. The workflow management system was developed for the EU-funded VESTEC project, which aims to fuse HPC with real-time data for supporting urgent decision making. We first describe an example workflow from the VESTEC project, and show why existing workflow technologies do not meet the needs of the project. We then go on to present the design of our Workflow Management System, describe how it is implemented into the VESTEC system, and provide an example of the workflow system in use for a test case.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.