REVIEW 2 cited by
AI-coupled HPC Workflows
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Increasingly, scientific discovery requires sophisticated and scalable workflows. Workflows have become the ``new applications,'' wherein multi-scale computing campaigns comprise multiple and heterogeneous executable tasks. In particular, the introduction of AI/ML models into the traditional HPC workflows has been an enabler of highly accurate modeling, typically reducing computational needs compared to traditional methods. This chapter discusses various modes of integrating AI/ML models to HPC computations, resulting in diverse types of AI-coupled HPC workflows. The increasing need of coupling AI/ML and HPC across scientific domains is motivated, and then exemplified by a number of production-grade use cases for each mode. We additionally discuss the primary challenges of extreme-scale AI-coupled HPC campaigns -- task heterogeneity, adaptivity, performance -- and several framework and middleware solutions which aim to address them. While both HPC workflow and AI/ML computing paradigms are independently effective, we highlight how their integration, and ultimate convergence, is leading to significant improvements in scientific performance across a range of domains, ultimately resulting in scientific explorations otherwise unattainable.
Forward citations
Cited by 2 Pith papers
-
A Study on Messaging Trade-offs in Data Streaming for Scientific Workflows
Batching publisher confirms, batching acknowledgements, raising prefetch, and using a few parallel queues recover most throughput lost to reliable-messaging settings in RabbitMQ for Deleria and LCLS-style streaming.
-
Enabling Seamless Transitions from Experimental to Production HPC for Interactive Workflows
OLCF proposes a structured ACE-to-Frontier path that combines policy adaptations and three technical services to make interactive, time-sensitive HPC workflows transition from testbeds to production.
Discussion (0). Continue with ORCID to comment.