yProv4ML is a new provenance-tracking library for ML workflows that logs experiments as W3C PROV-compliant provenance graphs and demonstrates its use in large-scale distributed training studies.
Trustworthy Provenance for Big Data Science: a Modular Architecture Leveraging Blockchain in Federated Settings
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Ensuring the trustworthiness and long-term verifiability of scientific data is a foundational challenge in the era of data-intensive, collaborative research. Provenance metadata plays a key role in this context, capturing the origin, transformation, and usage of research artifacts. However, existing solutions often fall short when applied to distributed, multi-institutional settings. This paper introduces a modular, domain-agnostic architecture for provenance tracking in federated environments, leveraging permissioned blockchain infrastructure to guarantee integrity, immutability, and auditability. The system supports decentralized interaction, persistent identifiers for artifact traceability, and a provenance versioning model that preserves the history of updates. Designed to interoperate with diverse scientific domains, the architecture promotes transparency, accountability, and reproducibility across organizational boundaries. Ongoing work focuses on validating the system through a distributed prototype and exploring its performance in collaborative settings.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
support 1representative citing papers
citing papers explorer
-
Provenance Tracking in Large-Scale Machine Learning Systems
yProv4ML is a new provenance-tracking library for ML workflows that logs experiments as W3C PROV-compliant provenance graphs and demonstrates its use in large-scale distributed training studies.