REVIEW 9 cited by
Carbontracker: Tracking and Predicting the Carbon Footprint of Training Deep Learning Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Deep learning (DL) can achieve impressive results across a wide variety of tasks, but this often comes at the cost of training models for extensive periods on specialized hardware accelerators. This energy-intensive workload has seen immense growth in recent years. Machine learning (ML) may become a significant contributor to climate change if this exponential trend continues. If practitioners are aware of their energy and carbon footprint, then they may actively take steps to reduce it whenever possible. In this work, we present Carbontracker, a tool for tracking and predicting the energy and carbon footprint of training DL models. We propose that energy and carbon footprint of model development and training is reported alongside performance metrics using tools like Carbontracker. We hope this will promote responsible computing in ML and encourage research into energy-efficient deep neural networks.
Forward citations
Cited by 9 Pith papers
-
Towards Decentralized and Sustainable Foundation Model Training with the Edge
Idle edge devices could cut foundation-model training carbon by an estimated 4-8x versus a cloud GPU, based on small-scale energy measurements and lifecycle accounting.
-
Keyword Matters: Unveiling the Energy Sensitivity of On-Device LLM Prompting
On-device LLMs use measurably different amounts of energy depending on the prompt verb, but the effect is mostly a side-effect of response length and is inconsistent across models.
-
HAFM: Hierarchical Autoregressive Foundation Model for Music Accompaniment Generation
HAFM uses a hierarchical autoregressive model with dual-rate HuBERT and EnCodec tokens to generate coherent instrumental music from vocals, achieving FAD 2.08 on MUSDB18 while matching prior systems with fewer parameters.
-
Energy and Quality of Surrogate-Assisted Search Algorithms: a First Analysis
A first empirical study of the energy consumption of surrogate-assisted particle swarm optimization, proposing energy and surrogate accuracy as evaluation axes.
-
Calculating Software's Energy Use and Carbon Emissions: A Survey of the State of Art, Challenges, and the Way Ahead
A structured survey of 21 software energy and carbon calculation tools, organized as Monitoring, Estimation, or Black-Box approaches, with a component-wise comparison and a list of open challenges.
-
A Discrepancy-Based Perspective on Dataset Condensation
Dataset condensation is reframed as minimizing distribution discrepancies, and existing methods are sorted into a taxonomy; no new algorithm or experiments are provided.
-
Performance is not All You Need: Sustainability Considerations for Algorithms
The paper introduces FMS and ASC, composite sustainability scores that fuse accuracy and energy consumption, and evaluates them on multiple vision tasks.
-
Quantifying the Energy Consumption and Carbon Emissions of LLM Inference via Simulations
A simulation framework couples an LLM inference simulator with a GPU power model and an energy-grid co-simulator to estimate energy and carbon emissions across deployment configurations.
-
Greening AI-enabled Systems with Software Engineering: A Research Agenda for Environmentally Sustainable AI Practices
A 29-participant workshop synthesized a research agenda for reducing AI's environmental footprint through software engineering, covering measurement, benchmarking, architecture, empirical methods, and education.
Discussion (0). Sign in to comment.