REVIEW 7 cited by
Life-Cycle Emissions of AI Hardware: A Cradle-To-Grave Approach and Generational Trends
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Specialized hardware accelerators aid the rapid advancement of artificial intelligence (AI), and their efficiency impacts AI's environmental sustainability. This study presents the first publication of a comprehensive AI accelerator life-cycle assessment (LCA) of greenhouse gas emissions, including the first publication of manufacturing emissions of an AI accelerator. Our analysis of five Tensor Processing Units (TPUs) encompasses all stages of the hardware lifespan - from raw material extraction, manufacturing, and disposal, to energy consumption during development, deployment, and serving of AI models. Using first-party data, it offers the most comprehensive evaluation to date of AI hardware's environmental impact. We include detailed descriptions of our LCA to act as a tutorial, road map, and inspiration for other computer engineers to perform similar LCAs to help us all understand the environmental impacts of our chips and of AI. A byproduct of this study is the new metric compute carbon intensity (CCI) that is helpful in evaluating AI hardware sustainability and in estimating the carbon footprint of training and inference. This study shows that CCI improves 3x from TPU v4i to TPU v6e. Moreover, while this paper's focus is on hardware, software advancements leverage and amplify these gains.
Forward citations
Cited by 7 Pith papers
-
Lights, Camera, Carbon: Architectural Scaling Laws for Video Generation Energy Consumption
Energy of text-to-video diffusion models is predicted from architectural first principles and observable generation parameters with under 3% MAPE, without needing weights or model size.
-
CarbonFlex: Enabling Carbon-aware Provisioning and Scheduling for Cloud Clusters
A learning-based cluster scheduler that jointly provisions capacity and elastically scales batch jobs to cut operational carbon by up to 57.5% in AWS tests.
-
Auto-Scaling Heterogeneous Neural Processing Units for Energy and Cost-Efficient LLM Serving
NeuScale routes LLM inference requests to the most energy/cost-efficient configuration of heterogeneous NPU chips using roofline allocation and runtime auto-scaling.
-
CEO-DC: Driving Decarbonization in HPC Data Centers with Actionable Insights
A decision framework using new carbon and price efficiency metrics shows most AI platform improvements cannot keep pace with demand growth, and short upgrade cycles need carbon prices far above current levels.
-
Misinformation by Omission: The Need for More Environmental Transparency in AI
Environmental disclosure for notable AI models peaked in 2022 and then declined, and out-of-context energy and emissions estimates now dominate media coverage.
-
LLM Harms: A Taxonomy and Discussion
This paper proposes a taxonomy of LLM harms in five categories and suggests mitigation strategies plus a dynamic auditing system for responsible development.
-
A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO
This survey classifies distributed DNN training simulators into analytical, profiling-based, and execution-driven categories, and compares them alongside TCO and carbon-emission models.
Discussion (0). Sign in to comment.