Pith. sign in

REVIEW 7 cited by

A Framework for Understanding Sources of Harm throughout the Machine Learning Life Cycle

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1901.10002 v5 pith:WWBC7OWL submitted 2019-01-28 cs.LG stat.ML

classification cs.LGstat.ML
keywords harmlearningmachineconsequencescycledownstreamframeworklife
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

As machine learning (ML) increasingly affects people and society, awareness of its potential unwanted consequences has also grown. To anticipate, prevent, and mitigate undesirable downstream consequences, it is critical that we understand when and how harm might be introduced throughout the ML life cycle. In this paper, we provide a framework that identifies seven distinct potential sources of downstream harm in machine learning, spanning data collection, development, and deployment. In doing so, we aim to facilitate more productive and precise communication around these issues, as well as more direct, application-grounded ways to mitigate them.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Sources of Inequity and Fairness Risks in Wellbeing Sensing

    cs.HC 2026-07 conditional novelty 6.0 of 10

    A 14-person interview study identifies five situated sources of inequity and 15 lifecycle fairness risks in wellbeing sensing, going beyond identity-based audits.

  2. Perception-Driven Bias Detection in Machine Learning via Crowdsourced Visual Judgment

    cs.LG 2025-05 reject novelty 6.0 of 10

    A pilot study suggests people can sometimes spot visible salary disparities in dot plots, but one positive cluster out of four is too little evidence to support perception-driven bias detection as reliable.

  3. ALBAR: Adversarial Learning approach to mitigate Biases in Action Recognition

    cs.CV 2025-01 conditional novelty 6.0 of 10

    ALBAR trains a single video encoder with an adversarial objective on repeated-frame static clips, entropy maximization and a gradient penalty, raising HMDB51 SCUBA/SCUFO contrasted accuracy from 40.28% to 53.22% and i...

  4. Using Machine Bias To Measure Human Bias

    cs.LG 2024-11 reject novelty 6.0 of 10

    A method that uses models trained on human decisions, after threshold recalibration to equalize a recall-precision ratio, to estimate group disparities in human true positive rates from a small disjoint gold-standard set.

  5. A Cross-Cultural Comparison of LLM-based Public Opinion Simulation: Evaluating Chinese and U.S. Models on Diverse Societies

    cs.CL 2025-06 conditional novelty 5.0 of 10

    Across U.S. and Chinese survey questions, DeepSeek, GPT-4o, Qwen2.5, and Llama-3.3 all show demographic overgeneralization, with no consistent home-field advantage for the Chinese model.

  6. Generative AI regulation can learn from social media regulation

    cs.CY 2024-12 conditional novelty 4.0 of 10

    Regulatory lessons from social media, especially transparency, researcher access, trust and safety, and a global perspective, can be transferred to generative AI regulation.

  7. Navigating the Risks: A Survey of Security, Privacy, and Ethics Threats in LLM-Based Agents

    cs.AI 2024-11 conditional novelty 4.0 of 10

    A survey proposing a source-and-impact taxonomy (input, model, combined; security, privacy, ethics) for threats to LLM-based agents, with feature analysis and four case studies.

Pith tools