REVIEW 2 cited by
The What-If Tool: Interactive Probing of Machine Learning Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
A key challenge in developing and deploying Machine Learning (ML) systems is understanding their performance across a wide range of inputs. To address this challenge, we created the What-If Tool, an open-source application that allows practitioners to probe, visualize, and analyze ML systems, with minimal coding. The What-If Tool lets practitioners test performance in hypothetical situations, analyze the importance of different data features, and visualize model behavior across multiple models and subsets of input data. It also lets practitioners measure systems according to multiple ML fairness metrics. We describe the design of the tool, and report on real-life usage at different organizations.
Forward citations
Cited by 2 Pith papers
-
Deep learning inference with the Event Horizon Telescope II. The Zingularity framework for Bayesian artificial neural networks
Bayesian neural networks trained on synthetic EHT observations of Sgr A* and M87* recover spin and magnetic state well in cross-code tests, but give overconfident wrong estimates for temperature ratio and inclination ...
-
LangFair: A Python Package for Assessing Bias and Fairness in Large Language Model Use Cases
LangFair is an open-source Python package that computes bias and fairness metrics for LLM use cases from user-provided prompts and responses, guided by a decision framework.
Discussion (0). Continue with ORCID to comment.