Coping with Inductive Risk When Theories are Underdetermined: Decision Making with Partial Identification
Pith reviewed 2026-05-16 08:27 UTC · model grok-4.3
The pith
Combining partial identification with decision criteria under uncertainty enables coherent policy choices without selecting one among underdetermined theories.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Study of partial identification finds underdetermination and inductive risk to be highly consequential for credible prediction of important societal outcomes and for credible public decision making. Mathematical tools characterize scientific uncertainties arising from data and well-supported assumptions. Combining partial identification with criteria for reasonable decision making under uncertainty yields coherent approaches to make policy choices without accepting one among multiple empirically underdetermined theories.
What carries the argument
Partial identification analysis, the process of determining the set of possible values for a population outcome that are consistent with the observed data and the maintained assumptions.
Load-bearing premise
Well-supported assumptions together with available data are sufficient to characterize the relevant scientific uncertainties for making credible societal predictions.
What would settle it
An empirical application in which the identified set of outcomes is so wide that no standard decision criterion can rank policy options would show the approach provides no guidance.
read the original abstract
Controversy about the significance of underdetermination of theories persists in the philosophy and conduct of science. The issue has practical import when research is used to inform decision making, because scientific uncertainty yields inductive risk. Seeking to enhance communication between philosophers and researchers who study public policy, this paper describes econometric analysis of partial identification and its use in welfare-economic policy analysis. Study of partial identification finds underdetermination and inductive risk to be highly consequential for credible prediction of important societal outcomes and, hence, for credible public decision making. It provides mathematical tools to characterize a broad class of scientific uncertainties that arise when available data and well-supported assumptions are combined to predict population outcomes. Combining study of partial identification with criteria for reasonable decision making under uncertainty yields coherent approaches to make policy choices without accepting one among multiple empirically underdetermined theories. The paper argues that study of partial identification warrants attention in philosophical discourse on underdetermination and inductive risk.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper claims that partial identification in econometrics provides mathematical tools to characterize a broad class of scientific uncertainties arising from underdetermined theories when combining data with well-supported assumptions, and that integrating these tools with standard decision criteria under uncertainty (such as maximin or minimax regret) yields coherent policy decision procedures that avoid the need to select among competing empirically underdetermined theories, thereby addressing inductive risk in public policy contexts.
Significance. If the integration holds, the work offers a substantive bridge between philosophy-of-science discussions of underdetermination and practical econometric methods for welfare-economic policy analysis, potentially enabling more credible societal-outcome predictions and decisions that explicitly account for identified sets rather than point estimates.
major comments (2)
- [Abstract and decision-criteria section] Abstract and decision-criteria section: The central claim that the combination produces coherent approaches without relocating underdetermination requires explicit discussion of how to select among decision criteria when they disagree on the same identified set; different criteria (maximin vs. minimax regret) can yield conflicting policy rankings, and absent a further grounding that itself avoids underdetermination, the inductive-risk problem is shifted rather than eliminated.
- [Partial-identification applications] Partial-identification applications: The manuscript should supply at least one fully worked numerical example deriving explicit bounds on an outcome distribution from data plus assumptions and then applying a specific decision criterion to produce a policy ranking, to demonstrate that the claimed coherence is operational rather than conceptual only.
minor comments (1)
- Clarify notation for identified sets and decision functionals early and maintain consistency; avoid switching between set-valued and interval representations without explicit mapping.
Simulated Author's Rebuttal
We thank the referee for these constructive comments, which highlight important aspects of how partial identification interacts with decision criteria under uncertainty. We address each major comment below and will revise the manuscript to strengthen the exposition while preserving the core argument that partial identification tools address inductive risk without requiring selection among underdetermined theories.
read point-by-point responses
-
Referee: [Abstract and decision-criteria section] Abstract and decision-criteria section: The central claim that the combination produces coherent approaches without relocating underdetermination requires explicit discussion of how to select among decision criteria when they disagree on the same identified set; different criteria (maximin vs. minimax regret) can yield conflicting policy rankings, and absent a further grounding that itself avoids underdetermination, the inductive-risk problem is shifted rather than eliminated.
Authors: We agree that explicit discussion of criterion selection is warranted when maximin and minimax regret (or other rules) produce conflicting rankings on the same identified set. However, this does not relocate the original inductive-risk problem. The underdetermination addressed by partial identification concerns the empirical content of the model (what outcomes are consistent with data plus maintained assumptions). In contrast, the choice among decision criteria is a normative matter of how the policy maker wishes to handle ambiguity, which can be grounded in explicit preferences or robustness considerations without reintroducing empirical underdetermination. In the revised version we will add a dedicated paragraph in the decision-criteria section clarifying this distinction and outlining practical approaches (e.g., reporting rankings under multiple criteria or adopting a meta-criterion such as maximin regret over the set of admissible rules). This addition will make the coherence claim more precise without altering the manuscript's central thesis. revision: yes
-
Referee: [Partial-identification applications] Partial-identification applications: The manuscript should supply at least one fully worked numerical example deriving explicit bounds on an outcome distribution from data plus assumptions and then applying a specific decision criterion to produce a policy ranking, to demonstrate that the claimed coherence is operational rather than conceptual only.
Authors: We accept that a concrete numerical illustration would better demonstrate operational coherence. Although the manuscript is primarily conceptual to facilitate dialogue between philosophy of science and econometrics, we will add a short worked example in a new subsection of the applications section. The example will derive sharp bounds on a binary outcome distribution from a simple data-generating process plus a monotonicity assumption, then apply the maximin criterion to rank two policy alternatives. This will show explicitly how the identified set feeds into a decision rule and produces a determinate policy recommendation without point identification. The addition will be kept concise to maintain the paper's focus while addressing the referee's request. revision: yes
Circularity Check
No load-bearing circularity; external criteria and prior methods keep derivation independent
full rationale
The paper combines established partial-identification bounds with separate decision criteria (maximin, minimax regret, etc.) drawn from decision theory. No equation or step in the described framework defines a prediction in terms of itself or renames a fitted parameter as a novel result. Self-citations to Manski's earlier partial-ID work are present but not load-bearing for the central claim that the combination yields coherent policy choices; that claim rests on the external decision criteria rather than reducing to a tautology within this manuscript.
Axiom & Free-Parameter Ledger
axioms (2)
- domain assumption Available data and well-supported assumptions can be combined to bound population outcomes
- domain assumption Criteria exist for reasonable decision making under uncertainty that do not require selecting a single theory
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel echoes?
echoesECHOES: this paper passage has the same mathematical shape or conceptual pattern as the Recognition theorem, but is not a direct formal dependency.
Manski (2003) introduced a principle called 'The Law of Decreasing Credibility: The credibility of inference decreases with the strength of the assumptions maintained.'
-
IndisputableMonolith/Foundation/ArithmeticFromLogic.leanLogicNat recovery from non-trivial generator echoes?
echoesECHOES: this paper passage has the same mathematical shape or conceptual pattern as the Recognition theorem, but is not a direct formal dependency.
Combining study of partial identification with criteria for reasonable decision making under uncertainty yields coherent approaches to make policy choices without accepting one among multiple empirically underdetermined theories.
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.