RECORD
Efficient and Reliable Probabilistic Interactive Learning with Structured Outputs
Machine Learning · Submitted 17 Feb 2022
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim We identify conditions under which a class of probabilistic models -- which we denote CRISPs -- meet all of these conditions, thus delivering tractable computation of the above quantities while preserving expressiveness.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
In this position paper, we study interactive learning for structured output spaces, with a focus on active learning, in which labels are unknown and must be acquired, and on skeptical learning, in which the labels are noisy and may need relabeling. These scenarios require expressive models that guarantee reliable and efficient computation of probabilistic quantities to measure uncertainty. We identify conditions under which a class of probabilistic models -- which we denote CRISPs -- meet all of these conditions, thus delivering tractable computation of the above quantities while preserving expressiveness. Building on prior work on tractable probabilistic circuits, we illustrate how CRISPs enable robust and efficient active and skeptical learning in large structured output spaces.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | In this position paper, we study interactive learning for structured output spaces, with a focus on active learning, in which labels are unknown and must be acquired, and on skeptical learning, in which the labels are noisy and may need relabeling. | background 0.73 | 0.37 | 0.04 | asserted 0.94 |
| s1 | These scenarios require expressive models that guarantee reliable and efficient computation of probabilistic quantities to measure uncertainty. | background 0.89 | 0.07 | 0.07 | asserted 0.98 |
| s2 | We identify conditions under which a class of probabilistic models -- which we denote CRISPs -- meet all of these conditions, thus delivering tractable computation of the above quantities while preserving expressiveness. | contribution 0.94 | 0.90 | 0.69 | asserted 1.00 |
| s3 | Building on prior work on tractable probabilistic circuits, we illustrate how CRISPs enable robust and efficient active and skeptical learning in large structured output spaces. | contribution 0.77 | 0.76 | 0.33 | asserted 0.99 |
What was examined, and what was not
- arXiv listing abstract v1
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
In this position paper, we study interactive learning for structured output spaces, with a focus on active learning, in which labels are unknown and must be acquired, and on skeptical learning, in which the labels are noisy and may need relabeling. These scenarios require expressive models that guarantee reliable and efficient computation of probabilistic quantities to measure uncertainty. We identify conditions under which a class of probabilistic models -- which we denote CRISPs -- meet all of these conditions, thus delivering tractable computation of the above quantities while preserving expressiveness. Building on prior work on tractable probabilistic circuits, we illustrate how CRISPs enable robust and efficient active and skeptical learning in large structured output spaces.
Human review
How the literature uses it
1 arXiv paper cite this in 1 sentence
What it cites · 4 sentences without a confident label
Compares with 2 papers
-
Closest to our work, [ref] also develop selection heuristics for picking informative example/sub-label pairs based on entropy reduction.
Active Learning amidst Logical Knowledge · Related Work · 0.95
-
On the other hand, [ref] combine skeptical learning with explanation-based interaction in the context of deep neural networks [ref] , but are unconcerned with structured output spaces.
Interactive Label Cleaning with Example-based Explanations · Related Work · 0.91
Cites as background 3 papers
-
Active learning with partial labels has been studied in the context of Bayesian networks [ref] , max-margin predictors [ref] , and other models [ref] .
Active Learning for Structured Prediction from Partially Labeled Data · Related Work · 0.97
-
Active learning with partial labels has been studied in the context of Bayesian networks [ref] , max-margin predictors [ref] , and other models [ref] .
Active Learning with Partial Feedback · Related Work · 0.97
-
Active learning with partial labels has been studied in the context of Bayesian networks [ref] , max-margin predictors [ref] , and other models [ref] .
Partial Or Complete, That's The Question · Related Work · 0.97
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.