RECORD
Improving Operator Situation Awareness when Working with AI Recommender Systems
Human-Computer Interaction · Submitted 17 Oct 2023
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim We found that providing contextual information upfront improves the team's shared situation awareness by improving the human decision maker's initial and final judgment, as well as their ability to discern the recommender's error boundary.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
AI recommender systems are sought for decision support by providing suggestions to operators responsible for making final decisions. However, these systems are typically considered black boxes, and are often presented without any context or insight into the underlying algorithm. As a result, recommender systems can lead to miscalibrated user reliance and decreased situation awareness. Recent work has focused on improving the transparency of recommender systems in various ways such as improving the recommender's analysis and visualization of the figures of merit, providing explanations for the recommender's decision, as well as improving user training or calibrating user trust. In this paper, we introduce an alternative transparency technique of structuring the order in which contextual information and the recommender's decision are shown to the human operator. This technique is designed to improve the operator's situation awareness and therefore the shared situation awareness between the operator and the recommender system. This paper presents the results of a two-phase between-subjects study in which participants and a recommender system jointly make a high-stakes decision. We varied the amount of contextual information the participant had, the assessment technique of the figures of merit, and the reliability of the recommender system. We found that providing contextual information upfront improves the team's shared situation awareness by improving the human decision maker's initial and final judgment, as well as their ability to discern the recommender's error boundary. Additionally, this technique accurately calibrated the human operator's trust in the recommender. This work proposes and validates a way to provide model-agnostic transparency into AI systems that can support the human decision maker and lead to improved team performance.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | AI recommender systems are sought for decision support by providing suggestions to operators responsible for making final decisions. | background 1.00 | 0.04 | 0.02 | asserted 0.98 |
| s1 | However, these systems are typically considered black boxes, and are often presented without any context or insight into the underlying algorithm. | background 0.89 | 0.04 | 0.01 | asserted 0.92 |
| s2 | As a result, recommender systems can lead to miscalibrated user reliance and decreased situation awareness. | background 0.97 | 0.05 | 0.02 | hedged possibility 0.55 |
| s3 | Recent work has focused on improving the transparency of recommender systems in various ways such as improving the recommender's analysis and visualization of the figures of merit, providing explanations for the recommender's decision, as well as improving user training or calibrating user trust. | background 1.00 | 0.03 | 0.02 | asserted 1.00 |
| s4 | In this paper, we introduce an alternative transparency technique of structuring the order in which contextual information and the recommender's decision are shown to the human operator. | contribution 0.99 | 0.83 | 0.04 | asserted 0.99 |
| s5 | This technique is designed to improve the operator's situation awareness and therefore the shared situation awareness between the operator and the recommender system. | contribution 0.90 | 0.26 | 0.08 | asserted 0.83 |
| s6 | This paper presents the results of a two-phase between-subjects study in which participants and a recommender system jointly make a high-stakes decision. | method 0.77 | 0.93 | 0.03 | asserted 0.99 |
| s7 | We varied the amount of contextual information the participant had, the assessment technique of the figures of merit, and the reliability of the recommender system. | method 0.98 | 0.91 | 0.02 | asserted 0.98 |
| s8 | We found that providing contextual information upfront improves the team's shared situation awareness by improving the human decision maker's initial and final judgment, as well as their ability to discern the recommender's error boundary. | result 1.00 | 0.97 | 0.77 | asserted 1.00 |
| s9 | Additionally, this technique accurately calibrated the human operator's trust in the recommender. | result 1.00 | 0.92 | 0.16 | asserted 1.00 |
| s10 | This work proposes and validates a way to provide model-agnostic transparency into AI systems that can support the human decision maker and lead to improved team performance. | contribution 0.73 | 0.76 | 0.57 | asserted 0.69 |
What was examined, and what was not
- arXiv listing abstract v1
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
AI recommender systems are sought for decision support by providing suggestions to operators responsible for making final decisions. However, these systems are typically considered black boxes, and are often presented without any context or insight into the underlying algorithm. As a result, recommender systems can lead to miscalibrated user reliance and decreased situation awareness. Recent work has focused on improving the transparency of recommender systems in various ways such as improving the recommender's analysis and visualization of the figures of merit, providing explanations for the recommender's decision, as well as improving user training or calibrating user trust. In this paper, we introduce an alternative transparency technique of structuring the order in which contextual information and the recommender's decision are shown to the human operator. This technique is designed to improve the operator's situation awareness and therefore the shared situation awareness between the operator and the recommender system. This paper presents the results of a two-phase between-subjects study in which participants and a recommender system jointly make a high-stakes decision. We varied the amount of contextual information the participant had, the assessment technique of the figures of merit, and the reliability of the recommender system. We found that providing contextual information upfront improves the team's shared situation awareness by improving the human decision maker's initial and final judgment, as well as their ability to discern the recommender's error boundary. Additionally, this technique accurately calibrated the human operator's trust in the recommender. This work proposes and validates a way to provide model-agnostic transparency into AI systems that can support the human decision maker and lead to improved team performance.
Human review
How the literature uses it
What this paper does with the arXiv papers it cites
What it cites · 4 sentences without a confident label
Cites as background 1 paper
-
Much work in this area focuses on providing explanations for singular decision points [ref] .
Interpretable & Explorable Approximations of Black Box Models · Known Contributions to Mitigate Challenges · 0.94
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.