pith. sign in

arxiv: 2605.01600 · v1 · submitted 2026-05-02 · 💻 cs.SE

A Lightweight Scrum Sprint Simulation to Help Learners Traverse the Empirical Process Control Threshold Concept

Eduardo Miranda , Torgeir Dings{\o}yr , Pritam Chita This is my paper

Pith reviewed 2026-05-09 13:52 UTC · model grok-4.3

classification 💻 cs.SE
keywords Scrum simulationempirical process controlthreshold conceptsagile educationactive learningsoftware engineering teachingsprint activity
0
0 comments X

The pith

A lightweight sprint simulation helps students traverse the empirical process control threshold in Scrum.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper introduces a free, customizable sprint simulation for teaching how to manage Scrum projects through empirical observation rather than upfront planning. In the activity, students present work status, interpret results, select tasks, and allocate resources within a single session. The authors used this in master-level courses at two universities and for training teaching assistants, then mapped student comments to the threshold concepts framework to show it aids crossing from theoretical knowledge to practical empirical control. Readers would care because this addresses a common difficulty in agile education where students struggle to apply iterative, observation-based decision making in real projects.

Core claim

The central discovery is that a lightweight, scalable sprint simulation, used as an active learning complement to direct instruction, enables students to engage directly in the presentation and interpretation of work status information, task selection, and resource allocations, thereby helping them traverse the empirical process control threshold concept, as evidenced by abductive mapping of their comments to teaching practices in the threshold concepts framework.

What carries the argument

The lightweight Scrum sprint simulation activity that simulates a single sprint's empirical control activities.

If this is right

  • Students gain hands-on experience with empirical decision-making in a low-risk setting.
  • Instructors can add it to courses without significant time or resource investment.
  • The simulation supports scalability across different class sizes and customization for specific needs.
  • It proves useful for training teaching assistants in addition to students.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • If the simulation works, similar lightweight activities could help with other threshold concepts in software engineering education.
  • Adoption might lead to faster development of practical agile skills in graduates.
  • Testing the simulation in industry training contexts could extend its reach beyond academia.

Load-bearing premise

Mapping student comments abductively to the threshold concepts framework provides sufficient evidence of effectiveness, without needing controlled comparisons or quantitative measures.

What would settle it

A controlled experiment where one group uses the simulation and another does not, followed by assessing their ability to apply empirical process control in a follow-up project or test.

read the original abstract

Empirical process control, a way of managing work based on the observation of the successes or misfortunes of earlier activities, is a key process in Scrum and other agile development frameworks. In this experience report, we present a lightweight, scalable, free and customizable sprint simulation activity designed to teach students how to empirically control a Scrum project by engaging in the presentation and interpretation of work status information, task selection and resource allocations in a single teaching session. We reflect on our experience using the simulation as an active learning complement to direct instruction in two master level courses at two different universities and in the training of teaching assistants at a third institution, and abductively establish its effectiveness by mapping student comments to the teaching practices in the threshold concepts framework.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 3 minor

Summary. The paper presents a lightweight, scalable, free, and customizable sprint simulation activity for teaching empirical process control in Scrum. It reports on the simulation's use as an active learning complement to direct instruction in two master's-level courses at different universities and in TA training at a third institution. The authors claim to abductively establish the simulation's effectiveness in helping learners traverse the empirical process control threshold concept by mapping student comments to teaching practices from the threshold concepts framework.

Significance. If the effectiveness claim holds, this would be a useful contribution to software engineering education by offering a practical, low-overhead experiential tool that addresses a key threshold concept in agile development. The simulation's free, customizable, and single-session design supports broad adoption and scalability, which is a strength for educators. The integration with the threshold concepts framework provides theoretical grounding for the active learning approach.

major comments (2)
  1. [Experience and Reflection] In the section on experience and reflection: the central claim that the simulation helps learners traverse the empirical process control threshold concept is established solely through abductive mapping of qualitative student comments to the threshold concepts framework. No pre/post measures of concept mastery, quantitative performance indicators, baseline assessments, or comparison groups are described, leaving the attribution of effectiveness to the simulation (as opposed to direct instruction or other factors) open to alternative explanations.
  2. [Experience and Reflection] The paper does not address how student comments were collected, selected, or interpreted, including any discussion of potential response bias, the role of the simulation's novelty, or inter-rater reliability in the abductive mapping process. This is load-bearing for the effectiveness claim.
minor comments (3)
  1. [Simulation Description] Clarify the precise mechanics of the simulation (e.g., how work status is presented, task selection rules, and resource allocation steps) with an example or pseudocode to improve reproducibility.
  2. [Experience and Reflection] Explicitly state any ethical considerations or consent processes for collecting and reporting student comments.
  3. [Conclusion] Consider adding a limitations subsection that acknowledges the interpretive nature of the evidence and suggests directions for more controlled future evaluations.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the insightful comments on our experience report. We provide point-by-point responses to the major comments below, clarifying our methodological choices and agreeing to enhance transparency where possible.

read point-by-point responses

  1. Referee: In the section on experience and reflection: the central claim that the simulation helps learners traverse the empirical process control threshold concept is established solely through abductive mapping of qualitative student comments to the threshold concepts framework. No pre/post measures of concept mastery, quantitative performance indicators, baseline assessments, or comparison groups are described, leaving the attribution of effectiveness to the simulation (as opposed to direct instruction or other factors) open to alternative explanations.

    Authors: We recognize the limitations of relying solely on qualitative student comments without quantitative pre/post assessments or control groups. As an experience report, our intent is to describe the simulation and share observed student reflections rather than to conduct a rigorous experimental evaluation of its effectiveness. The abductive mapping to the threshold concepts framework provides a theoretical lens to interpret how the simulation may facilitate the crossing of the threshold, drawing on established teaching practices. While this does not eliminate alternative explanations such as the impact of direct instruction, we believe it offers valuable insights for educators. No revisions to add quantitative data are planned, as such measures were not collected in our implementation. revision: no

  2. Referee: The paper does not address how student comments were collected, selected, or interpreted, including any discussion of potential response bias, the role of the simulation's novelty, or inter-rater reliability in the abductive mapping process. This is load-bearing for the effectiveness claim.

    Authors: We agree that the manuscript would benefit from greater transparency regarding the student comments. The comments were obtained from voluntary, anonymous student reflections submitted at the end of the courses and TA training sessions. We selected comments that explicitly addressed aspects of empirical process control, such as understanding the need for inspection and adaptation. The mapping was performed by the authors through iterative discussion to align comments with elements of the threshold concepts framework. We acknowledge potential biases, including the novelty of the simulation and self-selection in providing feedback. We will revise the paper to include a dedicated paragraph or subsection describing the data collection process, selection criteria, and analytical approach, along with a discussion of limitations such as response bias and the absence of formal inter-rater reliability assessment. revision: partial

Circularity Check

0 steps flagged

No significant circularity in derivation chain

full rationale

The paper is an experience report describing a Scrum sprint simulation activity and its use in courses. Effectiveness is claimed via abductive mapping of student comments to the external threshold concepts framework (an independent educational theory). No equations, fitted parameters presented as predictions, self-definitional claims, or load-bearing self-citations appear in the provided text. The central claim does not reduce to the paper's own inputs by construction and remains self-contained against external benchmarks.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

The paper rests on the applicability of the threshold concepts framework to interpret learning gains in empirical process control; no free parameters or invented entities are introduced.

axioms (1)
  • domain assumption Threshold concepts framework can be used to evaluate effectiveness of a Scrum simulation by mapping student comments to teaching practices
    Invoked to abductively establish effectiveness from qualitative feedback.

pith-pipeline@v0.9.0 · 5426 in / 1218 out tokens · 39971 ms · 2026-05-09T13:52:46.667488+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

22 extracted references · 22 canonical work pages

  1. [1]

    A. Ananth. 2019. Students’ Experiences of Learning Statistics in a Threshold Concepts-enriched Tutorial Programme. Doctoral dissertation. University of KwaZulu-Natal, Westville

    work page 2019

  2. [2]

    Christensen and M

    E. Christensen and M. Paasivaara. 2022. Respond to change or die: An educational scrum simulation for distributed teams. In Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Software Engineering Education and Training

    work page 2022

  3. [3]

    O. Cico, L. Jaccheri, A. Nguyen-Duc, and H. Zhang. 2021. Exploring the in- tersection between software industry and Software Engineering education-A systematic mapping of Software Engineering Trends. Journal of Systems and Software (2021)

    work page 2021

  4. [4]

    Collett, H

    T. Collett, H. Neve, and N. Steven. 2017. Using audio diaries to identify threshold concepts in ’softer’ disciplines: a focus on medical education. https://pearl. plymouth.ac.uk/pms-research/436

    work page 2017

  5. [5]

    S. Corrall. 2017. Crossing the threshold: Reflective practice in information literacy development. Journal of Information Literacy (2017)

    work page 2017

  6. [6]

    Di Nardo, R

    V. Di Nardo, R. Fino, M. Fiore, G. Mignogna, M. Mongiello, and G. Simeone

    work page

  7. [7]

    Computers (2024)

    Usage of Gamification Techniques in Software Engineering Education and Training: A Systematic Review. Computers (2024)

    work page 2024

  8. [8]

    productive feedback

    Torgeir Dingsøyr. 2022. Educating Reflective Systems Developers at Scale: To- wards “productive feedback” in a semi-capstone large-scale software engineering course. In 2022 IEEE Frontiers in Education Conference (FIE). IEEE, 1–8

    work page 2022

  9. [9]

    Flanagan and J

    M. Flanagan and J. Smith. 2008. From playing to understanding. In Threshold Concepts within the Disciplines, R. Land, J. Meyer, and J. Smith (Eds.). Sense Publishers

    work page 2008

  10. [10]

    S. Hyde, A. Flatau, and D. Wilson. 2018. Integrating threshold concepts with re - flective practice: Discussing a theory-based approach for curriculum refinement in dental education. European Journal of Dental Education (2018)

    work page 2018

  11. [11]

    Krivitsky

    A. Krivitsky. 2023. lego4scrum: post-covid revision. LeanPub

    work page 2023

  12. [12]

    R. Land, G. Cousin, J. Meyer, and P. Davies. 2006. Implications of threshold concepts for course design. In Overcoming Barriers to Student Understanding, J. Meyer and R. Land (Eds.). Routledge

    work page 2006

  13. [13]

    McCartney, J

    R. McCartney, J. Boustedt, A. Eckerdal, J. Moström, K. Sanders, L. Thomas, and C. Zander. 2009. Liminal spaces and learning computing. European Journal of Engineering Education (2009)

    work page 2009

  14. [14]

    S. Meek, H. Neve, and A. Wearn. 2023. Threshold Concepts and Troublesome Knowledge. In Clinical Education for the Health Professions, D. Nestel, G. M. Reedy, and S. Gough (Eds.). Springer

    work page 2023

  15. [15]

    Meyer and R

    J. Meyer and R. Land. 2003. Threshold Concepts and Troublesome Knowledge (1): linkages to ways of thinking and practising within the disciplines. In Improving Student Learning – Ten Years On, C. Rust (Ed.). Oxford

    work page 2003

  16. [16]

    Eduardo Miranda. 2017. Teaching Agile Project Management by Combining Group Interaction and Simulation. In 2017 IEEE 30th Conference on Software Engineering Education and Training (CSEE&T). IEEE, 232–233

    work page 2017

  17. [17]

    Paasivaara, V

    M. Paasivaara, V. Heikkilä, C. Lassenius, and T. Toivola. 2014. Teaching students scrum using LEGO blocks. In Companion Proceedings of the 36th International Conference on Software Engineering. ACM, Hyderabad

    work page 2014

  18. [18]

    Savin-Baden

    M. Savin-Baden. 2008. Liquid Learning and Troublesome Spaces: Journeys from the Threshold. In Threshold Concepts within the Disciplines, R. Land, J. Meyer, and J. Smith (Eds.). Sense Publishers

    work page 2008

  19. [19]

    Schroeder, A

    A. Schroeder, A. Klarl, P. Mayer, and C. Kroiß. 2012. Teaching agile software de- velopment through lab courses. In Proceedings of the 2012 IEEE Global Engineering Education Conference (EDUCON). IEEE

    work page 2012

  20. [20]

    Steghöfer, E

    J. Steghöfer, E. Knauss, E. Alégroth, I. Hammouda, H. Burden, and M. Ericsson

    work page

  21. [21]

    In Proceedings of the 38th International Conference on Software Engineering Companion

    Teaching Agile – Addressing the Conflict Between Project Delivery and Application of Agile Methods. In Proceedings of the 38th International Conference on Software Engineering Companion. ACM

    work page

  22. [22]

    Tenhunen, T

    S. Tenhunen, T. Männistö, M. Luukkainen, and P. Ihantola. 2023. A systematic literature review of capstone courses in software engineering. Information and Software Technology (2023)

    work page 2023