REVIEW
Laboratory-Tutorial activities for teaching probability
Physics Education · Submitted 21 Feb 2006 · 51 references
Pith's verdict: Honest, useful curriculum paper with a robust broad conclusion; the pattern-matching coding is shakier than the abstract suggests but not fatal.
T0 · AI review
Why Pith says this
Highlight any text to comment on it.
Referee report
The paper
The paper claims
A laboratory-based course for non-science majors maps the persistent reasoning patterns that block understanding of probability density, from edge effects and pattern matching to the gambler's fallacy.
The reading
What carries the argument
The central machinery is the definition of probability density as a ratio of times: the probability of finding an object in a region is the time it spends there divided by the total time of the motion, and that time is set by the object's speed. Students are led to this through a sequence of discrete systems (drawing balls from a box, coin tosses, two-dice sums) before turning to physics, where they count video frames of a tossed ball and of a spring-attached air glider to build histograms. Those histograms are later tied to potential-energy graphs for 'touchstone' systems such as the harmonic oscillator, a cart on ramps, a square well, and a barrier. The frame-counting step is what carries the argument: it turns probability density from an abstract graph into an observed proportion, which students can then compare against their predictions.
Extended reading notes
Core claim
On the paper's own terms, the central discovery is a catalogue of how non-major students reason about probability density before and after instruction. Before instruction on a coin-toss question, 57% correctly said the eleventh toss is still 50-50, while 24% invoked the gambler's fallacy, 14% expected the future to make up for the past, and 7% applied a Bayesian-style ratio. On a raindrop question, one-third reasoned correctly; one-third said equal-sized bins are equally likely; about one-fifth focused on the starting or ending region. After a lab tutorial using video frame-counting, only 52% of students answered the constant-speed 'free cart' question correctly, and the most common wrong answer--'higher at the edges'--rose from 33% to 48%; by an examination six weeks later, after students had worked with quantum well contexts, 88% answered correctly. The paper reads this as evidence that the ideas can ultimately be learned, but that a single tutorial does not by itself dislodge the entrenched reasoning patterns.
Load-bearing premise
The load-bearing premise is that the authors' categorisation of students' sketches and written explanations correctly reveals the reasoning behind each answer, even for the students whose sketches did not clearly distinguish pattern matching from other strategies.
Editorial extensions
If this is right
- A single lab-tutorial on probability density is not enough to shift many students' answers on a simple transfer question; the fraction correct on the free-cart problem was the same (52%) before and immediately after instruction.
- Persistent incorrect responses cluster into identifiable families--edge and endpoint effects, pattern matching to the harmonic oscillator, and ensemble-based reasoning--so instruction can be targeted at those specific alternatives.
- Correct performance can emerge later: after students worked with probability density in quantum contexts, 88% answered the free-cart question correctly on the examination, suggesting that repeated use across contexts matters more than the initial tutorial.
- At the end of the semester, 83% of students could solve the two-speed ramps problem, indicating that the time-ratio idea can become usable in a new physical setting for the majority.
- On even 'simple' coin-toss questions, a substantial minority of students used past outcomes to predict the next toss, so instruction on the independence of trials and on the distinction between expectation values and actual ensembles needs to be explicit.
Reading between the lines
- One testable extension: if a version of the course taught the free cart before, rather than after, the harmonic oscillator, the 'higher at edges' pattern-matching response should drop; the paper's data suggest the oscillator tutorial may be inadvertently teaching a template rather than a principle.
- The post-test-to-examination jump is compatible with a consolidation account: students need spaced practice and multiple quantum contexts before the time-ratio reasoning stabilises, so a delayed post-test (rather than the day-after-lab post-test) would be a fairer measure of what the tutorial alone achieves.
- Because the paper's coding could not distinguish the reasoning behind six of the eight students who switched from correct to incorrect, a think-aloud version of the free-cart question would sharpen the trajectory: are those students pattern matching, counting edge visits per half-cycle, or confusing region width with probability?
Original abstract
We report on the development of students' ideas of probability and probability density in a University of Maine laboratory-based general education physics course called Intuitive Quantum Physics. Students in the course are generally math phobic with unfavorable expectations about the nature of physics and their ability to do it. We describe a set of activities used to teach concepts of probability and probability density. Rudimentary knowledge of mechanics is needed for one activity, but otherwise the material requires no additional preparation. Extensions of the activities include relating probability density to potential energy graphs for certain "touchstone" examples. Students have difficulties learning the target concepts, such as comparing the ratio of time in a region to total time in all regions. Instead, they often focus on edge effects, pattern match to previously studied situations, reason about necessary but incomplete macroscopic elements of the system, use the gambler's fallacy, and use expectations about ensemble results rather than expectation values to predict future events. We map the development of their thinking to provide examples of problems rather than evidence of a curriculum's success.
The compiled record
The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
The abstract, sentence by sentence
We report on the development of students' ideas of probability and probability density in a University of Maine laboratory-based general education physics course called Intuitive Quantum Physics. Students in the course are generally math phobic with unfavorable expectations about the nature of physics and their ability to do it. We describe a set of activities used to teach concepts of probability and probability density. Rudimentary knowledge of mechanics is needed for one activity, but otherwise the material requires no additional preparation. Extensions of the activities include relating probability density to potential energy graphs for certain "touchstone" examples. Students have difficulties learning the target concepts, such as comparing the ratio of time in a region to total time in all regions. Instead, they often focus on edge effects, pattern match to previously studied situations, reason about necessary but incomplete macroscopic elements of the system, use the gambler's fallacy, and use expectations about ensemble results rather than expectation values to predict future events. We map the development of their thinking to provide examples of problems rather than evidence of a curriculum's success.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | We report on the development of students' ideas of probability and probability density in a University of Maine laboratory-based general education physics course called Intuitive Quantum Physics. | contribution 0.98 | 0.87 | 0.07 | asserted 0.98 |
| s1 | Students in the course are generally math phobic with unfavorable expectations about the nature of physics and their ability to do it. | background 1.00 | 0.27 | 0.02 | asserted 1.00 |
| s2 | We describe a set of activities used to teach concepts of probability and probability density. | contribution 0.66 | 0.85 | 0.04 | asserted 0.99 |
| s3 | Rudimentary knowledge of mechanics is needed for one activity, but otherwise the material requires no additional preparation. | method 0.58 | 0.50 | 0.03 | asserted 1.00 |
| s4 | Extensions of the activities include relating probability density to potential energy graphs for certain "touchstone" examples. | method 0.51 | 0.68 | 0.04 | asserted 0.93 |
| s5 | Students have difficulties learning the target concepts, such as comparing the ratio of time in a region to total time in all regions. | result 0.99 | 0.82 | 0.11 | asserted 1.00 |
| s6 | Instead, they often focus on edge effects, pattern match to previously studied situations, reason about necessary but incomplete macroscopic elements of the system, use the gambler's fallacy, and use expectations about ensemble results rather than expectation values to predict future events. | result 0.99 | 0.80 | 0.11 | asserted 0.99 |
| s7 | We map the development of their thinking to provide examples of problems rather than evidence of a curriculum's success. | limitation 0.89 | 0.88 | 0.27 | asserted 0.99 |
What was examined, and what was not
- arXiv listing abstract v1
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
Figures
Figures reproduced from arXiv:physics/0602141 by the authors.
References
Discussion
Disagree with the review, or know something it missed? Leave a comment, highlight any passage above to comment on it, or challenge this review formally.