{"id":"99a7e738-a089-4ddd-8962-f94fd8d4925a","arxiv_id":"1908.05042","paper_version":3,"verdict":"CONDITIONAL","confidence":"HIGH","novelty_score":4.0,"correctness_risk":"low","formal_verification":"none","parameter_count":5,"one_line_summary":"A classroom exercise computing CMB and matter power spectra with CLASS for exotic model universes illustrates why the Lambda-CDM standard model fits observations.","lead":"A university cosmology course used the CLASS computer code to calculate what the cosmic microwave background would look like in three deliberately unnatural universes: one with no dark matter, one with no dark energy, and one with far more ordinary matter than ours. Comparing those made-up skies with the real Lambda-CDM prediction lets students see why the standard model is so widely used.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Learning-gain claim rests on instructor observation; no assessment evidence supports it.","rationale":"The paper is a clear, reproducible teaching resource: it gives the exact CLASS version, input parameters, model definitions, and the types of output to plot, and the physics discussion is consistent with standard CMB theory and supported by analytic references. The reader's verdict of CONDITIONAL is reasonable. My stress-test focuses on the aspect that is most load-bearing for the central claim: the absence of systematic evidence for student learning. The reader's stated weakest assumption was CLASS reliability in exotic regions, which I do not think is the critical weak point. CLASS is widely used and the qualitative features of the exotic models are corroborated by analytic work; even a numerical offset would not overturn the pedagogical points about peak shifts and baryon loading. In contrast, the claim that students 'grasped' the physics is asserted from instructor observation alone. Since the student reports exist, this concern is testable without a new experiment. I keep the verdict as CONDITIONAL: the teaching recipe can stand, but the learning-outcome claim needs assessment evidence before it can be accepted as demonstrated.","tokens_in":16965,"tokens_out":4221,"duration_ms":45861,"concrete_test":"Score the 19 existing student lab reports against a pre-defined rubric requiring (1) correct direction of the first-peak shift, (2) correct physical cause via sound-horizon/baryon-loading arguments, (3) correct explanation of the odd/even peak pattern in the no-CDM model, and (4) correct identification of the zeq/zrec ordering. If fewer than roughly 15 of 19 reports satisfy all rubric items, the 'students were able to grasp' claim is not supported by the available data.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim, stated in the abstract and repeated in Section 5, is that students 'were able to grasp the impact of cosmological parameters on CMB observables' and understood the CMB physics. The only evidence offered is the instructor's statement that 'all students were able to grasp the main changes and their causes' (Section 4.2) and the existence of 19 student reports (Section 3). No pre/post test, rubric, independent scoring, or comparison group is presented. This makes the headline learning-outcome claim unverified: the exercise may well be pedagogically effective, but the paper does not demonstrate it. The reader's weakest assumption, CLASS numerical reliability for exotic parameters, is secondary: even if CLASS has offsets far from the Planck-calibrated region, the qualitative effects described (peak shifts, odd/even peak alternation, suppression with high Omega_cdm) are independently supported by the analytic references the paper itself cites, e.g. [9,10,18,19]. The load-bearing gap is not the Boltzmann solver but the missing evidence connecting the activity to student understanding.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper reports on a graduate-level cosmology computer laboratory exercise in which students used the CLASS Boltzmann code to compute background evolution, CMB temperature power spectra, and matter power spectra for the ΛCDM model and for three deliberately exotic models: no CDM (Model 2), no Λ (Model 3), and a high-baryon model (Model 4). The manuscript presents the model parameters in Table 1, the resulting characteristic quantities in Table 2, and physical interpretations of the spectral differences in Section 4. The central claim, stated in the abstract and repeated in Section 5, is that by comparing these models the students 'were able to grasp' the impact of cosmological parameters on CMB observables and to understand CMB physics directly. The paper also asserts in Section 2 that the successful CLASS runs for extreme parameters 'speaks for the robustness and reliability of CLASS.'","tokens_in":17167,"tokens_out":2637,"duration_ms":28234,"significance":"If the pedagogical claim is taken at face value, the paper offers a useful, low-cost classroom template for teaching CMB physics through exploration of non-standard models, and it does so with openly available software and clearly tabulated input parameters. The physical explanations of peak shifts, odd-even peak alternation, and suppression effects are consistent with standard CMB physics and are supported by the classical analytic references cited by the author. The paper's value as a teaching resource is real: it provides a concrete, reproducible activity that other instructors can adapt, and it explicitly connects qualitative spectral features to underlying physics. However, the paper's headline claim about student learning is not supported by any assessment evidence, and the assertion of CLASS reliability in extreme parameter regimes is made without independent validation. These limitations currently place the paper's central contribution in the category of a descriptive course report rather than a demonstrated pedagogical study.","major_comments":[{"comment":"The central claim that 'all students were able to grasp the main changes and their causes' (Section 4.2) and the corresponding statement in the abstract and Section 5 are not supported by evidence. The manuscript mentions that 19 students completed the course and produced written reports (Section 3), but it provides no pre/post-test, rubric, independent scoring, comparison group, or even representative excerpts from student reports. Without such evidence, the paper cannot substantiate a learning-gain claim. I recommend either (a) presenting structured assessment data, or (b) reframing the paper explicitly as a descriptive account of a course activity, with claims about student understanding clearly labeled as instructor observations rather than measured outcomes.","section":"§4.2 and §5"},{"comment":"The statement that successful CLASS runs for parameters 'wildly different' from ΛCDM 'speaks for the robustness and reliability of CLASS' is an assertion, not a demonstrated result. The models in Table 1 include Ω_cdm,0 = 0 (Model 2) and Ω_b,0h² = 0.12 with Y_He = 0.28 (Model 4), regimes far from the Planck-calibrated region. Because the paper's physical interpretations of peak locations, peak heights, and suppression rely on quantitative CLASS output, a hidden numerical inaccuracy in these regimes would directly affect the teaching conclusions. I recommend adding a validation check against an independent code (e.g., CAMB) or against the analytic approximations already cited (e.g., Hu & Sugiyama 1995/1996, Eisenstein & Hu 1998) for at least the spectra shown in Figs. 2-4, or alternatively tempering the robustness claim with an explicit caveat that the numerical accuracy in exotic regimes has not been independently verified.","section":"§2 and Table 1"},{"comment":"The comparison of z_rec and z_bd across models is presented as 'numerical results' that illustrate known analytic dependencies, but the paper does not quantify how these values compare with the fitting formulae from Hu & Sugiyama (1996), which are cited in the same paragraph. Adding a direct comparison (e.g., CLASS output versus the fitting formula for each model) would strengthen the interpretation and provide a concrete check on the CLASS outputs in these exotic regimes. Without this, the claim that these numbers are 'evidence for the well-known fact' remains an appeal to authority rather than a verification.","section":"§4.1 and Table 2"}],"minor_comments":[{"comment":"There are several typographical errors, including 'euqations' near the end of Section 1, 'multipol' in Section 4.2, and 'severly' in Section 4.2 and Section 4.3. These should be corrected.","section":"§1"},{"comment":"For reproducibility, the paper should provide the exact CLASS input files or a machine-readable listing of all parameter values. The statement in the note to Table 1 that the exact T_CMB value for ΛCDM (2018) 'could not be pinpointed' is a gap in reproducibility, since T_CMB enters the background and perturbation calculations. Please state the actual value used or specify the default in CLASS 2.7.1.","section":"Table 1 and §3"},{"comment":"The figures would be more useful if the first acoustic peak position and the second/third peak heights were annotated for each model, as the text discusses them extensively. As it is, the reader must estimate these features by eye from overlapping curves; since the paper is intended as a teaching resource, clear annotation would enhance its pedagogical value.","section":"§4.2, Fig. 2 and Fig. 3"},{"comment":"The comparison of ΛCDM (2011) and ΛCDM (2018) in Fig. A1 is presented visually but without numerical differences in, for example, the peak location or the integrated TT power. A brief quantitative statement (e.g., 'the first peak positions agree to within Δl ≈ 2') would make the 'marginal differences' claim more precise and would help students calibrate what 'marginal' means.","section":"Appendix A"}],"recommendation":"major_revision","confidential_remarks":"The paper is best viewed as a course report with a valuable, freely reproducible classroom activity. The referee report focuses on the gap between the paper's pedagogical claims and the evidence provided. In my view, the appropriate scope for this journal is a revised manuscript that either adds assessment data or explicitly reframes the learning-outcome statements as anecdotal. The CLASS robustness point is secondary but should be handled either by a caveat or by a small validation comparison, because it is the kind of claim that a careful reader would otherwise check. I do not see grounds for rejection: the activity itself is sound and likely useful, and the physical interpretations align with standard results. I also note that the paper cites relevant analytic literature, which strengthens its usefulness as a teaching resource."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"This is a teaching paper, not a research paper, and it is honest about that. What is new is the specific, fully specified CLASS lab: three exotic models (no CDM, no Lambda, high baryon) compared against Planck 2018 LCDM, with detailed Tables 1-2 and figures for background evolution, CMB TT, and matter power spectrum. The physics explanations in Section 4 are standard and match the analytic literature (Hu & Sugiyama, McGaugh, Eisenstein & Hu). I checked the logic: peak shifts, odd/even peak alternation, suppression with high Omega_cdm, BAO wiggles are correctly described. Input parameters are tabulated enough that someone could rerun the exercise. That reproducibility is the real value.\n\nThe soft spots are two. The bigger one is the learning-gain claim. The abstract and summary state students 'were able to grasp' the impacts, but the evidence is the instructor's observation in Section 4.2 and the fact that 19 students completed reports. There is no pre/post test, no rubric, no comparison. For a course report this is fine, but as a claim about effectiveness it is unsupported. The paper would be stronger if 'grasp' were replaced with 'were able to describe in reports' or similar, or if some assessment evidence were added. The smaller issue is the assertion in Section 2 that CLASS's ability to run with extreme parameters 'speaks for the robustness and reliability of CLASS.' That is opinion; no independent benchmark is given. However, the qualitative conclusions do not depend on CLASS being perfect in those regimes, because the analytic references support the same effects, so this is minor.\n\nI disagree with the stress-test note only in emphasis: I think the missing assessment is the load-bearing gap, but it is a gap in the strength of a pedagogical claim, not a flaw in the physics or the recipe. The paper is a genuinely useful resource for cosmology lecturers.\n\nVerdict: should be sent to peer review at an education-focused venue, with the expectation that the claims about learning will be softened or evidence added. Readers who want a ready-made CMB exercise will get real value; readers looking for new scientific results should not bother.","headline":"A solid, reproducible teaching exercise with accurate CMB physics; the pedagogical effectiveness claim is anecdotal and should be softened or assessed.","tokens_in":17670,"tokens_out":2592,"would_cite":false,"duration_ms":27356,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"This paper reports that a computer-lab exercise comparing the CMB and matter power spectra of Lambda-CDM with three deliberately unrealistic models lets students directly grasp how baryons, dark matter, and the cosmological constant shape…","keywords":["cosmological parameters","cosmic microwave background radiation","expansion history","structure formation","Lambda-CDM","exotic cosmological models","Boltzmann code CLASS","physics education"],"falsifier":"Recompute the three exotic models with an independent Boltzmann solver, or compare the CLASS outputs against the analytic fitting formulae for $z_{\\rm rec}$, $z_{\\rm bd}$, and the acoustic peak positions; if the predicted peak shifts or peak-height ratios disagree by more than a few percent on any exotic run, both the robustness claim and the pedagogical conclusions would need to be revised.","tokens_in":16766,"feed_emoji":"🌌","tokens_out":9861,"duration_ms":93699,"temperature":0.7,"pith_summary":"This paper argues that a computer-lab exercise can give students a first-hand appreciation of why the $\\Lambda$CDM model is the standard in cosmology, by having them compute and compare CMB and matter spectra with the open-source Boltzmann code CLASS. The exercise uses four model universes: $\\Lambda$CDM, a universe with no dark matter, one with no cosmological constant, and one with a much larger baryon fraction. For each, students follow the background density parameters, the CMB temperature power spectrum $C_l$, and the matter power spectrum $P(k)$, and interpret the changes in terms of the baryon-photon fluid, dark-matter gravitational wells, and the sound horizon. The paper reports that all nineteen students completed the analysis and could explain the physical causes of the spectral differences, and it offers the setup as a reusable teaching resource.","feed_headline":"A classroom lab shows why Lambda-CDM dominates cosmology","feed_subtitle":"Comparing CMB and matter spectra across four extremes lets students see baryon and dark-matter physics directly.","key_machinery":"The central object is the open-source Boltzmann code CLASS, the standard numerical solver that integrates the linearised Einstein-Boltzmann equations for a chosen set of cosmological parameters and outputs the background expansion history, the CMB temperature power spectrum $C_l$ as a function of multipole $l$, and the matter power spectrum $P(k)$ as a function of wavenumber $k$. The pedagogical machinery is the controlled comparison: four models are run with the same adiabatic initial conditions and Newtonian gauge, changing exactly one ingredient at a time, so that every difference in the spectra can be traced back to a specific physical component.","core_discovery":"The central claim is that comparing theoretical spectra across models that differ by one cosmic ingredient is enough to make the physics of the CMB visible to learners. Removing dark matter leaves a pure baryon-photon fluid whose even-numbered acoustic peaks are suppressed almost to disappearance and whose structure growth is stunted; removing the cosmological constant while keeping the geometry flat creates a CDM-dominated, Einstein-de Sitter-like universe with suppressed first peaks and a smooth matter power spectrum; and boosting baryons to $\\Omega_{\\rm b,0}h^2=0.12$ shortens the sound horizon, shifting the first peak to higher $l$, enhances odd-numbered peaks, and raises the baryon drag redshift above the recombination redshift. These comparisons are the paper's evidence that students acquire a direct, physical grasp of the impacts of baryons, dark matter, and $\\Lambda$ on CMB observables.","pith_inferences":["The same four-model protocol could easily be extended to neutrino mass, $N_{\\rm eff}$, running of the spectral index, or an open-geometry $\\Omega_k\\neq0$ model; the paper explicitly says its examples are not exhaustive, and CLASS's modular input files make such extensions natural homework.","Running CLASS at these extreme parameter values already functions as an informal numerical stress test; a systematic cross-check against an independent Boltzmann code would turn the paper's robustness opinion into a verifiable validation.","Because the exercise never fits real CMB data, it targets forward prediction and physical intuition rather than parameter estimation; a natural follow-up would ask students to compare the four spectra with actual CMB measurements to see quantitatively which models are excluded."],"forward_implications":["The first acoustic peak is not a pure geometric probe: in the flat, baryon-rich Model 4 the peak shifts to higher $l$ because the sound horizon shrinks, so curvature can only be read off after the baryon density is pinned down.","The odd-even peak height pattern is a direct baryon-versus-dark-matter diagnostic: it becomes extreme in the baryon-only Model 2 and is strongly enhanced in Model 4, while in the CDM-dominated Model 3 the third peak stands out as the clearest matter indicator.","The recombination redshift $z_{\\rm rec}$ changes by less than two percent across all four models, whereas the baryon drag redshift $z_{\\rm bd}$ moves by up to ten percent, illustrating that recombination is a robustly predicted epoch while drag depends more strongly on parameters.","The age of the universe printed by CLASS rules out the no-$\\Lambda$ (9.65 Gyr) and baryon-rich (11.84 Gyr) models against known old stars, showing students how independent astrophysical data constrain cosmological models."],"supporting_citations":[{"why":"Introduces the CLASS code, the numerical engine used for all spectra in the exercise.","marker":"[14]"},{"why":"Provides analytic predictions for CMB anisotropies in models with varying baryon and CDM content, used to interpret the acoustic peak structure.","marker":"[9]"},{"why":"Gives analytic fitting formulae for $z_{\\rm rec}$ and $z_{\\rm bd}$, invoked to explain why recombination is nearly model-independent while drag shifts in Model 4.","marker":"[10]"},{"why":"Contrasts CDM and MOND predictions for the CMB, serving as the interpretive source for Model 2 (no dark matter).","marker":"[18]"},{"why":"Supplies the theory of baryonic acoustic features in the matter transfer function, used to interpret the BAO pattern in $P(k)$.","marker":"[19]"},{"why":"Supplies the best-fit parameters for the reference $\\Lambda$CDM (2018) input file used as the baseline model.","marker":"[3]"}],"fun_headline_variants":["Classroom lab reveals CMB physics through model comparisons","Students see dark matter and Lambda in CMB peaks","Tinkering with cosmology models teaches CMB physics","How a classroom exercise explains Lambda-CDM's reign"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The teaching conclusions rest on the assumption that CLASS remains numerically accurate and physically reliable for parameter values far outside its calibrated region, such as zero dark matter or $\\Omega_{\\rm b,0}h^2=0.12$ with $Y_{\\rm He}=0.28$; the paper states this robustness as an opinion in Section 2 without an independent-code cross-check, and if it fails the comparisons would mislead.","fun_headline_variants_meta":{"raw":{"variants":["Classroom lab reveals CMB physics through model comparisons","Students see dark matter and Lambda in CMB peaks","Tinkering with cosmology models teaches CMB physics","How a classroom exercise explains Lambda-CDM's reign"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000237,"raw_usage":{"total_tokens":1517,"prompt_tokens":962,"completion_tokens":555,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":578,"completion_tokens_details":{"reasoning_tokens":492}},"tokens_in":578,"tokens_out":555,"duration_ms":5713,"temperature":1.0,"reasoning_tokens":492,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T13:24:45.635878+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Recompute the three exotic models with an independent Boltzmann solver, or compare the CLASS outputs against the analytic fitting formulae for $z_{\\rm rec}$, $z_{\\rm bd}$, and the acoustic peak positions; if the predicted peak shifts or peak-height ratios disagree by more than a few percent on any exotic run, both the robustness claim and the pedagogical conclusions would need to be revised.","supporting_citations":[{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Provides analytic predictions for CMB anisotropies in models with varying baryon and CDM content, used to interpret the acoustic peak structure."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Gives analytic fitting formulae for $z_{\\rm rec}$ and $z_{\\rm bd}$, invoked to explain why recombination is nearly model-independent while drag shifts in Model 4."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Contrasts CDM and MOND predictions for the CMB, serving as the interpretive source for Model 2 (no dark matter)."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"Supplies the theory of baryonic acoustic features in the matter transfer function, used to interpret the BAO pattern in $P(k)$."}],"review_version":1}