{"id":"0840b783-ecb3-4d85-9a33-dc7225cd9dde","arxiv_id":"2506.03232","paper_version":2,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":4.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":0,"one_line_summary":"Spreadsheets can support K-12 students' data acumen and computational thinking when integrated across subjects, the paper argues.","lead":"This paper argues that spreadsheets, despite their limitations for statistical analysis, should be part of the K-12 data science toolkit. It proposes five spreadsheet-based data skills and connects them to existing educational standards and frameworks.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The 'foundation for work in other tools' claim assumes transfer without evidence; a transfer study would test it.","rationale":"The reader's weakest assumption was the general effectiveness of spreadsheet-based activities. My concern narrows this to the specific transfer claim embedded in 'foundation for work in other tools.' This is more precise and more load-bearing because the paper's primary contribution beyond the obvious is this foundational role. The reader's call for evidence or reframing is correct, and the paper does reframe at the end, but the transfer claim still overreaches. A pilot transfer study would settle whether the claimed foundation is real. Since the reader's verdict was CONDITIONAL and my concern reinforces that condition with a sharper test, the verdict should remain CONDITIONAL (UNCHANGED).","tokens_in":19572,"tokens_out":4612,"duration_ms":58835,"concrete_test":"Run a small randomized pilot (target N=60 middle/high school students) comparing two conditions: (A) four weeks of data organization, aggregation, and visualization instruction in Google Sheets followed by a transfer task in CODAP or R, versus (B) the same content taught directly in the target tool. Measure outcomes with a common data acumen assessment (e.g., Data Moves tasks). If the spreadsheet-first group does not perform at least as well on transfer tasks, the 'foundation' claim fails. A cheaper check: systematically review the empirical literature for any studies demonstrating transfer of spreadsheet skills to other data tools in K-12; if none exist, the claim is unsupported.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim includes that spreadsheets 'can serve as a foundation for work in other tools' (Section 5). This is a transfer-of-learning claim: skills acquired in a spreadsheet environment are expected to generalize to CODAP, R, Python, or other data tools. The paper does not provide a mechanism for this transfer (e.g., explicit abstraction, metacognitive bridging) nor empirical evidence that it occurs. Section 4's proposed skills are largely tool-specific (VLOOKUP, pivot tables, Apps Script), and the paper itself documents spreadsheet limitations (e.g., no built-in multivariate plots, weak reproducibility) that require additional tools. If transfer fails, the 'foundation' assertion is unsupported, reducing the contribution to the already-known point that spreadsheets are useful for data entry and simple visualization. The paper's own caveat in Section 5 that it provides no empirically validated lesson plans confirms the gap, but the gap directly undermines the strongest version of the claim.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper argues that spreadsheets, despite their well-documented limitations for statistical analysis, have a valuable role in K-12 data science education as one component of a broader data and computing toolkit. It evaluates spreadsheet tools against the Pimentel et al. (2022) framework, reviews several K-12 standards and frameworks (CSTA, Data Science Learning Progressions, Common Core, GAISE II, NRC Framework, NASEM 2026), and proposes five data and computing skills—data entry/aggregation/visualization, consistency checking, mathematical applications, algorithmic thinking, and scripting/automation—each illustrated with Google Sheets activities and Apps Script examples. The paper discusses adoption barriers, teacher professional development needs, and limitations such as reproducibility, multivariate visualization, and scaling to big data. It explicitly states in Section 5 that it does not provide empirically validated lesson plans or a comprehensive curriculum; the contribution is deliberately conceptual and illustrative.","tokens_in":19697,"tokens_out":5663,"duration_ms":69744,"significance":"If the central claim is accepted as a carefully hedged proposal, the paper makes a useful contribution by synthesizing existing K-12 standards and arguing that spreadsheets should not be dismissed outright in favor of purpose-built tools. Its concrete strengths include the integration of widely cited frameworks, freely available sample Google Sheets activities, and copy-ready Apps Script code, which practitioners can adapt immediately. The paper also responsibly identifies limitations and does not claim to have demonstrated learning gains. However, the significance is diminished by the gap between the assertive language of 'demonstrating utility' and 'serving as a foundation for other tools' and the absence of any empirical or theoretical support for those strong claims; as a result, the contribution is best viewed as a well-grounded position piece that should motivate future studies rather than as an established conclusion.","major_comments":[{"comment":"The central claim that spreadsheets 'can serve as a foundation for work in other tools' (Section 5) is a transfer-of-learning assertion, but the paper provides neither a theoretical mechanism (e.g., abstraction, metacognitive bridging, or deliberate comparison across tools) nor empirical evidence that skills acquired in spreadsheets generalize to CODAP, R, or Python. The activities in Section 4 are largely tool-specific (VLOOKUP, pivot tables, Apps Script), and Section 5 concedes that no empirically validated lesson plans are provided. I ask the authors to either weaken this claim to a hypothesis ('may serve') or add a concrete transfer design and evidence; as written, the strongest version of the central claim is unsupported.","section":"Section 5 and Section 4"},{"comment":"The abstract states that the paper 'demonstrates the potential utility of spreadsheets,' and Section 1 lists 'Demonstrate the potential utility of spreadsheets' as a goal, but the body of the paper offers a reasoned argument, a standards review, and illustrative activities rather than an empirical demonstration. Section 5 explicitly disclaims validated lesson plans. Please reframe the stated contribution as arguing for or proposing a role for spreadsheets, and move the effectiveness question to an explicitly open research problem; otherwise the claimed contribution exceeds what the manuscript can support.","section":"Abstract and Section 1"},{"comment":"The five 'aspirational' data and computing skills are presented as 'derived from existing learning standards and frameworks,' but no selection criteria or systematic mapping are provided. For example, Skill 5 (scripting, automation, and tool integration) is justified mainly through Google Workspace examples, and its connection to particular CSTA or NASEM competencies is asserted rather than demonstrated. I recommend adding a table that maps each of the five skills to specific standards statements, lists which frameworks were considered, and explains why other candidate skills were not included, so that the proposed skill set can be evaluated as a coherent and justified contribution.","section":"Section 4"}],"minor_comments":[{"comment":"The 'Grade' column is described as an informal assessment, but the table would benefit from a caption note stating explicitly that these letter grades are the authors' subjective judgments rather than the result of a formal rubric or independent rating, since the table currently appears to be a more objective evaluation than it is.","section":"Table 1"},{"comment":"The statement that 'numerous conversations between the authors and selected K-12 educators' shed light on pedagogical considerations provides no protocol, participant count, or analytic method; as presented, this anecdotal evidence should be labeled as informal consultation or removed from statements that carry evidentiary weight.","section":"Section 5"},{"comment":"Please replace the non-standard ligature characters in 'efficiently', 'difficult', and 'sufficient' with standard ASCII spellings, as these appear to be encoding artifacts.","section":"Sections 4.1.1 and 5"},{"comment":"Several references lack complete identifying information, including Erickson (2022) and Frischemeier et al. (2022), which have no URL or DOI; please complete these entries to allow readers to locate the sources.","section":"References"}],"recommendation":"major_revision","confidential_remarks":"This is a practice-oriented position paper that could be a good fit for a journal that publishes pedagogical perspectives, provided the authors are willing to substantially hedge the central claims. The main risk is not internal inconsistency or circularity—the paper is coherent and appropriately self-limiting in places—but rather that the assertive framing of 'demonstrating utility' and 'foundation for other tools' overstates the evidential basis. I would support publication after the authors revise to frame the contribution as a proposal and add or explicitly call for a transfer study."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Here's my take. This is a solid position paper. It makes a modest claim—spreadsheets have a role in K-12 data science as a foundation, not as the only tool—and it mostly stays inside that claim. The authors know they're not offering empirical evidence; they say so in Section 5. That honesty matters.\n\nWhat's actually new: the five data skills in Section 4 (data entry/aggregation/visualization, consistency checking, math applications, algorithmic thinking, scripting/automation). They're a reasonable organizing device, and they don't reduce perfectly to prior categories like data moves—they add a spreadsheet-specific flavor, especially skills 4 and 5 with Apps Script. The bundled set is not in the cited standards, so it's a genuine synthesis. The demo sheets and Appendix code are real, reproducible resources; that's more concrete than most position papers.\n\nThe paper also does a good job reviewing the standards landscape (GAISE, CSTA, National Academies, etc.) and mapping spreadsheets onto them. The Table 1 informal grades are a nice quick overview, though they are subjective—the authors could have said more about how they assigned those grades.\n\nSoft spots, in order: (1) The 'foundation for work in other tools' claim is a transfer-of-learning assertion with no evidence and no mechanism. If a student learns VLOOKUP and pivot tables in Sheets, will those skills transfer to R or Python? The paper says they will build data acumen and computational fluency, but it doesn't show how. That's the weakest link, but it's a weakness in the proposal, not a false claim—the paper explicitly says it's not providing validated lesson plans. (2) The teacher input is anecdotal; fine for a position paper, but it's not data. (3) The paper leans on some self-citations, but they're relevant prior work, and there's no circular reasoning.\n\nThe citation pattern looks fine. The argument is coherent on its own terms.\n\nBottom line: this deserves peer review. It's not going to change scientific understanding, but it could influence curriculum design and teacher PD. A serious referee should ask the authors to (a) sharpen the transfer argument, perhaps by citing transfer-of-learning literature or proposing a pilot study, and (b) either justify the Table 1 grades or soften them. I'd send it to review.","headline":"A clear, honest position paper making a modest case for spreadsheets in K-12 data science; worth reviewing but it stops short of demonstrating the transfer it asserts.","tokens_in":20139,"tokens_out":2669,"would_cite":false,"duration_ms":31283,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Spreadsheets have a meaningful role in K-12 data and computing education, despite their analytic limits.","keywords":["spreadsheets","K-12 data science","data acumen","computational fluency","computational thinking","data skills","Google Sheets","statistics education"],"falsifier":"A controlled classroom study would settle it: randomly assign K-12 students to equivalent data-science lessons taught with spreadsheets versus a non-spreadsheet tool, and measure data acumen and transfer to a new tool before and after. If the spreadsheet group does not show at least as much growth as the comparison group, the paper's claim that spreadsheets can serve as the foundation loses its empirical support.","tokens_in":19384,"feed_emoji":"📊","tokens_out":7391,"duration_ms":80421,"temperature":0.7,"pith_summary":"The paper argues that spreadsheets, despite being weak tools for advanced statistical analysis, have a meaningful role in K-12 data and computing education and can serve as a foundation for work in other tools. Its case rests on three observations: spreadsheets are near-universal in schools, they make data visible and directly manipulable, and they already map onto existing learning standards. To make the case concrete, the paper proposes five data skills—data entry, aggregation, and visualization; data consistency checking; mathematical applications; algorithmic thinking and implementation; and scripting, automation, and tool integration—each illustrated with classroom activities. The paper does not claim to prove these activities raise testable outcomes; it explicitly says it does not provide empirically validated lesson plans. If the claim is right, schools can build data and computing instruction on software they already license.","feed_headline":"Spreadsheets get a real role in K-12 data science","feed_subtitle":"Five teachable skills turn existing spreadsheet licenses into a foundation for data acumen and computational thinking.","key_machinery":"The mechanism carrying the argument is the spreadsheet grid itself, treated as a first-order data object—meaning the data are the primary thing the student sees and touches—together with the five skill categories the paper proposes. The spreadsheet's grid makes data visible and directly editable, and the paper uses that property to argue for rapid development of a student's conception of data. The five skills—entry, aggregation, and visualization; consistency checking; mathematical modeling; nested-logic and algorithmic formulas; and scripting and tool integration—are the proposed bridge from ordinary classroom use to computational thinking. The paper also leans on the analogy between spreadsheet cell references and variables in programming, and between spreadsheet formulas and function composition, as conceptual footholds.","core_discovery":"The central claim is that spreadsheets should be treated as a legitimate component of the K-12 data science toolkit rather than as a tool to be avoided because of its analytic limitations. The paper grades spreadsheets on an adapted framework for data-science tools and finds their strengths where data are shown plainly and can be touched—accessibility, data as a first-order object, ease of entry—while conceding weaknesses in interactivity, flexible plotting, reproducibility, and inferential analysis. From that balance it derives five proposed skills that students should develop through repeated spreadsheet use, and it argues that these skills translate to other tools. The paper's final position is that spreadsheets are a foundation, not a replacement: they prepare students for environments such as visual interfaces and scripting languages.","pith_inferences":["If the learning mechanism is real, the five skills could be organized into an explicit progression with assessment items attached to each skill, something the paper does not supply.","A natural test would compare spreadsheet-first and visual-tool-first groups on a transfer task, since the paper's argument predicts positive transfer from spreadsheets to other tools.","Generative AI tutors could lower the teacher-knowledge barrier the paper identifies, but could also let students skip the foundational practice the argument depends on; the paper notes the tension but does not resolve it.","The paper's case centers on a single web-based spreadsheet system, leaving open whether the same argument holds in districts that rely on other spreadsheet software."],"forward_implications":["Schools can begin data and computing instruction immediately with the spreadsheet software they already license, without new procurement.","Repeated spreadsheet activities across science, math, and computer science classes can build data acumen and computational fluency before students encounter scripting languages.","Spreadsheet proficiency can make later tools easier to learn, because the five skills of organizing, checking, modeling, algorithmic logic, and automation transfer.","The cell-reference and formula analogies give teachers a concrete language for introducing variables and function composition.","Teacher professional development becomes a binding constraint, since instructors who lack spreadsheet fluency will be reluctant to teach it."],"supporting_citations":[{"why":"Supplies the K-12 data-tool framework and the skeptical conclusion about relying solely on spreadsheets that the paper qualifies.","marker":"Pimentel et al. (2022)"},{"why":"Defines the key attributes of statistical computing tools that the paper adapts to grade spreadsheet tools.","marker":"McNamara (2018)"},{"why":"Establishes the data-organization best practices that define the spreadsheet's legitimate role beyond analysis.","marker":"Broman & Woo (2018)"},{"why":"Provides survey evidence that a large majority of K-12 science educators already use spreadsheets with their students.","marker":"Rosenberg et al. (2022)"},{"why":"Defines the K-12 data and computing competencies that the paper maps its five proposed skills onto.","marker":"National Academies of Sciences, Engineering, and Medicine (2026)"},{"why":"Provides the computational-thinking definition that motivates the algorithmic and scripting skills in the paper.","marker":"Wing (2006)"},{"why":"Offers the K-12 statistics education guidelines that anchor the statistical problem-solving activities.","marker":"American Statistical Association (2020)"}],"fun_headline_variants":["Spreadsheets: a real foundation for K-12 data science","Five spreadsheet skills for K-12 data acumen","Why spreadsheets belong in K-12 data science","Spreadsheets as stepping stones for K-12 data skills","Spreadsheets: a practical start for K-12 data science"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The load-bearing premise is that using spreadsheets in the ways proposed actually causes the intended growth in data acumen and computational fluency; the paper offers example activities but no empirical evidence that the learning happens.","fun_headline_variants_meta":{"raw":{"variants":["Spreadsheets: a real foundation for K-12 data science","Five spreadsheet skills for K-12 data acumen","Why spreadsheets belong in K-12 data science","Spreadsheets as stepping stones for K-12 data skills","Spreadsheets: a practical start for K-12 data science"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000462,"raw_usage":{"total_tokens":2269,"prompt_tokens":861,"completion_tokens":1408,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":477,"completion_tokens_details":{"reasoning_tokens":1327}},"tokens_in":477,"tokens_out":1408,"duration_ms":10011,"temperature":1.0,"reasoning_tokens":1327,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-07T11:11:17.036847+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"A controlled classroom study would settle it: randomly assign K-12 students to equivalent data-science lessons taught with spreadsheets versus a non-spreadsheet tool, and measure data acumen and transfer to a new tool before and after. If the spreadsheet group does not show at least as much growth as the comparison group, the paper's claim that spreadsheets can serve as the foundation loses its empirical support.","supporting_citations":[],"review_version":1}