Pith. sign in

REVIEW 6 cited by

MathDial: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problems

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2305.14536 v2 pith:IFF6JKDU submitted 2023-05-23 cs.CL

classification cs.CL
keywords tutoringdatasetmathdialautomaticdatasetsdialoguedialoguesframework
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

While automatic dialogue tutors hold great potential in making education personalized and more accessible, research on such systems has been hampered by a lack of sufficiently large and high-quality datasets. Collecting such datasets remains challenging, as recording tutoring sessions raises privacy concerns and crowdsourcing leads to insufficient data quality. To address this, we propose a framework to generate such dialogues by pairing human teachers with a Large Language Model (LLM) prompted to represent common student errors. We describe how we use this framework to collect MathDial, a dataset of 3k one-to-one teacher-student tutoring dialogues grounded in multi-step math reasoning problems. While models like GPT-3 are good problem solvers, they fail at tutoring because they generate factually incorrect feedback or are prone to revealing solutions to students too early. To overcome this, we let teachers provide learning opportunities to students by guiding them using various scaffolding questions according to a taxonomy of teacher moves. We demonstrate MathDial and its extensive annotations can be used to finetune models to be more effective tutors (and not just solvers). We confirm this by automatic and human evaluation, notably in an interactive setting that measures the trade-off between student solving success and telling solutions. The dataset is released publicly.

Discussion (0). Sign in to comment.

Forward citations

Cited by 6 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Credit Cards, Confusion, Computation, and Consequences: What Can We Uncover About Language Model Reasoning?

    cs.CL 2026-07 conditional novelty 6.5 of 10

    CreditCardQA shows LLMs err mainly on credit-card contractual conditions and comparisons, not arithmetic, with Program-of-Thought narrowing open–closed model gaps.

  2. Simultaneous Multi-objective Alignment Across Verifiable and Non-verifiable Rewards

    cs.LG 2025-10 conditional novelty 6.0 of 10

    MAHALO aligns LLMs to multiple objectives in one model via per-objective action heads and PRM-guided decoding, improving math, value, and tutoring metrics jointly.

  3. Intent Matters: Enhancing AI Tutoring with Fine-Grained Pedagogical Intent Annotation

    cs.CL 2025-06 conditional novelty 5.0 of 10

    Fine-tuning a math tutor model on 11 fine-grained pedagogical intents instead of 4 broad ones gave better automatic scores and a modest human preference in a small evaluation.

  4. Simulating LLM-to-LLM Tutoring for Multilingual Math Feedback

    cs.CL 2025-06 conditional novelty 5.0 of 10

    A large LLM-to-LLM math tutoring simulation across 11 languages shows English-language hints often yield the largest accuracy gains for student models, but the low-resource-language results lack statistical support.

  5. BD at BEA 2025 Shared Task: MPNet Ensembles for Pedagogical Mistake Identification and Localization in AI Tutor Responses

    cs.CL 2025-06 conditional novelty 4.0 of 10

    An ensemble of MPNet classifiers trained with grouped cross-validation and class-weighted loss reaches competitive macro-F1 on mistake identification and location in AI tutor responses.

  6. Robust pid sliding mode control for dc servo motor speed control

    eess.SY 2025-08 unverdicted novelty 2.0 of 10

    An abstract-only claim that SMC-PID outperforms PID for DC servo motor speed on the CE110 trainer; the submitted body text is an unrelated paper, so the result is unverifiable.

Pith tools