REVIEW 1 cited by
Do AI assistants help students write formal specifications? A study with ChatGPT and the B-Method
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
This paper investigates the role of AI assistants, specifically OpenAI's ChatGPT, in teaching formal methods (FM) to undergraduate students, using the B-method as a formal specification technique. While existing studies demonstrate the effectiveness of AI in coding tasks, no study reports on its impact on formal specifications. We examine whether ChatGPT provides an advantage when writing B-specifications and analyse student trust in its outputs. Our findings indicate that the AI does not help students to enhance the correctness of their specifications, with low trust correlating to better outcomes. Additionally, we identify a behavioural pattern with which to interact with ChatGPT which may influence the correctness of B-specifications.
Forward citations
Cited by 1 Pith paper
-
Can Large Language Models Help Students Prove Software Correctness? An Experimental Study with Dafny
Students solve Dafny verification exercises significantly better with ChatGPT, but the benefit depends on prompt quality and including full program context.
Discussion (0). Continue with ORCID to comment.