REVIEW 2 cited by
Exploring the Efficacy of ChatGPT in Analyzing Student Teamwork Feedback with an Existing Taxonomy
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Teamwork is a critical component of many academic and professional settings. In those contexts, feedback between team members is an important element to facilitate successful and sustainable teamwork. However, in the classroom, as the number of teams and team members and frequency of evaluation increase, the volume of comments can become overwhelming for an instructor to read and track, making it difficult to identify patterns and areas for student improvement. To address this challenge, we explored the use of generative AI models, specifically ChatGPT, to analyze student comments in team based learning contexts. Our study aimed to evaluate ChatGPT's ability to accurately identify topics in student comments based on an existing framework consisting of positive and negative comments. Our results suggest that ChatGPT can achieve over 90\% accuracy in labeling student comments, providing a potentially valuable tool for analyzing feedback in team projects. This study contributes to the growing body of research on the use of AI models in educational contexts and highlights the potential of ChatGPT for facilitating analysis of student comments.
Forward citations
Cited by 2 Pith papers
-
Who Plays Which Role When? Communication Role Dynamics for Peer Recognition and Team Performance Prediction
A theory-grounded taxonomy of eight communication roles enables scalable annotation via LLMs and outperforms baselines when predicting peer recognition in student teams and performance improvement on a public delibera...
-
Investigation of the Inter-Rater Reliability between Large Language Models and Human Raters in Qualitative Analysis
GPT-4o and GPT-4.5-preview reached moderate to substantial Cohen's kappa with human coders for three of four student thinking themes after per-theme hyperparameter and prompt tuning.
Discussion (0). Sign in to comment.