Pith. sign in

REVIEW 1 cited by

ChatGPTest: opportunities and cautionary tales of utilizing AI for questionnaire pretesting

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2405.06329 v1 pith:2TVDR6IM submitted 2024-05-10 cs.CY cs.AI

classification cs.CYcs.AI
keywords pretestingarticlesurveyapplicationsdesignfeedbackquestionnairequestionnaires
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

The rapid advancements in generative artificial intelligence have opened up new avenues for enhancing various aspects of research, including the design and evaluation of survey questionnaires. However, the recent pioneering applications have not considered questionnaire pretesting. This article explores the use of GPT models as a useful tool for pretesting survey questionnaires, particularly in the early stages of survey design. Illustrated with two applications, the article suggests incorporating GPT feedback as an additional stage before human pretesting, potentially reducing successive iterations. The article also emphasizes the indispensable role of researchers' judgment in interpreting and implementing AI-generated feedback.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Exploring LLMs for Automated Generation and Adaptation of Questionnaires

    cs.HC 2025-01 conditional novelty 5.0 of 10

    LLM-generated survey questions were rated as clear and specific, while LLM-based pretesting improved some adapted questions but often made original questions wordier and less clear.

Pith tools