Recruiting Software Engineers on Prolific
read the original abstract
Recruiting participants for software engineering research has been a primary concern of the human factors community. This is particularly true for quantitative investigations that require a minimum sample size not to be statistically underpowered. Traditional data collection techniques, such as mailing lists, are highly doubtful due to self-selection biases. The introduction of crowdsourcing platforms allows researchers to select informants with the exact requirements foreseen by the study design, gather data in a concise time frame, compensate their work with fair hourly pay, and most importantly, have a high degree of control over the entire data collection process. This experience report discusses our experience conducting sample studies using Prolific, an academic crowdsourcing platform. Topics discussed are the type of studies, selection processes, and power computation.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
Beyond the Binary: Motivations, Challenges, and Strategies of Transgender and Non-binary Software Engineering Students
Transgender and non-binary software engineering students choose the field mainly for remote-work flexibility and the chance to build inclusive tools, encounter societal hostility that harms mental health rather than d...
-
Academic Integrity and Emotional Responses to Inappropriate LLM Use in Software Engineering Education
Cross-sectional survey of 116 SE undergraduates finds heterogeneous emotional responses to perceived inappropriate LLM use, dominated by indifference with context-dependent guilt, anxiety, relief, and satisfaction.
-
Exploring Individual Factors in the Adoption of LLMs for Specific Software Engineering Purposes
Survey of 188 engineers using SEM finds that UTAUT2 constructs influence LLM adoption differently across five SE purposes, with some factors showing negative effects when examined in isolation.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.