{"paper":{"title":"Prototype Tasks: Improving Crowdsourcing Results through Rapid, Iterative Task Design","license":"http://arxiv.org/licenses/nonexclusive-distrib/1.0/","headline":"","cross_cats":[],"primary_cat":"cs.HC","authors_text":"Aaron Gilbee, Abhratanu Paul, Adam Ginzberg, Ahmed Nasser, Akshansh Sinha, Alipta Ballav, Angela Richmond-Fuller, Catherine Mullings, Christopher Diemert, Dilrukshi Gamage, Dinesh Majeti, Jeff Regino, Kamila Mananova, Karolina Ziulkoski, Mahesh Murag, Manoj Pandey, Mark Whiting, Michael Bernstein, Nalin Chhibber, Preethi Srinivas, Rajan Vaish, Sekandar Matin, Senadhipathige Niranga, Sharon Zhou, Shirish Goyal, Snehalkumar \"Neil\" S. Gaikwad, Tejas Sarma, Vibhor Sehgal, William Dai","submitted_at":"2017-07-18T14:35:20Z","abstract_excerpt":"Low-quality results have been a long-standing problem on microtask crowdsourcing platforms, driving away requesters and justifying low wages for workers. To date, workers have been blamed for low-quality results: they are said to make as little effort as possible, do not pay attention to detail, and lack expertise. In this paper, we hypothesize that requesters may also be responsible for low-quality work: they launch unclear task designs that confuse even earnest workers, under-specify edge cases, and neglect to include examples. We introduce prototype tasks, a crowdsourcing strategy requiring"},"claims":{"count":0,"items":[],"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"source":{"id":"1707.05645","kind":"arxiv","version":1},"verdict":{"id":null,"model_set":{},"created_at":null,"strongest_claim":"","one_line_summary":"","pipeline_version":null,"weakest_assumption":"","pith_extraction_headline":""},"references":{"count":0,"sample":[],"resolved_work":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57","internal_anchors":0},"formal_canon":{"evidence_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"author_claims":{"count":0,"strong_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"builder_version":"pith-number-builder-2026-05-17-v1"}