pith. the verified trust layer for science. sign in

arxiv: 1211.3200 · v1 · pith:RZGLAP4Bnew · submitted 2012-11-14 · 💻 cs.IR · cs.SI

An Analytic Approach to People Evaluation in Crowdsourcing Systems

classification 💻 cs.IR cs.SI
keywords reputationsystemstasksanalyticcredibilitycrowdsourcingevaluationevaluators
0
0 comments X p. Extension
Add this Pith Number to your LaTeX paper What is a Pith Number?
\usepackage{pith}
\pithnumber{RZGLAP4B}

Prints a linked pith:RZGLAP4B badge after your title and writes the identifier into PDF metadata. Compiles on arXiv with no extra files. Learn more

read the original abstract

Worker selection is a significant and challenging issue in crowdsourcing systems. Such selection is usually based on an assessment of the reputation of the individual workers participating in such systems. However, assessing the credibility and adequacy of such calculated reputation is a real challenge. In this paper, we propose an analytic model which leverages the values of the tasks completed, the credibility of the evaluators of the results of the tasks and time of evaluation of the results of these tasks in order to calculate an accurate and credible reputation rank of participating workers and fairness rank for evaluators. The model has been implemented and experimentally validated.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.