Title :
A quality enhancement of crowdsourcing based on quality evaluation and user-level task assignment framework
Author :
Sooyoung Lee ; Sehwa Park ; Seog Park
Author_Institution :
Dept. of Comput. Sci. & Eng., Sogang Univ., Seoul, South Korea
Abstract :
Crowdsourcing has recently been used in various applications, and the possibility of its utilization and importance is expected to increase continuously in the future. However, crowdsourcing cannot always ensure the precision of the results, which are generated by unspecified individuals. In particular, a more sophisticated task has more complex problems that are related to the accuracy of the result. In this paper, we propose a novel framework to improve the quality of work in a crowdsourcing environment. In this framework, we analyzes the characteristics of workers and allocates the appropriate task to individuals to improve the quality of work. It also provides cumulative voting for correct assessment instead of the majority representation method, which is more commonly used. Our experiments show that this framework facilitates effective work allocation.
Keywords :
information retrieval; personnel; quality management; social networking (online); task analysis; complex problems; crowdsourcing environment; crowdsourcing quality enhancement; cumulative voting; effective work allocation; majority representation method; quality evaluation framework; quality of work; task allocation; user-level task assignment framework; worker characteristics analysis; Accuracy; Computer science; Dynamic programming; Educational institutions; Equations; Mathematical model; Time complexity; Crowdsourcing; Quality Analysis; Task Distribution;
Conference_Titel :
Big Data and Smart Computing (BIGCOMP), 2014 International Conference on
Conference_Location :
Bangkok
DOI :
10.1109/BIGCOMP.2014.6741408