Title :
Human Beyond the Machine: Challenges and Opportunities of Microtask Crowdsourcing
Author :
Gadiraju, Ujwal ; Demartini, Gianluca ; Kawase, Ricardo ; Dietze, Stefan
Abstract :
In the 21st century, where automated systems and artificial intelligence are replacing arduous manual labor by supporting data-intensive tasks, many problems still require human intelligence. Over the last decade, by tapping into human intelligence through microtasks, crowdsourcing has found remarkable applications in a wide range of domains. In this article, the authors discuss the growth of crowdsourcing systems since the term was coined by columnist Jeff Howe in 2006. They shed light on the evolution of crowdsourced microtasks in recent times. Next, they discuss a main challenge that hinders the quality of crowdsourced results: the prevalence of malicious behavior. They reflect on crowdsourcing´s advantages and disadvantages. Finally, they leave the reader with interesting avenues for future research.
Keywords :
Internet; business data processing; outsourcing; Internet; artificial intelligence; automated system; data-intensive task; human intelligence; microtask crowdsourcing system; Context; Crowdsourcing; Human factors; Intelligent systems; Pricing; Taxonomy; MTurk; collective intelligence; crowdsourcing; data centric task; data science; microtask; worker behavior;
Journal_Title :
Intelligent Systems, IEEE
DOI :
10.1109/MIS.2015.66