Title :
MobileWorks: Designing for Quality in a Managed Crowdsourcing Architecture
Author :
Kulkarni, Anand ; Gutheim, Philipp ; Narula, Prayag ; Rolnitzky, David ; Parikh, Tapan ; Hartmann, Björn
Author_Institution :
MobileWorks, Berkeley, CA, USA
Abstract :
Online labor marketplaces offer the potential to automate tasks too difficult for computers, but don´t always provide accurate results. MobileWorks is a crowd platform that departs from the marketplace model to provide robust, high-accuracy results using three new techniques. A dynamic work-routing system identifies expertise in the crowd and ensures that posted work completes within a bounded time with fair wages. A peer-management system helps prevent wrong answers. Last, social interaction techniques let best workers manage and teach other crowd members. This process allows the crowd to collaboratively learn how to solve new tasks.
Keywords :
computer aided instruction; groupware; labour resources; mobile computing; quality assurance; MobileWorks; collaborative learning; crowd platform; dynamic work-routing system; managed crowdsourcing architecture; online labor marketplaces; peer-management system; social interaction techniques; Computer architecture; Crowdsourcing; Employment; Internet; Outsourcing; Quality control; Redundancy; Routing protocols; crowdsourcing; development; human computation; marketplace;
Journal_Title :
Internet Computing, IEEE
DOI :
10.1109/MIC.2012.72
