City Research Online

Tasks of a Different Color: How Crowdsourcing Practices Differ per Complex Task Type and Why This Matters

Wang, Y., Papangelis, K., Lykourentzou, I. , Saker, M. ORCID: 0000-0002-7414-2840, Chamberlain, A., Khan, V-J., Liang, H-N. & Yue, Y. (2023). Tasks of a Different Color: How Crowdsourcing Practices Differ per Complex Task Type and Why This Matters. In: UNSPECIFIED . Association for Computing Machinery. ISBN 9781450394215 doi: 10.1145/3544548.3581418


Crowdsourcing in China is a thriving industry. Among its most interesting structures, we find crowdfarms, in which crowdworkers self-organize as small organizations to tackle macrotasks. Little, however, is known as to which practices these crowdfarms use to tackle the macrotasks, and this goes hand in hand with the current practice of the HCI research community to treat all forms of complex crowdsourcing work as practically the same. However, macrotasks differ substantially regarding structure and decomposability. Treating them under one umbrella term - macrotasking - can lead to an imprecise understanding of the workforce involved. We address this gap by examining the work practices of 31 Chinese crowdfarms on the four main macrotask types, namely: modular, interlaced, wicked, and container macrotasks. Our results confirm essential differences in how these nascent crowd organizations address different macrotasks and shed light on what platforms can do to improve the uptake of such work.

Publication Type: Conference or Workshop Item (Paper)
Additional Information: Copyright © 2023 ACM. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems,
Publisher Keywords: crowdsourcing, crowdfarms, work practices
Subjects: H Social Sciences > HM Sociology
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Departments: School of Policy & Global Affairs > Sociology & Criminology
[thumbnail of CHI23 Accepted Version.pdf]
Text - Accepted Version
Download (273kB) | Preview


Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email


Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login