Crowdsourcing Complex Workflows under Budget Constraints
File(s)aaai15-budgetfix.pdf (1.52 MB)
Accepted version
Author(s)
Tran-Thanh, Long
Huynh, Trung Dong
Rosenfeld, Avi
Ramchurn, Sarvapali D
Jennings, Nicholas R
Type
Conference Paper
Abstract
We consider the problem of task allocation in crowdsourcing systems with multiple complex workflows, each of which consists of a set of interdependent micro-tasks. We propose Budgeteer, an algorithm to solve this problem under a budget constraint. In particular, our algorithm first calculates an efficient way to allocate budget to each workflow. It then determines the number of inter-dependent micro-tasks and the price to pay for each task within each workflow, given the corresponding budget constraints. We empirically evaluate it on a well-known crowdsourcing-based text correction workflow using Amazon Mechanical Turk, and show that Budgeteer can achieve similar levels of accuracy to current benchmarks, but is on average 45% cheaper.
Date Issued
2015-01
Date Acceptance
2015-01-25
Citation
2015, pp.1298-1304
ISBN
9781577357001
Publisher
AAAI Press
Start Page
1298
End Page
1304
Journal / Book Title
Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence
Volume
2
Copyright Statement
Copyright © 2015, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.
Source
Twenty-Ninth AAAI Conference on Artificial Intelligence (AAAI-15)
Publication Status
Unpublished
Start Date
2015-01-25
Finish Date
2015-01-30
Coverage Spatial
Austin, Texas