What prize is right? How to learn the optimal structure for crowdsourcing contests

File Description SizeFormat 
nhat.pdfFile embargoed until 23 August 20201.03 MBAdobe PDF    Request a copy
Title: What prize is right? How to learn the optimal structure for crowdsourcing contests
Authors: Truong, NV-Q
Stein, S
Tran-Thanh, L
Jennings, NR
Item Type: Conference Paper
Abstract: In crowdsourcing, one effective method for encouraging par-ticipants to perform tasks is to run contests where participants compete against each other for rewards. However, there are numerous ways to implement such contests in specific projects. They could vary in their structure (e.g., performance evaluation and the number of prizes) and parameters (e.g., the maximum number of participants and the amount of prize money). Additionally, with a given budget and a time limit, choosing incentives (i.e., contest structures with specific parameter values) that maximise the overall utility is not trivial, as their respective effectiveness in a specific project is usually unknown a priori. Thus, in this paper, we propose a novel algorithm, BOIS (Bayesian-optimisation-based incentive selection), to learn the optimal structure and tune its parameters effectively. In detail, the learning and tuning problems are solved simultaneously by using online learning in combination with Bayesian optimisation. The results of our extensive simulations show that the performance of our algorithm is up to 85% of the optimal and up to 63% better than state-of-the-art benchmarks.
Issue Date: 23-Aug-2019
Date of Acceptance: 1-Aug-2019
URI: http://hdl.handle.net/10044/1/74146
DOI: https://doi.org/10.1007/978-3-030-29908-8_7
ISBN: 9783030299071
ISSN: 0302-9743
Publisher: Springer International Publishing
Start Page: 85
End Page: 97
Journal / Book Title: PRICAI 2019: Trends in Artificial Intelligence
Volume: 1
Copyright Statement: © 2019 Springer Nature Switzerland AG.
Conference Name: Pacific Rim International Conference on Artificial Intelligence (PRICAI)
Keywords: Artificial Intelligence & Image Processing
Publication Status: Published
Start Date: 2019-08-26
Finish Date: 2019-08-30
Conference Place: Cuvu, Yanuka Island, Fiji
Embargo Date: 2020-08-23
Open Access location: https://link.springer.com/chapter/10.1007/978-3-030-29908-8_7
Online Publication Date: 2019-08-23
Appears in Collections:Computing
Faculty of Natural Sciences



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commons