Improving the gold standard in field experiments with multi-armed bandits

DOI:	https://doi.org/10.5465/ambpp.2017.16350abstract
URL:	https://journals.aom.org/doi/10.5465/ambpp.2017.16...
Weitere URL:	https://www.researchgate.net/publication/320786615...
Dokumenttyp:	Konferenzveröffentlichung
Erscheinungsjahr:	2017
Titel einer Zeitschrift oder einer Reihe:	Annual Meeting Proceedings / Academy of Management
Band/Volume:	2017
Seitenbereich:	16350
Veranstaltungstitel:	Academy of Management 2017 Annual Meeting
Veranstaltungsort:	Atlanta, GA
Veranstaltungsdatum:	04.-08.08.2017
Ort der Veröffentlichung:	Chicago, IL
Verlag:	Academy of Management
ISSN:	0065-0668 , 2151-6561
Sprache der Veröffentlichung:	Englisch
Einrichtung:	Fakultät für Betriebswirtschaftslehre > ABWL, Personalmanagement u. Führung (Biemann 2013-)
Fachgebiet:	330 Wirtschaft
Abstract:	In field experiments, researchers commonly allocate subjects to different treatment conditions before the experiment starts. While this approach is intuitive, new information gathered during the experiment is not considered. Based on methodological approaches from other scientific fields such as computer science and medicine, we suggest a randomized adaptive allocation for field experiments in organizational research that is based on a Bayesian multi-armed bandit algorithm. By means of Monte Carlo simulations, we test the usefulness of this approach in a comparison with randomized controlled trials that have a fixed and balanced subject allocation. Our findings suggest that randomized adaptive allocation is more efficient in most settings. We develop recommendations for researchers and discuss limitations of our approach.