psiTurk: An open-source framework for conducting replicable behavioral experiments online (2016)

Abstract

Online data collection has begun to revolutionize the behavioral sciences. However, conducting carefully con- trolled behavioral experiments online introduces a number of new of technical and scientific challenges. The project described in this paper, psiTurk, is an open-source plat- form which helps researchers develop experiment designs which can be conducted over the Internet. The tool pri- marily interfaces with Amazon’s Mechanical Turk, a pop- ular crowd-sourcing labor market. This paper describes the basic architecture of the system and introduces new users to the overall goals. psiTurk aims to reduce the technical hurdles for researchers developing online experiments while improving the transparency and collaborative nature of the behavioral sciences.

Bibliographic entry

Gureckis, T. M., Martin, J., McDonnell, J., Rich, A. S., Markant, D., Coenen, A., Halpern, D., Hamrick, J. B., & Chan, P. (2016). psiTurk: An open-source framework for conducting replicable behavioral experiments online. Behavior Research Methods, 48, 829-842. doi:10.3758/s13428-015-0642-8 (Full text)

Miscellaneous

Publication year 2016
Document type: Article
Publication status: Published
External URL: http://dx.doi.org/10.3758/s13428-015-0642-8 View
Categories:
Keywords: amazon mechanical turkinternet experimentsonline experimentsopen science

Edit | Publications overview