Resources

(Updated February 18, 2015) This page is in constant update and contains papers, tutorials, and links to other resources for clever experimentation on MTurk. If you have any suggestion, write to gpaolacci-at-rsm.nl.

Tutorials

Excluding MTurk workers who participated in your previous studies: An Excel solution
Gabriele Paolacci (Erasmus University)

Selectively Recruiting Participants from Amazon Mechanical Turk Using Qualtrics
Eyal Peer (Carnegie Mellon University), epeer@andrew.cmu.edu
Gabriele Paolacci (Erasmus University)
Jesse Chandler (Princeton University)
Pam Mueller (Princeton University)

(Suggested citation: Pe’er, Eyal, Paolacci, Gabriele, Chandler, Jesse and Mueller, Pam, Selectively Recruiting Participants from Amazon Mechanical Turk Using Qualtrics (May 2, 2012). Available at SSRN: http://ssrn.com/abstract=2100631 or http://dx.doi.org/10.2139/ssrn.2100631)

Emailing workers using Python
Pam Mueller (Princeton University), pamuelle@princeton.edu
Jesse Chandler (Princeton University)

(Suggested citation: Mueller, Pam and Chandler, Jesse, Emailing Workers Using Python (March 3, 2012). Available at SSRN: http://ssrn.com/abstract=2100601)

Review Article: 

  • Paolacci, G., Chandler, J. (2014). Inside the Turk: Understanding Mechanical Turk as a Participant Pool. Current Directions in Psychological Science, 23(3), 184-188.

(Some) Fundamental articles on MTurk experimentation

Online resources

  • Sid Suri and Winter Mason maintain a wiki about research on AMT and other crowdsourcing platforms.
  • Michael Buhrmester maintains a page about conducting experiments on AMT.
  • Panos Ipeirotis’ blog is often posting about AMT.
  • Dave Rand gave an introductory talk about conducting experiments on AMT.
  • Adam Finkelstein’s course “Crowdsourcing your experiment” refers to many useful resources to run experiments on AMT.
  • Deneme is another blog on experiments on AMT, with a different purpose. It also provides a link to Turkit, a Java/JavaScript API for running iterative tasks on AMT.
%d bloggers like this: