- Irani, L. & Silberman, M.S. (2016) Stories We Tell About Labor: Turkopticon and the Trouble with “Design”. Proc. SIGCHI.
- Salehi, Niloufar, Irani, L., and Bernstein, M.S. We Are Dynamo: Overcoming Stalling and Friction in Collective Action for Crowd Workers. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2015. (awarded honorable mention)
- Irani, L. (2015) The Cultural Work of Microwork. New Media & Society, 17(5), 720-739.
- Irani, L. (2015) Justice for “Data Janitors.” Public Books, Jan 15.
- Irani, L. (2015) Difference and Dependence Among Digital Workers: The Case of Amazon Mechanical Turk. South Atlantic Quarterly, 114(1), 225-234.
- Irani, L. and M.S. Silberman. (2013) Turkopticon: Interrupting Worker Invisibility in Amazon Mechanical Turk” Proceedings of CHI 2013, Apr 28-May 2, 2013.(20% acceptance rate, awarded best paper)
- Irani-Silberman, S.L. (2013) Interrupting Invisibilities: Bridging Worlds. Untitled. Portland: Pacific Northwest College of Arts. (awarded Special Mention for 2013 Hannah Arendt Prize in Critical Theory and Creative Research)
Selected online talks:
- 5 minutes – White House Office of Technology Policy / NYU AINow: The Labor that Makes AI “Magic”
- 45 minutes – UCLA Institute for Pure and Applied Mathematics: Centering the Human in Human Computation (broad sketch of my analyses of AMT and the politics of our design activism interventions)
Guidelines for Academic Requesters (of Amazon Mechanical Turk)
During the summer of 2014, a well-meaning researcher acted on Turkopticon in ways that workers found harmful. Partially in response to this latest in a string of systematically produced misunderstandings, a number of Mechanical Turk workers, researchers, and I developed a set of publicly published ethics guidelines for academic researchers using AMT. As it turns out, alongside Amazon’s market infrastructures of AMT, university IRBs (ethics institutional review boards) are one of the few institutions workers can use to call employers to account . They might call employers to account for unpaid wages, privacy intrusions, or hurtful deceptions. These guidelines are not only an act of communication, but a tactical document that workers can point to in their communications with IRBs to a higher set of standards for engagement than Amazon’s existing terms of service.
The guidelines were authored through a Wiki, but also through communication and debate both in Dynamo and in various worker-run forums and chats. They are signed by
This project is undertaken in collaboration with Six Silberman, the worker-moderators of Turkopticon, and Turkers who contribute reviews.
Since 2008, we have designed and maintained Turkopticon, a tool and web service that enables Amazon Mechanical Turk (AMT) workers to share job information with one another and hold employers accountable for fair treatment. Turkopticon is a browser extension that inserts reviews of employers into AMT’s task marketplace interface. Thousands of workers a month use the system.
AMT is a system that allows programmers to solicit large numbers of workers to do small bits of computational labor, such as transcription, image labeling, or survey participation. These bits of labor can be integrated directly into computational systems, layering human computation into existing and emerging information technologies. Human computation represents a growing area of both academic research and industrial development.
Our work examines what happens when people are organized as smooth computational infrastructure, integrated directly into algorithms. As a source of ethical insight into AMT, we began by surveying workers, asking them to draft a what they would like as a worker’s bill of rights. Though workers’ responses diverged wildly, many agreed on one problem: they had little recourse when employers withheld pay. We responded to these findings by designing Turkopticon.
Through our work on Turkopticon, we have explored how communications technologies support or hinder digital solidarities. Through the design and maintenance of the system, we have also explored the politics of mediated and massively distributed participation in design.
The project has drawn attention to the ethics of paid microlabor in the The Nation, San Jose Mercury News, New Scientist, Alter.net, East Bay Express, Communications of the ACM, Salon, O’Reilly Radar, the Sacramento Bee, The Verge, The Huffington Post.