Draft:CloudResearch
Submission declined on 9 July 2026 by Zippybonzo (talk).
Where to get help
How to improve a draft
You can also browse Wikipedia:Featured articles and Wikipedia:Good articles to find examples of Wikipedia's best writing on topics similar to your proposed article. Improving your odds of a speedy review To improve your odds of a faster review, tag your draft with relevant WikiProject tags using the button below. This will let reviewers know a new draft has been submitted in their area of interest. For instance, if you wrote about a female astronomer, you would want to add the Biography, Astronomy, and Women scientists tags. Editor resources
|
Submission declined on 6 March 2026 by Pythoncoder (talk). This draft appears to contain text generated by a large language model (such as ChatGPT). You cannot use LLMs to generate article content.
Declined by Pythoncoder 5 months ago.LLM-generated pages with certain obvious signs of being machine generated may be deleted without notice. Instead, only summarize in your own words a range of independent, reliable, published sources that discuss the subject. See the advice page on large language models for more information. |
Submission declined on 6 February 2026 by MightyRanger (talk). This draft is not written from a neutral point of view. Wikipedia articles must be written neutrally in a formal, impersonal, and dispassionate way. They should not read like a blog post, advertisement, or fan page. Rewrite the draft to remove:
Declined by MightyRanger 6 months ago.
|
CloudResearch is an American research technology company founded in 2012 and headquartered in New York, NY. The company provides behavioral and social scientists with access to people willing to take surveys or participate in online studies. Its users include university researchers, businesses conducting market research, and AI companies gathering training data.
History
CloudResearch was founded in 2012 as TurkPrime by Jonathan Robinson and Leib Litman, two academic researchers looking to improve participant recruitment for their own studies.[1] The platform initially operated as an add on tool to Amazon Mechanical Turk (MTurk). TurkPrime made MTurk easier to use for social science research by adding features to filter participants by demographics, screen for data quality, and manage who could take part in studies.[2] A 2016 article in Science described TurkPrime as "MTurk for the social sciences."[3]
In 2018, the quality of data collected through Mechanical Turk declined sharply[4][5]. TurkPrime responded by developing fraud detection and data quality tools that are used in both academia and market research [6][7]. This focus on data quality became a defining feature of the company and continues with AI agents.
In 2019, TurkPrime rebranded as CloudResearch to reflect its growing emphasis on research beyond Mechanical Turk. In 2022, CloudResearch launched Connect, its own participant recruitment platform operating independently of MTurk. In 2024, the company introduced Engage, a survey platform with built-in AI capabilities.
Research and Publications
The research team at CloudResearch has published more than 25 peer-reviewed studies on data quality and survey methodology. According to Google Scholar, these publications had been cited approximately 6,900 times as of January 2026. The company has also published two books.
A 2023 study published in 'PLOS ONE' by CloudResearch examined a CDC report that claimed millions of Americans had ingested cleaning products like bleach during the COVID-19 pandemic.[8] The CloudResearch study attributed reports of drinking bleach and using cleaning products in dangerous ways to fraudulent survey responses rather than actual behavior. The paper's findings were covered by ''U.S. News & World Report'' and ''Harvard Business Review''.[9][10]
In 2020, CloudResearch published 'Conducting Online Research on Amazon Mechanical Turk and Beyond' through SAGE Publications. [11] A second book, Research in the Cloud: An Introduction to Modern Methods in Behavioral Research, is being published by Cambridge University Press in 2026. The Research in the Cloud book is an open access textbook, focused on teaching students and researchers how to use the tools of online research.
Detecting Fraud and AI Agents in Online Surveys
Before AI-generated responses became a concern, the main threat to online survey data came from human fraud--people misrepresenting themselves online to earn money for taking surveys[12]. CloudResearch developed methods for detecting survey fraud and multiple independent academic studies have examined CloudResearch's data quality relative to other platforms. A 2023 study in PLOS ONE found that CloudResearch participants were more likely to pass attention checks and provide unique IP addresses compared to MTurk, Qualtrics, and other platforms.[13] A 2025 study forthcoming in Nature Human Behaviour compared nine platforms and found CloudResearch's Connect ranked among the highest in data quality.[14]
In response to concerns about AI-generated survey responses [15], CloudResearch developed detection methods analyzing behavioral signals such as mouse movements and typing patterns. A 2025 article in Science reported on CloudResearch's detection efforts, noting the company's internal testing results.[16] The article also noted that detection methods must continue to evolve as AI capabilities advance.
Artificial Intelligence and Engage
In 2024, CloudResearch launched Engage, an AI-powered survey platform.
Engage was used in collaboration with the Siena College Research Institute during the 2024 US presidential election to conduct over 5,000 AI-assisted interviews with battleground state voters.[17] The AI allowed researchers to gather both qualitative and quantitative data and analyze the data faster than traditional methods. Coverage of these polling projects appeared in CBS's Arizona affiliate, Arizona Family.[18] [19] [20].
Criticisms and Limitations
Online research platforms face an ongoing debate about participant compensation and working conditions[21]. Research published by CloudResearch in 2020 documented a gender-based pay gap in anonymous online labor markets. [22]
References
- ^ "Unconventional Data Sources Fuel Research Innovations". Association for Psychological Science - APS. Retrieved 2026-01-30.
- ^ Litman, Leib; Robinson, Jonathan; Abberbock, Tzvi (2017-04-01). "TurkPrime.com: A versatile crowdsourcing data acquisition platform for the behavioral sciences". Behavior Research Methods. 49 (2): 433–442. doi:10.3758/s13428-016-0727-z. ISSN 1554-3528. PMC 5405057. PMID 27071389.
- ^ Bohannon, J. (2016). "Mechanical Turk upends social sciences". Science. 352 (6291): 1263–1264. doi:10.1126/science.352.6291.1263. PMID 27284175. Retrieved 2026-01-30.
- ^ Chmielewski, Michael; Kucker, Sarah C. (2020). "An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results". Social Psychological and Personality Science. 11 (4): 464–473. doi:10.1177/1948550619875149.
- ^ Dreyfuss, Emily. "A Bot Panic Hits Amazon's Mechanical Turk". Wired. ISSN 1059-1028. Retrieved 2026-03-16.
- ^ PhD, Aaron Moss (2018-09-18). "After the Bot Scare: Understanding What's Been Happening With Data Collection on MTurk and How to Stop It". CloudResearch Blog. Retrieved 2026-03-16.
- ^ Hauser, David J.; Moss, Aaron J.; Rosenzweig, Cheskie; Jaffe, Shalom N.; Robinson, Jonathan; Litman, Leib (2023-12-01). "Evaluating CloudResearch's Approved Group as a solution for problematic data quality on MTurk". Behavior Research Methods. 55 (8): 3953–3964. doi:10.3758/s13428-022-01999-x. ISSN 1554-3528. PMC 10700412. PMID 36326997.
- ^ Litman, Leib; Rosen, Zohn; Hartman, Rachel; Rosenzweig, Cheskie; Weinberger-Litman, Sarah L.; Moss, Aaron J.; Robinson, Jonathan (2023-07-05). "Did people really drink bleach to prevent COVID-19? A guide for protecting survey data against problematic respondents". PLOS ONE. 18 (7) e0287837. Bibcode:2023PLoSO..1887837L. doi:10.1371/journal.pone.0287837. ISSN 1932-6203. PMC 10321604. PMID 37406017.
- ^ Hartman, Rachel (2021-04-20). "Did 4% of Americans Really Drink Bleach Last Year?". Harvard Business Review. ISSN 0017-8012. Retrieved 2026-01-30.
- ^ Smith-Schoenwalder, Cecelia (13 July 2023). "Did American Actually Drink Bleach During the COVID-19 Pandemic". US News and World Report.
- ^ Litman, Leib; Robinson, Jonathan (2021). Conducting Online Research on Amazon Mechanical Turk and Beyond. SAGE Publications, Inc. ISBN 978-1-5063-9115-1.
- ^ Jaffe, Shalom; Moss, Aaron; Hartman, Rachel; Rosenzweig, Cheskie; Gautam, Richa; Robinson, Jonathan; Litman, Leib (January 6, 2026). "The Bots Ruining Social Science Are Not Bots at All". Perspectives on Psychological Science. 21 (2): 127–137. doi:10.1177/17456916251404872. PMID 41493918. Retrieved 2026-02-11.
- ^ Douglas, Benjamin D.; Ewell, Patrick J.; Brauer, Markus (2023-03-14). "Data quality in online human-subjects research: Comparisons between MTurk, Prolific, CloudResearch, Qualtrics, and SONA". PLOS ONE. 18 (3) e0279720. Bibcode:2023PLoSO..1879720D. doi:10.1371/journal.pone.0279720. ISSN 1932-6203. PMC 10013894. PMID 36917576.
- ^ Stagnaro, Michael; Druckman, James; Berinsky, Adam; Arechar, Antonio; Willer, Rob; Rand, David (August 21, 2025). "Representativeness and Response Validity Across Nine Opt-In Online Samples". osf.io. doi:10.31234/osf.io/h9j2d_v2. Retrieved 2026-02-11.
- ^ Westwood, Sean J. (2025-11-25). "The potential existential threat of large language models to online survey research". Proceedings of the National Academy of Sciences. 122 (47) e2518075122. Bibcode:2025PNAS..12218075W. doi:10.1073/pnas.2518075122. PMC 12663962. PMID 41264250.
- ^ "Science". AAAS. Retrieved 2026-01-30.
- ^ "Double Haters May Decide the Presidency" (PDF). Siena College Research Institute. 27 June 2024.
- ^ Staahl, Derek (2024-08-09). "How artificial intelligence is changing the political polling industry". https://www.azfamily.com. Retrieved 2026-01-30.
{{cite web}}: External link in(help)|website= - ^ Staahl, Derek (2024-09-12). "A.I. poll reveals why most voters think Harris won the debate". https://www.azfamily.com. Retrieved 2026-01-30.
{{cite web}}: External link in(help)|website= - ^ Staahl, Derek (2024-10-31). "Why are some voters still undecided? AI poll offers answers". https://www.azfamily.com. Retrieved 2026-01-30.
{{cite web}}: External link in(help)|website= - ^ "Ghost Work". Ghost Work. Retrieved 2026-03-16.
- ^ Litman, Leib; Robinson, Jonathan; Rosen, Zohn; Rosenzweig, Cheskie; Waxman, Joshua; Bates, Lisa M. (2020-02-21). "The persistence of pay inequality: The gender pay gap in an anonymous online labor market". PLOS ONE. 15 (2) e0229383. Bibcode:2020PLoSO..1529383L. doi:10.1371/journal.pone.0229383. ISSN 1932-6203. PMC 7034870. PMID 32084233.
Content Disclaimer
Informasi ini disarikan dari Wikipedia dan disajikan kembali untuk tujuan edukasi. Konten tersedia di bawah lisensi CC BY-SA 3.0. Kami tidak bertanggung jawab atas ketidakakuratan data yang bersumber dari kontribusi publik tersebut.
- The information displayed on this website is sourced in part or in whole from Wikipedia and has been adapted for the purpose of restating it. We strive to provide accurate and relevant information, however:
- There is no guarantee of absolute accuracy. Wikipedia is an open, collaborative project that can be edited by anyone, so information is subject to change.
- It is not intended to constitute professional advice. The content displayed is for informational and educational purposes only. For important decisions (e.g., medical, legal, or financial), please consult a professional.
- Content copyright. Wikipedia is licensed under the Creative Commons Attribution-ShareAlike License (CC BY-SA). This means that content may be reused with appropriate attribution and shared under a similar license.
- Responsible use. Any risk arising from the use of information from this website is entirely the responsibility of the user.

- promotional language: see Words to watch;
- personal commentary: opinions or direct addresses to the reader;
- informal language.
Instead, only summarize in your own words a range of independent, reliable, published sources that discuss the subject.