Prolific

See you in Chicago!

If you're heading to the @spspnews.bsky.social Annual Convention from Feb 26-28th, stop by booth #19 to find out how you can use Prolific’s new bot detection tool in your next study.

🎁 $50 credits offer available for first-timers. #AcademicSky #SocialPsyc #Research

YouTube video by Prolific Google DeepMind Presents Deliberate Lab for Human-AI Experiments | The Frontier Series: Episode 1

📺 Watch part 1 now on YouTube → youtu.be/5vyiZXuDcSo

🎧 Listen on Spotify → open.spotify.com/episode/2Kmw...

On the first episode of The Frontier, we spoke to Crystal Qian, Senior Research Scientist at Google DeepMind about Deliberate Lab: an open-source platform for behavioral human-AI social experiments. 🧪

Developed by the PAIR (People + AI Research) team.

#MLSky #AcademicSky #ArtificialIntelligence

AI agents are becoming a serious threat to research data quality.

Today we’re rolling out Bot authenticity checks on @joinprolific.bsky.social, detecting agentic AI with 100% accuracy in testing.

Comes with a native Qualtrics integration! More info:

www.prolific.com/resources/in...

New authenticity checks detect AI misuse in research | Prolific Introducing authenticity checks: Ensure genuine human responses in the age of AI

As new threats to data integrity emerge, we’ll continuously evolve our systems to tackle them.

Read more and share your feedback: www.prolific.com/resources/in... 🔗

Introducing bot authenticity checks that detect agentic AI and bots in academic research.

100% accuracy in testing. Our tool flags automated browser scripts or non-human behavior within your Qualtrics studies, so you can collect data with high confidence that it's human.

#AcademicSky #Research

What drives retention in online longitudinal research? We conducted an experiment (N=1,798) on @joinprolific.bsky.social, orthogonally manipulating payment rate (£6–£9/hr + bonus) and session interval (1, 2, or 4 weeks) across five sessions. The findings challenge some common assumptions 👇

When platforms consolidate, research options shrink.

Researchers are rightly asking whether participant access will stay tool-agnostic, high-quality, and reliable.

As @phe-lim.bsky.social says, we believe access works best when it’s open by design. So if you're reassessing, get in touch. #Research

AI modelling, product research, and academic studies all hinge on one thing most platforms can’t guarantee: real, trustworthy human data. 👥

This is where @joinprolific.bsky.social comes in, the platform-model tech company filling a critical gap in AI and research by providing fast,... (1/11)

Thank you 2025. You’ve been great. ⭐️

Together, our global community across AI, research, and participants made this a truly monumental year.

Whether you were collecting high-quality data or contributing your expertise, we were honored to be your human data platform of choice.

Thanks! We've flagged this to our support team

Here's every current method we use to ensure you receive authentic human data 👉 www.prolific.com/resources/ho...

As always, we invite feedback and new suggestions to help us stay ahead.

This multi-layered approach includes:

- Verifying new participants during onboarding,
- In-app participant monitoring
- Helping researchers verify participants inside studies
- Continuous development of our systems

Our platform is built on robust defensive measures, from rigorous onboarding and ID checks to high-precision authenticity detection in studies.

These focus on catching bots, agentic AI, and participants who use AI tools without consent.

AI agents are becoming more sophisticated, more capable of mimicking human behavior, more accessible.

This raises questions about how we keep real human feedback at the core of online research. 🧵 #AcademicSky #ResearchIntegrity

Hi @michaeljkane.bsky.social happy to answer your question here - or alternatively if it's more sensitive and you've contacted support, please let us know the ticket number 🙂

🇬🇧 At the @universities-uk.bsky.social conference, Dr. Simon Jones discussed digital transformation in research services, with insights from 35,000+ researchers using Prolific.

He explored challenges and successful institutional practices. Great to sponsor another #UUK! #AcademicSky #Research

No problem - Westwood's research shows sophisticated AI can navigate questions/mimic human behavior within an external survey tool, whereas authenticity checks detect when humans are using AI to answer (not test for agentic AI). We're working on improvements however so they evolve as needs require.

For future we're continuing to invest and develop. Highly recommend this article where we share more about our current and evolving approaches: www.prolific.com/resources/pr...

Any feedback you have on that is appreciated.

Thanks @jessewise.bsky.social for raising. Our upgraded system addresses AI-generated responses. We run 50+ onboarding checks (including bank-grade ID verification), always-on monitoring such as periodic video identity checks and regular demographic refreshes, and offer in-study detection tools.

Lots of chatter about this paper currently. Its a stark warning, but at present I see this as a stark warning of what might come, not what is happening now. As a research community we need to see it as a call-to-arms to develop new strategies, NOT a call to abandon online sampling. Reasoning below

Without minimising the seriousness of the threat raised in this paper, I'm more optimistic. This is just the latest challenge in online integrity of online research.

We've been proactively adding to our suite of authenticity tools - more every week - including many of Sean's recommendations:

As part of our commitment to maintaining integrity, we believe ongoing collaboration is fundamental. If you share our vision for clean human data, reach out.

Full report here: www.insightsassociation.org/Education/Ed...

#AcademicSky #ResearchIntegrity

We’re proud to surpass multiple industry benchmarks in the Insights Association’s recent Global Data Quality (GDQ) Benchmarking Report for online #research data quality.

Our metrics include:

⭐️ 2.7% pre-survey removal rate
⭐️ 0.5% in-survey behavior removal
⭐️ 0.5% post-survey cleanout rate

There's not just a generational wealth gap anymore. There's a wellbeing gap too.

And right now, it's hitting younger people the hardest.

(Data from our latest @joinprolific.bsky.social poll - November 2024)

Full data: www.prolific.com/polling

Find out more about our approach with full details of each of the uncompromising layers of protection: www.prolific.com/resources/pr...

Protocol is our five-layer system built to ensure your data is of the highest quality.

VP of Product Sara Saab guides you through the rigorous identity and quality checks, in-study detection tools, and more that ensure your research is powered by human intelligence, always.

#AcademicSky #Research

Don’t wait to discover your data is contaminated. You should work with a data partner that refuses to compromise on what matters most: data integrity.

Learn more: www.prolific.com/resources/pr... 📰

Ongoing human oversight and fine-tuning of our data quality systems is also crucial in protecting good participants and research integrity.

Our system benefits everyone. You get reliable data, and our valued participants enjoy a platform free from unfair competition.

We architect authentic data through Protocol, a state-of-the-art system that sets the industry standard for data quality. With five layers of defense, it ensures every response on our platform is authentically human.

Each layer is detailed in the full article.