Alejandro Sandoval-Lentisco

Application Form Senior Editor Clinical/Associate Editor Social Section Collabra: Psychology Starting from 1 July 2026, Collabra: Psychology is on the look-out for a new senior editor for the clinical section as well as several new associate editors for the social section. If you are interest...

Contribute to open science! Collabra: Psychology needs a new senior editor for the clinical section as well as several new associate editors for the social section. If you are interested, please fill out the application form before 30 April 2026. Repost please!
forms.gle/DgM3484SuLVD...

The FORRT Library of Reproduction and Replication Attempts (FLoRA) will be the basis of upcoming tools and projects that help replications and reproductions become a natural and difficult to ignore part of research. It is already implemented in our FLoRA Annotator: forrt.org/annotator/

Where have all the comments gone?
For decades, the American Economic Review regularly published formal comments — papers that replicate, reassess, or challenge earlier AER articles.
In our latest blog post, we show: they’ve nearly disappeared.

How Ten Publishers Retract Research Retractions are the primary mechanism for correcting the scholarly record, yet publishers differ markedly in how they use them. We present a bibliometric analysis of 46,087 retractions across 10 major...

In which we learn @acm.org is exceptionally bad at retracting articles that need retracting:

arxiv.org/abs/2602.191...

It’s out!

Our updated strategic plan!

The major change (improvement?!) is focus. COS does many things. My insistence that they all fit together in my head was apparently insufficient.

Now, we are trying to improve clarity, accountability, and effectiveness by aligning activities on a true north objective.

I have not seen this mentioned here, but this is a great example of how the research world has dramatically changed underneath of us and if you're not keeping up you're going to be left behind quickly:

yiqingxu.org/papers/2026_...

Sunsetting TOPFactor.org: What’s Changing and Why COS shares our plans to sunset TopFactor.org, what prompted the decision, and how the research community can keep advancing open and transparent policymaking.

Since 2020, TOP Factor has helped researchers understand how journals support open practices. On March 16, 2026, COS will be sunsetting the tool.

Read more about what prompted the decision, what we've learned, and the future of open and transparent policymaking: www.cos.io/blog/sunsett...

Check out our preprint: "What Pilot Studies Can (and Cannot) Do for Validity in Psychological Research"

Great job @yashvin.bsky.social and @mbneff.bsky.social for leading!

doi.org/10.31234/osf...

first slide of presentation with OSC logo, and social media handles, name of presenter. the title says From the replicability crisis to credible science, and has three badges 1. preregistered: 100% p-hacking free, 2. open data: Here, check our numbers, 3. open materials: here's how you can replicate our results

Taught bavarian center for cancer research students about

Preregistration → more reliable research
Reproducible workflows
FAIR data managmt → higher-quality, reusable data

Yes, FAIR & sensitive medical data are compatible

Slides osf.io/p9sev/files/...
Tutorials lmu-osc.github.io/training/sel...

New paper, on a worrying trend in meta-science: the practice of anonymising datasets on, e.g., published articles. We argue that this is at odds with norms established in research synthesis, explore arguments for anonymisation, provide counterpoints, and demonstrate implications and epistemic costs.

vazul: An R Package for Analysis Blinding: https://osf.io/mp54s

Introduction to INSPECT-SR Training Workshop March (Europe) An introductory 2-hour online workshop will introduce participants to the INSPECT-SR tool for assessing trustworthiness of randomised controlled...

Next free online INSPECT-SR training workshop on March 6th. Register here: www.trybooking.com/uk/FZUN Timed for Europe. Will try to add something for North America in the next few days...

Early draft of my ebook for the course:

ianhussey.quarto.pub/reproducible...

Teaching Open Science ‘With open science becoming normative in academic research, it is important that it becomes part of student training to set students up for success. A key philosophy of Teaching Open Science is that open science principles are integrated throughout research education and training. Teachers will appreciate the concrete and comprehensive “how to” guidance across its 12 engaging chapters.’ – Brian Nosek, Center for Open Science and University of Virginia, USA

📚 Now available for preorder! Teaching Open Science is a practical guide for incorporating open science principles into teaching & learning across diverse contexts. Crystal Steltenpohl, COS Training & Education Manager, is lead author of the chapter on qualitative approaches

Reporting Practices, Open Science Practices, and Trustworthiness of Simulation Studies in Psychology: A Questionnaire Study: https://osf.io/jn9sy

Now with more Rat dck!

Check out this tool to get paper recommendations everyday from arxiv and biorxiv, very simple but effective! www.ggrxiv.com

Diagram showing four phases of methodological research (Theory, Exploration, Systematic Comparison, Evidence Synthesis) with an arrow indicating that preregistration usefulness increases from early to late phases. Each phase lists its aim, elements, outcome, and an example from factor retention research.

Does it make sense to preregister simulation studies?
This question has sparked a lot of debate.

▶️We* work through the why, when, and how
▶️We discuss different phases of methodological research to clarify where preregistration might (or might not) add value

📝 Preprint: doi.org/10.31234/osf...

This headline number has generated a lot of attention, but does not account for the classifier's accuracy. @jamiecummins.bsky.social and I wrote a short commentary showing that, assuming a paper mill base rate of 10%, 30% of the flagged papers are false positives. At a base rate of 5%, 50% are FPs.

A framework for assessing the trustworthiness of scientific research findings1 | PNAS Vigorous debate has erupted over the trustworthiness of scientific research findings in a number of domains. The question “what makes research find...

Our new paper, with colleagues from the Strategic Council of the National Academies, offers an integrative framework of the several components that contribute to making research findings trustworthy including ethics, methodology, transparency, inclusion, assessment, etc

www.pnas.org/doi/10.1073/...

Mega-journal Heliyon retracts hundreds of papers after internal audit Heliyon has published fewer papers and ramped up its retractions since a major indexing service put the journal on hold and the publisher launched an audit of all papers published in the journal si…

Heliyon has published fewer papers and ramped up its retractions since a major indexing service put the journal on hold and the publisher launched an audit of all papers published in the journal since its launch in 2016.

AStA Advances in Statistical Analysis AStA Advances in Statistical Analysis is a quarterly journal that publishes original contributions on statistical methodology, applications, and review ...

Advances in Statistical Analysis has a call for papers on the role of multiverse analysis in statistical modelling and applications: link.springer.com/journal/1018...

Deadline is May 1st, so still plenty of time to put something together!>

Interesting! AI-assisted assessment of responsible research practices. www.biorxiv.org/content/10.6...

#metascience #meta-science #meta-research

Likelihood Ratio Test for Publication Bias – a proof of concept - MetaROR

Publication bias poses a serious challenge to clarity and precision in scientific research & meta-analyses. This article by Paweł Lenartowicz poses a way to deal with this: the Likelihood Ratio Test for Publication Bias.

👇 Read the editorial assessment, peer reviews, and full article on MetaROR now

Wiley: "We’re supporting responsible research assessment practices" onlinelibrary.wiley.com/journal/1520...

Also Wiley: "Prove that your article is a good fit for this journal 😉😉😉😉😉 by citing at least two of our articles in your manuscript before we will even consider reviewing it" 🤡

Preregistration Works: Increased Reporting Quality, Internal Validity, and Protocol Adherence in Animal Studies: https://osf.io/ruw7p

📅 Mark your calendars for #SIPS2027!
The 2027 SIPS conference, organized in collaboration with the Association for Interdisciplinary Meta-Research and Open Science @aimosinc.bsky.social, will be held in November at the University of Melbourne, Australia.

We are looking forward to seeing you there!

The Iowa Gambling Task is an extreme example of Jingle Fallacy and schmeasurement.

In 100 articles we found 244 different ways of scoring it, 177 were never reused. Correlations between them range -.99 to .99.

At the same time, we show meta-analyses combine these results as if they’re equivalent.

RegCheck RegCheck is an AI tool to compare preregistrations with papers instantly.

Comparing registrations to published papers is essential to research integrity - and almost no one does it routinely because it's slow, messy, and time-demanding.

RegCheck was built to help make this process easier.

Today, we launch RegCheck V2.

🧵

regcheck.app