New 'Preliminary Report' submission format at Science and Medicine in Football. An idea that should be interesting for other journals! Explicitly make space for honestly reported smaller sample-size studies www.tandfonline.com/doi/full/10....
06.11.2025 14:40 — 👍 10 🔁 4 💬 0 📌 0
It seems, I was not up-to-date. Discipline specific examples have already been discussed, or should I say "will be discussed" ;)
Your output is insane! @crist14n.bsky.social
sportrxiv.org/index.php/se...
bsky.app/profile/cspa...
06.11.2025 13:13 — 👍 1 🔁 1 💬 0 📌 0
Check Research Outputs for Best Practices
A modular, extendable system for automatically checking research outputs for best practices using text search, R code, and/or (optional) LLM queries.
The package formerly known as papercheck has changed its name to metacheck! We're checking more than just papers, with functions to assess OSF projects, github repos, and AsPredicted pre-registrations, with more being developed all the time.
scienceverse.github.io/metacheck/
03.11.2025 16:20 — 👍 72 🔁 32 💬 0 📌 0
What is your hypothesis? : On the importance of knowing your hypothesis before conducting a hypothesis test
| SportRxiv
Just discovered this great preprint by
@crist14n.bsky.social @lakens.bsky.social
sportrxiv.org/index.php/se...
I wish someone had given me tutorials/easy-to-understand explanations like these when I was doing my bachelor's degree!
02.11.2025 09:34 — 👍 7 🔁 2 💬 0 📌 0
Relatedly, I think SESOI is a tremendously useful and under-appreciated concept. It's become a regular tool in my power analysis workflows, and I wish I understood it sooner in my career.
31.10.2025 15:42 — 👍 14 🔁 2 💬 2 📌 0
These are exactly the right discussions to have IMO, especially when they help us better understand what knowledge we need (and might still be missing) for setting up meaningful, informative tests.
31.10.2025 10:28 — 👍 3 🔁 1 💬 1 📌 0
I think the thing that most people struggle with though is how to set that SESOI... @cspaeth.bsky.social and I been chatting about it in this thread (and I give examples of how we've gone about it... though our recent theory prediction + practical SESOI is best I think) bsky.app/profile/cspa...
31.10.2025 10:16 — 👍 9 🔁 1 💬 1 📌 0
Yes, in my specific example, we are investigating the "minimal perceived change" using a "global rating of change" as an anchor. So basically a similar approach.
But thank you also for the other recommendations!!! I will have a look!
31.10.2025 12:21 — 👍 1 🔁 0 💬 0 📌 0
There still seems to be a lot of confusion about significance testing in psych. No, p-values *don’t* become useless at large N. This flawed point also used to be framed as "too much power". But power isn't the problem – it's 1) unbalanced error rates and 2) the (lack of a) SESOI. 1/ >
31.10.2025 08:13 — 👍 111 🔁 42 💬 2 📌 9
So (beyond this specific example of anchor-based approaches) I would be happy to see many diverse applied examples on how SESOIs have been reasonably specified in sport and exercise science (if they exist...).
31.10.2025 05:19 — 👍 2 🔁 1 💬 1 📌 0
Redirecting
But the literature on the best estimation procedure to validly derive a SESOI based on these anchor-variables is very heterogenous:
doi.org/10.1016/j.ym...
31.10.2025 05:19 — 👍 1 🔁 0 💬 1 📌 0
Redirecting
The most common approach is an anchor-based approach (i.e., using an external anchor/reference variable as a guidance to derive a SESOI), especially for psychological variables that have no natural metric and are measured with Likert-type scales.
doi.org/10.1016/j.je...
31.10.2025 05:19 — 👍 1 🔁 0 💬 1 📌 0
For example, I am currently working on determining a SESOI for improvements in affective responses during exercise (hope to submit the paper by the end of the year). ->
31.10.2025 05:19 — 👍 1 🔁 0 💬 1 📌 0
Exactly, but as we all know foundational work is not "sexy"... Even if researchers are engaging with the questions how they might be able to empirically specify a SESOI, there are still challenges. ->
31.10.2025 05:19 — 👍 1 🔁 0 💬 1 📌 0
Many thanks to Daniel Lakens @lakens.bsky.social and my supervisor Ralf Brand for providing feedback on previous versions of this commentary
30.10.2025 21:43 — 👍 1 🔁 0 💬 0 📌 0
The call for specifying SESOIs in sport and exercise sciences has already been made @crist14n.bsky.social doi.org/10.1080/0264...
30.10.2025 21:43 — 👍 0 🔁 0 💬 1 📌 0
I am not considering myself a meta-scientist but as a PhD student, I follow meta-scientific discussions to improve my research practices.
This is my humble attempt to summarize previous discussions on severe testing for fellow (German) sport scientist outside the „open science bubble“
30.10.2025 21:43 — 👍 3 🔁 0 💬 1 📌 0
My paper with @lakens.bsky.social and @annaveer.bsky.social - “Replication value as a function of citation impact and sample size” - has just been published in Meta psychology! open.lnu.se/index.php/me...
30.10.2025 09:11 — 👍 19 🔁 5 💬 1 📌 0
"the very core of science – an institution that promotes mutual criticism, while accepting our fallibility"
bsky.app/profile/lake...
29.10.2025 08:02 — 👍 4 🔁 1 💬 0 📌 0
New release of PowerLMM.js! Browser-based power analysis for longitudinal models with dropout.
Now includes:
- Power analysis summary report
- Reproducible & shareable configs (URL/JSON)
- Calculations validated against R
- Hypothesis region visualization
powerlmmjs.rpsychologist.com
28.10.2025 14:02 — 👍 92 🔁 44 💬 4 📌 2
Title: A Justification for 80% Power
Abstract:
Cohen’s heuristic reason for choosing 80% power (balancing Type I and TypeII errors) conveniently arrives at approximately the same number as an approachwhere one maximizes the marginal gain in power per standard error reduction. Ihave yet to see someone point this out, and this is interesting because it providesa non-arbitrary justification for 80% power.
a derivation of the result
I think this is kind of neat and I don't think anyone else has noticed it (I've looked and I can't find anyone who has) osf.io/preprints/so...
Maybe I should back off "justification" language, but it's at least a remarkable coincidence. I still think someone else *must* have noticed it...
24.10.2025 12:23 — 👍 70 🔁 21 💬 5 📌 0
It also reminded me of the “stats maven” concept coined by @sanjaysrivastava.com some very long time ago, I believe here? thehardestscience.com/2014/12/04/s...
22.10.2025 16:18 — 👍 10 🔁 2 💬 1 📌 0
Hi Daniel, will these slides be available online? I would have liked to attend the symposium, but unfortunately I couldn't make it time-wise...
17.10.2025 09:43 — 👍 0 🔁 0 💬 1 📌 0
When and How to Deviate From a Preregistration, with Prof Daniël Lakens
Prof Daniël Lakens will share guidance on appropriate circumstances and methods for deviating from a pre-registration
When is it appropriate to deviate from a pre-registration, and how should this be done? 🧐
Join us to find out from Daniël Lakens @lakens.bsky.social at the next ReproducibiliTea!
October 28, 1pm GMT.
Sign up: www.eventbrite.co.uk/e/when-and-h...
@tabeasch.bsky.social @reproducibilitea.org
13.10.2025 10:41 — 👍 23 🔁 16 💬 2 📌 1
Since all meta-scientific discussions of the open science movement are only slowly being carried over into sports and exercise science, I believe that it is unfortunately still a bubble
11.10.2025 08:08 — 👍 0 🔁 0 💬 0 📌 0
Assistant prof @ Leiden University, the Netherlands. Researcher, teacher and Open Science Community manager to further responsible research methods and research(er) integrity in Psychology, Neuroscience and beyond.
Interested in psychology and philosophy of science.
Society for Transparency, Openness, and Replication in Kinesiology. Join today at http://storkinesiology.org
Guardians of SportRxiv https://sportrxiv.org/index.php/server/index
Communications in Kinesiology https://storkjournals.org/index.php/cik/index
Ecology, evolution, epidemiology, statistics (mixed models). McMaster University, Hamilton, Ontario https://math.mcmaster.ca/bolker
Using Statistical Analysis to Cut Through the BS.
Historically posting mostly about Sport, Physiology & Research Methods.
No idea what I'll post now. Follow and find out, I guess.
PhD candidate studying Monte Carlo simulations in the social/behavioral sciences | Meta-Research Center, Tilburg University | Board member at the Platform for Young Meta-Scientists (PYMS)
Psychology prof at UniMelb, co-director of MetaMelb (interdisciplinary metascience lab).
Live (mostly) in Sydney.
Study credibility of science & how to improve it.
@siminevazire on Twitter
PhD candidate at Eindhoven University of Technology. Having a great time doing meta-research. Wary optimism in sports and exercise science research
Associate Professor at @uOttawa.ca, Faculty of Health Sciences. all comments are my own. Contributing to @pci-hms.bsky.social & @cik.bsky.social. #OpenScience #Kin #PT 🇨🇦 www.linkedin.com/in/matthieuboisgontier
Personality psych & causal inference @UniLeipzig. I like all things science, beer, & puns. Even better when combined! Part of http://the100.ci, http://openscience-leipzig.org
Assistant Professor at the Meta-Research Center, Tilburg University, NL. Interested in reproducibility, replicability, and overall robustness of psychological science. Developer of #statcheck: a spellchecker for statistics. She/her. Mom.
PYMS | We host events to bring early-career-meta-researchers together at our own symposia, external conferences, or online! | Interested in joining our Discord server? Send a message! | https://youngmetascientists.github.io/
An open access, open science psychology journal from @ucpress.bsky.social, and the official journal of @improvingpsych.org (SIPS). Editor-in-Chief: @donvanraven.bsky.social
https://online.ucpress.edu/collabra
https://forrt.org
In a nutshell, FORRT is a Framework for Open and Reproducible Research Training advancing research transparency, reproducibility, rigor, and ethics through pedagogical reform and meta-scientific research.
PCI Health & Movement Sciences (PCI-HMS) promotes #OpenScience through the free editing, review, & recommendation of preprints. https://healthmovsci.peercommunityin.org/about/about
I'm a bot that posts new preprints from PsyArXiv.
Maintained by @remoschmutz.bsky.social & @malte.the100.ci
#rstats #PsyTeachR #PsySciAcc #OpenResearch #CodingClub #ManyFaces (overwhelmed by social media) 🏳️🌈 she/they
Professor of Psychology at the University of Oslo | Behavioral neuroendocrinology, psychophysiology, and meta-science 🇦🇺🇨🇴🇳🇴
Senior Lecturer in Psychology @ Aston University 🧠 ; UKRN Local Network Lead 📊; AE of #RegisteredReports for PCI & Addiction Research & Theory 👩🔬. Author of: "A Student's Guide to Open Science: Using the Replication Crisis to Reform Psychology".