Cristian Mesquida's Avatar

Cristian Mesquida

@crist14n.bsky.social

PhD candidate at Eindhoven University of Technology. Having a great time doing meta-research. Wary optimism in sports and exercise science research

146 Followers  |  202 Following  |  13 Posts  |  Joined: 18.11.2023  |  2.1916

Latest posts by crist14n.bsky.social on Bluesky

Preview
An umbrella review of randomized control trials on the effects of physical exercise on cognition - Nature Human Behaviour This umbrella review of meta-analytic evidence reveals that previously reported benefits of physical exercise on cognitive function may have been exaggerated. The authors emphasize the importance of obtaining stronger evidence to confirm the causal relationship between regular physical exercise and enhancements in cognitive functioning.

2 years since we published this paper www.nature.com/articles/s41.... I've checked the around 100 papers that according to Scopus have cited our umbrella. 33% of these papers have cited it incorrectly.

06.10.2025 18:15 β€” πŸ‘ 3    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Preview
Introduction to INSPECT-SR Training Workshop November An introductory 2-hour online workshop will introduce participants to the INSPECT-SR tool for assessing trustworthiness of randomised controlled...

Introductory online INSPECT-SR workshop. November 6th, 12-2pm UK-time. Free, places limited. BOOK: www.trybooking.com/uk/events/la...

03.10.2025 11:08 β€” πŸ‘ 5    πŸ” 6    πŸ’¬ 1    πŸ“Œ 0
Histogram figure illustrating selection bias in estimating intervention effects. The central blue histogram shows the full population distribution of pre-scores (mean = 100, SD = 10). A green histogram (top left) shows a random sample of 1000 participants with similar mean (β‰ˆ100) and SD (β‰ˆ10), producing a raw intervention effect of ~8.7 and standardised mean difference (SMD) of ~0.86. A red histogram (top right) shows a conditionally sampled group (n = 1000, pre-score β‰₯ 110), with higher mean (β‰ˆ115) and smaller SD (β‰ˆ4.4). This sample yields a similar raw effect (~9) but an inflated SMD (~2.0) compared to the population. A corrected SMD brings it back closer to the true effect (~0.9). The figure illustrates how restricting samples to higher-performing individuals (e.g., β€œelite” athletes) compresses variance and artificially inflates standardised effect sizes, despite unbiased raw effects.

Histogram figure illustrating selection bias in estimating intervention effects. The central blue histogram shows the full population distribution of pre-scores (mean = 100, SD = 10). A green histogram (top left) shows a random sample of 1000 participants with similar mean (β‰ˆ100) and SD (β‰ˆ10), producing a raw intervention effect of ~8.7 and standardised mean difference (SMD) of ~0.86. A red histogram (top right) shows a conditionally sampled group (n = 1000, pre-score β‰₯ 110), with higher mean (β‰ˆ115) and smaller SD (β‰ˆ4.4). This sample yields a similar raw effect (~9) but an inflated SMD (~2.0) compared to the population. A corrected SMD brings it back closer to the true effect (~0.9). The figure illustrates how restricting samples to higher-performing individuals (e.g., β€œelite” athletes) compresses variance and artificially inflates standardised effect sizes, despite unbiased raw effects.

#SportScience, especially in elite sports, has an issue that can make effects seem more impressive than they really are... selection bias on the sample (explanation🧡 and a simulation pictured to illustrate below).

1/12

28.09.2025 18:58 β€” πŸ‘ 13    πŸ” 2    πŸ’¬ 1    πŸ“Œ 1

Congrats Peder! See you soon in Eindhoven!

26.09.2025 14:03 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Screenshot of first page of slidecrafting-book.com website

Screenshot of first page of slidecrafting-book.com website

I'm exited to announce a new resource about making slides with quarto and revealjs. This book is the combination of all the work I have done in this area, reordered and polished up

There isn't a lot of new information yet, but this format allows me to add more easily

slidecrafting-book.com
#quarto

24.09.2025 16:12 β€” πŸ‘ 179    πŸ” 64    πŸ’¬ 11    πŸ“Œ 6
Video thumbnail

Version 2.0.0 of quarto-revealjs-editable now lets you edit the text in divs

github.com/EmilHvitfeld...
#quarto

21.08.2025 18:30 β€” πŸ‘ 16    πŸ” 5    πŸ’¬ 0    πŸ“Œ 2

So a spurious correlation from an observational study is β€œgold standard science”, but testing vaccines in multiple RCTs with over 30,000 participants each is not?

23.09.2025 14:01 β€” πŸ‘ 86    πŸ” 13    πŸ’¬ 5    πŸ“Œ 0
Figure 2 from preprint illustrating simulation workflow. From left to right, it goes from simulation grid, to generation function, to analysis function, to results table

Figure 2 from preprint illustrating simulation workflow. From left to right, it goes from simulation grid, to generation function, to analysis function, to results table

Tidy simulation: Designing robust, reproducible, and scalable Monte Carlo simulations #StatsSky
arxiv.org/abs/2509.11741
It is not formally linked to the {tidyverse}, bit affinity is obvious.
The paper does a solid job in describing the simulation workflow, could be useful for intros to simulation

23.09.2025 09:25 β€” πŸ‘ 9    πŸ” 6    πŸ’¬ 0    πŸ“Œ 0
Sage Journals: Discover world-class research Subscription and open access journals from Sage, the world's leading independent academic publisher.

Excited to finally have my first paper officially published! "How Do Psychology Journals Handle Postpublication Critique?" is now online with AMPPS. Huge thanks to my supervisors @tomhardwicke.bsky.social and @simine.com and co-authors @bethclarke.bsky.social, N Moodie, S Schiavone, and R Thibault ☺️

17.09.2025 23:23 β€” πŸ‘ 42    πŸ” 16    πŸ’¬ 1    πŸ“Œ 3
37Β  Performance – Model to Meaning

The new {marginaleffects} release for #RStats (0.30.0) comes with two new vignettes:

1. Speed up computation with automatic differentiation (often 10x gains) marginaleffects.com/bonus/perfor...

2. Power analyses with {marginaleffects} and {DeclareDesign}. marginaleffects.com/bonus/power....

13.09.2025 18:37 β€” πŸ‘ 145    πŸ” 34    πŸ’¬ 3    πŸ“Œ 3
Post image

Time is running out to register for our pre-symposium workshop and Meta Research Symposium event at Paul Meehl Graduate School
Check the information and registration links below:

paulmeehlschool.github.io/workshops/

10.09.2025 13:53 β€” πŸ‘ 6    πŸ” 6    πŸ’¬ 0    πŸ“Œ 1
Preview
Guidelines for Meta-analyses and Systematic Reviews in Urology Our guideline comprises points addressing the conduct and interpretation of systematic reviews and meta-analyses in urology. Application of the guideline would lead to a more considered interpretation...

This is big! Worked with great statisticians on guidelines for meta-analysis & systematic review. We discuss rationales for systematic review, evaluation & interpretation of heterogeneity, & common errors in network meta-analysis, funnel plots etc. www.europeanurology.com/article/S030...

05.09.2025 14:29 β€” πŸ‘ 21    πŸ” 6    πŸ’¬ 2    πŸ“Œ 0
Preview
INSPECT-SR: a tool for assessing trustworthiness of randomised controlled trials The integrity of evidence synthesis is threatened by problematic randomised controlled trials (RCTs). These are RCTs where there are serious concerns about the trustworthiness of the data or findings....

www.medrxiv.org/content/10.1...

INSPECT-SR: A tool for assessing trustworthiness of randomised controlled trials.

05.09.2025 18:11 β€” πŸ‘ 65    πŸ” 34    πŸ’¬ 3    πŸ“Œ 8
A further problem is illustrated by the authors equating no treatment with placebo. For example, describing their second assumption, they state, β€˜Implicit in this notation is that there is a single version of β€˜no treatment’ that is consistently defined across all subjects in the RCT and external controls’ (p4). However, most clinical trials are add-on trials (Senn, 2002), even if not specifically identified as such. In placebo-controlled trials, one starts with standard of care and then subjects are either allocated to receive in addition the active treatment or a placebo to it. The statistical analysis plan for SUNFISH (F Hoffman-La-Roche Ltd, 2020) has a protocol summary as Appendix 1, which has this to say, β€˜In addition to the study drug treatment, patients may continue to receive concomitant drug medication…’ (p186). This is very standard for clinical trials. It highlights that a key assumption in borrowing control data in this way is that there has been no evolution in the standard of care in the period since the trial.

A further problem is illustrated by the authors equating no treatment with placebo. For example, describing their second assumption, they state, β€˜Implicit in this notation is that there is a single version of β€˜no treatment’ that is consistently defined across all subjects in the RCT and external controls’ (p4). However, most clinical trials are add-on trials (Senn, 2002), even if not specifically identified as such. In placebo-controlled trials, one starts with standard of care and then subjects are either allocated to receive in addition the active treatment or a placebo to it. The statistical analysis plan for SUNFISH (F Hoffman-La-Roche Ltd, 2020) has a protocol summary as Appendix 1, which has this to say, β€˜In addition to the study drug treatment, patients may continue to receive concomitant drug medication…’ (p186). This is very standard for clinical trials. It highlights that a key assumption in borrowing control data in this way is that there has been no evolution in the standard of care in the period since the trial.

One of the most common misunderstandings about the use and value of placebos in clinical RCTs, often made by both methodological experts and experienced trialists:

(from @stephensenn.bsky.social in academic.oup.com/jrsssa/advan...)

05.09.2025 05:52 β€” πŸ‘ 45    πŸ” 15    πŸ’¬ 3    πŸ“Œ 0

Spending 3 full days coding up a simulation for a method that *should* be better, but performs identically to a common R function (that takes about 5 seconds to apply). Absolutely priceless.
#rstats

02.09.2025 15:45 β€” πŸ‘ 15    πŸ” 4    πŸ’¬ 0    πŸ“Œ 1
Post image

I love looking at this graph, showing it to my students, and sharing it on social media, even though it unerringly brings out the trolls.

This is the efficacy curve of Pfizer's mRNA COVID vaccine.

This, people, is what ended the emergency phase of the COVID pandemic. Despite what RFK Jr says.

02.09.2025 03:31 β€” πŸ‘ 1522    πŸ” 525    πŸ’¬ 31    πŸ“Œ 15

It was a rewarding labour of love to work on this paper with a fantastic team of authors, β€œUnderstanding Treatment Response Heterogeneity Using Crossover Randomized Controlled Trials: A Primer for Exercise and Nutrition Scientists”. @hk-ijsnem.bsky.social journals.humankinetics.com/view/journal...

28.08.2025 17:50 β€” πŸ‘ 12    πŸ” 6    πŸ’¬ 2    πŸ“Œ 0
Models as Prediction Machines: How to Convert Confusing Coefficients into Clear Quantities

Abstract
Psychological researchers usually make sense of regression models by interpreting coefficient estimates directly. This works well enough for simple linear models, but is more challenging for more complex models with, for example, categorical variables, interactions, non-linearities, and hierarchical structures. Here, we introduce an alternative approach to making sense of statistical models. The central idea is to abstract away from the mechanics of estimation, and to treat models as β€œcounterfactual prediction machines,” which are subsequently queried to estimate quantities and conduct tests that matter substantively. This workflow is model-agnostic; it can be applied in a consistent fashion to draw causal or descriptive inference from a wide range of models. We illustrate how to implement this workflow with the marginaleffects package, which supports over 100 different classes of models in R and Python, and present two worked examples. These examples show how the workflow can be applied across designs (e.g., observational study, randomized experiment) to answer different research questions (e.g., associations, causal effects, effect heterogeneity) while facing various challenges (e.g., controlling for confounders in a flexible manner, modelling ordinal outcomes, and interpreting non-linear models).

Models as Prediction Machines: How to Convert Confusing Coefficients into Clear Quantities Abstract Psychological researchers usually make sense of regression models by interpreting coefficient estimates directly. This works well enough for simple linear models, but is more challenging for more complex models with, for example, categorical variables, interactions, non-linearities, and hierarchical structures. Here, we introduce an alternative approach to making sense of statistical models. The central idea is to abstract away from the mechanics of estimation, and to treat models as β€œcounterfactual prediction machines,” which are subsequently queried to estimate quantities and conduct tests that matter substantively. This workflow is model-agnostic; it can be applied in a consistent fashion to draw causal or descriptive inference from a wide range of models. We illustrate how to implement this workflow with the marginaleffects package, which supports over 100 different classes of models in R and Python, and present two worked examples. These examples show how the workflow can be applied across designs (e.g., observational study, randomized experiment) to answer different research questions (e.g., associations, causal effects, effect heterogeneity) while facing various challenges (e.g., controlling for confounders in a flexible manner, modelling ordinal outcomes, and interpreting non-linear models).

Figure illustrating model predictions. On the X-axis the predictor, annual gross income in Euro. On the Y-axis the outcome, predicted life satisfaction. A solid line marks the curve of predictions on which individual data points are marked as model-implied outcomes at incomes of interest. Comparing two such predictions gives us a comparison. We can also fit a tangent to the line of predictions, which illustrates the slope at any given point of the curve.

Figure illustrating model predictions. On the X-axis the predictor, annual gross income in Euro. On the Y-axis the outcome, predicted life satisfaction. A solid line marks the curve of predictions on which individual data points are marked as model-implied outcomes at incomes of interest. Comparing two such predictions gives us a comparison. We can also fit a tangent to the line of predictions, which illustrates the slope at any given point of the curve.

A figure illustrating various ways to include age as a predictor in a model. On the x-axis age (predictor), on the y-axis the outcome (model-implied importance of friends, including confidence intervals).

Illustrated are 
1. age as a categorical predictor, resultings in the predictions bouncing around a lot with wide confidence intervals
2. age as a linear predictor, which forces a straight line through the data points that has a very tight confidence band and
3. age splines, which lies somewhere in between as it smoothly follows the data but has more uncertainty than the straight line.

A figure illustrating various ways to include age as a predictor in a model. On the x-axis age (predictor), on the y-axis the outcome (model-implied importance of friends, including confidence intervals). Illustrated are 1. age as a categorical predictor, resultings in the predictions bouncing around a lot with wide confidence intervals 2. age as a linear predictor, which forces a straight line through the data points that has a very tight confidence band and 3. age splines, which lies somewhere in between as it smoothly follows the data but has more uncertainty than the straight line.

Ever stared at a table of regression coefficients & wondered what you're doing with your life?

Very excited to share this gentle introduction to another way of making sense of statistical models (w @vincentab.bsky.social)
Preprint: doi.org/10.31234/osf...
Website: j-rohrer.github.io/marginal-psy...

25.08.2025 11:49 β€” πŸ‘ 942    πŸ” 283    πŸ’¬ 49    πŸ“Œ 19
Post image

Been working on a tutorial on synthetic data for open science for @lmu-osc.bsky.social
A draft version is now up: lmu-osc.github.io/synthetic-da...

It covers model building, evaluating synthetic data utility with density ratio estimation, and disclosure risk.

Feedback is very welcome!

21.08.2025 15:11 β€” πŸ‘ 38    πŸ” 13    πŸ’¬ 3    πŸ“Œ 1
Video thumbnail

Happy to announce ✨quarto-revealjs-editable✨

This fully supersedes the imagemover extension, as I back then didn't realize the potential. You can now also move, resize, change font size and alignment for text in your slides

github.com/EmilHvitfeld...
#quarto #slidecrafting

20.08.2025 17:38 β€” πŸ‘ 119    πŸ” 38    πŸ’¬ 10    πŸ“Œ 8
DSS Instructor Resources

Teaching/learning intro stats and R? #rstats

Explore my teaching materials, including syllabus, lecture slides, exercises, interactive graphs, and self-graded review exercises: ellaudet.github.io/dss_instructor_resources

Instructors using DSS: source files from PUP have just been updated!

20.08.2025 20:17 β€” πŸ‘ 30    πŸ” 9    πŸ’¬ 2    πŸ“Œ 0
Preview
Meta Research Symposium 2025 PMGS PMGS Meta Research Symposium 2025 16-17 October 2025, TU/e Eindhoven Conference website: https://paulmeehlschool.github.io/workshops/ Program Day 1 - Pre-Symposium Mini-Workshop Time Activity…

The full program for the PMGS Meta Research Symposium 2025 is online: docs.google.com/document/d/1... If you are interested in causal inference, systematic review, hypothesis testing, and preregistration, join is October 17th in Eindhoven! Attendance is free!

20.08.2025 14:34 β€” πŸ‘ 21    πŸ” 13    πŸ’¬ 0    πŸ“Œ 3
Preview
Symposium Program Announced | Paul Meehl Graduate School We are pleased to announce that the program for the second Paul Meehl Graduate School Meta-Research Symposium is now available!...

The PMGS Meta-Research Symposium program is out!
πŸ“… Oct 16–17, Eindhoven University of Technology

πŸ§‘β€πŸ« Workshop: Aaron Peikert

🎀 Keynotes: Duygu Uygun-Tunç & Lisa Spitzer

πŸ‘©β€πŸ”¬ Talks by early-career researchers

Check the program + register by Oct 1 πŸ‘‰ paulmeehlschool.github.io/2025-08-17-p...

18.08.2025 09:40 β€” πŸ‘ 6    πŸ” 4    πŸ’¬ 0    πŸ“Œ 0
Post image

For those interested, here is a link to a new power paper:

Hancock, G. R., & Feng, Y. (2026). nmax and the quest to
restore caution, integrity, and practicality to the sample size planning process. Psychological Methods.

yifengquant.github.io/Publications...

19.08.2025 01:04 β€” πŸ‘ 63    πŸ” 24    πŸ’¬ 4    πŸ“Œ 2
Video thumbnail

Excited to share my newest quarto revealjs plugin: imagemover

Easily reposition and resize images directly in your quarto revealjs slides for a much smoother slidecrafting experience

github.com/EmilHvitfeld...
#quarto

13.08.2025 19:20 β€” πŸ‘ 205    πŸ” 51    πŸ’¬ 8    πŸ“Œ 10

A letter from myself and @jdwilko.bsky.social that expands on this a bit more. Thanks to Fertility and Sterility for the opportunity.

doi.org/10.1016/j.fe...

12.08.2025 09:53 β€” πŸ‘ 54    πŸ” 25    πŸ’¬ 2    πŸ“Œ 3

Your intuitions about individual responses to training are probably wrong πŸ˜‰

πŸ‘‡πŸ§΅ 1/11

11.08.2025 10:16 β€” πŸ‘ 5    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0
Post image

New Preprint: Rethinking Type S and M Errors. We argue Type S and M errors are not useful when designing or evaluating studies, and present alternative solutions to address the issues they were supposed to address (minimum effect tests, and correcting for bias with p-uniform). osf.io/preprints/ps...

05.08.2025 14:35 β€” πŸ‘ 20    πŸ” 8    πŸ’¬ 1    πŸ“Œ 2
Post image

Translation: The weighted average of the thing that can't be less than zero was very much significantly different from zero. Science!

23.07.2025 09:11 β€” πŸ‘ 10    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Post image

SOMEONE PLEASE STOP ME

23.07.2025 09:05 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0

@crist14n is following 20 prominent accounts