We built the openESM database:
▶️60 openly available experience sampling datasets (16K+ participants, 740K+ obs.) in one place
▶️Harmonized (meta-)data, fully open-source software
▶️Filter & search all data, simply download via R/Python
Find out more:
🌐 openesmdata.org
📝 doi.org/10.31234/osf...
22.10.2025 19:34 — 👍 259 🔁 134 💬 14 📌 13
Models as Prediction Machines: How to Convert Confusing Coefficients into Clear Quantities
Abstract
Psychological researchers usually make sense of regression models by interpreting coefficient estimates directly. This works well enough for simple linear models, but is more challenging for more complex models with, for example, categorical variables, interactions, non-linearities, and hierarchical structures. Here, we introduce an alternative approach to making sense of statistical models. The central idea is to abstract away from the mechanics of estimation, and to treat models as “counterfactual prediction machines,” which are subsequently queried to estimate quantities and conduct tests that matter substantively. This workflow is model-agnostic; it can be applied in a consistent fashion to draw causal or descriptive inference from a wide range of models. We illustrate how to implement this workflow with the marginaleffects package, which supports over 100 different classes of models in R and Python, and present two worked examples. These examples show how the workflow can be applied across designs (e.g., observational study, randomized experiment) to answer different research questions (e.g., associations, causal effects, effect heterogeneity) while facing various challenges (e.g., controlling for confounders in a flexible manner, modelling ordinal outcomes, and interpreting non-linear models).
Figure illustrating model predictions. On the X-axis the predictor, annual gross income in Euro. On the Y-axis the outcome, predicted life satisfaction. A solid line marks the curve of predictions on which individual data points are marked as model-implied outcomes at incomes of interest. Comparing two such predictions gives us a comparison. We can also fit a tangent to the line of predictions, which illustrates the slope at any given point of the curve.
A figure illustrating various ways to include age as a predictor in a model. On the x-axis age (predictor), on the y-axis the outcome (model-implied importance of friends, including confidence intervals).
Illustrated are
1. age as a categorical predictor, resultings in the predictions bouncing around a lot with wide confidence intervals
2. age as a linear predictor, which forces a straight line through the data points that has a very tight confidence band and
3. age splines, which lies somewhere in between as it smoothly follows the data but has more uncertainty than the straight line.
Ever stared at a table of regression coefficients & wondered what you're doing with your life?
Very excited to share this gentle introduction to another way of making sense of statistical models (w @vincentab.bsky.social)
Preprint: doi.org/10.31234/osf...
Website: j-rohrer.github.io/marginal-psy...
25.08.2025 11:49 — 👍 953 🔁 282 💬 48 📌 20
OSF
🚨New paper (preprint, accepted at @psychscience.bsky.social journal AMPPS, with @herzog.bsky.social): a tutorial on conformal prediction, a distribution-free method for quantifying the uncertainty of predictions from statistical methods. Short 🧵 below!
osf.io/preprints/ps...
#PsychSciSky
11.09.2025 08:41 — 👍 43 🔁 10 💬 3 📌 2
Cool perspective on depression recurrence
>19,000 observations, n=37 discontinuing anti-depressants
Recurrence in ~1/3rd preceded by early warning signals in affect
journals.sagepub.com/doi/epub/10....
Smit et al. @mahelmich.bsky.social @bringmannlaura.bsky.social @eveliensnippe.bsky.social
14.07.2025 15:13 — 👍 16 🔁 2 💬 1 📌 0
OSF
📣New preprint 📣
@leonieschorrlepp.bsky.social, @domimaciejewski.bsky.social, @bringmannlaura.bsky.social, Mithra Hesselink and I wrote a paper illustrating the value of qualitative methods for checking the validity of your ESM data.
doi.org/10.31219/osf...
28.03.2025 13:55 — 👍 11 🔁 6 💬 1 📌 1
New work in @clinpsychrev: "EMA in psychotherapy research"
EMA:
✅ most used in clin *research*
✅ often to predict symptom changes
✅ rarely implemented to impact therapeutic processes
✅ research needed on actual EMA benefits in *practice*
www.sciencedirect.com/science/arti...
04.03.2025 14:46 — 👍 22 🔁 14 💬 1 📌 1
Measurement Is The New Black -
We are a group of scientists interested in improving the validity of time-series measurement in social sciences.
If you do ESM research, please fill out this Short ESM Survey on open-ended items. 🤓
You can fill it out even if you do not use open-ended items in your own ESM research (will be even shorter 😊) rug.eu.qualtrics.com/jfe/form/SV_...
.
03.03.2025 15:56 — 👍 7 🔁 11 💬 1 📌 0
Thanks for sharing, Daniel! 🙏 glad you enjoyed the paper
19.02.2025 09:08 — 👍 1 🔁 0 💬 0 📌 0
Fascinating study showing affective dynamics as predictors of depression relapse in those discontinuing anti-depressants
@ CPS by Smit, @mahelmich.bsky.social @bringmannlaura.bsky.social Oldehinkel Wichers @eveliensnippe.bsky.social
@psychscience.bsky.social
journals.sagepub.com/doi/epub/10....
18.02.2025 15:25 — 👍 10 🔁 2 💬 1 📌 0
How Accurate & Consistent are Self-Report responses via Visual Analogue Scales (VAS) in Ecological Momentary Assessment & Digital Studies?
Examined in a large EMA study (N = 3,761) w/L. Cloos @bsiepe.bsky.social @marilynpicciri1.bsky.social @eikofried.bsky.social @shirleybwang.bsky.social ... 🧵:
07.02.2025 11:59 — 👍 110 🔁 41 💬 4 📌 6
SAA 2025
Web site created using create-react-app
Exciting news! 🎉 Registration for the 2025 SAA Conference is now OPENED!✨ Join us in the historic city of Leuven from May 26–28 for inspiring symposia, talks, workshops and networking! Don’t miss out—secure your Early Bird spot now! www.saa2025.com #SAA2025 #KULeuven @saa2025leuven.bsky.social
24.01.2025 12:42 — 👍 6 🔁 4 💬 0 📌 0
Our global study on the state of trust in scientists is now out in Nature Human Behaviour! 🥳
With a team of 241 researchers, we surveyed 71,922 people in 68 countries, providing the largest dataset on trust in scientists post-pandemic 👇🧵https://www.nature.com/articles/s41562-024-02090-5
20.01.2025 10:16 — 👍 909 🔁 385 💬 25 📌 52
Emotions are reactions to situations we encounter in daily life. In our new paper in Psych Review (psycnet.apa.org/fulltext/202...; with @oisinryan.bsky.social and @fdabl.bsky.social), we take a first step towards building a generative model for emotion dynamics based on this simple principle 1/4
07.01.2025 09:19 — 👍 101 🔁 40 💬 3 📌 1
Bookmark for all future grants: Use of Promotional Language in Grant Applications and Grant Success: "the percentage of promotional words was positively associated with the probability of receiving funding (NIH grants: odds ratio, 1.51 [95% CI, 1.10-2.11])." jamanetwork.com/journals/jam...
11.12.2024 22:53 — 👍 30 🔁 9 💬 0 📌 1
Social expectations in depression - Nature Reviews Psychology
Expectations of negative social interactions or low interpersonal self-efficacy are common among people with depression. In this Review, Kirchner et al. integrate the cognitive, social and clinical as...
🍾New article out in @natrevpsych.bsky.social🍾:
We review how social expectations form and change in individuals with depression and how they shape the onset, course, and severity of depression. Particular emphasis is on why social expectations persist despite pos info.
www.nature.com/articles/s44...
06.12.2024 07:43 — 👍 47 🔁 19 💬 2 📌 1
APA PsycNet
📊 Key finding: Emotional improvements often precede behavioral changes, which may partly be due to smaller and less frequent behavioral changes. Cognitive shifts tend to align closely with mood changes. 📄 Link to the full paper: psycnet.apa.org/doiLanding?d...
02.12.2024 18:39 — 👍 2 🔁 2 💬 1 📌 0
I’m excited to share that @psypost.bsky.social featured our recent study on the timing of emotional, cognitive, and behavioral improvements during treatment for depression.
Co-authored with:
@mahelmich.bsky.social
@timonelmer.bsky.social
@arnoutcsmit.bsky.social
Wolfgang Lutz & Eva Ceulemans
02.12.2024 18:39 — 👍 18 🔁 10 💬 2 📌 0
🚨New Preprint on Affective Stress Responses in Daily life (N=248) - w/ @vizecolin.bsky.social and @aidangcw.bsky.social! We used high-density sampling after stressful events to closely examine the dynamic affective response following daily hassles by estimating latent microtrajectories. 1/3
18.11.2024 07:36 — 👍 107 🔁 33 💬 8 📌 5
Now that I understand starter packs, I've (re)started one for people interested in all things psychotherapy personalization and optimizing treatments to the individual 😊
Anyone welcome! And consider joining our Person-Centered Treatment and Prevention Collaborative group!
go.bsky.app/FXmURQf
15.11.2024 15:17 — 👍 75 🔁 24 💬 27 📌 1
I’d love to be added! Thanks for putting this together :)
17.11.2024 16:00 — 👍 1 🔁 0 💬 1 📌 0
Oh, I didn't realise it worked like that! Would be happy to share the PDF of course :) can you send me a DM or an email? marhelm @ uio.no
11.11.2024 14:37 — 👍 1 🔁 0 💬 0 📌 0
Thank you! 🙌
09.11.2024 23:20 — 👍 1 🔁 0 💬 0 📌 0
Wowed by the fact that the cover of the new @natrevpsych.bsky.social issue was inspired by our Perspective paper 🤩 read it here: rdcu.be/dWyLO
co-1st @schreudermj.bsky.social @bringmannlaura.bsky.social @harrietteriese.bsky.social @eveliensnippe.bsky.social @arnoutcsmit.bsky.social
09.11.2024 20:46 — 👍 11 🔁 3 💬 2 📌 1
I had a blast spending a whole week working on improving the measurement of intensive longitudinal data with so many smart and kind people. Like a nerdy school trip with friends. Thank you 🙏
@eikofried.bsky.social @bringmannlaura.bsky.social @miguelsilan.bsky.social Josip razum
#LorMITNB
08.11.2024 15:16 — 👍 28 🔁 5 💬 1 📌 2
Hi #LorMITNB forks, this may be useful of you want to follow other participants ; ) go.bsky.app/42Nh8oA
06.11.2024 20:47 — 👍 7 🔁 5 💬 1 📌 0
Amazing to see so many early career folks who care deeply about improving measurement of intensive longitudinal data
#LorMITNB
04.11.2024 14:50 — 👍 22 🔁 6 💬 1 📌 0
Anthropologist - Bayesian modeling - science reform - cat and cooking content too - Director @ MPI for evolutionary anthropology https://www.eva.mpg.de/ecology/staff/richard-mcelreath/
Official account for the Society for Ambulatory Assessment Conference 2025 taking place from May 26-28 in Leuven, Belgium.
SAA official account: @ambulatory-assessment.org
PhD Student at KU Leuven | ESM, Statistics and Data Science enthusiast 🌟
The Society for Psychotherapy Research (SPR) is an international, multidisciplinary scientific association devoted to research on psychotherapy.
https://www.psychotherapyresearch.org/
WOinActie strijdt voor een adequate basisfinanciering van en werkomstandigheden in het WO.
woinactie.blogspot.com
Meta-research & evidence synthesis in clinical psychology
PhD candidate @VUAmsterdam
metapsy.org
Researcher at Cambridge. PhD in evolutionary psychiatry. Explaining neurodiversity, improving methods & stigma. 'Evolving Psychiatry' podcast host.
Postdoc @Dartmouth | Researching how to optimize the use of passive data (e.g., from smartphones & smartwatches) to predict mental health outcomes.
🇨🇦 Distinguished Research Professor at the University of Calgary. Creator of the PROCESS macro for SPSS, SAS, and R. Director of the Canadian Centre for Research Analysis and Methods. afhayes.com haskayne.ucalgary.ca/ccram/academy (he/him) 🇺🇦
Person-centred psychotherapist | PhD Researcher | Impact of menstruation on psychotherapists | Qual & Feminist Research | Clinical Supervisor
Assistant Prof of Clinical Psychology @Tilburg University | FWO Senior Research Fellow @KU Leuven | Clinical Psychologist @PraxisP | Associate Editor @SPPE | Studying all things self-injury for better understanding, prevention, and intervention
Postdoc at Osnabrück University I Licensed Psychotherapist I Psychotherapy Research I Personalized Psychotherapy I EMA I Feedback
Licensed clinical psychologist | PhD candidate | Anxiety disorders | PTSD | CBT | PE | MCT
Norwegian center for violence and traumatic stress studies • University of Oslo
The Experience Sampling Method (ESM) Item Repository is an #OpenScience initiative to increase transparency & quality of ESM measures. Open bank of ESM items for use in research with 3000+ items. www.esmitemrepository.com | https://osf.io/kg376/
The CCP @KU_Leuven led by Prof. Inez Myin -Germeys (@inezgermeys.bsky.social) & Prof. Olivia J. Kirtley (@oliviajkirtley.bsky.social).
Psychotherapy Research; Professor Clinical Psychology and Psychotherapy at Trier University @unitrier.bsky.social
https://www.researchgate.net/profile/Wolfgang-Lutz-3/research
Professor of Clinical Psychology at LMU Munich
https://www.lmu.de/psy/en/persons/contact-page/thomas-ehring-c0f08419.html
Phd | University of Amsterdam | Psychological Methods | Center for Urban Mental Health
Complexity | Urban Mental Health | Formal modelling | Amsterdam Complexity School for Climate Change
Crisis preparedness 🛡️ Complex systems approach to behaviour change science. Resilience 🔀 Antifragility. PhD social psychology by accident.
psychologist & philosopher, assistant prof. clinical psychology @GhentUniversity. Co-organizer of the Too Mad to be True conferences. Interests in psychosis, delusions, phenomenology, mad studies, altered self/reality-experiences.