What’s a multiverse good for anyway?
Julia M. Rohrer, Jessica Hullman, and Andrew Gelman
Multiverse analysis has become a fairly popular approach, as indicated by the present special issue on the matter. Here, we take one step back and ask why one would conduct a multiverse analysis in the first place. We discuss various ways in which a multiverse may be employed – as a tool for reflection and critique, as a persuasive tool, as a serious inferential tool – as well as potential problems that arise depending on the specific purpose. For example, it fails as a persuasive tool when researchers disagree about which variations should be included in the analysis, and it fails as a serious inferential tool when the included analyses do not target a coherent estimand. Then, we take yet another step back and ask what the multiverse discourse has been good for and whether any broader lessons can be drawn. Ultimately, we conclude that the multiverse does remain a valuable tool; however, we urge against taking it too seriously.
New preprint! So, what's a multiverse analysis good for anyway?>
With @jessicahullman.bsky.social and @statmodeling.bsky.social
juliarohrer.com/wp-content/u...
04.02.2026 10:24 — 👍 173 🔁 52 💬 9 📌 3
Knew it would be Rohrer et al before following the links :)
13.12.2025 09:46 — 👍 3 🔁 0 💬 1 📌 0
But it raises so many questions. Most importantly: who are the"gold standard" agers in the training data that you are comparing to?
17.11.2025 19:23 — 👍 2 🔁 0 💬 0 📌 0
I think the main practical reason to do it is to re-use trained models in new samples. But somewhere along the line this practically gets morphed into "the errors are biologically meaningful" rather than just "some model trained in a different sample predicted this new person's age badly"
17.11.2025 19:20 — 👍 2 🔁 0 💬 1 📌 0
I know a little bit about these types of analyses (not this study specifically)--they are beyond causal salad. They interpret residual errors of a machine learning algorithm (actual age - predicted) as a 'aging acceleration/deceleration'. Literal noise-mining.
17.11.2025 11:16 — 👍 7 🔁 1 💬 1 📌 0
Correlated observation-level random effects
21.10.2025 12:30 — 👍 1 🔁 0 💬 1 📌 0
correlated observation-level random effects
21.10.2025 12:30 — 👍 2 🔁 0 💬 0 📌 0
16.10.2025 17:20 — 👍 0 🔁 0 💬 0 📌 0
The Wisdom of the Orient (Published 1971)
"Your acts of pity and cruelty are absurd, committed with no calm, as if they were Irresistible. Finally, you fear blood more and more. Blood and time.”
www.nytimes.com/1971/03/25/a...
07.10.2025 08:50 — 👍 1 🔁 0 💬 0 📌 0
"This is the law by which the intelligence despises law, and you encourage its violence! You are in love with Intelligence, until it frightens you. For your ideas are terrifying and your hearts are faint." 3/n
07.10.2025 08:50 — 👍 1 🔁 0 💬 1 📌 0
"A man intoxicated on it believes his own thoughts are legal decisions or facts themselves born of the crowd and time. He confuses his quick changes of heart with the imperceptible variation of real forms and enduring beings" 2/n
07.10.2025 08:49 — 👍 0 🔁 0 💬 1 📌 0
"For you, intelligence is not one thing among many. Every day it devours everything. It would like to put an end to a new state of society every morning." 1/n
07.10.2025 08:49 — 👍 1 🔁 0 💬 1 📌 0
Postdoc position open in Zurich -- Prof. Martin Tomasik and I have a joint SNF project on interpretable neural network approaches for large scale, complex item / temporal structure, online learning / cognitive development data.
Please retweet.
tinyurl.com/PostdocGNNSNF
28.05.2025 11:16 — 👍 23 🔁 19 💬 0 📌 1
For the XL voice messagers in her life, my wife listens on 2x speed...
09.06.2025 19:47 — 👍 1 🔁 0 💬 1 📌 0
🚨NEWS: The House is set to vote Monday on H.R. 867, the “IGO Anti-Boycott Act,” which would punish Americans with fines of up to $1 million or prison terms up to 20 years for participating in boycotts of Israel or Israeli settlements that are promoted by international governmental organizations (IGOs), such as the UN or EU.
The bill, sponsored by pro-Israel lawmaker Rep. Mike Lawler, expands U.S. anti-boycott law to target voluntary, values-based political action by U.S. citizens. Its aim is to shield Israel from nonviolent international pressure campaigns such as BDS.
Rights groups say the legislation criminalizes constitutionally protected political expression and is part of a broader push to suppress opposition to Israeli genocide, apartheid, and illegal settlement expansion, under the guise of fighting antisemitism.
I’m not sure I’ve ever seen something so simultaneously absurd and disturbing: the House will vote
Monday on a bill that would punish Americans for participating in boycotts of Israel with fines of up to $1 MILLION or prison terms up to TWENTY YEARS.
03.05.2025 11:46 — 👍 2575 🔁 1232 💬 185 📌 495
If you calculate marginal effects at the level of the ordinal response, then it shouldn't matter whether the effect is captured by the thresholds as opposed to a predictor tho, right?
28.04.2025 13:18 — 👍 3 🔁 0 💬 1 📌 0
Excited to share that I’ve started a new role as Principal Data Scientist with @pymc-labs.bsky.social. I’m working with and learning from an amazing group of people to do applied Bayesian modeling and advance open-source @pymc.io libraries.
05.04.2025 13:35 — 👍 9 🔁 0 💬 1 📌 0
Maybe this is the easiest way to understand it: you are never just adding more data with these analyses. More data implies a more complex model because it adds to the tree structure/history you are modelling. So you can end up with less precision when adding more data.
02.01.2025 13:49 — 👍 0 🔁 0 💬 0 📌 0
Very unsure if this is a similar phenomenon, but I have seen something like this happen when simulating from phylogenetic models, where power can depend on how "tippy vs branchy" the tree. But nobody has an estimand in PCMs so power per se isn't necessarily the right way to think about it
02.01.2025 13:47 — 👍 0 🔁 0 💬 1 📌 0
Full Luxury Bayesian Structural Equation Modeling with brms
OK, here is a very rough draft of a tutorial for #Bayesian #SEM using #brms for #rstats. It needs work, polish, has a lot of questions in it, and I need to add a references section. But, I think a lot of folk will find this useful, so.... jebyrnes.github.io/bayesian_sem... (use issues for comments!)
21.12.2024 19:49 — 👍 226 🔁 60 💬 9 📌 1
Ah, I found what I was looking for! From Imai et al.'s "Unpacking the Black Box of Causality" (2011). This is coming from the angle of two experiments in which you identify A -> B and B -> C and why you cannot infer the average causal mediation effect from that.
06.12.2024 15:24 — 👍 29 🔁 7 💬 4 📌 2
my recommenders are bi-modal since becoming a parent
06.12.2024 14:49 — 👍 0 🔁 0 💬 0 📌 0
@solomonkurz.bsky.social's post is a much better introduction to OLREs, mine had a narrower aim of reminding ppl that trusting the default behavior of any stats software will burn you, even when the defaults are good.
03.12.2024 18:06 — 👍 1 🔁 0 💬 0 📌 0
Not yet. My context is seeking principled way to deal with the spaces between behavior. Often ambiguous whether the dead time between behaviors is a distinct "rest" state or instead just a short pause. Matters a lot for Markov models if A -> B or A -> Rest -> B.
03.12.2024 12:19 — 👍 1 🔁 0 💬 2 📌 0
And was humbled again recently implementing latent multi-state (competing hazards) models in Stan
03.12.2024 11:14 — 👍 0 🔁 0 💬 1 📌 0
Time-to-event analyses taught me more about statistics than any other modelling exercise.
03.12.2024 11:11 — 👍 3 🔁 0 💬 1 📌 0
Our JSS article is out!
And now I get to focus on {marginaleffects} 1.0.0. Stay tuned.
www.jstatsoft.org/article/view...
02.12.2024 04:00 — 👍 380 🔁 113 💬 13 📌 14
Biologist - Ethologist
postdoctoral researcher @University of Tuebingen
studying the communication of BONOBOS
🔊🐵🎙
U.S. Senator, Washington state | Senate Appropriations Vice Chair | Working every day to help people and solve problems
Biological anthropologist | Behavioral endocrinologist | Primate & coyote social lives, oxytocin 🐒🐺🧪
Postdoc @ Utah State | PhD in Biological Anthropology @ Emory
Fieldwork in Costa Rica, DRC, Bolivia 🥾🌲
Human evolution-obsessed anthropology professor, book coming 2027, southern Rhode Islander; https://ecodevoevo.blogspot.com/2025/06/fossil-men-indeed-book-review.html
Cook and food-writer specialising in Chinese cuisine. Latest book 'Invitation to a Banquet'. China food tours https://wildchina.com/?s=Fuchsia%20&tab=tours
phd @ cambridge
social media | psychiatry | anthropology
co-parenting the @cognitations.bsky.social podcast
website: https://tinyurl.com/t-katiyar
Associate Prof in Biological Anthropology, bringing Evolution to Public Health. Director of Education at UCL Anthropology.
Profile: https://profiles.ucl.ac.uk/30051
Research Fellow, University of Leicester, Psychology, Biocultural/Evolutionary Anthropology, kls52@leicester.ac.uk
Surgeon. Farmer. Entrepreneur.
Researcher (OpenAI. Ex: DeepMind, Brain, RWTH Aachen), Gamer, Hacker, Belgian.
Anon feedback: https://admonymous.co/giffmana
📍 Zürich, Suisse 🔗 http://lucasb.eyer.be
Anthropologist. Research and education fellow, UM6P School of Collective Intelligence.
Community organisation and leadership in rural Bolivia and Morocco.
edseab.github.io
Highly regarded Thought Follower.
PhD researcher in Bayesian statistics at TU Dortmund. He/Him.
https://jear2412.github.io
Nigerian. Assistant professor in the Research, Measurement & Statistics program at University of North Texas. Uses Stan a lot. Member @CWA6186 / TSEU
💡 PhD candidate @ Heidelberg University.
🌱 AI for science - simulation-based inference, robust deep learning & cognitive modeling.
Independent Practice @ Govcraft | ex-Principal AWS, Microsoft, Accenture | 30 yrs of nerd cred | 🧠 Learning Machine | 🌮 Enthusiast | Husband, Dad, Cat Whisperer
• Social behavior reseacher
• Animal emotions & empathy
• Combining methods & theory from psychology, biology, and ecology
https://scholar.google.com/citations?user=9ebdkaQAAAAJ&hl=en
Primatologist lost in a Markov chain | benkawam.github.io.
Associate Professor at @durhampsych.bsky.social. I look at how culture influences children's learning, and how learning makes us human.