Matthew B. Jané

Congrats on being nominated Edoardo Masset, Hugh Sharma-Waddington, @davidreiley.bsky.social , @cannoncloud.bsky.social , @matthewbjane.bsky.social, & anon. hero.

And thanks for the strong work!

We want your feedback – which evaluations merit the top award, and why?

Total prize pool: $6600

www.unjournal.org/news/unjourn...

Anonymous: coda.io/form/The-Unj...

I think what ultimately will matter in this context is that it needs to be consistent for each study. I see the argument with either the resid SD or the raw within group SD, but I would worry about a meta-analyst mixing and matching them in a meta-analysis

Wanna write a meta-analysis error report? matthewbjane.quarto.pub/meta-analysi...

Update on Error Report #2: The impact of acoustic stimulation during sleep on memory and sleep architecture: A meta-analysis

The article has been retracted by agreement with the journal editor and authors #metascience

When Evidence Synthesis Obscures: A Critique of Meta-Meta-Analyses – Matthew B. Jané Meta-analyses are often seen as the gold standard of evidence synthesis–systematic, quantitative, and rigorous (at least when done well). So it’s no surprise that some researchers have taken things a ...

"Meta-meta-analyses trade precision & rigor for expediency. If your aim is rigor, there’s no substitute for doing the hard work."

Preach!

I once read a #meta-analysis that mistook SE for SD. Since then I am suspicious of all such studies.

Do the hard work!

matthewbjane.github.io/blog-posts/b...

When Evidence Synthesis Obscures: A Critique of Meta-Meta-Analyses – Matthew B. Jané Meta-analyses are often seen as the gold standard of evidence synthesis–systematic, quantitative, and rigorous (at least when done well). So it’s no surprise that some researchers have taken things a ...

This is very nice from @matthewbjane.bsky.social as to why umbrella reviews are basically useless (sorry!), essentially because they compound up the issues with the meta analyses they include. I have the same concerns but articulate them less eloquently. matthewbjane.github.io/blog-posts/b...

No a meta-meta-analysis-analysis

I think my reaction to the first time I saw it was something along the lines of “wait you can just do that?”

I've moaned about meta-analyses of meta-analyses for a while and had several interesting experiences reviewing them... Now I can save time and just send people to Matt's post to explain why not to do them.

Yeah I might do that. Maybe I’ll make it into a pre-print for now

Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses.

Link: matthewbjane.github.io/blog-posts/b...

#stats #metascience

Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses.

Link: matthewbjane.github.io/blog-posts/b...

#stats #metascience

I’ve been hearing it’s good. No spoilers please, still gotta watch it

Most meta-analyses are bad, some are useful

I'm calling for a total and complete shutdown of JAMA Pediatrics until we can figure out what is going on goodscience.substack.com/p/the-resear... I mean, come ON

(#metascience) A good article by @stuartbuck.bsky.social on the Fluoride and IQ meta-analysis: goodscience.substack.com/p/the-resear.... Summarizes some of the points in our forensic review of it (see the forensic review as a pre-print here: osf.io/preprints/os...). Very nice excerpt below:

We tried to. Best we can do for now is submit to meta-psychology and post a pub-peer comment

Nah y’all are right.

When a STALT error messes up your pagination.

Error Report #4: matthewbjane.quarto.pub/meta-analysi...

The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os...
#metascience

What does the pin emoji do?

Error Report #4: matthewbjane.quarto.pub/meta-analysi...

The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os...
#metascience

Don’t do it

Spent the past couple days looking at meta-analyses in body comp literature to get reasonable parameter estimates to use in simulations for a study we're planning and really trying to avoid giving myself a to-do list of meta-analyses that I need to correct/redo 🙃 cc: @matthewbjane.bsky.social

Posts | Noah Greifer Statistical Consultant and Programmer

livefreeordichotomize.com by @lucystats.bsky.social

matthewbjane.github.io/blog.html by @matthewbjane.bsky.social

www.andrewheiss.com/blog/ by the king @andrew.heiss.phd

ngreifer.github.io/blog/ by yours truly (can't resist a self-promotion 😉)

Stats blogs are the best!

Coding RCTs for a meta-analysis…

The meta-analysis on the relationship between Fluoride and IQ by Taylor et al. (2025) that RFK Jr. has cited contains major methodological flaws and data integrity issues that we describe in the following pre-print (submitted to meta-psychology): osf.io/preprints/os...

Another great meta-science contribution by @matthewbjane.bsky.social and others.

This and his re-analysis of the “social media causes harm” meta-analysis are great examples of how we can use science to serve society without necessarily having to be “activists”