Juli Nagel

Understanding the Replication Crisis as a Base Rate Fallacy | The British Journal for the Philosophy of Science: Vol 72, No 4 The replication (replicability, reproducibility) crisis in social psychology and clinical medicine arises from the fact that many apparently well-confirmed experimental results are subsequently overtu...

E.g.
www.journals.uchicago.edu/doi/abs/10.1...

(But personally, I think it's not either/or, and even IF base rates were the main explanation, we should STILL fight against questionable research practices.)

Joke aside, we recently discussed in our journal club about how there's no nominal rate of successful replication, i.e., the replication rates we're seeing might be just what to expect. I don't buy that, BUT there's an interesting discussion here about base rates of theories being correct etc. etc.

I think it says a lot about how dominant RStudio is as an IDE that people frequently mistake it for the actual programming language. Sure, many don't even think about the difference between a language and an IDE, but you'd never see someone write "we used Spyder for data analysis" (I hope).

Banana for scale: Gauging trends in academic interest by normalising publication rates to common and innocuous keywords Many academics use yearly publication numbers to quantify academic interest for their research topic. While such visualisations are ubiquitous in grant applications, manuscript introductions, and revi...

Also, I wonder what these data would look like if they were normaized to account for increasing overall publication rates. Here's a banana for scale! 🍌
arxiv.org/abs/2102.06418
@dalmaijer.bsky.social

🖖

I can see past the questionable artistic choices if they can also give me the data normalized by the overall consumption of each food item.

preprint alert 🚨
1/ Can we accurately detect sequential replay in humans using Temporally Delayed Linear Modelling (#TDLM)? In our recent study, we could not find any replay and decided to dig deeper by running a hybrid simulation with surprising results. Link to preprint & details below 👇

Ohhh, thanks for reminding me that I still have this bookmarked! (Have been hesitating to order it, though, because it would increase my pile of shame, i.e., unread books.)

Soooo ... you could potentially set up an automated pipeline on GitHub/GitLab/whatever where you push the bio updates to a repo, and then they get implemented here via some API magic. Would very likely be a massive waste of time, but, hypothetically speaking ...

Rey–Osterrieth complex figure - Wikipedia

If I didn't know the test was designed in the 1940ies, I'd almost say it looks like a drawing of the Rey–Osterrieth complex figure, a test where you have to draw a comple figure (duh!) after memorizing it.

en.wikipedia.org/wiki/Rey%E2%...

It's bonkers that in academic science we spend hours obsessing over the wording of a paper, but often only one person has seen the code that produced the results! 2/N

🚀 Join Us for the Next Mannheim Open Science Meetup! 🚀
🔬 Topic: ARIADNE – A Scientific Navigator to Find Your Way Through the Research Resource Labyrinth
🎙 Speaker: Çağatay Gürsoy, Central Institute of Mental Health
📅 Date & Time: April 30, 2025, 3:00 PM
📍 Location: Register online lnkd.in/exErgJfy

This is so beautiful 😍

🧠🌱 New preprint from the IGOR Sustainability project!

"There is no research on a dead planet"
How can we balance neuroscience, open science, and climate responsibility?

📄 Read our position paper on OSF:
osf.io/preprints/osf/rju75_v1

Science Barometer 2024

Now online: The Science Barometer 2024! It shows long-term trends and makes it clear what citizens think about academic freedom in Germany. Citizens were asked about scenarios that could prevent scientists from speaking freely about their research.
wissenschaft-im-dialog.de/ressourcen/#...
#SciComm

Schöne Grüße an @jensfoell.de !

Shoutout to my co-authors @gordonfeld.bsky.social, @samusander.bsky.social and bluesky-less Susanne Diekelmann. That's right - the first author of the original study helped us to re-assess the results of her study! A really cool team effort.

10/10

So, differences in intrusions and/or general memory performance could explain potential differences between studies. Also, general effects of sleep on memory (or false memories) are definitely smaller than previously reported; large samples are needed to detect those.

9/10

What do we think is going on? Gist abstraction during sleep! When the words the sleep group produces are more associated, participants who produce a lot of correct words will also produce more (semantically related) false memories - that is, if they generate a lot of words (intrusions).

8/10

So, in exploratory analyses, we explicitly modelled the effect of intrusions on false memories. We found that only in the sleep group, higher memory performance is associated with more false memories - but only when intrusions are high.

7/10

Contrary to Diekelmann et al., we find INCREASED false memories when memory performance is high - especially in the sleep group, and especially when looking at intrusion-adjusted memory performance, i.e., taking into account the # of responses that are neither list words nor false memories.

6/10

Participants' memory was tested either after a period of wake (day) or sleep (night). Consistent with Diekelmann et al., we find no effect of sleep on false memory production or veridical memory performance (whether the number of correctly recalled words was adjusted by intrusions or not).

5/10

In an online study, N = 398 participants completed a DRM paradigm: They learned different word lists; all words within a list were associated with a "critical lure" that was never presented. Participants tend to falsely recall this critical lure in later memory tests.

4/10

There might also be moderators, e.g., Diekelmann et al. (2010) found that sleep benefits false memory performance when general memory performance is low. We set out to replicate Diekelmann et al. (2010), following the call for well-powered publications in the field.

3/10

On the other hand, sleep might reduce false memories by improving source memory. The literature on the effect of sleep on false memories has been inconsistent so far. This might be due to small samples sizes (leading to imprecise and likely inflated effect size estimates).

2/10

Check out our preprint "Sleep Links Gist Abstraction to Veridical Memory"!

osf.io/preprints/ps...

Summary 🧵:

Sleep benefits memory and it reorganizes it. It integrates new and pre-existing memories, and extracts gist across episodes. However, extracting gist might generate false memories.

1/10

Noch ein Monat Zeit, um sich auf den WissKomm-Preis zu bewerben! Auch geplante Projekte können gefördert werden, das ist also der perfekte Boost, um mit der WissKomm erstmalig durchzustarten ;-)

Additionally, adding to the confusion: In position_jitterdodge(), inconsistently, the default for jitter_height IS 0!

Best way to find a typo in a paper is to read the draft carefully 100 times, print it, mark it up, submit it, get it accepted, have copy editors review it, read it again, finalize it, get it published, and then proudly share it will all of your close colleagues

Hello? Police? I would like to report a graph crime.