Brent W. Roberts

The individual-level precision of implicit measures - Behavior Research Methods Implicit measures are used extensively in psychological science. One fundamental goal of these measures is to provide information diagnostic of an individual’s attitudes or beliefs. After 25 years of ...

Just published in Behavior Research Methods:

The individual-level precision of implicit measures

w/ @ianhussey.mmmdata.io

🧵👇

link.springer.com/article/10.3...

LPa...

Perils of Partialing: Can Scholars Predict Residualized Variables' Nomological Nets? Objective Partialing is a statistical procedure in which the variance shared among two or more constructs is removed, allowing researchers to examine the unique properties of the residualized, parti...

Excited to share a Registered Report in J. of Personality looking at the “perils of partialing” – led by the Bluesky-less Leigha Rose with @drlynam.bsky.social and me. (1)

onlinelibrary.wiley.com/doi/10.1111/...

Mega-multiverses?

If you were doing a history of personality psychology, he would on the "Big Names" list of figures that defined the field (Allport, Murray, Cattell, Block, Gough, Hathaway), albeit his particular take on it which was very biologically focused. James is not wrong. He's bigger than Stapel 2/

He was the author of one of the main personality inventories (en.wikipedia.org/wiki/Eysenck...) at a time when your fame was defined by being the author of a personality inventory. He built a theory around that work and also started a journal, Personality and Individual Differences. 1/

Number of ‘unsafe’ publications by psychologist Hans Eysenck could be ‘high and far reaching’ Hans Eysenck A “high and far reaching” number of papers and books by Hans Eysenck could be “unsafe,” according to an updated statement from King’s College London, where the psychologist was a profe…

Diederik Stapel was a massive watershed moment in psychology.

However, he was -- and let's be slightly glib here -- some guy from The Netherlands who wrote social psychology papers.

The full accounting of the Eysenck case is approx, at minimum, TWO STAPELS.

retractionwatch.com/2025/12/03/n...

Now we wrote a piece about many things we always wanted to say about replications.

How they are used, tracked and valued by the science community. And how we can evaluate their results, whatever those may be 🤔

Read the preprint 📃 osf.io/preprints/me...

Browse the Hub 🌐 forrt.org/replication-...

Early Career Rescue Fellowship | Universität Tübingen Academic freedom is under pressure today. This requires rescue havens of free research. The Freiburg Institute for Advanced Studies (FRIAS), the Tübingen College of Fellows (CoF), and the…

Are you someone "who cannot conduct or continue their work in the USA appropriately because of actual political pressure" and are interested in a two-year, funded post-doctoral fellowship at a German University to do that work? Then check out the link below! #PsychSciSky #AcademicSky #EduSky

Fig. 3. Effects of the intervention. In (a) are shown effects 7 months after the intervention; in (b) are shown interaction effects 7 months after the intervention. Models show the effects of the intervention on expressive-language skills in the grade 1 posttest, with an interaction between expressive-language skills in the pretest and after the intervention. Standardized coefficients (with 95% confidence intervals) are shown, except for the intervention dummy variable and the interaction where y-standardized values are indicated. Rectangles and circles contain observed variables and latent variables, respectively. Solid arrows point to significant regression or factor loadings (arrows from latent variables to their observed indicators); the arrow with dotted lines shows nonsignificant regression. The interaction (Fig. 3b) is illustrated by the arrow from the black circle to expressive language in the posttest. **p < .01.

Fig. 4. Long-term effects of the intervention on expressive-language skills. Model showing the effect of the intervention on expressive-language skills in the grade 4 posttest. Standardized coefficients (with 95% CIs) are shown, except for the intervention dummy variable where y-standardized values (equal to Cohen’s d) are indicated. Rectangles and circles contain observed variables and latent variables, respectively. Solid arrows point to significant regression or factor loadings (arrows from latent variables to their observed indicators); arrows with dotted lines show nonsignificant regression. **p < .01.

Fadeout of cognitive training remains one of the more replicable
findings in psychology in this preregistered study of 300 preschool children. Well-done study with a 4 year follow up. The language gains either faded or the control group caught up.
journals.sagepub.com/doi/full/10....

PCI Webinar series #13 - Simine Vazire - Recognizing and responding to a replication crisis

In case you have missed Simine Vazire's excellent webinar yesterday, here is the link to watch it online: youtu.be/_vb1CNwC3CM Thanks again @simine.com for staying up so late and thanks to the audience for the great questions!

New paper in press at JPSP! An adversarial collaboration focusing on a large-scale test of how strongly implicit racial attitudes predict discriminatory behavior. Pre-print here: osf.io/preprints/ps...

Individual differences in violent extremism - Nature Reviews Psychology In this Review, Obaidi et al. propose that understanding violent extremism requires integration of trait-descriptive models (such as Big Five and HEXACO) with process-oriented frameworks that outline mechanisms in social reactivity, needs and mindsets that make some individuals more at risk for engaging in violent extremism.

A Review in Nature Reviews Psychology proposes that understanding violent extremism needs integration of trait-descriptive models with process-oriented frameworks that outline mechanisms in social reactivity, needs and mindsets that make some people more at risk for engaging in violent extremism. 🧪

On the Value of Just Observing What descriptive research revealed about singles' sexual satisfaction

If descriptive research is supposed to be one cure for the replication crisis, why do reviewers and editors keep downgrading descriptive research for not advancing theory? I explore this (in the context of sex and singlehood) in my latest Substack post. unromanticprof.substack.com/p/on-the-val...

“The articles in AMPPS offer, month in and month out, the invitation to practice aligning your values, intentions, and actions to do less scientific harm and reach for the methodological ceiling”

Grateful to @dsbarra.bsky.social for continuing what @profsimons.bsky.social & co started at AMPPS!

1/2

New open access paper in which we apply the Nyquist-Shannon thereom from signal processing to 2 EMA datasets to figure out the optimal sampling frequency for EMA assessments.

🧪 #psychscisky #statssky

www.cambridge.org/core/journal...

I think that’s basically correct, and the methods are selected for maximizing interest but also for falling into the goldilocks zone of understanding: simple enough so that readers don’t feel entirely overwhelmed, complex enough so that they can’t quite see through and understand the limitations.

Semantic and cognitive tools to aid statistical science: replace confidence and significance by compatibility and surprise - BMC Medical Research Methodology Background Researchers often misinterpret and misrepresent statistical outputs. This abuse has led to a large literature on modification or replacement of testing thresholds and P-values with confiden...

that guy with the panda avi wrote a nice paper out it link.springer.com/article/10.1...

I updated the personality psychology starter pack a bit:
go.bsky.app/TwHBMQi

Congratulations to @simine.com well deserved winner of the Einstein Foundation Individual Award for Promoting Quality in Research 2025 🎉 www.einsteinfoundation.de/en/media/pre...

Any reasonably trained psychometrician would alert you to the fact that you have no outcome, you have no valid decision rule, you lack measurement equivalence and thus any justification for using your measures. I'd like to think they might also point out your moral failings...2/

You mean using half-ass psychometrics to cover their full-ass moral failing. I mean, the irony of going with the "we got to measure things well" argument just kills me. At some level, their instinct is right, but only if they really mean measure things well. 1/

Did they ever consider alternative approaches like simply providing more governmental support for the kids that they flagged instead of traumatizing the parents? I'm assuming all of the answers to these questions are no... 4/

Did they ever bother to do a study of the effect of ripping kids away from their birth parents, or did they just assume they were doing something positive? Did they ever consider that the disparate impact on Greenlanders was racist? 3/

Did they ever show that their concept of parental competence predicted anything of importance in the kids outcomes? Did they even bother to test the measurement equivalence of the tests given the different language and culture? 2/

Wow, just wow. There are so many questions...Did they ever define "parental competence" in a justifiable way or just wing it? Did they ever do a study showing that any part of their assessment could predict their definition of "parental competence"? 1/

New paper with @jzberman.bsky.social finally out!

Are you a US-based PhD student WITHOUT summer funding who is interested in adolescent development, trans youth, and/or gender? Reach out to me about applying to join my lab in Summer 2026 for the VIPS program! psych.princeton.edu/diversity/vi...

This guy’s mad about fake research, and he should be. Research incompetence, research fraud, and the promotion of fraudulent or incompetent work . . . these are not victimless crimes.
statmodeling.stat.columbia.edu/2025/11/19/t...