Data Colada

Colada[128] The Best Audit Study and its interesting shortcoming
datacolada.org/128

23.06.2025 14:15 — 👍 13    🔁 8    💬 0    📌 0

Don't assume, plot
datacolada.org/126

02.06.2025 15:37 — 👍 34    🔁 13    💬 1    📌 2

[125] "Complexity" 2: Don't be mean to the median - Data Colada In Colada[124] I summarized a co-authored critique (with Banki, Walatka and Wu) of a recent AER paper that proposed risk preferences reflect 'complexity' rather than preferences a-la Prospect Theory. ...

If you saw this
3% of valuations within $1 of mean
58% of valuations within $1 of median

Which would be more representative of the data:
the mean or the median?

datacolada.org/125?ab=1

02.04.2025 11:06 — 👍 5    🔁 5    💬 0    📌 0

[124] "Complexity": 75% of participants missed comprehension questions in AER paper critiquing Prospect Theory - Data Colada Kahneman and Tversky’s (1979) “Prospect Theory” article is the most cited paper in the history of economics, and it won Kahneman the Nobel Prize in 2002. Among other things, it predicts that people ar...

Measurement error, Nobel Prize winning research, friendly disagreements, and more....
datacolada.org/124

14.03.2025 13:27 — 👍 19    🔁 10    💬 1    📌 1

[123] Dear Political Scientists: The binning estimator violates ceteris paribus - Data Colada This post delves into a disagreement I have with three prominent political scientists, Jens Hainmueller, Jonathan Mummolo, and Yiqing Xu (HMX), on a fundamental methodological question: how to analyze...

Delving into a disagreement with prominent political scientists on a fundamental data-analysis question: what do you want to learn from a regression interaction?
datacolada.org/123

05.03.2025 12:48 — 👍 19    🔁 7    💬 1    📌 0

[122] Arresting Flexibility: A QJE field experiment on police behavior with about 40 outcome variables - Data Colada A forthcoming paper in the Quarterly Journal of Economics (QJE), "A Cognitive View of Policing" (htm), reports results from a field experiment showing that teaching police officers to "consider differ...

Did a police training improve officers' behavior during arrests?

A forthcoming QJE paper with a flexible pre-registration and key p-values of p=.048 & p=.051 says yes.

datacolada.org/122

07.01.2025 16:24 — 👍 46    🔁 19    💬 1    📌 4

[121] Dear Political Scientists: Don't Bin, GAM Instead - Data Colada There is a 2019 paper, in the journal Political Analysis (htm), with over 1000 Google cites, titled "How Much Should We Trust Estimates from Multiplicative Interaction Models? Simple Tools to Improve ...

A popular tool in political science for dealing with nonlinearities in invalidated by...
...nonlinearities.

datacolada.org/121

03.12.2024 18:40 — 👍 75    🔁 20    💬 5    📌 6

[120] Off-Label Smirnov: How Many Subjects Show an Effect in Between-Subjects Experiments? - Data Colada There is a classic statistical test known as the Kolmogorov-Smirnov (KS) test (Wikipedia). This post is about an off-label use of the KS-test that I don’t think people know about (not even Kolmogorov ...

Want to know how many people show an effect in a between-subjects study? Consider this off-label use of the Kolmogorov-Smirnov test

datacolada.org/120

16.09.2024 13:10 — 👍 29    🔁 7    💬 3    📌 3

[119] A Hidden Confound in a Psych Methods Pre‑registrations Critique - Data Colada A forthcoming paper in Psych Methods (.pdf) had a set of coders evaluate 300 pre-registrations in terms of how informative they were about several study attributes (e.g., hypotheses, analysis, DVs). T...

Hidden Confound in Pre-Registrations Critique
datacolada.org/119

Post ends with link to submit suggestions for AsPredicted & OSF

02.09.2024 12:07 — 👍 15    🔁 7    💬 0    📌 1

The fake data were coming from inside the lab
datacolada.org/117

12.06.2024 11:35 — 👍 50    🔁 14    💬 1    📌 7

Barplot showing that 30%, 35% 58% and 44% of papers in JCR, JEPG, JPSP and Psych Science have pre-registrations, half of them at AsPredicted

Colada[115] shows the prevalence of pre-registrations in papers published in 2022, with lessons to improve in 2023+
datacolada.org/115

13.11.2023 13:32 — 👍 22    🔁 10    💬 2    📌 4

Hello world

11.10.2023 01:44 — 👍 82    🔁 24    💬 2    📌 1