Eva Vivalt

Since people are still applying to this, I'll leave it open but start to review applications (so early is better, but if you haven't applied yet you still can).

Amazing! This is huge news and so great for JHU.

I'm hiring pre-docs interested in applied microeconomics, especially with AI. Check out the link and apply!

Deadline for the first round of review is tomorrow, Feb. 24. evavivalt.com/2026/02/pre-...

Adding a link to the tool, so you can try it out yourself: earlyreview.ai

Anyway, feedback is always welcome, and get in touch if you have a particular use case. 7/7

An obvious paper someone could write would be to score a large number of plans and see if ambiguity / lack of clarity / missing information was associated with more apparent p-hacking. 6/

Where were plans most likely to fail?

Here is a summary: evavivalt.com/2026/02/a-no... 5/

At the same time, it is EASILY possible to be stricter. In an earlier version, many more registered reports failed. 4/

Some of the pre-analysis plans posted on the registry could have more information on their public webpage in required fields; this screening was only done on the pre-analysis plan attachments. 3/

This is in contrast to the randomly-selected registered reports I tested. Under the same version, almost all registered reports passed. It's a good sanity check: you expect registered reports to be more detailed. 2/

I tested out EarlyReview on a random set of pre-analysis plans posted to the AEA RCT Registry.

All received comments. Hardly any passed all the checks. 1/

I'm looking for a few pre-analysis plans / registered reports to highlight as examples on EarlyReview (with permission).

If interested, DM me. I can provide free credits!

I wouldn't mind doing trials at cost for journal editors.

Weird, I just opened it on a few browsers on my end... maybe it was a traffic hiccup?

EarlyReview Verification for pre-analysis plans and registered reports

Check it out and get your free report here: earlyreview.ai

Looking for more beta testers and collabs - get in touch if you have a special use case. 8/8

Running your plan through EarlyReview ensures a standardized, vetted output - approved by you, the researcher - that can serve as a clean, structured input to downstream tools. 7/

3. Generating clearer inputs for downstream tools

Imagine you're in a world in which LLMs play an increasingly larger role in research. Tools like RegCheck screen for compliance against pre-analysis plans. It may all the more important to ensure that your plans are clearly documented. 6/

2. Screening, if you are a funder / teacher / journal

I tested this on publicly available pre-analysis plans and registered reports.

Most failed at least one check.

If you are evaluating someone's work, wouldn't you like to know that it passed? 5/

As a beta tester writes: "Many of the issues flagged did actually come up as we were writing up the paper and we've had to address them now with the paper prep, so it's pretty clear that having this info upfront could have helped identify those blind spots." 4/

This can help with:

1. Developing complete plans, without ambiguity that you later need to resolve. 3/

Plans that clear all the checks can share a public page documenting that it passed them, which could be provided to funders or referees as a third-party signal. 2/

I've built a new tool!

You can upload your pre-analysis plan or registered report, pre-submission to a registry or journal, and it will screen it for completeness, clarity, and consistency. 1/ 🧵

Hiring a pre-doc! Please circulate in your networks and apply here:

evavivalt.com/2026/02/pre-...

Other site: all Claude Code all the time.
This site: crickets.

Hmm.

I remember visiting New Orleans and hanging out with some people doing research on the coast. There are areas where people know the water's getting close, but they're like "great, in 10 years it will be on my doorstep!" They don't seem to think about year 11. Analogy for AI?

Blatantly lying is a poor strategy when people are not that stupid.

I was into crypto arbitrage in its heyday. I remember the crunch for time, when every minute felt (and was) insanely valuable.

The current moment, with Claude Code etc., feels like that.

DHS Warns Any Action By Americans Will Be Treated As Domestic Terrorism

DHS Warns Any Action By Americans Will Be Treated As Domestic Terrorism https://theonion.com/dhs-warns-any-action-by-americans-will-be-treated-as-domestic-terrorism/

Federal obstruction like this is a threat to the rule of law and our basic rights as citizens.

It cannot be that immigration officers kill citizens and the federal government then blocks investigation.

This is the clearest video analysis, lining up the different videos. The guy's feet are clear, he leans over.