Yanai Elazar

Thanks! I've actually read it, and I feel like it falls mostly under the "for people who don't know how LLMs work" category, for which it can be super useful! But I'm looking for something else.

Any good tutorials/guides on how to code with LLMs?
What I found so far targeted folks who don't know what they are, mostly setting expectations and saying what LLMs can or cannot do.
I'm beyond that. I'm looking for best practices. Kind of design patterns for vibe coding.

Estimating the Causal Effect of Early ArXiving on Paper Acceptance What is the effect of releasing a preprint of a paper before it is submitted for peer review? No randomized controlled trial has been conducted, so we turn to observational data to answer this questio...

A data point in favor is from an observational data study we performed on the effect of early arxiving (= potentially breaking anonymity) on paper acceptance. We measured very small effects, and perhaps more importantly, no difference in the effect on different groups.
arxiv.org/abs/2306.13891

Call for Applications for the Azrieli International Postdoctoral Fellowship-2026-27 - The Azrieli Foundation

azrielifoundation.org/azrieli-fell...

Interested in interpretability, data attribution, evaluation, and similar topics?
Interested in doing a postdoc with me?
Apply to the prestigious Azrieli program!
Link below 👇

DMs are open (email is good too!)

You had one job!

would you like to have a pop tart?

cool, let's have a chat then!

Detection and Measurement of Syntactic Templates in Generated Text Recent work on evaluating the diversity of text generated by LLMs has focused on word-level features. Here we offer an analysis of syntactic features to characterize general repetition in models, beyo...

and in another work led by @chantalsh.bsky.social we also found a convergence of LLMs to the same patterns (syntactic templates)
arxiv.org/abs/2407.00211

GRADE: Quantifying Sample Diversity in Text-to-Image Models We introduce GRADE, an automatic method for quantifying sample diversity in text-to-image models. Our method leverages the world knowledge embedded in large language models and visual question-answeri...

Cool stuff!
We had a (somewhat) similar investigation in text2image models where we actually found that newer models are becoming even less diverse
arxiv.org/abs/2410.22592

"AI slop" seems to be everywhere, but what exactly makes text feel like "slop"?

In our new work (w/ @tuhinchakr.bsky.social, Diego Garcia-Olano, @byron.bsky.social ) we provide a systematic attempt at measuring AI "slop" in text!

arxiv.org/abs/2509.19163

🧵 (1/7)

I did a QA with Quanta about interpretability and training dynamics! I got to talk about a bunch of research hobby horses and how I got into them.

the transparency is just so bad

lol I was very confused towards the end until i read the title again

The new Tahoe UI is so bad. Everything just looks so blurred...

Call for Applications for the Azrieli International Visiting PhD Fellowship - The Azrieli Foundation The Azrieli International Visiting PhD Fellowship offers outstanding international PhD candidates the opportunity to conduct short-term research in Israel, fostering academic collaboration and strengt...

Interesting opportunity for a research visit through the Azrieli foundation - azrielifoundation.org/azrieli-fell...
Let me know if you're interested!

Organizing a workshop? Checkout our compiled material for organizing one: www.bigpictureworkshop.com/open-workshop

(and hopefully we'll be back for another iteration of the Big Picture next year w/ Allyson Ettinger, @norakassner.bsky.social, @sebruder.bsky.social)

Thank you!!! ☺️

Thank you!! 😊

Thank you Ana!! 😊

Thanks! and so I've heard 😀

Thank you! 😊

I’m excited to share that I'm joining Bar-Ilan University as an assistant professor!

A strange trend I've noticed at #ACL2025 is that people are hesitant to reach out to papers/"academic products" authors.
This is unfortunate for both parties! A simple email can save a lot of time to the sender, but is also one of my favorite kind of email as the receiver!

EPFL NLP Postdoctoral Scholar Posting - Swiss AI LLMs The EPFL Natural Language Processing (NLP) lab is looking to hire a postdoctoral researcher candidate in the area of multilingual LLM design, training, and evaluation. This postdoctoral position is as...

The EPFL NLP lab is looking to hire a postdoctoral researcher on the topic of designing, training, and evaluating multilingual LLMs:

docs.google.com/document/d/1...

Come join our dynamic group in beautiful Lausanne!

Had a really great and fun time with @yanai.bsky.social, Niloofar Mireshghallah, and Reza Shokri discussing memorisation at the @l2m2workshop.bsky.social panel. Thanks to the entire organising team and attendees for making this such a fantastic workshop! #ACL2025

I just wish a particular conversation from the workshop's dinner would be appended to the panel's proceedings

I had a lot of fun contemplating about memorization questions at the @l2m2workshop.bsky.social panel yesterday together with Niloofar Mireshghallah and Reza Shokri, moderated by
@pietrolesci.bsky.social who did a fantastic job!
#ACL2025

I'll present our work w/ @santosh-tyss.bsky.social
@yanai.bsky.social @barbaraplank.bsky.social on LLMs memorization of distributions of political leanings in their pretraining data! Catch us at L2M2 workshop @l2m2workshop.bsky.social #ACL2025 tmrw
📆 Aug 1, 14:00–15:30 📑 arxiv.org/pdf/2502.18282

Ai2 is excited to be at #ACL2025 in Vienna, Austria this week. Come say hello, meet the team, and chat about the future of NLP. See you there! 🤝📚