Kate Sanders

GitHub - kr-ramesh/synthtexteval: SynthTextEval: A Toolkit for Generating and Evaluating Synthetic Data Across Domains (EMNLP 2025 System Demonstration) SynthTextEval: A Toolkit for Generating and Evaluating Synthetic Data Across Domains (EMNLP 2025 System Demonstration) - kr-ramesh/synthtexteval

🚀 SynthTextEval, our open-source toolkit for generating and evaluating synthetic text data for high-stakes domains, will be featured at EMNLP 2025 as a system demonstration!

GitHub: github.com/kr-ramesh/sy...
Paper 📝: aclanthology.org/2025.emnlp-d...

#EMNLP2025 #EMNLP #SyntheticData

In honor of some new people coming from AI twitter, I finally updated my post to recommend For You over Discover.

A company that believed it was in the verge of AGI or ASI wouldn’t capitulate to the government because it wouldn’t care about government contracts. They would soon BE the economy and the government would soon be capitulating to them.

Astronaut meme: "Wait, it's all perception?" "Always has been"

Keynote spotlight #4: the second day of COLM will close with @ghadfield.bsky.social from JHU talking about human society alignment, and lessons for AI alignment

Congratulations to Alane Suhr '22, a #CornellTech Ph.D. #alumni advised by associate professor Yoav Artzi, for receiving the prestigious 2022 @aaai.org / @acmsigai.bsky.social Doctoral Dissertation Award!

Read more about the award here: aaai.org/about-aaai/a...

@yoavartzi.com

Line chart showing that there's been a rapid escalation in how quickly the world installs a gigawatt of solar power capacity.

Time for the world to install a gigawatt of solar power capacity
2004: A year
2010: ~ a month
2015: ~ a week
Now: A day
ourworldindata.org/data-insight... 🧪

🚨 Urban Stats 28.0.0 🚨

The mapper is now completely redesigned by me and @spudwaffle.bsky.social, allowing for much prettier looking maps and way more customization alongside significantly more options for geographies!

See below for some of the examples of the maps you can create!

Humans Perceive Wrong Narratives from AI Reasoning Texts A new generation of AI models generates step-by-step reasoning text before producing an answer. This text appears to offer a human-readable window into their computation process, and is increasingly r...

When reading AI reasoning text (aka CoT), we (humans) form a narrative about the underlying computation process, which we take as a transparent explanation of model behavior. But what if our narratives are wrong? We measure that and find it usually is.

Now on arXiv: arxiv.org/abs/2508.16599

jackzhang/JBDistill-Bench · Datasets at Hugging Face

Paper: arxiv.org/pdf/2505.22037
🔗 Project page: aka.ms/jailbreak-d...
📊 Dataset: huggingface.co/datasets/ja...

So, what's the future of AI safety benchmarks? Jack's solution is "renewable benchmarks" that allows us to refresh and expand benchmarks with a single click!!
x.com/jackjingyuz...

From Basic Affordances to Symbolic Thought: A Computational Phylogenesis of Biological Intelligence What is it about human brains that allows us to reason symbolically whereas most other animals cannot? There is evidence that dynamic binding, the ability to combine neurons into groups on the fly, is...

In our forthcoming paper, John Hummel and I ask what it would mean for a neural computing architecture such as a brain to implement a symbol system, and the related question of what makes it difficult for them to do so, with an eye toward the differences between humans, animals, and ANNs.

This paper is making the rounds: arxiv.org/abs/2506.21734

A tiny (27M) brain-inspired model trained just on 1000 samples outperforming o3-mini-high on reasoning tasks.

#MLSky 🧠🤖

Interested in large-scale GPU optimization? Interested in how modern neural networks are being deployed to solve classical optimization problems?

Writing a paper on these topics? Submit to the ScaleOPT workshop at NeurIPS!

www.cvxgrp.org/scaleopt/#su...

I'm recruiting MLEs @ #ACL2025!

Reach out if you know folks interested in legal NLP, structured prediction, and full-time at a startup environment in NYC

I'll also always chat about:
• population-level inference on corpora
• broad-coverage semantics
• which café has the best Sachertorte in Vienna

My students and I are presenting three papers on Monday at #ACL2025 and this thread will recap them (including their videos).

“Wikipedia is this economic anomaly. In many ways, it’s sort of magical that people will just volunteer without explicit economic incentives to create artifacts that are meant to share knowledge with everyone in the world”

Taking off for Vienna #ACL2025! 🇦🇹 Excited to talk with people about transparent reasoning, multimodality, and fact verification. Stop by our multimodal RAG workshop on Friday 🔥🔥🔥

Please reach out if you want to grab coffee!

The #ACL2025 #ACL2025NLP feed is up and running! It matches both hashtags and any posts from or mentions of @aclmeeting.bsky.social

Pin it to your home 📌 and enjoy!

bsky.app/profile/did:...

Juxtastat DAU update! Crazy how we've been >1000 every day for over a year now!

Thank you all for all your support, and make sure to keep spreading the word!

🥳 🎉 ❤️ The ACL 2025 Proceedings are live on the ACL Anthology 🥰 !
We’re thrilled to pre-celebrate the incredible research 📚 ✨ that will be presented starting Monday next week in Vienna 🇦🇹 !
Start exploring 👉 aclanthology.org/events/acl-2...
#NLProc #ACL2025NLP #ACLAnthology

This New Yorker piece is the most hopeful I've felt about the world in a long time.

I had no idea solar was booming like this. And if you live in the same world as me, dominated by oil & gas guys maintaining that solar and wind are inefficient gimmicks, you might not've known some of this either.

🔈When LLMs solve tasks with a mid-to-low resource input or target language, their output quality is poor. We know that. But can we put our finger on what breaks inside the LLM? We introduce the 💥 translation barrier hypothesis 💥 for failed multilingual generation with LLMs. arxiv.org/abs/2506.22724

The AI Researcher's Guide to a Non-Boring Bluesky Feed | Naomi Saphra How to migrate to bsky without a boring feed.

I wrote something up for AI people who want to get into bluesky and either couldn't assemble an exciting feed or gave up doomscrolling when their Following feed switched to talking politics 24/7.

Explore Wikipedia through a data map. Pages are grouped by semantic similarity, for topic clusters.
Hover to see details, zoom to explore more fine-grained topics, click to go to a page. Search by page
name to find interesting starting points for exploration.

lmcinnes.github.io/datamapplot_...

William Walden, Kathryn Ricci, Miriam Wanner, Zhengping Jiang, Chandler May, Rongkun Zhou, Benjamin Van Durme
How Grounded is Wikipedia? A Study on Structured Evidential Support
https://arxiv.org/abs/2506.12637

What Is Seen Cannot Be Unseen: The Disruptive Effect of Knowledge Conflict on Large Language Models Large language models frequently rely on both contextual input and parametric knowledge to perform tasks. However, these sources can come into conflict, especially when retrieved documents contradict…

What happens when an LLM is asked to use information that contradicts its knowledge? We explore knowledge conflict in a new preprint📑
TLDR: Performance drops, and this could affect the overall performance of LLMs in model-based evaluation.📑🧵⬇️ 1/8
#NLProc #LLM #AIResearch

Johns Hopkins researchers to highlight work at CVPR 2025 Researchers from the Department of Computer Science will present groundbreaking work at the IEEE/CVF Computer Vision and Pattern Recognition Conference, the premier annual computer vision event.

Learn about the groundbreaking work being presented by JHU researchers at @cvprconference.bsky.social’s #CVPR2025! Check out the full list here www.cs.jhu.edu/news/johns-h... or browse through the thread below! 🧵 (1/14)

We know that speech LID systems flunk on accented speech. But why? And what can we do about it? 🤔
Our work arxiv.org/abs/2506.00628 (Interspeech '25) finds that *accent-language confusion* is an important culprit, ties it to the length of feature that the model relies on, and proposes a fix.

image of nyc

Excited to announce that I'm working on a project at AWS in New York this summer! Reach out if you're in the area and want to grab coffee 😀