EvalEval Coalition

This kickoff post lays out: 1) 🔍 Why we need a science of evaluation; 2) 🤝 Our goals for the community; 3) 🛠️ How you can get involved (2/2)

Interested in joining? Check out evalevalai.com

The Science of Evaluations: Workstream Kickoff Post Announcing the launch of a research-driven initiative among a community of researchers to strengthen the science of AI evaluations.

🚨 AI Evals Crisis: Officially kicking off the Eval Science Workstream 🚨

We’re building a shared scientific foundation for evaluating AI systems, one that’s rigorous, open, and grounded in real-world & cross-disciplinary best practices👇 (1/2)

Read our new blog post: tinyurl.com/evalevalai

Join us for the Eval Eval Coalition Social at @facct.bsky.social tomorrow Tuesday June 24th from 4-4:30 pm during the coffee break! We would love to have you join us and we look forward to seeing you there!! #FAccT2025 #EvalEval

We would love to have you join us!! Check out evaleval.github.io for more info and stay tuned for future updates!! #EvalEval #AIEvaluations (3/3)

Our coalition is focused on producing scientifically grounded research outputs, robust deployment infrastructure for broader impact evaluations, and fostering a community of researchers passionate about developing better evaluations 🌎🌍🌏 (2/3)

Introducing the Eval Eval Coalition! ✨
We are a community of researchers dedicated to designing, developing, and deploying better evaluations (1/3)