Events
ACL 2026 Workshop on Evaluating Evaluations (EvalEval)
This workshop focuses on AI evaluation in practice, centering the tensions and collaborations between model developers and evaluation researchers and aims to surface practical insights from across ...
Chairs: Mubashara Akhtar, Jan Batzner, Leshem Choshen, Avijit Ghosh, Usman Gohar, Jennifer Mickel, Ichhya Pant, Zeerak Talat
FAccT 2026 Tutorial on Every Eval Ever
A FAccT 2026 tutorial walking through Every Eval Ever — a community-governed open source infrastructure unifying evaluation results under a shared metadata schema — and Evaluation Cards, an interpr...
Chairs: Jan Batzner, Sree Harsha Nelaturu, Anastassia Kornilova, Avijit Ghosh, Angelie Kraft, Usman Gohar, Michelle Lin, Yanan Long, Jennifer Mickel, Wm. Matthew Kennedy, Leon Staufer, David Hartmann, Leshem Choshen*, Irene Solaiman*
ACL Shared Task on Every Eval Ever
Help us build the first unifying, open database of LLM evaluation results! Convert evaluation data from leaderboards, papers, or your own runs into a shared format — and join as co-author on the re...
Chairs: Jan Batzner, Sree Harsha Nelaturu, Anastassia Kornilova, Damian Stachura, Stella Biderman, Irene Solaiman, Avijit Ghosh, Leshem Choshen
2025 Workshop on Evaluating AI in Practice
EvalEval, UK AI Security Institute (AISI), and UC San Diego (UCSD) are excited to announce the upcoming Evaluating AI in Practice workshop, happening on December 8, 2025, in San Diego, California.
Chairs: Icchya Pant, Jennifer Mickel
NeurIPS 2024 Workshop on Evaluating Evaluations
"Evaluating Evaluations: Examining Best Practices for Measuring Broader Impacts of Generative AI" was an official workshop at NeurIPS 2024.
Chairs: Avijit Ghosh, Irene Solaiman, Zeerak Talat, Yacine Jernite