Carolin Holtermann (@carolin-holtermann) — Bluesky Profile

5 days ago

First Workshop on Evaluating LLMs for Specialized Domains (Eval4SD)

📣 CFP: Eval4SD @ KONVENS 2026, Hamburg (Sept 14–17)

1st workshop on evaluating LLMs for specialized domains. We invite work on benchmarking, replication, and evaluation methodology across fields such as medicine, law, science, finance, and more.

Deadline: Jul 3, 2026, 23:59 CEST
eval4sd.github.io

5 1 0 0

7 months ago

Around the World in 24 Hours: Probing LLM Knowledge of Time and Place Carolin Holtermann, Paul Röttger, Anne Lauscher. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025.

Finally, I will be with @carolin-holtermann.bsky.social and @a-lauscher.bsky.social to present our work on evaluating geotemporal reasoning ability in LLMs. This will be in the Wednesday 1100 poster session:

aclanthology.org/2025.acl-lon...

7 4 1 0

8 months ago

Main Conference Papers:

Centurio: On Drivers of Multilingual Ability of Large Vision-Language Model (authors: G Geigle, F Schneider, C Holtermann, C Biemann, R Timofte, A Lauscher and G Glavas)
LazyReview: A Dataset for Uncovering Lazy Thinking in NLP Peer Reviews (authors: S Purkayastha, Z Li, A Lauscher, L Qu and I Gurevych)
Around the World in 24 Hours: Probing LLM Knowledge of Time and Place (authors: C Holtermann, P Röttger and A Lauscher)

Findings Papers:

GIMMICK: Globally Inclusive Multimodal Multitask Cultural Knowledge Benchmarking (authors: F Schneider, C Holtermann, C Biemann and A Lauscher)
FineCite: A Novel Approach For Fine-Grained Citation Context Analysis (authors: L Jantsch, D Koh, S Yoon, J Lee, A Lauscher and Y Suh)

Workshop on Online Abuse and Harms (WOAH):

Debunking with Dialogue? Exploring AI-Generated Counterspeech to Challenge Conspiracy Theories (authors: M Lisker, C Gottschalk, H Mihaljević)

🧵Excited to share that Data Science Lab Hamburg will be presenting 6 papers at #ACL2025 in Vienna! 🇦🇹 Our team has been working on cutting-edge research in multilingual AI, peer review analysis, and combating online harms. Here's what we're bringing to the conference 👇

7 2 2 0

9 months ago

Call for Papers, Interplay Workshop at COLM: June 23rd - submissions due. July 24th - acceptance notification. October 10th - workshop day.

🚨🚨 Studying the INTERPLAY of LMs' internals and behavior?

Join our
@colmweb.org
workshop on comprehensivly evaluating LMs.

Deadline: June 23rd
CfP: shorturl.at/sBomu
Page: shorturl.at/FT3fX

We're excited to see your insights and methods!!

See you in Montréal 🇨🇦 #nlproc #interpretability

12 9 0 2