Interspeech paper title: What do self-supervised speech models know about Dutch? Analyzing advantages of language-specific pre-training
Authors: Marianne de Heer Kloots, Hosein Mohebbi, Charlotte Pouw, Gaofei Shen, Willem Zuidema, Martijn Bentum
✨ Do self-supervised speech models learn to encode language-specific linguistic features from their training data, or only more language-general acoustic correlates?
At #Interspeech2025 we presented our new Wav2Vec2-NL model and SSL-NL evaluation dataset to test this!
📄 arxiv.org/abs/2506.00981
⬇️
27.08.2025 14:31 — 👍 19 🔁 6 💬 1 📌 0
Had such a great time presenting our tutorial on Interpretability Techniques for Speech Models at #Interspeech2025! 🔍
For anyone looking for an introduction to the topic, we've now uploaded all materials to the website: interpretingdl.github.io/speech-inter...
19.08.2025 21:23 — 👍 40 🔁 14 💬 2 📌 1
YouTube video by Hosein Mohebbi
Posthoc Disentanglement of Textual and Acoustic Features in Self-Supervised Speech Encoders | AIW'25
Sadly, I couldn't make #ICML2025 in person to present our work at the exciting Actionable Interpretability Workshop @actinterp.bsky.social.
📺The recording is online: www.youtube.com/watch?v=QkDF...
+ Poster (on the workshop's website)
👋Check it out and feel free to get in touch for any questions!
17.07.2025 13:52 — 👍 1 🔁 0 💬 0 📌 0
📢 In our #Interspeech2025 tutorial, we'll provide a structured overview of interpretability methods, their applications, challenges, and limitations when applied to spoken language models.
➕ hands-on experience
interspeech2025.org/tutorials
13.06.2025 13:58 — 👍 5 🔁 0 💬 0 📌 0
Have you already found #BlackboxNLP on Bluesky?🎉
15.05.2025 18:41 — 👍 5 🔁 0 💬 0 📌 0
🎉 Our Actionable Interpretability workshop has been accepted to #ICML2025! 🎉
> Follow @actinterp.bsky.social
> Website actionable-interpretability.github.io
@talhaklay.bsky.social @anja.re @mariusmosbach.bsky.social @sarah-nlp.bsky.social @iftenney.bsky.social
Paper submission deadline: May 9th!
31.03.2025 16:59 — 👍 43 🔁 16 💬 3 📌 3
My PhD thesis is now available online! It is called "Finding Structure in Language Models" and presents the work I have done in the past 4 years on the intersection of NLP, interpretability, and linguistics.
I'll defend it on December 10, streamed here: jumelet.ai/phd
arxiv.org/abs/2411.16433
🧵
29.11.2024 15:49 — 👍 115 🔁 14 💬 8 📌 3
The sec. background in (aclanthology.org/2023.emnlp-m...) explains how representations are made in the encoder/decoder of speech transformers.
27.11.2024 08:02 — 👍 1 🔁 0 💬 0 📌 0
🙋🏻♂️
23.11.2024 23:16 — 👍 1 🔁 0 💬 0 📌 0
Phonologist | asst. prof @ University of Southern California Linguistics | previously: postdoc @ MIT Brain & Cognitive Sciences, PhD @ UCLA Linguistics | theory 🔁 experiments 🔁 (Bayesian) models | 🌈 he | cbreiss.com
Working on dynamic signs and signals in communication at Tilburg University at the Department of Computational Cognitive Science. Interested in language & movement science, complex systems & 4E, Open Science (envisionbox.org) & other things (wimpouw.com)
Professor @SapienzaRoma - Comparative psychology, music neuroscience & bioacoustics. Works on rhythm/sync/speech/communication across species (humans, primates, marine mammals, etc.)
Master's student @ltiatcmu.bsky.social, working on speech AI at @shinjiw.bsky.social
PhD student at ILLC - University of Amsterdam 🌷
Interested in linguistics and interpretability.
PhD candidate in Trustworthy and Responsible NLP @ Technical University of Munich (TUM)
PhD student in Speech and Hearing at Harvard/MIT. Building ANNs to study how humans perceive/produce speech and voice.
Working with @joshhmcdermott.bsky.social
https://gasserelbanna.github.io/
MSc. at EPFL
BSc. at Cairo University
ex Logitech and IDIAP
Associate Professor and Computational Linguist @ University of Augsburg, Germany
Master student at Saarland university
Assistant professor of computer science at Technion; visiting scholar at @KempnerInst 2025-2026
https://belinkov.com/
The largest workshop on analysing and interpreting neural networks for NLP.
BlackboxNLP will be held at EMNLP 2025 in Suzhou, China
blackboxnlp.github.io
PhD student, NLP Researcher at @cislmu.bsky.social | Prev. Intern @Adobe.com
NLP Graduate Researcher at The University of Tehran #NLProc
#NLP Postdoc at Mila - Quebec AI Institute & McGill University
mariusmosbach.com
Computational linguist trying to understand how humans and computers learn and use language 👶🧠🗣️🖥️💬
The work is mysterious and important. See https://bbunzeck.github.io
PhDing at @clausebielefeld.bsky.social
Associate Professor at GroNLP ( @gronlp.bsky.social ) #NLP | Multilingualism | Interpretability | Language Learning in Humans vs NeuralNets | Mum^2
Head of the InClow research group: https://inclow-lm.github.io/
Postdoctoral researcher at the Institute for Logic, Language and Computation at the University of Amsterdam.
Previously PhD Student at NLPNorth at the IT University of Copenhagen, with internships at AWS, Parameter Lab, Pacmed.
dennisulmer.eu
PhD student in NLP, focusing on low-resource translation with LLMs.
University of Amsterdam
Postdoc at MIT BCS, interested in language(s) in humans and LMs
https://andrea-de-varda.github.io/
