Read the cookbook: arxiv.org/abs/2510.00368
Join us for weekly seminars on formal language theory, ML, NLP, and more: flannseminars.github.io
03.10.2025 16:24 β π 1 π 2 π¬ 0 π 0
The Transformer Cookbook
We present the transformer cookbook: a collection of techniques for directly encoding algorithms into a transformer's parameters. This work addresses the steep learning curve of such endeavors, a prob...
We present The Transformer Cookbook: a collection of recipes for programming algorithms directly into transformers!
Hungry for an induction head? Craving a Dyck language recognizer? We show you step-by-step how to cook up transformers for these algorithms and many more!
03.10.2025 16:24 β π 5 π 5 π¬ 1 π 0
There is no better way to understand what transformers can do than to get your hands dirty and construct them, weight-by-weight. The Transformer Cookbook provides a guide for anyone aiming to understand the expressive power of transformers on such a formal level.
03.10.2025 16:24 β π 1 π 2 π¬ 1 π 0
Thanks to all the chefs: @ccwatson.bsky.social, @antonxue.bsky.social, @satwik77.bsky.social, @ll4r3n4.bsky.social, @lambdaviking.bsky.social, Emile Dos Santos Ferreira, @anejsvete.bsky.social, @dchiang.bsky.social
03.10.2025 16:24 β π 2 π 2 π¬ 1 π 0
Neural methods haven't taken over as much you'd think, especially in smaller companies that can't afford large-scale data + compute. OpenFST is still used directly in Hybrid DNN-HMM ASR models, and also indirectly, through Pynini, in (Inverse) Text Normalisation, needed for both TTS and ASR
16.08.2025 12:40 β π 1 π 0 π¬ 0 π 0
You might find these useful mirror.aclweb.org/emnlp2014/tu..., borjaballe.github.io/slides/fopss...
06.06.2025 18:56 β π 0 π 0 π¬ 1 π 0
Explainable AI research from the machine learning group of Prof. Klaus-Robert MΓΌller at @tuberlin.bsky.social & @bifold.berlin
Mathematics Sorceror (sensory alchemist) at the Arctangent Transpetroglyphics Algra Laboratory (ATAL), I transflarnx mathematics into living rainbows. http://owen.maresh.info https://github.com/graveolensa
Psoeppe-Tlaxtlal, (an undreamt splendour?)
Interdisciplinary language researcher.
A new research network for scholars, practitioners, writers, activists and other stakeholders working on issues broadly related to the study of language and society, both in Scotland and around the world.
https://lasscotland.wordpress.com/
Postdoctoral researcher @birkbeckpsychology.bsky.social @audioneurolab.bsky.social | speech + sounds + brains π§ cognitive sci, auditory neurosci, brain imaging, language, methods https://mkachlicka.github.io
Searching for the neuronal mechanisms of language | https://ndlab.ch @ INI | computational neuroscience | human intracranial recordings | epilepsy.
PhD student at the University of Buenos Aires studying language processing with eyetracking-pupillometry
https://julietalaurino.quarto.pub/personal-website/
Doctoral researcher. Interested in memory, audition, semantics, predictive coding, spiking networks.
I study how human brains learn to communicate and understand. I am a cognitive neuroscientist and developmental psycholinguist.
https://qlab.sites.northeastern.edu/
Associate Professor, Psycholinguistics, Neuropsychology and Cognitive Neuroscience, Semantic Memory and Language Processing,
Bangor University, Wales.
Associate Editor, Cortex
https://linktr.ee/RichardBinney
β’ Postdoc, Dept of Neurosurgery, UTHealth
β’ Compositionality in neural and artificial systems
Website: https://elliot-murphy.com/
Cognitive neuroscientist at Cambridge University. Assoc Prof at the Department of Psychology; Fellow and Director of Studies at King's College. Interested in language, evolution and bilingualism
Professor of Psychology, researching language and reading, using science to improve children's reading
Phonetics/prosody/linguistics/cogpsy academic in UK & amateur classical pianist πΉ & fountain pen enthusiast ποΈ
Postdoc in Linguistics at National Taiwan University. Iβm studying brain and language (psycholinguistics and neurolinguistics) via eye-tracking, electroencephalography (EEG), and web-based experiments.
π sites.google.com/view/pohengchen
Studying speech using intracranial recordings and EEG. Opinions my own.
Distinguished Professor, Departments of Cognitive Sciences & Language Science, University of California Irvine. Author, Wired for Words: The Neural Architecture of Language (MIT Press, forthcoming).
linguist researching language-cognition interactions and multilingualism; decision-making; linguistic relativity | musician and keen rock n roller | views own
Group Leader @BCBL and Research Fellow @Ikerbasque studying speech and language. Passionate about basic research. Mom and feminist.
https://www.bcbl.eu/en/conocenos/equipo/efthymia-kapnoula
http://effiekapnoula.com/WorkWithMe.html
Linguist (syn-sem-prag interface) β’ gesture & dance in human & non-human primates β’ cross-linguistic diversity β’ evolutionary biology
Professor of Linguistics, University of Oslo π¬π§π³π΄π± PhD Linguistics MIT
Views expressed are mine, repost β endorsement
