Alex van Meegen's Avatar

Alex van Meegen

@avm.bsky.social

Theory of Neural Networks (how the heck do they work?) | Postdoc @EPFL, prev. Swartz Fellow @Harvard and PhD @FZJuelich | https://alexvanmeegen.github.io | Background art by https://bettina-hachmann.de

310 Followers  |  436 Following  |  6 Posts  |  Joined: 25.09.2023  |  1.9153

Latest posts by avm.bsky.social on Bluesky

Home | Neuroscience | World Wide Theoretical Neuroscience Seminar WWTNS is a weekly digital seminar on Zoom targeting the theoretical neuroscience community. Its aim is to be a platform to exchange ideas among theoreticians.

Excited to be giving the van Vreeswijk Theoretical Neuroscience Seminar this Wednesday, Jan 14, where I'll talk about "Computation Through Neuronal-Synaptic Dynamics"!
www.wwtns.online

10.01.2026 19:45 โ€” ๐Ÿ‘ 31    ๐Ÿ” 5    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Our paper on data constrained RNN that generalize to optogenetic perturbations now citable on eLife:
doi.org/10.7554/eLif...

18.12.2025 23:07 โ€” ๐Ÿ‘ 42    ๐Ÿ” 18    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 2
Preview
A theory of multi-task computation and task selection Neural activity during the performance of a stereotyped behavioral task is often described as low-dimensional, occupying only a limited region in the space of all firing-rate patterns. This region has...

1/X Excited to present this preprint on multi-tasking, with
@david-g-clark.bsky.social and Ashok Litwin-Kumar! Timely too, as โ€œlow-D manifoldโ€ has been trending again. (If you read thru the end, we escape Flatland and return to the glorious high-D world we deserve.) www.biorxiv.org/content/10.6...

15.12.2025 19:41 โ€” ๐Ÿ‘ 83    ๐Ÿ” 20    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 2
Post image

๐ŸงตExcited to present our latest work at #Neurips25! Together with @avm.bsky.social, we discover ๐œ๐ก๐š๐ง๐ง๐ž๐ฅ๐ฌ ๐ญ๐จ ๐ข๐ง๐Ÿ๐ข๐ง๐ข๐ญ๐ฒ: regions in neural networks loss landscapes where parameters diverge to infinity (in regression settings!)

We find that MLPs in these channels can take derivatives and compute GLUs ๐Ÿคฏ

04.12.2025 17:26 โ€” ๐Ÿ‘ 14    ๐Ÿ” 6    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 0
Post image

Finally got the job adโ€”looking for 2 PhD students to start spring next year:

www.gao-unit.com/join-us/

If comp neuro, ML, and AI4Neuro is your thing, or you just nerd out over brain recordings, apply!

I'm at neurips. DM me here / on the conference app or email if you want to meet ๐Ÿ–๏ธ๐ŸŒฎ

03.12.2025 09:36 โ€” ๐Ÿ‘ 81    ๐Ÿ” 51    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 5
Preview
Different learning algorithms achieve shared optimal outcomes in humans, rats, and mice Animals must exploit environmental regularities to make adaptive decisions, yet the learning algorithms that enabels this flexibility remain unclear. A central question across neuroscience, cognitive science, and machine learning, is whether learning relies on generative or discriminative strategies. Generative learners build internal models the sensory world itself, capturing its statistical structure; discriminative learners map stimuli directly onto choices, ignoring input statistics. These strategies rely on fundamentally different internal representations and entail distinct computational trade-offs: generative learning supports flexible generalisation and transfer, whereas discriminative learning is efficient but task-specific. We compared humans, rats, and mice performing the same auditory categorisation task, where category boundaries and rewards were fixed but sensory statistics varied. All species adapted their behaviour near-optimally, consistent with a normative observer constrained by sensory and decision noise. Yet their underlying algorithms diverged: humans predominantly relied on generative representations, mice on discriminative boundary-tracking, and rats spanned both regimes. Crucially, end-point performance concealed these differences, only learning trajectories and trial-to-trial updates revealed the divergence. These results show that similar near-optimal behaviour can mask fundamentally different internal representations, establishing a comparative framework for uncovering the hidden strategies that support statistical learning. ### Competing Interest Statement The authors have declared no competing interest. Wellcome Trust, https://ror.org/029chgv08, 219880/Z/19/Z, 225438/Z/22/Z, 219627/Z/19/Z Gatsby Charitable Foundation, GAT3755 UK Research and Innovation, https://ror.org/001aqnf71, EP/Z000599/1

paper๐Ÿšจ
When we learn a category, do we learn the structure of the world, or just where to draw the line? In a cross-species study, we show that humans, rats & mice adapt optimally to changing sensory statistics, yet rely on fundamentally different learning algorithms.
www.biorxiv.org/content/10.1...

17.11.2025 19:18 โ€” ๐Ÿ‘ 79    ๐Ÿ” 19    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 1
Preview
Prediction of neural activity in connectome-constrained recurrent networks - Nature Neuroscience The authors show that connectome datasets alone are generally not sufficient to predict neural activity. However, pairing connectivity information with neural recordings can produce accurate predictio...

Connectome datasets alone are generally not sufficient to predict neural activity. However, pairing connectivity information with neural recordings can produce accurate predictions of activity in unrecorded neurons

www.nature.com/articles/s41...

10.11.2025 22:12 โ€” ๐Ÿ‘ 45    ๐Ÿ” 11    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 1

This was a lot of fun! From my side, it started with a technical Q: what's the relation between two-side cavity and path integrals? Turns out it's a fluctuation correction - and amazingly, this also enable the "O(N) rank" theory by @david-g-clark.bsky.social and @omarschall.bsky.social. ๐Ÿคฏ

05.11.2025 09:15 โ€” ๐Ÿ‘ 12    ๐Ÿ” 3    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

First paper from the lab!
We propose a model that separates estimation of odor concentration and presence and map it on olfactory bulb circuits
Led by @chenjiang01.bsky.social and @mattyizhenghe.bsky.social joint work with @jzv.bsky.social and with @neurovenki.bsky.social @cpehlevan.bsky.social

04.11.2025 15:40 โ€” ๐Ÿ‘ 36    ๐Ÿ” 13    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 1
Post image

Applying to do a postdoc or PhD in theoretical ML or neuroscience this year? Consider joining my group (starting next Fall) at UT Austin!
POD Postdoc: oden.utexas.edu/programs-and... CSEM PhD: oden.utexas.edu/academics/pr...

23.10.2025 21:36 โ€” ๐Ÿ‘ 33    ๐Ÿ” 11    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

A study led by Cina Aghamohammadi is now out in โ€ช@natcomms.nature.comโ€ฌ! We developed a mathematical framework for partitioning spiking variability, which revealed that spiking irregularity is nearly invariant for each neuron and decreases along the cortical hierarchy.
www.nature.com/articles/s41...

12.10.2025 00:42 โ€” ๐Ÿ‘ 71    ๐Ÿ” 24    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

๐ŸŽ‰ "High-dimensional neuronal activity from low-dimensional latent dynamics: a solvable model" will be presented as an oral at #NeurIPS2025 ๐ŸŽ‰

Feeling very grateful that reviewers and chairs appreciated concise mathematical explanations, in this age of big models.

www.biorxiv.org/content/10.1...
1/2

19.09.2025 08:01 โ€” ๐Ÿ‘ 110    ๐Ÿ” 23    ๐Ÿ’ฌ 4    ๐Ÿ“Œ 4

Lab members are at the Bernstein conference @bernsteinneuro.bsky.social with 9 posters! Hereโ€™s the list:

TUESDAY 16:30 โ€“ 18:00

P1 62 โ€œMeasuring and controlling solution degeneracy across task-trained recurrent neural networksโ€ by @flavioh.bsky.social

30.09.2025 09:29 โ€” ๐Ÿ‘ 9    ๐Ÿ” 3    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Awesome. Congratulations!!

24.09.2025 10:45 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Check out our new preprint where we analyzed the dynamics of over ten thousand neurons across 223 brain areas and found a surprising universal principle that describes the organization of intrinsic timescales across the entire mouse brain, including subcortical structures!
#neuroskyence

03.09.2025 06:52 โ€” ๐Ÿ‘ 36    ๐Ÿ” 5    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Frontiers | Summary statistics of learning link changing neural representations to behavior How can we make sense of large-scale recordings of neural activity across learning? Theories of neural network learning with their origins in statistical phy...

Since I'm back on BlueSky - with @frostedblakess.bsky.social and @cpehlevan.bsky.social we wrote a brief perspective on how ideas about summary statistics from the statistical physics of learning could potentially help inform neural data analysis... (1/2)

04.09.2025 18:30 โ€” ๐Ÿ‘ 34    ๐Ÿ” 10    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Preview
Convergent motifs of early olfactory processing are recapitulated by layer-wise efficient coding The architecture of early olfactory processing is a striking example of convergent evolution. Typically, a panel of broadly tuned receptors is selectively expressed in sensory neurons (each neuron exp...

Excited to share new computational work, led by @jzv.bsky.social, driven by Juan Carlos Fernandez del Castillo + contribution from Farhad Pashakanloo. We recover 3 core motifs in the olfactory system of evolutionarily distant animals using a biophysically-grounded model + efficient coding ideas!

04.09.2025 16:51 โ€” ๐Ÿ‘ 24    ๐Ÿ” 12    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 1
Preview
Associative synaptic plasticity creates dynamic persistent activity In biological neural circuits, the dynamics of neurons and synapses are tightly coupled. We study the consequences of this coupling and show that it enables a novel form of working memory. In recurren...

(1/26) Excited to share a new preprint led by grad student Albert Wakhloo, with me and Larry Abbott: "Associative synaptic plasticity creates dynamic persistent activity."
www.biorxiv.org/content/10.1...

25.08.2025 17:17 โ€” ๐Ÿ‘ 37    ๐Ÿ” 9    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Theoretical neuroscience has room to grow Nature Reviews Neuroscience - The goal of theoretical neuroscience is to uncover principles of neural computation through careful design and interpretation of mathematical models. Here, I examine...

I wrote a Comment on neurotheory, and now you can read it!

Some thoughts on where neurotheory has and has not taken root within the neuroscience community, how it has shaped those subfields, and where we theorists might look next for fresh adventures.

www.nature.com/articles/s41...

20.08.2025 16:09 โ€” ๐Ÿ‘ 151    ๐Ÿ” 52    ๐Ÿ’ฌ 8    ๐Ÿ“Œ 3
Preview
Connectivity structure and dynamics of nonlinear recurrent neural networks Studies of the dynamics of nonlinear recurrent neural networks often assume independent and identically distributed couplings, but large-scale connectomics data indicate that biological neural circuit...

Wanted to share a new version (much cleaner!) of a preprint on how connectivity structure shapes collective dynamics in nonlinear RNNs. Neural circuits have highly non-iid connectivity (e.g., rapidly decaying singular values, structured singular-vector overlaps), unlike classical random RNN models.

19.08.2025 15:42 โ€” ๐Ÿ‘ 40    ๐Ÿ” 9    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Preview
Differential kinematic coding in sensorimotor striatum across behavioral domains reflects different contributions to movement - Nature Neuroscience Hardcastle and Marshall et al. show that striatal function is domain specific, required for task-related but not spontaneously expressed movements. This functional distinction is reflected in starkly ...

Excited to announce that my first postdoc paper is now online!

Links:
www.nature.com/articles/s41...
rdcu.be/eAcN7

In it, we examine the perennial question: what changes in the brain when learning a new motor skill?

Read more below to find out ๐Ÿ‘‡

12.08.2025 18:26 โ€” ๐Ÿ‘ 144    ๐Ÿ” 35    ๐Ÿ’ฌ 9    ๐Ÿ“Œ 1
Post image

Coming March 17, 2026!
Just got my advance copy of Emergence โ€” a memoir about growing up in group homes and somehow ending up in neuroscience and AI. Itโ€™s personal, itโ€™s scientific, and itโ€™s been a wild thing to write. Grateful and excited to share it soon.

04.08.2025 16:21 โ€” ๐Ÿ‘ 184    ๐Ÿ” 37    ๐Ÿ’ฌ 8    ๐Ÿ“Œ 0

Congratulations!!

01.08.2025 07:17 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Studiengang Physik interdisziplinรคr - Georg-August-Universitรคt Gรถttingen Webseiten der Georg-August-Universitรคt Gรถttingen

Physik studieren? Oder ein anderes Fach?

In Gรถttingen geht jetzt beides, mit dem "Bachelor Interdisziplinรคr", der Physik mit spannenden Disziplinen Eurer Wahl, wie z.B. Kรผnstlicher Intelligenz, Philosophie, Neurowissenschaften, ... kombiniert.

www.uni-goettingen.de/de/studium/6...

19.07.2025 05:30 โ€” ๐Ÿ‘ 21    ๐Ÿ” 10    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Out today in @nature.com: we show that individual neurons have diverse tuning to a decision variable computed by the entire population, revealing a unifying geometric principle for the encoding of sensory and dynamic cognitive variables.
www.nature.com/articles/s41...

25.06.2025 22:38 โ€” ๐Ÿ‘ 206    ๐Ÿ” 52    ๐Ÿ’ฌ 5    ๐Ÿ“Œ 4
Preview
Structure of activity in multiregion recurrent neural networks | PNAS Neural circuits comprise multiple interconnected regions, each with complex dynamics. The interplay between local and global activity is thought to...

(1/23) In addition to the new Lady Gaga album "Mayhem," my paper with Manuel Beiran, "Structure of activity in multiregion recurrent neural networks," has been published today.

PNAS link: www.pnas.org/doi/10.1073/...

(see dclark.io for PDF)

An explainer thread...

07.03.2025 19:39 โ€” ๐Ÿ‘ 87    ๐Ÿ” 18    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 0

Interested in high-dim chaotic networks? Ever wondered about the structure of their state space? @jakobstubenrauch.bsky.social has answers - from a separation of fixed points and dynamics onto distinct shells to a shared lower-dim manifold and linear prediction of dynamics.

10.06.2025 19:45 โ€” ๐Ÿ‘ 13    ๐Ÿ” 2    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Our new preprint ๐Ÿ‘€

09.06.2025 19:32 โ€” ๐Ÿ‘ 31    ๐Ÿ” 6    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Emergence of Robust Memory Manifolds Frozen stabilization enables small unstructured neural networks to form robust continuous memories and exhibit separation of timescales without fine-tuning or symmetries.

Our work on how continuous attractors emerge in unstructured RNNs is now out in PRX Life #PRXLife :
journals.aps.org/prxlife/abst...

Work done with @tankutcan.bsky.social

@sesamedusa.bsky.social

06.05.2025 22:40 โ€” ๐Ÿ‘ 25    ๐Ÿ” 6    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I'll be presenting this at #cosyne2025 (poster 3-50)!

I'll also be giving a talk at the "Collectively Emerged Timescales" workshop on this work, plus other projects on emergent dynamics in neural circuits.

Looking forward to seeing everyone in ๐Ÿ‡จ๐Ÿ‡ฆ!

26.03.2025 18:54 โ€” ๐Ÿ‘ 12    ๐Ÿ” 2    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

@avm is following 20 prominent accounts