I am recruiting graduate students for the experimental side of my lab @mcgill.ca for admission in Fall 2026!
Get in touch if you're interested in how brain circuits implement distributed computation, including dopamine-based distributed RL and probabilistic representations.
19.11.2025 18:04 β π 33 π 24 π¬ 1 π 0
Subsecond dopamine fluctuations do not specify the vigor of ongoing actions
Nature Neuroscience - Liu and colleagues show that the vigor (that is, speed and amplitude) of dexterous movements is not controlled by ongoing fluctuations in extracellular dopamine within the...
Delighted to see this finally out: rdcu.be/eO9oW
We tested whether brief striatal dopamine release events influence the vigor of skilled movements. Despite popular belief, we did not find any evidence linking rapid dopamine dynamics to motor vigor on a moment-by-moment basis.
10.11.2025 15:43 β π 74 π 24 π¬ 9 π 0
First paper from the lab!
We propose a model that separates estimation of odor concentration and presence and map it on olfactory bulb circuits
Led by @chenjiang01.bsky.social and @mattyizhenghe.bsky.social joint work with @jzv.bsky.social and with @neurovenki.bsky.social @cpehlevan.bsky.social
04.11.2025 15:40 β π 36 π 13 π¬ 2 π 1
Excited to share that our work βSimultaneous detection and estimation in olfactory sensingβ with @mattyizhenghe.bsky.social, @neurovenki.bsky.social , @cpehlevan.bsky.social, @jzv.bsky.social and @paulmasset.bsky.social has been launched!
1/7
04.11.2025 05:25 β π 12 π 3 π¬ 1 π 1
Congrats Hafez!
20.09.2025 12:11 β π 1 π 0 π¬ 0 π 0
This is one of the most outstanding examples of circuit understanding I've seen in a long time. The unification of theory and experiment is beautiful.
When Malcolm presented this in my lab, the audience was cheering at the end, and one person shouted (non-ironically) "You did it!"
19.09.2025 13:37 β π 106 π 21 π¬ 5 π 0
π¨Our preprint is online!π¨
www.biorxiv.org/content/10.1...
How do #dopamine neurons perform the key calculations in reinforcement #learning?
Read on to find out more! π§΅
19.09.2025 13:05 β π 195 π 71 π¬ 11 π 4
Thanks for sharing this exciting work! It seems the author's link has expired, so maybe it's worth updating? (Was able to find the paper myself π)
09.09.2025 16:07 β π 0 π 0 π¬ 0 π 0
Yes, finally! The bookmarking button is here for caching of both existing and future posts.
08.09.2025 20:20 β π 0 π 0 π¬ 0 π 0
My biggest skill/life gains come when Iβm unconscious of the external metering. Heavy reliance on external reward signals, neglecting the intrinsic drives and non-reward returns hamper long-horizon success in complex real life setting - a lose hypothesis - and what in part motivates #scicomm :)
28.08.2025 20:56 β π 2 π 0 π¬ 1 π 0
Where do some of Reinforcement Learning's great thinkers stand today?
Find out! Keynotes of the RL Conference are online:
www.youtube.com/playlist?lis...
Wanting vs liking, Agent factories, Theoretical limit of LLMs, Pluralist value, RL teachers, Knowledge flywheels
(guess who talked about which!)
27.08.2025 12:46 β π 76 π 23 π¬ 1 π 1
It's a comprehensive examination across Marr's three levels - in conjunction with chapters on dopamine and psychiatric conditions - as Prof. @PeterDayan describes in the opening perspective, for 'the most important and most elusive molecule in the brain.'
05.08.2025 04:49 β π 0 π 0 π¬ 0 π 0
What's even better than a great review is a volume of them! So excited to learn that The Handbook of Dopamine is out!
05.08.2025 04:48 β π 1 π 0 π¬ 1 π 0
Multi-timescale reinforcement learning in the brain - Nature
Individual dopaminergic neurons encode future rewards over distinct temporal horizons.
Our work with Pablo Tano, @hyunggoo-kim.bsky.social Athar Malik, Alexandre Pouget and @naoshigeuchida.bsky.social exploring how dopamine neurons could enable multi-timescale reinforcement learning in the brain is out in @nature.com
www.nature.com/articles/s41...
04.06.2025 18:11 β π 111 π 46 π¬ 8 π 2
Multi-timescale reinforcement learning in the brain - Nature
Individual dopaminergic neurons encode future rewards over distinct temporal horizons.
Two papers out today on RL in the dopaminergic neurons of the midbrain of mice (one from McGill's new PI @paulmasset.bsky.social). Both papers demonstrate heterogeneity in discount factors!
www.nature.com/articles/s41...
nature.com/articles/s41...
π§ π π§ͺ #NeuroAI
04.06.2025 16:32 β π 83 π 26 π¬ 2 π 2
Honoured to have been selected as a #SloanFellow
Thankful for all the support from family, mentors, collaborators, colleagues and students along the way!
@sloanfoundation.bsky.social
18.02.2025 22:13 β π 48 π 9 π¬ 3 π 0
What a great thread! Repost for bookmarking. A real bookmarking button is needed here as great content and convo are emerging at scale now.
06.12.2024 19:23 β π 1 π 0 π¬ 0 π 1
I am recruiting graduate students for my lab @mcgillu.bsky.social for admission in Fall 2025! Get in touch if you're interested in how brain circuits implement distributed computation, including dopamine-based distributed RL and probabilistic representations.
09.11.2024 20:25 β π 42 π 27 π¬ 1 π 6
Neural reverse engineer, Author, Scientist at Meta Reality Labs, Adjunct Prof at Stanford
Department of Molecular and Cellular Biology at Harvard University
https://www.mcb.harvard.edu/
Comp Neuro, ML, Dynamical Systems π§ π€PhD student at Harvard & Kempner Institute. Prev at McGill, Mila, EPFL.
Psychiatrist & Future Leaders Fellow at UCL, head of the Translational Computational Psychiatry lab: https://www.tcplab.org/. Working on psychosis, brain imaging, computational models of the brain. Co-Ed-in-Chief of @cpsyjournal.bluesky.social
Cognitive computational neuroscientist at Yale interested in decision making, happiness & mangosteens.
Play games for science! https://happinessquest.app
Empowering neuroscientists with fiber-based microscopic systems for imaging at any brain depth
CTO at DeepEn, @deepen-imaging.bsky.social
( https://deepen-imaging.com/ )
Neuroscientist, Associate Professor, Lerner Lab. Dopamine and basal ganglia circuits controlling reinforcement learning and decision-making. Open/inclusive science. Happy working mom of 3.
Yale β‘οΈ UCSF β‘οΈ Stanford β‘οΈ Northwestern
lernerlab.org
RL & Agents Reading Group @ University of Edinburgh
We regularly discuss recent papers in RL, MARL & related
https://edinburgh-rl.github.io/reading-group
Graduate Researcher | Mila, UniversitΓ© de MontrΓ©al
PhD Candidate in NeuroAI @ McGill | Mila
Neuroimaging, Cognition, Epilepsy | Montreal Neurological Institute, McGill University
IVADO est un consortium de recherche, de formation et de mobilisation des connaissances qui a pour mission de bΓ’tir et de promouvoir une IA robuste, raisonnante et responsable.
learning | neuroethology | basal ganglia | birdsong | decision-making | natural history | Current K99 Postdoc Rich Mooney @Duke | PhD Christina Gremel @UC San Diego
Abolish the value function!
comp neuro assistant prof at columbia
5th year PhD student in Cognitive Science at Johns Hopkins, working with Leyla Isik
https://www.hannah-small.com/
Cognitive neuroscientist and #scicommmom interested in habits, including those of scientists, my toddlers and cats.
Hobby illustrator & designer β¨ www.lienekejanssen.nl
Science Communicator with a PhD in cell & molecular biology + neuroscience.
ποΈ Host of Curiosity Weekly for Discovery
πΊ Science Expert on CTVβs The Good Stuff
π she/her/ΩΩ
bit.ly/CuriosityWeekly
instagram.com/science.sam
samanthayammine.com
CTO of Technology & Society at Google, working on fundamental AI research and exploring the nature and origins of intelligence.