Are world models necessary to achieve human-level agents, or is there a model-free short-cut?
Our new #ICML2025 paper tackles this question from first principles, and finds a surprising answer, agents _are_ world modelsโฆ ๐งต
arxiv.org/abs/2506.01622
04.06.2025 15:48 โ ๐ 40 ๐ 15 ๐ฌ 2 ๐ 4
And thanks for the celebration dinner ๐ฅบ It was the best sushi I had!
31.05.2025 23:13 โ ๐ 2 ๐ 0 ๐ฌ 0 ๐ 0
Thank you! I really tried hard to not tear up when I was mentioning you & the lab during the acknowledgements ๐ข I am so fortunate to have been part of such a beautiful community!
31.05.2025 22:49 โ ๐ 8 ๐ 0 ๐ฌ 1 ๐ 0
OSF
New preprint from Yining Ding (@liliand.bsky.social)!
"Temporal order memory in naturalistic events is scaffolded by semantic knowledge and hierarchical event structure"
osf.io/preprints/ps...
26.03.2025 22:45 โ ๐ 20 ๐ 10 ๐ฌ 1 ๐ 2
Excellent resource here, including a slide deck, for teaching students about science funding! Any similar additional resources out there? I would love to add some graphics quantifying the consequences of the current attacks on science.
07.03.2025 01:44 โ ๐ 11 ๐ 4 ๐ฌ 0 ๐ 0
What papers do you like that demonstrate the use of 'orthogonal subspaces' for encoding information in neural populations? #neuroskyence #compneuro #neuroAI
23.12.2024 17:37 โ ๐ 138 ๐ 34 ๐ฌ 26 ๐ 3
I love the uncompromising defense of absolute stupidity. I sometimes explain it to students using Keats' phrase 'negative capability'. Can you be comfortable with not knowing?
15.12.2024 13:10 โ ๐ 31 ๐ 8 ๐ฌ 2 ๐ 1
Temporal-Difference Learning Using Distributed Error Signals
A computational problem in biological reward-based learning is how credit assignment is performed in the nucleus accumbens (NAc). Much research suggests that NAc dopamine encodes temporal-difference (...
Could we get away with (1) region specific RPEs and (2) no end-to-end training? Is that how the brain works?
My guess is yes to (1), no to (2).
This paper from our "cousins" at @vectorinst.bsky.social is exploring thes issues and has some promising results!
arxiv.org/abs/2411.03604
#NeuroAI ๐งช
29.11.2024 16:32 โ ๐ 45 ๐ 9 ๐ฌ 0 ๐ 0
An inductive bias for slowly changing features in human reinforcement learning
Author summary Learning experiments in the laboratory are often assumed to exist in a vacuum, where participants solve a given task independently of how they learn in more natural circumstances. But h...
Our work on inductive biases in reinforcement learning is out: tinyurl.com/yfc74e3u
By the fantastic
@noahedrich.bsky.social
Ppl learn faster from slowly changing features; we argue this reflects an inductive bias. Teamwork w @ericschulz.bsky.social & S HallMcMaster
#neuroskyence #compneuro
27.11.2024 08:34 โ ๐ 144 ๐ 44 ๐ฌ 0 ๐ 1
Important paper!
www.biorxiv.org/content/bior...
Im not sure the Discussion fully delineates its radical implications.
No more...
* Place cells
* Grid cells, splitter cells, border cells
* Mirror neurons
* Reward neurons
* Conflict cells
(continued)
22.11.2024 14:47 โ ๐ 254 ๐ 70 ๐ฌ 13 ๐ 15
Space is a sensory-motor sequence in the hippocampus
A guide for cognitive/neuro scientists for reinterpreting space and cognitive maps
ICYMI on X/Twitter...if you are into space, cognitive maps, place cells, planning, replay, etc., I predict that this blog+paper will change the way you think about those ideas.
Goes against the conventional Kantian thought that space is apriori ...
blog.dileeplearning.com/p/space-is-a...
14.11.2024 01:03 โ ๐ 28 ๐ 8 ๐ฌ 1 ๐ 0
BrainFacts
Do you know www.brainfacts.org?
Terrific, accessible (free!) articles there about whatโs new in brain research.
Like this timely piece! The neuroscience behind conspiracy theories.
www.brainfacts.org/thinking-sen...
Iโm delighted to soon step into an editorial role at this terrific effort!
20.11.2024 22:14 โ ๐ 73 ๐ 21 ๐ฌ 0 ๐ 3
@aaronbornstein.bsky.social
19.11.2024 04:10 โ ๐ 2 ๐ 0 ๐ฌ 0 ๐ 0
OK folks, I've started an episodic memory starter pack. By no means a full list so reply below if you're an episodic memory nerd! go.bsky.app/2mtNK43
12.11.2024 21:47 โ ๐ 114 ๐ 53 ๐ฌ 72 ๐ 3
RLDM | The Multi-disciplinary Conference on Reinforcement Learning and Decision Making
Did you know #RLDM2025 is coming to Dublin next June? rldm.org Abstract submission open now โ๏ธ ๐ฎ๐ช
11.11.2024 19:32 โ ๐ 58 ๐ 35 ๐ฌ 1 ๐ 3
Iโm presenting my poster soon! Please stop by ;)
05.10.2024 17:38 โ ๐ 1 ๐ 1 ๐ฌ 0 ๐ 0
Iโll be presenting my poster today! Please stop by :)
06.08.2024 13:12 โ ๐ 4 ๐ 1 ๐ฌ 0 ๐ 0
One more week to apply for our joint faculty position in Princeton Neuroscience Institute and Computer Science Dept, in neuroAI and intelligent systems, broadly construed. Do you fit? Yes. But feel free to contact me with q's. puwebp.princeton.edu/AcadHire/app...
08.11.2023 20:21 โ ๐ 20 ๐ 19 ๐ฌ 1 ๐ 0
Human and Machine Learning Lab logo, with three converging boxes around a gear. The gear represents learning mechanisms, and the boxes represent a process of converging on common understanding of human learning and high-performance machine learning.
The Human and Machine Learning (HaML) Lab is recruiting a PhD student to start in Fall 2024. If youโre interested in human learning, machine learning, and neuroimaging, apply to work with me at UWM! See hamllab.org/positions.html for more detailsย about PhD training and the application process.
02.11.2023 18:27 โ ๐ 2 ๐ 3 ๐ฌ 0 ๐ 2
cybernetic cognitive control ๐ค
computational cognitive neuroscience ๐ง
postdoc princeton neuro ๐
he/him ๐จ๐ฆ harrisonritz.github.io
Cognitive neuroscientist exploring how the brain learns, decides, and generalizes. ๐ง http://ccnvt.github.io
postdoc at nyu | (episodic) memory and decision making | jonathanicholas.github.io
Pronounced pree-yum | she/her | Cognitive scientist and recovering academic | Passionate about lifelong learning, womenโs health, public transit, & public libraries.
๐San Francisco Peninsula
๐ง๐ปโโ๏ธ assist prof in brain & cognitive science @USC
(postdoc @caltech, phd @princeton)
๐ computational approaches to reinforcement learning, memory & decision-making at individual & collective level; comp psychiatry
http://www.rouhanilab.com
Research Fellow, University of Oxford
Theology, philosophy, ethics, politics, environmental humanities
Associate Director @LSRIOxford
Anglican Priest
https://www.theology.ox.ac.uk/people/revd-dr-timothy-howles
grad kid studying memory in human spatial navigation @ SKKU & CNIR
Psych PhD student in Dynamic Cognition Lab @WUSTL๐ง
Postdoc in the Kuhl Lab at the University of Oregon, PhD from UT Austin. Episodic Memory | Computational Neuroscience | Cognitive Neuroscience | Machine Learning. ๐ฟ -> ๐ -> ๐ -> ๐ฆ, he/him
soroushmirjalili.com
phd researcher in cognitive sciences @ uc irvine. working on evidence accumulation, metacognition, memory, and philosophy of cognitive [neuro]science ๐ง they/them ๐ณ๏ธโ๐ โง๏ธ ๐ธ๐พ https://arikhoudary.com/
PhD student in neuroscience at UW-Milwaukee.
Principal Researcher @ Microsoft Research.
AI, RL, cog neuro, philosophy.
www.momen-nejad.org
Postdoc @NassarLab || information seeking, planning, exploration, latent states, emotion || musical, cheese foam fruit tea, cats!
Mood & Memory researcher with a computational bent. https://www.nicolecrust.com. Science advocate. Prof (UPenn Psych) - on leave as a Simons Pivot Fellow. Author: Elusive Cures. https://press.princeton.edu/books/hardcover/9780691243054/elusive-cures
Computational cognitive science of learning, reasoning and creativity, in both social and non-social contexts ๐ง ๐พ๐๐ฅ
DSAN Lab PI, UT Dallas, CVL | How the self is shaped, protected, reflected upon, expressed, expanded, and transcended
Developmental Social Affective Neuroscience Lab at UT Dallas | Expanding knowledge on the Adolescent Brain, the Self, and Social Behavior | https://labs.utdallas.edu/dsanlab/ | PI. Leehyun Yoon
now: neuro postdoc with Janice Chen & Chris Honey @ Johns Hopkins. before: neuro phd student with Ken Norman @ Princeton & Chris Baldassano @ Columbia | dspan