Yifei Cao's Avatar

Yifei Cao

@yifeicaoethz.bsky.social

Incoming PhD @ucla working with Erie Boorman and @mariaeckstein.bsky.social on Cognitive Map, Reinforcement Learning and Artificial Neural Network. Current neuroscience master student @ethzurich.bsky.social studying human decision-making.

51 Followers  |  112 Following  |  6 Posts  |  Joined: 25.12.2024  |  1.7598

Latest posts by yifeicaoethz.bsky.social on Bluesky

Preview
Apparent learning biases emerge from optimal inference: Insights from master equation analysis | PNAS Recent studies [S. Palminteri, G. Lefebvre, E. J. Kilford, S. J. Blakemore, PLoS Comput. Biol. 13, e1005684 (2017); G. Lefebvre, M. Lebreton, F. Me...

Very cool study showing that "apparent" asymmetric update in reinforcement learning can emerge from Bayes optimal principles by Prakhar Godara in @pnas.org

www.pnas.org/doi/abs/10.1...

13.10.2025 12:03 โ€” ๐Ÿ‘ 41    ๐Ÿ” 8    ๐Ÿ’ฌ 3    ๐Ÿ“Œ 1

Congrats Randolph!

09.10.2025 08:44 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
A brain-inspired agentic architecture to improve planning with LLMs - Nature Communications Multi-step planning is a challenge for LLMs. Here, the authors introduce a brain-inspired Modular Agentic Planner that decomposes planning into specialized LLM modules, improving performance across tasks and highlighting the value of cognitive neuroscience for LLM design.

Very excited to share that our work (together with co-first author Shanka Subhra Mondal and @neuroai.bsky.social ) on a brain-inspired architecture for planning with LLMs is now out in Nature Communications! www.nature.com/articles/s41... (thread below)

06.10.2025 21:50 โ€” ๐Ÿ‘ 63    ๐Ÿ” 15    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 1

Crazy cool work, Ji-An! your arXiv paper was like a tutorial for me on modeling behavior with cognitive and neural network models, I really read it a lot of times and feel so happy to see it on Nature now. Huge congrats! Looking forward to your future works!

03.07.2025 02:33 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Discovering cognitive strategies with tiny recurrent neural networks - Nature Modelling biological decision-making with tiny recurrent neural networks enables more accurate predictions of animal choices than classical cognitive models and offers insights into the underlying cog...

Thrilled to see our TinyRNN paper in @nature! We show how tiny RNNs predict choices of individual subjects accurately while staying fully interpretable. This approach can transform how we model cognitive processes in both healthy and disordered decisions. doi.org/10.1038/s415...

02.07.2025 19:03 โ€” ๐Ÿ‘ 329    ๐Ÿ” 141    ๐Ÿ’ฌ 9    ๐Ÿ“Œ 4

This is so crazy Marcel, really love this paper when I also modeling reversal learning with hybrid cog-RNN model. Big congrats!!!!!!

02.07.2025 19:19 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Congrats, Phillip!

17.04.2025 11:49 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Neural signatures of model-based and model-free reinforcement learning across prefrontal cortex and striatum

Epic recordings of model-based and model-free learning signals from Kennerley lab (Bruno Miranda). Now at @elife.bsky.social

doi.org/10.7554/eLif...

16.04.2025 21:33 โ€” ๐Ÿ‘ 45    ๐Ÿ” 11    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Deep reinforcement learning can promote sustainable human behaviour in a common-pool resource problem - Nature Communications Koster et al introduce a deep reinforcement learning (RL) mechanism designed to manage common-pool resources successfully encourages sustainable cooperation among human participants by dynamically adj...

getting this paper published was a bit painful but I am proud of it: www.nature.com/articles/s41.... We use deep RL to find mechanisms that help (real) people sustain the commons. Well done to Raphael Koster and Miruna Pislar (not on BlueSky). non-paywalled version on arxiv.

24.03.2025 08:21 โ€” ๐Ÿ‘ 58    ๐Ÿ” 23    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 1
Preview
Google PhD fellowship program The Google PhD Fellowship Program recognizes outstanding graduate students doing exceptional work in computer science, related disciplines, or promising research areas.

Applications for the global Google PhD Fellowship Program are open! Fellowships directly support graduate students doing exceptional and innovative research in computer science and related fields as they pursue their PhD. Learn more and apply by May 15 at goo.gle/phdfellowship.

10.04.2025 18:12 โ€” ๐Ÿ‘ 8    ๐Ÿ” 4    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Thank you for your reply Marcel, and itโ€™s a bit pitty๐Ÿฅน really enjoyed reading your work on meta-leaning and LLM cognition, hope we have opportunity to collaborate in the future๐Ÿ˜

09.04.2025 19:57 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Hi Marcel, do you have any position for interns? Thanks!

09.04.2025 14:01 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

We are looking for two PhD students at our institute in Munich.

Both postions are open-topic, so anything between cognitive science and machine learning is possible.

More information: hcai-munich.com/PhDHCAI.pdf

Feel free to share broadly!

09.04.2025 12:11 โ€” ๐Ÿ‘ 6    ๐Ÿ” 5    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 1
Preview
Intrinsically-Motivated Humans and Agents in Open-World Exploration What drives exploration? Understanding intrinsic motivation is a long-standing challenge in both cognitive science and artificial intelligence; numerous objectives have been proposed and used to train...

New preprint with Aly Dayan Eliza Kosoy Yuqing Du.I really love this study, play and exploration, comparing free exploration of children adults and agents w entropy, empowerment and info gain as rewards. Plus kids private speech increases exploration.

arxiv.org/abs/2503.23631

01.04.2025 14:00 โ€” ๐Ÿ‘ 18    ๐Ÿ” 2    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 1
Post image

Can LLMs be used to discover interpretable models of human and animal behavior?๐Ÿค”

Turns out: yes!

Thrilled to share our latest preprint where we used FunSearch to automatically discover symbolic cognitive models of behavior.
1/12

10.02.2025 12:21 โ€” ๐Ÿ‘ 134    ๐Ÿ” 44    ๐Ÿ’ฌ 3    ๐Ÿ“Œ 11

@yifeicaoethz is following 20 prominent accounts