Dmitry Krotov's Avatar

Dmitry Krotov

@krotov.bsky.social

I am a physicist working on neural networks (artificial and biological). Find me on dmitrykrotov.com.

230 Followers  |  141 Following  |  29 Posts  |  Joined: 24.11.2024  |  1.9052

Latest posts by krotov.bsky.social on Bluesky

Workshop on Associative Memory @ICLR 2025 New Frontiers in Associative Memories Workshop @ICLR 2025. Discuss the latest multidisciplinary developments in Associative Memory. Explore synergies between Associative Memories and LLMs.

CDS Silver Professor Julia Kempe (@kempelab.bsky.social) is co-organizing this year's ICLR 2026 Workshop on New Frontiers in Associative Memory.

The workshop is accepting submissions related to associative memory until Feb 14.

nfam2026.amemory.net

30.01.2026 19:50 β€” πŸ‘ 2    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0
Post image

Now that ICML papers are submitted, what could be a better time to prepare a cool paper for the New Frontiers in Associative Memory workshop @iclr-conf.bsky.social?

Deadline: February 14, 2026.

Call for papers: nfam2026.amemory.net

Submissions are open via Open Review.

29.01.2026 19:32 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Workshop on Associative Memory @ICLR 2025 New Frontiers in Associative Memories Workshop @ICLR 2025. Discuss the latest multidisciplinary developments in Associative Memory. Explore synergies between Associative Memories and LLMs.

Workshop website: nfam2026.amemory.net

18.12.2025 20:59 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

The lineup of invites speakers is amazing: Jay McClelland, Xueyan Niu, Paul Liang, Meisam Razaviyayn, Natalia Berloff, David Clark, and others. There will also be exciting panel discussions.

The call for contributed papers is now open via Open Review. Please consider submitting your best work!

18.12.2025 20:59 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

Official #ICLR2026 workshop on Associative Memory! The scope covers algorithms, architectures, hardware design, agentic workflows, and other ideas where memory plays a crucial computational role.

18.12.2025 20:59 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 1    πŸ“Œ 1

I will also present our paper Dense Associative Memory with Epanechnikov Energy on Wednesday. Stop by and say hi!

02.12.2025 04:43 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

I have just landed in San Diego and I will be at #NeurIPS2025 for the week. DM or send me an email if you want to chat about interesting papers and potential projects related to associative memory, energy-based models, new architectures, or other cool ideas.

02.12.2025 04:43 β€” πŸ‘ 5    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0

The overlaid network illustrates a mathematical model, which represents the astrocyte as a network of processes that enables multi-synaptic communication and supports associative memory function.

Data credit: Leyka Nagendren, Cagla Eroglu.
Artist Credit: Annette Hui, IBM Research

29.05.2025 18:12 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

The raw image was captured in October 2023 using an Olympus FV 3000 confocal microscope with a 60x objective lens and a z-step size of 0.5 ΞΌm across a 50–60 ΞΌm z-stack for high magnification and resolution.

29.05.2025 18:12 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

A custom Imaris extension, 3D Sholl Analysis, was used to quantify the number of process intersections at 5 ΞΌm intervals from the cell soma, marked by the sphere, thereby visualizing the highly complex network of processes of the astrocyte.

29.05.2025 18:12 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

The image summarizes the main message of our paper: astrocyte = network of processes that engage in information exchange and computation. The image shows a 3D reconstruction of an astrocyte from the visual cortex using Imaris Bitplane 9.9.

29.05.2025 18:12 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Key takeaways:
πŸ”· Astrocytes compute.
πŸ”· Dense Associative Memories can be built using astrocytes.
πŸ”· From the computational perspective astrocyte is a network of processes.
πŸ”· Memories can be stored, at least partially, in the biochemical machinery inside the astrocyte, as opposed to just synapses.

29.05.2025 18:12 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

I am very excited about our new paper just published in PNAS.

www.pnas.org/doi/abs/10.1...

It was a pleasure to work on this idea together with @leokoz8.bsky.social and Jean-Jacques Slotine.

29.05.2025 18:12 β€” πŸ‘ 12    πŸ” 3    πŸ’¬ 1    πŸ“Œ 0
Post image

Big week for astrocyte research: 3 new Science papers link astrocytes to behavior. We're excited to add to the momentum with our new PNAS paper: a theory, grounded in biology, proposing astrocytes as key players in memory storage and recall. w/ JJ Slotine and @krotov.bsky.social
(1/6)

28.05.2025 19:44 β€” πŸ‘ 35    πŸ” 13    πŸ’¬ 1    πŸ“Œ 0
John J. Hopfield, Nobel Prize in Physics 2024: Official interview
YouTube video by Nobel Prize John J. Hopfield, Nobel Prize in Physics 2024: Official interview

John Hopfield on pursuing interesting things: β€œDoesn’t matter what they are - interesting is the important one”. www.youtube.com/watch?v=iYgs...

25.04.2025 00:22 β€” πŸ‘ 5    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Workshop on Associative Memory @ICLR 2025 New Frontiers in Associative Memories Workshop @ICLR 2025. Discuss the latest multidisciplinary developments in Associative Memory. Explore synergies between Associative Memories and LLMs.

More info here: nfam.vizhub.ai

23.04.2025 03:48 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

I am heading to #ICLR2025 in Singapore. If you want to chat about associative memories, energy-based models, and related topics let’s connect! The highlight for me this year is the New Frontiers in Associative Memories workshop on Sunday April 27. Here is the schedule ⬇️

23.04.2025 03:47 β€” πŸ‘ 5    πŸ” 1    πŸ’¬ 2    πŸ“Œ 0
Preview
Convergence of efficient and predictive coding in multimodal sensory processing The existence of pathways connecting different sensory modalities in the brain challenges the traditional view of sensory systems as operating independently. However, the reasons and mechanisms underl...

New ms! www.biorxiv.org/content/10.1...
I developed a normative coding theory for feedback-modulated canonical networks, providing a unified view of (1) efficient & predictive coding, (2) computational & algorithmic principles, (3) unimodal & multimodal sensory processing.

16.03.2025 17:35 β€” πŸ‘ 15    πŸ” 4    πŸ’¬ 1    πŸ“Œ 0
Preview
Workshop on Associative Memory @ICLR 2025 New Frontiers in Associative Memories Workshop @ICLR 2025. Discuss the latest multidisciplinary developments in Associative Memory. Explore synergies between Associative Memories and LLMs.

Website: nfam.vizhub.ai

Submissions on Open Review: openreview.net/group?id=ICL...

31.01.2025 14:41 β€” πŸ‘ 1    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

Associative memory is a prominent emerging paradigm in the landscape of mainstream AI and I expect exciting developments in this area in the next few years. Please take a look at the call for papers and submit by the deadline: February 14. It will be interesting! πŸ˜€

31.01.2025 14:40 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

Now that ICML papers are submitted and we are in the midst of discussions on whether scaling is enough or new architectural/algorithmic ideas are needed, what can be a better time to submit your best work to our workshop on New Frontiers in Associative Memory @iclr-conf.bsky.social?

31.01.2025 14:40 β€” πŸ‘ 14    πŸ” 2    πŸ’¬ 1    πŸ“Œ 1
Post image

I am very honored to return to my alma mater to give a distinguished lecture on AI for Science at Rice University's Ken Kennedy Institute.
events.rice.edu/event/spring...

14.01.2025 22:37 β€” πŸ‘ 17    πŸ” 3    πŸ’¬ 1    πŸ“Œ 0
Post image

I am excited to announce the call for papers for the New Frontiers in Associative Memories workshop at ICLR 2025. New architectures and algorithms, memory-augmented LLMs, energy-based models, Hopfield nets, AM and diffusion, and many other topics.

Website: nfam.vizhub.ai

@iclr-conf.bsky.social

14.01.2025 16:56 β€” πŸ‘ 16    πŸ” 6    πŸ’¬ 0    πŸ“Œ 0
Post image Post image Post image Post image

Wow, what a night! A heartfelt congratulations to my dear friend and collaborator John Hopfield and all the 2024 Laureates. #NobelPrize

11.12.2024 18:33 β€” πŸ‘ 13    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image Post image Post image Post image

What a wonderful day of Nobel lectures and inspiring conversations at the beautiful Aula Magna, Stockholm University! #NobelPrize

09.12.2024 13:35 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Physics is a point of view. Wise words from John Hopfield’s Nobel lecture. #NobelPrize

08.12.2024 13:13 β€” πŸ‘ 8    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

Please check out the post in the first quote and join us at the Scientific Methods for Understanding Deep Learning workshop at #NeurIPS2024 on December 15 to learn more.

05.12.2024 18:19 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

We demonstrate empirically that spurious states exist in conventional DMs. Their existence is a distinct prediction of DenseAM theory, yet these states have been overlooked in the DM literature. Spurious states mark the onset of the memorization-generalization transition in DMs.

05.12.2024 18:19 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

In our latest work, we leverage the correspondence between DenseAMs and Diffusion Models (DMs) to make a theoretical prediction: a similar phenomenon must occur during the memorization-to-generalization transition in DMs.

05.12.2024 18:19 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

DenseAM theory predicts a distinct phenomenon when the amount of data surpasses the critical memory capacity: spurious states emerge. Spurious states are local minima of the energy function that fail to store each pattern in a unique basin of attraction (two or more patterns sharing the same basin).

05.12.2024 18:19 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

@krotov is following 20 prominent accounts