Tom Ringstrom's Avatar

Tom Ringstrom

@noreward4u.bsky.social

Reward-Free Model-based Maximalist. High-dimensional Empowerment. Self-Preserving Autonomous Agents. Theories of intelligence grounded in compositional control.

1,584 Followers  |  686 Following  |  31 Posts  |  Joined: 25.09.2023  |  1.7112

Latest posts by noreward4u.bsky.social on Bluesky

Looks cool! Heads up, my collaborators and I derived the state-action Linearly Solvable MDP a while back. You might be interested arxiv.org/pdf/2007.02527

25.05.2025 15:51 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

First time seeing a wild giraffe. Just chillinโ€™ on the side of the road.

28.03.2025 14:04 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Ringstrom_Thesis_v4.pdf

Thesis: drive.google.com/file/d/1peG7...

24.03.2025 21:17 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Stoffel, the honey badger that can escape from anywhere! - BBC
YouTube video by BBC Stoffel, the honey badger that can escape from anywhere! - BBC

Stoffel lives at an animal rehabilitation center near Kruger National Park and is an expert escape artist. But he is 26 now (they only live an average of 8 years in the wild) so he spends most days snuggling with his girlfriend Hammie. BBC show: m.youtube.com/watch?v=c36U...

24.03.2025 21:17 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image Post image Post image Post image

They say donโ€™t meet your heroes, but I traveled to South Africa and met mine and it was worth it. Stoffel the Honey Badger became a major inspiration for my PhD thesis when my advisor showed our lab a BBC show on clever animals who can solve long horizon tasks, presumably for abstract reasons.

24.03.2025 21:17 โ€” ๐Ÿ‘ 3    ๐Ÿ” 1    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

And I've always wondered how this works with his Constructor theory.

14.03.2025 19:26 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

By the way, while Deutsch doesn't have a deeply rigorous decision theory to match his views, I did once hear him say (on a podcast I can't seem to find) that he regards value as equivalent to the space of possible transformations one can make, which is to a close approximation what empowerment is.

14.03.2025 19:23 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

I've been thinking recently about Bostrom's notion of instrumental convergence, and what would entail instrumental divergence. There's an obvious sense in which infinitely large time horizons and infinitely small relevant probabilities play a role in washing out potential differences.

13.03.2025 10:09 โ€” ๐Ÿ‘ 5    ๐Ÿ” 1    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Deutsch's emphasis on universal explainers is a better (though incomplete) alternative and has nothing to do with emulation (he never talks about the normative part of why one should want to explain something)

13.03.2025 12:13 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Yeah, their emphasis on emulation is frustrating (for somewhat similar reasons to the recent Jaeger/Vervaeke paper). AI-by-learning being intractable is not interesting. It doesn't imply anything about the intractability of creating generally intelligent systems.

13.03.2025 12:13 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Related:

bsky.app/profile/nore...

06.01.2025 17:54 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

Unfortunately for SlipFrosty, a theory of instrumental intelligence is inseparable from a theory of normative intelligence. Abolish the value function!

06.01.2025 17:53 โ€” ๐Ÿ‘ 7    ๐Ÿ” 2    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
The Gradient Podcast - Pete Wolfendale: The Revenge of Reason
YouTube video by The Gradient The Gradient Podcast - Pete Wolfendale: The Revenge of Reason

My favorite interview from the past year, of philosopher Pete Wolfendale. Recommended to anyone interested in AI, the relationship between value, aesthetics and ethics, or anyone who wants a reason to abandon "rationality as Bayes + Utility".

www.youtube.com/watch?v=0xMc...

31.12.2024 02:11 โ€” ๐Ÿ‘ 11    ๐Ÿ” 2    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

IMO, A problem with RL is that, in sparse-reward problems, value functions donโ€™t have a general decomposition over high-dimensional transition kernels so people are trying to learn neural-net approximations to difficult-to-generalize functions from a lot of experience.

Fun ep.

26.12.2024 17:08 โ€” ๐Ÿ‘ 4    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 1

Exactly :)

17.12.2024 16:36 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image 17.12.2024 13:33 โ€” ๐Ÿ‘ 10    ๐Ÿ” 2    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

@denizrudin.bsky.social Deniz, did your grandma and grandpa call you baby Rudin?

08.12.2024 14:47 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Love that Fog Lake song.

07.12.2024 15:47 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
A tale of two algorithms: Structured slots explain prefrontal sequence memory and are unified with hippocampal cognitive maps The algorithm of the prefrontal working memory system on sequence memory tasks is not well understood, whereas it is well understood for the hippocampal episodic memory system. This work shows a mathematical duality between working and episodic sequence memory. This leads to a computational understanding of sequence working memoryโ€”as structured activity slots. This theory algorithmically explains recurrent neural network (RNN) and prefrontal representations during sequence memory tasks.

Stellar new work lead by the inimitable James Whittington in Neuron that develops a new theory unifying episodic and working memory and explains diverse hippocampal and prefrontal data: www.cell.com/neuron/fullt... w/Will Dorrell, @behrenstimb.bsky.social Mohamedy El Gaby

06.12.2024 18:47 โ€” ๐Ÿ‘ 110    ๐Ÿ” 30    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 1

Starter packs are making it easier to keep constructing niches, so I made this one for people broadly interested in intrinsic motivation, with some focus on RL, neuroscience and cognitive science. Havenโ€™t found many people on Bluesky that I wanted to add here, so help me out! go.bsky.app/TPNrnpE

26.11.2024 03:19 โ€” ๐Ÿ‘ 7    ๐Ÿ” 4    ๐Ÿ’ฌ 3    ๐Ÿ“Œ 1

I wish we could turn some of the starter-packs into a custom feed rather than following everyone.

25.11.2024 17:37 โ€” ๐Ÿ‘ 11    ๐Ÿ” 1    ๐Ÿ’ฌ 6    ๐Ÿ“Œ 0

@bsky.app Please consider this!

25.11.2024 17:45 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I wish we could turn some of the starter-packs into a custom feed rather than following everyone.

25.11.2024 17:37 โ€” ๐Ÿ‘ 11    ๐Ÿ” 1    ๐Ÿ’ฌ 6    ๐Ÿ“Œ 0

@saxelab.bsky.social

25.11.2024 16:49 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 0

Which ones do you have?

25.11.2024 00:19 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Immunity Jon Hopkins ยท Album ยท 2013 ยท 17 songs

Probably this one:
open.spotify.com/album/0Dg1Kw...
and
open.spotify.com/album/1ehwJG...

24.11.2024 23:03 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

And you're all three??

22.11.2024 21:55 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Thanks!

19.11.2024 12:20 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I know the name, never looked into his work. Is there something I should check out?

19.11.2024 12:10 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

I'm with you haha, I didn't feel anything about the latest movie, other than "this orange tone is nice".

18.11.2024 21:13 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

@noreward4u is following 20 prominent accounts