(Let me just say that I think I agree with all you are saying, but Iโm trying to understand it better!)
04.03.2026 08:35 โ ๐ 1 ๐ 0 ๐ฌ 1 ๐ 0(Let me just say that I think I agree with all you are saying, but Iโm trying to understand it better!)
04.03.2026 08:35 โ ๐ 1 ๐ 0 ๐ฌ 1 ๐ 0If we take syntax as rules that say that only certain sequences of symbols (ie trajectories) are well-formed (ie actually take place), could one say that the regularities that arise due to the laws of physics impose some sort of syntax?
04.03.2026 08:33 โ ๐ 1 ๐ 0 ๐ฌ 1 ๐ 0but, could a smart enough observer use a simple system to run any computation? Or do properties of โsubstratesโ bound what they can be used for, computationally?
04.03.2026 01:09 โ ๐ 1 ๐ 0 ๐ฌ 1 ๐ 0So, in this view the notion of โobserver independent computationโ would be an oxymoron?
03.03.2026 21:21 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
Final version of this paper with Richard Watson is out!
www.sciencedirect.com/science/arti...
"Machines all the way up and cognition all the way down: Updating the machine metaphor in biology"
(quite a bit different than the original preprint at osf.io/preprints/os...).
Ok I should read the paper then. Thanks for the clarification ๐
20.02.2026 22:39 โ ๐ 1 ๐ 0 ๐ฌ 1 ๐ 0
I thought that this new paper was saying that not only pairwise mechanisms can generate some high order behaviour, but that they can generate all of themโฆ
(โฆ and hence reverse inference from behaviour to mechanisms is kind of cursed)
But maybe Iโm misunderstanding the paper?
One of the points our paper touches is that one doesnโt need high order mechanisms to generate high order behaviour. For example, one can have statistical synergy with pairwise (but frustrated) Ising models
20.02.2026 22:31 โ ๐ 1 ๐ 0 ๐ฌ 2 ๐ 0So the expressivity is only in terms of mechanisms and not related to behaviours?
20.02.2026 22:31 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0Just read the abstract and intro and looks extremely interesting, congrats! One question: how are the arguments raised here related to the distinction between mechanism and behaviours discussed here? arxiv.org/abs/2203.12041
20.02.2026 22:17 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
Happy to announce this new preprint!
In it, we use info decomp (ฮฆID) on fMRI in Alzheimer's and MCI to explore how info-dynamic representations change.
AD saw big decreases in synergy ('deductive' information) and increases in redundancy.
Check it out here:
๐
www.biorxiv.org/content/10.6...
The key idea is mesa-optimisation: just as humans were shaped by a process of fitness maximisation but are not fitness maximisers themselves (we do other stuff, like listen to music), LLMs are shaped by next token prediction but that is not what they do
19.02.2026 01:23 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
Hot take ๐ฅ
Why math classes work well in uni? Not because that specific math will be useful later, but because solving hard problems makes you build instrumental skills, which enable you to solve other problems later in life
โฆ and that is exactly why next token prediction works so well
Indeed, rather than fight against it, it seems life surfs on entropy ๐
18.02.2026 15:55 โ ๐ 9 ๐ 1 ๐ฌ 0 ๐ 0Could it be that the issue is not so much computability in principle, but that waves may be a way to increase the signal-to-noise ratio?
14.02.2026 08:43 โ ๐ 0 ๐ 0 ๐ฌ 2 ๐ 0
Tomorrow in Amsterdam Iโll be giving a talk about my most recent work on abstractions and world modelling
๐๐ฝ๐๐ฝ
DIEP seminar tomorrow 11am! ๐ช
Join us to attend a talk by @frosas.bsky.social (lecturer at the University of Sussex) titled
โMirroring the world: How symmetry shapes hierarchical beliefsโ ๐คผ
Abstract & registration: ias.uva.nl/content/even...
See you there!
Why donโt neural networks learn all at once, but instead progress from simple to complex solutions? And what does โsimpleโ even mean across different neural network architectures?
Sharing our new paper @iclr_conf led by Yedi Zhang with Peter Latham
arxiv.org/abs/2512.20607
There is a new Postdoctoral Research Associate position available in my group, to work on computational analysis of human neuroimaging workflows to develop robust, interpretable and scalable biomarkers of cognitive brain health.
Closing date 10th Feb 2026.
www.imperial.ac.uk/jobs/search-...
We also provide a roadmap for future directions organising research priorities into sequential stages.
Kudos to the awesome team brilliantly lead by Constanza Baquedano and Mar Estarellas! โจ
These benefits are not just fleeting states: longitudinal MRI studies suggest that cumulative greenspace exposure is linked to better white matter integrity and brain structure over time. Nature isn't just a luxury, but a scaffold for neurocognitive resilience
22.01.2026 14:54 โ ๐ 4 ๐ 1 ๐ฌ 1 ๐ 0Across modalities, we found that nature shifts the brain into a distinct state via a โrestorative cascadeโ: enhances sensory restoration and coherence, down-regulates stress circuitry, and fosters functional integration in self-related networks
22.01.2026 14:54 โ ๐ 3 ๐ 0 ๐ฌ 1 ๐ 0
Finally published:
โYour brain on nature: A scoping review of the neuroscience of
nature exposureโ
www.sciencedirect.com/science/arti...
A synthesis of multiple EEG, fMRI, and fNIRS studies to map the mechanisms behind the restoring effects of nature on the brain ๐ง ๐ฑ
We're running a 5th edition of the always-exciting UCL Summer School on Consciousness and Metacognition this year, 8th-10th July 2026 in London. Accommodation and travel expenses are covered.
For more information and how to apply, check out metacoglab.org/summer-schoo...
cool work about information decomposition in artificial systems!
Synergistic information processing emerges through learning in LLMs and ablating these synergistic components causes large performance drops
#NeuroAI
๐๐๐
Preprint time:
A Brain-like Synergistic Core in LLMs Drives Behaviour and Learning
arxiv.org/abs/2601.06851
LLMs are clearly different from actual brainsโฆ but could they share a similar functional architecture related to how they process information?
Looking forward to participate in this workshop on high-order interactions and multivariate information theory:
mithic2026.github.io
๐ง๐ต๐ฒ ๐๐ป๐๐ฎ๐ป๐ด๐น๐ฒ๐ฑ ๐๐ฟ๐ฎ๐ถ๐ป
Annual reminder that the book is open access.
How do we think of the brain as a deeply interconnected system with highly distributed, non hierarchical processing.
Want to learn about the brain from a fresh perspective?
#neuroskyence
mitpress.mit.edu/978026254460...
Hi RL Enthusiasts!
RLC is coming to Montreal, Quebec, in the summer: Aug 16โ19, 2026!
Call for Papers is up now:
Abstract: Mar 1 (AOE)
Submission: Mar 5 (AOE)
Excited to see what youโve been up to - Submit your best work!
rl-conference.cc/callforpaper...
Please share widely!
A new, long paper on evolution - natural induction - split into 2:
royalsocietypublishing.org/rsfs/article...
royalsocietypublishing.org/rsfs/article...
@RichardWatson90 and Tim Lewens