Sorry. I didn't mean to imply the oldest is the most important. Usually, the oldest is the first to be proven wrong. I was just saying it's therefore worth knowing about if only to avoid bringing it back up as a "new" idea.
08.09.2025 21:14 โ ๐ 3 ๐ 0 ๐ฌ 0 ๐ 0
Those who don't know history are doomed to repeat it. And for those who do know history, it is frustrating (to say the least) to see the same mistakes made over and over.
08.09.2025 17:04 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
Dude, _nothing_ is ever proven in science. Proof is strictly the purview of logic. More concretely: The limitations of transformers as models of human language use are still being revealed. There will be no time, _ever_, when we can definitively say they have all been demonstrated.
08.09.2025 17:01 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
This is a big part of why systems trained by back propagation will necessarily fail. To such systems "meaningful properties" are simply "statistical regularities in the training set", which are a degenerate case, in part because they cannot represent meaningful invariants: arxiv.org/pdf/2508.15082
07.09.2025 16:58 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
This is a big part of whyy systems based on back propagation will always fail. To them, "meaningful property" means "statistical regularity". But statistical regularities are a degenerate case of meaningful. This is why modern AI is barking up the entirely wrong tree. See arxiv.org/pdf/2508.15082
07.09.2025 16:55 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
This is a big part of why systems based on back propagation will always fail. To them, "meaningful property" means "statistical regularity". But statistical regularities are a degenerate case of meaningful. This is why modern AI is barking up the entirely wrong tree. See arxiv.org/pdf/2508.15082
07.09.2025 16:54 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
And a d repro'n of a task may consist of l rep's of its components. The important question is not d vs. l but whether the neurons code for meaningful properties of the system's universe. If yes, then you have biological intelligence; if no, then you have a deep net or an LLM.
07.09.2025 16:50 โ ๐ 0 ๐ 0 ๐ฌ 3 ๐ 0
The question of whether a representation is distributed, d, or localist, l, is ill posed. You have to specify d or l _with respect to what_. A "distributed" representation of an object may consist of neurons that locally code the object's properties.
07.09.2025 16:49 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
I do not think this means what you seem to think it means. You seem to be celebrating the refutation of a claim absolutely no one makes. The "claim" you're refuting is disproved by every fMRI study that has ever been done. As Bowers noted, no one claims just a single neuron responds to anything.
04.09.2025 18:16 โ ๐ 2 ๐ 0 ๐ฌ 1 ๐ 0
Director, Centre for the Sciences of Place & Memory, Stirling Uni, Scotland. Skill, memory, embodied cognition, philosophy, cognitive history, cricket, music, collaboration, wayfinding. Leverhulme International Prof: johnsutton.net & placememory.net
Progressive Democrat. ๐บ๐ธ๐ง๐ฟ๐ณ๏ธโ๐ Blue dot in a purple mitten.
#Photographer. ๐. Boomer. Atheist. Meditation saves lives. Living w/stage-4. No profile + No posts = No followback.
NO AI
NO RELIGION
NO MAGA
NO PORN
NO DMs.
#photographersunited
Academic, geek and aspiring musician!
Computational cognitive neuroscientist at University of Nevada, Reno. Uses fMRI to study visual representations of objects, scenes, and bodies, and how attention affects them. Dad. Nerd since before it was cool. Likes pretty science pictures & puns. He/him
47 peer review cycles taught me that nothing is ever novel enough. Now I archive the academic violence for posterity.
Professor and cognitive neuroscientist. Functional neuroimaging of concept representation and language-based communication.
History of Science/Philosophy of Science/Cognitive Science, ex-chemistry+philosophy student, Department of History of Science, Tsinghua University๐งธ๐ฐ๏ธ
Clinical psychologist and researcher investigating anxiety disorders, Acute PTSD, dissociations, OCD, Affective Neuroscience, neuropsychoanalysis, application of nonlinear dynamical systems to psychology
https://montgomerycountypsychologist.com
The Centre for Logic and Philosophy of Science (CLPS) at the Institute of Philosophy (@kuleuvenuniversity.bsky.social) focuses on #logic and #philsci, with a concentration on the philosophies of the special sciences โข https://hiw.kuleuven.be/clps #philsky
Postdoc @ Princeton AI Lab
Natural and Artificial Minds
Prev: PhD @ Brown, MIT FutureTech
Website: https://annatsv.github.io/
Biostatistician @IDEXX formerly at harvardmed, @BIDMChealth, @nasa. Big data, clinical trials, and medical diagnostics. Mainer. Opinions are my own. he/him
Researcher at Google and CIFAR Fellow, working on the intersection of machine learning and neuroscience in Montrรฉal (academic affiliations: @mcgill.ca and @mila-quebec.bsky.social).
Animal & Ocean lover, activist, vegan & 4 x cancer survivor ~
DONโT GIVE IN TO THE LIES. DONโT GIVE INTO THE FEAR. HOLD ON TO THE TRUTH โฆ & HOPE ๐ฆ๐
~ Good Trouble ~ FAFO ~
#RESIST
Lover of music ๐ถ๐ผ~ dance ~ books ๐๐ซDMโs
Straight but NOT narrow
I know a lot about behavioral neuroscience ๐ง , model thinking ๐, & business. | 27k on TikTok (main page) | BlueSky & YouTube will be my main platforms if TT gets banned๐๐ฟ
All my links: brainpal.co/bio
Picower Professor of Neuroscience @ MIT
Cognitive neuroscience, executive brain functions, consciousness, and bass guitar. You know, the good stuff.
ekmillerlab.mit.edu
Co-founder, Neuroblox
https://www.neuroblox.ai/
Neuroscientist, writer, speaker, first female EIC of the Journal of Comparative Neurology, interested in human and brain evolution, doesn't understand the race to have AI make ourselves obsolete. Intelligence is flexibility, and life is whatever works.