Neil Traft's Avatar

Neil Traft

@ntraft.bsky.social

PhD student at the Vermont Complex Systems Institute. Interested in ML, evolution, self-organization, & collective intelligence. http://ntraft.com https://t.co/ja3fdtRLdM

391 Followers  |  251 Following  |  224 Posts  |  Joined: 27.07.2023  |  2.2284

Latest posts by ntraft.bsky.social on Bluesky

Just wait till you hear about 0's decision...

03.08.2025 21:54 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Even here, they miss the point. They somehow don't realize there is no universal alignment. Our species is a collectiveβ€”a collective of collectives, even. To be "aligned" is just to be part of the collective; an integrated whole. Which requires us *all* to participate in building & integrating AI.

03.08.2025 16:23 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

OpenAI, of all companies, should know this.

Ah, but they were not *exactly* created to further AI technology. They were created specifically to secure against the mythical AI End Times, the Apocalypse. So they closed down rather than opening up.

03.08.2025 16:23 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

The best thing a company could possibly do is to create an ecosystem around its technology. Everyone claims to want to be "a platform, not a product". But their behavior belies their big words.

"Platform" should mean an open foundation for building. Not a limited-use API gateway.

03.08.2025 16:23 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

With its focus on short term profitability, the US has forgotten how to make markets competitive. And companies have forgotten that they are only *vehicles* for the final product, not ends in themselves.

03.08.2025 16:23 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

As long as we agree that no state space is truly markovian, I can get behind that! πŸ˜›

03.08.2025 12:13 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

What do you mean exactly? Can a state space be fully observable, yet incomplete? Or are you just referring to unknown transition function or something else?

03.08.2025 11:10 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Good news, those are all partially observable, so you get to keep those! πŸ˜‰

In retrospect I should have said RL should never be *framed* any other way... Except for maybe a chess game.

03.08.2025 11:06 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
kermit the frog is using a typewriter in a messy room . ALT: kermit the frog is using a typewriter in a messy room .

I’m very excited to announce that I’ve just signed a contract with @princetonupress.bsky.social for a new book, tentatively titled β€œThe Genomic Code” πŸ“– 😊

01.08.2025 17:10 β€” πŸ‘ 126    πŸ” 9    πŸ’¬ 6    πŸ“Œ 0

In reality, all environments are only partially observable, so this is the only regime in which RL should be evaluated.

03.08.2025 00:42 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 2    πŸ“Œ 0

Hmm, I guess at that point I'd call it something other than "LLM" and "Transformer"; even if we accidentally use the same name it seems to me that would constitute a significantly different system. So I still think this is a core justification for why the current paradigm will never be enough.

31.07.2025 12:31 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Guessing you're talking about a situation where there are multiple equally-good opportunities to turn, so Google should say something like, "if current light is green, keep going; else, take the turn now"?

31.07.2025 03:16 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

I've always held that the ideal attitude for a PhD is, "the experience of doing a PhD is worthwhile in and of itself, regardless of what comes after". Even if you continue as a researcher, you may never have as much freedom to learn/explore as you do now. (Assuming a good advisor.)

31.07.2025 03:10 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0

Send like a useful framework. Looking forward to reading this new position paper.

30.07.2025 00:31 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Wonder if a truck and a car count as different embodiments? Probably still workable even if not. But maybe sedan & pickup = same embodiment; tractor-trailer = different embodiment.

29.07.2025 22:09 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I just realized that the "AI scientist" vision is all about this "collecting of facts", like packrats or crows.
bsky.app/profile/ntra...

29.07.2025 18:03 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

And you would think that this would finally be our chance to focus on that now that we have language models! They could actually be very good at explanation… If they actually β€œunderstood”, that is.

29.07.2025 17:58 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

It's quite revealing... in tech circles nowadays we are so fixed on the conception of "science as innovation", completely leaving behind the other half of science, fundamental understanding.

29.07.2025 17:58 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image Post image Post image Post image

I just realized that all these hyped-up β€œAI scientist” concepts all concentrate on the idea of *discovery*β€”new algorithms, new materials, new productsβ€”without exception. Not a one of them focus on *understanding*β€”arguably the larger role of a scientist! 🧐

29.07.2025 17:58 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 1    πŸ“Œ 1

So, you need *some* adaptability to changes in body type. But I don't know exactly how far "one brain, any embodiment" folks would want to push that. It does sound extreme.

29.07.2025 17:34 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

On the flip side, if each brain is so specific to its embodiment that, e.g., every time you want to tweak the sensors on your self-driving car you need to *completely re-gather all data from all cities and make all new maps*, then this would be pretty devastating to that use case, no?

29.07.2025 17:34 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 2    πŸ“Œ 0

Ehhhh, no I unfortunately don't think so, because if someone is doing "the right thing for the wrong reasons" then they will absolutely be led astray into doing the wrong thing, usually sooner rather than later. Depends on the severity of their wrongness, perhaps.

29.07.2025 00:57 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Team from the University of Vermont + External faculty posing for a picture by a river

Team from the University of Vermont + External faculty posing for a picture by a river

VCSI executive director announcing location for the conference in 2026, standing on a large stage with colleagues

VCSI executive director announcing location for the conference in 2026, standing on a large stage with colleagues

female scholar presenting a parallel talk, engaging with the audience

female scholar presenting a parallel talk, engaging with the audience

PhD student presenting a research poster

PhD student presenting a research poster

Proud of our team's talks and posters at #IC2S2 in NorrkΓΆping Sweden - what a great week. We're excited to host next year in Vermont!

25.07.2025 11:13 β€” πŸ‘ 10    πŸ” 3    πŸ’¬ 0    πŸ“Œ 1
Preview
Women Dating Safety App 'Tea' Breached, Users' IDs Posted to 4chan β€œDRIVERS LICENSES AND FACE PICS! GET THE FUCK IN HERE BEFORE THEY SHUT IT DOWN!” the thread read before being deleted.

We are going to spend the next few years finding out exactly *why* it was a horrible idea to unleash a tsunami of vibe-coded apps made by idiots and scammers on an unprepared world.

Welcome to the Entirely Foreseeable AI Consequences Era.

26.07.2025 01:46 β€” πŸ‘ 983    πŸ” 299    πŸ’¬ 25    πŸ“Œ 20

Apparently Papers With Code was abruptly sunsetted for reasons that are unclear. 😒

26.07.2025 11:33 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Trending Papers - Hugging Face Your daily dose of AI research from AK

😞 So sad to see paperswithcode is discontinued – but grateful that the @hf.co team is, as always, stepping up to support the community!

It was an incredible resource for use cases, common themes in papers, and visualizing how models have improved on evals over time:

huggingface.co/papers/trend...

25.07.2025 12:57 β€” πŸ‘ 18    πŸ” 6    πŸ’¬ 0    πŸ“Œ 1
Post image

Been studying Mixture of Experts recently. It's baffling to learn that typically different tokens are routed to *different* experts. How can you be an "expert" at a particular word?? I suspect this name lends us very poor intuition for what these models actually do!

(shows 2 tokens and 4 "experts")

25.07.2025 12:56 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

There are people, in tech (and now in the government!), who will mislead you about what current AI models are capable of. If we don't call them out, they'll drag us all down.

23.07.2025 20:01 β€” πŸ‘ 20    πŸ” 6    πŸ’¬ 3    πŸ“Œ 0

more evidence for β€œa bunch of AI cultists dismantled large parts of the federal government because they believed that their LLMs were intelligent and could do the work better” thesis

23.07.2025 17:51 β€” πŸ‘ 8859    πŸ” 2676    πŸ’¬ 171    πŸ“Œ 78

He's absolutely drunk with power... and summer tomatoes

24.07.2025 00:45 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

@ntraft is following 20 prominent accounts