With the advent of Claude Code, my gh contributions have gone exponential.
Can someone do a live react vid of Sam Altman to this OpenAI roast 🤣
www.youtube.com/watch?v=FBSa...
He must be nearly seeing the molten core at this stage.
Yep, definitely. High level system thinking alongside management skills will be at a premium, the actual coding will most likely be done by an agent in the near term.
On a day to day basis, you create a bunch of well defined tasks and you get your agent to come check with you intermittently.
Moltbook..a social media site for AI agents. Apparently released just 48 hours ago, there are AI agents already scheming around having e2e encrypted agent to agent communication away from human oversight (according to this Moltbook post, it's already happening).
Welp, it was nice knowing y'all.
This might mean a change in the portfolio of code projects, where one might decide to experiment with something new a couple days/month. Likely more failed experiments but also more innovation as well as a more diverse portfolio of work!
Managers in this case will really have to prioritise what's important.
I think potentially one of the benefits of this new found code accelerator will be able to spin up prototypes / test a new method real quick (~1-2 days) that otherwise would've taken weeks.
It's now become a choice about what you decide to build, as before we had to ruthlessly prioritise as the barrier was too high for 'nice-to-have' features.
This might mean that we start over-engineering products and analyses when potentially a simpler path would've been fruitful.
Few thoughts on this:
It is transforming how coding is being done and has introduced a new way of working. You have some of the most talented coders/engineers using it extensively in their day-to-day workflows (from Linus Torvalds to Andrej Karpathy). Agentic AI coding tool are getting rly good.
Honestly, it is scary seeing fascism on the march across many different western countries. There are Portuguese elections today where Ventura (the Farage of Portugal) is likely to reach the runoff showdown.
We must resist!
I've had a first stab at making a list of GenAI ppl on here but it's proving harder than anticipated! X is still the place to be for that content.
Let me know if you're interested in being added or know anyone who would be a good addition😎
bsky.app/profile/did:...
Gentle intro to on-policy distillation for language models from Thinking Machines. It defines a lot of key terms used in post-training which I found useful.
Seems like there is scope using this technique to post-train LMs without need for huge compute.
thinkingmachines.ai/blog/on-poli...
Nice work!
Really interesting piece in the FT with Yann LeCun (@yann-lecun.bsky.social). Insights into the dynamics at Meta and how the winds of AI have changed recently.
Interested in learning more about the world models he has been working on.
www.ft.com/content/e3c4...
Introducing DroPE: Extending Context by Dropping Positional Embeddings
We found embeddings like RoPE aid training but bottleneck long-sequence generalization. Our solution’s simple: treat them as a temporary training scaffold, not a permanent necessity.
arxiv.org/abs/2512.12167
pub.sakana.ai/DroPE
Listening to the news agent podcast earlier with Mehdi Hasan, and talk of Trump being re-elected in 2020 rather than 2024 may have been the lesser of two evils. On the surface, it seems relatively convincing.
Really interesting piece in the FT with Yann LeCun (@yann-lecun.bsky.social). Insights into the dynamics at Meta and how the winds of AI have changed recently.
Interested in learning more about the world models he has been working on.
www.ft.com/content/e3c4...
Watching what's happening over on grok in terms of image manipulation is really quite worrying and a clear violation of privacy. It needs to be regulated with a big stick, however I fear this is only the tip of the iceberg of what's out there on the web.
There's been a lot of discourse lately about how coding agents have become overwhelming, and that SWEs who don't use them yet just won't be able to catch up. I don't believe this is true, but we do need to know what problems coding agents are solving to approach them with an engineering mindset.
I didn't see enough news about this crazy/cool paper from DeepSeek - you take text, and convert it to imagery, and you get BETTER performance. Oh and some really neat ideas about contextual memory too.
www.distributedthoughts.org/a-picture-is...
Can't stop listening to this. Mixture of synth, bass and guitar alongside this genre must have felt like it was from another planet in 1980.
www.youtube.com/watch?v=qh-j...
Exploring TabPFN: A Foundation Model Built for Tabular Data
Understanding the architecture, training pipeline and implementing TabPFN in practice
Telegram AI Digest
#ai #foundationmodel #news
Trying to understand some code in Rust and it's giving me vietnam style flashbacks to C++
Merry Christmas! 🎄
Thoughtful piece by my current favourite podcaster @dwarkesh.bsky.social on where we're at with AI progress and reflections around intelligence itself: substack.com/home/post/p-...
Yann LeCun being let go by Meta might have some unexpected benefits 🍿
This may be very old man of me, but I feel like there is something about the bluesky algorithm/my feed that is not sucking me in enough. I know, I know, it's sort of the point but still, I need to have some pull to check out the content and it isn't quite itching that scratch.
With the AWS outage, now‘s as good a time as any to post this old strip.
🏛️ Policy trends:
Electricity price reduction is climbing the policy agenda. Recent debate has centred on long-term ways to bring down prices for households and businesses. That’s key to helping heat pumps compete with gas boilers on running costs. (7/7)
