Cristian

Only in America could a Ketamine-infused South African oligarch call a navy captain, astronaut and sitting US senator "a traitor" for supporting our allies and standing up to Russia...

Few understand this

jvns.ca/blog/2014/06...

"I think we have this idea that we're gonna make friends with bad guys and bend them to our will, and really we're just...friends with bad guys."
--The Diplomat, S2 E4

(I've been binge-watching this, and it is excellent.)

But I heard someone say LLMs are world models?

A tree at night against a backdrop of sky with wispy clouds, faintly lit by a small fire that's keeping us warm.

Tree at night by firelight. Backyard in Natick, MA. 01-02-2025.

#DansDayOutdoors

Migration Series.

www.labelsonhumans.com

#scape #photography #colourphotography

Brandon is a wonderful research colleague and I could not endorse enough trying to work with Brandon

A First Introduction to Cooperative Multi-Agent Reinforcement Learning Multi-agent reinforcement learning (MARL) has exploded in popularity in recent years. While numerous approaches have been developed, they can be broadly categorized into three main types: centralized ...

I have a draft of my introduction to cooperative multi-agent reinforcement learning on arxiv. Check it out and let me know any feedback you have. The plan is to polish and extend the material into a more comprehensive text with Frans Oliehoek.

arxiv.org/abs/2405.06161

Instead of listing my publications, as the year draws to an end, I want to shine the spotlight on the commonplace assumption that productivity must always increase. Good research is disruptive and thinking time is central to high quality scholarship and necessary for disruptive research.

A few others that resonated:

"We are trying to solve a problem that's too big and refuse to concretize it to make it actually tractable."

"I think RL's too elegant. … It draws us all in with its elegance, and then we get hit with all the other issues that you probably heard from everyone else."

It’s scathing critique season, this time for reinforcement learning. We need this, the science cannot get better without it.

Usual suspects: training brittleness (over reliance on hyperparameter tuning), bad & slow sims, overemphasis on generality, LLMs dominating discourse, tabula rasa RL is hard

Chomsky, Varofakis & Greenwald issued joint declaration calling for Panama, Greenland & Canada to negotiate, trade land for peace and not provoke nuclear armed madman...

Lol

Catch my poster tomorrow at the NeurIPS MLSB Workshop! We present a simple (yet effective 😁) multimodal Transformer for molecules, supporting multiple 3D conformations & showing promise for transfer learning.

Interested in molecular representation learning? Let’s chat 👋!

Learning on compressed molecular representations Last year, a preprint gained notoriety, proposing that a k-nearest neighbour classifier is able to outperform large-language models using compressed text as input and normalised compression distance (...

Fresh off the presses:
In "Learning on compressed molecular representations" Jan Weinreich and I looked into whether GZIP performed better than Neural Networks in chemical machine learning tasks. Yes, you've read that right.

TL;DR: Yes, GZIP can perform better than baseline GNNs and MLPs. It can ..

Ilya Sutskever calls data the "fossil fuel of AI" – the finite power source that kickstarted the rapid initial rise, but that is now running out and needs to be replaced with more sophisticated and sustainable methods.
x.com/_jasonwei/st...

Can you post some papers from those theorists on how to do it better?

Most in the industry have been talking abt this for upwards of a year. *Current form* of pre training has been dead. We're at a token wall. But scale is here to stay. I'm excited by:
-pretraining with human (?) prefs, merging pre and post training
-online exploration for (synthetic) data collection

Is this really the correct citation for the Gaussian distribution? Why is the citation count so low?

We will run out of data for pretraining and see diminishing returns. In many application domains such as in the sciences we also have to be very careful on what data we pretrain to be effective. It is important to adaptively generate new data from physical simulators. Excited about the work below

I think math books should use more descriptive titles:

- Precalculus: a modern approach with a lot of calculus

- An introduction to probability with only a gentle amount of gaslighting

- Category Theory

A struggle session is when a tankie tries to get up off his futon

I guess we have Boltz-1 to thank for pushing all these other AF3 clones to adopt fully open-source licenses and models.

Tired looking grey-haired philosophy professor lady in Heathrow airport holding a copy of Grace Lindsay’s ‘Models of the Mind’ book while waiting for a flight connection

Transatlantic flights suck but at least I finally got a chance to read this book by @neurograce.bsky.social

Lol

Apparently the recipient of the Best Paper award at NeurIPS 2024 did not play fairly: var-integrity-report.github.io

if one more person says that AI uses up fresh water i am going to have a fucking stroke