jeffcarp

A Waymo vehicle was driving in a 25mph zone in LA when an oncoming car swerved into its lane while speeding up to over 70mph… 3x the speed means 9x the destructive energy.

Waymo vehicle reacted safely.

Source: Dmitri Dolgov (Co-CEO at waymo)

Awesome LLM Post-training

This repository is a curated collection of the most influential papers, code implementations, benchmarks, and resources related to Large Language Models (LLMs) Post-Training Methodologies.

github.com/mbzuai-oryx/...

Are you aware 94% of traffic fatalities are caused by human error?

Thanks for reposting my video. I think Waymo also solves the critical urban problem of literally not having people dying every day for no reason

I’ll take a look!

How to Scale Your Model

This book aims to demystify the science of scaling language models on TPUs: how TPUs work and how they communicate with each other, how LLMs run on real hardware, and how to parallelize your models during training and inference so they run efficiently at massive scale.

That immigrants, from China, India, Iran, Latin America, and so many places choose to come here is a blessing and a gift. That this needs to be said and that politicians ever make them feel otherwise is an eternal disappointment.

A vision researcher’s guide to some RL stuff: PPO & GRPO by Yuge (Jimmy) Shi

This is a deep dive into Proximal Policy Optimization (PPO), which is one of the most popular algorithm used in RLHF for LLMs, as well as Group Relative Policy Optimization (GRPO) proposed by the DeepSeek folks.

Same, I love seeing spelling errors now, they’re so human

A guide to JAX for PyTorch developers | Google Cloud Blog PyTorch users can learn about JAX in this tutorial that connects JAX concepts to the PyTorch building blocks that they’re already familiar with.

The PyTorch developer's guide to JAX fundamentals cloud.google.com/blog/product...

For next time, consider rsync to copy files in parallel

#2025 is the sum of the first 9 cubes 🤩

1+8+27+64+125+216+343+512+729 🥂 🎉 🎆 🎇 🧮

Charting the Shapes of Stories with Game Theory Stories are records of our experiences and their analysis reveals insights into the nature of being human. Successful analyses are often interdisciplinary, leveraging mathematical tools to extract str...

Would be fascinated to learn how this paper came into being given the authors on it: arxiv.org/abs/2412.05747

Research scholar program Overview

Applications open on Dec 20 for the #Research Scholar program, which aims to strengthen long-term collaboration with the academic community by supporting early-career professors pursuing research in fields relevant to #Google. Learn more & apply by Jan 27 ↓

research.google/programs-and...

A good advice from Victor Dibia

A short list of tips for keeping a clean, organized ML codebase for new researchers: eugenevinitsky.com/posts/quick-...

If you like Pyrallis you might also want to look at Fiddle, which goes one step further and uses the model classes themselves as config (skipping the need for extra dataclasses).
fiddle.readthedocs.io/en/latest/

If machine learning is the high-interest credit card of technical debt, quantization is the back alley predatory loan

Release 0.7 · simonw/llm-gemini New Gemini 2.0 Flash model: llm -m gemini-2.0-flash-exp 'prompt goes here'. #28

Gemini 2.0 is out, and there's a ton of interesting stuff about it. From my testing it looks like Gemini 2.0 Flash may be the best currently available multi-modal model - I upgraded my LLM plugin to support that here: github.com/simonw/llm-g...

Gemini 2.0 announcement: blog.google/technology/g...

Adds initial support for an MLX backend by angeloskath · Pull Request #18962 · keras-team/keras This PR adds an MLX (https://github.com/ml-explore/mlx) backend as mentioned also in #18901 . A lot of things are still missing but my initial goal was to be able to pass the trainer and backend te...

There has been ongoing work to add one, you can follow along here:
github.com/keras-team/k...

Going full circle: in 2019 Waymo made an April Fools video about a dog-only robotaxi service. Now people are actually sending their dogs in Waymo unattended.
youtu.be/ljbeFpOHvEA?...

Reinforcement Learning: An Overview

This manuscript gives a big-picture, up-to-date overview of the field of (deep) reinforcement learning and sequential decision making, covering value-based RL, policy-gradient methods, model-based methods, and various other topics.

arxiv.org/abs/2412.05265

Looking back at the first year of the Gemini era Google's Gemini family of AI models has empowered developers to build innovative applications and explore its journey over the first year.

Happy Birthday to Gemini! ✨🎂

Around this time last year, I was working on the Gemini Launch and it was exciting to have access to such models

After one year I've learned a lot and I'm still amazed of what can be done!

best feature: 2M context window 🤯

developers.googleblog.com/en/looking-b...

I’m late to the game here, but super impressed this UI is an open source React Native app, the framework has come a long way!

Google Colab

It's possible to access token embeddings directly in KerasHub models - would something like this work for you?
colab.research.google.com/drive/1HaKXa...

Derek Sivers once said “Mastery is the best goal because the rich can’t buy it, the impatient can’t rush it, the privileged can’t inherit it, and nobody can steal it. You can only earn it through hard work. Mastery is the ultimate status.”

Does it still hold in the age of LLMs? 😎

Paligemma2 is out! Bigger models, better results. For the best experience, do not forget to finetune.

Congrats Paligemma2 team!

Hi Bluesky! Any AI/ML following recommendations?