Zachary Lipton's Avatar

Zachary Lipton

@zacharylipton.bsky.social

Cofounder & CTO @ Abridge, Raj Reddy Associate Prof of ML @ CMU, occasional writer, relapsing 🎷, creator of d2l.ai & approximatelycorrect.com

9,569 Followers  |  198 Following  |  78 Posts  |  Joined: 19.05.2023  |  1.9216

Latest posts by zacharylipton.bsky.social on Bluesky

We’ll know he’s really made it when Alcatraz gets autocorrected to Alcaraz.

15.09.2025 06:04 β€” πŸ‘ 5    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Small idiosyncratic language errors in otherwise clear technical papers are now a plus; assurance that I'm not wasting my time trying to read GPT spam. #neurips2025

05.07.2025 23:56 β€” πŸ‘ 59    πŸ” 5    πŸ’¬ 2    πŸ“Œ 0

Spent the whole day reading unlearning papers. If any of the methods worked, I might hope to recover from the experience.

30.06.2025 07:33 β€” πŸ‘ 8    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Final 5m of NBA games solved. If you foul:
β€’ opposing team gets 1 FT
β€’ & keeps possession w fresh 24
Next up, Israel/Palestine.

30.05.2025 01:42 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image Post image 10.05.2025 01:20 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Google miles behind Open/Anth til overnight boom 2.5.
Mosaic models underwrite $1B until boom mothballed.
Deepseek turns world upside down, but only for 5min.
The speed at which the winds turn here is truly wild.

10.05.2025 00:54 β€” πŸ‘ 16    πŸ” 0    πŸ’¬ 2    πŸ“Œ 0
Post image

What problem were airplane designers hoping to solve when they proposed this monstrosity?

06.05.2025 01:50 β€” πŸ‘ 6    πŸ” 0    πŸ’¬ 2    πŸ“Œ 0

50M human hours have been spent adjusting airplane seats into upright position before takeoff, saving a grand total of 0 human lives

03.05.2025 03:34 β€” πŸ‘ 16    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Unlike OpenAI, ostensibly controlled by a powerful holding entity, here have effectively 0 board power. This saga's shaping up like the Asimov's Spacer novels, but instead of each book exploring a different ratio of humans to robotic servants, it's a different level of corporate oversight.

30.04.2025 01:20 β€” πŸ‘ 7    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Thinking Machines Lab CEO Has Unusual Control in Andreessen-Led Deal It’s common nowadays for founders of hot startups to hold special shares that give them more voting power than most investors. But Mira Murati, a former OpenAI chief technology officer who is now a fo...

OpenAI folks getting creative about corporate governance. I've seen this movie before...

www.theinformation.com/articles/thi...

30.04.2025 00:23 β€” πŸ‘ 6    πŸ” 0    πŸ’¬ 0    πŸ“Œ 1

We even found that sometimes with deep nets imputing 0 is better than running a fancy imputation algorithm because it’s more obvious which values are imputed so there’s less destruction of information.

23.04.2025 08:29 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Yeah, it makes sense, it gives you all the info you have. A powerful enough model can learn any reasonable imputation strategy implicitly.

23.04.2025 08:27 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 2    πŸ“Œ 0

Taking me back to 2016 baby. proceedings.mlr.press/v56/Lipton16...

In some clinical tasks the indicators are so useful, they’re almost as informative as the features themselves.

23.04.2025 07:59 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

On my way to Singapore for #iclr2025. Excited to pop my head out of AI product development to get inspired, connect w the next generation of researchers, and also for food. hmu

23.04.2025 07:56 β€” πŸ‘ 10    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Thus the β€œcontroversiality”. Point is, hard to imagine any non-political reason to get any other compact EV than a tesla. Seems like nobody is even close, which i found surprising given the growing market.

07.03.2025 06:20 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Controversial opinion. It’s impossible to lease an EV in the US that’s even half as good a deal as @Tesla model 3/Y.

07.03.2025 02:41 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 2    πŸ“Œ 0

Plugin that automatically clicks thru "reject" to select "only strictly necessary" on the cookie pop-ups. πŸ’΅

28.02.2025 12:46 β€” πŸ‘ 30    πŸ” 0    πŸ’¬ 3    πŸ“Œ 0

CTO’s the most slippery title in the world. Depending on the company, you’re either

1. A technical founder who never wanted to manage, now an IC engineer
2. A VP of Engineering
3. Leading all of EPD (+AI)
4. An influencer with no internal responsibilities

25.02.2025 14:37 β€” πŸ‘ 14    πŸ” 1    πŸ’¬ 3    πŸ“Œ 0

what sort of model was involved in the retrieval step?

16.02.2025 23:30 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Just as the jaws of tetragenarianism are closing in, stole this W from the jaws of impending awardless decrepitude.

10.02.2025 14:43 β€” πŸ‘ 9    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

...you’re thinking about infrastructure, user experience, orchestration, governance, and automation at scale. That’s a different game altogether."

07.02.2025 20:24 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

per ChatGPT:

"AI is no longer just β€œmachine learning at scale.” It’s a full-stack engineering and economic transformation, where ML is just one piece of the puzzle. If you’re building modern AI systems, you’re thinking beyond MLβ€”...

07.02.2025 20:24 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Phase 1 of my research career: "ML" = rebranding of the successful subset of AI.

Phase 2: "AI" = rebranding of the successful subset of ML.

Phase 3: AI & ML truly starting to diverge.

07.02.2025 20:24 β€” πŸ‘ 12    πŸ” 0    πŸ’¬ 2    πŸ“Œ 0

Can't find any person or AI that can explain Luka β†’ Lakers. Only satisfying theory I can conjure: behind-the-scenes feud β†’ "calf strain" masking a relationship strain β†’ trade demand. But according to ChatGPT's research, Luka was blindsided by the trade.

03.02.2025 05:04 β€” πŸ‘ 8    πŸ” 1    πŸ’¬ 2    πŸ“Œ 0

Just another boring week in the AI capabilities landscape.

27.01.2025 16:28 β€” πŸ‘ 14    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

How to **efficiently** build personalized language models **without** textual info on user preferences?

Our Personalized-RLHF work:
- light-weight user model
- personalize all *PO alignment algorithms
- strong performance on the largest personalized preference dataset

arxiv.org/abs/2402.05133

14.12.2024 17:02 β€” πŸ‘ 12    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0

First #runconference @neuripsconf.bsky.social #NeurIPS2024 was great! Will share tomorrow's deets later today, join us!
@zacharylipton.bsky.social @adamjelley.bsky.social @random-steve.bsky.social

10.12.2024 16:49 β€” πŸ‘ 29    πŸ” 2    πŸ’¬ 2    πŸ“Œ 1

optimizing for inclusivity, pace depends on crowd, never crazy, maybe as fast as 8:00 miles, as slow as 10:00, depending on the crowd

09.12.2024 22:52 β€” πŸ‘ 5    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

caught red-handed

09.12.2024 14:07 β€” πŸ‘ 7    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

@zacharylipton is following 20 prominent accounts