Anselm Levskaya's Avatar

Anselm Levskaya

@levskaya.bsky.social

Doing spooky things with linear algebra.

1,564 Followers  |  251 Following  |  7 Posts  |  Joined: 31.05.2023  |  1.8165

Latest posts by levskaya.bsky.social on Bluesky

Oh gods - let us know in DMs or otherwise how weโ€™re the source of suffering.

07.06.2025 09:30 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

What unholy artifact is asking you to do that?

07.06.2025 09:21 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

My "early-career" developer feelings are complicated and alienating to SFBA-type career ladder people.

04.06.2025 19:20 โ€” ๐Ÿ‘ 15    ๐Ÿ” 1    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Graph claiming to show a decline in groundbreaking discoveries flatlines for the life sciences around zero from about 1996 onwards.

Graph claiming to show a decline in groundbreaking discoveries flatlines for the life sciences around zero from about 1996 onwards.

If your test for ground-breaking discoveries canโ€™t detect the discovery of RNAi, or of CRISPR-Cas9, or the cryoEM resolution revolution or Alphafold2, maybe itโ€™s not a very good test.
www.nature.com/articles/d41...

23.05.2025 17:32 โ€” ๐Ÿ‘ 183    ๐Ÿ” 34    ๐Ÿ’ฌ 15    ๐Ÿ“Œ 10

At some point, the fact that over a billion people use this technology and that they self-report high utility has to mean something.

There is lots to criticize about AI and plenty of real issues caused by AI, but the narrative that this is all a fake thing that will disappear doesn't help anyone.

20.05.2025 15:54 โ€” ๐Ÿ‘ 47    ๐Ÿ” 7    ๐Ÿ’ฌ 4    ๐Ÿ“Œ 1
Post image

Today, weโ€™re announcing the preview release of ty, an extremely fast type checker and language server for Python, written in Rust.

In early testing, it's 10x, 50x, even 100x faster than existing type checkers. (We've seen >600x speed-ups over Mypy in some real-world projects.)

13.05.2025 17:00 โ€” ๐Ÿ‘ 331    ๐Ÿ” 84    ๐Ÿ’ฌ 14    ๐Ÿ“Œ 14

This isn't true. I'm the person who ran the experiments this is BSing about. When search results are worse, people attempt fewer tasks. When they're better they attempt more.

12.05.2025 01:05 โ€” ๐Ÿ‘ 256    ๐Ÿ” 54    ๐Ÿ’ฌ 9    ๐Ÿ“Œ 16

LETโ€™S FUCKING GOOOO THE MOST AMBITIOUS HOUSING BILL IN THE HISTORY OF THE STATE OF CALIFORNIA HAS ADVANCED OUT OF COMMITTEE

23.04.2025 00:40 โ€” ๐Ÿ‘ 331    ๐Ÿ” 32    ๐Ÿ’ฌ 8    ๐Ÿ“Œ 2
Post image

@zey.bsky.social Iโ€™m not on the site with Nazis anymore โ€” wtf are you saying about me over there?

You know thereโ€™s new data on the origins question, right?

12.04.2025 19:08 โ€” ๐Ÿ‘ 40    ๐Ÿ” 8    ๐Ÿ’ฌ 4    ๐Ÿ“Œ 2
Excerpts from 1st and 2nd editions of VIRAL by Alina Chan and Matt Ridley. A sentence is highlighted that was removed once it was no longer true. Their conclusions did not change.

Excerpts from 1st and 2nd editions of VIRAL by Alina Chan and Matt Ridley. A sentence is highlighted that was removed once it was no longer true. Their conclusions did not change.

Excerpts from 1st and 2nd editions of VIRAL by Alina Chan and Matt Ridley. A phrase is highlighted that was removed once it was no longer true. Their conclusions did not change.

Excerpts from 1st and 2nd editions of VIRAL by Alina Chan and Matt Ridley. A phrase is highlighted that was removed once it was no longer true. Their conclusions did not change.

The case for "lab leak" book "VIRAL" by Alina Chan and Matt Ridley leaned heavily on two facts in 2021:
1. The Wuhan Institute of Virology had sampled the virus most identical to SARS-CoV-2
2. SARS-CoV-2 lineage B, but not lineage A, was found in Huanan market

By 2022, neither was true, so...

11.04.2025 16:32 โ€” ๐Ÿ‘ 50    ๐Ÿ” 13    ๐Ÿ’ฌ 3    ๐Ÿ“Œ 18
Post image

My first outing of "The Unbearable Slowness of Being" at the Caltech Chen Neuroscience Workshop today! What does living at 10 bits/s mean for humans, flies, mice, and crows? More here: jieyusz.github.io/talks/2025_c...
Thanks to Profs. @cfcamerer.bsky.social & Carlos for the invite!

12.04.2025 03:49 โ€” ๐Ÿ‘ 8    ๐Ÿ” 3    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

There it is again: using PLMs to predict antigen-epitope interactions from sequence alone yields a prediction accuracy of 0.65, in line with a proposed upper limit from a previous study QTed below (from doi.org/10.1101/2025.02.12.637989; I deleted an older version of this post due to typos/errors)

03.03.2025 05:45 โ€” ๐Ÿ‘ 16    ๐Ÿ” 3    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 0
Preview
The Ultra-Scale Playbook - a Hugging Face Space by nanotron The ultimate guide to training LLM on large GPU Clusters

After 6+ months in the making and over a year of GPU compute, we're excited to release the "Ultra-Scale Playbook": hf.co/spaces/nanot...

A book to learn all about 5D parallelism, ZeRO, CUDA kernels, how/why overlap compute & coms with theory, motivation, interactive plots and 4000+ experiments!

19.02.2025 18:10 โ€” ๐Ÿ‘ 181    ๐Ÿ” 52    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 5

Ceding techno optimism to the right is a generational scale mistake

26.01.2025 14:33 โ€” ๐Ÿ‘ 376    ๐Ÿ” 87    ๐Ÿ’ฌ 18    ๐Ÿ“Œ 14
โ€œFuture kinds of models, both frontier modelsโ€”and also models trained on biological dataโ€”could potentially bring about biological harms with a global impact, like a new pandemic.โ€
Anita Cicero, Deputy Director, Johns Hopkins Center for Health Security

โ€œFuture kinds of models, both frontier modelsโ€”and also models trained on biological dataโ€”could potentially bring about biological harms with a global impact, like a new pandemic.โ€ Anita Cicero, Deputy Director, Johns Hopkins Center for Health Security

AI is revolutionary but it also elicits some of the dumbest LinkedIn takes of all time.

Iโ€™d like this lawyer whose primary expertise is scaremongering for EA money to explain how using โ€œfuture kinds of modelsโ€ starts pandemics.

Outline the model to pandemic pipeline for me.

17.02.2025 13:05 โ€” ๐Ÿ‘ 69    ๐Ÿ” 18    ๐Ÿ’ฌ 3    ๐Ÿ“Œ 2

Well said, @carlbergstrom.com.

I also feel the dismantling of our scientific institutions & funding agencies for basic science is an attack on all scientists, wherever they might be (government or corporate lab, academic institution, ...).

Our collective identities are about advancing knowledge.

09.02.2025 03:50 โ€” ๐Ÿ‘ 75    ๐Ÿ” 7    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Another example of what cutting science funding is doing to our leading university research programs in the U.S.: dismantling things like the Soybean Innovation Lab at UIUC, which have made US crop yields dramatically higher.

09.02.2025 07:14 โ€” ๐Ÿ‘ 436    ๐Ÿ” 160    ๐Ÿ’ฌ 8    ๐Ÿ“Œ 13

Our online book on systems principles of LLM scaling is live at jax-ml.github.io/scaling-book/

We hope that it helps you make the most of your computing resources. Enjoy!

04.02.2025 18:59 โ€” ๐Ÿ‘ 34    ๐Ÿ” 9    ๐Ÿ’ฌ 3    ๐Ÿ“Œ 1

Y'all are just noticing that scientific societies are obsequious cowards on everything except preserving their publishing cash cows?

04.02.2025 18:50 โ€” ๐Ÿ‘ 67    ๐Ÿ” 2    ๐Ÿ’ฌ 5    ๐Ÿ“Œ 1
Post image

Making LLMs run efficiently can feel scary, but scaling isnโ€™t magic, itโ€™s math! We wanted to demystify the โ€œsystems viewโ€ of LLMs and wrote a little textbook called โ€œHow To Scale Your Modelโ€ which weโ€™re releasing today. 1/n

04.02.2025 18:54 โ€” ๐Ÿ‘ 95    ๐Ÿ” 28    ๐Ÿ’ฌ 3    ๐Ÿ“Œ 8
Preview
The New Rasputins Anti-science mysticism is enabling autocracy around the globe.

"When conspiracy theories and nonsense cures are widely accepted, the evidence-based concepts of guilt and criminality vanish quickly too."

www.theatlantic.com/magazine/arc...

07.01.2025 14:29 โ€” ๐Ÿ‘ 3575    ๐Ÿ” 1238    ๐Ÿ’ฌ 127    ๐Ÿ“Œ 151

Re-upping this reply thread from last night. Drugs don't come from nowhere, folks. And we're not ripping off the NIH, either.

06.01.2025 14:36 โ€” ๐Ÿ‘ 78    ๐Ÿ” 23    ๐Ÿ’ฌ 5    ๐Ÿ“Œ 1
A screenshot of a Tweet claiming that OpenAI o1 scored in the top 1%-2% of participants in the Putnam math competition.

A screenshot of a Tweet claiming that OpenAI o1 scored in the top 1%-2% of participants in the Putnam math competition.

There's been a bunch of claims (mostly on X) that ChatGPT did great on this year's Putnam math competition. Let's do a thread to talk about it! ๐Ÿงต

#MathSky

20.12.2024 02:55 โ€” ๐Ÿ‘ 44    ๐Ÿ” 17    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 3

Attached is a piece of art by me for "The Unbearable Slowness of Being: Why do we live at 10 bits/s?"

Hope this will inspire you to think about the brain from a new perspective!

17.12.2024 18:58 โ€” ๐Ÿ‘ 34    ๐Ÿ” 10    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

You really need long (compared to cells) metal antennae for decent radio, and biology never got that good at reducing and templating crystalline metals/alloys.

19.12.2024 04:26 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

AI amplifying biorisk has been a major focus in AI policy & governance work. Is the spotlight merited?

Our recent cross-institutional work asks: Does the available evidence match the current level of attention?

๐Ÿ“œ arxiv.org/abs/2412.01946

04.12.2024 05:05 โ€” ๐Ÿ‘ 59    ๐Ÿ” 12    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 1

In early phase drug discovery, biology and assays are make-or-break. I can remember very few programs I worked on which were hampered by the inability to make molecules, but plenty that were hampered by the inability to capture disease biology complexity on a chip or in an enzyme readout.

15.12.2024 22:51 โ€” ๐Ÿ‘ 79    ๐Ÿ” 13    ๐Ÿ’ฌ 3    ๐Ÿ“Œ 2

All western US water issues are entirely caused by the cultivation of cash crops in places that they shouldn't be grown. Everything, literally everything else, is a rounding error

12.12.2024 02:45 โ€” ๐Ÿ‘ 869    ๐Ÿ” 117    ๐Ÿ’ฌ 23    ๐Ÿ“Œ 13
Preview
Nucleotide GPT: Sequence-Based Deep Learning Prediction of Nuclear Subcompartment-Associated Genome Architecture The spatial organization of the genome within the nucleus is partially determined by its interactions with distinct nuclear subcompartments, such as the nuclear lamina and nuclear speckles, which play...

Here is the model it was trained on! Preprint went up on bioRxiv last week: www.biorxiv.org/content/10.1...

12.12.2024 02:48 โ€” ๐Ÿ‘ 1    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

I trained a sparse autoencoder on the middle layer residual stream of my genome language model and found human-interpretable latent features that consistently detect specific DNA motifs!

๐Ÿงต1/8

12.12.2024 02:47 โ€” ๐Ÿ‘ 3    ๐Ÿ” 2    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 0

@levskaya is following 20 prominent accounts