's Avatar

@prescod.bsky.social

96 Followers  |  1,088 Following  |  20 Posts  |  Joined: 15.11.2024  |  1.9943

Latest posts by prescod.bsky.social on Bluesky

Post image

No they don’t. Canada and Mexico want none of this. They want the president of the United States to respect and abide by the trade treaty he negotiated with them - and not make up bogus pretexts for plunging us all into a gratuitous no win economic debacle.

02.02.2025 18:44 β€” πŸ‘ 16343    πŸ” 3081    πŸ’¬ 409    πŸ“Œ 129

I’m going to put my rich guy hat on and say I hope that Mexico and Canada issue equal, retaliatory tariffs and stick to them for an extended period.

I apologize to all the people it will cost money and the businesses it will hurt.

But it’s the only way for tariffs to be seen for what they are

02.02.2025 00:02 β€” πŸ‘ 144348    πŸ” 16148    πŸ’¬ 8420    πŸ“Œ 1231

A friend shared these words by Aeschylus (in Agamemnon). I had to read them a couple of times.

"Be healer to this perplexity
that grows now into darkness of thought
while again sweet hope shining from the flames
beats back the pitiless pondering
of sorrow that eats my heart."

27.01.2025 02:19 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Academics think they will take all of the jobs because they plan to grow them far beyond anything recognizable as "LLMs", until they actually can do all of the jobs.

But in the meantime: a lot of jobs are actually a lot like homework.

27.01.2025 02:17 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Weeks ago it was just a list of things designed to anger. Now it is policy harming real individual human beings and soon everyone’s economy and livelihoods.

21.01.2025 03:33 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Interesting. Why?

20.01.2025 17:33 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I am a climate scientist and this is correct ⬇️

09.01.2025 03:06 β€” πŸ‘ 32167    πŸ” 9264    πŸ’¬ 323    πŸ“Œ 101

Occasional reminder that there’s no, β€œit’s too late, its over” for anthropogenic climate change. Every molecule of CO2 that doesn’t go into the atmosphere makes a difference. Preventing 0.1 degree of warming makes a difference. Every bit of climate resilience we build together makes a difference.

09.01.2025 01:18 β€” πŸ‘ 36370    πŸ” 10479    πŸ’¬ 440    πŸ“Œ 342
Post image

I'm gonna share this cartoon again simply because Jeff Bezos' Washington Post tried to censor it.

05.01.2025 21:04 β€” πŸ‘ 20064    πŸ” 7205    πŸ’¬ 326    πŸ“Œ 263

It looks to me as if it will be easier to build intelligence and then study it in a lab rather than observe it with primitive tools, understand it and then build it.

The engineering seems to progress much faster than the first principles research, but I’d be happy to be proven wrong.

05.01.2025 18:26 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Thank you.

05.01.2025 17:52 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Even if that were true, which It is not, it would be irrelevant to the larger question which is what we should expect for the future of test time compute (TTC) ala o3.

o3 is the GPT-2 of TTC. Costs will come down. Quality will go up. Efficiency will go up. Open source will emerge.

04.01.2025 20:30 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

By the way, it illuminates a lot about your mindset when you mock people for having a life outside of social media. Maybe you should try it yourself and you wouldn’t need to be so angry and unhappy.

04.01.2025 19:49 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

So you admit that the trend over the last several years has been towards lower costs, higher token qualities and lower latency.

But in the face of the existence of gpt-4o, deepseek v3, and Claude sonnet 3.5 that this process stopped in March of 2023.

You think gpt-4 was the pinnacle?

04.01.2025 19:47 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Please don’t let the haters bring you down. People have extremely irrational views about these technologies. Both pro and con.

04.01.2025 19:15 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

You said price per token is negatively correlated with quality of tokens. gpt-4o is<$ than Babbage was.

So your assertion is wrong.

Sticking to the gpt-4 lineage you are still wrong. 4o is better (according to my private evals and most people’s public evals) and <$ than GPT-4 of last year

04.01.2025 19:13 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

These extremely expensive, highly reliable models will be used to train the mainstream models that we use every day to do these right/wrong tasks much more reliably than a they do today. Subjective tasks may not improve much but they are already decent at most such tasks of industrial value. 2/2

21.12.2024 11:13 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

My belief about what o3 seems to prove: given enough compute, you can now fine tune a model to do any task that a human can do which has a clear right or wrong answer. This model can then (usually? always? sometimes?) be used to train a much cheaper model to do it at scale. 1/2

21.12.2024 11:09 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

If you truly believe that gpt-4o-mini is worse than than babbage-002 was then I am talking to a brick wall and I will just stop now.

I eval these things literally every day against my private dataset and custom task. Not sure what motivates a person to state what everyone knows is false. Carry on.

21.12.2024 11:02 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

So much hostility and so little imagination. Go back to Twitter.

21.12.2024 04:39 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
x.com

x.com/tsarnick/sta...

100x drop in 18 months.

21.12.2024 04:37 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Andrej Karpathy: GPT-2 (124M) in llm.c, in 90 minutes for $20

Okay fine, I can β€œonly” demonstrate a 100x reduction in the research time I have available to me.

www.reddit.com/r/mlscaling/...

So maybe I’ll need to wait until next summer to demonstrate 1000x. Or maybe tomorrow I’ll have time to find a good example of distillation that is 1000x.

21.12.2024 04:20 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

β€œHow will this computer thing have any relevance to society. They each require a large room with dedicated operators.”

The technique works.

In 2 years it will cost $1720 and 2 years after it will be $17.20.

Have a bit of foresight.

21.12.2024 03:39 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Human beings also study for tests.

We’ve crossed an important threshold when one can fine-tune a model for any task that a human can do.

It’s not the same as AGI but it is an important milestone.

Few jobs can be automated away with O3-ish technology but most tasks in each job can be (w/ $$$)

21.12.2024 03:30 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

bsky.app/profile/aoc....

25.11.2024 06:22 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

@prescod is following 20 prominent accounts