Cameron Holmes

New paper: Finetuning on narrow domains leaves traces behind. By looking at the difference in activations before and after finetuning, we can interpret what it was finetuned for. And so can our interpretability agent! 🧵

I think it's pretty hard to disentangle them really, I was initially skeptical of the (very convenient) argument from the labs about them not being orthogonal, but I'm increasingly buying it.

When will the first general AI system be devised, tested, and publicly announced?

Right, predictions were 30+ years well into 2020.

www.metaculus.com/questions/51...

Banger

Congratulations!

It would have been an all-too-convenient refrain for the "I don't believe in that sci-fi nonsense" AI Safety scepticism line

She shall know your ways as if born to them

Truly an excellent milestone.

Although concessions do follow in (incorrect) episode preferences. Sleepytime falling out of favour was crushing.

Yeah I try to follow a similar approach

The fora draw a clear distinction between upvotes / agreement votes so I think the culture of upvoting contributions stems from that maybe?

Bizarre that was included in the screenshot, doesn't seem like it belongs to the same class as the others at all.

Tradle | Have fun with OEC Data | The Observatory of Economic Complexity Became an instant classic, guess the country based on an export distribution | In OEC we work hard and also party hard.

Crushing it

#Tradle #992 1/6
🟩🟩🟩🟩🟩
oec.world/en/games/tra...

Now grappling with whether I'd be in that group or not.

Not everyone, then we'd have to read them. If only those inclined to make one did then the mere existence of the doc would probably clarify 90% of scenarios.

"Oh they've got one of those docs, we are probably cool"

The Settlers of Catan Problem

I've been really noticing autumn this year

Will Google sell or divest Chrome by 2029? 25% chance. Resolves to YES if Google sells or divests Chrome, for any reason, by Jan 1, 2029. Resolves to NO if it does not. Asking because of this: https://x.com/unusual_whales/status/185864351...

Prediction markets not giving great odds of this going through:

manifold.markets/ZviMowshowit...

Hoping this generalizes into alignment research

The HS2 bat tunnel is even worse value for money once you factor in the updated direct cash transfer effectiveness estimates.

Animal Welfare vs Global Health Debate Week - EA Forum Animal Welfare vs Global Health Debate Week was an event which ran from 7-13 October (2024) on the EA Forum.  Posts with this tag can be arguments, investigations, research summaries, book-reviews, q...

It's an edit of EA forum debate week interface:

forum.effectivealtruism.org/topics/anima...

Draft Amnesty Week - EA Forum Draft Amnesty Week is an event running on the EA Forum between March 11th and 17th 2024, where Forum users can publish scrappy, draft-y, or incomplete posts with impunity.  This tag is to be used on ...

Good idea, for more details that might help: forum.effectivealtruism.org/topics/draft...

Oh yes, an entirely intentional error on my part in the spirit of #DAW 😬

deleting dating apps because i want to meet someone the old fashioned way (we caught a wild pig together while not sharing a common language, then met 12 years later under the tree we planted)

This is a Draft Amnesty Week #DAW draft. It may not be polished, up to my usual standards, fully thought through, or fully fact-checked.

FYI it's Draft Amnesty Week on TPOB, where users can publish scrappy, draft-y, or incomplete posts with impunity. #DAW

Circles, but it's just a different app for each emigrating TPOT

On new beginnings: This week I handed in my notice, ending 10 years in Product Management, capital markets to start as an Alignment Research Manager in January! 🎉

Good ~Morning Agus