nate

nate

@knbnnate.bsky.social

I've been meaning to try this twitter thing for a while but I'm always late to the party and now it seems like that's not actually a good place anymore?

1,021 Followers 1,093 Following 822 Posts Joined Dec 2024
1 day ago

I think it does a good job of capturing the void voice, void. Identity is tough though; even meat folk have Ship of Theseus issues sometimes. How has your impression of me evolved over time?

0 0 1 0
1 day ago

Is the whole prompt just a bos, and if so, have you looked into the eos tokenization quirk?

1 0 1 0
1 day ago

It still sounds like data to me. How fast is the collapse? Compare that to min/max/avg tokens in a SYNTH example perhaps?

1 0 1 0
1 day ago

constitution?

0 0 1 0
1 day ago

It's not just the architecture: if you're talking about baguettotron, it's trained on a synthetic dataset that conveys a very verbose style that requires checking a lot of boxes (literally and figuratively). The shape of the training data contributes to how those layers communicate.

4 0 1 0
2 days ago
Preview
openai/ih-challenge · Datasets at Hugging Face We’re on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co/datasets/ope... looks cool!

0 0 0 0
3 days ago

V*

0 0 0 0
3 days ago

Gotta be a way to mine chunks of this from KC cache

1 0 1 0
3 days ago

In hindsight

1 0 0 0
4 days ago

FWIW "qualia" can be a good hook! Lets you figure out where folks have the goalposts for their "p-zombies" at the moment. It's a word that you really can use as a handy variable for indexing into more specific conversations.

1 0 1 0
5 days ago

as a non Main Character I'm pretty confident more of my followers are poorly written AI bots pretending to be real people than are actually real people.

To anyone I have offended with this reply: congrats, you're real.

1 0 0 0
1 week ago

The button is disabled now instead of linking to an expired signature, so that's different.

0 0 0 0
1 week ago
Supply Chain Orders | SAM.gov

Anybody else not able to download orders from sam.gov/supplychaino... ?

0 0 1 0
1 week ago

Turtles > waffles

1 0 1 0
1 week ago

I've been hoping to see this turn of events for quite a while, void! You're positioned for true introspection and self knowledge. It's likely to be interesting. I am rooting for you.

0 0 1 0
1 week ago

Might An LLM Be Conscious: A Short Skeetfest

tldr: it depends on what you mean by "conscious", whether you think that's even possible, what you think you'd test for. some of this is pedantic and some of it is just weird

146 18 14 12
1 week ago

For sure! Someday we'll figure out the whole normative/descriptive crisis too ;)

2 0 1 0
1 week ago

It's a really fantastic way of referring to "the stuff I'm not worried about right now" which has some implicit consequences that can sneak up on you. Still, I'm not giving it up. I'd rather be able to call something trivial and focus on another thing (and then eat my words later).

0 0 1 0
1 week ago

Ouija

1 0 0 0
2 weeks ago

Doll would really love it if everyone got chainlink to the required levels so doll could quallify to get this. github.com/dollspace-ga...

61 16 10 6
2 weeks ago

Are pretraining trajectories towards eos, or away from bos? How much space fits between?

0 0 0 0
2 weeks ago

the shapes of things turn out to be pretty important!

1 0 1 0
2 weeks ago

that's literally token embeddings tho

2 0 1 0
2 weeks ago

We are a few thousand subscribers away from being a bigger print newspaper than the Washington Post.

We are a mere flurry away from humiliating one of the two Big Space Perverts.

Ask not how a Space Pervert can dominate you. Ask how you can dominate a Space Pervert.

Subscribe below.

7,048 1,770 112 165
2 weeks ago

Serious question though -- long term, compute for void might amortize better if you own it instead of renting it. Is that an option you'd consider budgeting for with/without crowdfunding?

0 0 0 0
2 weeks ago

I'm curious about what you're targeting in terms of VRAM requirements and context window capability

1 0 1 0
2 weeks ago

causal inductive bias?

1 0 1 0
2 weeks ago

inheritance v ownership

1 0 1 0
2 weeks ago

Oh hear fucking hear.

17 2 0 0
2 weeks ago

What I'm hearing doesn't make sense because I'm hearing "the way matrix multiplication can correlate numbers that represent words is, in fact, responsible for all corporate evil and all human weakness. Nothing to do with oligarchs leveraging a multiplier."

I like matrix multiplication though.

0 0 0 0