AKA NickleDave's Avatar

AKA NickleDave

@nicholdav.bsky.social

I'm interested in how animals communicate with sound and I try to make that easier for everyone to study: https://www.vocalpy.org/ Cat & dog dad, cold brew addict, video gamer, Florida boy, #altac, podcast fan, occasional espanglish. nicholdav.info

1,813 Followers  |  2,489 Following  |  948 Posts  |  Joined: 24.08.2023  |  1.9737

Latest posts by nicholdav.bsky.social on Bluesky

What I would like to remind everyone talking about Sam Altman talking about the β€œPhD level intelligence” of the new ChatGPT is that Sam Altman dropped out of college so he… has no experiential construct for what grad school even is.

09.08.2025 05:16 β€” πŸ‘ 827    πŸ” 167    πŸ’¬ 18    πŸ“Œ 12

Likening PhD holders to a (non-functional) algorithm is a form of dehumanisation & anti-intellectualism that is a bellwether for contemporary fascism. Essentially it's a typical β€” if not the archetypal β€” first step towards fascism: to dehumanise, deskill, defund, and, ultimately, fire the academics.

09.08.2025 06:35 β€” πŸ‘ 845    πŸ” 295    πŸ’¬ 11    πŸ“Œ 14

This was a block from my lab BTW. Me and 4 of my lab members sheltered in place for 2 hours getting repeated active shooter notifications. So I can imagine how much more traumatizing it must have been for CDC workers… and how this is exactly what the administration wants

09.08.2025 12:55 β€” πŸ‘ 8    πŸ” 3    πŸ’¬ 0    πŸ“Œ 0
Preview
Suspect and Officer Are Dead After Shooting Outside C.D.C. in Atlanta

A gunman opened fire on federal workers at CDC because of disinformation promoted by the right, including agency leaders, and the administration has said nothing. We knew project2025 wanted federal workers to be β€œtraumatized”, apparently it’s also ok if they’re killed www.nytimes.com/2025/08/08/u...

09.08.2025 12:48 β€” πŸ‘ 60    πŸ” 34    πŸ’¬ 4    πŸ“Œ 1

SimOffice

09.08.2025 02:39 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Just to give the TL;DR on this one:

*The* main purpose of the EO is to move funding priorities and decisions away from experts and career professionals over to political appointees. With the ultimate power held by Vought / OMB.

07.08.2025 22:55 β€” πŸ‘ 498    πŸ” 296    πŸ’¬ 20    πŸ“Œ 28
Preview
a man in a suit and tie is waving his hands in the air in a crowd . ALT: a man in a suit and tie is waving his hands in the air in a crowd .

when you get replies from Blueberrby OP it's time to mute the thread

08.08.2025 16:05 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

how much "test-time compute" does GPT-5 Stinking need to search its compressed database of the entire Internet and find this guy's Bluesky post

bsky.app/profile/jman...

08.08.2025 16:03 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Excellent, thank you.
Guessing their prominence on flycatchers and kingbirds is consistent with the idea the bristles play are important for prey capture?

08.08.2025 14:19 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Preview
Seven replies to the viral Apple reasoning paper – and why they fall short Also: another paper that seals the deal

For why we are unlikely to get LLMs that can count the number of b's in blueberry with "reasoning", as it is defined by these techcel dweebs without ever having read a cogsci book (they were too busy scanning the books to train their multi-PhD LLMs), see:

garymarcus.substack.com/p/seven-repl...

08.08.2025 14:16 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Good question. They don't tokenize letters because 1. it would be crazy expensive to train models on such long sequences and 2. tokenizing is a form of compression that *adds* info. You make your set of tokens based on things like word frequency. Also 3. some languages don't have letters

08.08.2025 13:44 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

But a next-token predictor doesn't "know" facts like "blueberry has only two bs"

One way to deal with this is replace tokenization with "end-to-end" learning from bytes

bsky.app/profile/hnws...

Others involve welding "memory" and "reasoning" on to LLMs, that have their issues </rant>

3/3

08.08.2025 13:34 β€” πŸ‘ 5    πŸ” 0    πŸ’¬ 2    πŸ“Œ 0

Think word parts, but in practice the tokens are a set of bytes. We map each token to a continuously valued vector called an embedding. The LLM "sees" sequence of embeddings, and is fit to predict the next token.

So they do a good job of estimating "these bytes/tokens are very unpredictable!"

2/3

08.08.2025 13:29 β€” πŸ‘ 5    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
LLM Tokenization Issues!
YouTube video by Mathelecs LLM Tokenization Issues!

It's complicated, but the main reason is what everyone else said. LLMs don't see words. But the term of art you want is "tokenization".

1/3

youtube.com/shorts/mtJYj...

08.08.2025 13:25 β€” πŸ‘ 12    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Preview
Improving Oversight of Federal Grantmaking By the authority vested in me as President by the Constitution and the laws of the United States of America, and to improve the process of Federal

Well, this is a huge Executive Order power grab...

www.whitehouse.gov/presidential...

1/3

07.08.2025 20:43 β€” πŸ‘ 428    πŸ” 245    πŸ’¬ 53    πŸ“Œ 84

I bet. Now I want to go find some BFs and see if I can see any whiskers

08.08.2025 03:32 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

New ChatGPT data just dropped

07.08.2025 23:29 β€” πŸ‘ 36    πŸ” 6    πŸ’¬ 0    πŸ“Œ 1

"blueberrby," Altman said.

07.08.2025 23:31 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
title screen, finding a chest, intro (pac-girl in adventurer's clothing) an empty dungeon corridor #pixelart #gamedev

title screen, finding a chest, intro (pac-girl in adventurer's clothing) an empty dungeon corridor #pixelart #gamedev

a dungoen map, an encounter (Blinky), a door with a horizontal sliding switch in the shape of pacman, the fairy from PacLand is a shopkeeper. Buy power pills to increase Attack or healing potions to recover HP

a dungoen map, an encounter (Blinky), a door with a horizontal sliding switch in the shape of pacman, the fairy from PacLand is a shopkeeper. Buy power pills to increase Attack or healing potions to recover HP

Another 64x64pixel game mockup.
Pac-girl as a dungeon crawler.
#pixelart #gamedev

06.08.2025 13:10 β€” πŸ‘ 496    πŸ” 106    πŸ’¬ 14    πŸ“Œ 5
Devastator in the palm of Shockwave's hand, looking distraught. #pixelart

Devastator in the palm of Shockwave's hand, looking distraught. #pixelart

Still very happy with my Transformers cover for IDW comics

I channeled some gundam/ macross into my robots. I love how badly Devastator is being manipulated in that story arc. Also still impressed that they'd take a chance at a #pixelart cover.

07.07.2025 03:56 β€” πŸ‘ 280    πŸ” 52    πŸ’¬ 2    πŸ“Œ 0
Post image

Andy Warhol
Water Heater, 1961

31.07.2025 03:38 β€” πŸ‘ 35    πŸ” 7    πŸ’¬ 1    πŸ“Œ 0

#TherapySky US folks, if your legislature doesn't have someone sponsoring a version of this bill, ask your professional organization and your regulatory body why the hell not. We need a 50-state ban on this dangerous, unproven trash.

07.08.2025 19:30 β€” πŸ‘ 4    πŸ” 3    πŸ’¬ 0    πŸ“Œ 0

Two TT positions at Bowdoin College, a small liberal arts college in Maine:

Neuroscientist Assistant Professor: careers.bowdoin.edu/postings/16571
Neuroscientist (AI-based research) Assistant Professor:
careers.bowdoin.edu/postings/16572

07.08.2025 14:59 β€” πŸ‘ 9    πŸ” 6    πŸ’¬ 0    πŸ“Œ 0

very cool. I just got this badge in Grand Theft Doody 9

07.08.2025 19:32 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

good. Fuck BetterHelp and all these techbro therapy start-ups who think they can do an Uber to mental health care providers, then pull the rug by replacing their gig worker therapists with LLMs trained on all the calls they record

07.08.2025 19:29 β€” πŸ‘ 8    πŸ” 5    πŸ’¬ 0    πŸ“Œ 0
07.08.2025 19:05 β€” πŸ‘ 3014    πŸ” 399    πŸ’¬ 30    πŸ“Œ 12

figure 1 of my dissertation

07.08.2025 19:06 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
First-of-a-kind US class-action lawsuit would force EPA to reinstate $3bn climate program Coalition of non-profits, tribes and local governments sued EPA chief for halting climate justice grants

First-of-its-kind US class-action lawsuit would force EPA to reinstate $3bn climate program www.theguardian.com/us-news/2025... via @us.theguardian.com

07.08.2025 18:34 β€” πŸ‘ 31    πŸ” 17    πŸ’¬ 0    πŸ“Œ 1
Internet Archive: Digital Library of Free & Borrowable Texts, Movies, Music & Wayback Machine

The highlight that the Internet Archive preserving Flash is starting to get "but flash was awful" comments but I can't hear you over the sound of 600 cooking games.

archive.org/details/soft...

07.08.2025 18:34 β€” πŸ‘ 71    πŸ” 12    πŸ’¬ 7    πŸ“Œ 1

By the way if you all want to read these experiments, I have 2 novellas published in Clarkesworld trying it out. Axiom of Dreams and Fractal Karma. The latter is an Ignyte Award finalist this year.

They’re a different vibe from my early stories. reading PKD & certain events changed my perspective.

07.08.2025 16:50 β€” πŸ‘ 9    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0

@nicholdav is following 20 prominent accounts