Martin Elstner's Avatar

Martin Elstner

@martin.elstner.dev

AI and ML engineering. Search and recommendation. Founder of Elstner Analytics. Helping companies solve their data issues https://elstner.dev

1,255 Followers  |  821 Following  |  87 Posts  |  Joined: 28.08.2023  |  2.2255

Latest posts by martin.elstner.dev on Bluesky

The 120b variant is probably too large for home usage, but the 20b variant as 4 or 8 bit quantisation can run on notebooks or even maxed out phones. I get:
18.79 tok/sec; 1426 tokens total out; 0.60s to first token with the 4bit gguf (4096 tokens context) in LM studio on a M4 MacBook Air with 32GB.

06.08.2025 07:33 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
LM Studio - Run openai/gpt-oss on your computer Run gpt-oss, Llama, Gemma, Qwen, and DeepSeek locally and privately.

In terms of tooling. LM studio lowers the entry barrier, at least on a Mac and it's totally accessible to any user (install the chat app from a .dmg, download the default model (~12GB) and you are good to go). lmstudio.ai

06.08.2025 07:33 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

defaults directly on my sloppy, short inputs. We will see what can be build on top (the license is permissive) and how fine-tuning turns out, but the base model usability in chat is great.

06.08.2025 07:33 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

the overall usability is great. For chat applications, the answers are exactly right in tone and length. It's a bit to positive and supports the users view (as most OpenAI models do). Qwen3 has also strong models, but I have to put more work into prompt tuning to get a good answer, get-oss has good

06.08.2025 07:33 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

The Open Model release from OpenAI is a good reason to check out local AI models on your device.
Is it the best model out there? Definitely not, even in it's parameter class, it may not be THE best, benchmark wise (aside: OpenAI build sizes that are uncommon, so direct comparison is harder), but

06.08.2025 07:33 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

I often see and use something like:
print(numpy.__version__)
is there a way to do it without calling the dunder method directly? For everything else I'm completely with you, but that's the one exemption that directly comes to mind

05.08.2025 06:16 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

It's actually already build in some variants and products. But driven by a 'making money fast' approach. If done properly, todays technology already has much dystopian potential.

04.08.2025 10:52 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Be Right Back - Wikipedia

Waiting for people to live in something like that:
en.wikipedia.org/wiki/Be_Righ...
If it hits you in a weak moment of grieve, there is a lot of potential to get addicted and move to a very unhealthy "co-existence"

04.08.2025 10:50 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

The jumping bunnies are an interesting case, because they hit the sweet spot of "uncommon, cool, but still plausible" and depending on the model you run it on, the quality is really good and as layman watching it you can't directly point to obvious flaws.

04.08.2025 10:50 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

I honestly think, we need to adapt our notion of reality. The tools to reshape it are here already. We can try to regulate them, we can mourn for our loss or we can adapt. I would see it as an exercise in media literacy...
bsky.app/profile/mart...

04.08.2025 10:42 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

But we made some progress on the โ€œbunny videoโ€œ task

bsky.app/profile/mart...

02.08.2025 10:29 โ€” ๐Ÿ‘ 2    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Same for chemistry (IChO), not even the theory part

02.08.2025 10:27 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Video thumbnail

Nevertheless, mine is better :)

01.08.2025 09:16 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 1

Dropping generated videos is a good test if you want to know what other platforms your followers use.
Bluesky has a large user base of AI sceptics and seems generally isolated from the hot topics on the video platforms (not judging, but the latter is probably a good thing).

01.08.2025 09:16 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Preview
Mehrere Kindergรคrten in Thรผringen schlieรŸen endgรผltig | MDR.DE Kรผnftig gibt es in Thรผringen sieben Kindergรคrten weniger. Hintergrund sind sinkende Geburtenzahlen, baulicher Mรคngel und finanzieller Engpรคsse. Vor allem Ostthรผringen ist betroffen.

Man schaut da glaub ich auch schon auf den weiteren Verlauf und die Geburtenrรผckgรคnge. Oder: "Die Kinder die heute in der KiTa fehlen, verstopfen in Bรคlde auch kein Gymnasium"
www.mdr.de/nachrichten/...

31.07.2025 19:29 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

TBC: the day off atlas

bsky.app/profile/kevi...

26.07.2025 16:01 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

A few years back, I ordered Judea Pearl's "Causal Inference". But was expecting "Casual Inference", like in "Yeah, I do inference, but very casual". You can't imagine my disappointment

20.07.2025 18:52 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
New Experiment Rules out Bohmian Mechanics. Itโ€™s Serious.
YouTube video by Sabine Hossenfelder New Experiment Rules out Bohmian Mechanics. Itโ€™s Serious.

Need to read more carefully. Was watching Sabine's recent video and was expecting to learn about "Bohemian mechanics". You can't imagine my disappointment
www.youtube.com/watch?v=DvpS...

20.07.2025 18:52 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

DHH on the Lex Fridman Podcast (2h in): probably you can see a productivity drop this week from all the techies wading through it...

17.07.2025 20:38 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
A little snail sitting inside a cars charging port

A little snail sitting inside a cars charging port

POV: EV charging in rural Germany

12.07.2025 06:22 โ€” ๐Ÿ‘ 1    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
A 12 panel cartoon showing an increasingly well worn walking path in the grass.

A 12 panel cartoon showing an increasingly well worn walking path in the grass.

A 'desire path' represents the shortest or the most easily navigated route between an origin and destination.

If you can preempt these in your UX/UI you'll lower support tickets and increase user retention.

People are going to people. Let them.

08.07.2025 09:17 โ€” ๐Ÿ‘ 10    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

A workflow with just and uv, close to what I had stitched together over the last months. I got a handful of new ideas (like putting PORT in .env); recommend watching it!

07.07.2025 07:04 โ€” ๐Ÿ‘ 2    ๐Ÿ” 2    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

So, Simon says I should quitting this computer programming thing
<taking notes>

03.07.2025 17:37 โ€” ๐Ÿ‘ 2    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Great post, agree to most of your points!
At the moment, I just feel that MCP is the least awful way to make tools available in an enterprise context. Yes there is significant overhead, but enterprises are ok with that. Besides the only available way to channel tool discovery.

03.07.2025 11:14 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Maybe a bit of jargon, but as many microwaves have pressure sensors (and 10bar sounds like close to the maximum they allow) itโ€™s like โ€˜under refluxโ€™?

01.07.2025 18:17 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Viele sind an den Ergebnissen interessiert, aber nur wenige rechnen damit ;) Genau andersherum als bei Halbleiter band gap predictions. Gibt es ein gutes Erstsemesterbuch o.ร„. in das man mal reinschauen kann?

27.06.2025 18:59 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Guter Artikel

27.06.2025 16:31 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Still wonder why Apple (or the ecosystem) doesnโ€™t have anything

27.06.2025 12:59 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Initial exploration of using Koog for developing Kotlin based AI agents Koog, announced recently at KotlinConf, is a new Kotlin-based framework designed to build and run AI agents. This article will outline initial exploration of using Koog along with a number of configur...

Will try this out, also to check how well coding agents can help me with a language I donโ€™t know. But I like the examples I found, e.g.: johnoreilly.dev/posts/kotlin...

27.06.2025 12:58 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Thank you, looks good and well thought through. Unfortunately far from my usual tech stack

27.06.2025 10:36 โ€” ๐Ÿ‘ 0    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

@martin.elstner.dev is following 20 prominent accounts