The 120b variant is probably too large for home usage, but the 20b variant as 4 or 8 bit quantisation can run on notebooks or even maxed out phones. I get:
18.79 tok/sec; 1426 tokens total out; 0.60s to first token with the 4bit gguf (4096 tokens context) in LM studio on a M4 MacBook Air with 32GB.
06.08.2025 07:33 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
LM Studio - Run openai/gpt-oss on your computer
Run gpt-oss, Llama, Gemma, Qwen, and DeepSeek locally and privately.
In terms of tooling. LM studio lowers the entry barrier, at least on a Mac and it's totally accessible to any user (install the chat app from a .dmg, download the default model (~12GB) and you are good to go). lmstudio.ai
06.08.2025 07:33 โ ๐ 1 ๐ 0 ๐ฌ 1 ๐ 0
defaults directly on my sloppy, short inputs. We will see what can be build on top (the license is permissive) and how fine-tuning turns out, but the base model usability in chat is great.
06.08.2025 07:33 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
the overall usability is great. For chat applications, the answers are exactly right in tone and length. It's a bit to positive and supports the users view (as most OpenAI models do). Qwen3 has also strong models, but I have to put more work into prompt tuning to get a good answer, get-oss has good
06.08.2025 07:33 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
The Open Model release from OpenAI is a good reason to check out local AI models on your device.
Is it the best model out there? Definitely not, even in it's parameter class, it may not be THE best, benchmark wise (aside: OpenAI build sizes that are uncommon, so direct comparison is harder), but
06.08.2025 07:33 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
I often see and use something like:
print(numpy.__version__)
is there a way to do it without calling the dunder method directly? For everything else I'm completely with you, but that's the one exemption that directly comes to mind
05.08.2025 06:16 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
It's actually already build in some variants and products. But driven by a 'making money fast' approach. If done properly, todays technology already has much dystopian potential.
04.08.2025 10:52 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Be Right Back - Wikipedia
Waiting for people to live in something like that:
en.wikipedia.org/wiki/Be_Righ...
If it hits you in a weak moment of grieve, there is a lot of potential to get addicted and move to a very unhealthy "co-existence"
04.08.2025 10:50 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
The jumping bunnies are an interesting case, because they hit the sweet spot of "uncommon, cool, but still plausible" and depending on the model you run it on, the quality is really good and as layman watching it you can't directly point to obvious flaws.
04.08.2025 10:50 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
I honestly think, we need to adapt our notion of reality. The tools to reshape it are here already. We can try to regulate them, we can mourn for our loss or we can adapt. I would see it as an exercise in media literacy...
bsky.app/profile/mart...
04.08.2025 10:42 โ ๐ 1 ๐ 0 ๐ฌ 1 ๐ 0
But we made some progress on the โbunny videoโ task
bsky.app/profile/mart...
02.08.2025 10:29 โ ๐ 2 ๐ 1 ๐ฌ 0 ๐ 0
Same for chemistry (IChO), not even the theory part
02.08.2025 10:27 โ ๐ 2 ๐ 0 ๐ฌ 1 ๐ 0
Nevertheless, mine is better :)
01.08.2025 09:16 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 1
Dropping generated videos is a good test if you want to know what other platforms your followers use.
Bluesky has a large user base of AI sceptics and seems generally isolated from the hot topics on the video platforms (not judging, but the latter is probably a good thing).
01.08.2025 09:16 โ ๐ 2 ๐ 0 ๐ฌ 1 ๐ 0
TBC: the day off atlas
bsky.app/profile/kevi...
26.07.2025 16:01 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
A few years back, I ordered Judea Pearl's "Causal Inference". But was expecting "Casual Inference", like in "Yeah, I do inference, but very casual". You can't imagine my disappointment
20.07.2025 18:52 โ ๐ 2 ๐ 0 ๐ฌ 1 ๐ 0
YouTube video by Sabine Hossenfelder
New Experiment Rules out Bohmian Mechanics. Itโs Serious.
Need to read more carefully. Was watching Sabine's recent video and was expecting to learn about "Bohemian mechanics". You can't imagine my disappointment
www.youtube.com/watch?v=DvpS...
20.07.2025 18:52 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
DHH on the Lex Fridman Podcast (2h in): probably you can see a productivity drop this week from all the techies wading through it...
17.07.2025 20:38 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
A little snail sitting inside a cars charging port
POV: EV charging in rural Germany
12.07.2025 06:22 โ ๐ 1 ๐ 1 ๐ฌ 0 ๐ 0
A 12 panel cartoon showing an increasingly well worn walking path in the grass.
A 'desire path' represents the shortest or the most easily navigated route between an origin and destination.
If you can preempt these in your UX/UI you'll lower support tickets and increase user retention.
People are going to people. Let them.
08.07.2025 09:17 โ ๐ 10 ๐ 1 ๐ฌ 0 ๐ 0
A workflow with just and uv, close to what I had stitched together over the last months. I got a handful of new ideas (like putting PORT in .env); recommend watching it!
07.07.2025 07:04 โ ๐ 2 ๐ 2 ๐ฌ 0 ๐ 0
So, Simon says I should quitting this computer programming thing
<taking notes>
03.07.2025 17:37 โ ๐ 2 ๐ 1 ๐ฌ 0 ๐ 0
Great post, agree to most of your points!
At the moment, I just feel that MCP is the least awful way to make tools available in an enterprise context. Yes there is significant overhead, but enterprises are ok with that. Besides the only available way to channel tool discovery.
03.07.2025 11:14 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Maybe a bit of jargon, but as many microwaves have pressure sensors (and 10bar sounds like close to the maximum they allow) itโs like โunder refluxโ?
01.07.2025 18:17 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
Viele sind an den Ergebnissen interessiert, aber nur wenige rechnen damit ;) Genau andersherum als bei Halbleiter band gap predictions. Gibt es ein gutes Erstsemesterbuch o.ร. in das man mal reinschauen kann?
27.06.2025 18:59 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Guter Artikel
27.06.2025 16:31 โ ๐ 2 ๐ 0 ๐ฌ 0 ๐ 0
Still wonder why Apple (or the ecosystem) doesnโt have anything
27.06.2025 12:59 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Thank you, looks good and well thought through. Unfortunately far from my usual tech stack
27.06.2025 10:36 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
cheerleader
eatonphil.com
Anwalt und Unternehmerย ๐จ๐ญ fรผr Recht im digitalen Raum (Steiger Legalย AGย / Datenschutzpartnerย AG)ย ยท ๐ฆญ-freie Zoneย ยท #BildungAberSicher #Netzpolitik #TeamDatenschutzย ยท https://martinsteiger.ch mit Kontaktadressenย ยท Automatische Lรถschung von Beitrรคgenย ๐๐ป
PfarrermitMaske im Gesundheitswesen (he/him), #climatechangeisreal #racismisreal #teamvorsicht #loveisreal #godislove #diemaskebleibtauf #noafd #afdverbotjetzt
Kosmopolit, Omnivore
versucht Dinge zu verstehen
Und wieder ๐: ich fave und kommentiere keine Bilder mit Menschen oder Kรถrperteilen
No DM
The Organic Chemistry Portal - For daily updates please visit https://www.organic-chemistry.org/abstracts/ and check out https://www.organic-chemistry.org/info/linking/
Big Tech and startups, from the inside. Highly relevant for software engineers and managers, useful for those working in tech. The #1 technology newsletter on Substack. https://newsletter.pragmaticengineer.com/about
American fiction writer equally devoted to novels and short stories.
For more AI&Tech content, check here www.luok.ai
๐Apple Die Hard Fan๏ฝ ่นๆ้ชจ็ฐ็ฒ
๐คGenAI Observer ๏ฝ GenAI่งๅฏ่
๐จ๐ปโ๐คCutting Edge Tech Enthusiast ๏ฝ ็งๆ็ฑๅฅฝ่
Real stories of data work from the folks in the trenches.
Wednesday, 2025-09-24
https://databsconf.com/
header: Voyage Pro on Unsplash
avi: vectorsmarket15 on Flaticon
posts: @qethanm.bsky.social
Vorerkrankte Familie! Pluslife-Nutzer!
Wer mich auf Listen setzt, wird geblockt! #CovidIsNotOver #FckAfD #FckMrz #TeamHabeck #nurnochgrรผn ๐๐๐
Sharing info on COVID since the start of the pandemic.
#COVIDisNotOver #COVIDisAirborne #MaskUp๐ท
Weather Forecaster@DWD, but also interested in a lot of other stuff.
Dipl.-Meteorologe und IT-Mensch bei http://kachelmannwetter.com mit Schwerpunkt numerische Wettervorhersage und Radardaten. Gelegenheits-Stormchaser und Linux-Nerd.
Breaker of software, responder of incidents, IANS Faculty, VP R&D Hunter Strategy, Supreme Allied Commander of ANTIFA.
Health is non-negotiable.
Using quantitative, data-driven approaches to make synthetic chemistry more predictable. Phase II CCI #NSFFunded
๐ https://ccas.nd.edu/
๐ท https://www.instagram.com/nsf_ccas/
Author, international speaker, consultant, software architect, kitchen-sink wrangler.
I'm a pharmaceutical chemist working at the interface of cheminformatics, molecular modeling, and machine learning. All views are my own.
https://ligandintheloop.blogspot.com/