YouTube video by Kubesimplify
Run LLMs Locally with Docker Model Runner | Simplify AI Dev with Docker Desktop
In this video for #Kubesimplify, our Engineering Manager for the AI Runtime Team @wittek.dev talks #Docker's latest feature: Model Runner
It allows developers to run and test #LLM from their local environment w/ Docker Desktop 4.40
www.youtube.com/watch?v=md3W...
24.04.2025 16:49 โ ๐ 3 ๐ 2 ๐ฌ 0 ๐ 0
Running a GenAI app locally with OpenAI SDK + Docker Model Runner? Yes, please.
This demo uses Next.js + Docker Compose to serve up an LLM chatbot (Qwen 2.5) with hardware acceleration on Apple Silicon.
Local, fast, secure. Watch it go! @wittek.dev
#Docker #JavaScript #NextJS #LLM #AI #OpenAI
15.04.2025 20:12 โ ๐ 13 ๐ 3 ๐ฌ 0 ๐ 0
I think to enjoy Mastodon, I have to curate my following list.
Right now itโs weirdly random plus some grumpy German Linux IT stuff ^^
13.04.2025 11:17 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
Kind of, which makes it somehow worse also ^^
13.04.2025 07:06 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
Docker Does What?!? Run AI Models Locally with Docker
Docker has always been about simplifying developers' lives, making it effortless to build, ship, and...
Developers: โI wish I could run AI locally without all the setup.โ Docker: โSay less.โ
@hummusonrails.com dropped a ๐ฅ blog on the new Docker Model Runner:
๐ http://spklr.io/63328AJqs
#Docker #AI #Git #DevTools
12.04.2025 20:32 โ ๐ 3 ๐ 3 ๐ฌ 0 ๐ 0
Yeah, that would essentially be the self-hosting option.
12.04.2025 15:15 โ ๐ 2 ๐ 0 ๐ฌ 1 ๐ 0
I really liked the Fediverse stuff and gave Mastodon a good try when the whole Twitter debacle happened, but somehow it fizzled out for me.
12.04.2025 14:37 โ ๐ 1 ๐ 0 ๐ฌ 1 ๐ 0
Wanted to reboot my blog and was pondering the options. Self-hosting a static site would be okayish, but I also don't really want to yak shave the whole thing.
I used to like Substack, but it just is becoming an increasingly weird platform thingie. So maybe giving Ghost a try?
12.04.2025 14:36 โ ๐ 4 ๐ 0 ๐ฌ 2 ๐ 0
I don't really know what to do about all the different social media sites. More and more folks are following me here, but I am not really using it.
Maybe I should rotate through the different networks on a weekly basis :D (bsky, X, LinkedIn, Mastodon...)
12.04.2025 14:35 โ ๐ 4 ๐ 0 ๐ฌ 3 ๐ 0
Oh look, it's me!
03.04.2025 16:11 โ ๐ 13 ๐ 3 ๐ฌ 0 ๐ 0
In the style of The Ambassadors, Hans Holbein the Younger's Renaissance masterpiece painted in 1533, The Computers portrays many of the concepts and artifacts that define the world of computing.
07.03.2025 07:57 โ ๐ 138 ๐ 22 ๐ฌ 9 ๐ 2
An honor to be mentioned here :o
27.02.2025 09:57 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
docker run docker/hello-bluesky
12.02.2025 16:15 โ ๐ 106 ๐ 32 ๐ฌ 3 ๐ 6
I have the same impression, the search is so bad, especially about product reviews, I resort to search things like "$product reddit".
25.02.2025 15:12 โ ๐ 2 ๐ 0 ๐ฌ 0 ๐ 0
Sounds like Sunsama :)
06.02.2025 16:00 โ ๐ 3 ๐ 0 ๐ฌ 1 ๐ 0
Even for Java? :o
06.02.2025 15:58 โ ๐ 2 ๐ 0 ๐ฌ 1 ๐ 0
That is interesting news.
06.02.2025 15:57 โ ๐ 3 ๐ 0 ๐ฌ 1 ๐ 0
This project is key to Java. We need a notebook to bring Java towards students, scientists,... and help them doing research/POC's in the same language that can later be used in production systems where performance/stability/scaling/security is key.
06.02.2025 07:44 โ ๐ 10 ๐ 8 ๐ฌ 1 ๐ 1
๐๏ธ Speaker Spotlight: Do not miss Kevin Wittek @wittek.dev with his lecture "Learning GenAI/LLM programming with langchain4j and Testcontainers" at Hashtag#JavaLand 2025! scomp.ly/R1oDxZ8
29.01.2025 14:08 โ ๐ 6 ๐ 2 ๐ฌ 0 ๐ 0
I awkwardly get the feeling, I know why you want to use this :o
29.01.2025 16:46 โ ๐ 1 ๐ 0 ๐ฌ 1 ๐ 0
You Can Code Offline With Local AI(Ollama)
ChatGPT and other Generative AI tools took the world by a storm. People are using these AI tools for various purposes such as to explore a topic, to seek answers to their questions or to get help in c...
๐ Say hello to coding offline with Local AI! ๐ปโจ
Check out how Ollama lets you harness the power of AI models like Llama 3, Deepseek, and moreโright on your machine! ๐ง โก
๐ Privacy-first
๐ ๏ธ Works even when you're offline
๐ Dive in: www.sivalabs.in/code-offline...
#AI #Ollama
27.01.2025 03:32 โ ๐ 5 ๐ 1 ๐ฌ 0 ๐ 0
Oh look, I am there ^^
22.01.2025 13:18 โ ๐ 3 ๐ 0 ๐ฌ 1 ๐ 0
Remembering Russel. RIP ๐ค
21.01.2025 16:30 โ ๐ 42 ๐ 11 ๐ฌ 0 ๐ 0
"Who gets to hit @anthropic.com harder with the money stick" apparently remains the sport of kings.
22.01.2025 05:52 โ ๐ 40 ๐ 2 ๐ฌ 4 ๐ 1
Me, while reading a book behind my desk.
For my mental health, I usually refrain from commenting on politics. Today, I feel compelled to break this rule and speak out. In Germany, history revisionists yell their devoid phrases from the chancel, echoed by those who struggle with recent politics and are afraid of the future.
๐งต 1/8
20.01.2025 08:06 โ ๐ 2 ๐ 1 ๐ฌ 2 ๐ 0
Google Gemini for Workspace requires an enterprise tier subscription to turn off. It's the best economic story for their AI.
I didn't expect them to find it, but they did because after billions of dollars and decades of ML work Google has finally created a self-aware product manager.
17.01.2025 20:02 โ ๐ 85 ๐ 10 ๐ฌ 4 ๐ 1
I swear it wasn't me xD
15.01.2025 16:45 โ ๐ 3 ๐ 0 ๐ฌ 1 ๐ 0
Baker Street by Kevin Wittek
Stream and Save Baker Street - Distributed by DistroKid
Check out the song I recorded over the holidays, an instrumental version of Gerry Rafferty's Baker Street.
First time doing everything in Logic, all guitars done using Neural DSP.
Cover by Neslihan Wittek <3
cc @calvobianco.com , who was asking for music content :D
distrokid.com/hyperfollow/...
14.01.2025 09:00 โ ๐ 4 ๐ 0 ๐ฌ 1 ๐ 0
Chief KISS officer @ Midokura, builds platform for vision AI on edge devices. Dist. systems, software plumbing, CD.
Long form at http://varoa.net
Docker helps developers bring their ideas to life by conquering the complexity of app development.
Software Engineer @ Red Hat
Author of mildly entertaining and somewhat useful #Java Specialistsโ Newsletter. Email is heinz at javaspecialists dot eu.
Husband, dad, enjoys working distributed, likes distributed databases & search engines, the JVM, Basketball/Streetball fan, gulps coffee, lives in Emsdetten/Germany, occasionally blogs at https://spinscale.de
Open source enthusiast; Project Lead for Spring Security
AI innovator. Builder of social futures
@metaminds.bsky.social
. Pro-democracy. Resisting fascism. The Singularity is near.
Musician.
Rock out with Epic Jam Tracks!
New tracks every other Saturday!
Subscribe on YT!
https://youtube.com/@epicjamtracks?si=y-XS5TXdlZJeqxX9
Showcasing timeless tracks such as the Nรผrburgring Nordschleife and real open-world environments in racing simulation games. Just type "Nordschleife 4EVER" on Youtube.
Co-leader OWASP Cornucopia. If you like what we do for open source, visit our code repository https://github.com/OWASP/cornucopia and give us a star โญ
๐ ยซDifference is of the essence of humanityยป โ John Hume
#appsec #owasp #cornucopia #threatmodeling
- PhD in AI and Consciousness - www.samhincks.com
- Building a company to Save the Oceans - www.yourdevocean.com
- Fantasy Author - www.isadorancreed.com
- Musician - Spotify/ Sam Hincks
- Following people to build spiritual/AI/ocean community
Member of GraalVM, Oracle
๐ฆ Voxxed Amsterdam conference organiser --> amsterdam.voxxeddays.com
๐ฅ JUGLeader @CodeLabJUG
๐งโ๐ป Working @CodeLab
๐ค Speaker, talks about #Green #Java #Kotlin
#RedHatter, #CNCF Ambassador, Confluent #Kafka Community Catalyst, Principal Engineer #ansible, prev. #strimzi. Tech Writer & Trainer, #Rockets fan
coder โข speaker โข musician โข MS MVP โข creator of @codewithrockstar.com โข founder of @linebreakers.band โข organiser of @ldnug.org โข fun stuff: dylanbeattie.net โข work stuff: ursatile.com โข he/him โข ๐ฅ
Professor of Computer Science, Volunteer Firefighter, Werder and Packers fan.
Software Engineer @Craftsmen | Speaker | Community builder
Full-stack dev with a focus on Java, Angular & AI.
Passionate about Machine Learning, cats ๐พ, and sharing knowledge.
Advocating for diversity as a woman in tech.
ApeldoornJUG, JUGNoord,Devoxx4Kids