Kevin Wittek's Avatar

Kevin Wittek

@wittek.dev.bsky.social

Engineering Manager and Tech Lead at Docker, doing AI & Testcontainers, guitar & simracing, husband & dad

895 Followers  |  228 Following  |  122 Posts  |  Joined: 16.10.2023  |  1.9049

Latest posts by wittek.dev on Bluesky

Run LLMs Locally with Docker Model Runner | Simplify AI Dev with Docker Desktop
YouTube video by Kubesimplify Run LLMs Locally with Docker Model Runner | Simplify AI Dev with Docker Desktop

In this video for #Kubesimplify, our Engineering Manager for the AI Runtime Team @wittek.dev talks #Docker's latest feature: Model Runner

It allows developers to run and test #LLM from their local environment w/ Docker Desktop 4.40

www.youtube.com/watch?v=md3W...

24.04.2025 16:49 โ€” ๐Ÿ‘ 3    ๐Ÿ” 2    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Unlock AI Potential Master Docker Model Runner Today! The Docker, Inc ๐Œ๐จ๐๐ž๐ฅ ๐‘๐ฎ๐ง๐ง๐ž๐ซ is a beta feature within Docker Desktop (version 4.40 and later) designed specifically for Mac users with Apple Silic...

Super cool talking cartoon from Hamida Rebai Senior Cloud Application Architect at @microsoft.com on #DockerModelRunner

http://spklr.io/63325AF5v

18.04.2025 19:44 โ€” ๐Ÿ‘ 2    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Video thumbnail

Running a GenAI app locally with OpenAI SDK + Docker Model Runner? Yes, please.

This demo uses Next.js + Docker Compose to serve up an LLM chatbot (Qwen 2.5) with hardware acceleration on Apple Silicon.

Local, fast, secure. Watch it go! @wittek.dev

#Docker #JavaScript #NextJS #LLM #AI #OpenAI

15.04.2025 20:12 โ€” ๐Ÿ‘ 13    ๐Ÿ” 3    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I think to enjoy Mastodon, I have to curate my following list.
Right now itโ€™s weirdly random plus some grumpy German Linux IT stuff ^^

13.04.2025 11:17 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Kind of, which makes it somehow worse also ^^

13.04.2025 07:06 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Preview
Docker Does What?!? Run AI Models Locally with Docker Docker has always been about simplifying developers' lives, making it effortless to build, ship, and...

Developers: โ€œI wish I could run AI locally without all the setup.โ€ Docker: โ€œSay less.โ€

@hummusonrails.com dropped a ๐Ÿ”ฅ blog on the new Docker Model Runner:

๐Ÿ”— http://spklr.io/63328AJqs

#Docker #AI #Git #DevTools

12.04.2025 20:32 โ€” ๐Ÿ‘ 3    ๐Ÿ” 3    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Yeah, that would essentially be the self-hosting option.

12.04.2025 15:15 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

I really liked the Fediverse stuff and gave Mastodon a good try when the whole Twitter debacle happened, but somehow it fizzled out for me.

12.04.2025 14:37 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Wanted to reboot my blog and was pondering the options. Self-hosting a static site would be okayish, but I also don't really want to yak shave the whole thing.

I used to like Substack, but it just is becoming an increasingly weird platform thingie. So maybe giving Ghost a try?

12.04.2025 14:36 โ€” ๐Ÿ‘ 4    ๐Ÿ” 0    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 0

I don't really know what to do about all the different social media sites. More and more folks are following me here, but I am not really using it.

Maybe I should rotate through the different networks on a weekly basis :D (bsky, X, LinkedIn, Mastodon...)

12.04.2025 14:35 โ€” ๐Ÿ‘ 4    ๐Ÿ” 0    ๐Ÿ’ฌ 3    ๐Ÿ“Œ 0

Oh look, it's me!

03.04.2025 16:11 โ€” ๐Ÿ‘ 13    ๐Ÿ” 3    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0
Post image

In the style of The Ambassadors, Hans Holbein the Younger's Renaissance masterpiece painted in 1533, The Computers portrays many of the concepts and artifacts that define the world of computing.

07.03.2025 07:57 โ€” ๐Ÿ‘ 138    ๐Ÿ” 22    ๐Ÿ’ฌ 9    ๐Ÿ“Œ 2

An honor to be mentioned here :o

27.02.2025 09:57 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

docker run docker/hello-bluesky

12.02.2025 16:15 โ€” ๐Ÿ‘ 106    ๐Ÿ” 32    ๐Ÿ’ฌ 3    ๐Ÿ“Œ 6

I have the same impression, the search is so bad, especially about product reviews, I resort to search things like "$product reddit".

25.02.2025 15:12 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Sounds like Sunsama :)

06.02.2025 16:00 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

Even for Java? :o

06.02.2025 15:58 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

That is interesting news.

06.02.2025 15:57 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Preview
Evolving our middleware strategy Red Hat and IBM will join forces to secure the future of the Java application ecosystem for our customers.

Do I read this right, Quarkus is IBM now?
www.redhat.com/en/blog/evol...

06.02.2025 15:56 โ€” ๐Ÿ‘ 2    ๐Ÿ” 0    ๐Ÿ’ฌ 5    ๐Ÿ“Œ 1

This project is key to Java. We need a notebook to bring Java towards students, scientists,... and help them doing research/POC's in the same language that can later be used in production systems where performance/stability/scaling/security is key.

06.02.2025 07:44 โ€” ๐Ÿ‘ 10    ๐Ÿ” 8    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 1
Post image

๐ŸŽ™๏ธ Speaker Spotlight: Do not miss Kevin Wittek @wittek.dev with his lecture "Learning GenAI/LLM programming with langchain4j and Testcontainers" at Hashtag#JavaLand 2025! scomp.ly/R1oDxZ8

29.01.2025 14:08 โ€” ๐Ÿ‘ 6    ๐Ÿ” 2    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

I awkwardly get the feeling, I know why you want to use this :o

29.01.2025 16:46 โ€” ๐Ÿ‘ 1    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Preview
You Can Code Offline With Local AI(Ollama) ChatGPT and other Generative AI tools took the world by a storm. People are using these AI tools for various purposes such as to explore a topic, to seek answers to their questions or to get help in c...

๐Ÿš€ Say hello to coding offline with Local AI! ๐Ÿ’ปโœจ

Check out how Ollama lets you harness the power of AI models like Llama 3, Deepseek, and moreโ€”right on your machine! ๐Ÿง โšก

๐Ÿ”’ Privacy-first
๐Ÿ› ๏ธ Works even when you're offline

๐Ÿ‘‰ Dive in: www.sivalabs.in/code-offline...

#AI #Ollama

27.01.2025 03:32 โ€” ๐Ÿ‘ 5    ๐Ÿ” 1    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

Oh look, I am there ^^

22.01.2025 13:18 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Post image

Remembering Russel. RIP ๐Ÿ–ค

21.01.2025 16:30 โ€” ๐Ÿ‘ 42    ๐Ÿ” 11    ๐Ÿ’ฌ 0    ๐Ÿ“Œ 0

"Who gets to hit @anthropic.com harder with the money stick" apparently remains the sport of kings.

22.01.2025 05:52 โ€” ๐Ÿ‘ 40    ๐Ÿ” 2    ๐Ÿ’ฌ 4    ๐Ÿ“Œ 1
Me, while reading a book behind my desk.

Me, while reading a book behind my desk.

For my mental health, I usually refrain from commenting on politics. Today, I feel compelled to break this rule and speak out. In Germany, history revisionists yell their devoid phrases from the chancel, echoed by those who struggle with recent politics and are afraid of the future.

๐Ÿงต 1/8

20.01.2025 08:06 โ€” ๐Ÿ‘ 2    ๐Ÿ” 1    ๐Ÿ’ฌ 2    ๐Ÿ“Œ 0

Google Gemini for Workspace requires an enterprise tier subscription to turn off. It's the best economic story for their AI.

I didn't expect them to find it, but they did because after billions of dollars and decades of ML work Google has finally created a self-aware product manager.

17.01.2025 20:02 โ€” ๐Ÿ‘ 85    ๐Ÿ” 10    ๐Ÿ’ฌ 4    ๐Ÿ“Œ 1

I swear it wasn't me xD

15.01.2025 16:45 โ€” ๐Ÿ‘ 3    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0
Preview
Baker Street by Kevin Wittek Stream and Save Baker Street - Distributed by DistroKid

Check out the song I recorded over the holidays, an instrumental version of Gerry Rafferty's Baker Street.
First time doing everything in Logic, all guitars done using Neural DSP.

Cover by Neslihan Wittek <3

cc @calvobianco.com , who was asking for music content :D

distrokid.com/hyperfollow/...

14.01.2025 09:00 โ€” ๐Ÿ‘ 4    ๐Ÿ” 0    ๐Ÿ’ฌ 1    ๐Ÿ“Œ 0

@wittek.dev is following 18 prominent accounts