Why GenAI Infrastructure Feels Backwards
Todayโs GenAI tooling is built from the client inwardโbut the long-term infrastructure needs to live server-side. Hereโs why I think Go will play a major role in that future.
Been thinking about how most GenAI tools feel designed from the front-end in. Langfuse, LangChain, even MCP all assume the client leads.
What happens when we shift toward server-side agents?
I think Go has a role to play.
open.substack.com/pub/soypetet...
#genai #golang #aiinfra #llmops
28.07.2025 00:19 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Concurrency is a Go Anti-Pattern
TL;DR: Goโs concurrency model is elegant, but modern cloud-native applications rarely benefit from it.
Just published a new post
Go was built for concurrencyโbut should you be using it? Most modern Go services run better without it.
Hereโs when to lean in, and when to step back.
๐ open.substack.com/pub/soypetet...
#golang #microservices #cloudnative #devtools
21.07.2025 14:46 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
Self-Hosting Models IS for Nerds
A Practical Guide to Local AI Dev
I gave a talk recently about self-hosting AI models, and Iโve turned that into a new post.
The post covers how I started with local-first tools like Ollama and Llama.cpp, and why I still run them
Check it out here:
open.substack.com/pub/soypetet...
#LLMDev #SelfHost #LocalAI #Ollama #LlamaCpp
08.07.2025 15:16 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Finally setting up my Mac Studio on stream today. I've got a script that boots up my whole dev environment in one shotโCLI tools, AI stuff, everything. Come hang if you like clean setups, terminal life, or software tools that just work.
๐ด [twitch.tv/soypetech]
#MacStudio #DevSetup #HomeLab
04.07.2025 17:42 โ ๐ 4 ๐ 0 ๐ฌ 0 ๐ 0
What to Optimize When Youโre a Small Data Team
How I balance AI dreams, BI demands, and real-world constraints in data engineering
Small data team? Big goals? I wrote about how Iโve built practical, high-impact data platforms as a team of oneโbalancing AI dreams, BI demands, and real-world constraints.
Read & comment: substack.com/@soypetetech...
#DataEngineering #Startups #ModernDataStack #AI #BI
02.06.2025 16:22 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
Agents Are Just Software: Why Frameworks Canโt Replace Engineering
TL;DR Agent frameworks are exploding in popularity, but most of them obscure the real engineering challenges behind LLM-powered applications.
Everyoneโs building agents. But the truth? Theyโre just software wrapped around an LLM.
If we want reliability, scale, and ROI, we need fewer frameworks and more engineeringโand we canโt ignore NLP.
open.substack.com/pub/soypetet...
#LLM #AI #NLP #DataEngineering #Agents #LangChain #Substack
29.05.2025 15:15 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
Can an M3 Ultra Mac really outperform an RTX 5090 PC in LLM benchmarks?
This Memorial Day, Iโm running a full LLaMA.cpp showdown to test it live.
Will be Live on Twitch & YouTube.
#LLAMAcpp #RTX5090 #M3Ultra #MacStudio #AIInfrastructure #Benchmarking #LocalLLM #OpenSourceAI
23.05.2025 01:21 โ ๐ 2 ๐ 0 ๐ฌ 0 ๐ 0
Prompt Engineering Without the Bloat: Lessons from Building LLM-Driven Tools
How building a Twitch chatbot taught me the real job of a software engineer working with LLMs
New post: Prompt Engineering Without the Bloat
What I learned building and why most AI features come down to 2 questions:
How do you talk to the model?
How do you talk to the user?
No overengineering. Just clean design.
open.substack.com/pub/soypetet...
#GenAI #PromptEngineering #SoftwareDesign
20.05.2025 16:15 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
gosh I love me some IAC. I dont know why, but it just is sooo cool to run
terraform apply
and watch a world get built
13.05.2025 21:05 โ ๐ 2 ๐ 0 ๐ฌ 1 ๐ 0
Running Llama.cpp on My GPU
How I Compiled Llama.cpp for GPU on WSL (With Twitch Debugging!)Struggling to run Llama.cpp with GPU support on WSL? Hereโs how I compiled it for my NVIDIA 1590 GPU, debugged missing dependencies live...
Just streamed compiling llama.cpp for GPU on my RTX 1590.
Ran into:
CUDA arch 12.0 not supported yet
Missing curl + SSL dev libs
WSL docs buried deep
With Twitch chatโs help, we got it running!
๐ open.substack.com/pub/soypetet...
#llamacpp #AIinfra #opensource #gpu #WSL2
12.05.2025 18:57 โ ๐ 5 ๐ 0 ๐ฌ 0 ๐ 0
I just posted a new video breaking down Pedroโs full 5090 upgrade:
Setup, WSL, LLaMA.cpp install, and a 9x performance boost.
Iโm trying to hit 500 subscribers to unlock YouTube monetizationโthis is now my full-time gig.
Drop a comment if you like the video!
youtu.be/hm4_VJP4GnE
05.05.2025 15:22 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Wild analytics anomaly this week on Twitch:
Jumped from 9 to 835 viewers.
No raid. No follow bump. Justโฆ poof. 800 viewers?
But only 57 unique viewers.
68 live views.
No other signals.
Gut check matters.
Donโt trust dashboards at first glance.
Sanity-check your dataโalways.
#dataengineering
02.05.2025 14:44 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
great! just make sure you have a few rounds of human revision before production ๐
30.04.2025 22:28 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
GoWest Conf 2025: Call for Speakers
The GoWest Conference is a hybrid conference for the Rocky Mountain West communities (Arizona, Utah, Colorado, Idaho).It has two main goals:โHighlight...
Got a technical deep dive on Go?
GoWest Conf 2025 wants:
โข Production stories
โข Tools & internals
โข Compiler tricks
โข Infra, performance, scale
๐ค Submit your in-person talk:
๐ sessionize.com/gowest-conf-...
๐ Lehi, UT โ Oct 24
30.04.2025 19:30 โ ๐ 1 ๐ 0 ๐ฌ 0 ๐ 0
SoyPeteTech - Twitch
CMake Canโt Find CUDA and Iโm Losing My Mind โ Letโs Compile llama.cpp Together | !pedro !linktree
๐ง Live now! Thought I could just download a binaryโฆ turns out I need to recompile llama.cpp for GPU ๐
Todayโs stream includes:
- CMake & CUDA debugging
- Compiling from source
- Running a bigger model from Hugging Face
๐ twitch.tv/soypetetech
#llamacpp #AI #CMake #CUDA
30.04.2025 19:22 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
YouTube video by SoyPete Tech
MSI Infinite RS RTX 5090 + Ultra 9 285K Unboxing and Setup | New Gaming + AI Dev Tower!
I made a supercut of my RTX 5090 unboxing streamโ
featuring the MSI Infinite RS Tower w/ the Ultra 9 285K and all the fixings.
If you were there live, drop a like!
If not, check it out and see whatโs powering Pedro now:
youtu.be/ixtMcmEZtGo
30.04.2025 14:38 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Twitch
Twitch is an interactive livestreaming service for content spanning gaming, entertainment, sports, music, and more. Thereโs something for everyone on Twitch.
๐ฅ + โ๏ธ Live now!
Todayโs stream is half content creation, half DevOps adventure:
Recording the talking head segment for the PedroGPT unboxing vid
Deploying the Discord bot to Kubernetes
Come for the AI bot, stay for the cluster chaos.
www.twitch.tv/soypetetech
#Kubernetes #DevOps #LiveCoding
25.04.2025 21:45 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
SoyPeteTech - Twitch
Making Pedro Remember: Writing Discord Messages to Postgres with Go + SQLX | !pedro
Hey everyone!
Todayโs stream is all about refactoring Pedroโs Connector APIโwe're improving how the LLM connects to Twitch + Discord and pulling out the database logic to make the AI layer clean, reusable, and self-contained.
๐ twitch.tv/soypetetech
23.04.2025 20:42 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
@soypete_tech | Linktree
Software Content Creator
I left my last job as part of the lay-offs.
While I job hunt, Iโm going all-in on building content, learning new tech, and investing in myself while I look for the next thing.
Leads welcome!
All links: linktr.ee/soypete_tech
22.04.2025 22:19 โ ๐ 2 ๐ 0 ๐ฌ 0 ๐ 0
SoyPeteTech - Twitch
Refactoring Pedro: Clean AI Layers + Connector API Upgrade! | !pedro !linktree
๐ง Live now! Weโre refactoring the Pedro Connector API to better integrate our LLM with Twitch + Discordโand removing database logic from the AI layer to make it self-contained.
Cleaner code, smarter bots.
๐ twitch.tv/soypetetech
#AI #LLM #Golang #LiveCoding #TwitchDev
22.04.2025 17:09 โ ๐ 2 ๐ 0 ๐ฌ 0 ๐ 0
SoyPeteTech - Twitch
Hi, I am Miriah - Google Developer Expert: Go, Community Builder (Forge Utah Foundation), Twitch streamerI stream software development. I don't play video games. In addition to steaming, I give talks,...
๐จ Todayโs Stream: PedroGPT Goes K3s! ๐จ
๐ twitch.tv/soypetetech
๐ youtube.com/c/miriahpete...
Join me and let's make Pedro cloud-native!
#K3s #Kubernetes #PedroGPT #LLMs #DevOps #HomeLab #LiveCoding #SelfHosted #Tailscale #Prometheus #InfraAsCode
11.04.2025 20:58 โ ๐ 2 ๐ 0 ๐ฌ 0 ๐ 0
SoyPeteTech - Twitch
RTX 5090 Unboxing, Setup, and LLM Migration | Pedroโs Upgrade Party | !pedro !linktree
Going live with Pedroโs Upgrade Party ๐
๐ RTX 5090 unboxing
๐ค Migrating my LLM bot Pedro
๐ LLaMA.cpp vs Ollama showdown
๐ณ๏ธ Community poll results live on stream!
๐บ Watch on Twitch + YouTube
twitch.tv/soypetetech
08.04.2025 22:18 โ ๐ 1 ๐ 0 ๐ฌ 1 ๐ 0
Tomorrow I'm going live with a new MSI PC rocking an RTX 5090.
I'll stream the full setup + migrating Pedro, my AI botโbut I need your vote:
Should I run Llama.cpp or Ollama on the new machine?
Poll is in my Discord, open for 24 hrs only: tr.ee/BETnCH
Stream goes live tomorrow on Twitch+YouTube!
07.04.2025 16:25 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
YouTube video by SoyPete Tech
โClaude Code: Real Dev Tool or Just Vibe Coding?โ
I made a video summarizing my experience with Claude cose
โClaude Code: Real Dev Tool or Just Vibe Coding?โ
youtu.be/Ejxm7GTXVqU
07.04.2025 13:17 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
What if we stopped renting compute from trillion-dollar clouds and started learning how systems actually work again?
I built a home lab using Pis, an old PC, and some curiosity.
Hereโs what I learned:
open.substack.com/pub/soypetet...
#homelab #AIinfra #selfhosted
02.04.2025 22:41 โ ๐ 3 ๐ 0 ๐ฌ 0 ๐ 0
YouTube video by SoyPete Tech
Why sqlc Is Better Than an ORM for Go | Full Setup & Demo
Why sqlc Is Better Than an ORM for Go | Full Setup & Demo
youtu.be/fwtxdP6mzMM
30.03.2025 16:50 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Optimizing into Chaos: Why AI Agents Need Guardrails
Lessons from Son of Anton
โInnovation requires riskโbut risk without a mitigation plan is just recklessness.โ
open.substack.com/pub/soypetet...
24.03.2025 22:19 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
New Course Launched ๐
Introduction to Go Programming
I am happy to announce a new way to learn #golang
open.substack.com/pub/soypetet...
17.03.2025 15:23 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Do you wanna know the number one way to trigger me right now? talk about building an AI agent
11.03.2025 16:02 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
I do computers. Married to @radkat.fitzpat.com. Three kids. Xoogler.
Go (#golang) team 2010~2020. Made LiveJournal, OpenID, memcached. Currently at @Tailscale.com making WireGuard easy.
Seattle, WA // Bainbridge
wvdial, bup, sshuttle, netselect, popularity-contest, redo, gfblip, GFiber, and now CEO @Tailscale.com doing WireGuard mesh. Top search result for "epic treatise."
Network nerd. Hanging out with cats and wonderful people whenever possible.
I've made computers, gizmos, vegetables, coffee, and occasionally some sense.
๐ฉ๐พโ๐ป๐ฎ๐ฉ๐ป ๐๐ชฌ๐งฟLover of nerd jokes, tacos & โ๏ธCoffee โข Mom โข ๐ Readerโข Advocates โข OpenSourceโข DevOpsโข Javaโข Linuxโข Security โข ๐Speaker โข NoSQL Databasesโข MilSpouseCoders Thoughts are my own she/her
https://www.fafo.fm
https://sessionize.com/autumn-nash
DuckDB is an analytical in-process SQL database management system. "DuckDB" and the DuckDB logo are registered trademarks of the DuckDB Foundation.
Director of Tech Evangelism @Itential โข AWS Community Builder โข LinkedIn Learning Instructor โข Host of The Cloud Gambit Pod โข Hockey ๐ when I'm not smashing that mechanical keyboard
Networking | AI | Operations | Automation | Grateful
Messing around with boats and databases.
Okta pays the bills. Sometimes data systems, sometimes security, sometimes ai/ml, sometimes a blend of it all.
Building data science tools @posit.co, #rstats, parenthood โจ๐โจ
product-focused machine learning engineer. broadly curious; amazed by the effectiveness of simple ideas.
jeremyjordan.me
former ๐ฅ dev advocate @rstudio, ๐ hoop head, data-viz lover, gnashgab, blatherskite, #rstats, doggos, and horses
Associate Prof. of Databases @ Carnegie Mellon.
programming and exclamation marks
blog: jvns.ca
zines: wizardzines.com
Geek dad with a clipboard. data / AI, open source, community building. Interested in ideas with high creative surface area
blog.abegong.com
Forward Deployed Angel Investor
https://github.com/jwills
Software engineer at @ Epic Games. Open Source enthusiast. Gopher. Aspiring Rustacean. Typescript typer. Swift swifter. Java memory consumer.
i do things | http://twitch.tv/pointcrow | http://youtube.com/pointcrow | Business inquiries: pointcrow@loaded.gg
The Wireshark Foundation is a non-profit organization helping as many people as possible understand their networks as much as possible.
https://wiresharkfoundation.org
Account Technology Strategist @ Microsoft.
https://adamfowlerit.com & https://msportals.io
Opinions mine.
https://linktr.ee/adamfowler_it