ahmet alp balkan

one could say the same about genocides, but clearly all the museums, exhibits aren't solving the root cause ¯\_(ツ)_/¯

Anthropic is leading something?

I absolutely love the table of contents design and animations you have.

I cooked yesterday's block party potluck recipe with LLM, does it count?

Admiralty's been out there forever and its proxy/chaperon idea is sadly one of the most nonscalable approaches.

Anyone have recommended readings on any scalable k8s multi-cluster work API implementations? Planning to roll out a similar model on our own and I want to study the state of the art and the rationale behind the existing model.

You gotta read it in his voice too

Shoulda asked about that blue dye shit

#KubeCon schedule is out! Team LinkedIn will give 3 talks this year (myself included):
1️⃣ Making Application Rollouts Observable (lnkd.in/gmnM-8Z4)
2️⃣ How We Upgrade the Whole ML Training Fleet Bi-weekly(lnkd.in/gG_a_Etc)
3️⃣ Evicted! All the Ways Kubernetes Kills Your Pods
(lnkd.in/ggm9HKZF)

yeah we do that but it would be so much better if we didn't need to. all our microservices and our entire service infra except for CNCF components use push model, and we have to run a otel collector just for those.

Our team at LinkedIn will give 3 talks at the #KubeCon 2025! Looks like we'll be meeting in Atlanta again. 👋🏼 Stay tuned.

I think this largely assumes OLTP pushing to Prometheus backend, whereas it would be good to have no Prometheus at all in the picture. Admittedly, nearly the whole CNCF ecosystem makes a big assumption around Prometheus, whereas projects like Kyverno catching up to using OTel SDK.

Yeah but how do we change all these off the shelf components to use OTel SDK instead of Prometheus?

Does anyone know why all cloud-native open source ecosystem uses pull model to expose their /metrics (instead of pushing the metrics)? Pull model is really poor when the metric cardinality exposed on a single endpoint increases.

pedantic point: creation idea of Israel and mass Jewish migration to the British Mandate Palestine predate WW2 by many decades (Theodor Herzl, First Zionist Congress, the Uganda plan, Balfour declaration, ...)

We’ve been systematically evaluating the scalability of our fleet’s control planes, and the recent work on storage layer scalability in the Kubernetes community is going to prove pivotal as we scale further!

Check out what we’ve been upto for the past couple of weeks ♥️

As we test Kubernetes clusters beyond the supported 5,000+ nodes limit at LinkedIn, we're finding out 'List API' calls are a bottleneck in cluster reliability. So I'm publishing a deep dive about why this is a problem and what you can do about them. ahmet.im/blog/kuberne...

no man stop right there. it's a timesink.

Yeah, we also plumb all the data to mysql over time and build UIs on top. This is more for ad hoc surgical queries for nodes matching a particular label (plus I wanna be able to use this in my next jobs too 😛)

have you considered Hugo instead? it's not extremely feature rich or JS-heavy like Docusaurus, and is a bit more barebones, yet works well in sites like k8s.io.

Open sourcing a new kubectl plugin called `kubectl node-resource` that queries allocations/utilizations for all/subset of the Kubernetes nodes. It has optimizations for large clusters. We've needed this in our set up to quickly answer questions. github.com/ahmetb/kubec...

Madhav and Ahmet in the office

Glad to have @madhavjivrajani.bsky.social join us at LinkedIn compute team this summer. I’m constantly impressed by the depth of his kube-apiserver expertise.

Do you have any strava or mapmyride routes of this? Would love to give it a shot.

no :D

DAYS SINCE ETCD BACKUPS SAVED OUR ASS IN PRODUCTION: 0

If you manage your Kubernetes clusters and think you won’t lose your etcd, you’re almost certainly wrong. It takes years for the disaster to happen and you’ll be glad you have invested in building a backup/restore system.

is it officially reversed? I couldn't find much in writing about it.

@kelseyhightower.com hi Kelsey, what was your toto model again? can’t find after the twitter nuke ☹️

what does it even do lol? do we turn off the street lights April 21-28? I feel like a whereas is missing in there.

is swarm beta coming anytime soon?