Kafka Streams 101: Optimizing your apps for maximum performance
Learn the concepts, configs, and application design strategies to get your Kafka Streams apps running as optimally as possible.
Next up in the Kafka Streams 101 series: performance optimization!
Admittedly this one goes way beyond just the "101" level, with general tips to incredibly specific optimization techniques.
Check it out to get a handle on your application's performance: bit.ly/43zXoQM
11.03.2025 01:19 โ ๐ 5 ๐ 2 ๐ฌ 0 ๐ 0
Kafka Streams 101: Application Lifecycle
Learn how to properly start, stop, and manage the lifecycle of Kafka Streams
Next entry in the Kafka Streams 101 series: application lifecycle.
Very beginner friendly, but even the pros might find a useful tip or two -- for example: have you heard of the new standby task listener?
Check it out: www.responsive.dev/blog/app-lif...
26.02.2025 22:04 โ ๐ 9 ๐ 4 ๐ฌ 0 ๐ 1
I like to think the capybara would be friends with an otter if it ever met one though
26.02.2025 22:00 โ ๐ 4 ๐ 0 ๐ฌ 0 ๐ 0
Kafka Streams 101: The Most Important Configs
Learn which configurations are most critical for a reliable and efficient deployment
We're keeping the ball rolling on the Kafka Streams 101 series with yet another blog post! This time the focus is on configuration, and breaking down the most important configs to focus on for various needs (such as correctness, resiliency, etc)
Check it out here: www.responsive.dev/blog/importa...
18.02.2025 22:40 โ ๐ 8 ๐ 6 ๐ฌ 0 ๐ 0
Kafka Streams 101 | Responsive
Learn to build bulletproof Kafka Streams applications
By the way, we're integrating this into our Kafka Streams 101 series, so if this speaks to you poke around the curriculum for other things that interest you and subscribe to get notified when new lessons comes out: www.responsive.dev/resources/ka...
13.02.2025 19:31 โ ๐ 0 ๐ 0 ๐ฌ 0 ๐ 0
Kafka Streams 101: Topology Upgrades
A Kafka Streams 101 lesson to learn how to identify unsafe changes to a topology and the techniques to mitigate them
The 2025 blog post series has begun and we're kicking things off with the "official" Kafka Streams upgrade-guide -- check it out for best practices when setting up a new app, rules for safe vs unsafe upgrades, and tips for making the process go smoothly: www.responsive.dev/blog/topolog...
13.02.2025 19:29 โ ๐ 5 ๐ 2 ๐ฌ 1 ๐ 0
Kafka Streams 101 | Responsive
Learn to build bulletproof Kafka Streams applications
Thanks everyone for all the feedback on blog post ideas! Performance and upgrades were most popular so stay tuned for these deep dives - for beginners and advanced users alike
Check out our new Kafka Streams 101 site and subscribe to get notified for these and other upcoming lessons! bit.ly/40LWJZL
04.02.2025 02:42 โ ๐ 6 ๐ 2 ๐ฌ 0 ๐ 0
[4/5]
And if none of these resonate with you or there's something in particular you've always wanted to go deeper on that isn't listed here, feel free to respond in the thread or DM me.
Happy streaming!
15.01.2025 03:29 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
Don't Panic: The Definitive Guide to Kafka Streams State
A definitive guide to managing Kafka Streams state that covers some history, architecture concepts and many tips to prevent panic in the face of long restoration and rebalances.
[3/5]
1. Understanding & optimizing performance
2. Processing semantics
3. Task assignment
4. Topology upgrades
5. Testing Kafka Streams
6. Topology design and architectural best practices
7. State management v2 (followup to www.responsive.dev/blog/guide-t...)
15.01.2025 03:29 โ ๐ 2 ๐ 0 ๐ฌ 1 ๐ 1
[2/5] To that end I'd love to get feedback from you, the people actually using Kafka Streams, about which topics would be most helpful to touch on this year.
I have a few ideas already queued up so let me know which of these, if any, sound most interesting to you:
15.01.2025 03:29 โ ๐ 0 ๐ 0 ๐ฌ 1 ๐ 0
[1/5] Hey fellow Kafka Streams otters! You may have already seen my previous blog posts such as the "Debugging Rebalances" and "EOS guide" from last year (and if you haven't, go check them out! Links in thread)
But now it's 2025, and time for me to think about what to write next...
15.01.2025 03:29 โ ๐ 8 ๐ 2 ๐ฌ 1 ๐ 1
Q&A: Scaling Event Driven Architectures with Metronome | LinkedIn
We're hosting a live Q&A session with two engineers who have seen it all:
- Casey Crites, a founding engineer at Metronome, implemented and scaled the Kafka pipeline at Metronome from zero to where i...
For any Kafka Streams fans out there who want to know what it's like scaling an EOS application up to multiple TB of state at ~10k+ records/s with minimal downtime -- make sure to catch the Q&A we're hosting tomorrow with Metronome.
Join us Dec 12th at 9:30am PST!
www.linkedin.com/events/72647...
11.12.2024 23:26 โ ๐ 10 ๐ 4 ๐ฌ 0 ๐ 0
i remember useless things and solve weird problems
i get paid to help AWS do open source things
once, i co-wrote an O'Reilly book on raspberry pi hacks
i maintain a lot of fedora packages, maybe too many
Regular news about #ApacheKafka or any Kafka API compatible implementation including the direct ecosystem. We are not affiliated with the Apache Software Foundation.
Technologist @ Confluent ยท Ex-lead of Debezium ยท Spec lead of Bean Validation 2.0 ยท Creator of JfrUnit, kcctl and MapStruct ยท Java Champion ยท morling.dev ยท ๐ด
Shitposting & Memes.
Data & Stuff.
#dataBS #trailrunning
โ๏ธ https://rmoff.net ๐ https://rmoff.info
BigTech BigData infra @ LinkedIn, Twitter, Cloudera
Founder and CEO at Nile (https://www.thenile.dev/). Previously: VP of Engineering at Confluent. Believe to win.
Developer ๐ฅ Advocate, Ex-Decodable, Ex-Red Hat, formerly Engineer/Trainer/Consultant - also proud husband, ๐ฆ hearted dad of 2 and โ๏ธ aficionado.
Co-Founder of @responsive.dev. Views are my own.
Entrepreneur, software engineer, non-conformist.
๐ฅ Creator of shadowtraffic.io
Building distributed systems and data infra.
Previously co-creator of Apache Flink (https://flink.apache.org/),
now building Restate (https://restate.dev/) to make distributed apps more easily resilient and scalable.
Opinions my own.
Developer Advocate. ๐ฅ โ๏ธ
http://linktr.ee/thedanicafine
Founder of SaaS Developer Community and Nile Database.
VP DevRel at Confluent. Relentless hobbyist. Married to @swimflythrive.bsky.social. Father of three, grandfather of four. Believer in Christ. Opinions should be your own.
Moving and storing bits at Confluent
Apache Kafka PMC; Software Engineer @ Confluent.
An efficient way to ingest, analyze, and export telemetry data at a fraction of the cost.
Kafka architect & developer, Java developer
Jessica Fletcher/She-Ra mashup wielding a laptop and an insane amount of curiosity Event Driven Everything, Kafka Duchess ๐ #BillsMafia She/her