Adam Bellemare

Also thank you, of course, to Confluent, for sponsoring me and supporting me with both time and technical expertise while I worked on this book (note: I work for Confluent now, but didn't when I wrote the first edition).

I'd like to thank everyone at O'Reilly for everything they've done to make this book a reality. They have some of the best editors, production managers, and content reviewers that I've ever worked with.

(con't) New content includes (but not limited to):
- A major revision to building, managing, and deploying services in the age of cloud computing (remember, I started the first book in 2017: 8 years ago).
- How to handle bad data in event streams.

New content includes (but not limited to):
- An extensive focus on event design, including types of events, schema usage, mapping to streams, and changes through time.
- A major revision of the types of frameworks you can use to build your event-driven services.

Building Event-Driven Microservices, 2E Kafka can autoscale guarantee resilience minimize operational overhead secure your data save you money.

You can also find it as an ebook PDF from Confluent (www.confluent.io/resources/eb...) , or printed in paper on various online sellers starting in mid-to-late October.

Building Event-Driven Microservices, 2nd Edition Event-driven microservices offer an optimal approach to harnessing event streams, reacting and responding to changes as they occur across your company. With this fully revised and... - Selection from ...

It's DONE. SHIP IT.

Finished my 2nd edition of Building Event-Driven Microservices, published by @oreilly.bsky.social and sponsored by the good people at @confluent.io.

You can find this book on the O'Reilly learning platform (www.oreilly.com/library/view... - you get a free trial!),

Pretty slick blog from my (new!) colleague Gunnar Morling. Check out GraalVM for native binaries with Kafka

How many times does your organization process the same data?

@abellemare.bsky.social introduces a shift left approach, minimizing duplication by processing data once and making it accessible across different use cases. Read here: https://www.infoq.com/articles/rethinking-medallion-architecture/

$1.5B for less than $20M ARR? Yikes. Is this a repeat of Databricks buying Tabular?

Apologies for the late reply - I was on vacation and unplugged!

Shift left is makes data readily available to whatever systems need it. Streams get it there in near-realtime. Iceberg Table into Silver layer is slower and typically part of a data lake. It may or may not be suitable for operations

The End of the Bronze Age: Rethinking the Medallion Architecture A shift left approach to data processing relies on data products that form the basis of data communication across the business. This addresses many flaws in traditional data processing and makes data ...

My new post is available on InfoQ. The bronze age is over! Rethink the medallion architecture.

www.infoq.com/articles/ret...

Building Event-Driven Microservices 2nd Edition is a go!

It's an ambitious release date, targeting the end of this year. 😬

Round - the warmest of shapes!

Man, I sure do love the Gulf of Mexico. Check out that Mexico Basin!

Gotta keep those AI models warm with something...

I'm thinking of writing a second edition of Building Event-Driven Microservices. Any requests for specific subjects to tackle?

Since we're kicking things off around here, again, I may as well find the rest of my fellow Kafka fans:

It's rough out there. Know the signs. Know what your loved ones are saying about #apacheKafka.

Announcing Amazon S3 Tables – Fully managed Apache Iceberg tables optimized for analytics workloads - AWS Discover more about what's new at AWS with Announcing Amazon S3 Tables – Fully managed Apache Iceberg tables optimized for analytics workloads

Hey look - AWS just released managed Apache Iceberg tables.
aws.amazon.com/about-aws/wh...

How Apache Iceberg Won the Open Table Wars Apache Iceberg has recently emerged as the de facto open-table standard for large-scale datasets, with a thriving community and support from many of the

And the winner is: Apache Iceberg!

Please commence the flame wars in the comments below.

www.bigdatawire.com/2024/12/03/h...

S3 (Iceberg) Tables is everything I dreamt of, and more. I blogged some long-form thoughts: meltware.com/2024/12/04/s...

I think we're about to see an explosion of data tools (@materialize.com, @clickhouse.com, @duckdb.org, et al.) learn to write Iceberg tables via S3 table buckets.

#databs

The deep goal of bluesky is to decentralize the social internet so that every individual controls their experience of it rather than having it be controlled by 5 random billionaires. Everyone thinks they signed up for a demuskified twitter...we actually signed an exciting and bizarre experiment.

YouTube video by Confluent Developer Confluent Developer but Wes Anderson.

My colleagues at Confluent just put out this video. I'm sharing because it's an homage to Wes Anderson, but also... really cool pastel colors, sets, vintage computers, and a mention to one of my favourite Canadian places, Victoria Island, BC!
www.youtube.com/watch?v=IQ3V...

Thansk Andrew. I have a few more parts coming out yet (maybe 2, definitely 1), so stay tuned.

How to Design Event Streams, Part 2 This article covers the degree of normalization when using events created from a relational source, and how to go about denormalizing them.

Just published part II of "How to Design Event Streams". Check it out here.

They're popping up like mushrooms after a rain!
It's good to see the Kafka API is so widely adopted though, and the de-facto standard.

November 2024 Top 10 (by Monte Carlo) For this month's top ten, Lindsay MacDonald from Monte Carlo asks a critical question: Is data ready for GenAI? While AI seems ready to take off, are our data foundations really prepared? Let’s find o...

Hey cool, I made #2 this month: www.datacouncil.ai/blog/novembe...

I wrote about how to deal with (and prevent) bad data in your event stream. It's on my company's blog: www.confluent.io/blog/shift-l...

Great post by my friend Jack - check it out.

Agreed. Here's hoping it holds out.

Can't say I'm surprised. I remember the days when Twitter was actually good - it's sure been a long time.

Guide to Building Resilient Data Pipelines w/Data Products: Shift Left Discover how to build resilient data pipelines with Confluent Data Portal. Learn essential strategies for isolating upstream systems and empowering downstream consumers.

Repost Wednesday:
Data Products, Shift-Left, and Streams - how does it all fit together? In this post, I go into depth on how you can build a data product using event streams, schemas, and Flink.

www.confluent.io/blog/impleme...