Adam Bellemare

Pretty slick blog from my (new!) colleague Gunnar Morling. Check out GraalVM for native binaries with Kafka

How many times does your organization process the same data?

@abellemare.bsky.social introduces a shift left approach, minimizing duplication by processing data once and making it accessible across different use cases. Read here: https://www.infoq.com/articles/rethinking-medallion-architecture/

$1.5B for less than $20M ARR? Yikes. Is this a repeat of Databricks buying Tabular?

Apologies for the late reply - I was on vacation and unplugged!

Shift left is makes data readily available to whatever systems need it. Streams get it there in near-realtime. Iceberg Table into Silver layer is slower and typically part of a data lake. It may or may not be suitable for operations

The End of the Bronze Age: Rethinking the Medallion Architecture A shift left approach to data processing relies on data products that form the basis of data communication across the business. This addresses many flaws in traditional data processing and makes data ...

My new post is available on InfoQ. The bronze age is over! Rethink the medallion architecture.

www.infoq.com/articles/ret...

Building Event-Driven Microservices 2nd Edition is a go!

It's an ambitious release date, targeting the end of this year. 😬

Round - the warmest of shapes!

Man, I sure do love the Gulf of Mexico. Check out that Mexico Basin!

Gotta keep those AI models warm with something...

I'm thinking of writing a second edition of Building Event-Driven Microservices. Any requests for specific subjects to tackle?

Since we're kicking things off around here, again, I may as well find the rest of my fellow Kafka fans:

It's rough out there. Know the signs. Know what your loved ones are saying about #apacheKafka.

Announcing Amazon S3 Tables – Fully managed Apache Iceberg tables optimized for analytics workloads - AWS Discover more about what's new at AWS with Announcing Amazon S3 Tables – Fully managed Apache Iceberg tables optimized for analytics workloads

Hey look - AWS just released managed Apache Iceberg tables.
aws.amazon.com/about-aws/wh...

How Apache Iceberg Won the Open Table Wars Apache Iceberg has recently emerged as the de facto open-table standard for large-scale datasets, with a thriving community and support from many of the

And the winner is: Apache Iceberg!

Please commence the flame wars in the comments below.

www.bigdatawire.com/2024/12/03/h...

S3 (Iceberg) Tables is everything I dreamt of, and more. I blogged some long-form thoughts: meltware.com/2024/12/04/s...

I think we're about to see an explosion of data tools (@materialize.com, @clickhouse.com, @duckdb.org, et al.) learn to write Iceberg tables via S3 table buckets.

#databs

The deep goal of bluesky is to decentralize the social internet so that every individual controls their experience of it rather than having it be controlled by 5 random billionaires. Everyone thinks they signed up for a demuskified twitter...we actually signed an exciting and bizarre experiment.

YouTube video by Confluent Developer Confluent Developer but Wes Anderson.

My colleagues at Confluent just put out this video. I'm sharing because it's an homage to Wes Anderson, but also... really cool pastel colors, sets, vintage computers, and a mention to one of my favourite Canadian places, Victoria Island, BC!
www.youtube.com/watch?v=IQ3V...

Thansk Andrew. I have a few more parts coming out yet (maybe 2, definitely 1), so stay tuned.

How to Design Event Streams, Part 2 This article covers the degree of normalization when using events created from a relational source, and how to go about denormalizing them.

Just published part II of "How to Design Event Streams". Check it out here.

They're popping up like mushrooms after a rain!
It's good to see the Kafka API is so widely adopted though, and the de-facto standard.

November 2024 Top 10 (by Monte Carlo) For this month's top ten, Lindsay MacDonald from Monte Carlo asks a critical question: Is data ready for GenAI? While AI seems ready to take off, are our data foundations really prepared? Let’s find o...

Hey cool, I made #2 this month: www.datacouncil.ai/blog/novembe...

I wrote about how to deal with (and prevent) bad data in your event stream. It's on my company's blog: www.confluent.io/blog/shift-l...

Great post by my friend Jack - check it out.

Agreed. Here's hoping it holds out.

Can't say I'm surprised. I remember the days when Twitter was actually good - it's sure been a long time.

Guide to Building Resilient Data Pipelines w/Data Products: Shift Left Discover how to build resilient data pipelines with Confluent Data Portal. Learn essential strategies for isolating upstream systems and empowering downstream consumers.

Repost Wednesday:
Data Products, Shift-Left, and Streams - how does it all fit together? In this post, I go into depth on how you can build a data product using event streams, schemas, and Flink.

www.confluent.io/blog/impleme...

How to Handle Bad Data in Event Streams Apache Kafka topics are immutable, so you can’t edit or delete their data. But there are a few things you can do to fix bad data in event streams.

Got bad data in your event streams? It's gonna hurt. Learn how to avoid and fix it.

thenewstack.io/how-to-handl...

YouTube video by Confluent Event-Driven Architecture (EDA) vs Request/Response (RR)

Repost Wednesday: I've a series of videos about Event-Driven architectures, here's my first one!

www.youtube.com/watch?v=7fkS...

Databricks wants to merge Apache Iceberg and Delta Lake...