Danica Fine

Listen along and learn a bit more about how they efficiently solve this issue ⤵️

I sat down with Roman Kolesnev and learned that Streambased is building out a product that solves this problem exactly! Allowing your #apacheKafka data to be indexed and available immediately (without copying) and queryable through databases, open table formats like #apacheIceberg, or file systems.

But when the time comes to use your infinite data, how do you find the *right* data? #apacheKafka is a log. And even with smart partitioning, you still have to re-stream most of the data in order to find the specific account or key that you're looking for. 🔎

🔙 Back Fill. Use the history of events to rebuild state in other applications/databases.
😰 Anxiety? You don't quite know what you'll do with that data now, but you might need it someday!

📊 Time Travel Analytics. Having the entire history of data means you can easily go back to any time period and analyze those events for fraud, debugging, etc.
📑 Auditing and Regulatory. Certain industries/companies are required to retain data for a specific length of time

Infinite storage in #apacheKafka is all the rage. But what exactly is your plan when you decide to keep years' worth of data in Kafka topics? 🤔

From what I've seen, folks opt in for infinite storage for a few reasons:

I also had a chance to work with Yufei Gu, the Polaris 1.0 release manager, to put together a blog that highlights the most important parts of this release. 👇
www.snowflake.com/en/engineeri...

It's been a great week because the #apachePolaris (incubating) community just announced a milestone release with version 1.0!

Want to know what's included? You're in luck, because there's a release video for that! 📹
www.youtube.com/watch?v=ST8P...

I'll consult your calendar for the next one! 😉

Snowflake + LlamaIndex Data Agent Builders Meetup Amsterdam · Luma Join local AI engineers, data scientists, and builders for an evening of hands-on talks and open discussion around one challenge we all care about: building…

Hello, #amsterdam-based #AI enthusiasts! Let's have a meetup!

On July 31, LlamaIndex and Snowflake are coming together to host folks for an evening of discussion around building effective data agents.

Register now to secure your slot! 🎟️
lu.ma/vzwsj72w

My First Year at Snowflake — An Open Source Avalanche When I joined Snowflake a year ago, I knew that rallying Snowflake into the OSS community would have huge benefits for Apache. But I had a…

It's been a wild ride for #openSource at Snowflake this year!

"What's it like?" you ask? 🤔

Check out @russellspitzer.bsky.social's Medium blog on his first year at Snowflake. ❄️
medium.com/snowflake/my...

Request for Proposal - Atlanta Apache Iceberg Meetup If you would like to speak at one of the future meetups, please fill out the form below!

Interested in speaking? We're still looking for folks to join the agenda. Submit your idea here
💡 forms.gle/z6Qsj1D53Y1G...

We'll talk all things #apacheIceberg, #dataLakehouse, open table formats, and more. This is a great chance to connect with #openSource community members like @russellspitzer.bsky.social, stay up to data on what's new in the space, and learn more about the open lakehouse movement.

Apache Iceberg™ Meetup Atlanta · Luma Apache Iceberg™ Meetup Atlanta! 🧊❄️ Join us on July 24th (Thursday) from 5:00-8:30 PM At Snowflake Atlanta Office Connect with fellow enthusiasts, share…

#atlanta #tech community! Come join us for the first official #apacheIceberg meetup in your city on Thursday, July 24!

Don't miss it! RSVP now to secure your space 🎟️
lu.ma/vdbjh2fc

Senior Developer Advocate, OSS | Marketing | Snowflake Careers Apply for Senior Developer Advocate, OSS job with Snowflake in Menlo Park, California, United States. Marketing at Snowflake

Check out the req for more details 👇
careers.snowflake.com/us/en/job/SN...

📖 enjoy creating developer-focused content around #openSource #dataEngineering technologies (think #apacheIceberg, #postgres, #apacheNifi, and more)
🫂 love building, supporting, and championing the technical community
... then this just might be the role for you!

If you...
🏛️ have experience with #openSource foundations (like the Apache Software Foundation, Linux Foundation, etc.)
⚙️ want the opportunity to work closely with and drive our evolving #OSPO

Senior Developer Advocate, OSS | Marketing | Snowflake Careers Apply for Senior Developer Advocate, OSS job with Snowflake in Menlo Park, California, United States. Marketing at Snowflake

🗞️ Hot off the press: come join my team! 🗞️

I'm looking for a #developerAdvocate to join my #openSource #developerRelations team at Snowflake.
careers.snowflake.com/us/en/job/SN...

Not convinced? Let's hear from Lester Martin, #starburst, on why else you should care and give #apacheNifi a try 👇

What about from a #Snowflake perspective?

#apacheNifi is the foundation for Snowflake's data integration service, #openFlow. It's especially useful for multi-modal datasets that you might need for your #AI workflows.
docs.snowflake.com/en/user-guid...

#apacheNifi is an #openSource data workflow tool that's great for #etl, #dataStreaming ingestion, and #dataProcessing pipelines. Its drag-and-drop, no-code interface that makes it easy for developers and #dataEngineering folks to get started.
nifi.apache.org

Have you heard about #apacheNifi? No, well here's your chance to learn a bit about it! 🧵

YouTube video by Snowflake Developers Snowflake Summit 2025 Builders Keynote

#snowflakeSummit is over, but all of the keynotes are up on our #Snowflake Youtube channels! For no reason at all, start with the Builders keynote. 😉

See #agentic workflows in action, an #apacheIceberg #dataMesh, and how the community is coming together on #AI.
www.youtube.com/watch?v=slyY...

Request for Proposal - Seattle Apache Iceberg Meetup If you would like to speak at one of the future meetups, please fill out the form below! Website: https://sites.google.com/view/icebergmeetup Google Group: https://groups.google.com/g/seattle-apache-...

Have a use case, integration, or proposed feature you want to share? Submit to speak! We're looking for folks to share a ~20 minute session. The CfP is live and will close on July 7. ✏️
forms.gle/cABj9Ubcn3qC...

Seattle Apache Iceberg™ Community Meetup · Luma Seattle Apache Iceberg™ Community Meetup! 🧊❄️🍦 Join us on July 15th (Tuesday) from 5:00-8:30 PM At Snowflake Bellevue Office Connect with fellow enthusiasts,…

The #apacheIceberg meetup series continues in the #seattle area with a stop at the brand new Snowflake office in Bellevue! ❄️

Join fellow Iceberg enthusiasts, committers, and users on July 15th for networking, great technical discussions, and more! RSVP to reserve your spot. 🎟️
lu.ma/q9w0j1ky

Apache Iceberg™ Europe Community Meetup - July 2025 Edition · Luma Apache Iceberg™ Meetup Europe - live in Berlin! 🌍 Join us for the very first Apache Iceberg™ Meetup Europe in Berlin! Our event is hosted in Berlin,…

Psst, did you know that there's an #apacheIceberg meetup coming to #berlin in just a few weeks?

Join fellow community members at Snowflake's Berlin office for a night of networking and technical discussion around the #openLakehouse!

👉 lu.ma/pposobem

This means that any organization (large or small) can use Polaris and rest assured that it can scale with them and their users. 💥

Check out the blog to learn more about the refactor, what went into it, and more specifics around the benchmarking the team used. 👇
medium.com/snowflake/ap...

What do you get out of it? 🤔
✅ Better reliability and performance on both concurrent and sequential operations
✅ Improved scalability of Polaris
✅ Easier to manage deployments due to a simpler schema and better configurability

Apache Polaris™ (incubating) Now Supports 3X Concurrent Transactions with New Relational JDBC… Note: Apache Polaris is currently undergoing Incubation at the Apache Software Foundation

NEWS: The #openSource #apachePolaris community has just refactored the catalog persistence layer, delivering an awesome performance boost for users!

Specifically, a new JDBC-based persistence layer has taken the place of the old EclipseLink backend.
medium.com/snowflake/ap...

Snowflake’s Native Support for Apache Iceberg Tables Build secure, high-performance pipelines with native Apache Iceberg support in Snowflake—enabling seamless batch, streaming, and AI-driven data workflows.

I'm looking forward to seeing what's next as we continue building out our native support for all Iceberg workflows! Learn more about all we have to offer 👇
www.snowflake.com/en/product/f...

And, of course, watch this space for even more! 👀