Or listen along with my latest release video:
🎬 youtu.be/7BLoAkrA-h4

So good to meet you! Hope to see you again at another conference. 😁

😂 Hope to catch you at my #apacheKafka <> #apacheIceberg session!

Listen along and learn a bit more about how they efficiently solve this issue ⤵️

I sat down with Roman Kolesnev and learned that Streambased is building out a product that solves this problem exactly! Allowing your #apacheKafka data to be indexed and available immediately (without copying) and queryable through databases, open table formats like #apacheIceberg, or file systems.

But when the time comes to use your infinite data, how do you find the *right* data? #apacheKafka is a log. And even with smart partitioning, you still have to re-stream most of the data in order to find the specific account or key that you're looking for. 🔎

🔙 Back Fill. Use the history of events to rebuild state in other applications/databases.
😰 Anxiety? You don't quite know what you'll do with that data now, but you might need it someday!

📊 Time Travel Analytics. Having the entire history of data means you can easily go back to any time period and analyze those events for fraud, debugging, etc.
📑 Auditing and Regulatory. Certain industries/companies are required to retain data for a specific length of time

I also had a chance to work with Yufei Gu, the Polaris 1.0 release manager, to put together a blog that highlights the most important parts of this release. 👇
www.snowflake.com/en/engineeri...

I'll consult your calendar for the next one! 😉

Interested in speaking? We're still looking for folks to join the agenda. Submit your idea here
💡 forms.gle/z6Qsj1D53Y1G...

We'll talk all things #apacheIceberg, #dataLakehouse, open table formats, and more. This is a great chance to connect with #openSource community members like @russellspitzer.bsky.social, stay up to data on what's new in the space, and learn more about the open lakehouse movement.

Check out the req for more details 👇
careers.snowflake.com/us/en/job/SN...

📖 enjoy creating developer-focused content around #openSource #dataEngineering technologies (think #apacheIceberg, #postgres, #apacheNifi, and more)
🫂 love building, supporting, and championing the technical community
... then this just might be the role for you!

If you...
🏛️ have experience with #openSource foundations (like the Apache Software Foundation, Linux Foundation, etc.)
⚙️ want the opportunity to work closely with and drive our evolving #OSPO

Not convinced? Let's hear from Lester Martin, #starburst, on why else you should care and give #apacheNifi a try 👇

What about from a #Snowflake perspective?

#apacheNifi is the foundation for Snowflake's data integration service, #openFlow. It's especially useful for multi-modal datasets that you might need for your #AI workflows.
docs.snowflake.com/en/user-guid...