The Streaming Otter
@thestreamingotter.bsky.social
The unoffical Apache Kafka Streams account. Long live the otter.
Reposted by The Streaming Otter
We are happy to share that the Apache Kafka 4.1.1 bug-fix release is now available!
It contains a critical memory-leak fix for #KafkaStreams and many other fixes. For details see kafka.apache.org/blog#apache_...
Thanks to 32 contributors and Lianet Magrans as our RM.
It contains a critical memory-leak fix for #KafkaStreams and many other fixes. For details see kafka.apache.org/blog#apache_...
Thanks to 32 contributors and Lianet Magrans as our RM.
Apache Kafka
Apache Kafka: A Distributed Streaming Platform.
kafka.apache.org
November 14, 2025 at 5:56 PM
We are happy to share that the Apache Kafka 4.1.1 bug-fix release is now available!
It contains a critical memory-leak fix for #KafkaStreams and many other fixes. For details see kafka.apache.org/blog#apache_...
Thanks to 32 contributors and Lianet Magrans as our RM.
It contains a critical memory-leak fix for #KafkaStreams and many other fixes. For details see kafka.apache.org/blog#apache_...
Thanks to 32 contributors and Lianet Magrans as our RM.
Reposted by The Streaming Otter
Also congrats to our friends from Michelin.
Excited to see their DLQ feature for #KafkaStreams being included in the upcoming #ApacheKafka 4.2.0 release.
#Current #DataStreamingAwards
current.confluent.io/data-streami...
Excited to see their DLQ feature for #KafkaStreams being included in the upcoming #ApacheKafka 4.2.0 release.
#Current #DataStreamingAwards
current.confluent.io/data-streami...
Data Streamign Awards Winner | Michelin
Winner of the 2025 Data Modernization and Contribution award
current.confluent.io
October 31, 2025 at 8:04 AM
Also congrats to our friends from Michelin.
Excited to see their DLQ feature for #KafkaStreams being included in the upcoming #ApacheKafka 4.2.0 release.
#Current #DataStreamingAwards
current.confluent.io/data-streami...
Excited to see their DLQ feature for #KafkaStreams being included in the upcoming #ApacheKafka 4.2.0 release.
#Current #DataStreamingAwards
current.confluent.io/data-streami...
Reposted by The Streaming Otter
I've built a Core Insights dashboard for #Kafka Streams! 📊
This Prometheus-based Grafana dashboard brings together the metrics that actually matter. One view to spot issues before they become incidents.
#dataengineering
kafkastreamsfieldguide.com/articles/kaf...
This Prometheus-based Grafana dashboard brings together the metrics that actually matter. One view to spot issues before they become incidents.
#dataengineering
kafkastreamsfieldguide.com/articles/kaf...
October 27, 2025 at 7:40 AM
I've built a Core Insights dashboard for #Kafka Streams! 📊
This Prometheus-based Grafana dashboard brings together the metrics that actually matter. One view to spot issues before they become incidents.
#dataengineering
kafkastreamsfieldguide.com/articles/kaf...
This Prometheus-based Grafana dashboard brings together the metrics that actually matter. One view to spot issues before they become incidents.
#dataengineering
kafkastreamsfieldguide.com/articles/kaf...
Reposted by The Streaming Otter
#KafkaStreams is at the core of Metronome.
"There is some talks we've given[...] on what it looks like to run KS at scale." -- "We are storing TBs of state in RocksDB."
A very advanced deployment requiring careful engineering. But the library approach shines!
Check it out.
cnfl.io/3WPoAGE
"There is some talks we've given[...] on what it looks like to run KS at scale." -- "We are storing TBs of state in RocksDB."
A very advanced deployment requiring careful engineering. But the library approach shines!
Check it out.
cnfl.io/3WPoAGE
Life Is But A Stream Podcast Hosted by Joseph Morais
Life Is But A Stream is a web show and podcast for tech leaders looking to harness real-time data streaming to accelerate innovation and drive business impact.
www.confluent.io
November 5, 2025 at 1:43 AM
#KafkaStreams is at the core of Metronome.
"There is some talks we've given[...] on what it looks like to run KS at scale." -- "We are storing TBs of state in RocksDB."
A very advanced deployment requiring careful engineering. But the library approach shines!
Check it out.
cnfl.io/3WPoAGE
"There is some talks we've given[...] on what it looks like to run KS at scale." -- "We are storing TBs of state in RocksDB."
A very advanced deployment requiring careful engineering. But the library approach shines!
Check it out.
cnfl.io/3WPoAGE
Reposted by The Streaming Otter
🚀 Announcing the Kafka Streams Field Guide! I’m writing a book with 8 insights for running Kafka Streams in production. Join the waiting list at kafkastreamsfieldguide.com and get 2 free chapters! #ApacheKafka
Kafka Streams Field Guide | Kafka Streams Field Guide Book
kafkastreamsfieldguide.com
September 30, 2025 at 3:25 PM
🚀 Announcing the Kafka Streams Field Guide! I’m writing a book with 8 insights for running Kafka Streams in production. Join the waiting list at kafkastreamsfieldguide.com and get 2 free chapters! #ApacheKafka
Reposted by The Streaming Otter
Happy to share, that we did release an update to our @kafkastreams.bsky.social UI in #ConfluentCloud.
We are now showing more detailed information about instances, threads, running/rebalancing state, and JMX metrics.
Check it out and let us know what you think!
www.confluent.io/blog/monitor...
We are now showing more detailed information about instances, threads, running/rebalancing state, and JMX metrics.
Check it out and let us know what you think!
www.confluent.io/blog/monitor...
Monitor Kafka Streams Health in Confluent Cloud
Quickly troubleshoot Kafka Streams apps with new health metrics in Confluent Cloud. Spot bottlenecks, monitor RocksDB, and reduce MTTR—no extra code.
www.confluent.io
October 14, 2025 at 4:27 PM
Happy to share, that we did release an update to our @kafkastreams.bsky.social UI in #ConfluentCloud.
We are now showing more detailed information about instances, threads, running/rebalancing state, and JMX metrics.
Check it out and let us know what you think!
www.confluent.io/blog/monitor...
We are now showing more detailed information about instances, threads, running/rebalancing state, and JMX metrics.
Check it out and let us know what you think!
www.confluent.io/blog/monitor...
Reposted by The Streaming Otter
We are excited to announce the Apache Kafka 4.0.1 bug-fix release, containing over 40 fixes!
Thanks to 53 contributors and your RM Christo Lolov.
For more details, checkout the announcement:
kafka.apache.org/blog#apache_...
Thanks to 53 contributors and your RM Christo Lolov.
For more details, checkout the announcement:
kafka.apache.org/blog#apache_...
Apache Kafka
Apache Kafka: A Distributed Streaming Platform.
kafka.apache.org
October 13, 2025 at 7:40 PM
We are excited to announce the Apache Kafka 4.0.1 bug-fix release, containing over 40 fixes!
Thanks to 53 contributors and your RM Christo Lolov.
For more details, checkout the announcement:
kafka.apache.org/blog#apache_...
Thanks to 53 contributors and your RM Christo Lolov.
For more details, checkout the announcement:
kafka.apache.org/blog#apache_...
Oh-oh!
🚨Kafka Streams 4.1.0 contains a memory leak regression bug: issues.apache.org/jira/browse/...
Be careful upgrading, or wait for 4.1.1 bug-fix release. We plan to get it out quickly.
Be careful upgrading, or wait for 4.1.1 bug-fix release. We plan to get it out quickly.
issues.apache.org
October 7, 2025 at 7:31 PM
Oh-oh!
Reposted by The Streaming Otter
Any KIP-1071 experience out there?
Asking for a friend.
Asking for a friend.
September 30, 2025 at 2:34 AM
Any KIP-1071 experience out there?
Asking for a friend.
Asking for a friend.
Reposted by The Streaming Otter
🚀 Yesterday, we announced that 𝗥𝗲𝘀𝘁𝗮𝘁𝗲 𝗖𝗹𝗼𝘂𝗱 is now publicly available. Today, we’re announcing 𝗥𝗲𝘀𝘁𝗮𝘁𝗲 𝟭.𝟱!
This release brings key features for building, controlling and observing your durable agents and workflows.
This release brings key features for building, controlling and observing your durable agents and workflows.
October 1, 2025 at 2:51 PM
🚀 Yesterday, we announced that 𝗥𝗲𝘀𝘁𝗮𝘁𝗲 𝗖𝗹𝗼𝘂𝗱 is now publicly available. Today, we’re announcing 𝗥𝗲𝘀𝘁𝗮𝘁𝗲 𝟭.𝟱!
This release brings key features for building, controlling and observing your durable agents and workflows.
This release brings key features for building, controlling and observing your durable agents and workflows.
Reposted by The Streaming Otter
The #ApacheKafka Java clients and #KafkaStreams engineering team at @confluent.io keeps growing.
Very excited to welcome @okaberintaroubeta.bsky.social, Genseric Ghiro, and @nikitashupletsov.bsky.social!
We also have one more entry level position in Toronto 🇨🇦
careers.confluent.io/jobs/job/67c...
Very excited to welcome @okaberintaroubeta.bsky.social, Genseric Ghiro, and @nikitashupletsov.bsky.social!
We also have one more entry level position in Toronto 🇨🇦
careers.confluent.io/jobs/job/67c...
careers.confluent.io
September 10, 2025 at 12:39 AM
The #ApacheKafka Java clients and #KafkaStreams engineering team at @confluent.io keeps growing.
Very excited to welcome @okaberintaroubeta.bsky.social, Genseric Ghiro, and @nikitashupletsov.bsky.social!
We also have one more entry level position in Toronto 🇨🇦
careers.confluent.io/jobs/job/67c...
Very excited to welcome @okaberintaroubeta.bsky.social, Genseric Ghiro, and @nikitashupletsov.bsky.social!
We also have one more entry level position in Toronto 🇨🇦
careers.confluent.io/jobs/job/67c...
Reposted by The Streaming Otter
Apache Kafka 4.1.0 was release!
Most exciting, the new “streams” rebalance protocol is available as early access.
We are happy to announce the Apache Kafka 4.1.0 release!
Please try it out, and let us know how it goes!
kafka.apache.org/blog#apache_...
Most exciting, the new “streams” rebalance protocol is available as early access.
We are happy to announce the Apache Kafka 4.1.0 release!
Please try it out, and let us know how it goes!
kafka.apache.org/blog#apache_...
Apache Kafka
Apache Kafka: A Distributed Streaming Platform.
kafka.apache.org
September 4, 2025 at 5:23 PM
Apache Kafka 4.1.0 was release!
Most exciting, the new “streams” rebalance protocol is available as early access.
We are happy to announce the Apache Kafka 4.1.0 release!
Please try it out, and let us know how it goes!
kafka.apache.org/blog#apache_...
Most exciting, the new “streams” rebalance protocol is available as early access.
We are happy to announce the Apache Kafka 4.1.0 release!
Please try it out, and let us know how it goes!
kafka.apache.org/blog#apache_...
Reposted by The Streaming Otter
While we are waiting for Apache Kafka 4.1.0 release, the development does not stop. We just completed KIP-1034 (cwiki.apache.org/confluence/d...) which adds a DLQ feature to Kafka Streams. Very exciting!
https://cwiki.apache.org/confluence/dis…
July 28, 2025 at 11:19 PM
While we are waiting for Apache Kafka 4.1.0 release, the development does not stop. We just completed KIP-1034 (cwiki.apache.org/confluence/d...) which adds a DLQ feature to Kafka Streams. Very exciting!
Reposted by The Streaming Otter
The schedule is now available for Community Over Code North America, and early bird registration ends June 28. We hope you'll join the ASF community in Minneapolis Sept 11-14! buff.ly/4b8kciW
#CommunityOverCode #opensource
#CommunityOverCode #opensource
June 17, 2025 at 7:00 PM
The schedule is now available for Community Over Code North America, and early bird registration ends June 28. We hope you'll join the ASF community in Minneapolis Sept 11-14! buff.ly/4b8kciW
#CommunityOverCode #opensource
#CommunityOverCode #opensource
Reposted by The Streaming Otter
Insane amount of SlateDB work going on:
- snapshot reads
- split/merge DBs (zero copy)
- deterministic simulation testing
And someone just pushed Python bindings in a PR! 🤯
- snapshot reads
- split/merge DBs (zero copy)
- deterministic simulation testing
And someone just pushed Python bindings in a PR! 🤯
June 18, 2025 at 2:48 PM
Insane amount of SlateDB work going on:
- snapshot reads
- split/merge DBs (zero copy)
- deterministic simulation testing
And someone just pushed Python bindings in a PR! 🤯
- snapshot reads
- split/merge DBs (zero copy)
- deterministic simulation testing
And someone just pushed Python bindings in a PR! 🤯
Reposted by The Streaming Otter
Apache Kafka 3.9.1 is now available for download: buff.ly/5ONjJgB
This bug-fix release has several fixes, and most importantly, it adds Java 23 support. #opensource
This bug-fix release has several fixes, and most importantly, it adds Java 23 support. #opensource
June 10, 2025 at 3:18 PM
Apache Kafka 3.9.1 is now available for download: buff.ly/5ONjJgB
This bug-fix release has several fixes, and most importantly, it adds Java 23 support. #opensource
This bug-fix release has several fixes, and most importantly, it adds Java 23 support. #opensource
Reposted by The Streaming Otter
Next at #Current25 a panel discussion on the past, present and future of @kafkastreams.bsky.social. I love the background...the likeness is uncanny...
May 20, 2025 at 1:17 PM
Next at #Current25 a panel discussion on the past, present and future of @kafkastreams.bsky.social. I love the background...the likeness is uncanny...
Reposted by The Streaming Otter
New blog post alert! My colleague Alieh Saeedi digs into the guts of manual consumer offset commits, and the improvements of KIP-1094 (AK 4.0) about it.
Outstanding work!
Enjoy the read and change your code. You most likely do it wrong right now!
www.confluent.io/blog/guide-t...
Outstanding work!
Enjoy the read and change your code. You most likely do it wrong right now!
www.confluent.io/blog/guide-t...
Kafka Consumer Offsets Guide—Basic Principles, Insights & Enhancements
Learn how to achieve data consistency and reliability with a complete Apache Kafka consumer offsets guide covering key principles, offset management, and KIP-1094 innovations.
www.confluent.io
April 22, 2025 at 3:04 PM
New blog post alert! My colleague Alieh Saeedi digs into the guts of manual consumer offset commits, and the improvements of KIP-1094 (AK 4.0) about it.
Outstanding work!
Enjoy the read and change your code. You most likely do it wrong right now!
www.confluent.io/blog/guide-t...
Outstanding work!
Enjoy the read and change your code. You most likely do it wrong right now!
www.confluent.io/blog/guide-t...
Reposted by The Streaming Otter
Today marks SlateDB’s one year anniversary! It’s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. 😀
SlateDB - An embedded storage engine built on object storage | SlateDB
Description will go into a meta tag in <head />
SlateDB.io
April 22, 2025 at 9:55 PM
Today marks SlateDB’s one year anniversary! It’s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. 😀
Reposted by The Streaming Otter
We are having two more (early career) open positions in our team, Java clients & #KafkaStreams (🇨🇦). If working on distributed data systems and stream processing sounds interesting to you, please apply: careers.confluent.io/jobs/1518441...
We have also not closed the other two positions yet:
We have also not closed the other two positions yet:
April 23, 2025 at 12:51 AM
We are having two more (early career) open positions in our team, Java clients & #KafkaStreams (🇨🇦). If working on distributed data systems and stream processing sounds interesting to you, please apply: careers.confluent.io/jobs/1518441...
We have also not closed the other two positions yet:
We have also not closed the other two positions yet:
Reposted by The Streaming Otter
Looking forward to @sharatchander.bsky.social 's Keynote. Then, looking forward to hearing @gamussa.dev talking about Kafka and the Schema Registry, and then more!
Java, Kafka, @kafkastreams.bsky.social, & @intellijidea.com - that's my tech stack!
lp.jetbrains.com/intellij-ide...
@jetbrains.com
Java, Kafka, @kafkastreams.bsky.social, & @intellijidea.com - that's my tech stack!
lp.jetbrains.com/intellij-ide...
@jetbrains.com
IntelliJ IDEA Conf 2025 | June 3-4, 2025
We invite you to join us for IntelliJ IDEA Conf 2025 and gain insights from industry leaders and experts.
lp.jetbrains.com
April 22, 2025 at 3:52 PM
Looking forward to @sharatchander.bsky.social 's Keynote. Then, looking forward to hearing @gamussa.dev talking about Kafka and the Schema Registry, and then more!
Java, Kafka, @kafkastreams.bsky.social, & @intellijidea.com - that's my tech stack!
lp.jetbrains.com/intellij-ide...
@jetbrains.com
Java, Kafka, @kafkastreams.bsky.social, & @intellijidea.com - that's my tech stack!
lp.jetbrains.com/intellij-ide...
@jetbrains.com
Reposted by The Streaming Otter
Apache Kafka 4.0 was released recently. We got a couple of a cool KIPs shipped.
KIP-1065: cwiki.apache.org/confluence/p...
The ProductionExceptionHandler becomes more flexible. It’s now also called for retriable errors. This allows you to break (previously infinite) retry loops.
\1
KIP-1065: cwiki.apache.org/confluence/p...
The ProductionExceptionHandler becomes more flexible. It’s now also called for retriable errors. This allows you to break (previously infinite) retry loops.
\1
https://cwiki.apache.org/confluence/pag…
April 5, 2025 at 5:40 AM
Apache Kafka 4.0 was released recently. We got a couple of a cool KIPs shipped.
KIP-1065: cwiki.apache.org/confluence/p...
The ProductionExceptionHandler becomes more flexible. It’s now also called for retriable errors. This allows you to break (previously infinite) retry loops.
\1
KIP-1065: cwiki.apache.org/confluence/p...
The ProductionExceptionHandler becomes more flexible. It’s now also called for retriable errors. This allows you to break (previously infinite) retry loops.
\1
