#apachekafka
LightNews LightNews
igfasouza.bsky.social
Why Diskless Is a Game-Changer for Running Kafka at Scale

#apachekafka

thenewstack.io/why-diskless...
Why Inkless Kafka Is a Game-Changer for Running Kafka at Scale
High replication costs are a serious problem when running Kafka in the cloud. Learn how writing data directly in object storage can help.
thenewstack.io
November 10, 2025 at 10:07 PM
igfasouza.bsky.social
From Tower of Babel to Babel Fish | Voxxed Days Thessaloniki 2025

#apachekafka

youtu.be/QOSoh_Q8pxU?...
From Tower of Babel to Babel Fish | Voxxed Days Thessaloniki 2025
YouTube video by Viktor Gamov
youtu.be
November 10, 2025 at 10:15 AM
igfasouza.bsky.social
You Don't Need Kafka, Just Use Postgres" Considered Harmful

#apachekafka

www.morling.dev/blog/you-don...
"You Don't Need Kafka, Just Use Postgres" Considered Harmful
Looking to make it to the front page of HackerNews? Then writing a post arguing that "Postgres is enough", or why "you don’t need Kafka at your scale" is a pretty failsafe way of achieving exactly tha...
www.morling.dev
November 9, 2025 at 7:15 PM
igfasouza.bsky.social
Building a 3 node Kafka cluster

#apachekafka

medium.com/@ranjanabhab...
Building a 3 node Kafka cluster
In the world of real-time data streaming, scalability and reliability are non-negotiable. Apache Kafka has become the backbone of modern…
medium.com
November 9, 2025 at 8:53 AM
igfasouza.bsky.social
Event Streaming is Topping Out

#apachekafka

There's no money left in real-time event streaming. A major consolidation wave is beginning.

bigdata.2minutestreaming.com/p/event-stre...
Event Streaming is Topping Out
There's no money left in real-time event streaming. A major consolidation wave is beginning.
bigdata.2minutestreaming.com
November 8, 2025 at 10:19 AM
igfasouza.bsky.social
How Would You Like Your Iceberg Sir? Stream or Batch Ordered?

#apachekafka

jack-vanlightly.com/blog/2025/11...
How Would You Like Your Iceberg Sir? Stream or Batch Ordered? — Jack Vanlightly
Today I want to talk about stream analytics, batch analytics and Apache Iceberg. Stream and batch analytics work differently but both can be built on top of Iceberg, but due to their differences there...
jack-vanlightly.com
November 7, 2025 at 7:33 PM
igfasouza.bsky.social
Old-School Kafka: A Terminal-First Approach to Learning Distributed Streaming

#apachekafka

medium.com/@priyankaguh...
Old-School Kafka: A Terminal-First Approach to Learning Distributed Streaming
Imagine a bustling city. Every second, millions of things are happening: someone orders a coffee, a taxi picks up a passenger, a tweet goes…
medium.com
November 7, 2025 at 9:30 AM
igfasouza.bsky.social
Exploring Seamless Kafka-to-Data Lake Integration: Evaluating Tableflow as a Robust Streaming Analytics Solution

#apachekafka

medium.com/@jp.mantuano...
Exploring Seamless Kafka-to-Data Lake Integration: Evaluating Tableflow as a Robust Streaming…
In today’s rapidly evolving data landscape, organizations are continuously exploring innovative solutions to better manage data stored in…
medium.com
November 6, 2025 at 7:36 PM
igfasouza.bsky.social
The Stream Processing Showdown: Kafka Streams vs. Flink vs. Spark

#apachekafka
#apacheflink
#apachespark

medium.com/@balaji.raja...
The Stream Processing Showdown: Kafka Streams vs. Flink vs. Spark
The Stream Processing Showdown: Kafka Streams vs. Flink vs. Spark Read the full story for free …
medium.com
November 6, 2025 at 9:09 AM
igfasouza.bsky.social
Kafka Log Cleanup: Delete vs Compact

#apachekafka

www.geekish.fun/blog/kafka-d...
Geekish.Fun | Kafka Log Cleanup: Delete vs Compact
When to use cleanup.policy=delete vs compact, with trade-offs, configs, and recipes
www.geekish.fun
November 5, 2025 at 6:06 PM
igfasouza.bsky.social
Managing Kafka at Scale: Common Pitfalls and the Conduktor Fix

#apachekafka

medium.com/@rajesh.sgr/...
Managing Kafka at Scale: Common Pitfalls and the Conduktor Fix
Apache Kafka is the lifeblood of modern enterprises. From retail payments to IoT pipelines, it keeps data flowing in real time. But anyone…
medium.com
November 5, 2025 at 9:11 AM
scholzj.bsky.social
1/2 Is it normal to do this kind of paid marketing for an open-source project proposal that is still under discussion? Or did I miss it, and #ApacheKafka KIP-1150 was approved? thenewstack.io/why-diskless...
Why Diskless Is a Game-Changer for Running Kafka at Scale
High replication costs are a serious problem when running Kafka in the cloud. Learn how writing data directly in object storage can help.
thenewstack.io
November 5, 2025 at 1:11 AM
igfasouza.bsky.social
The Good, The Bad and The AutoMQ

#apachekafka

medium.com/fresha-data-...
The Good, The Bad and The AutoMQ
Slack’s KIP-1176, Aiven’s Diskless 2.0, and AutoMQ’s KIP-1183 and how Kafka’s storage frontier shifts from disks to the cloud.
medium.com
November 4, 2025 at 7:48 PM
igfasouza.bsky.social
Kafka’s biggest contribution to enterprises isn’t what you think.

#apachekafka

medium.com/@chanaud.jul...
Kafka’s biggest contribution to enterprises isn’t what you think.
Kafka’s biggest contribution to the “Traditional World” [1] isn’t what you think. These organizations don’t use Kafka at LinkedIn scale and…
medium.com
November 4, 2025 at 9:13 AM
igfasouza.bsky.social
A collection of demos showcasing how stream processing can be used to solve real-world problems

#apachekafka

github.com/risingwavela...
GitHub - risingwavelabs/awesome-stream-processing: A collection of demos showcasing how stream processing can be used to solve real-world problems.
A collection of demos showcasing how stream processing can be used to solve real-world problems. - risingwavelabs/awesome-stream-processing
github.com
November 3, 2025 at 5:27 PM
igfasouza.bsky.social
Apache Kafka (Kafka Connect) vs. Apache Flink vs. Apache Spark: Choosing the Right Ingestion Framework

#apachekafka
#apacheflink
#apachespark

www.onehouse.ai/blog/kafka-c...
Apache Kafka® (Kafka Connect) vs. Apache Flink® vs. Apache Spark™: Choosing the Right Ingestion Framework
This article compares three data ingestion frameworks—Kafka, Flink, and Spark—highlighting their unique strengths, use cases, and performance capabilities.
www.onehouse.ai
November 3, 2025 at 9:11 AM
digitalbuff.dev
Exciting news about my #KafkaStreams Field Guide! 📚

✅ Will be available in HTML, PDF, and EPUB
✅ Code examples in both Java and Scala

Read it however you like, in whichever language you prefer. More details coming soon!

#ApacheKafka #dataengineering

kafkastreamsfieldguide.com
Kafka Streams Field Guide | Kafka Streams Field Guide Book
Field guide with 8 essential insights for running Kafka Streams in production
kafkastreamsfieldguide.com
November 3, 2025 at 7:30 AM
igfasouza.bsky.social
Examples of Kafka Headers

#apachekafka

www.superstream.ai/blog/kafka-h...
Kafka Headers Explained: Examples, Best Practices, and Metadata Governance | Superstream Blog
kafka-headers-explained-examples
www.superstream.ai
November 2, 2025 at 6:05 PM
igfasouza.bsky.social
The ZooKeeper Eviction Notice: A Senior Architect’s Playbook for Migrating to KRaft

#apachekafka

medium.com/@chathuskadi...
The ZooKeeper Eviction Notice: A Senior Architect’s Playbook for Migrating to KRaft
For over a decade, Apache ZooKeeper has been the faithful, if somewhat complex, companion to every Kafka cluster. It’s the distributed…
medium.com
November 2, 2025 at 9:23 AM
igfasouza.bsky.social
Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of Kafka clusters.

#apachekafka

github.com/linkedin/cru...
GitHub - linkedin/cruise-control: Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users b...
Cruise-control is the first of its kind to fully automate the dynamic workload rebalance and self-healing of a Kafka cluster. It provides great value to Kafka users by simplifying the operation of ...
github.com
November 1, 2025 at 5:36 PM
igfasouza.bsky.social
A Fork in the Road: Deciding Kafka’s Diskless Future

#apachekafka

jack-vanlightly.com/blog/2025/10...
A Fork in the Road: Deciding Kafka’s Diskless Future — Jack Vanlightly
“ The Kafka community is currently seeing an unprecedented situation with three KIPs ( KIP-1150 , KIP-1176 , KIP-1183) simultaneously addressing the same challenge of high replica...
jack-vanlightly.com
November 1, 2025 at 10:00 AM
igfasouza.bsky.social
Redpanda Kafka Benchmark

#apachekafka

youtu.be/7CdM1WcuoLc?...
Redpanda Kafka Benchmark
YouTube video by Aleksandr Khalikov
youtu.be
November 1, 2025 at 12:50 AM
igfasouza.bsky.social
Kafka Consumer Lag Explained

#apachekafka

dattell.com/data-archite...
Kafka Consumer Lag Explained
Consumer lag is one of the most common operational issues in Kafka-based systems—and one of the most misunderstood. Discover why it happens, and how to detect and resolve it in production environments...
dattell.com
October 31, 2025 at 8:56 AM
mjsax.bsky.social
Also congrats to our friends from Michelin.

Excited to see their DLQ feature for #KafkaStreams being included in the upcoming #ApacheKafka 4.2.0 release.

#Current #DataStreamingAwards

current.confluent.io/data-streami...
Data Streamign Awards Winner | Michelin
Winner of the 2025 Data Modernization and Contribution award
current.confluent.io
October 31, 2025 at 8:04 AM
igfasouza.bsky.social
A brand new Kafka Consumer Rebalance Protocol!

#apachekafka

suryateja9618.medium.com/a-brand-new-...
A brand new Kafka Consumer Rebalance Protocol!
Hello pals,
suryateja9618.medium.com
October 30, 2025 at 1:17 PM