Lightnews — Scholar-powered news

Reposted by rmoff 🏃‍♂️🫖🥓

Jack Vanlightly @vanlightly.bsky.social · 18h

New post: why I’m not a fan of “zero-copy” Iceberg tables for Apache Kafka.
From a systems design view, it trades storage savings for coupling and complexity.
Sometimes, duplication is cheaper than coupling.
jack-vanlightly.com/blog/2025/10...

Why I’m not a fan of zero-copy Apache Kafka-Apache Iceberg — Jack Vanlightly

Over the past few months, I’ve seen a growing number of posts on social media promoting the idea of a “zero-copy” integration between Apache Kafka and Apache Iceberg. The idea is that Kafka topics cou...

jack-vanlightly.com

1 3 11

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 17h

Just when you thought OTFs had settled down: IndexTables is an experimental open-table format for Apache Spark: github.com/indextables/...

GitHub - indextables/indextables_spark: IndexTables is an experimental open-table format for Apache Spark that enables fast retrieval and full-text search across large-scale data. It integrates seamlessly with Spark SQL, allowing you to combine powerful search capabilities with joins, aggregations, and standard SQL operations.

IndexTables is an experimental open-table format for Apache Spark that enables fast retrieval and full-text search across large-scale data. It integrates seamlessly with Spark SQL, allowing you to ...

github.com

3

Reposted by rmoff 🏃‍♂️🫖🥓

Matthias J. Sax @mjsax.bsky.social · 1d

Happy to share, that we did release an update to our @kafkastreams.bsky.social UI in #ConfluentCloud.

We are now showing more detailed information about instances, threads, running/rebalancing state, and JMX metrics.

Check it out and let us know what you think!

www.confluent.io/blog/monitor...

Monitor Kafka Streams Health in Confluent Cloud

Quickly troubleshoot Kafka Streams apps with new health metrics in Confluent Cloud. Spot bottlenecks, monitor RocksDB, and reduce MTTR—no extra code.

www.confluent.io

5 3

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 6d

Trying out #RevealJS with #Asciidoc and liking it a lot so far.
Some good resources/examples I've used:

8vi.cat/build-beauti...

zenika.github.io/adoc-present...

github.com/martsec/asci...

marketplace.visualstudio.com/items?itemNa...

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 7d

If I'm not using Keynote (which I probably will tho), what are my text-based slidewriting options these days? Ideally something asciidoc based, but can live with Markdown. It needs to not look like crap when presenting, too…

1

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 6d

More good stuff from Klaviyo with details of their platform including Kafka: Building a Resilient Event Publisher with Dual Failure Capture klaviyo.tech/building-a-r...

Building a Resilient Event Publisher with Dual Failure Capture

Our design for never losing an incoming event

klaviyo.tech

1 3

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 6d

Hey @sarna.dev @cynthiadunlop.bsky.social, I love the idea of writethat.blog - any chance of an RSS feed? 🙏

Write that blog!

writethat.blog

1 4

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 7d

ooh I'll check it out. Thank you!

1

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 7d

If I'm not using Keynote (which I probably will tho), what are my text-based slidewriting options these days? Ideally something asciidoc based, but can live with Markdown. It needs to not look like crap when presenting, too…

3 1

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 8d

that was a good read - thanks!

1 1

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 8d

For years I've used the "+" trick with emails when registering, and finally it paid off. Looks like surge are selling addresses (or got breached), and adobe are buying addresses for unsolicited emails ¯\_(ツ)_/¯

(I know, I know. In other words, bear seen wandering to the woods carrying loo roll)

2 1 10

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 8d

(🤦when you paste the wrong image off your clipboard manager 😬)

1

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 8d

yeah, that's one of the definitions I've got in there. Simon's writing has been really helpful 👍

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 8d

I'll check it out, thanks!

1

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 8d

What *IS* an AI Agent?

To mix my metaphors: I've been pushing this one around on my plate for a while now, but it's time to ship it or get off the pot. As it were.

So…what is an Agent? Have a read of this an LMK if I'm talking complete nonsense or not ;)

🔗 rmoff.net/2025/10/06/s...

A flowchart showing an AI agent workflow. User input flows to a central process that loops between calling an LLM (like GPT-5) and invoking tools (like servers, files, command prompt) until the task is complete. The system is labeled "my-agent.sh".

3 9

Reposted by rmoff 🏃‍♂️🫖🥓

Sebastian Korfmann @skorfmann.com · 9d

At this point, ignoring agentic coding tools is like refusing to use Git because you prefer manually tracking file versions in folders named 'final_v2_ACTUAL_final'

3 1 10

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 9d

this bit tho, 💯 completely agree. especially the first and last points :D

3

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 9d

This is where it gets a bit uncomfortable for folk like me with longer on their résumé _in_ devrel than out of it as a _practitioner_.
I think the "goldilocks" balance is an experienced devrel who is _already_ part of the community that your product targets. But then, I would say that ;)

a man with glasses and the words " it 's true " behind him

ALT: a man with glasses and the words " it 's true " behind him

media.tenor.com

1 2

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 9d

Good article from @pedramnavid.com about building a successful #DevRel team. databased.pedramnavid.com/p/reflection...

Measured and considered, and lots of wisdom. A++++ would read again.

Reflections on 2 Years Running Developer Relations

What is DevRel and do I need one?

databased.pedramnavid.com

1 7

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 9d

pssst… wanna free ticket to #current25 in NOLA later this month? I have a very limited number to give away to the first people to DM me!

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 12d

🌀 Streams, Schemas, and Swamp Gas: Why Every Streaming Nerd Is Flocking to New Orleans This October substack.com/inbox/post/1...

🌀 Streams, Schemas, and Swamp Gas: Why Every Streaming Nerd Is Flocking to New Orleans This October

If you’ve ever debated window joins at 1 AM or argued that “Exactly-Once” is a lifestyle, not a guarantee. you probably already know where you need to be this fall.

substack.com

3

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 10d

Stop Avoiding Workplace Politics terriblesoftware.org/2025/10/01/s...

Stop Avoiding Politics

Most engineers think workplace politics is dirty. They’re wrong. Refusing to play politics doesn’t make you noble; it makes you ineffective.

terriblesoftware.org

1 3

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 11d

Debezium 3.3.0.Final Released debezium.io/blog/2025/10...

3.3.0.Final

1

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 12d

🌀 Streams, Schemas, and Swamp Gas: Why Every Streaming Nerd Is Flocking to New Orleans This October substack.com/inbox/post/1...

🌀 Streams, Schemas, and Swamp Gas: Why Every Streaming Nerd Is Flocking to New Orleans This October

If you’ve ever debated window joins at 1 AM or argued that “Exactly-Once” is a lifestyle, not a guarantee. you probably already know where you need to be this fall.

substack.com

2

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 12d

great work Gunnar! and that is a nice medal too 👍👍

1 2

Reposted by rmoff 🏃‍♂️🫖🥓

Mickael Maison @mickaelmaison.bsky.social · 14d

I've just published the 92nd edition of my Kafka Monthly Digest! It covers the 4.1.0 release, as well as progress on 4.0.1 and 4.2.0. I also covers new KIPs, recent community releases and blog posts.

developers.redhat.com/blog/2025/10...

Kafka Monthly Digest: September 2025 | Red Hat Developer

This edition of the Kafka Monthly Digest covers the new Apache Kafka 4.1.0 release as well as the releases in progress: 4.0.1 and 4.2.0. It also looks at the new KIPs, community project releases and

developers.redhat.com

3 7

rmoff 🏃‍♂️🫖🥓 @rmoff.net · 13d

Inside Husky’s query engine: Real-time access to 100 trillion events | Datadog www.datadoghq.com/blog/enginee...

Inside Husky’s query engine: Real-time access to 100 trillion events | Datadog

See how Husky enables interactive querying across 100 trillion events daily by combining caching, smart indexing, and query pruning.

www.datadoghq.com

6