Tom Cooper
@tomcooper.dev
Senior Principal Engineer at IBM, Ex-Red Hat, Ex-Reddit, Ex-Twitter, Distributed Systems PhD, interested in all things stream processing, also cycling
It's my last day at Red Hat. Tomorrow I & the rest of middleware move to IBM. I wanted to work at RH since I heard about Fedora on the Linux Action Show (RIP) decades ago & I've loved developing in the open with RH. That'll continue after the move & after all, no one got fired for buying IBM...
June 30, 2025 at 4:49 PM
It's my last day at Red Hat. Tomorrow I & the rest of middleware move to IBM. I wanted to work at RH since I heard about Fedora on the Linux Action Show (RIP) decades ago & I've loved developing in the open with RH. That'll continue after the move & after all, no one got fired for buying IBM...
Luckily we have 2 people on the Strimzi team who literally wrote the book on Kafka Connect and Strimiz could do something (TBD) to help.
May 21, 2025 at 4:11 PM
Luckily we have 2 people on the Strimzi team who literally wrote the book on Kafka Connect and Strimiz could do something (TBD) to help.
Ending #Current25 with a talk on Polymorphic Table Functions in Flink🤘
May 21, 2025 at 1:57 PM
Ending #Current25 with a talk on Polymorphic Table Functions in Flink🤘
So nice to get a deep technical deep dive on a subject. They did a great job of explaining the migration process. If you want more detail we have blog posts:
May 21, 2025 at 12:42 PM
So nice to get a deep technical deep dive on a subject. They did a great job of explaining the migration process. If you want more detail we have blog posts:
Woooo 🎉 great to see Strimzi maintainers Kate Stanley and Paolo Patierno on stage at #Current25 talking about how Strimzi helps you migrate your K8s Kafka clusters from Zookeeper to KRaft
May 21, 2025 at 12:04 PM
Woooo 🎉 great to see Strimzi maintainers Kate Stanley and Paolo Patierno on stage at #Current25 talking about how Strimzi helps you migrate your K8s Kafka clusters from Zookeeper to KRaft
After a very interesting lunch time at #Current25 speaking to folks from OpenAI about Mirror Maker and what we could do in Strimzi to make things easier, I'm watching the Flink AMA MC'd by @rmetzger.bsky.social
May 21, 2025 at 11:28 AM
After a very interesting lunch time at #Current25 speaking to folks from OpenAI about Mirror Maker and what we could do in Strimzi to make things easier, I'm watching the Flink AMA MC'd by @rmetzger.bsky.social
My ⚡ talk choice at #Current25 is @hpgrahsl.bsky.social and vector stores in Flink
May 21, 2025 at 10:01 AM
My ⚡ talk choice at #Current25 is @hpgrahsl.bsky.social and vector stores in Flink
Ok so the main thrust is actually about removing Kafka from the mix & what you need to do in Iceberg to emulate topic compaction. A really interesting custom solution due to missing features in the Flink Iceberg connector. The headline, it works, it doesn't need Kafka but it's not as fast #Current25
May 21, 2025 at 9:36 AM
Ok so the main thrust is actually about removing Kafka from the mix & what you need to do in Iceberg to emulate topic compaction. A really interesting custom solution due to missing features in the Flink Iceberg connector. The headline, it works, it doesn't need Kafka but it's not as fast #Current25
Onto something a bit more concrete now at #Current25. Improving CDC performance using Kafka, Flink and Iceberg
May 21, 2025 at 9:06 AM
Onto something a bit more concrete now at #Current25. Improving CDC performance using Kafka, Flink and Iceberg
Kicking off day 2 of #Current25 by boarding the AI agent train🤖🚂 with MongoDB 🌿
May 21, 2025 at 8:04 AM
Kicking off day 2 of #Current25 by boarding the AI agent train🤖🚂 with MongoDB 🌿
Wooop Open Source Datastack FTW! Pinterest moving from an in-house to OSS based architecture! #Current25
May 20, 2025 at 4:49 PM
Wooop Open Source Datastack FTW! Pinterest moving from an in-house to OSS based architecture! #Current25
Final talk of the day at #Current25, Async processing with Flink SQL
May 20, 2025 at 4:31 PM
Final talk of the day at #Current25, Async processing with Flink SQL
Great to hear that OpenAI have identified and fixed several issues with PyFlink and intend to push those fixes upstream 👏👏👏
May 20, 2025 at 3:50 PM
Great to hear that OpenAI have identified and fixed several issues with PyFlink and intend to push those fixes upstream 👏👏👏
It's PyFlink for all the things and OpenAI uses the upstream Flink Kubernetes Operator
May 20, 2025 at 3:41 PM
It's PyFlink for all the things and OpenAI uses the upstream Flink Kubernetes Operator
Learning about how OpenAI built its stream processing system using Kafka and Flink at #Current25
May 20, 2025 at 3:34 PM
Learning about how OpenAI built its stream processing system using Kafka and Flink at #Current25
This talk has some really great examples of Flink's complex event processing (CEP) functionality in Flink SQL
May 20, 2025 at 2:49 PM
This talk has some really great examples of Flink's complex event processing (CEP) functionality in Flink SQL
Great to see a push to enhance upstream Flink SQL with addional AI orientated functions
May 20, 2025 at 2:43 PM
Great to see a push to enhance upstream Flink SQL with addional AI orientated functions
Next up at #Current25 Flink 🐿️ but with robots 🤖 (AI agents)!
May 20, 2025 at 2:33 PM
Next up at #Current25 Flink 🐿️ but with robots 🤖 (AI agents)!
Next at #Current25 a panel discussion on the past, present and future of @kafkastreams.bsky.social. I love the background...the likeness is uncanny...
May 20, 2025 at 1:17 PM
Next at #Current25 a panel discussion on the past, present and future of @kafkastreams.bsky.social. I love the background...the likeness is uncanny...
Starting #Current25 with an overview of anomaly detection in Flink SQL. This is from Confluent and AFAICS uses their proprietary ML functionality. But there is work in the upstream to support the same that builds on FLIP-437 which added the model syntax to Flink SQL
cwiki.apache.org/confluence/d...
cwiki.apache.org/confluence/d...
May 20, 2025 at 12:06 PM
Starting #Current25 with an overview of anomaly detection in Flink SQL. This is from Confluent and AFAICS uses their proprietary ML functionality. But there is work in the upstream to support the same that builds on FLIP-437 which added the model syntax to Flink SQL
cwiki.apache.org/confluence/d...
cwiki.apache.org/confluence/d...
Ready to start another Kafka and Flink filled couple of days in London at #Current25
Looking forward to hearing about stream processing with Flink, integrating with open table formats and this newfangled AI thing...
Looking forward to hearing about stream processing with Flink, integrating with open table formats and this newfangled AI thing...
May 20, 2025 at 8:59 AM
Ready to start another Kafka and Flink filled couple of days in London at #Current25
Looking forward to hearing about stream processing with Flink, integrating with open table formats and this newfangled AI thing...
Looking forward to hearing about stream processing with Flink, integrating with open table formats and this newfangled AI thing...
Got a bit trigger happy in @vinylguru.co.uk. Finally invested in some John Coltrane and filling in the gaps in the Fleetwood Mac collection. Also very happy to have a copy of the Cowboy Bebop soundtrack all the way from Japan "three, two, one, let's jam..."
February 21, 2025 at 3:45 PM
Got a bit trigger happy in @vinylguru.co.uk. Finally invested in some John Coltrane and filling in the gaps in the Fleetwood Mac collection. Also very happy to have a copy of the Cowboy Bebop soundtrack all the way from Japan "three, two, one, let's jam..."
After 15 years I finally left Twitter. I will miss what it was, not what it is.
I made a lot of good connections there. Even got to see behind the curtain doing an internship at head office. But all good things...
I made a lot of good connections there. Even got to see behind the curtain doing an internship at head office. But all good things...
November 7, 2024 at 2:44 PM
After 15 years I finally left Twitter. I will miss what it was, not what it is.
I made a lot of good connections there. Even got to see behind the curtain doing an internship at head office. But all good things...
I made a lot of good connections there. Even got to see behind the curtain doing an internship at head office. But all good things...