Reposted by KP
Uber - From Batch to Streaming www.uber.com/blog/from-ba...
From Batch to Streaming: Accelerating Data Freshness in Uber’s Data Lake
At Uber, the data lake is a foundational platform powering analytics and machine learning across the company. Historically, ingestion into the lake was powered by batch jobs with freshness measured…
www.uber.com
December 24, 2025 at 4:27 PM
Uber - From Batch to Streaming www.uber.com/blog/from-ba...
Reposted by KP
I am still sort of in disbelief how quickly we moved from "AI is not making me more productive as a programmer" to "of course AI can one-shot advent of code" in less than a year. bsky.app/profile/mits...
Today I violated my own blog's AI policy and had Claude Code write a guest blog post. That finishes my Advent of Code adventure where I had Claude Opus write and optimize all puzzles itself, including writing input generators in the end. Consider it art. lucumr.pocoo.org/2025/12/23/a...
Advent of Slop: A Guest Post by Claude
A guest post by Claude, reflecting on solving Advent of Code 2025 as an autonomous agent.
lucumr.pocoo.org
December 24, 2025 at 12:00 AM
I am still sort of in disbelief how quickly we moved from "AI is not making me more productive as a programmer" to "of course AI can one-shot advent of code" in less than a year. bsky.app/profile/mits...
Going deep into FDAP stack is super fun. I’m finding a rabbit hole to dive into like every hour.
December 21, 2025 at 2:57 AM
Going deep into FDAP stack is super fun. I’m finding a rabbit hole to dive into like every hour.
Reposted by KP
My colleague Sanjay Ghemawat & I have done a fair bit of performance tuning of various pieces of code. We wrote an internal Performance Hints document ~2 years ago as a way of identifying some general principles & we've recently published a version of it externally.
Doc: abseil.io/fast/hints.h...
Doc: abseil.io/fast/hints.h...
December 19, 2025 at 10:25 PM
My colleague Sanjay Ghemawat & I have done a fair bit of performance tuning of various pieces of code. We wrote an internal Performance Hints document ~2 years ago as a way of identifying some general principles & we've recently published a version of it externally.
Doc: abseil.io/fast/hints.h...
Doc: abseil.io/fast/hints.h...
Reposted by KP
Reliability is our top priority. We have declared "Code Orange: Fail Small" to focus our engineering efforts on a single goal: ensuring the causes of past outages are fundamentally eliminated. Here is how we are building a more resilient network for the future. https://cfl.re/4pOLIlC
Code Orange: Fail Small — Our resilience plan following recent incidents
We have declared “Code Orange: Fail Small” to focus everyone at Cloudflare on a set of high-priority workstreams with one simple goal: ensure that the cause of our last two global outages never happen...
cfl.re
December 19, 2025 at 11:44 PM
Reliability is our top priority. We have declared "Code Orange: Fail Small" to focus our engineering efforts on a single goal: ensuring the causes of past outages are fundamentally eliminated. Here is how we are building a more resilient network for the future. https://cfl.re/4pOLIlC
Reposted by KP
Building Modern Databases with the FDAP Stack • Andrew Lamb & Olimpiu Pop • GOTO 2025
www.youtube.com/watch?v=Gd-m...
www.youtube.com/watch?v=Gd-m...
Building Modern Databases with the FDAP Stack • Andrew Lamb & Olimpiu Pop • GOTO 2025
YouTube video by GOTO Conferences
www.youtube.com
November 24, 2025 at 2:21 PM
Building Modern Databases with the FDAP Stack • Andrew Lamb & Olimpiu Pop • GOTO 2025
www.youtube.com/watch?v=Gd-m...
www.youtube.com/watch?v=Gd-m...
Reposted by KP
Qiwei Huang explains how we use Late Materialization (LM) in the Apache Rust Parquet reader to accelerate filtering. LM can describe several techniques, but this is a core one (also applies to joins, Top-K, etc)
arrow.apache.org/blog/2025/12...
arrow.apache.org/blog/2025/12...
December 12, 2025 at 11:40 AM
Qiwei Huang explains how we use Late Materialization (LM) in the Apache Rust Parquet reader to accelerate filtering. LM can describe several techniques, but this is a core one (also applies to joins, Top-K, etc)
arrow.apache.org/blog/2025/12...
arrow.apache.org/blog/2025/12...
Reposted by KP
à propos nothing: cargo-nextest's "wrapper-scripts" feature is amazing if you find yourself having to run tests through valgrind, heaptrack, strace, perf... for uhhh reasons.
nexte.st/docs/configu...
nexte.st/docs/configu...
Wrapper scripts - cargo-nextest
Wrapping test execution with custom commands using filtersets and platform-specific scoping.
nexte.st
December 12, 2025 at 6:40 AM
à propos nothing: cargo-nextest's "wrapper-scripts" feature is amazing if you find yourself having to run tests through valgrind, heaptrack, strace, perf... for uhhh reasons.
nexte.st/docs/configu...
nexte.st/docs/configu...
Reposted by KP
but seriously:
$ systemd-run --user --scope -p MemoryMax=4G cargo nextest run woops
is preetty cool. I thought I'd have to mess with docker or something.
$ systemd-run --user --scope -p MemoryMax=4G cargo nextest run woops
is preetty cool. I thought I'd have to mess with docker or something.
December 12, 2025 at 5:52 AM
but seriously:
$ systemd-run --user --scope -p MemoryMax=4G cargo nextest run woops
is preetty cool. I thought I'd have to mess with docker or something.
$ systemd-run --user --scope -p MemoryMax=4G cargo nextest run woops
is preetty cool. I thought I'd have to mess with docker or something.
Reposted by KP
just for fun, with apptron you can jump into linux in the browser, boot up stock apache, get a public endpoint, and browse to the default page... served from the apache running in the other tab!
December 12, 2025 at 3:30 AM
just for fun, with apptron you can jump into linux in the browser, boot up stock apache, get a public endpoint, and browse to the default page... served from the apache running in the other tab!
Reposted by KP
Sometimes I look at the code suggested by Copilot and think of the developer who originally wrote it.
Who are you? What happened in your life? Where are you now?
Who are you? What happened in your life? Where are you now?
December 3, 2025 at 1:02 PM
Sometimes I look at the code suggested by Copilot and think of the developer who originally wrote it.
Who are you? What happened in your life? Where are you now?
Who are you? What happened in your life? Where are you now?
Reposted by KP
I've just realised that reading more fiction books for fun has really helped with me being able to focus properly on reading other stuff.
I was just reading something that usually I would skim.
Instead I noticed I was taking time to understand it, sometimes, re-reading sentences.
Read fiction.
I was just reading something that usually I would skim.
Instead I noticed I was taking time to understand it, sometimes, re-reading sentences.
Read fiction.
November 28, 2025 at 11:16 AM
I've just realised that reading more fiction books for fun has really helped with me being able to focus properly on reading other stuff.
I was just reading something that usually I would skim.
Instead I noticed I was taking time to understand it, sometimes, re-reading sentences.
Read fiction.
I was just reading something that usually I would skim.
Instead I noticed I was taking time to understand it, sometimes, re-reading sentences.
Read fiction.
Reposted by KP
Durable Executions, defined
Every durable execution framework: write normal code, get fault tolerance. Yet nobody defines what normal code or fault tolerance are
The alternative: a rigorous definition, grounded in first principles, and a minimal implementation
Dropping today
Every durable execution framework: write normal code, get fault tolerance. Yet nobody defines what normal code or fault tolerance are
The alternative: a rigorous definition, grounded in first principles, and a minimal implementation
Dropping today
December 3, 2025 at 10:35 AM
Durable Executions, defined
Every durable execution framework: write normal code, get fault tolerance. Yet nobody defines what normal code or fault tolerance are
The alternative: a rigorous definition, grounded in first principles, and a minimal implementation
Dropping today
Every durable execution framework: write normal code, get fault tolerance. Yet nobody defines what normal code or fault tolerance are
The alternative: a rigorous definition, grounded in first principles, and a minimal implementation
Dropping today
Reposted by KP
log in with your internet handle
Internet Handle
internethandle.org
November 27, 2025 at 6:14 PM
log in with your internet handle
Reposted by KP
TERM
wizardzines.com/comics/term/
(from The Secret Rules of the Terminal, out now! wizardzines.com/zines/terminal)
wizardzines.com/comics/term/
(from The Secret Rules of the Terminal, out now! wizardzines.com/zines/terminal)
October 14, 2025 at 3:08 PM
TERM
wizardzines.com/comics/term/
(from The Secret Rules of the Terminal, out now! wizardzines.com/zines/terminal)
wizardzines.com/comics/term/
(from The Secret Rules of the Terminal, out now! wizardzines.com/zines/terminal)
Reposted by KP
Our SIGMOD paper with our friends at Tsinghua + @wesmckinney.com + @pateljm.bsky.social on creating a next generation open-source data file format is out. F3 is a future-proof file format avoids the mistakes of Parquet.
📄 Paper: db.cs.cmu.edu/papers/2025/...
📁 Code: github.com/future-file-...
📄 Paper: db.cs.cmu.edu/papers/2025/...
📁 Code: github.com/future-file-...
October 1, 2025 at 1:49 PM
Our SIGMOD paper with our friends at Tsinghua + @wesmckinney.com + @pateljm.bsky.social on creating a next generation open-source data file format is out. F3 is a future-proof file format avoids the mistakes of Parquet.
📄 Paper: db.cs.cmu.edu/papers/2025/...
📁 Code: github.com/future-file-...
📄 Paper: db.cs.cmu.edu/papers/2025/...
📁 Code: github.com/future-file-...
Reposted by KP
Did you know your MacBook has a sensor that knows the exact angle of the screen hinge?
It’s not exposed as a public API, but I figured out a way to read it and make it sound like an old wooden door.
It’s not exposed as a public API, but I figured out a way to read it and make it sound like an old wooden door.
September 6, 2025 at 8:44 PM
Did you know your MacBook has a sensor that knows the exact angle of the screen hinge?
It’s not exposed as a public API, but I figured out a way to read it and make it sound like an old wooden door.
It’s not exposed as a public API, but I figured out a way to read it and make it sound like an old wooden door.
Reposted by KP
Today is the new semester for @db.cs.cmu.edu's Intro to Database Systems! We're going harder into material than before. More challenging projects but you can use LLMs to help. We also have 10min talks each Wed from leading DB companies: 15445.courses.cs.cmu.edu/fall2025
CMU 15-445/645 :: Intro to Database Systems (Fall 2025)
You want to know whether this is the premier course at Carnegie Mellon University on the design and implementation of database management systems? Well, it is. This course rips through data models (re...
15445.courses.cs.cmu.edu
August 25, 2025 at 2:29 PM
Today is the new semester for @db.cs.cmu.edu's Intro to Database Systems! We're going harder into material than before. More challenging projects but you can use LLMs to help. We also have 10min talks each Wed from leading DB companies: 15445.courses.cs.cmu.edu/fall2025
Reposted by KP
The positive thing about AI tooling going mainstream and setting expectations high (e.g. "anyone can build software with AI") is that a large group will learn what us devs know already:
Creating good software is hard and it's hard to explain to outsiders in a way they understand
Creating good software is hard and it's hard to explain to outsiders in a way they understand
August 20, 2025 at 5:51 PM
The positive thing about AI tooling going mainstream and setting expectations high (e.g. "anyone can build software with AI") is that a large group will learn what us devs know already:
Creating good software is hard and it's hard to explain to outsiders in a way they understand
Creating good software is hard and it's hard to explain to outsiders in a way they understand
Reposted by KP
Engineering is the intersection of Curiosity and Capability
When your curiosity outstrips your capability, you expand your capability and grow
When your capability expands, it allows you to see farther and grows your curiosity
Don't allow your tools take away both your Curiosity and Capability
When your curiosity outstrips your capability, you expand your capability and grow
When your capability expands, it allows you to see farther and grows your curiosity
Don't allow your tools take away both your Curiosity and Capability
August 3, 2025 at 3:43 AM
Engineering is the intersection of Curiosity and Capability
When your curiosity outstrips your capability, you expand your capability and grow
When your capability expands, it allows you to see farther and grows your curiosity
Don't allow your tools take away both your Curiosity and Capability
When your curiosity outstrips your capability, you expand your capability and grow
When your capability expands, it allows you to see farther and grows your curiosity
Don't allow your tools take away both your Curiosity and Capability
Reposted by KP
July 17, 2025 at 10:21 AM
www.youtube.com/watch?v=IdpD.... Loved the tooling.
Jonathan Blow - Jai Demo and Design Explanation (KEYNOTE) - Updated
YouTube video by LambdaConf
www.youtube.com
July 13, 2025 at 7:34 AM
www.youtube.com/watch?v=IdpD.... Loved the tooling.
Reposted by KP
Quitting programming as a career right now because of LLMs would be like quitting carpentry as a career thanks to the invention of the table saw.
July 3, 2025 at 2:36 PM
Quitting programming as a career right now because of LLMs would be like quitting carpentry as a career thanks to the invention of the table saw.
Reposted by KP
I have a friend looking for people using Clickhouse in production. They have some questions about usage/use cases. Mind shooting me a DM?
(please 🔃 for reach)
(please 🔃 for reach)
July 2, 2025 at 4:35 PM
I have a friend looking for people using Clickhouse in production. They have some questions about usage/use cases. Mind shooting me a DM?
(please 🔃 for reach)
(please 🔃 for reach)
LLM is the new OS. English is the new programming language
Andrej Karpathy: Software Is Changing (Again)
YouTube video by Y Combinator
www.youtube.com
June 19, 2025 at 5:31 AM
LLM is the new OS. English is the new programming language