Will Manning
willmanning.com
Will Manning
@willmanning.com
Reposted by Will Manning
Vortex is incredibly exciting, we’ve already made plans months ago to make it the primary format we will be storing our data in on object storage! www.linuxfoundation.org/press/lf-ai-...
LF AI & Data Foundation Hosts Vortex Project to Power High Performance Data Access for AI and Analytics
Contributed by SpiralDB, Vortex is an extensible, next-generation columnar storage format designed for building high-performance, future-proof data systems
www.linuxfoundation.org
August 6, 2025 at 5:32 PM
Genuinely cool work by @a10y.dev showing that Vortex provides a huge speed-up as a drop-in replacement for Parquet in Spark+Iceberg workloads.
Last month I worked on Apache Iceberg integration for Vortex, the results of which we presented earlier this month at Iceberg Summit.

I wrote a post about my experience bridging our Rust-based system to Iceberg and Spark

spiraldb.com/post/vortex-...
Vortex on Ice
Using Vortex to accelerate Apache Iceberg queries up to 4x
spiraldb.com
April 30, 2025 at 3:06 PM
Reposted by Will Manning
"So you want to use Object Storage"

By @adamgs.bsky.social

spiraldb.com/post/so-you-...
So you want to use Object Storage
Tips and lessons learned from building systems directly against object stores
spiraldb.com
April 16, 2025 at 1:27 PM