Dewey Dunnington
paleolimbot.bsky.social
Dewey Dunnington
@paleolimbot.bsky.social
Scaling spatial computing at Wherobots, Inc. ApacheArrow PMC, #gischat, #rstats, ex Voltron Data.
#30DayMapChallenege day 24: The Mud Lakes of Nova Scotia! Here I use the SedonaDB #Rstats bindings with ggspatial+utils for the cartography. The Nova Scotia boundary here is from Overture Maps "divisions" which works great in SedonaDB/R! dewey.dunnington.ca/post/2025/da...
November 24, 2025 at 3:37 PM
Reposted by Dewey Dunnington
Save the date -- Wednesday July 22, 2026 for the first Apache DataFusion meetup in Denver: luma.com/jsu6faie
Denver Apache DataFusion Meetup · Luma
Join us for an evening of talks, panel discussion, and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will…
luma.com
November 23, 2025 at 11:14 AM
Reposted by Dewey Dunnington
I talked about GeoArrow at FOSS4G Auckland 2025! Here's my slides.

GeoArrow on Web; Can We Live Without GeoJSON?
yutannihilation.github.io/foss4g-2025-...
GeoArrow on Web; Can We Live Without GeoJSON? - Slidev
yutannihilation.github.io
November 21, 2025 at 10:11 AM
It was a joy today to present alongside fellow DataFusion contributors and users at the @apachedatafusion.bsky.social meetup in Boston! Slides from my talk are at dewey.dunnington.ca/slides/df2025 and hopefully the others will be posted soon!
November 13, 2025 at 3:17 AM
Reposted by Dewey Dunnington
Here is a nice examination of the benefits of building new systems using the extensibility of @apachedatafusion.bsky.social vs other systems. www.bauplanlabs.com/post/duck-hu...
Duck Hunt: moving Bauplan from DuckDB to DataFusion
Bauplan's journey from DuckDB to Apache DataFusion: how switching SQL engines doubled query performance on Iceberg lakehouses while enabling greater hackability
www.bauplanlabs.com
November 11, 2025 at 3:41 PM
Reposted by Dewey Dunnington
Apache Arrow 22.0.0 is now available for download: buff.ly/rFyGsDV

This release includes 213 resolved issues. #opensource
November 9, 2025 at 8:01 PM
Reposted by Dewey Dunnington
This @posit.co::conf(2025) talk is everything: "The geospatial suite for Arrow is relatively new...so this is a PSA that it exists and it's really powerful and impressive. I actually also found it very easy to use...and I didn't really have much trouble learning it" www.youtube.com/watch?v=EHyg...
Make Big Geospatial Data Accessible with Arrow (Cari Gostic, Sonoma Technology) | posit::conf(2025)
YouTube video by Posit PBC
www.youtube.com
November 7, 2025 at 10:49 PM
Day 6 of the #30DayMapChallenege is Dimensions! Here I create a beautiful space-time dataset with M values and a proper temporal CRS with SedonaDB...and then ignore it because I couldn't find a tool that can animate M values (let me know if there is one!). dewey.dunnington.ca/post/2025/da...
November 7, 2025 at 3:20 PM
Day 5 of the #30DayMapChallenege! In which I attempt simple LiDAR processing for the first time using SedonaDB. Behold...a high-resolution elevation map of what's under my feet in my hometown of Winnipeg, Manitoba. Code + walk through included! dewey.dunnington.ca/post/2025/da...
November 6, 2025 at 3:02 PM
Excited to be one of the attendees and present our work on the DataFusion-powered SedonaDB alongside a great lineup of talks! If you're in the Boston area come and say hi!
November 4, 2025 at 6:33 PM
#30DayMapChallenge day three is polygons...here's a map I made for my Ph.D. thesis...a standard Fig 1 for lakes papers. This paper is about land use and how it is resolved in sediment, so I tried to communicate urban development in each catchment using very thin roads. This one is 100% QGIS!
November 3, 2025 at 3:22 PM
#30DayMapChallenege day two is lines! Here's an animated version of the stream traversal with SedonaDB post I made a few weeks ago but using the Gaspereau River, which drains Gaspereau Lake (featured in day one). dewey.dunnington.ca/post/2025/da...
November 2, 2025 at 1:43 PM
Day 1 of the #30DayMapChallenege is points! This one is entitled "Always Plot Your Test Data"...I've been using data called ns-water_point for a long time without properly inspecting it. It turns out the points are almost all rocks! They're pretty much all rocks. dewey.dunnington.ca/post/2025/da...
November 1, 2025 at 2:58 PM
Reposted by Dewey Dunnington
GeoArrow is undoubtedly a superior format to GeoJSON, yet GeoJSON remains the dominant standard in web browsers. I'm hoping we'll reach a point where using GeoArrow is just as easy and seamless as using GeoJSON. I hope my talk helps to figure out what's still missing in the ecosystem.
November 1, 2025 at 11:55 AM
Reposted by Dewey Dunnington
#30DayMapChallenge starts tomorrow: 30 days, 30 map ideas.

If you’re using R, Python, or Julia, consider sharing open-source examples or tutorials. 🧭

30daymapchallenge.com

#GeoData #DataViz #Maps #SpatialViz
30DayMapChallenge
Daily mapping challenge happening every November!
30daymapchallenge.com
October 31, 2025 at 3:02 PM
Reposted by Dewey Dunnington
New version of Rust Apache Arrow and Apache Parquet is out -- includes new new metadata parser, new avro reader, geometry and variant support 🤯 arrow.apache.org/blog/2025/10...
Apache Arrow Rust 57.0.0 Release
The Apache Arrow team is pleased to announce that the v57.0.0 release of Apache Arrow Rust is now available on crates.io (arrow and parquet) and as source download. See the 57.0.0 changelog for a full...
arrow.apache.org
October 31, 2025 at 10:26 AM
Reposted by Dewey Dunnington
We're cooking up a lot of great stuff, check out our announcement to learn more. I've been really lucky to get to work on Arrow the last few years and even luckier to get to keep doing that!
The future of data connectivity is columnar. Today we launched
@columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇
Announcing Columnar
Back to the future of data connectivity
columnar.tech
October 30, 2025 at 12:08 AM
Reposted by Dewey Dunnington
We made Apache Parquet metadata parsing 3x-9x faster in the latest release of the Rust implementation
arrow.apache.org/blog/2025/10...
October 24, 2025 at 9:55 AM
This week's Apache Sedona drop: lazy/selective GeoParquet reads in SedonaDB, @duckdb.org, GDAL, and GeoPandas! This is how querying a GeoParquet file plonked on a web server can be queried locally (and why GeoParquet can be even faster locally!) dewey.dunnington.ca/post/2025/la... #gischat
Lazy GeoParquet reading in SedonaDB, DuckDB, GeoPandas, and GDAL | Dewey Dunnington
I’m an obvious fan of GeoParquet and SedonaDB and it should be no surprise that I worked (still working!) pretty hard making sure SedonaDB could take advantage of all GeoParquet had to offer.
dewey.dunnington.ca
October 16, 2025 at 2:59 PM
This in turn was due to @yutannihilation-en.bsky.social's fantastic work on Savvy (lightweight R bindings for Rust)!
Thanks to @paleolimbot.bsky.social's great work, the sedonadb R package is now also available to Windows via R-universe 🎉 I'm excited particularly because I believe sedonadb is the easiest tool for R users to access GeoParquet data. #rstats

apache.r-universe.dev/sedonadb
sedonadb: Bindings for Apache SedonaDB
apache.r-universe.dev
October 11, 2025 at 5:09 PM
Reposted by Dewey Dunnington
Thanks to @paleolimbot.bsky.social's great work, the sedonadb R package is now also available to Windows via R-universe 🎉 I'm excited particularly because I believe sedonadb is the easiest tool for R users to access GeoParquet data. #rstats

apache.r-universe.dev/sedonadb
sedonadb: Bindings for Apache SedonaDB
apache.r-universe.dev
October 11, 2025 at 5:02 PM
Reposted by Dewey Dunnington
Our new thrift parser in the Rust Apache Parquet implementation is a 🎁 that keeps on giving performance wise 🚀 github.com/apache/arrow...

We are also working on a blog post that has a deeper explanation
October 10, 2025 at 6:52 PM
Well deserved!
I'm happy to announce I've been promoted to an Apache Arrow Committer, meaning I'm authorized to merge code patches into Arrow repositories!

I join this list of amazing people: arrow.apache.org/committers/
Committers
List of project-management committee (PMC) members and committers on the Apache Arrow project.
arrow.apache.org
October 9, 2025 at 6:42 PM