Dewey Dunnington's Avatar

Dewey Dunnington

@paleolimbot.bsky.social

Scaling spatial computing at Wherobots, Inc. ApacheArrow PMC, #gischat, #rstats, ex Voltron Data.

215 Followers  |  81 Following  |  59 Posts  |  Joined: 29.10.2024
Posts Following

Posts by Dewey Dunnington (@paleolimbot.bsky.social)

Post image

Does SedonaDB's KNN join help at all? I haven't wired up nice dplyrish syntax for everything yet but the SQL isn't too bad.

24.02.2026 04:26 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

πŸ“– Apache Parquet recently added native support for Geospatial. This post explains what that means and why it is important: parquet.apache.org/blog/2026/02...

13.02.2026 13:56 β€” πŸ‘ 13    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Native Geospatial Types in Apache Parquet Native Geospatial Types in Apache Parquet

Great inaugural post about the geospatial types on the Parquet blog.

Thank you Jia Yu, Dewey Dunnington , Kristin Cowalcijk, Feng Zhang.

More posts coming !

parquet.apache.org/blog/2026/02...

14.02.2026 00:36 β€” πŸ‘ 8    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Post image

Released this week: Version 22 of the ADBC libraries and drivers.

This release includes updates to the ADBC libraries for 8 languages, and improvements to the 4 ADBC drivers that are maintained in the apache/arrow-adbc repository. See the blog for more details: arrow.apache.org/blog/2026/01...

11.01.2026 00:18 β€” πŸ‘ 13    πŸ” 3    πŸ’¬ 0    πŸ“Œ 0
Preview
GitHub - brownag/gdalcli: An R Frontend for the GDAL CLI An R Frontend for the GDAL CLI. Contribute to brownag/gdalcli development by creating an account on GitHub.

Introducing gdalcli by Andrew Brown -- an R frontend to GDAL’s unified CLI (β‰₯3.11) 🌐

Compose and execute GDAL workflows with pipe-friendly functions.

Learn more: github.com/brownag/gdal...

#RStats #GDAL #Geospatial #OpenSource #RSpatial

04.01.2026 15:01 β€” πŸ‘ 37    πŸ” 13    πŸ’¬ 1    πŸ“Œ 0
Preview
Testing the R-universe build workflow from your own GitHub repository We refactored the R-universe CI workflows to make it possible to run the exact same workflow from your own GitHub repository.

ropensci.org/blog/2026/01...

03.01.2026 18:37 β€” πŸ‘ 6    πŸ” 3    πŸ’¬ 0    πŸ“Œ 0
Post image

Apache SedonaDB 0.2.0 is now available. Download here: buff.ly/k9LRlyC

SedonaDB is the first open source, single-node analytical database engine that treats spatial data as a first-class citizen. It is developed as a subproject of Apache Sedona. #opensource

23.12.2025 23:30 β€” πŸ‘ 6    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0

I taught a 70 person section of intro to computer science and the automated checks were a total godsend. (I also ran out of GitHub Actions minutes almost immediately...)

19.12.2025 21:00 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
SedonaDB 0.2.0 Release - Apache Sedona Apache Sedona is a cluster computing system for processing large-scale spatial data. Sedona extends existing cluster computing systems, such as Apache Spark, Apache Flink, and Snowflake, with a set of...

For the full scoop, check out our release post! sedona.apache.org/latest/blog/...

09.12.2025 20:03 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Finally...we're now on crates.io! We're still learning how to support Rust projects that are interested in spatial support...leave a note on our repo if you're interested!

09.12.2025 20:03 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

We were fortunate to have over 40 functions contributed since our last release, but if we didn't get to your favourite you can now patch it in via pyarrow and/or shapely!

09.12.2025 20:03 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

On the write side, SedonaDB can now write GeoParquet 1.1 files with spatial sorting and limited row group size to optimize partial reads when hosting or viewing large files.

09.12.2025 20:03 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

Just like our GeoParquet suport, if your query contains one or more WHERE ST_Intersects() (or similar), this is automatically pushed into the data source to read as little as possible!

09.12.2025 20:03 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

We're proud to officially be GDAL in a trenchcoat! You can now query GeoPackage, FlatGeoBuf, Shapefile, or anything else supported by GDAL/OGR, including URLs, zipped files, directories, and globs.

09.12.2025 20:03 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

Excited to announce SedonaDB 0.2.0! Highlights include reading spatial file formats via GDAL/OGR, improved GeoParquet IO, Python @arrow.apache.org UDFs, and 40+ additional functions.

09.12.2025 20:03 β€” πŸ‘ 6    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0
Apache DataFusion Boston Meetup: September 12, 2025
YouTube video by Andrew Lamb Apache DataFusion Boston Meetup: September 12, 2025

Here are the slides and recordings from our Boston DataFusion Meetup in September:

Youtube: youtu.be/wCAud478Dg8
Slides (pdf): drive.google.com/file/d/18KGH...

04.12.2025 11:51 β€” πŸ‘ 10    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Preview
FOSS4G Auckland 2025 Kia ora! Last week, we were in Auckland, New Zealand, for FOSS4G 2025. We had a great time and gave...

At FOSS4G Auckland 2025, we, MIERUNE Inc., had four talks about various topics from GTFS to GeoArrow. This is a quick summary of the presentation titles and the links to the slidesπŸ”—

dev.to/mierune/foss...

30.11.2025 02:41 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Preview
Implement QgsArrowIterator to iterate over features as batches of ArrowArray by paleolimbot Β· Pull Request #63749 Β· qgis/QGIS Description As encouraged by @nyalldawson! https://mastodon.social/@nyalld/115459416976982489 The motivation is to eliminate the need for per-feature iteration in Python to maintain the fidelity of...

Wohoo, QGIS Arrow support has been merged: https://github.com/qgis/QGIS/pull/63749

Thanks @paleolimbot & @nyalld et al.

Looking forward to testing it out soon 🀩

#QGIS #Arrow #GISChat

28.11.2025 08:44 β€” πŸ‘ 11    πŸ” 9    πŸ’¬ 0    πŸ“Œ 0
Preview
QOD November 2025 QGIS is a free, open source, cross platform (lin/win/mac) geographical information system (GIS) - qgis/QGIS

Starring in a few minutes: It’s QGIS Open Day today! πŸŽ‰ Don’t miss our two awesome talks. Grab all links and info on the wiki: https://github.com/qgis/QGIS/wiki/QOD-November-2025

#QGIS #GISChat

28.11.2025 13:38 β€” πŸ‘ 6    πŸ” 3    πŸ’¬ 0    πŸ“Œ 0

I love this country

26.11.2025 14:59 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
The Mud Lakes of Nova Scotia

The Mud Lakes of Nova Scotia

#30DayMapChallenege day 24: The Mud Lakes of Nova Scotia! Here I use the SedonaDB #Rstats bindings with ggspatial+utils for the cartography. The Nova Scotia boundary here is from Overture Maps "divisions" which works great in SedonaDB/R! dewey.dunnington.ca/post/2025/da...

24.11.2025 15:37 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Denver Apache DataFusion Meetup Β· Luma Join us for an evening of talks, panel discussion, and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will…

Save the date -- Wednesday July 22, 2026 for the first Apache DataFusion meetup in Denver: luma.com/jsu6faie

23.11.2025 11:14 β€” πŸ‘ 3    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Preview
GeoArrow on Web; Can We Live Without GeoJSON? - Slidev

I talked about GeoArrow at FOSS4G Auckland 2025! Here's my slides.

GeoArrow on Web; Can We Live Without GeoJSON?
yutannihilation.github.io/foss4g-2025-...

21.11.2025 10:11 β€” πŸ‘ 10    πŸ” 5    πŸ’¬ 0    πŸ“Œ 0
Post image

It was a joy today to present alongside fellow DataFusion contributors and users at the @apachedatafusion.bsky.social meetup in Boston! Slides from my talk are at dewey.dunnington.ca/slides/df2025 and hopefully the others will be posted soon!

13.11.2025 03:17 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Duck Hunt: moving Bauplan from DuckDB to DataFusion Bauplan's journey from DuckDB to Apache DataFusion: how switching SQL engines doubled query performance on Iceberg lakehouses while enabling greater hackability

Here is a nice examination of the benefits of building new systems using the extensibility of @apachedatafusion.bsky.social vs other systems. www.bauplanlabs.com/post/duck-hu...

11.11.2025 15:41 β€” πŸ‘ 8    πŸ” 2    πŸ’¬ 0    πŸ“Œ 0
Post image

Apache Arrow 22.0.0 is now available for download: buff.ly/rFyGsDV

This release includes 213 resolved issues. #opensource

09.11.2025 20:01 β€” πŸ‘ 12    πŸ” 4    πŸ’¬ 0    πŸ“Œ 0
Make Big Geospatial Data Accessible with Arrow (Cari Gostic, Sonoma Technology) | posit::conf(2025)
YouTube video by Posit PBC Make Big Geospatial Data Accessible with Arrow (Cari Gostic, Sonoma Technology) | posit::conf(2025)

This @posit.co::conf(2025) talk is everything: "The geospatial suite for Arrow is relatively new...so this is a PSA that it exists and it's really powerful and impressive. I actually also found it very easy to use...and I didn't really have much trouble learning it" www.youtube.com/watch?v=EHyg...

07.11.2025 22:49 β€” πŸ‘ 14    πŸ” 3    πŸ’¬ 1    πŸ“Œ 0

RE: https://fosstodon.org/@underdarkGIS/113300727609804149

Over 250 #geospatial #GISChat counts to follow: https://gist.github.com/anitagraser/a37118d74b839602e0f474375f548dfd

07.11.2025 22:08 β€” πŸ‘ 5    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0
Video thumbnail

Day 6 of the #30DayMapChallenege is Dimensions! Here I create a beautiful space-time dataset with M values and a proper temporal CRS with SedonaDB...and then ignore it because I couldn't find a tool that can animate M values (let me know if there is one!). dewey.dunnington.ca/post/2025/da...

07.11.2025 15:20 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0