Carlo Piovesan

An iPhone 17 Pro in a MAGEASY case, held afloat by DuckLake floating keychains, querying a remote DuckLake in the online Wasm shell. Do not try this at home.

In a new guest blog post, Mark Harrison (Madhive) presents Frozen DuckLakes. These are read-only DuckLakes that only require object storage and are frozen in time. He shows a process for creating and freezing DuckLakes, and demonstrates their use and performance.

📖 ducklake.select/2025/10/24/f...

GitHub - tobilg/duckdb-dns: DNS (Reverse) Lookup Extension for DuckDB DNS (Reverse) Lookup Extension for DuckDB. Contribute to tobilg/duckdb-dns development by creating an account on GitHub.

Created a DNS extension for @duckdb.org today:

github.com/tobilg/duckd...

Hopefully it will be available via the Community Extensions soon!

Should be live, in duckdb v1.4.0:
```
INSTALL dns FROM community;
LOAD dns;
CREATE TABLE websites AS WITH websites(endpoint) AS (VALUES ('google.com'), ('duckdb.org'), ('community-extensions.duckdb.org')) FROM websites;
SELECT dns_lookup(endpoint) FROM websites;
```
duckdb.org/community_ex...

Release Huey version 1.0.10 - Grimao Ermaôs · rpbouman/huey What's Changed Ensure the lists have a min-height that matches their size attribute. by @rpbouman in #580 Fix #584 by @rpbouman in #585 Fix #587 by @rpbouman in #589 Fix #590 by @rpbouman in #591 ...

Huey 1.0.10 is now released:
github.com/rpbouman/hue...
demo:
rpbouman.github.io/huey/src/ind...

- DuckDB version upgrade (1.4.0)
- Support for translation files. Currently supported: English, Dutch and Brazilian Portuguese (thanks @nosklo!)
- bugfixes and UI improvements

Had a blast speaking about query.farm at the #DuckDB Amsterdam Meetup #3 where I had time to spend some time with my heroes @carlo.piovesan.io @samansmink.bsky.social @szarnyasg.org Tania Bogatsch and so many more awesome people! Thank You @duckdb.org for giving space to the community! #opensource

Why DuckDB Why DuckDB There are many database management systems (DBMS) out there. But there is no one-size-fits all database system. All take different trade-offs to better adjust to specific use cases. DuckDB ...

There is also the "Science in DuckDB" section: duckdb.org/why_duckdb.h... and the follow up on "Standing on the Shoulders of Giants"

We just launched the “DuckDB in Science” site, a curated collection of papers, lectures and podcasts about DuckDB in research: duckdb.org/science/

🎡 If you would like to learn more about DuckDB in Science, consider joining our meetup in London this Thursday: www.meetup.com/duckdb/event...

DuckDB Meetup on Science and Education in London DuckDB is an in-process SQL database management system focused on analytical query processing. It is designed to be easy to install and easy to use. DuckDB has no external dependencies. DuckDB has bin...

🎓 On September 4, we are hosting a new kind of meetup in London which will focus on the use of DuckDB in Science and Education!

⚡️ We still have some spots for lightning talks. If you're working with DuckDB in your research and/or classroom, consider sharing your story!

🔗 duckdb.org/events/2025/...

We just published a deep dive on spatial joins in DuckDB by @maxxen.bsky.social.

In this blog post, Max explains how spatial joins evolved in DuckDB and how the current operator harnesses R-Trees.

Read the full post at duckdb.org/2025/08/08/s...

Is anyone aware whether it’s possible to set CORS policies on the R2 (@cloudflare.social) Iceberg REST catalog?

GSU Book Prices GSU Book Prices Tables

Weekend project, using R2 + DuckDB wasm to build a low price frontend for big data analytics crimede-coder.com/graphs/GSUBo...

Quack!!

Beyond excited to share that I'm now working with DuckDB Labs!

My first priority will be the DuckDB Rust client, which will receive a lot more love going forward.

🎉 🦆 ❤️

YouTube video by PyCon US Taming file zoos: Data science with DuckDB database files - Alex Monahan

My #PyConUS talk is up! Tame data science file zoos with @duckdb.org!
Read files of many shapes from any cloud, including your messiest CSVs. Then, organize all of your input tables, output tables, views, and relationships in one DuckDB file. No final_v3.csv!
youtu.be/Yq-hxgysWLQ?...

Yesterday DuckDB Labs announced DuckLake, a new Open data and catalog format. Here is a bit about why it is so awesome, how it solves some key problems with existing technologies, and why we're excited to host it in the cloud at MotherDuck.

Ducklake is a really elegant solution to the data lake. Radically simple and completely open.

Classing "cache invalidation and naming things" are the most complex problems.

I think DuckLake is cute, but naming stuff is hard.

And the biggest winner is... DuckDB support for running queries on [remote] parquet files.
This happens to be a basic building block of DuckLake and a few other alternative lake technologies

Today we're launching DuckLake, an integrated data lake and catalog format powered by SQL. DuckLake unlocks next-generation data warehousing where compute is local, consistency central, and storage scales till infinity. ⁠ducklake is an open standard and we implemented it in the "ducklake" extension.

USING KEY in Recursive CTEs Recursive CTEs in SQL allow for powerful iterative queries like graph traversals but can be memory-intensive and slow due to repeated row accumulation. DuckDB’s new USING KEY feature addresses this by...

Our USING KEY variant of recursive CTEs has landed in DuckDB 1.3 Formerly an off-the-beaten-path researchy idea, now available in a real off-the-shelf DBMS. Hooray! 🎉

duckdb.org/2025/05/23/u...

New post by Pedro Holanda, Ian Cook, Dewey Dunnington and Bryce Mecum:

Arrow IPC Support in DuckDB

This blog post introduces the new arrow community extension, which boosts interoperability by allowing to consume/produce data through the Arrow IPC Serialization Format.

duckdb.org/2025/05/23/a...

DuckDB v1.3.0 “Ossivalis” is out and it packs a ton of new features, fixes and optimizations.

See the announcement blog post: duckdb.org/2025/05/21/a...

A new preprint from database researchers found DuckDB the most environmentally efficient system: arxiv.org/pdf/2504.18980

So thrilled to announce we've released Instant SQL in both the MotherDuck and DuckDB UIs!

It's a new interaction pattern for writing SQL queries that provides realtime result previews and deep query inspection & debugging. Bye bye run button 👋

Truly, literally only possible with DuckDB

📢 The fifth and final episode of the “DuckDB in Research” podcast series is out!

Haralampos Gavriilidis | SheetReader: Efficient spreadsheet parsing

🎧 Apple: podcasts.apple.com/us/podcast/h...

🎧 Spotify: open.spotify.com/episode/2CRR...

The script is very hacky indeed. I think it's cute that the information is extracted from the catalog, but there is need to go outside duckdb somehow since extension can't be unloaded, so process is irreversible.

Python would have been probably better than bash, but this was what I did come out.

Weirdly enough, it contained a bunch of unsanitized commit content, talking about 404 using the forbidden word 'Error', that you should never pipe into standard output.

I assume since it's handy to have visual confirmation of the state of the repository at the moment you are changing it.

Up to here, there is lots of complexity, but it's actually needed to gain flexibiltity / speed.

Only the repo providing HTTP filesystem was special and could not be patched. Why?

Then we augmented the list to be a list of tuples `{repository, hash, [...,file1.patch]}` with an (ordered) array of patches to be applied.

Pretty standard trick for package managers (say Microsoft's VCPKG) to allow some wiggle room.

Now the logic to apply patches happened to perform a `git log`