Data Lab Tech

PostgreSQL Maximalism - YouTube Unlock the full power of PostgreSQL with cutting-edge extensions built for the modern data stack. This series covers everything from document stores, to high...

Also, if you're interested on learning more about PostgreSQL extensions, check out my playlist on PostgreSQL Maximalism, which covers data engineering and analytics, among other use cases! www.youtube.com/playlist?lis...

Looks like there's a new extension to handle #Iceberg on #PostgreSQL, and this one is by #Snowflake Labs! github.com/Snowflake-La...

LabStore - Part 1 - Building an Object Store in Go: How Hard Can It Be? Let's learn all about the inner workings of S3 object stores, along with enough Go to start building your own solution.

LabStore - Part 1 - Building an Object Store in Go: How Hard Can It Be? - Let's learn all about the inner workings of S3 object stores, along with enough Go to start building your own solution.

I'm now trying to write a blog post and a script for a video on all of this, so I can share this journey with you. Let's see if I can release it on schedule, next Tuesday! If not, hopefully you can understand why. 😅

The last two weeks have been hectic! Learned a lot of Go, delved into the docs for the AWS S3 API, implemented a few basic actions, along with SigV4 (with multi-chunk upload support), and setup a GitHub Org to collab with a friend on this project. 🚀

Cool interview of Guido, with a few good AI-related questions. #python #AI www.odbms.org/blog/2025/10...

GitHub - IllumiKnowLabs/labstore: Object store with S3-compatible API built to support systems prototyping Object store with S3-compatible API built to support systems prototyping - IllumiKnowLabs/labstore

You can follow the development on this link, if you're interested. I created a GitHub Org, that is separate from my main account, because I invited a buddy of mine, who is a web dev guru, to work on the frontend. github.com/IllumiKnowLa...

Learning Go to build an object store has been a really cool experience so far. At first, I thought that Go's syntax was a little weird, but now it just feels normal, and it flows quite well. Already have some basic requests working, but nothing too fancy to share yet!

Migrating DuckLake Catalog From SQLite to PostgreSQL Learn how to migrate your existing DuckLake catalog from SQLite to PostgreSQL, without losing any data, and see it in action in a production environment.

Migrating DuckLake Catalog From SQLite to PostgreSQL - Learn how to migrate your existing DuckLake catalog from SQLite to PostgreSQL, without losing any data, and see it in action in a production environment.

Anyway, the day for Rust will come, but I need a reason. Maybe a tiny search engine, to use what I learned during my PhD? Who knows, still a recovering academic (this one I stole from the DuckDB team—too good not to).

I was on the fence on whether to go with Go or to go with Rust, but then I thought... Since I need to go, let's go with Go. I still have time to Rust (ironical name, since that language produces everything but rust). I must praise uv, just, and even zed! If it's built in Rust, it's built for speed!

I spend so many years doing Python, with a side of R, a dose of Java and Scala backends, and a slice of web UIs and visualizations in JS. I used to spend my days learning new languages, but then I started spending more time writing code than learning to code. So I missed it dearly!

I also started going deeper into Go and I'm having a blast learning a new language after so many years focused on other languages. I admit I'm slightly obsessed with Go now!

This week I had fun making another video about DuckLake. It's scheduled to come out next Tuesday, so stay tuned! Love the duck! 💛🦆

An iPhone 17 Pro in a MAGEASY case, held afloat by DuckLake floating keychains, querying a remote DuckLake in the online Wasm shell. Do not try this at home.

In a new guest blog post, Mark Harrison (Madhive) presents Frozen DuckLakes. These are read-only DuckLakes that only require object storage and are frozen in time. He shows a process for creating and freezing DuckLakes, and demonstrates their use and performance.

📖 ducklake.select/2025/10/24/f...

Data Lab Infra - Part 5: Retrospective & MLOps - Model Deployment Learn how to use multi-project CI/CD with the GitLab Free tier, how to deploy an ML model with Docker, doing a retrospective and redesigning the architecture.

Data Lab Infra - Part 5: Retrospective & MLOps - Model Deployment - Learn how to use multi-project CI/CD with the GitLab Free tier, how to deploy an ML model with Docker, doing a retrospective and redesigning the architecture.

I was wrong, documentation is still available here: kuzudb.github.io/docs/

Just noticed that KùzuDB got archived on GitHub. Its website now points to GitHub Pages, and documentation is gone! Also, their Discord server was shutdown. What could this mean? Layoffs? Closing source code due to monetization efforts? kuzudb.github.io

Not a sponsor, but I wouldn't mind! *wink* *wink* /cc @zed.dev

Windows When? Windows Now - Zed Blog From the Zed Blog: Zed for Windows is finally here. Download it today.

Zed integrates with WSL like VSCode, it's written in Rust, and integrates with AI but it's not in-your-face! If you don't like Windows, the Linux and Mac version already existed before this one. #Zed #IDE #Rust zed.dev/blog/zed-for...

Data Lab Infra - Part 4: Core Services Learn how to automate data stack deployment using docker compose and GitLab, setting up CI/CD variables with Terraform, and using GPU passthrough to a Docker VM running on Proxmox.

Data Lab Infra - Part 4: Core Services - Learn how to automate data stack deployment using docker compose and GitLab, setting up CI/CD variables with Terraform, and using GPU passthrough to a Docker VM running on Proxmox.

And to change batteries on time, especially when they’re getting direct warnings from the manufacturer.

YouTube video by Seytonic Government Data Center Destroyed... NO BACKUP

South Korea just lost their government data. Expired batteries started a fire, and they didn't have an offsite backup... 3-2-1 rule guys! #DevOps youtu.be/pGjXwvD9tB4

If you're still using a Makefile or custom language-based solutions like npm or uv scripts, then you must take a look at just! This is a tool I recently adopted and will, most likely, keep using in my future projects. just.systems

YouTube video by IBM The "Mainframe Kid"

I was just learning about the IBM Z mainframe and bumped into this. Pretty awesome! www.youtube.com/watch?v=wJyi...

I am now running GitLab on a VM with 4 cores and 8 GiB RAM, and it seems to be stable, finally. But I'm not too happy about it. It's feeling bloated, a bit of a resource hog. Hopefully its features will make up for the amount of resources I had to let go.

At this point, I'm starting to question the decision to go with GitLab in such a resource constrained scenario. It's unclear what the problem is though, as I think 2 cores and 6 GiB RAM should be enough for a single user. Considering Gitea as an alternative, if this keeps happening.

My self-hosted GitLab instance suddenly went crazy. CPU was hitting 100% nonstop, and it kept freezing after navigating to certain pages on the UI (clearly when trying to load data). I kept having to reset the VM to regain access via SSH.

Data Lab Infra - Part 3: Platform Setup with Terraform Learn how to provision Proxmox VMs with Terraform, deploying GitLab and Docker using cloud-init. Configure GitLab as a container registry, and deploy a shared runner for CI/CD using variables for secret management.

Data Lab Infra - Part 3: Platform Setup with Terraform - Learn how to provision Proxmox VMs with Terraform, deploying GitLab and Docker using cloud-init. Configure GitLab as a container registry, and deploy a shared runner for CI/CD using variables for secret management.

Did you ever notice, when using Docker Desktop in Windows that sometimes it will hang for a while on stop or restart? This is usually because it's reclaiming disk space by compacting its virtual hard disk (vhdx). Check your disk activity, if you think it's hanging. #docker #windows #vhdx