Working on a GIS related project.
Curious about opinions on tooling around this:
Working with Geopandas vs working with DuckDb’s spatial extension vs just inserting into Postgres and using PostGIS?
#databs #python #pandas #duckdb #gis #dataengineer #dataengineering
27.12.2024 20:56 — 👍 2 🔁 0 💬 2 📌 0
Apache Airflow Template Variables and Dataset scheduled DAGs. · #TODO data engineering
Migrating to #ApacheAirflow Dataset scheduling? Be mindful of existing DAGs use of template variables.
tododataengineering.com/2024/11/26/a...
#dataengineering #data #databs #python
19.12.2024 17:05 — 👍 0 🔁 0 💬 0 📌 0
Airflow woes: Been seeing a lot of {{ ds }}, where I should be seeing {{ data_interval_start }}. 🥲
26.11.2024 13:23 — 👍 1 🔁 0 💬 0 📌 0