New chapter out about Data Engineering Workspace Packaging.
15.10.2025 05:34 — 👍 2 🔁 1 💬 0 📌 0
Random shoutout - I just started to read Data Engineering Design Patterns by @ssp.sh and it is full of tremendous inspiration, not only from a technical perspective, but also on how to effectively communicate data challenges. Getting pumped abt returning to work after paternity leave
dedp.online
11.10.2025 12:03 — 👍 5 🔁 3 💬 1 📌 0
What should be next?
15.10.2025 05:32 — 👍 1 🔁 0 💬 0 📌 0
Latest pattern published.
21.08.2025 19:46 — 👍 0 🔁 0 💬 0 📌 0
Data-Asset Reusability Pattern
Accelerate data engineering development through code and data reuse patterns, from templating to materialization and abstraction.
I am happy to share that I released my second pattern: «Data-Asset Reusability Pattern», focusing on #EfficientDataReuse.
This chapter explores reusability in data engineering with dedicated sub-patterns. But first, what is data-asset reusability?
05.03.2025 14:27 — 👍 11 🔁 3 💬 1 📌 0
The evolution of data engineering.
The history and state of data engineering have changed drastically over the years. Let's explore what and how it changed.
Much has been written about data engineering, but how long has it existed, and where does it come from?
🌐 dedp.online/part-1/1-int... (direct link)
17.01.2025 14:29 — 👍 5 🔁 1 💬 1 📌 0
The book on the front page on Hacker News.
21.08.2025 19:39 — 👍 0 🔁 0 💬 0 📌 0
The Evolution of Schema Change and database change management.
📖 New chapter: Evolution of Schema Change and database change management.
> #SchemaEvolution: Managing database changes while preserving integrity
> #NoSQL: Flexible schemas; speed over consistency
> #DataContracts: Producer-consumer agreements with automated validation
dedp.online/part-2/4-ce/...
15.11.2024 13:50 — 👍 7 🔁 1 💬 2 📌 1
Challenges in Data Engineering
This chapter explores the multifaceted challenges within data engineering, providing insights into the data lifecycle, from collection to actionable insights. It delves into the complexities of data s...
After years in #dataengineering, I've noticed we focus too much on tools & tech, missing the fundamental challenges. It's not about picking the right stack—it's about mastering the complete data lifecycle.
The reality: We can't control source systems and their upstream data yet.
07.01.2025 17:15 — 👍 19 🔁 2 💬 1 📌 0
If you enjoy the content, be sure to also check the connected «Data Engineering Vault», which is referenced in the book.
21.08.2025 19:36 — 👍 0 🔁 0 💬 0 📌 0
A recent review I've got 🥰.
> what a great content! "awesome, fresh view. I shown it to my fiancee & said "that's what wisdom is, like I would meet an 60 year old druid living in a forest and doing DE pipelines work".
> I'm patiently waiting to read more, It's a great piece &work that inspires me.
21.08.2025 19:34 — 👍 0 🔁 0 💬 0 📌 0
Book: Data Engineering Design Patterns (DEDP): Timeless Practices for Data Engineers
A living Book about Data Engineering Design Patterns, exploring the evolution and its significance. Different from usual books. It does not come finished.
Data Engineering Design Patterns.
This book aims to provide a practical guide based on convergent evolution, resulting in design patterns applicable for navigating the data engineering lifecycle—timeless practices for data engineers.
21.08.2025 19:32 — 👍 3 🔁 1 💬 1 📌 2
