New Dagster best practices video on how to bring assets managed by other processes into Dagster.
youtu.be/R92umN1voH8
@alexnoonan.bsky.social
Developer Advocate @dagster.io Substack: https://www.substack.com/@noonanlabs
New Dagster best practices video on how to bring assets managed by other processes into Dagster.
youtu.be/R92umN1voH8
Otto's data teams were stuck. Some drowning in endless Argo YAML configurations, others testing directly in production.
When your data platform fights against good practices, your teams waste time on operational overhead instead of building value.
dagster.io/blog/otto-ca...
I have finally published my post about Moneyball, as promised (a long time ago). If you're interested in baseball, numbers, or movies, please take a look. I'd love to know what you think.
cc @matsonj.com @alexnoonan.bsky.social
djpardis.medium.com/revisiting-m...
Come for Dark @alexnoonan.bsky.social , stay for the amazing speed that you can get up and running with an end to end data platform using Dagsterβs new dg + Components features
#dataBS
youtu.be/NaaF7sw1W_8?...
Turns out the Chinese have a lot too teach us with respect to slop technology
substack.com/@noonanlabs/...
The abundance guys are 100% right on the problems we face with our urban governance. substack.com/@noonanlabs/...
03.04.2025 10:54 β π 3 π 0 π¬ 0 π 0π Want to preview the brand new `dg` cli, and a framework for building and working with YAML DSLs built on top of Dagster called "Components"?
You can find a link to demo videos and a GitHub discussion in the thread!
Join us on April 1st for a deep dive into how Lee Littlejohn built a data platform at US Foods with Dagster!
Lee applies kitchen principles to data: minimizing action, reusing components, and creating a single source of truth.
lp.dagster.io/deep-dive-us...
We're pleased to announce that Dagster has officially earned Snowflake Technology Industry Competency status. This milestone validates our position as a critical component in modern data ecosystems!
26.03.2025 16:44 β π 3 π 1 π¬ 0 π 0Hear from our Community!
Emil Sundman is a Data Engineer at Bizware and an experienced data professional across the entire data stack.
Thanks Emil!
We understand that your data platform is highly contextual, and you need a tool to accommodate this. Components provide a low-code YAML interface for your users, backed by tools that support software engineering best practices and give platform teams complete control.
lp.dagster.io/components
It's never been easier to get the benefits of Dagster with your old Airflow DAGs with Airlift. Check out my new video about Airlift!
youtu.be/IaurHOKTycQ?...
They drank my yoo-hoo I was saving too!
19.02.2025 18:15 β π 1 π 0 π¬ 1 π 0A postgres user just came into my house and ate my leftover Chinese food without asking. I was saving that too
19.02.2025 14:23 β π 1 π 0 π¬ 1 π 0It's some Russian fella I believe
12.02.2025 00:29 β π 1 π 0 π¬ 1 π 0This is the founder of MongoDB
11.02.2025 23:54 β π 3 π 0 π¬ 1 π 1I can't believe USAID gave 50 million dollars to my followers to not reply ("banger", "rizz god") under my posts.
06.02.2025 14:36 β π 4 π 0 π¬ 0 π 0AIs have a tough time using JSON structure because that data structure isnt ensouled
06.02.2025 01:30 β π 1 π 0 π¬ 0 π 0The teacher always said I was good with shapes and colors. That's how I ended up in data
04.02.2025 12:39 β π 1 π 0 π¬ 0 π 0What ever happened to data?
04.02.2025 01:48 β π 2 π 0 π¬ 0 π 0In times like these I like to take solace in Data Engineering
03.02.2025 12:15 β π 8 π 0 π¬ 0 π 0I just found what I was looking for on StackOverflow
01.02.2025 13:15 β π 3 π 0 π¬ 0 π 0Concerning
25.01.2025 19:35 β π 1 π 0 π¬ 0 π 0Your data pipelines will not be ensouled unless you add metadata
25.01.2025 15:35 β π 1 π 0 π¬ 0 π 0I need to learn the history
24.01.2025 20:39 β π 1 π 0 π¬ 0 π 0Companies should do WWE style promos to hype people for product launches
24.01.2025 20:09 β π 0 π 0 π¬ 2 π 0The new Dagster docs experience is here, complete with dark mode!
This makes it easier than ever to get started with Dagster. Our focus was on creating a more user-friendly docs structure to ensure that all of the information you need is available within just a few clicks https://buff.ly/4awa90j
I was there when John Dagster wrote the first DAG
23.01.2025 17:27 β π 10 π 0 π¬ 1 π 0Waiting for the build to finish
23.01.2025 00:07 β π 1 π 0 π¬ 1 π 0Yeah, my 10 month old has slowed progress haha! evidence is really cool from a composability perspective. The next one will be around using dbt and Dagster
22.01.2025 18:22 β π 2 π 0 π¬ 1 π 0