That's awesome π
09.06.2025 01:05 β π 1 π 0 π¬ 0 π 0@andynelson817.bsky.social
Data Engineer living in Texas
That's awesome π
09.06.2025 01:05 β π 1 π 0 π¬ 0 π 0Why can't you test against the current schedule vs a delayed schedule?
20.02.2025 02:36 β π 0 π 0 π¬ 1 π 0Who's your favorite philosopher?π
20.02.2025 02:33 β π 1 π 0 π¬ 1 π 0Sorry to be 10 year late on the discussion
23.12.2024 19:51 β π 1 π 0 π¬ 0 π 0I'm reading there's controversy on putting satellites on links in data vault. Curious if #databs has any opinions on the matter.
23.12.2024 19:51 β π 1 π 0 π¬ 3 π 0Thanks Shane
17.12.2024 02:53 β π 1 π 0 π¬ 0 π 0Looking for data vault 2.0 training recommendations. Gotta be pre-recorded or remote. #databs
16.12.2024 15:44 β π 0 π 0 π¬ 1 π 0Never give up, never surrender πͺ
13.12.2024 16:31 β π 1 π 0 π¬ 0 π 0Bet that baby could possibly handle my 25 left joins I write.
13.12.2024 13:40 β π 1 π 0 π¬ 0 π 0Paradime has AI tools for dbt. I haven't used them, sorry.
12.12.2024 03:38 β π 0 π 0 π¬ 0 π 0Although one of the best, probably also the most boring exercise machine ever produced by Man
11.12.2024 16:47 β π 0 π 0 π¬ 0 π 0I think I'm your target demographic Timo. Our team is trying to put sunset clauses on new adhoc pipelines and dashboards so at least we don't support things indefinitely.
11.12.2024 13:55 β π 2 π 0 π¬ 1 π 0Honestly I think accumulating snapshots are underutilized. #databs
11.12.2024 13:44 β π 1 π 0 π¬ 0 π 0Thanks for the reply Shane. But that's where I disagree with the author. I feel like I the data warehouse we can apply transformations for analytical purposes only. If there are 200 transaction codes and we put them in 5 buckets that aren't represented in the application layer, what's wrong with it?
11.12.2024 03:42 β π 0 π 0 π¬ 0 π 0Not sure I understand this article. I wish the author gave examples of antipaterns of Data Engineers building business Logic in the data warehouse. I assumed unless if your doing reverse ETL the application layer needs to maintain their own business Logic. towardsdatascience.com/data-enginee...
09.12.2024 19:38 β π 1 π 0 π¬ 1 π 0Yeah I enjoyed his book. He uses some patterns from data vault without the complexity of full blown data vault.
07.12.2024 14:53 β π 1 π 0 π¬ 0 π 0I've been influenced by Roberto Zagni's pragmatic data platform approach. I like the patterns he uses. youtu.be/OYrbg5q-CHo?...
06.12.2024 23:32 β π 3 π 0 π¬ 1 π 0sadly I have to agree with you Matt. Not sure why Inmon is framing Kimball's approach as just data marts.
06.12.2024 23:20 β π 1 π 0 π¬ 0 π 0Chapter 2 of Adamson's Star Schema covers this well. Both authors are pragmatic and allowed flexibility in their approaches. Lots of misconceptions in this space.
06.12.2024 14:57 β π 2 π 0 π¬ 0 π 0Nobody doing data contracts lol
02.12.2024 21:13 β π 0 π 0 π¬ 0 π 0I really am falling in love with array_agg(). I'm scared to think that my end game is me flattening and reconstructing json objects. #databs
02.12.2024 20:38 β π 7 π 0 π¬ 0 π 0Reading this now. #databs
01.12.2024 02:20 β π 4 π 0 π¬ 0 π 0Agreed Joe. More so than reading books (which I highly recommend). I think we need repetitive practice in our industry. I take inspiration from web developers who can build simple websites over a weekend. Many data professionals are not getting their reps in. My $.02.
01.12.2024 02:13 β π 1 π 0 π¬ 0 π 0Ultimately, I provide dopamine to executives. They like seeing numbers on a screen.
01.12.2024 01:59 β π 0 π 0 π¬ 0 π 0Finished these two. Really enjoyed Star Schema. Data Modeling Storytelling has some good advice too #bsdata
01.12.2024 00:55 β π 2 π 0 π¬ 0 π 0I'm interested. I work in finance reporting. We take scd2 and date explode them and build periodic snapshot tables. Curious how others deal with them.
30.11.2024 03:45 β π 0 π 0 π¬ 0 π 0Really like it's ability to be a "glue" database. Read directly from postgres, s3, parquet, csv , json, pandas dataframes, http urls. As a data engineer I like to sample data before building automated pipelines.
30.11.2024 03:30 β π 5 π 0 π¬ 1 π 0Big fan or buying discarded corporate laptops, install SSD drive, and installing Ubuntu or Fedora. Give old tech new life.
29.11.2024 15:53 β π 1 π 0 π¬ 0 π 0In data warehousing, edit, publish, but don't manufacture. #databs
29.11.2024 15:50 β π 1 π 0 π¬ 0 π 0Thanks for uploading so much material. Learning a ton. @eczachly.bsky.social
27.11.2024 02:49 β π 2 π 1 π¬ 0 π 0