Andy Nelson's Avatar

Andy Nelson

@andynelson817.bsky.social

Data Engineer living in Texas

23 Followers  |  30 Following  |  30 Posts  |  Joined: 26.11.2024  |  2.0511

Latest posts by andynelson817.bsky.social on Bluesky

That's awesome 😎

09.06.2025 01:05 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Why can't you test against the current schedule vs a delayed schedule?

20.02.2025 02:36 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Who's your favorite philosopher?πŸ˜‚

20.02.2025 02:33 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Sorry to be 10 year late on the discussion

23.12.2024 19:51 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I'm reading there's controversy on putting satellites on links in data vault. Curious if #databs has any opinions on the matter.

23.12.2024 19:51 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 3    πŸ“Œ 0

Thanks Shane

17.12.2024 02:53 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Looking for data vault 2.0 training recommendations. Gotta be pre-recorded or remote. #databs

16.12.2024 15:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Never give up, never surrender πŸ’ͺ

13.12.2024 16:31 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Bet that baby could possibly handle my 25 left joins I write.

13.12.2024 13:40 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Paradime has AI tools for dbt. I haven't used them, sorry.

12.12.2024 03:38 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Although one of the best, probably also the most boring exercise machine ever produced by Man

11.12.2024 16:47 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I think I'm your target demographic Timo. Our team is trying to put sunset clauses on new adhoc pipelines and dashboards so at least we don't support things indefinitely.

11.12.2024 13:55 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Honestly I think accumulating snapshots are underutilized. #databs

11.12.2024 13:44 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Thanks for the reply Shane. But that's where I disagree with the author. I feel like I the data warehouse we can apply transformations for analytical purposes only. If there are 200 transaction codes and we put them in 5 buckets that aren't represented in the application layer, what's wrong with it?

11.12.2024 03:42 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Data Engineering, Redefined How data engineering is practiced today and why we should redefine it

Not sure I understand this article. I wish the author gave examples of antipaterns of Data Engineers building business Logic in the data warehouse. I assumed unless if your doing reverse ETL the application layer needs to maintain their own business Logic. towardsdatascience.com/data-enginee...

09.12.2024 19:38 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Yeah I enjoyed his book. He uses some patterns from data vault without the complexity of full blown data vault.

07.12.2024 14:53 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I've been influenced by Roberto Zagni's pragmatic data platform approach. I like the patterns he uses. youtu.be/OYrbg5q-CHo?...

06.12.2024 23:32 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

sadly I have to agree with you Matt. Not sure why Inmon is framing Kimball's approach as just data marts.

06.12.2024 23:20 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Chapter 2 of Adamson's Star Schema covers this well. Both authors are pragmatic and allowed flexibility in their approaches. Lots of misconceptions in this space.

06.12.2024 14:57 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Nobody doing data contracts lol

02.12.2024 21:13 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I really am falling in love with array_agg(). I'm scared to think that my end game is me flattening and reconstructing json objects. #databs

02.12.2024 20:38 β€” πŸ‘ 7    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Reading this now. #databs

01.12.2024 02:20 β€” πŸ‘ 4    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Agreed Joe. More so than reading books (which I highly recommend). I think we need repetitive practice in our industry. I take inspiration from web developers who can build simple websites over a weekend. Many data professionals are not getting their reps in. My $.02.

01.12.2024 02:13 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Ultimately, I provide dopamine to executives. They like seeing numbers on a screen.

01.12.2024 01:59 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Finished these two. Really enjoyed Star Schema. Data Modeling Storytelling has some good advice too #bsdata

01.12.2024 00:55 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I'm interested. I work in finance reporting. We take scd2 and date explode them and build periodic snapshot tables. Curious how others deal with them.

30.11.2024 03:45 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Really like it's ability to be a "glue" database. Read directly from postgres, s3, parquet, csv , json, pandas dataframes, http urls. As a data engineer I like to sample data before building automated pipelines.

30.11.2024 03:30 β€” πŸ‘ 5    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Big fan or buying discarded corporate laptops, install SSD drive, and installing Ubuntu or Fedora. Give old tech new life.

29.11.2024 15:53 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

In data warehousing, edit, publish, but don't manufacture. #databs

29.11.2024 15:50 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

Thanks for uploading so much material. Learning a ton. @eczachly.bsky.social

27.11.2024 02:49 β€” πŸ‘ 2    πŸ” 1    πŸ’¬ 0    πŸ“Œ 0

@andynelson817 is following 20 prominent accounts