StretchArmstrong

upload.wikimedia.org/wikipedia/en...

Remembering Tim Buckley on his birthday. Here he is playing Song to the Siren on the final episode of The Monkees TV show in 1968, two years before he released a very different version on his Starsailor LP

John Peel's Festive 50 Report Welcome to the John Peel's Festive 50 Report!  This comprehensive Power BI dashboard analyses tracks in the BBC's annual Festive 50 Chart from John Peel's Radio show's countdown across multiple years....

Also have a link to the Powerbi community Gallery

community.fabric.microsoft.com/t5/Data-Stor...

#PowerBI

John Peel's Festive 50 Report Welcome to the John Peel's Festive 50 Report!  This comprehensive Power BI dashboard analyses tracks in the BBC's annual Festive 50 Chart from John Peel's Radio show's countdown across multiple years....

As its Christmas I've published my John Peel's Festive 50 Report with loads of info on the many artists and great tracks broadcast over the years. Each track up to 2004 has my own rating. Enjoy Music Lovers!!!

app.powerbi.com/view?r=eyJrI...

#JohnPeel #PowerBI #datavis

Not sure about the #databricks assistant. I had an argument with it today about UNPIVOT. It is convinced that Databricks SQL doesn't support it and suggests I write UNION ALL for each column. If it has to do one thing, it's read its own bloody documentation.

is this any good?

WITH data AS (
SELECT json_extract(json, '$.value') AS v
FROM my_data),
kv AS (
SELECT
key,
json_extract_string(value, '$.string') AS val
FROM data, json_each(v)
WHERE json_extract_string(value, '$.string') IS NOT NULL
)
PIVOT kv ON key USING (MAX(val))

i have a similar stack @dagster.io @getdbt.com dlt and databricks in azure. Dagtster and dbt work together like a dream. love @duckdb.org for local dev and poc wrangling. might try motherduck at some point especially when ducklake has matured. using k8s and grafana for alerts

COMPETITION TIME! These are two A3 prints I’m not happy selling for various reasons.

Rather than throw them away you can win one (First place picks)

If you’d like the chance to win a print then please RT and follow and I’ll pick a winner Friday 1pm

My shop www.infinitebacon.com

GOOD LUCK!

I've only worn my fab new punching nazi's t a couple of times but its by far the most popular of my many t's. 7 random strangers have already said how much they love it.
www.infinitebacon.com/tshirts/p/pu...

bsky.app/profile/toky...

Screenshot of a post from the PC master race subreddit. It says "Man please stop dodging me I'm trying to conserve minuscule amounts of cpu/memory". Below, a photo of someone banging their desk with the text "When I try to end a task in task manager just for the app to jump to another spot causing me to end some other fuckass app"

If you hold CTRL, it will pause Task Manager so the processes don't move around when you're sorted by resource usage

this is the best tech tip i've seen for many years☺️

FYI i've posted a link to my dbt cheat sheet which might help
bsky.app/profile/stre...

Here is my dbt cheat sheet.

#dbt_labs #dataBS #data @getdbt.com

github.com/stretcharm/d...

feels like the perfect sized project to get you going. dbt has so many amazing features its well worth the effort and will save you so much time if you have anything more complex

Nice work. I love @duckdb.org is easy and fast to do analytical stuff. if you've not already tried it have a go with @getdbt.com its also an OSS and could make your ropey cron job 😁 and 14 sql statements into an elegant documented pipeline.

I hope they haven't just enrolled into squid game series 3

a rubber duck with a red heart above it ALT: a rubber duck with a red heart above it

And lastly if I host my parquet files in azure its way slower to run the pipe than if the files are local.
All that said its way faster and cheaper to do my dev than having to start and stop Databricks. Loving the duck

Only irritations are I like to use dbeaver to check my data and I have to keep disconnecting to run dbt. On occasion even need to quit dbeaver to release the file lock. I've also see dbt get locked out of the db by itself which is very odd as everything is single thread.

Nice. I'm also doing this with dbt but with duckdb and databricks. Some minor macros to help with some syntax diffs. However the dbt sdf news means that might be a thing of the past.
I've also got most of it running in dagster