Andrew Hatch's Avatar

Andrew Hatch

@hatchman76.bsky.social

Engineering Software and Platform Resilience as best as I can πŸ‡¦πŸ‡Ί ex-pat living in the πŸ‡ΊπŸ‡Έ Spending my spare time adapting to the πŸ„β€β™‚οΈ in Santa Cruz and πŸ‚ in the Sierras.

52 Followers  |  40 Following  |  1,445 Posts  |  Joined: 31.10.2024  |  1.9727

Latest posts by hatchman76.bsky.social on Bluesky

Post image

Published nearly 30 years ago, this quote details the profound impact AI is having. Change is hard, and adapting to the new normal can seem overwhelming, but we have no choice. By the end, this evolution will become as much a part of our personal and working lives as the Internet now is.

17.08.2025 16:20 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
MTTR: Bullshit Masquerading as Operational Efficiency Reducing the time it takes to recover from an incident is and should be a priority for any organization. And of course, any efforts made to…

MTTR (Mean Time To Recovery): It sounds intuitive, but it’s flawed and deeply misleading. After years of coping with this bullshit metric, I have broken it down to explain why it’s not the beacon of operational success we pretend it is and what we should be focusing on instead.

03.07.2025 06:04 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Runbooks: the Good, Bad and Ugly w/special guest Andrew Hatch
YouTube video by thisisfinepodcast Runbooks: the Good, Bad and Ugly w/special guest Andrew Hatch

I was on a podcast this week! Many thanks to Colette and Clint for the privilege of participating on their excellent podcast. This was a fun discussion on run books and strategies for building adaptive capacity in complex systems.

youtu.be/FibAgJ0G084

05.06.2025 03:49 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Heard an interesting quote today, β€œAI is not going to take your job, but the person who can use it to do your job better probably will”

21.05.2025 16:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Unless Staging is treated with the same rigor and discipline as Production, it will never be reliable. Success looks like testing safely in Prod using isolated or replayed traffic, then ramping out the change. Staging mostly just proves the deploy runs and smoke tests pass. That’s never enough.

15.05.2025 15:54 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

AI tools like ChatGPT are absolutely fundamental to technology work, especially anything to do with software and ops work.

If you are not enabling and encouraging usage of these advances in productivity in your workforce you are putting your competitive edge at risk

27.04.2025 19:39 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Last week I created a multithreaded Python script that creates CSV output scanning accounts and regions with even some nice emojis and status bars as it runs using my AWS/config file as input.

I did that in 10 minutes with ChatGPT, and it worked flawlessly.

27.04.2025 19:39 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Recently, I helped lead tracking down IAM keys and secrets, across multiple AWS Accounts and Regions.

Several years ago, this task would have taken me some solid hours of Googling and Testing to script this with Boto3 in Python. Mainly because I never remember all the AWS CLI and Boto3 nuances

27.04.2025 19:39 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

AI may not take my job yet, but boy am I loving how it is making the tedious menial aspects of it faster, freeing me to focus on higher-value work and reducing frustration from wasting mental cycles relearning things that I will only forget in time because I don't do them repeatedly

27.04.2025 19:39 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Good for you mate ❀️ The emotional side is just as important

27.04.2025 17:25 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

I actually pivoted and put it all into RoamResearch not long after that! It’s much better now and by using Readwise with my Kindle it pushes new highlights into Roam as notes

28.02.2025 00:33 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

It is so nice to be back working for a company building great products on AWS. I did not realize how much I missed the challenge of doing this

27.02.2025 01:22 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
The 15 Minute Guide to Management Flattening When entrenched organizational behaviors restrict business growth and sustainability, changing the structure can be an extreme but…

The danger of this term, indeed any such term, is when it is used by organizations already lacking awareness of the levels of pre-existing dysfunction. Buzzwords and clever presentations never fix systemic issues, once the rot has set in a more direct and forcible approach may be essential:

29.01.2025 01:41 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

Where the idea of "scrappy" came from was never openly stated by the decree - its origins come from tech industry buzzwords relating to a company's ability to be resourceful, agile, and efficient, primarily when operating with limited resources.

29.01.2025 01:41 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Preview
Out of the Crisis Deming offers a theory of management based on his famou…

Such an example highlights the danger of a lack of organization awareness in senior leadership being disconnected to the "work-as-done", and why more layers of middle management will not, (if you'll pardon the pun!), manage themselves Out of the Crisis:

29.01.2025 01:41 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

The result was sadly predictable. More chaos, misdirection, missed deadlines, and a further decline in intrinsic motivation. While the employees may have believed the "scrappy" intent was honorable, it would not help them win playing the already well-entrenched extrinsic motivation game.

29.01.2025 01:41 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

I once worked at a company where a senior leader, under pressure for new ideas and needing to improve employee motivation numbers, in addition to fixing flat growth numbers after years of prosperity, decreed to an engineering organization that people needed to be more "scrappy".

29.01.2025 01:41 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

The results are sadly predictable, organizational technical and system debt proliferates, urgency and critical efforts are mis-directed to whoever yells loudest usually the most entitled aka the HiPPO), objectives are often missed leading to reforecasting and endless re-organizations

29.01.2025 01:41 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

The situation stems from many factors: poor organizational goal alignment, over-indexing on extrinsic motivation for pet-projects, not enough respect paid to continuous improvement objectives a.k.a technical glue work

29.01.2025 01:41 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

This quote from Andrew Stotz, Transform Your Business With Dr.Deming's 14 Points, sums up perfectly a classic organization anti-pattern I've seen in many workplaces.

29.01.2025 01:41 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

"To be successful, management must make sure that each department (or person) understands that if each group pursues its own self-interest, it may optimize that department’s output, but it may also cause sub-optimization of the output of the overall company."

29.01.2025 01:41 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Preview
Layoffsβ€Šβ€”β€Ša survivors tale β€œWhat’s wrong?” My wife looked at my face, my eyes widening as I drew in a sharp breath, looking at my phone to check my daily emails. It…

One week before Thanksgiving last year I was laid off at LinkedIn. While it is not the first time I have dealt with this kind of adversity, it is never easy when it happens. I wrote this blog to share how I approached it in order to land my next play. I hope it helps others

20.01.2025 16:08 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
There’s No Such Thing As A Bad Personalityβ€Šβ€”β€ŠJust Bad Management Don’t be the one who makes this mistake.

This is a pretty good article about #EngineeringManagement roles. Look into Personality Styles writings or presentations for more in depth guidance. I recommend this to anyone looking to get into Manager roles

medium.com/engineering-...

28.12.2024 16:49 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Preview
Introducing the Resilience in Software Foundation Software failures are inevitable. No matter how hard we try, we can’t make our systems flawless, nor can we predict every possible problem. The systems we’re building today are beyond the mental model...


Introducing the Resilience in Software Foundation: a multi-disciplinary group interested in networking with and learning from each other's unique experiences, and helping to disseminate their knowledge to the broader software industry as a whole. resilienceinsoftware.org/news/1092580

20.12.2024 19:38 β€” πŸ‘ 29    πŸ” 17    πŸ’¬ 0    πŸ“Œ 5
Unsheathing sword meme

Title: MTTR
First image: mean
Second image: meaningless

Unsheathing sword meme Title: MTTR First image: mean Second image: meaningless

30.11.2024 17:10 β€” πŸ‘ 39    πŸ” 8    πŸ’¬ 2    πŸ“Œ 0
Post image

How I feel looking at my code after applying increasingly obscure language features and ugly variable names just to break into that last 5% of leetcode solutions.

27.11.2024 19:44 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

With a fully remote team of just 20 employees, Bluesky has surpassed 20 million users in its first year since opening to the public and is stealing thunder from rivals hundreds of times its size.

At a time when conventional wisdom among bosses is that workers must be in-person to be productive.

20.11.2024 16:16 β€” πŸ‘ 36523    πŸ” 5467    πŸ’¬ 452    πŸ“Œ 360
Slack

Just imported every post I had made on Twitter thanks to this repo resilienceinactionhq.slack.com/archives/C07...

And now deactivated my Twitter account. Feels good 😁

18.11.2024 01:28 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0

It’s the same phenomenon in Australian Rules Football too unfortunately. Sports science has some work to do here

17.11.2024 22:12 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

@hatchman76 is following 20 prominent accounts