Andrew Hatch
@hatchman76.bsky.social
Engineering Software and Platform Resilience as best as I can
🇦🇺 ex-pat living in the 🇺🇸 Spending my spare time adapting to the 🏄♂️ in Santa Cruz and 🏂 in the Sierras.
🇦🇺 ex-pat living in the 🇺🇸 Spending my spare time adapting to the 🏄♂️ in Santa Cruz and 🏂 in the Sierras.
Published nearly 30 years ago, this quote details the profound impact AI is having. Change is hard, and adapting to the new normal can seem overwhelming, but we have no choice. By the end, this evolution will become as much a part of our personal and working lives as the Internet now is.
August 17, 2025 at 4:20 PM
Published nearly 30 years ago, this quote details the profound impact AI is having. Change is hard, and adapting to the new normal can seem overwhelming, but we have no choice. By the end, this evolution will become as much a part of our personal and working lives as the Internet now is.
MTTR (Mean Time To Recovery): It sounds intuitive, but it’s flawed and deeply misleading. After years of coping with this bullshit metric, I have broken it down to explain why it’s not the beacon of operational success we pretend it is and what we should be focusing on instead.
MTTR: Bullshit Masquerading as Operational Efficiency
Reducing the time it takes to recover from an incident is and should be a priority for any organization. And of course, any efforts made to…
medium.com
July 3, 2025 at 6:04 AM
MTTR (Mean Time To Recovery): It sounds intuitive, but it’s flawed and deeply misleading. After years of coping with this bullshit metric, I have broken it down to explain why it’s not the beacon of operational success we pretend it is and what we should be focusing on instead.
I was on a podcast this week! Many thanks to Colette and Clint for the privilege of participating on their excellent podcast. This was a fun discussion on run books and strategies for building adaptive capacity in complex systems.
youtu.be/FibAgJ0G084
youtu.be/FibAgJ0G084
Runbooks: the Good, Bad and Ugly w/special guest Andrew Hatch
YouTube video by thisisfinepodcast
youtu.be
June 5, 2025 at 3:49 AM
I was on a podcast this week! Many thanks to Colette and Clint for the privilege of participating on their excellent podcast. This was a fun discussion on run books and strategies for building adaptive capacity in complex systems.
youtu.be/FibAgJ0G084
youtu.be/FibAgJ0G084
Heard an interesting quote today, “AI is not going to take your job, but the person who can use it to do your job better probably will”
May 21, 2025 at 4:44 PM
Heard an interesting quote today, “AI is not going to take your job, but the person who can use it to do your job better probably will”
Unless Staging is treated with the same rigor and discipline as Production, it will never be reliable. Success looks like testing safely in Prod using isolated or replayed traffic, then ramping out the change. Staging mostly just proves the deploy runs and smoke tests pass. That’s never enough.
May 15, 2025 at 3:54 PM
Unless Staging is treated with the same rigor and discipline as Production, it will never be reliable. Success looks like testing safely in Prod using isolated or replayed traffic, then ramping out the change. Staging mostly just proves the deploy runs and smoke tests pass. That’s never enough.
AI may not take my job yet, but boy am I loving how it is making the tedious menial aspects of it faster, freeing me to focus on higher-value work and reducing frustration from wasting mental cycles relearning things that I will only forget in time because I don't do them repeatedly
April 27, 2025 at 7:39 PM
AI may not take my job yet, but boy am I loving how it is making the tedious menial aspects of it faster, freeing me to focus on higher-value work and reducing frustration from wasting mental cycles relearning things that I will only forget in time because I don't do them repeatedly
It is so nice to be back working for a company building great products on AWS. I did not realize how much I missed the challenge of doing this
February 27, 2025 at 1:22 AM
It is so nice to be back working for a company building great products on AWS. I did not realize how much I missed the challenge of doing this
"To be successful, management must make sure that each department (or person) understands that if each group pursues its own self-interest, it may optimize that department’s output, but it may also cause sub-optimization of the output of the overall company."
January 29, 2025 at 1:41 AM
"To be successful, management must make sure that each department (or person) understands that if each group pursues its own self-interest, it may optimize that department’s output, but it may also cause sub-optimization of the output of the overall company."
One week before Thanksgiving last year I was laid off at LinkedIn. While it is not the first time I have dealt with this kind of adversity, it is never easy when it happens. I wrote this blog to share how I approached it in order to land my next play. I hope it helps others
Layoffs — a survivors tale
“What’s wrong?” My wife looked at my face, my eyes widening as I drew in a sharp breath, looking at my phone to check my daily emails. It…
medium.com
January 20, 2025 at 4:08 PM
One week before Thanksgiving last year I was laid off at LinkedIn. While it is not the first time I have dealt with this kind of adversity, it is never easy when it happens. I wrote this blog to share how I approached it in order to land my next play. I hope it helps others
This is a pretty good article about #EngineeringManagement roles. Look into Personality Styles writings or presentations for more in depth guidance. I recommend this to anyone looking to get into Manager roles
medium.com/engineering-...
medium.com/engineering-...
There’s No Such Thing As A Bad Personality — Just Bad Management
Don’t be the one who makes this mistake.
medium.com
December 28, 2024 at 4:49 PM
This is a pretty good article about #EngineeringManagement roles. Look into Personality Styles writings or presentations for more in depth guidance. I recommend this to anyone looking to get into Manager roles
medium.com/engineering-...
medium.com/engineering-...
Reposted by Andrew Hatch
Introducing the Resilience in Software Foundation: a multi-disciplinary group interested in networking with and learning from each other's unique experiences, and helping to disseminate their knowledge to the broader software industry as a whole. resilienceinsoftware.org/news/1092580
Introducing the Resilience in Software Foundation
Software failures are inevitable. No matter how hard we try, we can’t make our systems flawless, nor can we predict every possible problem. The systems we’re building today are beyond the mental model...
resilienceinsoftware.org
December 20, 2024 at 7:38 PM
Introducing the Resilience in Software Foundation: a multi-disciplinary group interested in networking with and learning from each other's unique experiences, and helping to disseminate their knowledge to the broader software industry as a whole. resilienceinsoftware.org/news/1092580
Reposted by Andrew Hatch
How I feel looking at my code after applying increasingly obscure language features and ugly variable names just to break into that last 5% of leetcode solutions.
November 27, 2024 at 7:44 PM
How I feel looking at my code after applying increasingly obscure language features and ugly variable names just to break into that last 5% of leetcode solutions.
Reposted by Andrew Hatch
With a fully remote team of just 20 employees, Bluesky has surpassed 20 million users in its first year since opening to the public and is stealing thunder from rivals hundreds of times its size.
At a time when conventional wisdom among bosses is that workers must be in-person to be productive.
At a time when conventional wisdom among bosses is that workers must be in-person to be productive.
November 20, 2024 at 4:16 PM
With a fully remote team of just 20 employees, Bluesky has surpassed 20 million users in its first year since opening to the public and is stealing thunder from rivals hundreds of times its size.
At a time when conventional wisdom among bosses is that workers must be in-person to be productive.
At a time when conventional wisdom among bosses is that workers must be in-person to be productive.
Just imported every post I had made on Twitter thanks to this repo resilienceinactionhq.slack.com/archives/C07...
And now deactivated my Twitter account. Feels good 😁
And now deactivated my Twitter account. Feels good 😁
Slack
resilienceinactionhq.slack.com
November 18, 2024 at 1:28 AM
Just imported every post I had made on Twitter thanks to this repo resilienceinactionhq.slack.com/archives/C07...
And now deactivated my Twitter account. Feels good 😁
And now deactivated my Twitter account. Feels good 😁
Starting this up again after 15 years on Twitter
October 31, 2024 at 8:33 PM
Starting this up again after 15 years on Twitter
Reflecting on 2023 I wrote a blog post on Management Flattening, why it happens, what are the conditions that lead to it and how it can be avoided or reduced in future.
I hope 2024 is a better year for all of us, especially those that lost their jobs.
https://t.co/arR3sfxpuH
I hope 2024 is a better year for all of us, especially those that lost their jobs.
https://t.co/arR3sfxpuH
The 15 Minute Guide to Management Flattening
When entrenched organizational behaviors restrict business growth and sustainability, changing the structure can be an extreme but…
medium.com
November 17, 2024 at 10:22 PM
Reflecting on 2023 I wrote a blog post on Management Flattening, why it happens, what are the conditions that lead to it and how it can be avoided or reduced in future.
I hope 2024 is a better year for all of us, especially those that lost their jobs.
https://t.co/arR3sfxpuH
I hope 2024 is a better year for all of us, especially those that lost their jobs.
https://t.co/arR3sfxpuH
I have lives in the US for 3 years and only just worked out now that they call a stubby holder a beer koozie!! WTF is the reason for calling it a Koozie??? 🤣
November 17, 2024 at 10:21 PM
I have lives in the US for 3 years and only just worked out now that they call a stubby holder a beer koozie!! WTF is the reason for calling it a Koozie??? 🤣
Sharing! Theresa is a great professional and leader and someone I highly recommend https://twitter.com/TheresaNeate/status/1680039006627856385
November 17, 2024 at 10:21 PM
Sharing! Theresa is a great professional and leader and someone I highly recommend https://twitter.com/TheresaNeate/status/1680039006627856385
Evidence your kids are becoming American
Tomato is now pronounced
🇺🇲toe-may-toe 🇺🇲
not
🇦🇺 toh-mar-toe 🇦🇺
Tomato is now pronounced
🇺🇲toe-may-toe 🇺🇲
not
🇦🇺 toh-mar-toe 🇦🇺
November 17, 2024 at 10:21 PM
Evidence your kids are becoming American
Tomato is now pronounced
🇺🇲toe-may-toe 🇺🇲
not
🇦🇺 toh-mar-toe 🇦🇺
Tomato is now pronounced
🇺🇲toe-may-toe 🇺🇲
not
🇦🇺 toh-mar-toe 🇦🇺
Popped up on my Readwise, so, so true
November 17, 2024 at 10:21 PM
Popped up on my Readwise, so, so true
The Bay Area is a great place for people in tech careers. And while this post resonates, I can honestly say after being here for 3 years that some of the smartest engineers I've ever met still live and work in Melbourne, Australia. https://twitter.com/BrandonMChu/status/1657517741786423298
November 17, 2024 at 10:21 PM
The Bay Area is a great place for people in tech careers. And while this post resonates, I can honestly say after being here for 3 years that some of the smartest engineers I've ever met still live and work in Melbourne, Australia. https://twitter.com/BrandonMChu/status/1657517741786423298
My talk at SRECon23, Confessions of an SRE Manager, has been posted.
Distilling over 10 years of SRE/DevOps/Platform Engineering management experience was not easy, but creating this talk was a lot of fun and cathartic.
Hope you enjoy it
https://youtu.be/y1rzaL_mOpM
Distilling over 10 years of SRE/DevOps/Platform Engineering management experience was not easy, but creating this talk was a lot of fun and cathartic.
Hope you enjoy it
https://youtu.be/y1rzaL_mOpM
SREcon23 Americas - Confessions of an SRE Manager
youtu.be
November 17, 2024 at 10:21 PM
My talk at SRECon23, Confessions of an SRE Manager, has been posted.
Distilling over 10 years of SRE/DevOps/Platform Engineering management experience was not easy, but creating this talk was a lot of fun and cathartic.
Hope you enjoy it
https://youtu.be/y1rzaL_mOpM
Distilling over 10 years of SRE/DevOps/Platform Engineering management experience was not easy, but creating this talk was a lot of fun and cathartic.
Hope you enjoy it
https://youtu.be/y1rzaL_mOpM