Kylee Tilley ⚠️
@testingrequired.com
Rarely updated: testingrequired.com
Pinned
Kylee Tilley ⚠️
@testingrequired.com
· Jul 2
I don't know who needs to hear this but tests can be wrong, even if they are passing.
Friday morning walk in to the office
November 14, 2025 at 3:49 PM
Friday morning walk in to the office
Reposted by Kylee Tilley ⚠️
I have a technique I call incompetence-based-mutation-testing.
Start making some changes. Bork everything, comment out half the existing code to just make stuff compile. Run tests. Watch tests pass.
Stop refactoring, go have a stern word with the tests.
Start making some changes. Bork everything, comment out half the existing code to just make stuff compile. Run tests. Watch tests pass.
Stop refactoring, go have a stern word with the tests.
November 14, 2025 at 11:54 AM
I have a technique I call incompetence-based-mutation-testing.
Start making some changes. Bork everything, comment out half the existing code to just make stuff compile. Run tests. Watch tests pass.
Stop refactoring, go have a stern word with the tests.
Start making some changes. Bork everything, comment out half the existing code to just make stuff compile. Run tests. Watch tests pass.
Stop refactoring, go have a stern word with the tests.
Reposted by Kylee Tilley ⚠️
Building Rube Goldberg Machines...can easily become hard to maintain, thereby reducing or eliminating the value we intended. As in all situations, we must ensure we get value from our efforts, lest we inadvertently create our own version of Mouse Trap.
#Automation #Testing #SoftwareTesting
#Automation #Testing #SoftwareTesting
November 13, 2025 at 7:32 PM
Building Rube Goldberg Machines...can easily become hard to maintain, thereby reducing or eliminating the value we intended. As in all situations, we must ensure we get value from our efforts, lest we inadvertently create our own version of Mouse Trap.
#Automation #Testing #SoftwareTesting
#Automation #Testing #SoftwareTesting
The thing about LLMs hallucinating is that next tokens are influenced by the tokens previously generated in current response.
It's like when someone lies. Each lie compounds making harder and harder to form a coherent/accurate response. Just replace lie with hallucinate. 🤷♂️
It's like when someone lies. Each lie compounds making harder and harder to form a coherent/accurate response. Just replace lie with hallucinate. 🤷♂️
November 13, 2025 at 7:46 PM
The thing about LLMs hallucinating is that next tokens are influenced by the tokens previously generated in current response.
It's like when someone lies. Each lie compounds making harder and harder to form a coherent/accurate response. Just replace lie with hallucinate. 🤷♂️
It's like when someone lies. Each lie compounds making harder and harder to form a coherent/accurate response. Just replace lie with hallucinate. 🤷♂️
I haven't shared in a while but I've been working on a file format specification allowing markdown files to be HTTP requests
- Optional HTTP responses used as tests/assertions
- Data templating for environment specific variables, prompted inputs, and secrets
- In editor HTTP client and diagnostics
- Optional HTTP responses used as tests/assertions
- Data templating for environment specific variables, prompted inputs, and secrets
- In editor HTTP client and diagnostics
GitHub - testingrequired/reqlang: A file format specification for defining HTTP requests, response assertions, and associated data/configuration in "request files".
A file format specification for defining HTTP requests, response assertions, and associated data/configuration in "request files". - testingrequired/reqlang
github.com
November 13, 2025 at 5:53 PM
I haven't shared in a while but I've been working on a file format specification allowing markdown files to be HTTP requests
- Optional HTTP responses used as tests/assertions
- Data templating for environment specific variables, prompted inputs, and secrets
- In editor HTTP client and diagnostics
- Optional HTTP responses used as tests/assertions
- Data templating for environment specific variables, prompted inputs, and secrets
- In editor HTTP client and diagnostics
Every project template I've used as various companies have all suffered from the same issues
- Not tested that the template actually works after updates/extended time
- No way easy way to update templated projects after the fact
- Not tested that the template actually works after updates/extended time
- No way easy way to update templated projects after the fact
November 13, 2025 at 2:26 AM
Every project template I've used as various companies have all suffered from the same issues
- Not tested that the template actually works after updates/extended time
- No way easy way to update templated projects after the fact
- Not tested that the template actually works after updates/extended time
- No way easy way to update templated projects after the fact
Reposted by Kylee Tilley ⚠️
Writing tests after the fact
October 27, 2025 at 1:32 PM
Writing tests after the fact
I have a new project to work on 🤩 I'm working on a Rust crate for editing parameters for the Roland JDXI synth. Those parameters are buried in menus on the actual synth.
Yes there are several JDXI editors at this point. Many of them paid (deservingly so) but this is really more for fun than utility
Yes there are several JDXI editors at this point. Many of them paid (deservingly so) but this is really more for fun than utility
November 12, 2025 at 3:12 PM
I have a new project to work on 🤩 I'm working on a Rust crate for editing parameters for the Roland JDXI synth. Those parameters are buried in menus on the actual synth.
Yes there are several JDXI editors at this point. Many of them paid (deservingly so) but this is really more for fun than utility
Yes there are several JDXI editors at this point. Many of them paid (deservingly so) but this is really more for fun than utility
Reposted by Kylee Tilley ⚠️
Spreadsheets can do anything.
(Spread)sheet Music: Making A Simple Music Sequencer Using CSV Spreadsheets pointersgonewild.com/2018/05/20/s...
November 10, 2025 at 3:41 PM
Spreadsheets can do anything.
Reposted by Kylee Tilley ⚠️
Our VP of DevRel, Christian Heilmann, says that deleting code is more important - and more fun - than actually writing it.
Do you agree? 🤔
Watch his closing session from the World Congress, in full, over at www.wearedevelopers.com/en/videos/14...
Do you agree? 🤔
Watch his closing session from the World Congress, in full, over at www.wearedevelopers.com/en/videos/14...
November 10, 2025 at 1:31 PM
Our VP of DevRel, Christian Heilmann, says that deleting code is more important - and more fun - than actually writing it.
Do you agree? 🤔
Watch his closing session from the World Congress, in full, over at www.wearedevelopers.com/en/videos/14...
Do you agree? 🤔
Watch his closing session from the World Congress, in full, over at www.wearedevelopers.com/en/videos/14...
Code coverage improvements: before and after 🎉
Lots of low hanging fruit e.g. invalid op codes, mapping errors to diagnostics, popping off an empty stack, removing unused code even.
Lots of low hanging fruit e.g. invalid op codes, mapping errors to diagnostics, popping off an empty stack, removing unused code even.
November 10, 2025 at 6:43 AM
Code coverage improvements: before and after 🎉
Lots of low hanging fruit e.g. invalid op codes, mapping errors to diagnostics, popping off an empty stack, removing unused code even.
Lots of low hanging fruit e.g. invalid op codes, mapping errors to diagnostics, popping off an empty stack, removing unused code even.
LPT: count how many bay leaves went in 😅
November 10, 2025 at 12:19 AM
LPT: count how many bay leaves went in 😅
I ended up adding support for numbers to my tiny expression programming language instead 😅
Finishing and publishing this post might be my project for this weekend.
Also fixed!
Maybe now I'll actually write a blog post.
"A decade of software delivery consulting"
🤔
Maybe now I'll actually write a blog post.
"A decade of software delivery consulting"
🤔
November 9, 2025 at 4:54 PM
I ended up adding support for numbers to my tiny expression programming language instead 😅
Fun fact, I only recently learned about dbg! in Rust 😅
November 8, 2025 at 3:09 AM
Fun fact, I only recently learned about dbg! in Rust 😅
This is blowing my mind right now. I was aware Lucky Pierre and Prick were both Kevin McMahon but I had no idea these were Lucky Pierre tracks first... 🤯
November 7, 2025 at 6:13 PM
This is blowing my mind right now. I was aware Lucky Pierre and Prick were both Kevin McMahon but I had no idea these were Lucky Pierre tracks first... 🤯
So this has to exist right? A chess app that shows you what moves the CPU might make if they were you? Multiple suggestions ranked by confidence? Updated when new moves are made.
November 7, 2025 at 4:45 PM
So this has to exist right? A chess app that shows you what moves the CPU might make if they were you? Multiple suggestions ranked by confidence? Updated when new moves are made.
Typescript's type system is complex but it's kind of wonderful when you're only dealing with other typescript you've written.
Especially over a dynamic language like Javascript. It's extremely expensive and interesting for exploring API interface ideas before writing any implementation.
Especially over a dynamic language like Javascript. It's extremely expensive and interesting for exploring API interface ideas before writing any implementation.
November 7, 2025 at 3:16 AM
Typescript's type system is complex but it's kind of wonderful when you're only dealing with other typescript you've written.
Especially over a dynamic language like Javascript. It's extremely expensive and interesting for exploring API interface ideas before writing any implementation.
Especially over a dynamic language like Javascript. It's extremely expensive and interesting for exploring API interface ideas before writing any implementation.
Option<T> in languages with null values
a poster that says i want to believe
Alt: Mulder's poster "I want to believe"
media.tenor.com
November 7, 2025 at 3:05 AM
Option<T> in languages with null values
When left to my own devices I will try to fix random flaky tests 😅
November 6, 2025 at 8:33 PM
When left to my own devices I will try to fix random flaky tests 😅
This is Carpenter Brut's best track and I won't be taking any follow up questions.
Seriously some of the best synth work and the production is fucking magical.
Seriously some of the best synth work and the production is fucking magical.
Carpenter Brut - Obituary
YouTube video by NeonAether
youtu.be
November 6, 2025 at 7:46 PM
This is Carpenter Brut's best track and I won't be taking any follow up questions.
Seriously some of the best synth work and the production is fucking magical.
Seriously some of the best synth work and the production is fucking magical.
Finishing and publishing this post might be my project for this weekend.
Also fixed!
Maybe now I'll actually write a blog post.
"A decade of software delivery consulting"
🤔
Maybe now I'll actually write a blog post.
"A decade of software delivery consulting"
🤔
November 6, 2025 at 4:51 PM
Finishing and publishing this post might be my project for this weekend.
Reposted by Kylee Tilley ⚠️
Throwing more and more AI at delivering software while removing human beings will backfire hard long term. It's unavoidable.
January 24, 2025 at 5:37 PM
Throwing more and more AI at delivering software while removing human beings will backfire hard long term. It's unavoidable.
"I'm 20/30/40/50 years old. Is it to late to learn THING"
It's never too late. You're never too old. Keep learning until the day you die.
It's never too late. You're never too old. Keep learning until the day you die.
November 6, 2025 at 2:02 PM
"I'm 20/30/40/50 years old. Is it to late to learn THING"
It's never too late. You're never too old. Keep learning until the day you die.
It's never too late. You're never too old. Keep learning until the day you die.