Pete Cheslock
@petecheslock.com
🥩 He/Him 🍖 "Anything worth doing is worth overdoing."
Reposted by Pete Cheslock
🏗️ llm-d v0.5: Sustaining Performance at Scale In our last release, we focused on breaking latency records.
With v0.5, we’re shifting from peak performance to the operational rigor required to sustain those gains in production.
🧵👇
llm-d.ai/blog/llm-d-v...
With v0.5, we’re shifting from peak performance to the operational rigor required to sustain those gains in production.
🧵👇
llm-d.ai/blog/llm-d-v...
llm-d 0.5: Sustaining Performance at Scale | llm-d
Announcing the llm-d 0.5 release
llm-d.ai
February 5, 2026 at 3:32 PM
🏗️ llm-d v0.5: Sustaining Performance at Scale In our last release, we focused on breaking latency records.
With v0.5, we’re shifting from peak performance to the operational rigor required to sustain those gains in production.
🧵👇
llm-d.ai/blog/llm-d-v...
With v0.5, we’re shifting from peak performance to the operational rigor required to sustain those gains in production.
🧵👇
llm-d.ai/blog/llm-d-v...
Reposted by Pete Cheslock
Standardizing high-performance inference requires deep ecosystem collaboration. 🚀
Huge shoutout to @vllm_project and @IBMResearch on the new KV Offloading Connector. We’re seeing up to 9x throughput gains on H100s and massive TTFT reductions. 🧵
blog.vllm.ai/2026/01/08/k...
Huge shoutout to @vllm_project and @IBMResearch on the new KV Offloading Connector. We’re seeing up to 9x throughput gains on H100s and massive TTFT reductions. 🧵
blog.vllm.ai/2026/01/08/k...
Inside vLLM’s New KV Offloading Connector: Smarter Memory Transfer for Maximizing Inference Throughput
In this post, we will describe the new KV cache offloading feature that was introduced in vLLM 0.11.0. We will focus on offloading to CPU memory (DRAM) and its benefits to improving overall inference…
blog.vllm.ai
January 9, 2026 at 6:45 PM
Standardizing high-performance inference requires deep ecosystem collaboration. 🚀
Huge shoutout to @vllm_project and @IBMResearch on the new KV Offloading Connector. We’re seeing up to 9x throughput gains on H100s and massive TTFT reductions. 🧵
blog.vllm.ai/2026/01/08/k...
Huge shoutout to @vllm_project and @IBMResearch on the new KV Offloading Connector. We’re seeing up to 9x throughput gains on H100s and massive TTFT reductions. 🧵
blog.vllm.ai/2026/01/08/k...
Reposted by Pete Cheslock
AI inference is like a busy airport: without a controller, you get gridlock. ✈️
Check out this breakdown by Cedric Clyburn from Red Hat on how llm-d intelligently routes distributed LLM requests.
🔹 Solves "round robin" congestion
🔹 Disaggregates P/D to save costs
www.youtube.com/watch?v=CNKG...
Check out this breakdown by Cedric Clyburn from Red Hat on how llm-d intelligently routes distributed LLM requests.
🔹 Solves "round robin" congestion
🔹 Disaggregates P/D to save costs
www.youtube.com/watch?v=CNKG...
LLM‑D Explained: Building Next‑Gen AI with LLMs, RAG & Kubernetes
YouTube video by IBM Technology
www.youtube.com
January 8, 2026 at 7:21 PM
AI inference is like a busy airport: without a controller, you get gridlock. ✈️
Check out this breakdown by Cedric Clyburn from Red Hat on how llm-d intelligently routes distributed LLM requests.
🔹 Solves "round robin" congestion
🔹 Disaggregates P/D to save costs
www.youtube.com/watch?v=CNKG...
Check out this breakdown by Cedric Clyburn from Red Hat on how llm-d intelligently routes distributed LLM requests.
🔹 Solves "round robin" congestion
🔹 Disaggregates P/D to save costs
www.youtube.com/watch?v=CNKG...
If you stop to think about it, Geysers are just Earth farts.
April 25, 2025 at 9:13 PM
If you stop to think about it, Geysers are just Earth farts.
So a long time ago when buying new headphones and reading reviews, I noticed how the reviews often sounded similar to reviews for a bottle of wine. Like:
"Rich and full-bodied with excellent depth. The bass notes are particularly impressive, with a smooth finish that lingers pleasantly."
"Rich and full-bodied with excellent depth. The bass notes are particularly impressive, with a smooth finish that lingers pleasantly."
January 28, 2025 at 7:04 PM
So a long time ago when buying new headphones and reading reviews, I noticed how the reviews often sounded similar to reviews for a bottle of wine. Like:
"Rich and full-bodied with excellent depth. The bass notes are particularly impressive, with a smooth finish that lingers pleasantly."
"Rich and full-bodied with excellent depth. The bass notes are particularly impressive, with a smooth finish that lingers pleasantly."
Reposted by Pete Cheslock
How do you pronounce “www” the abbreviation for “World Wide Web”?
https://youtube.com/shorts/MxuX7M661Hg
#www #sysadmin #devops #sre #pronunciation #tutorial #software #developers
https://youtube.com/shorts/MxuX7M661Hg
#www #sysadmin #devops #sre #pronunciation #tutorial #software #developers
How do you pronounce “www” the abbreviation for “World Wide Web”? #shorts
#www #sysadmin #sysadminlife #devops #sre #pronunciation #tutorial #software #opensource #developers #techtok
youtube.com
July 3, 2023 at 1:55 PM
How do you pronounce “www” the abbreviation for “World Wide Web”?
https://youtube.com/shorts/MxuX7M661Hg
#www #sysadmin #devops #sre #pronunciation #tutorial #software #developers
https://youtube.com/shorts/MxuX7M661Hg
#www #sysadmin #devops #sre #pronunciation #tutorial #software #developers
How do you pronounce "sudo" the #linux/#unix command?
So are you team "Su DOUGH" or team "Su DOOOO"
https://www.youtube.com/shorts/qpi5wYblQfY
So are you team "Su DOUGH" or team "Su DOOOO"
https://www.youtube.com/shorts/qpi5wYblQfY
How do you pronounce "sudo" the #linux/#unix command? #shorts
How do you pronouce "sudo" the #linux/#unix command? #sudo #sysadmin #sysadminlife #devops #sre #pronounciation #tutorial #software #opensource #developers #...
www.youtube.com
June 25, 2023 at 12:07 PM
How do you pronounce "sudo" the #linux/#unix command?
So are you team "Su DOUGH" or team "Su DOOOO"
https://www.youtube.com/shorts/qpi5wYblQfY
So are you team "Su DOUGH" or team "Su DOOOO"
https://www.youtube.com/shorts/qpi5wYblQfY
This is probably the most requested pronunciation video i've gotten.
How do you say: "fsck" - a.k.a - File System Check.
There is no agreed upon pronunciation of this one!
https://youtube.com/shorts/7b-X6MJGkdA
#linux #sysadmin #devops #sre
How do you say: "fsck" - a.k.a - File System Check.
There is no agreed upon pronunciation of this one!
https://youtube.com/shorts/7b-X6MJGkdA
#linux #sysadmin #devops #sre
There is no agreed upon way to pronounce \
#techtips #data #softwareengineer #developer #devops #sysadmin #software #linux #techlife #tutorial #pronounciation #shorts #linux
youtube.com
May 26, 2023 at 5:09 PM
This is probably the most requested pronunciation video i've gotten.
How do you say: "fsck" - a.k.a - File System Check.
There is no agreed upon pronunciation of this one!
https://youtube.com/shorts/7b-X6MJGkdA
#linux #sysadmin #devops #sre
How do you say: "fsck" - a.k.a - File System Check.
There is no agreed upon pronunciation of this one!
https://youtube.com/shorts/7b-X6MJGkdA
#linux #sysadmin #devops #sre
Another episode of “How do you say”. This one is definitely one of my favorites.
How do you say JWT (JSON Web Token)?
https://youtube.com/shorts/D2D9umQMKhA?feature=share
How do you say JWT (JSON Web Token)?
https://youtube.com/shorts/D2D9umQMKhA?feature=share
Have you heard of JWT before? But how would YOU pronounce it? #shorts #software #howdoyousay
Have you heard of JWT before? But how would YOU pronounce it? #shorts #software #howdoyousay #tech #softwareengineering #softwaretutorials
youtube.com
May 20, 2023 at 12:30 PM
Another episode of “How do you say”. This one is definitely one of my favorites.
How do you say JWT (JSON Web Token)?
https://youtube.com/shorts/D2D9umQMKhA?feature=share
How do you say JWT (JSON Web Token)?
https://youtube.com/shorts/D2D9umQMKhA?feature=share
Reposted by Pete Cheslock
Did you know there are at least 3 (THREE) different ways to say SQL?
https://www.tiktok.com/t/ZTRK9rNSh/
https://www.tiktok.com/t/ZTRK9rNSh/
petecheslock on TikTok
Did you know there are 3 ways to pronouce #SQL? #techtok #data #softwareengineer #developer #tech #code
www.tiktok.com
May 13, 2023 at 12:14 PM
Did you know there are at least 3 (THREE) different ways to say SQL?
https://www.tiktok.com/t/ZTRK9rNSh/
https://www.tiktok.com/t/ZTRK9rNSh/
Did you know there are at least 3 (THREE) different ways to say SQL?
https://www.tiktok.com/t/ZTRK9rNSh/
https://www.tiktok.com/t/ZTRK9rNSh/
petecheslock on TikTok
Did you know there are 3 ways to pronouce #SQL? #techtok #data #softwareengineer #developer #tech #code
www.tiktok.com
May 13, 2023 at 12:14 PM
Did you know there are at least 3 (THREE) different ways to say SQL?
https://www.tiktok.com/t/ZTRK9rNSh/
https://www.tiktok.com/t/ZTRK9rNSh/
How do you say….. “Epoch”
Turns out this one was heavily contested on pronounciation.
https://www.tiktok.com/t/ZTRws7M3b/
Turns out this one was heavily contested on pronounciation.
https://www.tiktok.com/t/ZTRws7M3b/
petecheslock on TikTok
Hey #techtok How do you say… “epoch” https://en.m.wikipedia.org/wiki/Epoch_(computing) #p#pronouncet#technologys#softwaredevelopers
www.tiktok.com
May 5, 2023 at 9:23 PM
How do you say….. “Epoch”
Turns out this one was heavily contested on pronounciation.
https://www.tiktok.com/t/ZTRws7M3b/
Turns out this one was heavily contested on pronounciation.
https://www.tiktok.com/t/ZTRws7M3b/
Reposted by Pete Cheslock
Oooh neat. New handle time.
April 28, 2023 at 10:16 PM
Oooh neat. New handle time.
Well - after recording over 30 of these. Check out the promo for my upcoming video series.
"How do you say" - Where the words are made up and the pronunciations don't matter.
This was an absolute blast and huge thanks to EVERYONE who was able to join me.
https://youtu.be/fkwF2rjOJKI
"How do you say" - Where the words are made up and the pronunciations don't matter.
This was an absolute blast and huge thanks to EVERYONE who was able to join me.
https://youtu.be/fkwF2rjOJKI
How Do You Say Tech Lingo - Promo
In the tech community, there are many words and acronyms! This series asks people from different tech companies and communities to pronounce them 😬 Let's see how they sound! 😂
What made you laugh, what made you cringe? Tell us in the comments.
We'd love if you try out AppMap as a code editor extension / plugin to visualize your runtime code. We promise it's not like anything else you've tried! https://appmap.io/download
youtu.be
April 28, 2023 at 10:10 PM
Well - after recording over 30 of these. Check out the promo for my upcoming video series.
"How do you say" - Where the words are made up and the pronunciations don't matter.
This was an absolute blast and huge thanks to EVERYONE who was able to join me.
https://youtu.be/fkwF2rjOJKI
"How do you say" - Where the words are made up and the pronunciations don't matter.
This was an absolute blast and huge thanks to EVERYONE who was able to join me.
https://youtu.be/fkwF2rjOJKI