jsulz
@jsulz.com
I like pretty things, functional things, funny things, food things, and computer things.
Former: Storage infra things 🤗 @hf.co, Devops things @lexblog.bsky.social and devex/cloud infra things at @pantheon.io
Former: Storage infra things 🤗 @hf.co, Devops things @lexblog.bsky.social and devex/cloud infra things at @pantheon.io
There is nothing "Fun Sized" about the smaller Milk Duds box. A true horror story, that is.
October 13, 2025 at 5:09 PM
There is nothing "Fun Sized" about the smaller Milk Duds box. A true horror story, that is.
Today, we've finalized this first phase of migrating the Hub to a new, modern storage system. One that's built to scale with AI builders of today and tomorrow. huggingface.co/blog/from-fi...
There's still a lot of work to do, but we're excited for what's next. 💪
There's still a lot of work to do, but we're excited for what's next. 💪
From Files to Chunks: Improving HF Storage Efficiency
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
October 3, 2025 at 3:16 PM
Today, we've finalized this first phase of migrating the Hub to a new, modern storage system. One that's built to scale with AI builders of today and tomorrow. huggingface.co/blog/from-fi...
There's still a lot of work to do, but we're excited for what's next. 💪
There's still a lot of work to do, but we're excited for what's next. 💪
This also serves as a reminder to myself that I owe a round of "Thank you"s to all the talented designers I've worked with over the years.
July 30, 2025 at 6:51 PM
This also serves as a reminder to myself that I owe a round of "Thank you"s to all the talented designers I've worked with over the years.
A sneaky part of making this all work is our backward compatibility with Git LFS. This allows us to roll out a significant protocol change without forcing workflow changes
We call this the Git LFS Bridge internally, and like our migration process, it's power is in its simplicity.
We call this the Git LFS Bridge internally, and like our migration process, it's power is in its simplicity.
July 15, 2025 at 3:16 PM
A sneaky part of making this all work is our backward compatibility with Git LFS. This allows us to roll out a significant protocol change without forcing workflow changes
We call this the Git LFS Bridge internally, and like our migration process, it's power is in its simplicity.
We call this the Git LFS Bridge internally, and like our migration process, it's power is in its simplicity.
You can see over the past few months some of the biggest migrations show up in our cluster throughput.
Each spike corresponds to a significant migration (where we download from LFS and upload to Xet) with the baseline steadily increasing to just shy of 100 Gb/s
Each spike corresponds to a significant migration (where we download from LFS and upload to Xet) with the baseline steadily increasing to just shy of 100 Gb/s
July 15, 2025 at 3:16 PM
You can see over the past few months some of the biggest migrations show up in our cluster throughput.
Each spike corresponds to a significant migration (where we download from LFS and upload to Xet) with the baseline steadily increasing to just shy of 100 Gb/s
Each spike corresponds to a significant migration (where we download from LFS and upload to Xet) with the baseline steadily increasing to just shy of 100 Gb/s
The engine behind moving from Git LFS to Xet is our migration process. It's simple, powerful, and has moved well over a dozen PB just by itself. Here's a high level view of how it works.
July 15, 2025 at 3:16 PM
The engine behind moving from Git LFS to Xet is our migration process. It's simple, powerful, and has moved well over a dozen PB just by itself. Here's a high level view of how it works.