Rajat Arya
@rajatarya.com
HF tech lead + software engineer, previously XetHub co-founder, 10+yrs building ML systems. Personal account, opinions are entirely mine and not any current or former employer. Work account is @rajatarya.hf.co.
Built my 1st app exclusively using @hf.co Hub features! It helps me keep track/summarize the latest HF News. Uses Datasets, Inference Endpoints, the newly announced `hf jobs`, and Spaces to visualize results. Check it out here: huggingface.co/spaces/rajat...
July 30, 2025 at 2:08 AM
Built my 1st app exclusively using @hf.co Hub features! It helps me keep track/summarize the latest HF News. Uses Datasets, Inference Endpoints, the newly announced `hf jobs`, and Spaces to visualize results. Check it out here: huggingface.co/spaces/rajat...
Reposted by Rajat Arya
We are in such a weird place where caring about other people is political.
May 15, 2025 at 2:08 PM
We are in such a weird place where caring about other people is political.
So much fun to be a part of this team, and at HF in general! 100PB here we come!
It's been a bit since I took a step back and looked at our progress to migrate @hf.co from Git LFS to Xet, but every time I do it's mind boggling.
A month ago there were 5,500 users/orgs on Xet with 150K repos and 4PB. Today?
🤗 700,000 users/orgs
📈 350,000 repos
🚀 15PB
A month ago there were 5,500 users/orgs on Xet with 150K repos and 4PB. Today?
🤗 700,000 users/orgs
📈 350,000 repos
🚀 15PB
June 26, 2025 at 6:17 PM
So much fun to be a part of this team, and at HF in general! 100PB here we come!
I regularly forget how powerful locally running LLMs are. Today's example, want to configure your awesome WezTerm but can't bring yourself to read docs/write Lua code. Just have Qwen3 do it for you.
I like llama-server best, and download models from HF, from here: github.com/ggml-org/lla...
I like llama-server best, and download models from HF, from here: github.com/ggml-org/lla...
June 6, 2025 at 8:31 PM
I regularly forget how powerful locally running LLMs are. Today's example, want to configure your awesome WezTerm but can't bring yourself to read docs/write Lua code. Just have Qwen3 do it for you.
I like llama-server best, and download models from HF, from here: github.com/ggml-org/lla...
I like llama-server best, and download models from HF, from here: github.com/ggml-org/lla...
If I listen to 90s music, now that some of it is > 30 years old, does this mean Spotify doesn't pay royalties to the artists? Do royalties stop when copyright ends?
(I'm thinking about this as "Mother" by Danzig is playing in the background.)
(I'm thinking about this as "Mother" by Danzig is playing in the background.)
May 29, 2025 at 6:10 PM
If I listen to 90s music, now that some of it is > 30 years old, does this mean Spotify doesn't pay royalties to the artists? Do royalties stop when copyright ends?
(I'm thinking about this as "Mother" by Danzig is playing in the background.)
(I'm thinking about this as "Mother" by Danzig is playing in the background.)
31% Dedupe!
With the models on our infrastructure, we can peer in and see how well our dedupe performs across the Llama 4 family.
On average, we're seeing ~25% dedupe, providing huge savings to the community who iterate on these state-of-the-art models. Here's a few selected models and how they perform on Xet.
On average, we're seeing ~25% dedupe, providing huge savings to the community who iterate on these state-of-the-art models. Here's a few selected models and how they perform on Xet.
April 5, 2025 at 8:12 PM
31% Dedupe!
Reposted by Rajat Arya
The entire Xet team is so excited to bring Llama 4 to the @hf.co community. Every byte downloaded comes through our infrastructure ❤️ 🤗 ❤️ 🤗 ❤️ 🤗
Read the whole post to see more about these models.
Read the whole post to see more about these models.
Welcome Llama 4 Maverick & Scout on Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
April 5, 2025 at 8:05 PM
The entire Xet team is so excited to bring Llama 4 to the @hf.co community. Every byte downloaded comes through our infrastructure ❤️ 🤗 ❤️ 🤗 ❤️ 🤗
Read the whole post to see more about these models.
Read the whole post to see more about these models.
Reposted by Rajat Arya
It's finally here ❤️
Build faster than ever on @hf.co starting today with 10x better upload/download performance. ⚡
Xet storage is rolling out access across the Hub; join the waitlist now! 🚀
Build faster than ever on @hf.co starting today with 10x better upload/download performance. ⚡
Xet storage is rolling out access across the Hub; join the waitlist now! 🚀
Join the Xet waitlist · Hugging Face
Unlock 10x faster uploads and downloads on HF
huggingface.co
March 12, 2025 at 10:36 PM
It's finally here ❤️
Build faster than ever on @hf.co starting today with 10x better upload/download performance. ⚡
Xet storage is rolling out access across the Hub; join the waitlist now! 🚀
Build faster than ever on @hf.co starting today with 10x better upload/download performance. ⚡
Xet storage is rolling out access across the Hub; join the waitlist now! 🚀
Reposted by Rajat Arya
On the Xet team at @huggingface.bsky.social we're always looking for ways to move bytes to computer near you as fast as possible.
To do this, we're redesigning the upload and download infrastructure on the Hub. This post describes how, check the thread for details 🧵
huggingface.co/blog/rearchi...
To do this, we're redesigning the upload and download infrastructure on the Hub. This post describes how, check the thread for details 🧵
huggingface.co/blog/rearchi...
Rearchitecting Hugging Face Uploads and Downloads
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
November 26, 2024 at 5:39 PM
On the Xet team at @huggingface.bsky.social we're always looking for ways to move bytes to computer near you as fast as possible.
To do this, we're redesigning the upload and download infrastructure on the Hub. This post describes how, check the thread for details 🧵
huggingface.co/blog/rearchi...
To do this, we're redesigning the upload and download infrastructure on the Hub. This post describes how, check the thread for details 🧵
huggingface.co/blog/rearchi...
Could you imagine giving a ⭐-rating to a bridge every time you cross it?
Infrastructure - even software infrastructure - is meant to be unsexy & work. It doesn't need Likes, Stars, and Re-posts to measure its impact. It uses adoption and utility to measure its impact.
Infrastructure - even software infrastructure - is meant to be unsexy & work. It doesn't need Likes, Stars, and Re-posts to measure its impact. It uses adoption and utility to measure its impact.
November 23, 2024 at 1:02 AM
Could you imagine giving a ⭐-rating to a bridge every time you cross it?
Infrastructure - even software infrastructure - is meant to be unsexy & work. It doesn't need Likes, Stars, and Re-posts to measure its impact. It uses adoption and utility to measure its impact.
Infrastructure - even software infrastructure - is meant to be unsexy & work. It doesn't need Likes, Stars, and Re-posts to measure its impact. It uses adoption and utility to measure its impact.
So much fun to work on this with the Xet-team!
When XetHub joined Hugging Face, we brainstormed how to share our tech with the community.
The magic? Versioning chunks, not files, giving rise to:
🧠 Smarter storage
⏩ Faster uploads
🚀 Efficient downloads
Curious? Read the blog and let us know how it could help your workflows!
The magic? Versioning chunks, not files, giving rise to:
🧠 Smarter storage
⏩ Faster uploads
🚀 Efficient downloads
Curious? Read the blog and let us know how it could help your workflows!
From Files to Chunks: Improving HF Storage Efficiency
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
November 21, 2024 at 6:47 PM
So much fun to work on this with the Xet-team!