DeepNVMe just got faster and more flexible:
✅ Gen5 NVMe support
✅ 20X faster model checkpointing
✅ Cost-efficient SGLang inference via ZeRO-Inference
✅ CPU-only pinned memory support

📘 pytorch.org/blog/deepnvm...
#PyTorch #DeepSpeed #AIInfrastructure

The #PyTorchFoundation newsletter is your go-to source for the latest updates, events, and community insights to build and innovate with #PyTorch—all in support of accelerating #OpenSourceAI.

📬 Subscribe: pytorch.org/newsletter/
📖 June: pytorch.org/newsletter/j...

🧠 Responsible AI is a design decision—and a strategic edge.

This new guide shows how to build a Yellow Teaming assistant using PyTorch and AWS Graviton4 to surface risks early and build more accountable systems.

🔗 pytorch.org/blog/build-r...

#ResponsibleAI #LLM #PyTorch #builtonArm

Mixture-of-Experts (MoE) is a popular #LLM architecture that reduces computation by activating fewer parameters per token. But it brings memory, communication, & control challenges.

💡We introduce MetaShuffling, enabling efficient Llama 4 model inference in production. 🔗 pytorch.org/blog/metashu...

The PyTorch Foundation is a Gold Sponsor of #MLSys2025 this week in Santa Clara.

Visit the booth and explore talks from Soumith Chintala, Ion Stoica, and Exec Dir Matt White on open source AI and scalable ML systems.

🔗 pytorch.org/blog/pytorch...

#PyTorch #OpenSourceAI #AIInfrastructure

PyTorch Foundation has expanded into an umbrella foundation.
vLLM and DeepSpeed have been accepted as hosted projects, advancing community-driven AI across the full lifecycle.

Quotes from AMD, AWS, Arm, Huawei, HuggingFace, IBM, Intel, LightningAI, Meta.

Read more: pytorch.org/blog/press-r...

Can language model systems autonomously complete entire tasks end-to-end?

In our next Expert Exchange webinar, Ofir Press explores autonomous LM systems for software engineering, featuring SWE-bench & SWE-agent—used by OpenAI, Meta, & more.

🔗 pytorch.org/autonomous-l...

#PyTorch #AI #OpenSource

Update from the PyTorch maintainers: 2.7 is out now.
🔹 Support for NVIDIA Blackwell (CUDA 12.8)
🔹 Mega Cache
🔹 torch.compile for Function Modes
🔹 FlexAttention updates
🔹 Intel GPU perf boost
🔗 Blog: hubs.la/Q03jBPSL0
📄 Release notes: hubs.la/Q03jBPlW0
#PyTorch #OpenSourceAI

The PyTorch Day France 2025 schedule is now live:
Explore the full agenda of talks and sessions
⛓️ pytorchdayfrance2025.sched.com
Co-located with #GOSIMAI2025

🎟️ Use code PYTORCHFRIEND for 25% off registration
👉 Or enter the Lucky Draw: paris2025.gosim.org

#PyTorch #PyTorchDayFrance

Join us in San Francisco Oct 22-23 to showcase your expertise at #PyTorchConf 2025! Share insights with the global #AI community at this industry-leading #OpenSource #ML framework event. Submit proposals for sessions, lightning talks & more by June 1: hubs.ly/Q03bpZ310