Ang Li
@angcharlesli.bsky.social
Asst. Professor@UMD ECE | Ph.D @DukeU | On-Device AI, Edge Computing, ML Systems, Federated Learning, Privacy.
Website: https://www.ang-li.com
Website: https://www.ang-li.com
DeepSpeed-Domino just came out, a communication-free LLM training engine with supporting tensor parallel. We are very glad to be part of this exciting project with DeepSpeed team.
Code: github.com/microsoft/De...
Paper: arxiv.org/abs/2409.15241
Code: github.com/microsoft/De...
Paper: arxiv.org/abs/2409.15241
DeepSpeed/blogs/deepspeed-domino at master · microsoft/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective. - microsoft/DeepSpeed
github.com
November 25, 2024 at 9:05 PM
DeepSpeed-Domino just came out, a communication-free LLM training engine with supporting tensor parallel. We are very glad to be part of this exciting project with DeepSpeed team.
Code: github.com/microsoft/De...
Paper: arxiv.org/abs/2409.15241
Code: github.com/microsoft/De...
Paper: arxiv.org/abs/2409.15241