Charlie Peterson
@charlespeterson.dev
HPC research R&D scientist at UCLA
https://charlespeterson.dev/
https://charlespeterson.dev/
Well it was only small 1B-3B models so it didn't take up too much time in the workshop 😅, though I did show an example of a Llama 70B on our A100 GPU.
Also talk about speeding up batch processing since running millions of inferences is tough even with the small models on the GPUs.
Also talk about speeding up batch processing since running millions of inferences is tough even with the small models on the GPUs.
May 3, 2025 at 2:28 AM
Well it was only small 1B-3B models so it didn't take up too much time in the workshop 😅, though I did show an example of a Llama 70B on our A100 GPU.
Also talk about speeding up batch processing since running millions of inferences is tough even with the small models on the GPUs.
Also talk about speeding up batch processing since running millions of inferences is tough even with the small models on the GPUs.
Workshop link: github.com/ucla-oarc-hp...
GitHub - ucla-oarc-hpc/WS_LLMonHPC
Contribute to ucla-oarc-hpc/WS_LLMonHPC development by creating an account on GitHub.
github.com
May 1, 2025 at 6:04 AM
Workshop link: github.com/ucla-oarc-hp...
Its back to Oat milk for me now!
February 6, 2025 at 2:18 AM
Its back to Oat milk for me now!
Hopefully, you are not teaching anything with DEI... Drowsiness, Exhaustion, and Insomnia
January 29, 2025 at 6:10 PM
Hopefully, you are not teaching anything with DEI... Drowsiness, Exhaustion, and Insomnia