Modal
@modal-labs.bsky.social
Bring your own code, and run CPU, GPU, and data-intensive compute at scale. The serverless platform for AI and data teams.
New blog post diving into the technical details of our container memory snapshot restore functionality.
Container memory restores can reduce cold start latency on user functions by more than 50% 💥
Container memory restores can reduce cold start latency on user functions by more than 50% 💥
Wrote about how a warmed up container can be saved to disk and later restored for a 2.5x cold start performance boost. Saving live container processes to disk turns out to be pretty whacky and interesting!
modal.com/blog/mem-sna...
modal.com/blog/mem-sna...
Memory Snapshots: Checkpoint/Restore for Sub-second Startup
Serializing container state to disk for aggressive cold start optimization.
modal.com
January 30, 2025 at 7:40 PM
New blog post diving into the technical details of our container memory snapshot restore functionality.
Container memory restores can reduce cold start latency on user functions by more than 50% 💥
Container memory restores can reduce cold start latency on user functions by more than 50% 💥
our resident cuda guru dropping some deep gpu knowledge 🧠
- 44 terms from all across the CUDA stack, each defined in its own article
- promiscuous interlinks, so you can drill into details naturally in the flow of reading
- slick themes and clean diagrams. who said technical docs had to be ugly?
modal.com/gpu-glossary
- promiscuous interlinks, so you can drill into details naturally in the flow of reading
- slick themes and clean diagrams. who said technical docs had to be ugly?
modal.com/gpu-glossary
GPU Glossary
A glossary of terms related to GPUs.
modal.com
December 13, 2024 at 8:21 PM
our resident cuda guru dropping some deep gpu knowledge 🧠
Reposted by Modal
new blog post: how at work, we built static IPs for serverless functions via WireGuard VPNs. with some diagrams explaining how container networking works! :D
modal.com/blog/vprox
modal.com/blog/vprox
December 2, 2024 at 9:44 PM
new blog post: how at work, we built static IPs for serverless functions via WireGuard VPNs. with some diagrams explaining how container networking works! :D
modal.com/blog/vprox
modal.com/blog/vprox