blugene.bsky.social
blugene.bsky.social
@blugene.bsky.social
Reposted by blugene.bsky.social
Nous Research announces the pre-training of a 15B parameter language model over the internet, using Nous DisTrO and heterogeneous hardware contributed by our partners at Oracle, Lambda Labs, Northern Data Group, Crusoe, and the Andromeda Cluster.

You can watch the run LIVE: distro.nousresearch.com
December 2, 2024 at 4:43 PM