Charlie Snell
@seasnell.bsky.social
370 followers
320 following
8 posts
PhD @berkeley_ai; prev SR @GoogleDeepMind. I stare at my computer a lot and make things
Posts
Media
Videos
Starter Packs
Pinned
Reposted by Charlie Snell
Charlie Snell
@seasnell.bsky.social
· Nov 26
Predicting Emergent Capabilities by Finetuning
A fundamental open challenge in modern LLM scaling is the lack of understanding around emergent capabilities. In particular, language model pretraining loss is known to be highly predictable as a func...
arxiv.org
Charlie Snell
@seasnell.bsky.social
· Nov 26