Tom Schaul
banner
schaul.bsky.social
Tom Schaul
@schaul.bsky.social
RL researcher at DeepMind
https://schaul.site44.com/ 🇱🇺
August 27, 2025 at 12:48 PM
The RL team is a small team led by David Silver. We build RL algorithms and solve ambitious research challenges. As one of DeepMind's oldest teams, it has been instrumental in building DQN, AlphaGo, Rainbow, AlphaZero, MuZero, AlphaStar, AlphaProof, Gemini, etc. Help us build the next big thing!
May 24, 2025 at 10:08 AM
The sound of two users joining per second: "tik", "tok"...
January 30, 2025 at 11:39 AM
Dynamic programming has a fun origin story. In 1950, Bellman wanted to coin a term that "was something not even a Congressman could object to".
See here:
pubsonline.informs.org/doi/pdf/10.1...
pubsonline.informs.org
December 9, 2024 at 4:50 PM
Ohh... good morning to you too!

Clearly this got off on the wrong foot: do you want to try again, maybe more constructively (in the spirit of bluesky not being the other place)? This is a preprint, so I'd be happy to hear your suggestions for making it less "ignorant"...
December 2, 2024 at 10:36 AM
Either one or many players. For "improvement" to be well-defined, one agent must be special (see footnote 6), but the multi-agent setting has many benefits.
November 30, 2024 at 4:54 PM
1: open-ended means that it will keep producing novel and learnable artifacts (see the definition here: arxiv.org/abs/2406.04268), on the timescale of interest for the observer.

2: I think as a thought experiment it is valid, as it could work in principle, but of course it hasn't been built?
Open-Endedness is Essential for Artificial Superhuman Intelligence
In recent years there has been a tremendous surge in the general capabilities of AI systems, mainly fuelled by training foundation models on internetscale data. Nevertheless, the creation of openended...
arxiv.org
November 29, 2024 at 12:33 PM
In section 5 (second paragraph), there's about a dozen references to language games people are already using (one per paper), some with ingenious ways to provide feedback.

Also, I suspect the workshop will ultimately have the poster abstracts online with plenty of additional material!
November 28, 2024 at 7:08 PM
I'll also be giving a talk about this at the @neuripsconf.bsky.social workshop on "Language Gamification" in two weeks. Pop by if you're around!

language-gamification.github.io
Language Gamification Workshop 2024
Join us for the Language Gamification Workshop 2024, featuring keynote speeches, panel discussions, and poster sessions.
language-gamification.github.io
November 28, 2024 at 4:03 PM
@colah.bsky.social: with a few years' hindsight, how do you see the Distill space now? Is there a chance for a reboot or a rebirth in another form?
November 28, 2024 at 11:23 AM
I think the Distill journal was really valuable in this space, but unfortunately is no longer around to help...

distill.pub
Distill — Latest articles about machine learning
Articles about Machine Learning
distill.pub
November 27, 2024 at 1:42 PM