キーワードとしては，「自然勾配法，Muon，分散学習/継続学習，GPU」周りで出しました．まずは，最適化に関して，最近読んでいるこの三冊の書籍を組み合わせたような論文を一本，出せるよう頑張ります．

The technical paper for Gemini 2.5 mention improvements in “signal propagation” and “optimization dynamics.” Those terms make it sound like theoretical insights have been applied, and if so, I’d be very curious what those insights are.
storage.googleapis.com/deepmind-med...

Just revisiting yesterday’s performance of Shostakovich’s Preludes & Fugues by Audeeva, a kind of Russian Bach where every voice writhes and resonates, from despair and natural sounds to prayer. Her radiant, multi-hued sounds were perfect match for these fugues.
music.apple.com/jp/album/sho...