Sung Kim
@sungkim.bsky.social
A business analyst at heart who enjoys delving into AI, ML, data engineering, data science, data analytics, and modeling. My views are my own.
You can also find me at threads: @sung.kim.mw
You can also find me at threads: @sung.kim.mw
Source: Roxy @RoxyTall on X
December 1, 2025 at 1:23 AM
Source: Roxy @RoxyTall on X
AI/ML for Biology & Healthcare: A Learning Path
Sharing my ML/AI & Biomedicine learning path
www.iamtk.co
December 1, 2025 at 1:04 AM
November 30, 2025 at 2:34 AM
According to the authors, ROOT outperforms Muon and Adam variants with faster convergence, higher final performance, and greater stability.
Paper: arxiv.org/abs/2511.20626
Repo: github.com/huawei-noah/...
Paper: arxiv.org/abs/2511.20626
Repo: github.com/huawei-noah/...
ROOT: Robust Orthogonalized Optimizer for Neural Network Training
The optimization of large language models (LLMs) remains a critical challenge, particularly as model scaling exacerbates sensitivity to algorithmic imprecision and training instability. Recent advance...
arxiv.org
November 29, 2025 at 3:22 PM
According to the authors, ROOT outperforms Muon and Adam variants with faster convergence, higher final performance, and greater stability.
Paper: arxiv.org/abs/2511.20626
Repo: github.com/huawei-noah/...
Paper: arxiv.org/abs/2511.20626
Repo: github.com/huawei-noah/...
What is surprising is that Lumine, exhibited an exceptional cross-game generalization ability, where it was able complete the entire chapter of Herta Space Station in Honkai: Star Rail within 7 hours.
Project: www.lumine-ai.org
Paper: arxiv.org/abs/2511.08892
Project: www.lumine-ai.org
Paper: arxiv.org/abs/2511.08892
Lumine: Building Generalist Agents in 3D Open Worlds
www.lumine-ai.org
November 29, 2025 at 3:02 PM
What is surprising is that Lumine, exhibited an exceptional cross-game generalization ability, where it was able complete the entire chapter of Herta Space Station in Honkai: Star Rail within 7 hours.
Project: www.lumine-ai.org
Paper: arxiv.org/abs/2511.08892
Project: www.lumine-ai.org
Paper: arxiv.org/abs/2511.08892
In this write-up, he will go through the construction of these matrices from the ground up.
arpitbhayani.me/blogs/qkv-ma...
arpitbhayani.me/blogs/qkv-ma...
The Q, K, V Matrices
At the core of the attention mechanism in LLMs are three matrices: Query, Key, and Value. These matrices are how transformers actually pay attention to different parts of the input. In this write-up, ...
arpitbhayani.me
November 29, 2025 at 2:43 PM
In this write-up, he will go through the construction of these matrices from the ground up.
arpitbhayani.me/blogs/qkv-ma...
arpitbhayani.me/blogs/qkv-ma...
But, the most efficient way to complete a task is via "illegible backchannels", which relies on the interpersonal relationships between engineers on different teams, which are very difficult to quantify.
www.seangoedecke.com/seeing-like-...
www.seangoedecke.com/seeing-like-...
Seeing like a software company
The big idea of James C. Scott’s Seeing Like A State can be expressed in three points: Modern organizations exert control by maximising “legibility”: by…
www.seangoedecke.com
November 29, 2025 at 2:40 PM
But, the most efficient way to complete a task is via "illegible backchannels", which relies on the interpersonal relationships between engineers on different teams, which are very difficult to quantify.
www.seangoedecke.com/seeing-like-...
www.seangoedecke.com/seeing-like-...
"
Gemini 3 can:
• Scour the internet for Black Friday deals.
• Analyze price history charts so you can feel confident that you’re getting the best price.
• Visualize how a gift will look IRL with Nano Banana Pro.
• Propose a list of gifts that fit the person you're shopping for.
"
Gemini 3 can:
• Scour the internet for Black Friday deals.
• Analyze price history charts so you can feel confident that you’re getting the best price.
• Visualize how a gift will look IRL with Nano Banana Pro.
• Propose a list of gifts that fit the person you're shopping for.
"
November 29, 2025 at 2:30 PM
"
Gemini 3 can:
• Scour the internet for Black Friday deals.
• Analyze price history charts so you can feel confident that you’re getting the best price.
• Visualize how a gift will look IRL with Nano Banana Pro.
• Propose a list of gifts that fit the person you're shopping for.
"
Gemini 3 can:
• Scour the internet for Black Friday deals.
• Analyze price history charts so you can feel confident that you’re getting the best price.
• Visualize how a gift will look IRL with Nano Banana Pro.
• Propose a list of gifts that fit the person you're shopping for.
"