Joe Hirst
LightNews LightNews
banner
joehirst.dev
Joe Hirst
@joehirst.dev
23 followers 65 following 0 posts
Posts Replies Media Videos
Reposted by Joe Hirst
danielvanstrien.bsky.social
This is the most exciting part of this DeepSeek release for me.
huggingface.co/deepseek-ai/...
Screenshot of this text: Meanwhile, we distilled the chain-of-thought from DeepSeek-R1-0528 to post-train Qwen3 8B Base, obtaining DeepSeek-R1-0528-Qwen3-8B. This model achieves state-of-the-art (SOTA) performance among open-source models on the AIME 2024, surpassing Qwen3 8B by +10.0% and matching the performance of Qwen3-235B-thinking. We believe that the chain-of-thought from DeepSeek-R1-0528 will hold significant importance for both academic research on reasoning models and industrial development focused on small-scale models. + a table of metrics
May 29, 2025 at 1:41 PM