i work at hugging face and here you can expect posts about machine learning (llms mainly), some rust, some nvim nerdy stuff and anything related to hugging face 🤗
posting is not easy for me, but i’ll try to do better from now on, support is highly appreciated!
`tokeni.zig` is a std-only implementation of the Byte Pair Encoding (BPE) algorithm in Zig for tokenizing sequences of text, used by OpenAI (among many others) to tokenize the text when pretraining their large language models!
github.com/alvarobartt/...
`tokeni.zig` is a std-only implementation of the Byte Pair Encoding (BPE) algorithm in Zig for tokenizing sequences of text, used by OpenAI (among many others) to tokenize the text when pretraining their large language models!
github.com/alvarobartt/...
a highly recommended read!
a highly recommended read!
P.S. The result of the script above is: "model_id='deepseek-ai/DeepSeek-R1' requires memory=756.716GB"
P.S. The result of the script above is: "model_id='deepseek-ai/DeepSeek-R1' requires memory=756.716GB"
Hugging Face is openly reproducing the pipeline of 🐳 DeepSeek-R1. Open data, open training. open models, open collaboration.
🫵 Let's go!
github.com/huggingface/...
Hugging Face is openly reproducing the pipeline of 🐳 DeepSeek-R1. Open data, open training. open models, open collaboration.
🫵 Let's go!
github.com/huggingface/...
Amazing stuff from the DeepSeek team, ICYMI they recently released some reasoning models (DeepSeek-R1 and DeepSeek-R1-Zero), fully open-source, their performance is on par with OpenAI-o1 and it's MIT licensed!
Amazing stuff from the DeepSeek team, ICYMI they recently released some reasoning models (DeepSeek-R1 and DeepSeek-R1-Zero), fully open-source, their performance is on par with OpenAI-o1 and it's MIT licensed!
👇 you can sign up in the link below, don't miss it!
bit.ly/hf-learn-age...
👇 you can sign up in the link below, don't miss it!
bit.ly/hf-learn-age...
i work at hugging face and here you can expect posts about machine learning (llms mainly), some rust, some nvim nerdy stuff and anything related to hugging face 🤗
posting is not easy for me, but i’ll try to do better from now on, support is highly appreciated!
i work at hugging face and here you can expect posts about machine learning (llms mainly), some rust, some nvim nerdy stuff and anything related to hugging face 🤗
posting is not easy for me, but i’ll try to do better from now on, support is highly appreciated!
You just need a free account on the Hugging Face Hub (you can also subscribe to PRO to increase the requests per hour)
More details on the thread 🧵
You just need a free account on the Hugging Face Hub (you can also subscribe to PRO to increase the requests per hour)
More details on the thread 🧵
bsky.social/about/blog/4...
Bonus: you can keep your handle if you ever want to move to another server in the future.
bsky.social/about/blog/4...
Bonus: you can keep your handle if you ever want to move to another server in the future.