Sergio Paniego
banner
sergiopaniego.bsky.social
Sergio Paniego
@sergiopaniego.bsky.social
AI PhD. Technology enables us to be more human. 🏳️‍🌈
Here’s what’s included:
📷 SmolVLM (VLM) by @hf.co
🔧 SFT & DPO fine-tuning methods
⚙️ Runs on consumer GPUs

🔗SFT project: huggingface.co/learn/cookbo...
🔗DPO project: huggingface.co/learn/cookbo...

🙏 @stevhliu.hf.co & @merve.bsky.social & @benburtenshaw.bsky.social
Fine-tuning SmolVLM with TRL on a consumer GPU - Hugging Face Open-Source AI Cookbook
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
December 18, 2024 at 8:23 AM
Thanks to @arig23498.bsky.social, @pcuenq.hf.co, and @reach-vb.hf.co for the collaboration. It's a pleasure working with such talented individuals! 🚀
November 29, 2024 at 10:10 AM
🔗 Link to the blog post: weaviate.io/blog/what-is... (by Erika Cardenas, @iamleonie.bsky.social)
🔗 Link to the recipe: huggingface.co/learn/cookbo...
🤗 Huge thanks to Aymeric Roucher and @stevhliu.hf.co for their support and insights!
What is Agentic RAG | Weaviate
Learn about Agentic Retrieval Augmented Generation (RAG), including architecture, implementation, and and difference to vanilla RAG.
weaviate.io
November 27, 2024 at 5:26 PM
In this notebook, I use Qwen2.5-72B-Instruct as the LLM to build a system with:
1️⃣ A manager agent
2️⃣ Three specialized agents: retriever, web search, and image generation
November 27, 2024 at 5:26 PM
🧑‍🍳 The result is this new Hugging Face Cookbook recipe, where I demonstrate how to create a Multi-Agent RAG system leveraging the agent support from the transformers module.
November 27, 2024 at 5:26 PM
Reposted by Sergio Paniego
4/6 More vision skills for complex visual tasks. This tutorial shows how to fine-tune the Qwen2-VL-7B model for visual question answering using the ChartQA dataset.

huggingface.co/learn/cookbo...

by @sergiopaniego.bsky.social
Fine-Tuning a Vision Language Model (Qwen2-VL-7B) with the Hugging Face Ecosystem (TRL) - Hugging Face Open-Source AI Cookbook
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
November 25, 2024 at 10:16 AM