On the Shifting Global Compute Landscape
•
54
AI & ML interests
The AI community building the future.
Recent Activity
View all activity
Papers
View all Papers
Articles
sergiopaniego
posted
an
update
about 2 hours ago
Post
25
As the year comes to an end, it’s a good moment to catch up on some of the best long-form pieces published by the
@huggingface
team.
I’ve gathered them all here if you want to read or save them for later:
https://huggingface.co/collections/sergiopaniego/research-and-long-form-blog-posts
I’ve gathered them all here if you want to read or save them for later:
https://huggingface.co/collections/sergiopaniego/research-and-long-form-blog-posts
sergiopaniego
posted
an
update
1 day ago
Post
1249
This super detailed tutorial by
@Paulescu
is pure gold 🪙 "Fine-tuning a Small Language Model for browser control with GRPO and OpenEnv"
LFM2-350M ( @LiquidAI ) + BrowserGym (OpenEnv) + GRPO (TRL) for learning browser control 🤝
https://paulabartabajo.substack.com/p/fine-tuning-lfm2-350m-for-browser
LFM2-350M ( @LiquidAI ) + BrowserGym (OpenEnv) + GRPO (TRL) for learning browser control 🤝
https://paulabartabajo.substack.com/p/fine-tuning-lfm2-350m-for-browser
craffel
authored
a
paper
5 days ago
nielsr
submitted
a
paper
to Daily Papers
7 days ago
sergiopaniego
posted
an
update
7 days ago
Post
360
if you’re on holidays 🎄 and want some reading, here are blogs I contributed to this year:
🦄 VLMs in TRL: https://huggingface.co/blog/trl-vlm-alignment
🦖 VLMs in 2025: https://huggingface.co/blog/vlms-2025
👾 tokenization in transformers v5: https://huggingface.co/blog/tokenizers
🛸 faster transformers: https://huggingface.co/blog/faster-transformers
🦄 VLMs in TRL: https://huggingface.co/blog/trl-vlm-alignment
🦖 VLMs in 2025: https://huggingface.co/blog/vlms-2025
👾 tokenization in transformers v5: https://huggingface.co/blog/tokenizers
🛸 faster transformers: https://huggingface.co/blog/faster-transformers
sergiopaniego
posted
an
update
8 days ago
Post
1889
The Christmas holidays are here! 🎄
Thinking about learning something new in AI?
@huggingface offers 12 FREE courses covering all the relevant topics, for every level of experience. A great challenge for the holidays (and worth saving for later 🙄)
Let’s explore them!
🧠 𝗟𝗟𝗠 𝗖𝗼𝘂𝗿𝘀𝗲: large language models with HF tools
https://huggingface.co/learn/llm-course
🤖 𝗔𝗴𝗲𝗻𝘁𝘀 𝗖𝗼𝘂𝗿𝘀𝗲: build and deploy AI agents
https://huggingface.co/learn/agents-course
🎨 𝗗𝗶𝗳𝗳𝘂𝘀𝗶𝗼𝗻 𝗖𝗼𝘂𝗿𝘀𝗲: diffusion models with 🤗 Diffusers
https://huggingface.co/learn/diffusion-course
🔊 𝗔𝘂𝗱𝗶𝗼 𝗖𝗼𝘂𝗿𝘀𝗲: transformers for audio tasks
https://huggingface.co/learn/audio-course
🎮 𝗗𝗲𝗲𝗽 𝗥𝗟 𝗖𝗼𝘂𝗿𝘀𝗲: deep reinforcement learning
https://huggingface.co/learn/deep-rl-course
👁️ 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗖𝗼𝗺𝗽𝘂𝘁𝗲𝗿 𝗩𝗶𝘀𝗶𝗼𝗻 𝗖𝗼𝘂𝗿𝘀𝗲: modern computer vision with HF
https://huggingface.co/learn/computer-vision-course
🦾 𝗥𝗼𝗯𝗼𝘁𝗶𝗰𝘀 𝗖𝗼𝘂𝗿𝘀𝗲 (𝗟𝗲𝗥𝗼𝗯𝗼𝘁): learning-based robotics
https://huggingface.co/learn/robotics-course
🧩 𝗠𝗖𝗣 𝗖𝗼𝘂𝗿𝘀𝗲: Model Context Protocol explained
https://huggingface.co/learn/mcp-course
🧪 𝗔 𝗦𝗺𝗼𝗹 𝗖𝗼𝘂𝗿𝘀𝗲: post-training AI models
https://huggingface.co/learn/a-smol-course
🕹️ 𝗠𝗟 𝗳𝗼𝗿 𝗚𝗮𝗺𝗲𝘀: AI in game development
https://huggingface.co/learn/ml-for-games-course
🧊 𝗠𝗟 𝗳𝗼𝗿 𝟯𝗗: machine learning for 3D data
https://huggingface.co/learn/ml-for-3d-course
📘 𝗢𝗽𝗲𝗻-𝗦𝗼𝘂𝗿𝗰𝗲 𝗔𝗜 𝗖𝗼𝗼𝗸𝗯𝗼𝗼𝗸: practical AI notebooks
https://huggingface.co/learn/cookbook
All of them can be found here: https://huggingface.co/learn
Thinking about learning something new in AI?
@huggingface offers 12 FREE courses covering all the relevant topics, for every level of experience. A great challenge for the holidays (and worth saving for later 🙄)
Let’s explore them!
🧠 𝗟𝗟𝗠 𝗖𝗼𝘂𝗿𝘀𝗲: large language models with HF tools
https://huggingface.co/learn/llm-course
🤖 𝗔𝗴𝗲𝗻𝘁𝘀 𝗖𝗼𝘂𝗿𝘀𝗲: build and deploy AI agents
https://huggingface.co/learn/agents-course
🎨 𝗗𝗶𝗳𝗳𝘂𝘀𝗶𝗼𝗻 𝗖𝗼𝘂𝗿𝘀𝗲: diffusion models with 🤗 Diffusers
https://huggingface.co/learn/diffusion-course
🔊 𝗔𝘂𝗱𝗶𝗼 𝗖𝗼𝘂𝗿𝘀𝗲: transformers for audio tasks
https://huggingface.co/learn/audio-course
🎮 𝗗𝗲𝗲𝗽 𝗥𝗟 𝗖𝗼𝘂𝗿𝘀𝗲: deep reinforcement learning
https://huggingface.co/learn/deep-rl-course
👁️ 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗖𝗼𝗺𝗽𝘂𝘁𝗲𝗿 𝗩𝗶𝘀𝗶𝗼𝗻 𝗖𝗼𝘂𝗿𝘀𝗲: modern computer vision with HF
https://huggingface.co/learn/computer-vision-course
🦾 𝗥𝗼𝗯𝗼𝘁𝗶𝗰𝘀 𝗖𝗼𝘂𝗿𝘀𝗲 (𝗟𝗲𝗥𝗼𝗯𝗼𝘁): learning-based robotics
https://huggingface.co/learn/robotics-course
🧩 𝗠𝗖𝗣 𝗖𝗼𝘂𝗿𝘀𝗲: Model Context Protocol explained
https://huggingface.co/learn/mcp-course
🧪 𝗔 𝗦𝗺𝗼𝗹 𝗖𝗼𝘂𝗿𝘀𝗲: post-training AI models
https://huggingface.co/learn/a-smol-course
🕹️ 𝗠𝗟 𝗳𝗼𝗿 𝗚𝗮𝗺𝗲𝘀: AI in game development
https://huggingface.co/learn/ml-for-games-course
🧊 𝗠𝗟 𝗳𝗼𝗿 𝟯𝗗: machine learning for 3D data
https://huggingface.co/learn/ml-for-3d-course
📘 𝗢𝗽𝗲𝗻-𝗦𝗼𝘂𝗿𝗰𝗲 𝗔𝗜 𝗖𝗼𝗼𝗸𝗯𝗼𝗼𝗸: practical AI notebooks
https://huggingface.co/learn/cookbook
All of them can be found here: https://huggingface.co/learn
sergiopaniego
posted
an
update
12 days ago
Post
1801
Google DeepMind releases FunctionGemma, a 240M model specialized in 🔧 tool calling, built for fine-tuning
TRL has day-0 support. To celebrate, we’re sharing 2 new resources:
> Colab guide to fine-tune it for 🌐 browser control with BrowserGym OpenEnv
> Standalone training script
> Colab notebook: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_functiongemma_browsergym_openenv.ipynb
> Training script: https://github.com/huggingface/trl/blob/main/examples/scripts/openenv/browsergym_llm.py (command to run it inside the script)
> More notebooks in TRL: https://huggingface.co/docs/trl/example_overview#notebooks
TRL has day-0 support. To celebrate, we’re sharing 2 new resources:
> Colab guide to fine-tune it for 🌐 browser control with BrowserGym OpenEnv
> Standalone training script
> Colab notebook: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_functiongemma_browsergym_openenv.ipynb
> Training script: https://github.com/huggingface/trl/blob/main/examples/scripts/openenv/browsergym_llm.py (command to run it inside the script)
> More notebooks in TRL: https://huggingface.co/docs/trl/example_overview#notebooks
akhaliq
submitted
a
paper
to Daily Papers
14 days ago
sergiopaniego
posted
an
update
15 days ago
sergiopaniego
posted
an
update
18 days ago
Post
2085
🎄 last talk of the year about open AI and HF today at Universidad Rey Juan Carlos for undergrad students
always a pleasure to be back at my alma mater
🎅 slides: https://github.com/sergiopaniego/talks
always a pleasure to be back at my alma mater
🎅 slides: https://github.com/sergiopaniego/talks
- 1 reply
akhaliq
submitted
a
paper
to Daily Papers
19 days ago
sergiopaniego
posted
an
update
19 days ago
Post
1666
TRL now includes agent training support for GRPO‼️
Train 🕵️ agents with 🔧 tools, enabling interaction with external functions and APIs.
And of course, a new notebook and scripts to get you up to speed
📘 notebook tutorial: https://github.com/huggingface/trl/blob/main/examples/notebooks/grpo_agent.ipynb
📂 script examples: https://github.com/huggingface/trl/blob/main/examples/scripts/grpo_agent.py
📦 TRL v0.26.0 release: https://github.com/huggingface/trl/releases/tag/v0.26.0
Train 🕵️ agents with 🔧 tools, enabling interaction with external functions and APIs.
And of course, a new notebook and scripts to get you up to speed
📘 notebook tutorial: https://github.com/huggingface/trl/blob/main/examples/notebooks/grpo_agent.ipynb
📂 script examples: https://github.com/huggingface/trl/blob/main/examples/scripts/grpo_agent.py
📦 TRL v0.26.0 release: https://github.com/huggingface/trl/releases/tag/v0.26.0
-
- 2 replies
sergiopaniego
posted
an
update
20 days ago
Post
2832
ICYMI, you can fine-tune open LLMs using Claude Code
just tell it:
“Fine-tune Qwen3-0.6B on open-r1/codeforces-cots”
and Claude submits a real training job on HF GPUs using TRL.
it handles everything:
> dataset validation
> GPU selection
> training + Trackio monitoring
> job submission + cost estimation
when it’s done, your model is on the Hub, ready to use
read more about the process: https://huggingface.co/blog/hf-skills-training
just tell it:
“Fine-tune Qwen3-0.6B on open-r1/codeforces-cots”
and Claude submits a real training job on HF GPUs using TRL.
it handles everything:
> dataset validation
> GPU selection
> training + Trackio monitoring
> job submission + cost estimation
when it’s done, your model is on the Hub, ready to use
read more about the process: https://huggingface.co/blog/hf-skills-training
- 1 reply
sergiopaniego
posted
an
update
20 days ago
Post
2261
We just released TRL v0.26.0!
It comes packed with updates:
> Agent training with tools in GRPO
> New CISPO & SAPO losses + reasoning rewards
> vLLM quantization in colocate mode
> Dataset shuffling in SFT
> Lots of NEW examples
> Tons of fixes and documentation improvements
It comes packed with updates:
> Agent training with tools in GRPO
> New CISPO & SAPO losses + reasoning rewards
> vLLM quantization in colocate mode
> Dataset shuffling in SFT
> Lots of NEW examples
> Tons of fixes and documentation improvements
-
- 3 replies
akhaliq
submitted
a
paper
to Daily Papers
21 days ago
sergiopaniego
posted
an
update
21 days ago
Post
2952
NEW:
@EssentialAI
just released Rnj-1, their first 8B model.
You can easily fine-tune it with GRPO using TRL to add reasoning capabilities to a compact mode
Free Colab link: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_rnj_1_instruct.ipynb
More free TRL notebooks: https://huggingface.co/docs/trl/main/en/example_overview#notebooks
You can easily fine-tune it with GRPO using TRL to add reasoning capabilities to a compact mode
Free Colab link: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_rnj_1_instruct.ipynb
More free TRL notebooks: https://huggingface.co/docs/trl/main/en/example_overview#notebooks
sergiopaniego
posted
an
update
25 days ago
Post
2856
Want to get started with fine-tuning but don’t know where to begin? 🤓☝️
We’re expanding our collection of beginner-friendly free Colab notebooks so you can learn and fine-tune models using TRL at no cost
🔬 Check out the full list of free notebooks: https://huggingface.co/docs/trl/main/en/example_overview#notebooks
🔬 If you want more advanced content, we also have a lot to cover in the community tutorials: https://huggingface.co/docs/trl/community_tutorials
And now the obvious question: what would you like us to add next?
We’re expanding our collection of beginner-friendly free Colab notebooks so you can learn and fine-tune models using TRL at no cost
🔬 Check out the full list of free notebooks: https://huggingface.co/docs/trl/main/en/example_overview#notebooks
🔬 If you want more advanced content, we also have a lot to cover in the community tutorials: https://huggingface.co/docs/trl/community_tutorials
And now the obvious question: what would you like us to add next?
sergiopaniego
posted
an
update
27 days ago
Post
2392
NEW:
@mistralai
released a fantastic family of multimodal models, Ministral 3.
You can fine-tune them for free on Colab using TRL ⚡️, supporting both SFT and GRPO
Link to the notebooks:
- SFT: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/sft_ministral3_vl.ipynb
- GRPO: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_ministral3_vl.ipynb
- TRL and more examples: https://huggingface.co/docs/trl/index
You can fine-tune them for free on Colab using TRL ⚡️, supporting both SFT and GRPO
Link to the notebooks:
- SFT: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/sft_ministral3_vl.ipynb
- GRPO: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/grpo_ministral3_vl.ipynb
- TRL and more examples: https://huggingface.co/docs/trl/index
-
- 2 replies
sergiopaniego
posted
an
update
28 days ago
Post
2211
ICYMI, transformers v5 is out!
Grab a coffee ☕ and go read the announcement blog https://huggingface.co/blog/transformers-v5
Grab a coffee ☕ and go read the announcement blog https://huggingface.co/blog/transformers-v5
sergiopaniego
posted
an
update
29 days ago
Post
3123
want to use open models easily through an API?
Inference Providers might be exactly what you’re looking for sooo here’s a complete beginner-friendly walkthrough 🧐
https://www.youtube.com/watch?v=oxwsizy1Spw
Inference Providers might be exactly what you’re looking for sooo here’s a complete beginner-friendly walkthrough 🧐
https://www.youtube.com/watch?v=oxwsizy1Spw
-
- 2 replies