Hugging Face's logo

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up

All HF Hub posts
danielhanchen 
posted an update 1 day ago
view post
Post
1884
Kimi K3 can now be run locally! ✨

The 1-bit model retains ~78.9% accuracy after we shrunk it from 1.56TB to 594GB (-62% size).

Run on a Mac Studio connected with 128GB RAM device. Kimi K3 is the strongest open model to date.

GGUF: unsloth/Kimi-K3-GGUF
Guide: https://unsloth.ai/docs/models/kimi-k3
  • 2 replies
·
julien-c 
posted an update 2 days ago
view post
Post
3682
who's working on an NVFP4 version of Kimi-K3?
  • 4 replies
·
FredyRivera-dev 
posted an update 3 days ago
view post
Post
6177
We wrote a full technical guide on how to train a bilingual (ES/EN) LLM from scratch: TinyQwen.

Covers:
- Hybrid architecture based on Qwen3.5
- Pre-training with 15B tokens
- Cost benchmark between H200 and B200
- Post-training with SFT + LoRA
- Full code and data, open source

With ~$11 of compute on an H200 we ran an initial training run, enough to validate the full architecture and pipeline.

Blog post: https://aquiles-ai.vercel.app/blog/tinyqwen-from-scratch

Technical feedback welcome, especially from anyone looking to replicate the pipeline with more compute.
  • 3 replies
·
Enderchef 
posted an update 2 days ago
view post
Post
3875
Introducing GCI-Bench, Glint Research's first benchmark!

This 5000-question bench benchmarks attention and gradients; it gives a prompt and unrelated filler parts. The goal is to benchmark if the model understands and attends to the important parts more than the unimportant parts.

I've already benchmarked on the top 5 models on our Leaderboard(Glint2, Supra 50M, Glint1.3, GPT S 5M, GPT X2 125M)
Pending benchmark status at OpenEvals/README#2


Glint-Research/GCI_Bench
  • 4 replies
·
Banaxi-Tech 
posted an update 1 day ago
view post
Post
2253
Our preview of BananaMind 2 Pro will release on August 3.
Before we do that we want to hit a goal
Lets get 150 followers on my account and 75 on BananaMind!
Me: @Banaxi-Tech
BananaMind:
BananaMind
Full Release on August 10-14
Would really appreciate it!
  • 1 reply
·
appvoid 
posted an update 3 days ago
view post
Post
1272
A Small Model is All You Need. Meet palmer-006 (90M)

After 3 years of experiments, we are finally releasing our flagship tiny model: **palmer-006**.

If you are building for edge hardware, SBCs (Raspberry Pi, etc.), or low-power devices, this is for you. Inspired by Andrej Karpathy's idea of a self-contained "cognitive core," we wanted to see how much power we could pack into a sub-100M parameter footprint.

🧠 **How we "Palmerized" it:**
We believe in starting our experiments with the absolute strongest baseline possible.
1. Light fine-tuning on highly curated data
2. Model merging
3. Another light fine-tuning round
4. Adjusted Mamba for maximum token speed ⚡️

⚠️ *Note: This is a foundational language model. It has not been instruction-tuned yet!*

Also, since this needs instruction tuning next to become a chat assistant—**what dataset would you recommend we use for the instruct tune?**

---
🔗 **Quick Links & Info:**

* **License:** Open for research, education, hobby, and modification! (For commercial use/hosted APIs, shoot an email to nosoyhackercodigo@gmail.com. *PS: Donators can claim a free commercial license!*)

* **Attribution:** Built using AI tech from the Technology Innovation Institute (TII).

Can't wait to see what you build at the edge. Let me know your prompt completions below! 👇

appvoid/palmer-006
  • 10 replies
·
sergiopaniego 
posted an update 3 days ago
view post
Post
2805
quick reminder! 🚨

tomorrow (Tuesday, July 28), we're back with Class 3 of the Training Agents live series

🧠 what: reinforcement learning for training agents (GRPO): how it works, how to implement it in TRL, and end-to-end examples
🗓️ when: Tuesday, July 28 - 🕔 5:00 PM CEST / 8:30 PM IST
📍 where: Live on @huggingface 's X, YouTube, and LinkedIn

live: https://www.youtube.com/watch?v=ztdTed5egrM

class 1: https://x.com/SergioPaniego/status/2069382207618379813
class 2: https://x.com/SergioPaniego/status/2075180665184686187
  • 1 reply
·
vovaRL 
posted an update 1 day ago
Banaxi-Tech 
posted an update 3 days ago
view post
Post
7852
BananaMind 2 Pro is training!
The current checkpoint (ONLY 20% DONE) GETS #6 On the entire Open SLM Leaderboard.
We are going to release the first public preview on August 2-4 (estimated from speed)

Give us a follow to know when it releases!
  • 4 replies
·
Banaxi-Tech 
posted an update about 8 hours ago
view post
Post
418
We're announcing BananaMind 2 Micro, our smallest model in the BananaMind 2 model family.
This model is not released yet, training has not started yet.
It uses only 2.9M parameters, while being overtrained on 75B tokens to get the maximum intelligence per parameter.
The key changes are:
No more AdamW, the model will use the Muon optimizer offering up to 2x faster convergence and higher lr.
LR goes to 2.2e-2.
We're adding the XSA refresh gate from the TX4 architecture into our own.
Training will start on August 3, release date is estimated to be August 4-6.
On August 3 we will also release our Public Preview of BananaMind 2 Pro.
Follow us to know when our models release
BananaMind
@Banaxi-Tech
  • 1 reply
·
Recently active users