The Synthetic Data Playbook: Generating Trillions of the Finest Tokens
📝
243
Explore synthetic data benchmarks with an interactive bookshelf
AI & ML interests
We release large pre-training datasets to accelerate open LLM development. Part of the Hugging Face Science team (hf.co/science)
Recent Activity
View all activity
Papers
FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language
The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale
joelniklaus
updated a
Space 3 days ago
Intrinsic quality evaluation of 3000 examples using LLM-as-judge
👍 1
9
#5 opened 2 months ago
by 
ratishsp
joelniklaus
published a
bucket 26 days ago
joelniklaus
updated a
bucket 26 days ago
joelniklaus
published a
bucket about 2 months ago
joelniklaus
updated a
bucket about 2 months ago
thomwolf
updated a
dataset about 2 months ago
joelniklaus
updated a
dataset 2 months ago
clefourrier
authored a
paper 3 months ago
error
2
#1 opened 3 months ago
by 
georgebassemfouad
joelniklaus
published a
Space 3 months ago
joelniklaus
updated 9
datasets 3 months ago
HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
Viewer • Updated • 56.1M • 2.64k
HuggingFaceFW/finepdfs_edu_50BT-dclm_30BT-fineweb_edu_20BT
Viewer • Updated • 56.1M • 6.58k
HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT-shuffled
Viewer • Updated • 62.1M • 628 • 3
HuggingFaceFW/finepdfs_50BT-dclm_30BT-fineweb_edu_20BT
Viewer • Updated • 62.1M • 2.91k • 1
HuggingFaceFW/finepdfs_edu_100BT-shuffled
Viewer • Updated • 17.8M • 765
HuggingFaceFW/finepdfs_edu_100BT
Viewer • Updated • 17.8M • 1.87k
HuggingFaceFW/finepdfs_100BT-shuffled
Viewer • Updated • 14.6M • 830
HuggingFaceFW/finepdfs_100BT
Viewer • Updated • 29.9M • 1.24k
HuggingFaceFW/fineweb_edu_100BT-shuffled
Viewer • Updated • 102M • 31.9k