What Nemotron-CC is
The dataset is a 6.3 trillion token collection that turns Common Crawl into a long-term pretraining set.
What you can do with it
- Use raw and synthetic tokens
- Choose a quality level and partition
- Download jsonl or parquet data
Application scenarios
- An 8B model is trained on the set
- A model is trained for 15T tokens
- Researchers study quality levels
Pros & cons
✓ What we like
- Quality levels and partitions are available
- Classifier ensembles and synthetic rewriting are used
! What to watch out for
- The dataset is tied to English Common Crawl
- Heuristic filter reliance is reduced, not removed
FAQ
How large is it?
The material states 6.3 trillion tokens.
Which formats?
jsonl and parquet are listed.
Last reviewed: 2026-11-15
More AI coding tools tools
View all →-
100 Vibe Coding Learn vibe coding by building Free tools Enterprise tools Developer tools API integration Coding -
10Web Prompt to WordPress site with hosting Free tools Developer tools No code development Coding Website builder -
16x Prompt Context management for AI coding Free tools Workflow automation Developer tools API integration Coding -
a0.dev Chat-built mobile apps to store Free tools Developer tools No code development Coding App builder -
Adalo No-code apps with a visual canvas Free tools Developer tools No code development Coding App builder -
AgentQL Natural language web data extraction Freemium tools Developer tools Browser extension Data extraction Coding