Category AI models
Tags AI Models
What Yuan2-M32-hf-int4 is
The model is described as a mixture-of-experts language model that uses an attention router to pick experts efficiently.
What you can do with it
- Start the container with the recommended docker image
- Preprocess data according to the documentation
- Run pretraining scripts and deploy with vllm
Pros & cons
✓ What we like
- Only 0.37 billion of 4 billion parameters are active
- MATH and ARC-Challenge results exceed Llama3-70B
! What to watch out for
- The licence and setup target technical users
- Deployment follows the vllm deployment plan
FAQ
How many experts are active?
Two of the 32 experts are active.
What is the training data size?
200 billion tokens from scratch training.
Last reviewed: 2026-11-15
More LLM API platform tools
View all →-
302.AI Aggregated cloud platform that hosts hundreds of large models behind one API Developer tools API integration Multi model platform Model deployment LLM API platform -
360智脑开放平台 360 model API platform API integration Multi model platform Knowledge base Q&A Enterprise automation LLM API platform -
4o Image API Image generation API gateway Free tools Freemium tools Developer tools API integration LLM API platform -
AI-Flow No-code multi-model workflows Workflow automation Developer tools API integration Knowledge base Q&A LLM API platform -
AI/ML API Single gateway to many models Developer tools API integration Multimodal Multi model platform LLM API platform -
Amazon Bedrock AWS code suggestions with security scans Free tools Code assistant IDE App builder LLM API platform