Category AI models
What Spirit LM is
The model is described as a foundational multimodal language model that mixes text and speech in a single token stream, trained by word-level interleaving.
What you can do with it
- Feed text and speech into one sequence
- Use phoneme units in the Base version
- Add pitch and style units in the Expressive version
Getting started
- Read the GitHub page or the paper
- Choose a version and download its weights
- Prepare a parallel speech-text corpus
Pros & cons
✓ What we like
- Text semantics and speech expression are both stated
- New tasks can be learned from few examples
! What to watch out for
- Two versions are described with different units
- The stated base is a 7B text model
FAQ
What are the two versions?
The material names a Base version with phoneme units and an Expressive version with pitch and style units.
Which tasks are named?
ASR, TTS and speech classification are named as cross-modal tasks.
Last reviewed: 2026-11-15
More LLM API platform tools
View all →-
302.AI Aggregated cloud platform that hosts hundreds of large models behind one API Developer tools API integration Multi model platform Model deployment LLM API platform -
360智脑开放平台 360 model API platform API integration Multi model platform Knowledge base Q&A Enterprise automation LLM API platform -
4o Image API Image generation API gateway Free tools Freemium tools Developer tools API integration LLM API platform -
AI-Flow No-code multi-model workflows Workflow automation Developer tools API integration Knowledge base Q&A LLM API platform -
AI/ML API Single gateway to many models Developer tools API integration Multimodal Multi model platform LLM API platform -
Amazon Bedrock AWS code suggestions with security scans Free tools Code assistant IDE App builder LLM API platform