Category AI music generation
What Make-An-Audio 2 is
The technique is described as a diffusion model that turns text into audio with help from pre-trained large language models.
What you can do with it
- Parse input text with a pre-trained LLM
- Learn semantic alignment with a structured encoder
- Generate audio through the diffusion denoiser
技術の要点
- A feed forward Transformer denoiser handles variable length audio
- LLMs convert audio label data into an audio text set
- Time information is drawn from the parsed text
Pros & cons
✓ What we like
- Variable length audio generation is addressed by the denoiser
- LLMs are used to ease the shortage of temporal data
! What to watch out for
- The described input is natural language text
- The generation flow runs through several encoder stages
FAQ
Who developed it?
The material names researchers from Zhejiang University, ByteDance and the Chinese University of Hong Kong.
What does the structured encoder do?
The feature list says it helps learn semantic alignment in the denoising process.
Last reviewed: 2026-11-15
More AI music creation tools
View all →-
A.V. Mapping Video-to-music matching tool Free tools Creator tools Audio Music generator -
ACE Studio AI vocal synthesis studio that turns MIDI and lyrics into sung tracks Free tools Creator tools Music generator Song generator Composition -
AI Hits Charts for AI-generated music Free tools Creator tools Audio Music generator -
AI Jingle Maker Branded jingles and station IDs Free tools Creator tools Voiceover Music generator Ad creative -
AI Make Song Text and lyrics to full songs Freemium tools Creator tools Music generator Text to music Song generator -
AI Music Maker Music suite plus vocal cloning Freemium tools Creator tools Music generator Song generator Music stem separation