What stable-audio-controlnet is
The model is a music generation system built on Stable Audio Open with a DiT ControlNet fine-tune. It accepts audio conditions and is still under development.
Main features
- Fine-tuning of a ControlNet adapter
- Audio-conditioned training and generation
- Example code for training and inference
Pros & cons
✓ What we like
- Training and generation work across different GPU sizes
- Code examples for both training and inference are provided
! What to watch out for
- The model is still in development
- A GPU with 16GB VRAM is named for use
FAQ
What is it based on?
Stable Audio Open, fine-tuned with a DiT ControlNet.
How are conditions supplied?
Through a condition dictionary carrying audio and other conditions.
Last reviewed: 2026-11-15
More AI music creation tools
View all →-
A.V. Mapping Video-to-music matching tool Free tools Creator tools Audio Music generator -
ACE Studio AI vocal synthesis studio that turns MIDI and lyrics into sung tracks Free tools Creator tools Music generator Song generator Composition -
AI Hits Charts for AI-generated music Free tools Creator tools Audio Music generator -
AI Jingle Maker Branded jingles and station IDs Free tools Creator tools Voiceover Music generator Ad creative -
AI Make Song Text and lyrics to full songs Freemium tools Creator tools Music generator Text to music Song generator -
AI Music Maker Music suite plus vocal cloning Freemium tools Creator tools Music generator Song generator Music stem separation