Skip to content

Stable Audio ControlNet

Music generation with audio-conditioned ControlNet

Visit official site

What stable-audio-controlnet is

The model is a music generation system built on Stable Audio Open with a DiT ControlNet fine-tune. It accepts audio conditions and is still under development.

Main features

  • Fine-tuning of a ControlNet adapter
  • Audio-conditioned training and generation
  • Example code for training and inference

Pros & cons

✓ What we like

  • Training and generation work across different GPU sizes
  • Code examples for both training and inference are provided

! What to watch out for

  • The model is still in development
  • A GPU with 16GB VRAM is named for use

FAQ

What is it based on?

Stable Audio Open, fine-tuned with a DiT ControlNet.

How are conditions supplied?

Through a condition dictionary carrying audio and other conditions.

Last reviewed: 2026-11-15

More AI music creation tools

View all →

How we review