Skip to content

MusePose

Turn a reference image into a pose-guided dance video

Visit official site

What MusePose is

The framework is described as an image-to-video framework developed by the Lyra Lab of Tencent Music Entertainment, using pose control signals to generate virtual character videos. It is stated to be the final building block of the Muse open-source series with MuseV and MuseTalk, built on a diffusion model and pose guidance for dance videos of a person in a reference image.

What you can do with it

  • Generate a dance video of a person in a reference image from a pose sequence
  • Align any dance video with a reference image through the pose alignment algorithm
  • Use code with bug fixes and improvements over Moore-AnimateAnyone
  • Enhance face regions with FaceFusion for better face consistency

Application scenarios

  • Game developers generate dynamic dance videos of game characters
  • Animation producers make character motions for short animated films
  • VR content creators add smooth motions to characters in virtual environments

Getting started

  • Install a Python environment and packages such as opencv, diffusers and mmcv
  • Download and prepare the pre-trained MusePose model and other component weights
  • Organise a reference image and a dance video in the example folders
  • Run pose alignment to obtain the aligned pose of the reference image

Pros & cons

✓ What we like

  • Bug fixes and improvements over the Moore-AnimateAnyone code base
  • Detailed installation tutorials and a training guide are provided

! What to watch out for

  • A pose alignment step is required before inference
  • Pre-trained model weights and component weights must be downloaded

FAQ

Who develops it?

The material names the Lyra Lab of Tencent Music Entertainment.

What does the pose alignment do?

The feature list states it aligns any dance video with a reference image to improve inference performance and usability.

Last reviewed: 2026-11-15

More AI video generation tools

View all →

How we review