What MusePose is
The framework is described as an image-to-video framework developed by the Lyra Lab of Tencent Music Entertainment, using pose control signals to generate virtual character videos. It is stated to be the final building block of the Muse open-source series with MuseV and MuseTalk, built on a diffusion model and pose guidance for dance videos of a person in a reference image.
What you can do with it
- Generate a dance video of a person in a reference image from a pose sequence
- Align any dance video with a reference image through the pose alignment algorithm
- Use code with bug fixes and improvements over Moore-AnimateAnyone
- Enhance face regions with FaceFusion for better face consistency
Application scenarios
- Game developers generate dynamic dance videos of game characters
- Animation producers make character motions for short animated films
- VR content creators add smooth motions to characters in virtual environments
Getting started
- Install a Python environment and packages such as opencv, diffusers and mmcv
- Download and prepare the pre-trained MusePose model and other component weights
- Organise a reference image and a dance video in the example folders
- Run pose alignment to obtain the aligned pose of the reference image
Pros & cons
✓ What we like
- Bug fixes and improvements over the Moore-AnimateAnyone code base
- Detailed installation tutorials and a training guide are provided
! What to watch out for
- A pose alignment step is required before inference
- Pre-trained model weights and component weights must be downloaded
FAQ
Who develops it?
The material names the Lyra Lab of Tencent Music Entertainment.
What does the pose alignment do?
The feature list states it aligns any dance video with a reference image to improve inference performance and usability.
Last reviewed: 2026-11-15
More AI video generation tools
View all →-
1703 Faceless YouTube videos produced quickly Free tools Creator tools Video generator Talking avatar -
A2E Digital human videos with voice cloning Video generator Image to video Lip sync video Digital human Voice cloning -
A9 Builds short marketing clips from assets a brand already has Free tools Video generator Short video -
Adobe Firefly Video Generates clips from text or images and translates them across languages Free tools Video generator Text to video Image to video Design tool -
Adpex Video, image and code tools in one web app Free tools Multi model platform Image editing Video generator Coding -
AdsTurbo Video ad variants for paid social Video generator Short video Video Ads Video translation Ad creative