Category AI avatar generation
Tags Text to image
What audio2photoreal is
The project is described as an open-source PyTorch implementation that synthesises photorealistic human figures in conversation from audio. The project lets researchers and developers train their own models for speech-driven avatar synthesis.
What you can do with it
- Generate lifelike human avatars from audio
- Use the provided pretrained models and dataset access
- Work with the included face and body models
- Render realistic avatars from speech input
Model notes
- A face diffusion model is included
- A body diffusion model is included
- A body VQ VAE model is included
- A body guidance transformer model is included
Example uses
- Train a model on collected speech data for a custom avatar
- Synthesise a virtual figure from historical speech material
- Fit character voice work into 3D games and virtual spaces
Pros & cons
✓ What we like
- Training and test code are both provided
- The PyTorch implementation is open source
! What to watch out for
- Avatar rendering is driven by audio input
- Training your own model uses the provided codebase
FAQ
What does the project generate?
The material describes photorealistic human avatars in conversation synthesised from audio.
What models are included?
A face diffusion model, a body diffusion model, a body VQ VAE model and a body guidance transformer are listed.
Last reviewed: 2026-11-15
More AI image generation tools
View all →-
123RF Stock library with integrated AI image tools Free tools Text to image Image editing Background remover Image upscaler -
360智图 Image search, licensing and AI editing from 360 Free tools Text to image Background remover Product image Model generator -
360鸿图 Image generation aimed at Chinese-speaking users, with prompts written in Chinese Free tools Creator tools Text to image Art generator Image to image -
a1.art Filter-driven image generation with face swap Free tools Creator tools Text to image Art generator -
AI Anime Generator Photos and text into anime-style art Freemium tools Creator tools Text to image Image to image Image to video -
AI Art Generator Text prompts into original artwork drafts Freemium tools Creator tools Text to image Image editing Art generator