ByteDance said that, unlike some deepfake models that can animate only faces or upper bodies, its OmniHuman-1 could generate realistic full-body animations that sync gestures and facial expressions with speech or music.

A technical paper (reviewed by the South China Morning Post) highlights that OmniHuman-1 specialises in generating videos of individuals speaking, singing, and moving. The research team behind the model claims that its performance surpasses existing AI tools that generate human videos based on audio.

ByteDance has come up with a generative AI framework that can create highly realistic videos of a human based on a single image and motion signal.