Lucy 2.5 – Real-Time Video Compositing and Editing
The idea itself isn’t exactly new—we’ve already seen similar approaches in LivePortrait, InfiniteTalk, and, of course, Kling’s Motion Control.
You upload an image of a character, take a video of yourself (or a more talented actor) performing in front of the camera, and your character instantly mimics those movements. In the 3D world, this is called retargeting.
But here’s the exciting part:
Everything happens in real time.
Just load an image, turn on your webcam, and start streaming at 24–30 FPS with minimal latency. The developers claim near-zero latency, although in real-world conditions, once internet transmission is factored in, I’d expect around 1–2 seconds of delay.
The idea itself isn’t exactly new—we’ve already seen similar approaches in LivePortrait, InfiniteTalk, and, of course, Kling’s Motion Control.
You upload an image of a character, take a video of yourself (or a more talented actor) performing in front of the camera, and your character instantly mimics those movements. In the 3D world, this is called retargeting.
But here’s the exciting part:
Everything happens in real time.
Just load an image, turn on your webcam, and start streaming at 24–30 FPS with minimal latency. The developers claim near-zero latency, although in real-world conditions, once internet transmission is factored in, I’d expect around 1–2 seconds of delay.