How Is AI VFX Used in Live-Action Film Production?
AI in film production does not always mean generating a scene from scratch.
Utopai Studios recently worked on a live action film, Half Moon. The performances were real, and the decisions on set still belonged to the director and cinematographer. AI came in later, on specific shots where production needed something more.
Shoot the Performance, Extend the Environment
The scene in Half Moon involved filming in open water around dusk. Shooting that literally means water, fading light, safety concerns, and the restrictions that come with filming in the ocean.. So the production captured the performance in a controlled pool instead.
The camera angle stayed intact. The performance stayed intact. AI VFX was used around it: removing the pool, extending the environment into open water, and adjusting the light to match the scene.
The practical gain is that a scene which is difficult to shoot safely can still be shot. The actor performs in a pool, and the open water arrives later.
Carsten Kurpanek, Head of Production at Utopai Studios, describes it as a workflow much closer to traditional VFX:
“You protect the camera angle and the performance 100%, and you’re applying visual effects elements like relighting and set extensions. You’re enhancing an existing shot.”
What Set Extension With AI VFX Actually Changes
Set extension and relighting with AI VFX means keeping the original plate and changing only what surrounds the performance. The production shoots the actor in a controlled or simplified environment, which protects the camera angle and the performance as filmed. The surroundings, the light, and anything the camera never captured are built afterwards in post. The director, actor, and cinematographer still determine the shot, and the AI work is applied to the parts of the frame the production did not need to photograph literally.
The director still directs the performance and the actor still performs it in a shot the DP determined. Nothing about the scene has to be invented. The plate comes from a real shoot, much like a conventional VFX workflow where CGI handles what the camera could not reach.
The standard for whether it works is the one any visual effects shot has to meet.
“When someone watches the movie, you don’t want them to get pulled out of it. It needs to be seamless with the other footage.”
The performance still matters, and so do the photography and the choices made on set. A production now has more ways to build the parts of the frame it could not photograph.
Explore how PAI by Utopai Studios can support hybrid production workflows, from extending live-action footage to creating new coverage in post: utopaistudios.com/pai
