In a blog posted by Nikola Todorovic, Co-Founder of Wonder Dynamics (an Autodesk company), the industry was introduced to a new tool that uses artificial intelligence to generate 3D scenes from live-action video footage.
“The most innovative part of Wonder Animation’s ‘Video to 3D Scene’ technology is its ability to film and edit sequences with multiple cuts and various shots (wide, medium, close-ups). The technology then uses AI to reconstruct the scene in a 3D space and matches the position and movement of each camera’s relationship to the characters and environment,” Todorovic explains in the post.
“This essentially creates a virtual representation of an artist’s live-action scene containing all camera setups and character body and face animation in one 3D scene, with fully editable elements (animation, character, environment, lighting and camera tracking data) in their preferred software, such as Maya, Blender or Unreal.”
The beta for this Wonder Animation technology has launched today for Wonder Studio users, just five months since Autodesk acquired Wonder Dynamics.
In response to concerns about the impact of generative AI on artists’ jobs within the animation community, Todorovic asserts:
“Even though there have been tremendous advancements in AI, there is a current misconception that AI is a one click solution — but we know that’s not the case. Wonder Animation underscores our focus on bringing the artist one step closer to producing fully animated films while ensuring they retain full creative control. Unlike the black-box approach of most generative AI tools currently on the market, we’re empowering artists to shape their vision instead of just relying on automated outputs.”
Learn more at autodesk.com/solutions/wonder-dynamics. Access Wonder Dynamics tools using the app.
