Virtual Production Real-time 3D Artist - Film

Virtual production is analogous to traditional production. The main difference is that renders occur in real-time. Real-time is paving new, improved workflows for the film industry and bridging some gaps in the traditional production pipeline, allowing real-world and digital platforms to converge. It’s been adopted as a tool by filmmakers and content creators to visualize what they’d usually only be able to view in post-production at the pre-production and production stages.

Marc's latest captivating short film using Unreal Engine 5, 'Dark Nebula', inspired by Ridley Scott's Alien. Marc worked on all aspects of the production — from concept, script, and direction to world building, animation, and cameras — as part of the Real-time 3D & Virtual Production Course at CG Spectrum.

The LED volume is possibly the most recognized use of virtual production methods. A wall of LEDs (light-emitting diodes) display a real-time rendered 3D virtual environment that curves around physical sets, actors, and props. Through live camera tracking, the virtual camera within the game engine moves to match the physical on-set camera, shifting what’s displayed on the LED wall, like a shift in perspective. This synchrony between camera and imagery creates parallax, helping to create the illusion that the real and virtual elements reside in the same space. Lucasfilm’s The Mandalorian is a well-known example of a production that used virtual production on set.

Real-time artists focus on content or asset creation in a real-time environment such as a game engine, often working on a project from concept to completion. They are also responsible for maintaining visuals in both quality and optimization — from entire environments down to small 3D props, known as assets.

Role & responsibilities of a real-time artist in virtual production for film and TV:

• Mockup concepts and adjust as directed
• Work with the Director and Real-time team to design interactive experiences using a game engine
• World building (create and layout assets in a real-time engine)
• Light scenes for a better cinematic experience
• Optimize content through profiling and enhancing performance with the help of diagnostic tools 
• Collaborate with programmers to develop and test new features, prototype shader code, and provide useful feedback during R&D phases.

When starting in this competitive field, you’ll need to focus on learning technical tools and be proficient in a game engine such as Unreal or Unity, which often also involves some coding.

Film studios may look for the following skills in a real-time artist for film:

• Experience in a real-time engine
• Real-time ready asset creation (props, characters, etc.)
• Texture/Shader knowledge 
• An understanding of animation, animation rigs, and anatomy
• Scripting languages like MEL, Python, C#, and Javascript are useful
• A general understanding of cameras and how changing their values will contribute to how you might block, light, and shoot a scene.
• Basic knowledge of film production processes (e.g., scripts, concepts, sets, storyboards) and the production pipeline.