Thrilled to announce the publication of our new open-access book chapter! "Augmented Reality for Lighting Adjustment in a Virtual Studio" by Maja Michaelis and Jens Herder is now available ONLINE FIRST on IntechOpen: https://www.intechopen.com/online-first/1219066
This work presents an Augmented Reality Lighting Adjustment System that lets a single operator control and synchronize real and virtual studio lighting directly on set using a Meta Quest Pro HMD. No more running between the studio floor and the control room!
Key highlights:
- Real-time control of physical lights via Art-Net and virtual lights in the render engine
- Digital-twin approach with virtual proxies for every real fixture
- Eye-tracking + pinch selection and hand-anchored menus for intuitive interaction
- Live NDI video feeds and Ultimate chroma keyer control inside the headset
- Full integration with Vizrt tools: Viz Artist (scene design & rendering), Viz Arc (virtual set control), and NDI for video streams
A huge thank you to Vizrt Austria GmbH for continuously supporting the Virtual Studio at Hochschule Düsseldorf University of Applied Sciences since 2009! This long-term partnership makes innovative research like this possible.
Read the chapter (free PDF download) and watch the prototype demo here: