This project establishes a premium, bespoke Volumetric Production and Playback Ecosystem designed for a private residential setting. The objective is to record real-world actors, environments, and multi-channel audio on a dedicated capture set, convert that data into a true 4D time-evolving holographic format, and play it back seamlessly on a massive, glasses-free light field display.
The resulting experience allows viewers to move around a living room and watch captured human performances with real physical depth. Moving your head left or right reveals hidden angles of the actors and physical sets, exactly as if looking through a portal into a live physical performance.
To achieve studio-quality recording and flawless holographic playback, the system splits into two distinct hardware loops: the Capture Stage and the Living Room Theater.
The core of successful volumetric generation depends entirely on microscopic timing synchronization across the entire multi-camera array.
The entire workflow is driven by a custom software pipeline built directly on top of industrial media frameworks, handling data compression, timing alignment, and real-time light field projection.
Driven natively by TouchDesigner, the software ingest layer pulls synchronous high-resolution RGB color maps and 32-bit Depth maps from the camera array simultaneously.
TouchDesigner acts as the unified system timeline clock, locking the incoming Dante studio audio directly to the visual depth-frames to ensure zero lip-sync drift during extended performance recording sequences.