Light field fechnology for film production
From 2014 to 2015 we realised a proof of concept research project with light filed technology. The aim of the project was to implement a light field array into a professional film production, to develop and test efficient workflows and to discuss aesthetical, technical and economical aspects of various use cases.
The Stuttgart Media University cooperated with the Frauenhofer IIS at Erlangen which has developed a nine cameras-prototype array. It provided data on illuminance, direction of light and dispersion appropriate to light field technology. Based on this data depth maps and normals maps icould be rendered with computational photography algorithms. Apply these data an enormous extension of aesthetical opportunites and new fields of applications could be achieved e.g.: rendering of virtual focal planes and depth of field, as well as stereo views, depth maps, normal maps, autostereoscopy and super-resolution.
The research project light field videography includes: Improvement of the algorithms used for computing dense fields, programming of plugins for the compositing software NUKE, workflow optimization for various use cases in film productions.
The research group at HdM creates visual concepts for adequate scenes and realizes them in a professional studio environment. The tended goal of producing a light field short movie was to proof that light field technology can be used in a professional movie production environment using adapted workflows.
In addition the resulting short film Coming Home features light field scenes with various applications, such as virtual focus, view rendering, depth based grading and depth based matte extractios. The short film was presented at NAB 2015 in Las Vegas. The project was completed with the publication of the paper "Multi-camera system for depth based visual effects and compositing" presented at CVMP in 2015.
Coming Home - First Live-Action Light-Field Movie
Breakdown Coming Home - First Live-Action Light-Field Movie