Application for Lighting Reconstruction in Augmented Reality

Augmented reality applications are applications that allow a user to "add" a virtual object to the real world by looking at the real world through the device camera. The problem of restoring illumination of three-dimensional objects compatible with real-world frames first arose in cinematography, as soon as computer graphics became used to create special effects in films. The main case of this technology is that 3D models on a real frame stand out and seem not real, because the real frame and three-dimensional virtual scene are illuminated in different ways and the person easily notices the mind between these two elements of the final frame. In the modern film industry, this problem is solved using only computer graphics as decorations, and exposing the light on the actors after the graphics are rendered. But applications of augmented reality set a goal to insert a virtual object into a real-world frame, so in this case this approach is not applicable. In this paper, overview of the sources that illuminates the existing methods for solving this problem are presented, using light probes, HDR cameras, RGBD cameras, and cameras with a fish eye lens. Lighting is restored, by detecting shadows and restoring the environmental map. As a result, this work will include an application that approximates the lighting in a three-dimensional scene in real time. In addition, an overview of sources and private solutions will be made. Key words: augmented reality, lighting restoration.