Real-time Reflective and Refractive Novel-view Synthesis
Loading...
Date
2014
Journal Title
Journal ISSN
Volume Title
Publisher
The Eurographics Association
Abstract
We extend novel-view image synthesis from the common diffuse and opaque image formation model to the reflective and refractive case. Our approach uses a ray tree of RGBZ images, where each node contains one RGB light path which is to be warped differently depending on the depth Z and the type of path. Core of our approach are two efficient procedures for reflective and refractive warping. Different from the diffuse and opaque case, no simple direct solution exists for general geometry. Instead, a per-pixel optimization in combination with informed initial guesses warps an HD image with reflections and refractions in 18 ms on a current mobile GPU. The key application is latency avoidance in remote rendering in particular for head-mounted displays. Other applications are single-pass stereo or multi-view, motion blur and depth-of-field rendering as well as their combinations.
Description
@inproceedings{10.2312:vmv.20141270,
booktitle = {Vision, Modeling & Visualization},
editor = {Jan Bender and Arjan Kuijper and Tatiana von Landesberger and Holger Theisel and Philipp Urban},
title = {{Real-time Reflective and Refractive Novel-view Synthesis}},
author = {Lochmann, Gerrit and Reinert, Bernhard and Ritschel, Tobias and Müller, Stefan and Seidel, Hans-Peter},
year = {2014},
publisher = {The Eurographics Association},
ISBN = {978-3-905674-74-3},
DOI = {10.2312/vmv.20141270}
}