Jason Lawrence
Wojciech Matusik
Hanspeter Pfister
Szymon Rusinkiewicz
Abstract
Recent progress in the measurement of surface reflectance has created a demand for non-parametric appearance representations that are accurate, compact, and easy to use for rendering. Another crucial goal, which has so far received little attention, is editability: for practical use, we must be able to change both the directional and spatial behavior of surface reflectance (e.g., making one material shinier, another more anisotropic, and changing the spatial "texture maps" indicating where each material appears). We introduce an Inverse Shade Tree framework that provides a general approach to estimating the "leaves" of a user-specified shade tree from high-dimensional measured datasets of appearance. These leaves are sampled 1- and 2-dimensional functions that capture both the directional behavior of individual materials and their spatial mixing patterns. In order to compute these shade trees automatically, we map the problem to matrix factorization and introduce a flexible new algorithm that allows for constraints such as non-negativity, sparsity, and energy conservation. Although we cannot infer every type of shade tree, we demonstrate the ability to reduce multi-gigabyte measured datasets of the Spatially-Varying Bidirectional Reflectance Distribution Function (SVBRDF) into a compact representation that may be edited in real time.
Supplemental Material
- Ashikhmin, M., Premože, S., and Shirley, P. 2000. A microfacet-based BRDF generator. In Proceedings of ACM SIGGRAPH 2000. Google Scholar
Digital Library
- Chen, W.-C., Bouguet, J.-Y., Chu, M. H., and Grzeszczuk, R. 2002. Light field mapping: efficient representation and hardware rendering of surface light fields. In ACM Transactions on Graphics (SIGGRAPH 2002). Google ScholarDigital Library
- Cook, R. L. 1984. Shade trees. In Computer Graphics (Proceedings of ACM SIGGRAPH 1984), 223--231. Google ScholarDigital Library
- Dana, K., van Ginneken, B., Nayar, S., and Koenderink, J. 1999. Reflectance and texture of real-world surfaces. ACM Transactions on Graphics 18, 1, 1--34. Google ScholarDigital Library
- Furukawa, R., Kawasaki, H., Ikeuchi, K., and Sakauchi, M. 2002. Appearance based object modeling using texture database: acquisition, compression and rendering. In Eurographics Workshop on Rendering, 257--266. Google ScholarDigital Library
- Gardner, A., Tchou, C., Hawkins, T., and Debevec, P. 2003. Linear light source reflectometry. ACM Transactions on Graphics (SIGGRAPH 2003) 22, 3, 749--758. Google ScholarDigital Library
- Gill, P., Murray, W., Saunders, M., and Wright, M. 1984. Procedures for optimization problems with a mixture of bounds and general linear constraints. In ACM Transactions on Mathematical Software. Google ScholarDigital Library
- Goldman, D. B., Curless, B., Hertzmann, A., and Seitz, S. M. 2005. Shape and spatially-varying BRDFs from photometric stereo. In IEEE International Conference on Computer Vision. Google ScholarDigital Library
- Gortler, S., Grzeszczuk, R., Szeliski, R., and Cohen, M. 1996. The lumigraph. In Proceedings of ACM SIGGRAPH 1996. Google ScholarDigital Library
- Han, J. Y., and Perlin, K. 2003. Measuring bidirectional texture reflectance with a kaleidoscope. ACM Transactions on Graphics (SIGGRAPH 2003) 22, 3, 741--748. Google ScholarDigital Library
- Hartigan, J. A., and Wong, M. A. 1979. A k-means clustering algorithm. Applied Statistics 28, 100--108.Google ScholarCross Ref
- Heidrich, W., and Seidel, H.-P. 1999. Realistic, hardware-accelerated shading and lighting. In Proceedings of ACM SIGGRAPH 1999. Google ScholarDigital Library
- Hofmann, T. 1999. Probabilistic latent semantic analysis. In Proceedings of Uncertainty in Artificial Intelligence. Google ScholarDigital Library
- Hoyer, P. O. 2002. Non-negative sparse coding. In IEEE Workshop on Neural Networks for Signal Processing, 557--565.Google ScholarCross Ref
- Jaroszkiewicz, R., and McCool, M. D. 2003. Fast extraction of BRDFs and material maps from images. In Graphcs Interface.Google Scholar
- Kautz, J., and McCool, M. 1999. Interactive rendering with arbitrary BRDFs using separable approximations. In Eurographics Workshop on Rendering, 247--260. Google ScholarDigital Library
- Lafortune, E. P. F., Foo, S.-C., Torrance, K. E., and Green-Berg, D. P. 1997. Non-linear approximation of reflectance functions. In Proceedings of ACM SIGGRAPH 1997, 117--126. Google ScholarDigital Library
- Lawrence, J., Rusinkiewicz, S., and Ramamoorthi, R. 2004. Efficient BRDF importance sampling using a factored representation. ACM Transactions on Graphics (SIGGRAPH 2004) 23, 3. Google ScholarDigital Library
- Lee, D., and Seung, H. S. 2000. Algorithms for non-negative matrix factorization. In Proceedings of Neural Information Processing Systems, 556--562.Google Scholar
- Lensch, H. P. A., Kautz, J., Goesele, M., Heidrich, W., and Seidel, H.-P. 2003. Image-based reconstruction of spatial appearance and geometric detail. ACM Transactions on Graphics 22, 2. Google ScholarDigital Library
- Leung, T., and Malik, J. 2001. Representing and recognizing the visual appearance of materials using three-dimensional textons. International Journal of Computer Vision 43, 1, 29--44. Google ScholarDigital Library
- Marschner, S., Westin, S., Lafortune, E., Torrance, K., and Greenberg, D. 1999. Image-Based BRDF measurement including human skin. In Eurographics Workshop on Rendering, 139--152. Google ScholarDigital Library
- Marschner, S. R., Westin, S. H., Arbree, A., and Moon, J. T. 2005. Measuring and modeling the appearance of finished wood. ACM Transactions on Graphics (SIGGRAPH 2005) 24, 3, 727--734. Google ScholarDigital Library
- Matusik, W., Pfister, H., Brand, M., and McMillan, L. 2003. A data-driven reflectance model. ACM Transactions on Graphics (SIGGRAPH 2003) 22, 3, 759--769. Google ScholarDigital Library
- McAllister, D. 2002. A Generalized Surface Appearance Representation for Computer Graphics. PhD thesis, UNC. Google ScholarDigital Library
- McCool, M. D., Ang, J., and Ahmad, A. 2001. Homomorphic factorization of BRDFs for high-performance rendering. In Proceedings of ACM SIGGRAPH 2001, 185--194. Google ScholarDigital Library
- Nag, 2005. Numerical Algorithms Group C Library.Google Scholar
- Ngan, A., Durand, F., and Matusik, W. 2005. Experimental analysis of BRDF models. In Proceedings of the Eurographics Symposium on Rendering, 117--226. Google ScholarDigital Library
- Olshausen, B. A., and Field, D. J. 2002. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381, 607--609.Google ScholarCross Ref
- Peers, P., Vom Berge, K., Matusik, W., Ramamoorthi, R., Lawrence, J., Rusinkiewicz, S., and Dutré, P. 2006. A compact factored representation of heterogeneous subsurface scattering. ACM Transactions on Graphics (SIGGRAPH 2006) 25, 3. Google ScholarDigital Library
- Rusinkiewicz, S. 1998. A new change of variables for efficient BRDF representation. In Eurographics Workshop on Rendering, 11--22.Google ScholarCross Ref
- Tsumura, N., Ojima, N., Sato, K., Shiraishi, M., Shimizu, H., Nabeshima, H., Akazaki, S., Hori, K., and Miyake, Y. 2003. Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin. ACM Transactions on Graphics (SIGGRAPH 2003) 22, 3, 770--779. Google ScholarDigital Library
- Vasilescu, M. A., and Terzopoulos, D. 2004. TensorTextures: Multilinear image-based rendering. ACM Transactions on Graphics (SIGGRAPH 2004) 23, 3. Google ScholarDigital Library
- Ward, G. J. 1992. Measuring and modeling anisotropic reflection. In Computer Graphics (Proceedings of ACM SIGGRAPH 1992), 265--272. Google ScholarDigital Library
Index Terms
- Inverse shade trees for non-parametric material representation and editing
Recommendations
A data-driven reflectance model
We present a generative model for isotropic bidirectional reflectance distribution functions (BRDFs) based on acquired reflectance data. Instead of using analytical reflectance models, we represent each BRDF as a dense set of measurements. This allows ...
Inverse shade trees for non-parametric material representation and editing
SIGGRAPH '06: ACM SIGGRAPH 2006 PapersRecent progress in the measurement of surface reflectance has created a demand for non-parametric appearance representations that are accurate, compact, and easy to use for rendering. Another crucial goal, which has so far received little attention, is ...
A scalable framework for image-based material representations
Web3D '12: Proceedings of the 17th International Conference on 3D Web TechnologyComplex material-light interaction is modeled mathematically in its most basic form through the 4D BRDF or the 6D spatially varying BRDF. To alleviate the overhead of calculating correct shading with a complex BRDF consisting of many parameters, many ...
Comments