Daniel Sýkora
Martin Čadík
Olga Sorkine-Hornung
Skip Abstract Section
Skip Supplemental Material SectionAbstract
We present a new approach for generating global illumination renderings of hand-drawn characters using only a small set of simple annotations. Our system exploits the concept of bas-relief sculptures, making it possible to generate 3D proxies suitable for rendering without requiring side-views or extensive user input. We formulate an optimization process that automatically constructs approximate geometry sufficient to evoke the impression of a consistent 3D shape. The resulting renders provide the richer stylization capabilities of 3D global illumination while still retaining the 2D hand-drawn look-and-feel. We demonstrate our approach on a varied set of hand-drawn images and animations, showing that even in comparison to ground-truth renderings of full 3D objects, our bas-relief approximation is able to produce convincing global illumination effects, including self-shadowing, glossy reflections, and diffuse color bleeding.
Supplemental Material
Available for Download
zip
sykora.zip (62.2 MB)
Supplemental movie and image files for, Ink-and-ray: Bas-relief meshes for adding global illumination effects to hand-drawn characters
- E. D. Andersen and K. D. Andersen. 2000. The Mosek interior point optimizer for linear programming: An implementation of the homogeneous algorithm. In High Performance Optimization, Kluwer Academic Publishers, 197--232.Google Scholar
- J. Andrews, P. Joshi, and N. A. Carr. 2011. A linear variational system for modelling from curves. Comput. Graph. Forum 30, 6, 1850--1861.Google ScholarCross Ref
- P. N. Belhumeur, D. J. Kriegman, and A. L. Yuille. 1999. The bas-relief ambiguity. Int. J. Comput. Vis. 35, 1, 33--44 Google ScholarDigital Library
- B.-Y. Chen, Y. Ono, and T. Nishita. 2005. Character animation creation using hand-drawn sketches. Vis. Comput. 21, 8--10, 551--558.Google ScholarCross Ref
- F. Cole, P. Isola, W. T. Freeman, F. Durand, and E. H. Adelson. 2012. Shapecollage: Occlusion-aware, example-based shape interpretation. In Proceedings of the European Conference on Computer Vision. 665--678. Google ScholarDigital Library
- H. A. David. 1988. The Method of Paired Comparisons 2nd Ed. Oxford University Press.Google Scholar
- D. Geiger, H.-K. Pao, and N. Rubin. 1998. Salient and multiple illusory surfaces. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 118--124. Google ScholarDigital Library
- Y. Gingold, T. Igarashi, and D. Zorin. 2009. Structured annotations for 2D-to-3D modeling. ACM Trans. Graph. 28, 5. Google ScholarDigital Library
- Y. Hochberg and A. C. Tamhane. 1987. Multiple Comparison Procedures 1st Ed. Wiley. Google ScholarDigital Library
- T. Igarashi, S. Matsuoka, and H. Tanaka. 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques. 409--416. Google ScholarDigital Library
- O. Jamriška, D. Sýkora, and A. Hornung. 2012. Cache-efficient graph cuts on structured grids. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (SIGGRAPH'12). 3673--3680. Google ScholarDigital Library
- S. Jeschke, D. Cline, and P. Wonka. 2009. A GPU laplacian solver for diffusion curves and poisson image editing. ACM Trans. Graphics 28, 5, 116. Google ScholarDigital Library
- S. F. Johnston. 2002. Lumo: Illumination for cel animation. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 45--52. Google ScholarDigital Library
- P. Joshi and N. A. Carr. 2008. Repousse: Automatic inflation of 2D artwork. In Proceedings of the Eurographics Workshop on Sketch-Based Interfaces and Modeling. 49--55. Google ScholarDigital Library
- J. T. Kajiya. 1986. The rendering equation. SIGGRAPH Comput. Graph. 20, 4, 143--150. Google ScholarDigital Library
- O. A. Karpenko and J. F. Hughes. 2006. SmoothSketch: 3D free-form shapes from complex sketches. ACM Trans. Graph. 25, 3, 589--598. Google ScholarDigital Library
- E. A. Khan, E. Reinhard, R. Fleming, and H. Buelthoff. 2006. Image-based material editing. ACM Trans. Graph. 25, 3, 654--663. Google ScholarDigital Library
- J. Lopez-Moreno, J. Jimenez, S. Hadap, E. Reinhard, K. Anjyo, and D. Gutierrez. 2010. Stylized depiction of images based on depth perception. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 109--118. Google ScholarDigital Library
- J. Malik. 1986. Interpreting line drawings of curved objects. Ph.D. dissertation, Stanford University. Google ScholarDigital Library
- D. C. Mongomery and G. C. Runger. 1999. Applied, Statistics, and, Probability, for, Engineers 2nd Ed. John Wiley and Sons.Google Scholar
- A. Nealen, T. Igarashi, O. Sorkine, and M. Alexa. 2007. FiberMesh: Designing freeform surfaces with 3D curves. ACM Trans. Graph. 26, 3. Google ScholarDigital Library
- G. Noris, D. Sýkora, A. Shamir, S. Coros, B. Whited, M. Simmons, A. Hornung, M. Gross, and R. Sumner. 2012. Smart scribbles for sketch segmentation. Comput. Graph. Forum 31, 8, 2516--2527. Google ScholarDigital Library
- M. Okabe, G. Zeng, Y. Matsushita, T. Igarashi, L. Quan, and H.-Y. Shum. 2006. Single-view relighting with normal map painting. In Proceedings of the Pacific Conference on Computer Graphics and Applications. 27--34.Google Scholar
- L. Olsen, F. Samavati, and J. A. Jorge. 2011. NaturaSketch: Modeling from images and natural sketches. IEEE Comput. Graph. Appl. 31, 6, 24--34. Google ScholarDigital Library
- Y. Ono, B.-Y. Chen, and T. Nishita. 2004. 3D character model creation from cel animation. In Proceedings of the International Conference on Cyberworlds. 210--215. Google ScholarDigital Library
- A. Orzan, A. Bousseau, H. Winnemöller, P. Barla, J. Thollot, and D. Salesin. 2008. Diffusion curves: A vector representation for smooth-shaded images. ACM Trans. Graph. 27, 3. Google ScholarDigital Library
- Y. Ostrovsky, P. Cavanagh, and P. Sinha. 2005. Perceiving illumination inconsistencies. Percept. 34, 11, 1301--1314.Google ScholarCross Ref
- S. G. Parker, J. Bigler, A. Dietrich, H. Friedrich, J. Hoberock, D. Luebke, D. McAllister, M. McGuire, K. Morley, A. Robison, and M. Stich. 2010. OptiX: A general purpose ray tracing engine. ACM Trans. Graph. 29, 4. Google ScholarDigital Library
- L. Petrović, B. Fujito, L. Williams, and A. Finkelstein. 2000. Shadows for cel animation. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'00). 511--516. Google ScholarDigital Library
- H. Read. 1961. The Art of Sculpture 2nd Ed. Bollingen Foundation, New York.Google Scholar
- M. W. Ren, J. Y. Yang, and H. Sun. 2002. Tracing boundary contours in a binary image. Image Vis. Comput. 20, 2, 125--131.Google ScholarCross Ref
- A. Rivers, T. Igarashi, and F. Durand. 2010. 2.5D cartoon models. ACM Trans. Graph. 29, 4, Google ScholarDigital Library
- C. Shao, A. Bousseau, A. Sheffer, and K. Singh. 2012. CrossShade: Shading concept sketches using cross-section curves. ACM Trans. Graph. 31, 4. Google ScholarDigital Library
- J. R. Shewchuk. 1996. Triangle: Engineering a 2D quality mesh generator and delaunay triangulator. In Proceedings of the ACM Workshop on Applied Computational Geometry. 203--222. Google ScholarDigital Library
- J. R. Shewchuk. 2002. Delaunay refinement algorithms for triangular mesh generation. Comput. Geometry: Theory Appl. 22, 1--3, 21--74. Google ScholarDigital Library
- D. Sýkora, M. Ben-Chen, M. Čadík, B. Whited, and M. Simmons. 2011. TexToons: Practical texture mapping for hand-drawn cartoon animations. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 75--83. Google ScholarDigital Library
- D. Sýkora, J. Buriánek, and J. Žára. 2005. Colorization of black-and-white cartoons. Image Vis. Comput. 23, 9, 767--782. Google ScholarDigital Library
- D. Sýkora, J. Dingliana, and S. Collins. 2009a. As-rigid-as-possible image registration for hand-drawn cartoon animations. In Proceedings of the International Symposium on Non-photorealistic Animation and Rendering. 25--33. Google ScholarDigital Library
- D. Sýkora, J. Dingliana, and S. Collins. 2009b. LazyBrush: Flexible painting tool for hand-drawn cartoons. Comput. Graph. Forum 28, 2, 599--608.Google ScholarCross Ref
- D. Sýkora, D. Sedláček, S. Jinchao, J. Dingliana, and S. Collins. 2010. Adding depth to cartoons using sparse depth (in)equalities. Comput. Graph. Forum 29, 2, 615--623.Google ScholarCross Ref
- B. G. Tabachnick and L. S. Fidell. 2007. Using Multivariate Statistics 5th Ed. Pearson Education. Google ScholarDigital Library
- C. Toler-Franklin, A. Finkelstein, and S. Rusinkiewicz. 2007. Illustration of complex real-world objects using images with normals. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. 111--119. Google ScholarDigital Library
- R. Vergne, P. Barla, R. W. Fleming, and X. Granier. 2012. Surface flows for image-based shading design. ACM Trans. Graph. 31, 4. Google ScholarDigital Library
- Y. Wang, Y. Chen, J. Z. Liu, and X. Tang. 2009. 3D reconstruction of curved objects from single 2D line drawings. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1834--1841.Google Scholar
- T. Weyrich, J. Deng, C. Barnes, S. Rusinkiewicz, and A. Finkelstein. 2007. Digital bas-relief from 3D scenes. ACM Trans. Graph. 26, 3. Google ScholarDigital Library
- H. Winnemöller, A. Orzan, L. Boissieux, and J. Thollot. 2009. Texture design and draping in 2D images. Comput. Graph. Forum 28, 4, 1091--1099. Google ScholarDigital Library
Index Terms
- Ink-and-ray: Bas-relief meshes for adding global illumination effects to hand-drawn characters
Recommendations
Ray tracing-based interactive diffuse indirect illumination
Despite great efforts in recent years to accelerate global illumination computation, the real-time ray tracing of fully dynamic scenes to support photorealistic indirect illumination effects has yet to be achieved in computer graphics. In this paper, we ...
Ray tracing via GPU rasterization
Ray tracing is a dominant method for generating a wide variety of global illumination effects, such as reflections/refractions, shadows, etc. In this paper, we propose an efficient technique to perform nearly accurate ray tracing using the programmable ...
Non-photorealistic ray tracing with paint and toon shading
SIGGRAPH '21: ACM SIGGRAPH 2021 PostersWe present a modification to traditional ray tracing that stylistically renders a scene with cartoon and painterly styles. Previous methods rely on post-processing, materials, or textures to achieve a non-photorealistic look. Our method uses a ray ...
Comments