Marek Dvorožňák
Cassidy Curtis
Olga Sorkine-Hornung
Skip Abstract Section
Skip Supplemental Material SectionAbstract
We present a new framework for sketch-based modeling and animation of 3D organic shapes that can work entirely in an intuitive 2D domain, enabling a playful, casual experience. Unlike previous sketch-based tools, our approach does not require a tedious part-based multi-view workflow with the explicit specification of an animation rig. Instead, we combine 3D inflation with a novel rigidity-preserving, layered deformation model, ARAP-L, to produce a smooth 3D mesh that is immediately ready for animation. Moreover, the resulting model can be animated from a single viewpoint --- and without the need to handle unwanted inter-penetrations, as required by previous approaches. We demonstrate the benefit of our approach on a variety of examples produced by inexperienced users as well as professional animators. For less experienced users, our single-view approach offers a simpler modeling and animating experience than working in a 3D environment, while for professionals, it offers a quick and casual workspace for ideation.
Supplemental Material
- Adrien Bernhardt, Adeline Pihuit, Marie-Paule Cani, and Loïc Barthe. 2008. Matisse: Painting 2D regions for Modeling Free-Form Shapes. In Eurographics Workshop on Sketch-Based Interfaces and Modeling. 57--64.Google Scholar
- Mikhail Bessmeltsev, Will Chang, Nicholas Vining, Alla Sheffer, and Karan Singh. 2015. Modeling Character Canvases from Cartoon Drawings. ACM Transactions on Graphics 34, 5 (2015), 162.Google ScholarDigital Library
- Cédric Bobenrieth, Frédéric Cordier, Arash Habibi, and Hyewon Seo. 2020. Descriptive: Interactive 3D Shape Modeling from A Single Descriptive Sketch. Computer-Aided Design 128 (2020), 102904.Google ScholarCross Ref
- Peter Borosán, Ming Jin, Doug DeCarlo, Yotam Gingold, and Andrew Nealen. 2012. RigMesh: Automatic Rigging for Part-Based Shape Modeling and Deformation. ACM Transactions on Graphics 31, 6 (2012), 198.Google ScholarDigital Library
- Frederic Cordier, Hyewon Seo, Jinho Park, and Jun yong Noh. 2011. Sketching of Mirror-Symmetric Shapes. IEEE Transactions on Visualization and Computer Graphics 17, 11 (2011), 1650--1662.Google ScholarDigital Library
- Keenan Crane, Fernando de Goes, Mathieu Desbrun, and Peter Schröder. 2013. Digital Geometry Processing with Discrete Exterior Calculus. In ACM SIGGRAPH 2013 Courses.Google Scholar
- Mihaly Csikszentmihalyi. 1991. Flow: The Psychology of Optimal Experience.Google Scholar
- Johanna Delanoy, Mathieu Aubry, Phillip Isola, Alexei A. Efros, and Adrien Bousseau. 2018. 3D Sketching Using Multi-View Deep Volumetric Prediction. Proceedings of the ACM on Computer Graphics and Interactive Techniques 1, 1 (2018), 21.Google ScholarDigital Library
- Marek Dvorožňák, Saman Sepehri Nejad, Ondřej Jamriška, Alec Jacobson, Ladislav Kavan, and Daniel Sýkora. 2018. Seamless Reconstruction of Part-Based HighRelief Models from Hand-Drawn Images. In Proceedings of the Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering. 5.Google Scholar
- Even Entem, Loïc Barthe, Marie-Paule Cani, Frederic Cordier, and Michiel van de Panne. 2015. Modeling 3D animals from a side-view sketch. Computers & Graphics 46 (2015), 221--230.Google ScholarDigital Library
- Even Entem, Amal dev Parakkat, Loïc Barthe, Ramanathan Muthuganapathy, and MariePaule Cani. 2019. Automatic Structuring of Organic Shapes from a Single Drawing. Computers & Graphics 81 (2019), 125--139.Google ScholarDigital Library
- Yotam Gingold, Takeo Igarashi, and Denis Zorin. 2009. Structured Annotations for 2D-to-3D Modeling. ACM Transactions on Graphics 28, 5 (2009), 148.Google ScholarDigital Library
- Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 1999. Teddy: A Sketching Interface for 3D Freeform Design. In SIGGRAPH Conference Proceedings. 409--416.Google ScholarDigital Library
- Takeo Igarashi, Tomer Moscovich, and John F. Hughes. 2005. As-Rigid-As-Possible Shape Manipulation. ACM Transactions on Graphics 24, 3 (2005), 1134--1141.Google ScholarDigital Library
- Alec Jacobson, Ilya Baran, Ladislav Kavan, Jovan Popović, and Olga Sorkine. 2012. Fast Automatic Skinning Transformations. ACM Transactions on Graphics 31, 4 (2012), 77.Google ScholarDigital Library
- Ming Jin, Daniel Gopstein, Yotam I. Gingold, and Andrew Nealen. 2015. AniMesh: Interleaved Animation, Modeling, and Editing. ACM Transactions on Graphics 34, 6 (2015), 207.Google ScholarDigital Library
- Pushkar Joshi and Nathan A. Carr. 2008. Repoussé: Automatic Inflation of 2D Artwork. In Proceedings of Eurographics Workshop on Sketch-Based Interfaces and Modeling. 49--55.Google Scholar
- Olga A. Karpenko and John F. Hughes. 2006. SmoothSketch: 3D free-form shapes from complex sketches. ACM Transactions on Graphics 25, 3 (2006), 589--598.Google ScholarDigital Library
- Zohar Levi and Craig Gotsman. 2013. ArtiSketch: A System for Articulated Sketch Modeling. Computer Graphics Forum 32, 2pt2 (2013), 235--244.Google Scholar
- Changjian Li, Hao Pan, Yang Liu, Alla Sheffer, and Wenping Wang. 2018. Robust Flow-Guided Neural Prediction for Sketch-Based Freeform Surface Modeling. ACM Transactions on Graphics 37, 6 (2018), 238.Google ScholarDigital Library
- Chang-Jian Li, Hao Pan, Yang Liu, Xin Tong, Alla Sheffer, and Wenping Wang. 2017. BendSketch: Modeling Freeform Surfaces Through 2D Sketching. ACM Transactions on Graphics 36, 4 (2017), 125.Google ScholarDigital Library
- Zhaoliang Lun, Matheus Gadelha, Evangelos Kalogerakis, Subhransu Maji, and Rui Wang. 2017. 3D Shape Reconstruction from Sketches via Multi-view Convolutional Networks. In Proceedings of International Conference on 3D Vision. 67--77.Google ScholarCross Ref
- James McCann and Nancy S. Pollard. 2009. Local layering. ACM Transactions on Graphics 28, 3 (2009), 84.Google ScholarDigital Library
- Andrew Nealen, Takeo Igarashi, Olga Sorkine, and Marc Alexa. 2007. FiberMesh: Designing Freeform Surfaces with 3D Curves. ACM Transactions on Graphics 26, 3 (2007), 41.Google ScholarDigital Library
- Jorge Nocedal and Stephen Wright. 2006. Numerical optimization.Google Scholar
- Luke Olsen, Faramarz Samavati, and Joaquim Jorge. 2011. NaturaSketch: Modeling from Images and Natural Sketches. IEEE Computer Graphics and Applications 31, 6 (2011), 24--34.Google ScholarDigital Library
- Saulo Ramos, Diogo Fernando Trevisan, Harlen Costa Batagelo, Mario Costa Sousa, and Joăo Paulo Gois. 2018. Contour-aware 3D reconstruction of side-view sketches. Computers & Graphics 77 (2018), 97--107.Google ScholarCross Ref
- Alec Rivers, Takeo Igarashi, and Frédo Durand. 2010. 2.5D Cartoon Models. ACM Transactions on Graphics 29, 4 (2010), 59.Google ScholarDigital Library
- Ryan Schmidt, Brian Wyvill, Mario Costa Sousa, and Joaquim A. Jorge. 2005. ShapeShop: Sketch-based Solid Modeling with BlobTrees. In Eurographics Workshop on Sketch-Based Interfaces and Modeling. 53--62.Google Scholar
- Olga Sorkine and Marc Alexa. 2007. As-Rigid-As-Possible Surface Modeling. In Proceedings of Eurographics/ACM SIGGRAPH Symposium on Geometry Processing. 109--116.Google ScholarDigital Library
- Daniel Sýkora, Ondřej Jamriška, Ondřej Texler, Jakub Fišer, Michal Lukáč, Jingwan Lu, and Eli Shechtman. 2019. StyleBlit: Fast Example-Based Stylization with Local Guidance. Computer Graphics Forum 38, 2 (2019), 83--91.Google ScholarCross Ref
- Daniel Sýkora, Ladislav Kavan, Martin Čadík, Ondřej Jamriška, Alec Jacobson, Brian Whited, Maryann Simmons, and Olga Sorkine-Hornung. 2014. Ink-and-Ray: BasRelief Meshes for Adding Global Illumination Effects to Hand-Drawn Characters. ACM Transactions on Graphics 33, 2 (2014), 16.Google ScholarDigital Library
- Chiew-Lan Tai, Hongxin Zhang, and Jacky Chun-Kin Fong. 2004. Prototype modeling from sketched silhouettes based on convolution surfaces. Computer Graphics Forum 23, 1 (2004), 71--83.Google ScholarCross Ref
- Bui Minh Tuan, Junho Kim, and Yunjin Lee. 2015. 3D-look Shading from Contours and Hatching Strokes. Computers & Graphics 51, C (2015), 167--176.Google Scholar
- Emmanuel Turquin, Jamie Wither, Laurence Boissieux, Marie-Paule Cani, and John F. Hughes. 2007. A Sketch-Based Interface for Clothing Virtual Characters. IEEE Computer Graphics and Applications 27, 1 (2007), 72--81.Google ScholarDigital Library
- Baoxuan Xu, William Chang, Alla Sheffer, Adrien Bousseau, James McCrae, and Karan Singh. 2014. True2Form: 3D Curve Networks from 2D Sketches via Selective Regularization. ACM Transactions on Graphics 33, 4 (2014), 131.Google ScholarDigital Library
- Chih-Kuo Yeh, Shi-Yang Huang, Pradeep Kumar Jayaraman, Chi-Wing Fu, and Tong-Yee Lee. 2017. Interactive High-Relief Reconstruction for Organic and Double-Sided Objects from a Photo. IEEE Transactions on Visualization and Computer Graphics 23, 7 (2017), 1796--1808.Google ScholarDigital Library
Index Terms
- Monster mash: a single-view approach to casual 3D modeling and animation
Recommendations
Energy-Brushes: Interactive Tools for Illustrating Stylized Elemental Dynamics
UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and TechnologyDynamic effects such as waves, splashes, fire, smoke, and explosions are an integral part of stylized animations. However, such dynamics are challenging to produce, as manually sketching key-frames requires significant effort and artistic expertise ...
Feature-based terrain editing from complex sketches
We present a new method for first person sketch-based editing of terrain models. As in usual artistic pictures, the input sketch depicts complex silhouettes with cusps and T-junctions, which typically correspond to non-planar curves in 3D. After ...
Life-sketch: a framework for sketch-based modelling and animation of 3D objects
AUIC '10: Proceedings of the Eleventh Australasian Conference on User Interface - Volume 106The design and animation of digital 3D models is an essential task for many applications in science, engineering, education, medicine and arts. In many instances only an approximate representation is required and a simple and intuitive modelling and ...
Comments