Abstract
This chapter describes a virtual try-on system with Kinect, which includes three components: data extraction from Kinect, animated body adaptation, garment prepositioning and simulation. With Kinect, some measurements and motion data of the customer can be extracted from captured RGB, depth and motion information. An anthropometry-based method is proposed to generate a customized 3D body from a template model. The method involves three processes. First, a statistical analysis method is proposed to estimate the anthropometric measurements based on partial information extracted from Kinect. Second, a constrained Laplacian-based deformation algorithm is presented to deform the template model to match the obtained anthropometric measurements. Third, a shape refinement method based on the contours is presented. The customized model is then animated by the recorded motion data from Kinect. Meanwhile, a scheme for automatic prepositioning the 2D patterns of garments onto the customized body is proposed. After the step of topological stitching and simulation, the garment is dressed on virtual model of customer finally. With the proposed framework, customers can try-on designed garments in an easy and convenient way. The experiments demonstrate that our try-on system can generate accurate results.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Allen B, Curless B, Popovi′c Z (2003) The space of human body shapes: reconstruction and parameterization from range scans. ACM Trans Graph 22(3):587–594
ANSUR. http://www.dtic.mil/dticasd/docs-a/anthro_military.html
Barron C, Kakadiaris IA (2000) Estimating anthropometry and pose from a single image. IEEE Comput Soc 1:669–676
Bodymetrics. http://www.bodymetrics.com/
Brekel Kinect. http://www.brekel.com/?page_id=155
Cordier F, Seo H, Magnenat-Thalmann N (2003) Made-to-measure technologies for an online clothing store. IEEE Comput Graph Appl 23:38–48
Fontana M, Rizzi C, Cugini U (2006) A cad-oriented cloth simulation system with stable and efficient ode solution. Comput Graph 30:391–406
Fontana M, Carubelli A, Rizzi C, Cugini U (2008) Clothassembler: a cad module for feature-based garment pattern assembly. Comput Aided Des Appl 2(6):795–804
Fuhrmann A, Groß C, Luckas V, Weber A (2003) Interaction-free dressing of virtual humans. Comput Graph-Uk 27(1):71–82
Groß C, Fuhrmann A, Luckas V (2003) Automatic pre-positioning of virtual clothing. In: Proceedings of the 19th spring conference on Computer graphics, SCCG’03, pp 99–108
Grosso MR, Quach RD, Otani E, Zhao J, Wei S, Ho PH, Lu J, Badler NI (1987) Anthropometry for computer graphics human figures, Technical Report No. MS-CIS-89-71
Izadi S, Newcombe RA, Kim D, Hilliges O, Molyneaux D, Hodges S, Kohli P, Shotton J, Davison AJ, Fitzgibbon A (2011) KinectFusion: real-time dynamic 3D surface reconstruction and interaction, ACM, New York, p 23
Jianhua S, Magnenat-Thalmann N, Thalmann D (1994) Human skin deformation from cross-sections. In: Proceedings of the computer graphics international, pp 9–24
Kasap M, Magnenat-Thalmann N (2010) Customizing and populating animated digital mannequins for real-time application. In: Proceedings of the 2010 international conference on cyberworlds, CW’10, pp 368–374
Kasap M, Magnenat-Thalmann N (2011) Skeleton-aware size variations in digital mannequins. Vis Comput 27:263–274
Lipman Y, Sorkine O, Cohen-Or D, Levin D, Rössl C, Seidel HP (2004) Differential coordinates for interactive mesh editing. In: Giannini F, Pasko A (eds) Shape modeling international 2004 (SMI 2004), pp 181–190
Magnenat-Thalmann N (2010) Modeling and simulating bodies and garments. ISBN 978-1-84996-263-6, Springer-Verlag Berlin, Heidelberg
Magnenat-Thalmann N, Volino P (2005) From early draping to haute couture models: 20 years of research. Vis Comput 21(8–10):506–519
Magnenat-Thalmann N, Seo H, Cordier F (2004) Automatic modeling of virtual humans and body clothing. J Comput Sci Technol 19(5):575–584
Maïm J, Yersin B, Thalmann D (2009) Unique character instances for crowds. IEEE Comput Graph Appl 29:82–90
Make Human. http://www.makehuman.org
Meyer M, Desbrun M, Schröder P, Barr AH (2002) Discrete differential-geometry operators for triangulated 2-manifolds. In: Hege HC, Polthier K (eds) Visualization and mathematics III, Springer, Berlin, pp 35–57
Nealen A, Sorkine O, Alexa M, Cohen-Or D (2005) A sketchbased interface for detail-preserving mesh editing. ACM Trans Graph 24:1142–1147
Seo H, Magnenat-Thalmann N (2004) An example-based approach to human body manipulation. Graph Models 66(1):1–23
Seo H, Yeo YI, Wohn K (2006) 3d body reconstruction from photos based on range scan. In: Proceedings of the first international conference on technologies for e-learning and digital entertainment, Edutainment'06 pp 849–860
Thanh TL, Gagalowicz A (2005) Virtual garment pre-positioning. In: Proceedings of the 11th international conference on computer analysis of images and patterns, CAIP’05, pp 837–845
Thanh TL, Gagalowicz A (2009) From interactive positioning to automatic try-on of garments. In: Proceedings of the 4th International conference on computer vision/computer graphics collaboration techniques, MIRAGE’09, pp 182–194
Volino P, Magnenat-Thalmann N (2000) Virtual clothing-theory and practice. ISBN 978-3-642-57278-4, Springer, London
Acknowledgements
The authors would like to acknowledge the Ph.D. grant from the Institute for Media Innovation, Nanyang Technological University, Singapore.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer Science+Business Media Singapore
About this chapter
Cite this chapter
Zhang, Y., Zheng, J., Magnenat-Thalmann, N. (2014). Cloth Simulation and Virtual Try-on with Kinect Based on Human Body Adaptation. In: Cai, Y., Goei, S. (eds) Simulations, Serious Games and Their Applications. Gaming Media and Social Effects. Springer, Singapore. https://doi.org/10.1007/978-981-4560-32-0_3
Download citation
DOI: https://doi.org/10.1007/978-981-4560-32-0_3
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-4560-31-3
Online ISBN: 978-981-4560-32-0
eBook Packages: EngineeringEngineering (R0)