Skip to main content

Cloth Simulation and Virtual Try-on with Kinect Based on Human Body Adaptation

  • Chapter
  • First Online:

Part of the book series: Gaming Media and Social Effects ((GMSE))

Abstract

This chapter describes a virtual try-on system with Kinect, which includes three components: data extraction from Kinect, animated body adaptation, garment prepositioning and simulation. With Kinect, some measurements and motion data of the customer can be extracted from captured RGB, depth and motion information. An anthropometry-based method is proposed to generate a customized 3D body from a template model. The method involves three processes. First, a statistical analysis method is proposed to estimate the anthropometric measurements based on partial information extracted from Kinect. Second, a constrained Laplacian-based deformation algorithm is presented to deform the template model to match the obtained anthropometric measurements. Third, a shape refinement method based on the contours is presented. The customized model is then animated by the recorded motion data from Kinect. Meanwhile, a scheme for automatic prepositioning the 2D patterns of garments onto the customized body is proposed. After the step of topological stitching and simulation, the garment is dressed on virtual model of customer finally. With the proposed framework, customers can try-on designed garments in an easy and convenient way. The experiments demonstrate that our try-on system can generate accurate results.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Allen B, Curless B, Popovi′c Z (2003) The space of human body shapes: reconstruction and parameterization from range scans. ACM Trans Graph 22(3):587–594

    Google Scholar 

  • ANSUR. http://www.dtic.mil/dticasd/docs-a/anthro_military.html

  • Barron C, Kakadiaris IA (2000) Estimating anthropometry and pose from a single image. IEEE Comput Soc 1:669–676

    Google Scholar 

  • Bodymetrics. http://www.bodymetrics.com/

  • Brekel Kinect. http://www.brekel.com/?page_id=155

  • Cordier F, Seo H, Magnenat-Thalmann N (2003) Made-to-measure technologies for an online clothing store. IEEE Comput Graph Appl 23:38–48

    Article  Google Scholar 

  • Fontana M, Rizzi C, Cugini U (2006) A cad-oriented cloth simulation system with stable and efficient ode solution. Comput Graph 30:391–406

    Article  Google Scholar 

  • Fontana M, Carubelli A, Rizzi C, Cugini U (2008) Clothassembler: a cad module for feature-based garment pattern assembly. Comput Aided Des Appl 2(6):795–804

    Google Scholar 

  • Fuhrmann A, Groß C, Luckas V, Weber A (2003) Interaction-free dressing of virtual humans. Comput Graph-Uk 27(1):71–82

    Article  Google Scholar 

  • Groß C, Fuhrmann A, Luckas V (2003) Automatic pre-positioning of virtual clothing. In: Proceedings of the 19th spring conference on Computer graphics, SCCG’03, pp 99–108

    Google Scholar 

  • Grosso MR, Quach RD, Otani E, Zhao J, Wei S, Ho PH, Lu J, Badler NI (1987) Anthropometry for computer graphics human figures, Technical Report No. MS-CIS-89-71

    Google Scholar 

  • Izadi S, Newcombe RA, Kim D, Hilliges O, Molyneaux D, Hodges S, Kohli P, Shotton J, Davison AJ, Fitzgibbon A (2011) KinectFusion: real-time dynamic 3D surface reconstruction and interaction, ACM, New York, p 23

    Google Scholar 

  • Jianhua S, Magnenat-Thalmann N, Thalmann D (1994) Human skin deformation from cross-sections. In: Proceedings of the computer graphics international, pp 9–24

    Google Scholar 

  • Kasap M, Magnenat-Thalmann N (2010) Customizing and populating animated digital mannequins for real-time application. In: Proceedings of the 2010 international conference on cyberworlds, CW’10, pp 368–374

    Google Scholar 

  • Kasap M, Magnenat-Thalmann N (2011) Skeleton-aware size variations in digital mannequins. Vis Comput 27:263–274

    Google Scholar 

  • Lipman Y, Sorkine O, Cohen-Or D, Levin D, Rössl C, Seidel HP (2004) Differential coordinates for interactive mesh editing. In: Giannini F, Pasko A (eds) Shape modeling international 2004 (SMI 2004), pp 181–190

    Google Scholar 

  • Magnenat-Thalmann N (2010) Modeling and simulating bodies and garments. ISBN 978-1-84996-263-6, Springer-Verlag Berlin, Heidelberg

    Google Scholar 

  • Magnenat-Thalmann N, Volino P (2005) From early draping to haute couture models: 20 years of research. Vis Comput 21(8–10):506–519

    Google Scholar 

  • Magnenat-Thalmann N, Seo H, Cordier F (2004) Automatic modeling of virtual humans and body clothing. J Comput Sci Technol 19(5):575–584

    Article  Google Scholar 

  • Maïm J, Yersin B, Thalmann D (2009) Unique character instances for crowds. IEEE Comput Graph Appl 29:82–90

    Google Scholar 

  • Make Human. http://www.makehuman.org

  • Meyer M, Desbrun M, Schröder P, Barr AH (2002) Discrete differential-geometry operators for triangulated 2-manifolds. In: Hege HC, Polthier K (eds) Visualization and mathematics III, Springer, Berlin, pp 35–57

    Google Scholar 

  • Nealen A, Sorkine O, Alexa M, Cohen-Or D (2005) A sketchbased interface for detail-preserving mesh editing. ACM Trans Graph 24:1142–1147

    Article  Google Scholar 

  • Seo H, Magnenat-Thalmann N (2004) An example-based approach to human body manipulation. Graph Models 66(1):1–23

    Article  MATH  Google Scholar 

  • Seo H, Yeo YI, Wohn K (2006) 3d body reconstruction from photos based on range scan. In: Proceedings of the first international conference on technologies for e-learning and digital entertainment, Edutainment'06 pp 849–860

    Google Scholar 

  • Thanh TL, Gagalowicz A (2005) Virtual garment pre-positioning. In: Proceedings of the 11th international conference on computer analysis of images and patterns, CAIP’05, pp 837–845

    Google Scholar 

  • Thanh TL, Gagalowicz A (2009) From interactive positioning to automatic try-on of garments. In: Proceedings of the 4th International conference on computer vision/computer graphics collaboration techniques, MIRAGE’09, pp 182–194

    Google Scholar 

  • Volino P, Magnenat-Thalmann N (2000) Virtual clothing-theory and practice. ISBN 978-3-642-57278-4, Springer, London

    Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the Ph.D. grant from the Institute for Media Innovation, Nanyang Technological University, Singapore.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yuzhe Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media Singapore

About this chapter

Cite this chapter

Zhang, Y., Zheng, J., Magnenat-Thalmann, N. (2014). Cloth Simulation and Virtual Try-on with Kinect Based on Human Body Adaptation. In: Cai, Y., Goei, S. (eds) Simulations, Serious Games and Their Applications. Gaming Media and Social Effects. Springer, Singapore. https://doi.org/10.1007/978-981-4560-32-0_3

Download citation

  • DOI: https://doi.org/10.1007/978-981-4560-32-0_3

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-4560-31-3

  • Online ISBN: 978-981-4560-32-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics