Brett Allen
ABSTRACT
We develop a novel method for fitting high-resolution template meshes to detailed human body range scans with sparse 3D markers. We formulate an optimization problem in which the degrees of freedom are an affine transformation at each template vertex. The objective function is a weighted combination of three measures: proximity of transformed vertices to the range data, similarity between neighboring transformations, and proximity of sparse markers at corresponding locations on the template and target surface. We solve for the transformations with a non-linear optimizer, run at two resolutions to speed convergence. We demonstrate reconstruction and consistent parameterization of 250 human body models. With this parameterized set, we explore a variety of applications for human body modeling, including: morphing, texture transfer, statistical analysis of shape, model fitting from sparse markers, feature analysis to modify multiple correlated parameters (such as the weight and height of an individual), and transfer of surface detail and animation controls from a template to fitted models.
Supplemental Material
- ALLEN, B., CURLESS, B., AND POPOVIĆ, Z. 2002. Articulated body deformation from range scan data. 612--619. Google Scholar
Digital Library
- BLANZ, V., AND VETTER, T. 1999. A morphable model for the synthesis of 3D faces. In Proceedings of ACM SIGGRAPH 99, ACM Press/Addison-Wesley Publishing Co., New York, A. Rockwood, Ed., Computer Graphics Proceedings, Annual Conference Series, 187--194. Google ScholarDigital Library
- CARR, J. C., BEATSON, R. K., CHERRIE, J. B., MITCHELL, T. J., FRIGHT, W. R., MCCALLUM, B. C., AND EVANS, T. R. 2001. Reconstruction and representation of 3D objects with radial basis functions. In Proceedings of ACM SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, New York, E. Fiume, Ed., Computer Graphics Proceedings, Annual Conference Series, 67--76. Google ScholarDigital Library
- DAVIS, J., MARSCHNER, S. R., GARR, M., AND LEVOY, M. 2002. Filling holes in complex surfaces using volumetric diffusion. In Proc. First International Symposium on 3D Data Processing, Visualization, and Transmission.Google ScholarCross Ref
- DECARLO, D., METAXAS, D., AND STONE, M. 1998. An anthropometric face model using variational techniques. In Proceedings of ACM SIGGRAPH 98, ACM Press, Computer Graphics Proceedings, Annual Conference Series, 67--74. Google ScholarDigital Library
- FELDMAR, J., AND AYACHE, N. 1994. Rigid and affine registration of smooth surfaces using differential properties. In ECCV (2), 397--406. Google ScholarDigital Library
- HILTON, A., STARCK, J., AND COLLINS, G. 2002. From 3D shape capture to animated models. In Proc. First International Symposion on 3D Data Processing, Visualization, and Transmission (3DPVT 2002).Google ScholarCross Ref
- KÄHLER, K., HABER, J., YAMAUCHI, H., AND SEIDEL, H.-P. 2002. Head shop: Generating animated head models with anatomical structure. In Proceedings of the 2002 ACM SIGGRAPH Symposium on Computer Animation, ACM SIGGRAPH, San Antonio, USA, S. N. Spencer, Ed., Association of Computing Machinery (ACM), 55--64. Google ScholarDigital Library
- LEE, A. W. F., SWELDENS, W., SCHRÖDER, P., COWSAR, L., AND DOBKIN, D. 1998. MAPS: Multiresolution adaptive parameterization of surfaces. In Proceedings of ACM SIGGRAPH 98, ACM Press, Computer Graphics Proceedings, Annual Conference Series, 95--104. Google ScholarDigital Library
- LEE, A., MORETON, H., AND HOPPE, H. 2000. Displaced subdivision surfaces. In Proceedings of ACM SIGGRAPH 2000, ACM Press / ACM SIGGRAPH / Addison Wesley Longman, K. Akeley, Ed., Computer Graphics Proceedings, Annual Conference Series, 85--94. Google ScholarDigital Library
- LEWIS, J. P., CORDNER, M., AND FONG, N. 2000. Pose space deformations: A unified approach to shape interpolation and skeleton-driven deformation. In Proceedings of ACM SIGGRAPH 2000, ACM Press / ACM SIGGRAPH / Addison Wesley Longman, K. Akeley, Ed., Computer Graphics Proceedings, Annual Conference Series, 165--172. Google ScholarDigital Library
- MARSCHNER, S. R., GUENTER, B., AND RAGHUPATHY, S. 2000. Modeling and rendering for realistic facial animation. In Proceedings of 11th Eurographics Workshop on Rendering, 231--242. Google ScholarDigital Library
- PRAUN, E., SWELDENS, W., AND SCHRÖDER, P. 2001. Consistent mesh parameterizations. In Proceedings of ACM SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, New York, E. Fiume, Ed., Computer Graphics Proceedings, Annual Conference Series, 179--184. Google ScholarDigital Library
- SHELDON, W. H., STEVENS, S. S., AND TUCKER, W. B. 1940. The Varieties of Human Physique. Harper & Brothers Publishers, New York.Google Scholar
- SLOAN, P.-P., ROSE, C., AND COHEN, M. F. 2001. Shape by example. In Proceedings of 2001 Symposium on Interactive 3D Graphics, 135--143. Google ScholarDigital Library
- SZELISKI, R., AND LAVALLÉE, S. 1994. Matching 3-D anatomical surfaces with non-rigid deformations using octree-splines. In IEEE Workshop on Biomedical Image Analysis, IEEE Computer Society, 144--153.Google ScholarCross Ref
- TURK, G., AND LEVOY, M. 1994. Zippered polygon meshes from range images. In Proceedings of ACM SIGGRAPH 94, ACM Press, Computer Graphics Proceedings, Annual Conference Series, 311--318. Google ScholarDigital Library
- TURK, M., AND PENTLAND, A. 1991. Eigenfaces for recognition. Journal of Cognitive Neuroscience 3, 1, 71--86.Google ScholarDigital Library
- WHITAKER, R. 1998. A level-set approach to 3-D reconstruction from range data. International Journal of Computer Vision 29, 3, 203--231. Google ScholarDigital Library
- ZHU, C., BYRD, R. H., LU, P., AND NOCEDAL, J. 1997. Algorithm 778. L-BFGS-B: Fortran subroutines for Large-Scale bound constrained optimization. ACM Transactions on Mathematical Software 23, 4 (Dec.), 550--560. Google ScholarDigital Library
Index Terms
- The space of human body shapes: reconstruction and parameterization from range scans
Recommendations
SCAPE: shape completion and animation of people
We introduce the SCAPE method (Shape Completion and Animation for PEople)---a data-driven method for building a human shape model that spans variation in both subject shape and pose. The method is based on a representation that incorporates both ...
SCAPE: shape completion and animation of people
SIGGRAPH '05: ACM SIGGRAPH 2005 PapersWe introduce the SCAPE method (Shape Completion and Animation for PEople)---a data-driven method for building a human shape model that spans variation in both subject shape and pose. The method is based on a representation that incorporates both ...
The space of human body shapes: reconstruction and parameterization from range scans
We develop a novel method for fitting high-resolution template meshes to detailed human body range scans with sparse 3D markers. We formulate an optimization problem in which the degrees of freedom are an affine transformation at each template vertex. ...
Comments