Shintami Chusnul Hidayati
ABSTRACT
Clothing is an integral part of life. Also, it is always an uneasy task for people to make decisions on what to wear. An essential style tip is to dress for the body shape, i.e., knowing one's own body shape (e.g., hourglass, rectangle, round and inverted triangle) and selecting the types of clothes that will accentuate the body's good features. In the literature, although various fashion recommendation systems for clothing items have been developed, none of them had explicitly taken the user's basic body shape into consideration. In this paper, therefore, we proposed a first framework for learning the compatibility of clothing styles and body shapes from social big data, with the goal to recommend a user about what to wear better in relation to his/her essential body attributes. The experimental results demonstrate the superiority of our proposed approach, leading to a new aspect for research into fashion recommendation.
- David Bainbridge. 2015. Curvology: The Origins and Power of Female Body Shape. Portobello Books Ltd.Google Scholar
- Yu-Ting Chang, Wen-Huang Cheng, Bo Wu, and Kai-Lung Hua. 2017. Fashion World Map: Understanding Cities Through Streetwear Fashion. In Proc. ACM Int. Conf. Multimedia. 91--99. Google ScholarDigital Library
- Wen-Huang Cheng, Jia Jia, Si Liu, Jianlong Fu, Johnny Tseng, and Jau Huang. 2018. Perfect Corp. Challenge 2018: Half Million Beauty Product Image Recognition. https://challenge2018.perfectcorp.com/index.html .Google Scholar
- Kat Collings. 2018. The Foolproof Way to Find Out Your Real Body Type. http://www.whowhatwear.com/how-to-find-body-shape-calculator/. Accessed: 2018-02--15.Google Scholar
- Yingying Deng, Fan Tang, Weiming Dong, Hanxing Yao, and Bao-Gang Hu. 2017. Style-oriented Representative Paintings Selection. In SIGGRAPH Asia 2017 Posters. 12:1--12:2. Google ScholarDigital Library
- Cherene Francis. {n. d.}. Body Shape Calculator. https://auraimageconsulting.com/body-shape-calculator/. Accessed: 2017-08--21.Google Scholar
- Brendan J. Frey and Delbert Dueck. 2007. Clustering by passing messages between data points. Science, Vol. 315, 5814 (2007), 972--976.Google Scholar
- Jianlong Fu, Heliang Zheng, and Tao Mei. 2017. Look Closer to See Better: Recurrent Attention Convolutional Neural Network for Fine-Grained Image Recognition. In Proc. IEEE Conf. Computer Vision and Pattern Recognition. 4438--4446.Google ScholarCross Ref
- Xintong Han, Zuxuan Wu, Yu-Gang Jiang, and Larry S Davis. 2017. Learning Fashion Compatibility with Bidirectional LSTMs. In Proc. ACM Int. Conf. Multimedia . 1078--1086. Google ScholarDigital Library
- Li He, Xing Xu, Huimin Lu, Yang Yang, Fumin Shen, and Heng Tao Shen. 2017. Unsupervised Cross-modal Retrieval through Adversarial Learning. In Proc. IEEE Int. Conf. Multimedia and Expo. 1153--1158.Google ScholarCross Ref
- Shintami Chusnul Hidayati, Yi-Ling Chen, Chao-Lung Yang, and Kai-Lung Hua. 2017a. Popularity Meter: An Influence- and Aesthetics-aware Social Media Popularity Predictor. In Proc. ACM Int. Conf. Multimedia . 1918--1923. Google ScholarDigital Library
- Shintami Chusnul Hidayati, Wen-Huang Cheng, and Kai-Lung Hua. 2012. Clothing Genre Classification by Exploiting the Style Elements. In Proc. ACM Int. Conf. Multimedia. 1137--1140. Google ScholarDigital Library
- Shintami Chusnul Hidayati, Kai-Lung Hua, Wen-Huang Cheng, and Shih-Wei Sun. 2014. What Are the Fashion Trends in New York?. In Proc. ACM Int. Conf. Multimedia . 197--200. Google ScholarDigital Library
- Shintami Chusnul Hidayati, Chuang-Wen You, Wen-Huang Cheng, and Kai-Lung Hua. 2017b. Learning and Recognition of Clothing Genres From Full-Body Images. IEEE Trans. Cybernetics, Vol. 48, 5 (2017), 1647--1659.Google ScholarCross Ref
- Yang Hu, Xi Yi, and Larry S. Davis. 2015. Collaborative Fashion Recommendation: A Functional Tensor Factorization Approach. In Proc. ACM Int. Conf. Multimedia. 129--138. Google ScholarDigital Library
- Gao Huang, Zhuang Liu, Laurens van der Maaten, and Kilian Q. Weinberger. 2017. Densely Connected Convolutional Networks. In Proc. IEEE Conf. Computer Vision and Pattern Recognition. 4700--4708.Google Scholar
- Shuhui Jiang, Yue Wu, and Yun Fu. 2016. Deep Bi-directional Cross-triplet Embedding for Cross-Domain Clothing Retrieval. In Proc. ACM Int. Conf. Multimedia. 52--56. Google ScholarDigital Library
- Kelly. 2011. Petite Body Types. http://www.alterationsneeded.com/2011/01/petite-body-types.html . Accessed: 2017-08--21.Google Scholar
- M. Hadi Kiapour, Xufeng Han, Svetlana Lazebnik, Alexander C. Berg, and Tamara L. Berg. 2015. Where to Buy It: Matching Street Clothing Photos in Online Shops. In Proc. IEEE Int. Conf. Computer Vision. 3343--3351. Google ScholarDigital Library
- M. Hadi Kiapour, Kota Yamaguchi, Alexander C. Berg, and Tamara L. Berg. 2014. Hipster Wars: Discovering Elements of Fashion Styles. In Proc. European Conf. Computer Vision . 472--488.Google Scholar
- Marlene V. Kindes. 2006. Body Image: New Research. Nova Publishers.Google Scholar
- Nir Y. Krakauer and Jesse C. Krakauer. 2012. A New Body Shape Index Predicts Mortality Hazard Independently of Body Mass Index. PLOS ONE , Vol. 7, 7 (2012).Google Scholar
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet Classification with Deep Convolutional Neural Networks. In Proc. Int. Conf. Neural Information Processing Systems. 1097--1105. Google ScholarDigital Library
- Yin-Hsi Kuo, Wen-Huang Cheng, Hsuan-Tien Lin, and Winston H. Hsu. 2012. Unsupervised Semantic Feature Discovery for Image Object Retrieval and Tag Refinement. IEEE Trans. Multimedia, Vol. 14, 4 (2012), 1079--1090. Google ScholarDigital Library
- Jeong Yim Lee, Cynthia L. Istook, Yun Ja Nam, and Sun Mi Park. 2007. Comparison of body shape between USA and Korean women. Int. Jrnl. of Clothing Science and Technology , Vol. 19, 5 (2007), 374--391.Google ScholarCross Ref
- Si Liu, Jiashi Feng, Zheng Song, Tianzhu Zhang, Hanqing Lu, Changsheng Xu, and Shuicheng Yan. 2012. Hi, Magic Closet, Tell Me What to Wear!. In Proc. ACM Int. Conf. Multimedia. 619--628. Google ScholarDigital Library
- Ziwei Liu, Ping Luo, Shi Qiu, Xiaogang Wang, and Xiaoou Tang. 2016a. Deepfashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations. In Proc. IEEE Conf. Computer Vision and Pattern Recognition. 1096--1104.Google ScholarCross Ref
- Ziwei Liu, Sijie Yan, Ping Luo, Xiaogang Wang, and Xiaoou Tang. 2016b. Fashion Landmark Detection in the Wild. In Proc. European Conf. Computer Vision. 229--245.Google ScholarCross Ref
- B. S. Manjunath, J.-R. Ohm, V. V. Vasudevan, and A. Yamada. 2001. Color and texture descriptors. IEEE Trans. Circuits and Systems for Video Technology, Vol. 11, 6 (2001), 703--715. Google ScholarDigital Library
- Helen McCormack. 2005. The shape of things to wear: scientists identify how women's figures have changed in 50 years. https://www.independent.co.uk/news/uk/this-britain/the-shape-of-things-to-wear-scientists-identify-how-womens-figures-have-changed-in-50-years-516259.html Accessed: 2017-08--21.Google Scholar
- D. Nister and H. Stewenius. 2006. Scalable recognition with a vocabulary tree. In Proc. IEEE Computer Vision and Pattern Recognition. 2161--2168. Google ScholarDigital Library
- Mary Brooks Picken. 2013. A Dictionary of Costume and Fashion: Historic and Modern .Courier Corporation.Google Scholar
- Jordi Sanchez-Riera, Jun-Ming Lin, Kai-Lung Hua, Wen-Huang Cheng, and Arvin Wen Tsui. 2017. i-Stylist: Finding the Right Dress Through Your Social Networks. In Proc. Int. Conf. Multimedia Modeling. 662--673.Google ScholarCross Ref
- Edgar Simo-Serra and Hiroshi Ishikawa. 2016. Fashion Style in 128 Floats: Joint Ranking and Classification Using Weak Data for Feature Extraction. In Proc. IEEE Conf. Computer Vision and Pattern Recognition. 298--307.Google ScholarCross Ref
- Edgar Simo-Serral, Sanja Fidler, Francese Moreno-Noguerl, and Raquel Urtasun. 2015. Neuroaesthetics in Fashion: Modeling the Perception of Fashionability. In Proc. IEEE Conf. Computer Vision and Pattern Recognition. 869--877.Google Scholar
- Zheng Song, Meng Wang, Xian-sheng Hua, and Shuicheng Yan. 2011. Predicting Occupation via Human Clothing and Contexts. In Proc. IEEE Int. Conf. Computer Vision. 1084--1091. Google ScholarDigital Library
- Guang-Lu Sun, Xiao Wu, and Qiang Peng. 2016. Part-based Clothing Image Annotation by Visual Neighbor Retrieval. Neurocomputing , Vol. 213 (2016), 115--124. Google ScholarDigital Library
- Tsung-Hung Tsai, Wen-Huang Cheng, Chuang-Wen You, Min-Chun Hu, Arvin Wen Tsui, and Heng-Yu Chi. 2014. Learning and Recognition of On-Premise Signs (OPSs) from Weakly Labeled Street View Images. IEEE Trans. Image Processing, Vol. 23, 3 (2014), 1047--1059. Google ScholarDigital Library
- Bokun Wang, Yang Yang, Xing Xu, Alan Hanjalic, and Heng Tao Shen. 2017. Adversarial Cross-Modal Retrieval. In Proc. ACM Int. Conf. Multimedia . 154--162. Google ScholarDigital Library
- Zhiqiang Wei, Yan Yan, Lei Huang, and Jie Nie. 2017. Inferring Intrinsic Correlation between Clothing Style and Wearers? personality. Multimedia Tools and Applications, Vol. 76, 19 (2017), 20273--20285. Google ScholarDigital Library
- Bo Wu, Tao Mei, Wen-Huang Cheng, and Yongdong Zhang. 2016. Unfolding Temporal Dynamics: Predicting Social Media Popularity Using Multi-scale Temporal Decomposition. In Proc. AAAI Conf. Artificial Intelligence . 272--278. Google ScholarDigital Library
- Kota Yamaguchi, Tamara L Berg, and Luis E Ortiz. 2014a. Chic or Social: Visual Popularity Analysis in Online Fashion Networks. In Proc. ACM Int. Conf. Multimedia. 773--776. Google ScholarDigital Library
- Kota Yamaguchi, M. Hadi Kiapour, Luis E. Ortiz, and Tamara L. Berg. 2014b. Retrieving Similar Styles to Parse Clothing. IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 37, 5 (2014), 1028--1040.Google ScholarCross Ref
- Xishan Zhang, Jia Jia, Ke Gao, Yongdong Zhang, Dongming Zhang, Jintao Li, and Qi Tian. 2016. Trip Outfits Advisor: Location-oriented Clothing Recommendation. IEEE Trans. Multimedia, Vol. 19, 11 (2016), 2533--2544.Google ScholarCross Ref
- Bo Zhao, Jiashi Feng, Xiao Wu, and Shuicheng Yan. 2017. Memory-Augmented Attribute Manipulation Networks for Interactive Fashion Search. In Proc. IEEE Conf. Computer Vision and Pattern Recognition. 1520--1528.Google ScholarCross Ref
- Bo Zhao, Xiao Wu, Qiang Peng, and Shuicheng Yan. 2016. Clothing Cosegmentation for Shopping Images With Cluttered Background. IEEE Trans. Multimedia, Vol. 18, 6 (2016), 1111--1123.Google ScholarCross Ref
Index Terms
- What Dress Fits Me Best?: Fashion Recommendation on the Clothing Style for Personal Body Shape
Recommendations
Personalized fashion outfit generation with user coordination preference learning
AbstractThis paper focuses on personalized outfit generation, aiming to generate compatible fashion outfits catering to given users. Personalized recommendation by generating outfits of compatible items is an emerging task in the recommendation community ...
Highlights- It works on recommending new, rather than pre-defined, outfits for individual users.
- Novel formulation for personalized outfit generation task with better performance.
- A new TOG framework organically integrates personalization & ...
Clothing style recognition using fashion attribute detection
MobiMedia '15: Proceedings of the 8th International Conference on Mobile Multimedia CommunicationsIn this paper, a new framework is proposed for clothing style recognition in natural scenes. Clothing region is first detected through the fusion of super-pixel segmentation, saliency detection and Gaussian Mixture Model (GMM). Next, a group of fashion ...
Fine-tuning SMPL: A Framework for Highly Detailed Statistical Human Model Building
VSIP '19: Proceedings of the 2019 International Conference on Video, Signal and Image ProcessingIn this paper, we consider the task of statistical modeling of 3D human shape and pose. Current advances in computer graphics, 3D scanning and reconstruction technologies and emergence of new application areas for human body models raise the need not ...
Comments