Xinyi Fu
ABSTRACT
In Dunhuang Mogao Grottoes, unique Buddhist murals of ancient China are preserved. Unfortunately, the exquisite murals are suffering from degradation. Experts have been trying to enhance public's awareness of mural protection, but there's no efficacious means to attract interest and popularize knowledge yet. In this paper, we propose RestoreVR, an interactive virtual reality (VR) system engaging users to experience Dunhuang mural restoration in a digital tour in the cave. Based on an online survey with the public and in-depth interviews with five Dunhuang experts, we derive a set of design requirements for generating embodied knowledge and situated experience in VR to bridge the gap between highly specialized experts and general audiences. Accordingly, we design RestoreVR and conduct a between-subjects user study to compare our system with traditional methods. The results suggest that RestoreVR significantly improves user experience and awareness of CH protection over existing methods.
Supplemental Material
Available for Download
zip
paper544aux.zip (632.4 KB)
This auxiliary material includes five questionaires used in our user study. They are 'Knowledge Test Questionnaire?, 'Post-test questionnaire (RestoreVR)', 'Post-test questionnaire (Comparison)', 'Public Questionnaire on Cultural Heritage', and 'VRSQ Questionnaire'. All five questionaires are in pdf file type.
- 2017. Lotus Sutra Exhibition in Singapore. http://www.iop.or.jp/ExhibitionSingapore2017.html. (2017). Accessed: 2019-09--10.Google Scholar
- 2017. Sacred Art of the Silk Road Exhibition. https:// www.psta.org.uk/news-and-events/dunhuang-exhibition. (2017). Accessed: 2019-09--10.Google Scholar
- 2017. Tongji University VR Dunhuang. http://www.jfdaily.com/news/detail?id=48500. (2017). Accessed: 2019-09--10.Google Scholar
- Dunhuang Academy. 2015. Digital Dunhuang. (2015). https://www.e-dunhuang.com/index.htm [Accessed: 2019-09--10].Google Scholar
- Carmelo Ardito, Paolo Buono, Maria Francesca Costabile, Rosa Lanzilotti, and Antonio Piccinno. 2009. Enabling Interactive Exploration of Cultural Heritage: An Experience of Designing Systems for Mobile Devices. Knowledge Technology & Policy 22, 1 (2009), 79--86.Google ScholarCross Ref
- Piero Baglioni, Luigi Dei, Francesca Piqué, Giuseppe Sarti, and Enzo Ferroni. 1997. New autogenous lime-based grouts used in the conservation of lime-based wall paintings. Studies in Conservation 42, 1 (1997), 43--54.Google ScholarCross Ref
- S Baldissini and M Gaiani. 2014. Interacting with the Andrea Palladio Works: The History of Palladian Information System Interfaces. Journal on Computing & Cultural Heritage 7, 2 (2014), 1--26.Google ScholarDigital Library
- Miri Barak, Orit Herscoviz, Zvia Kaberman, and Yehudit J Dori. 2009. MOSAICA: A web-2.0 based system for the preservation and presentation of cultural heritage. Computers & Education 53, 3 (2009), 841--852.Google ScholarDigital Library
- S. Gonizzi Barsanti, G. Caruso, L. L. Micoli, M. Covarrubias Rodriguez, and G. Guidi. 2015. 3D Visualization of Cultural Heritage Artefacts with Virtual Reality devices. ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences XL-5/W7 (2015), 165--172.Google Scholar
- Mafkereseb Kassahun Bekele, Roberto Pierdicca, Emanuele Frontoni, Eva Savina Malinverni, and James Gain. 2018. A survey of augmented, virtual, and mixed reality for cultural heritage. Journal on Computing and Cultural Heritage (JOCCH) 11, 2 (2018), 7.Google ScholarDigital Library
- Danilo Bersani, Gianni Antonioli, Pier Paolo Lottici, L Fornari, and Marcello Castrichini. 2001. Restoration of a Parmigianino's fresco: a micro-Raman investigation of the pictorial surface. In Laser Techniques and Systems in Art Conservation, Vol. 4402. International Society for Optics and Photonics, 221--226.Google Scholar
- Marcelo Bertalmio, Luminita Vese, Guillermo Sapiro, and Stanley Osher. 2003. Simultaneous structure and texture image inpainting. IEEE transactions on image processing 12, 8 (2003), 882--889.Google ScholarDigital Library
- Jan Blacek, Barbara Zitová, Miroslav Bene?, and Janka Hradilová. 2009. Fresco restoration: Digital image processing approach. In 2009 17th European Signal Processing Conference. IEEE, 1210--1214.Google Scholar
- Emiliano Carretti, Rodorico Giorgi, Debora Berti, and Piero Baglioni. 2007. Oil-in-water nanocontainers as low environmental impact cleaning tools for works of art: Two case studies. Langmuir 23, 11 (2007), 6396--6403.Google ScholarCross Ref
- Gangquan Chen, Zaixuan Fan, Qunli Yu, Bomin Su, Yanfei Li, Hai Qiao, and Wei Tang. 2009. Primary Test of Desalination to Treat the Disrupted Wall Painting in Cang Jie Temple of Baishui. Dunhuang Research 2009, 6 (2009), 8--12.Google Scholar
- Zhenwang Chen and Jinshi Fan. 2016. Application of Cultural and Technological Convergence in Cultural Heritage Protection-A Case Study. Dunhuang Research 002 (2016), 100--107.Google Scholar
- Antonio Criminisi, Patrick Pérez, and Kentaro Toyama. 2004. Region flling and object removal by exemplar-based image inpainting. IEEE Transactions on image processing 13, 9 (2004), 1200--1212.Google ScholarDigital Library
- Tom Djajadiningrat, Kees Overbeeke, and Stephan Wensveen. 2002. But how, Donald, tell us how?: on the creation of meaning in interaction design through feedforward and inherent feedback. In Proceedings of the 4th conference on Designing interactive systems: processes, practices, methods, and techniques. ACM, 285--291.Google ScholarDigital Library
- S. F. El-Hakim, J. A. Beraldin, M Picard, and G Godin. 2004. Detailed 3D reconstruction of large-scale heritage sites with integrated techniques. Computer Graphics & Applications IEEE 24, 3 (2004), 21--29.Google ScholarDigital Library
- Jinshi Fan. 2005. Mogao Grottoes Conservation and Contrariety with Tourism and Its Counter-Measure. Dunhuang Research 2005, 4 (2005), 1--3.Google Scholar
- Jinshi Fan. 2015. Maintaining the Heritage Management System of Dunhuang Mogao Grottoes. Dunhuang Research 004 (2015), 1--4.Google Scholar
- Jianping Fan, David KY Yau, Ahmed K Elmagarmid, and Walid G Aref. 2001. Automatic image segmentation by integrating color-edge extraction and seeded region growing. IEEE transactions on image processing 10, 10 (2001), 1454--1466.Google Scholar
- ZX Fan, GQ Chen, BM Su, YF Li, H Qiao, and W Tang. 2009. The testing study for repairing the disruption wall paintings in Cave 98 at Mogao Grottoes. Dunhuang Res 6 (2009), 4--7.Google Scholar
- Zaixuan Fan, Stephen Rickerby, Lisa Shekede, Hai Qiao, Wei Tang, and Jinjian Yang. 2008. The technique measurement for repairing the mural -paintings in Cave 85 at Mogao Grottoes. Dunhuang Research 6 (2008), 19--22.Google Scholar
- XY Fu, Y Han, ZJ Sun, XJ Ma, and YQ Xu. 2017. Line-drawing enhanced interactive mural restoration for Dunhuang Mogao Grottoes. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences 4 (2017), 99.Google Scholar
- Youxu Fu, Heqiang Niu, Jing Ma, Zaixuan Fan, Fasi Wu, Linyi Zhao, Wanyu Zhu, and Wanfu Wang. 2015. The Conservation and Restoration of Cave 98 of Mogao Grottoes, Dunhuang. Studies of the Cave Temples 0 (2015), 424--439.Google Scholar
- Ioannis Giakoumis, Nikos Nikolaidis, and Ioannis Pitas. 2005. Digital image processing techniques for the detection and removal of cracks in digitized paintings. IEEE Transactions on Image Processing 15, 1 (2005), 178--188.Google ScholarDigital Library
- Alvaro Guevara, Christian Conrad, and Rudolf Mester. 2011. Boosting segmentation results by contour relaxation. In 2011 18th IEEE International Conference on Image Processing. IEEE, 1405--1408.Google ScholarCross Ref
- Diego Gutierrez, Francisco J Seron, Juan A Magallon, Emilio J Sobreviela, and Pedro Latorre. 2004. Archaeological and cultural heritage: bringing life to an unearthed Muslim suburb in an immersive environment. Journal of Cultural Heritage 5, 1 (2004), 63--74.Google ScholarCross Ref
- Mahmoud Haydar, David Roussel, Madjid Maïdi, Samir Otmane, and Malik Mallem. 2011. Virtual and augmented reality for cultural computing and heritage: a case study of virtual exploration of underwater archaeological sites (preprint). Virtual Reality 15, 4 (2011), 311--327.Google ScholarCross Ref
- Kim H.K., Park J., Choi Y., and Choe M. 2018. Virtual reality sickness questionnaire (VRSQ): Motion sickness measurement index in a virtual reality environment. Applied Ergonomics 69, January (2018), 66--73.Google ScholarCross Ref
- Sara Invitto, Italo Spada, Dario Turco, and Genuario Belmonte. 2014. Easy Perception Lab: Evolution, Brain and Virtual and Augmented Reality in Museum Environment. Lecture Notes in Computer Science 8853 (2014), 302--310.Google ScholarCross Ref
- K Manikanta Prasanth Kumar, Mayank Kumar, BVS Bhargav, and Mrinmoy Ghorai. 2014. Digital Restoration of Deteriorated Mural Images. In 2014 Fifth International Conference on Signal and Image Processing. IEEE, 36--41.Google Scholar
- J Lalley and R Miller. 2007. The learning pyramid: Does it point teachers in the right direction. Education 128, 1 (2007), 16.Google Scholar
- Jiamin Li, Hui Zhang, Zaixuan Fan, Xiang He, Shimin He, Mingyuan Sun, Yimin Ma, Shiqiang Fang, Huabing Zhang, and Bingjian Zhang. 2013. Investigation of the renewed diseases on murals at Mogao Grottoes. Heritage Science 1, 1 (2013), 31.Google ScholarCross Ref
- James Jeng Weei Lin, Henry B.L. Duh, Donald E. Parker, Habib Abi-Rached, and Thomas A. Furness. 2002. Effects of feld of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. Proceedings - Virtual Reality Annual International Symposium February (2002), 164--171.Google Scholar
- Marco P Locatelli, Davide L Rinaldi, Carla Simone, and Giuseppe Vizzari. 2012. Supporting valorization of cultural heritage documentation: The TIVal portal approach. In 2012 18th International Conference on Virtual Systems and Multimedia. IEEE, 453--460.Google ScholarCross Ref
- Michela Mortara, Chiara Eva Catalano, Francesco Bellotti, Giusy Fiucci, Minica Houry-Panchetti, and Panagiotis Petridis. 2014. Learning cultural heritage by serious games. Journal of Cultural Heritage 15, 3 (2014), 318--325.Google ScholarCross Ref
- Gero Müller, Gerhard H. Bendels, and Reinhard Klein. 2005. Rapid Synchronous Acquisition of Geometry and Appearance of Cultural Heritage Artefacts. In International Conference on Virtual Reality.Google Scholar
- Milind G Padalkar and Manjunath V Joshi. 2015. Auto-inpainting heritage scenes: a complete framework for detecting and inflling cracks in images and videos with quantitative assessment. Machine Vision and Applications 26, 2--3 (2015), 317--337.Google ScholarDigital Library
- Markku Reunanen, Lily Diaz, and Tommi Horttana. 2015. A Holistic User-Centered Approach to Immersive Digital Cultural Heritage Installations. Journal on Computing & Cultural Heritage 7, 4 (2015), 1--16.Google ScholarDigital Library
- Carla Simone, Marco Martini, Susanna Bortolotto, Gabriele Guidi, Marco Malagodi, Maria Teresa Mazzilli, Marco Morandotti, Goffredo Haus, and Pasquale Tucci. 2012. The TIVAL project: Integrating multidisciplinary perspectives. In 2012 18th International Conference on Virtual Systems and Multimedia. IEEE, 491--498.Google ScholarCross Ref
- Elizabeth A Smith. 2001. The role of tacit and explicit knowledge in the workplace. Journal of knowledge Management 5, 4 (2001), 311--321.Google ScholarCross Ref
- G Schirripa Spagnolo and Fabrizia Somma. 2010. Virtual restoration of cracks in digitized image of paintings. In Journal of Physics: Conference Series, Vol. 249. IOP Publishing, 012059.Google Scholar
- Mariagrazia Tortora, Stefano Sfarra, Marco Chiarini, Valeria Daniele, Giuliana Taglieri, and Giorgio Cerichelli. 2016. Non-destructive and micro-invasive testing techniques for characterizing materials, structures and restoration problems in mural paintings. Applied Surface Science 387 (2016), 971--985.Google ScholarCross Ref
- Naman Turakhia, Ruchin Shah, and Manjunath Joshi. 2012. Automatic crack detection in heritage site images for image inpainting. In Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing. ACM, 68.Google ScholarDigital Library
- Fei Yue Wang. 2009. Is Culture Computable? IEEE Intelligent Systems 24, 2 (2009), 2--3.Google ScholarDigital Library
- Wanfu Wang, Zanfeng Ma, Linyi Zhao, Qiangqiang Pei, and Zaixuan Fan. 2008. Practice and applying of the theory of the design procedure for conservative restoration of the wall. Dunhuang Research 2008, 6 (2008), 13--18.Google Scholar
- Xudong Wang. 2011. Exploration and Practice of the Methodology for Wall Painting Conservation Based Upon Principles for the Conservation of Heritage Sites in China. Dunhuang Research 6 (2011), 3.Google Scholar
- Roderick Whitfeld, Susan Whitfeld, and Neville Agnew. 2015. Cave Temples of Mogao at Dunhuang: Art History on the Silk Road. Getty Publications.Google Scholar
- DD Zhang. 2015. Tacit knowledge: the microscopic perspective of design innovation research on traditional crafts. ZhuangShi 266 (2015), 117--119.Google Scholar
- LI Zui-xiong. 2004. Sixty Years On The Conservation of The Dunhuang Grottoes [J]. Dunhuang Research 3 (2004), 10--26.Google Scholar
Index Terms
- RestoreVR: Generating Embodied Knowledge and Situated Experience of Dunhuang Mural Conservation via Interactive Virtual Reality
Recommendations
Generating Embodied Storytelling and Interactive Experience of China Intangible Cultural Heritage “Hua'er” in Virtual Reality
CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing SystemsHua'er, a type of traditional oral performance, is one of the national intangible cultural heritages (ICH) in China. Experts have been trying to enhance public's awareness of Hua'er protection through digital documentation technology, but there's no ...
Aesthetic Contemplation of the Tang Dynasty Dunhuang Frescoes Elements on Contemporary Costume Design
Cross-Cultural Design. User Experience of Products, Services, and Intelligent EnvironmentsAbstractWith a history of over one thousand years, the art of Dunhuang has developed into a series and diversified schools of design, highlighting the profound connotation of the Chinese culture. Influenced by social politics, economy, culture and ...
Lessons learned from designing a virtual heritage entertainment application for interactive education
ICEC'06: Proceedings of the 5th international conference on Entertainment ComputingDigital Koguryo is a virtual reality reconstruction of a Koguryo mural tumulus, Anak No. 3, designed to help educate visitors in the cultural background and life style of the ancient Koguryo. The focus of Digital Koguryo was to give users an interactive,...
Comments