Natural markers for augmented reality-based indoor navigation and facility maintenance
Introduction
The longest period in the lifecycle of a building is the operation and maintenance (O&M) or facility management (FM) phase. In this phase, facility managers and operators perform activities to provide a comfortable living and working environment (e.g. pleasant temperatures) as well as to upkeep equipment to prevent functional failures. Since over 85% of the entire lifecycle costs are spent on facility management [1], improvements to the maintenance procedure will significantly reduce the overall building lifecycle budget.
Today's maintenance practice is characterized by dispersed and unformatted facility information that operators often need to manually browse, sort and select. Although software systems have recently been introduced, 50% of the on-site maintenance time is still spent on localizing inspection targets and navigating to them inside a facility [2]. Moreover, linked maintenance instructions are often multi-page documents, which sometimes are difficult to comprehend, in particular in case of emergencies.
Although some recent research studies propose to use Building Information Modeling (BIM) by either integrating or linking work order information to them, not all necessary information is currently available in a digitally integrated and standardized model. Moreover, available Ultra-wide Band (UWB), Wireless Local Area Networks (WLAN), Radio Frequency Identification (RFID) and Global Positioning System (GPS) indoor navigation approaches have been validated, but they rely on a costly equipment infrastructure for tags and readers. Existing Augmented Reality (AR) based solutions use artificial markers for both navigation and maintenance instruction support. This kind of marker is tedious to install all over a facility and also has some esthetical issues.
In this paper we propose a natural marker based Augmented Reality framework that can digitally support facility maintenance operators in performing their daily on-site maintenance jobs. Since 50% of the on-site maintenance time is still spent on localizing and navigating, and existing maintenance instructions are often multi-page, incomprehensible documents [2], our framework supports operators when (1) navigating to the FM item of interest and when (2) actually performing the maintenance and repair action. The main contribution of this paper is to highlight the big potential of natural markers, such as exit signs, to enable AR-based facility maintenance support. The presented methodology is implemented as a prototype and has been successfully tested on the university's campus. The results indicate the feasibility and the potential of the proposed framework.
Section snippets
Current practices
In today's maintenance and repair practice facility operators need to gather and access dispersed and unformatted facility information in order to handle work orders [3]. Typically, this information is handed over from the building design and the construction phase and is available in form of 2D drawings, spreadsheets, bar charts, field reports and paper-based guidelines. Collected in so-called Facility Document Repositories, the facility handover data is physically space consuming and might
Research framework
The overall project framework combines with Building Information Modeling (BIM) and natural markers to support AR-based facility maintenance activities (Fig. 2). By analogy with Ayer et al. [25], the proposed FM maintenance workflow is comprised of three major activities: (1) Digital Work Order (DWO) Compilation (collecting relevant information), (2) AR-based Indoor Navigation (positioning and navigation), and (3) AR-based Maintenance Instructions (performing maintenance task). While the first
Implementation
In order to test and illustrate the potential of the proposed framework, the methodology was prototypically implemented. For this purpose, an iPad 2 (processor: 1 GHz dual-core A5, max. camera resolution: 1280 × 720 pixels) and the Augmented Reality framework “metaioSDK 4.1.2” [26], including the picture marker tracking functionality, were utilized.
Fig. 5 depicts the software architecture and its major components: the metaioSDK framework, the mobile Operating System (OS) framework, positioning and
Conclusion and future work
The longest phase in a facility's lifecycle is its operation and maintenance period, during which facility operators perform activities to provide a comfortable living and working environment (e.g. pleasant temperature) as well as to upkeep equipment to prevent functional failures. In current practice operators need to manually process dispersed and unformatted facility information. Although software systems have recently been introduced, 50% of the on-site maintenance time is still spent on
Acknowledgments
The authors would like to thank Jens Neumann who contributed to this work in terms of preparing and running the experiments.
References (26)
- et al.
Augmented reality-based computational fieldwork support for equipment operations and maintenance
Autom. Constr.
(2011) RFID-based building maintenance system
Autom. Constr.
(2009)- et al.
Role-based access to facility lifecycle information on RFID tags
Adv. Eng. Inform.
(2011) - et al.
Evaluation of position tracking technologies for user localization in indoor construction environments
Autom. Constr.
(2009) - et al.
Performance evaluation of ultra wideband technology for construction resource location tracking in harsh environments
Autom. Constr.
(2011) - et al.
GPS-less indoor construction location sensing
Autom. Constr.
(2012) - et al.
RFID indoor location identification for construction projects
Autom. Constr.
(2014) - et al.
High-precision identification of contextual information in location-aware engineering applications
Adv. Eng. Inform.
(2009) - et al.
InfoSPOT: a mobile augmented reality method for assessing building information through a situation awareness approach
Autom. Constr.
(2013) - et al.
A framework for proactive construction defect management using BIM, augmented reality and ontology-based collection template
Autom. Constr.
(2013)
An invisible head marker tracking system for indoor mobile augmented reality
Autom. Constr.
Identification of application areas for augmented reality in industrial construction based on technology suitability
Autom. Constr.
Augmented reality in built environment: classification and implications for future research
Autom. Constr.
Cited by (138)
Key functions in BIM-based AR platforms
2023, Automation in ConstructionDiscovering pathways to the improve maintainability of multifamily residential building remodeling projects: Importance applicability analysis
2023, Sustainable Cities and SocietyBIM-based repair and maintenance for hospital work order management
2022, Automation in ConstructionCitation Excerpt :Data collection for detecting and diagnosing target assets on-site has been a known issue in R&M activities [60]. Koch et al. [66] estimated a waste of 50% of the on-site maintenance time to identify targets and navigate inside a building. Several recent studies have employed AR technology to enhance navigation inside a building.
Game-like interactive environment using BIM-based virtual reality for the timber frame self-build housing sector
2022, Automation in ConstructionAugmented Reality for Maintenance Tasks with ChatGPT for Automated Text-To-Action
2024, Journal of Construction Engineering and Management