Abstract
Maintenance workers in the oil and process industry have typically had minimal IT support, relying on paper-based solutions both for the information they need to bring into the field and for data capture. This paper proposes a mobile context aware system for maintenance work based on electronically tagged equipment and handheld wireless terminals with a multimodal user interface. Particular attention has been given to voice interaction in noisy industrial scenarios, utilising the PARAT earplug. A proof-of-concept demonstrator of the system has been developed. The paper presents the demonstrator architecture and experiences gained through this work.
Chapter PDF
Similar content being viewed by others
Key words
References
Ailisto, H., Haataja, V., Kyllönen, V. and Lindh, M. (2003) ‘Wearable context aware terminal for maintenance personnel’, In: Proceedings of The European Symposium on Ambient Intelligence (EUSAI 2003), Nov. 3–4 2003, Elsevier Science, Eindhoven, The Netherlands
Cole, R., et. al. (1995) ‘The challenge of spoken language systems: research directions for the nineties’, IEEE Transactions on Speech and Audio Processing, vol. 3, Jan. 1995, pp. 1–21
Comerford, L., Frank, D., Gopalakrishnan, P., Gopinath, R. and Sedivy J., (2001) ‘The IBM Personal Speech Assistant’, In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2001), May 2001, Salt Lake City, Utah
Dey, K. (2001) ‘Understanding and Using Context’, Personal and Ubiquitous Computing, vol. 5, pp. 4–7
Gamma, E., Helm, R., Johnson, R. and Vlissides, J. (1995) Design Patterns — Elements of Reusable Object-Oriented Software, Addison-Wesley
Huang X. et. al. (2001) ‘MIPAD: A Multimodal Interaction Prototype’, In: Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2001), May 2001, Salt Lake City, Utah
Krasner, G. E. and Pope S. T. (1998) ‘A cookbook for using the model-view controller user interface paradigm in Smalltalk-80’, Journal of Object-Oriented Programming, vol. 1, August/September 1998, pp. 26–49
Ockerman, J.J. and Pritchett, A.R. (1998) ‘Preliminary Investigation of Wearable Computers for Task Guidance in Aircraft Inspection’, In: Proceedings of The Second International Symposium on Wearable Computers (ISWC’ 98), Oct. 19–20 1998, Pittsburgh, PA, pp. 33–40
Oviatt, S. et. al. (2000) ‘Designing the User Interface for Multimodal Speech and Pen-Based Gesture Applications: State-of-the-Art Systems and Future Research Directions’, Human-Computer Interaction, vol. 15, pp. 263–322
Siegel, J. and Bauer, M. (1997) ‘A Field Usability Evaluation of a Wearable System’, In: Proceedings of The First International Symposium on Wearable Computers (ISWC’ 97), Oct. 13–14 1997, Cambridge, Mass, pp. 18–22
Siewiorek, D., Smailagic, A., Bass, L., Siegel, J., Martin, R. and Bennington, B. (1998) ‘Adtranz: A Mobile Computing System for Maintenance and Collaboration’, In: Proceedings of The Second International Symposium on Wearable Computers (ISWC’ 98), Oct. 19–20 1998, Pittsburgh, PA, pp. 25–32.
SINTEF (2002), Offshore Reliability Data Handbook (OREDA), 4th ed, Det Norske Veritas, Norway
Strand, O. M., Holter, T., Egeberg, A. and Stensby, S. (2003) ‘On the feasibility of ASR in extreme noise using the PARAT earplug communication terminal’, In: Proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU 2003), December 2003, IEEE, Virgin Islands, USA
Stäger, M., Junker, H., von Waldkirch, M., Tröster, G. (2003) ‘Using Wearables in Maintenance: A Modular Test Platform’, In: Proceedings of TCMC 2003: Workshop on Wearable Computing, Mar. 11–12 2003, Graz, Austria
Tempest, W. (1985) Noise in Industry, in: Tempest, W. (ed) The Noise Handbook, Academic Press, New York, pp. 179–194
Aakervik, A.-L. (2000, Dec. — copyright date) “An earplug passes the word”, (Gemini), Available: http://www.ntnu.no/gemini/2000-06e/09_1.htm (Accessed: 2004, May 25)
“ANSR — Action-oriented, Network-distributed Speech Recognition”, (2004 — copyright date), (Sprex), http://cassandra.sprex.com/ansr/, (Accessed 2004, May 25)
“ATEX Directive 94/9/EC: Equipment and Protective systems intended for use in potentially Explosive Atmospheres”, (1994, Mar. 23 — copyright date), (European Union), Available: http://europa.eu.int/comm/enterprise/atex/ (Accessed 2004, May 25)
“Aurora — Distributed Speech Recognition”, (2004, May 25 — last updated), (ETSI), Available: http://portal.etsi.org/stq/kta/DSR/dsr.asp, (Accessed 2004, May 25)
“aveLink Bluetooth”, (2003 — copyright date), (Atinav), Available: http://www.atinav.com/bluetoot/index.htm (Accessed 2004, May 25)
“JSR-82: Java APIs for Bluetooth”, (2004 — copyright date), Available: http://www.jcp.org/en/jsr/detail?id=82 (Accessed 2004, May 25)
“Natural Communication in Rough Environments”, (2004, Jan 30 — last updated), (NACRE), Available: http://www.nacre.no (Accessed 2004, May 25)
“WIDCOMM: Bluetooth Connectivity Solutions”, (2003 — copyright date), (WIDCOMM), Available: http://www.widcomm.com/Products/bluetooth_comm_software_btce.asp (Accessed 2004, May 25)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 International Federation for Information Processing
About this paper
Cite this paper
Vraalsen, F., Holter, T., Svagård, I.S., Kvennås, Ø. (2005). A Multimodal Context Aware Mobile Maintenance Terminal for Noisy Environments. In: Lawrence, E., Pernici, B., Krogstie, J. (eds) Mobile Information Systems. MOBIS 2004. IFIP International Federation for Information Processing, vol 158. Springer, Boston, MA. https://doi.org/10.1007/0-387-22874-8_6
Download citation
DOI: https://doi.org/10.1007/0-387-22874-8_6
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-22851-8
Online ISBN: 978-0-387-22874-7
eBook Packages: Computer ScienceComputer Science (R0)