Abstract
In this article we set out to examine whether analysis of the audio from a multimedia surveillance application can be used to augment an event detection system based on visual processing, and possibly contribute to any improvements. In processing audio information we are not concerned with identifying or classifying what type of event is detected as our aim is to keep audio processing to a minimum in order to allow deployment on a wireless sensor network. We describe an experiment where we gathered information from a series of traditional wired microphones installed in a typical surveillance setting. We also obtained information on activities carried out from cameras located in the same area. We present the results of analysis of audio information based on the mean of the volume, the zero-crossing rate, and the frequency and how these correlate with events detected visually. We found that detecting events, based on their volume only, returned satisfactory results. We show the results determined by applying this volume based approach to a range of physical environments.
Similar content being viewed by others
References
Anastasi, G., Falchi, A., Passarella, A., Conti, M., Gregori, E.: Performance measurements of motes sensor networks. In: MSWiM ’04: Proceedings of the 7th ACM International Symposium on Modeling, Analysis and Simulation of Wireless and Mobile Systems, pp. 174–181. ACM Press, New York (2004)
Beigl, M., Krohn, A., Zimmer, T., Decker, C.: Typical sensors needed in ubiquitous and pervasive computing. In: First International Workshop on Networked Sensing Systems (INSS) 2004, Tokyo, Japan, pp. 153–158, June 22–23 (2004)
Bohn J., Coroama V., Langheinrich M., Mattern F., Rohs M. (2004) Living in a world of smart everyday objects – social, economic, and ethical implications. J. Hum an Ecol. Risk Assess 10(5): 763–785
Cai, R., Lu, L., Zhang, H.-J., Cai, L.-H.: Highlight sounds effects detection in audio stream. In: ICME 2003, 6–9 July (2003)
Chen, J., Phua, K.: An adaptive microphone array with local acoustic sensitivity. In: ICME 2005, 6–8 July (2005)
Clavel, C., Ehrette, T., Richard, G.: Events detection for an audio-based surveillance system. In: ICME 2005, 6–8 July (2005)
Ellis, D.P., Lee, K.: Minimal-impact audio-based personal archives. In: CARPE’04: Proceedings of the the 1st ACM Workshop on Continuous Archival and Retrieval of Personal Experiences, pp. 39–47. ACM Press, New York (2004)
Goldhor, R.S.: Recognition of environmental sounds. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, vol. 1, pp. 149–152 (1993)
Heierman, E., Youngblood, G., Cook, D.: Mining temporal sequences to discover interesting patterns. In: Proceedings of the 2004 International Conference on Knowledge Discovery and Data Mining (KDD’04) (2004)
Hrm, M., McKinney, M.F., Skowronek, J.: Automatic surveillance of the acoustic activity in our living environment. In: ICME 2005, 6–8 July (2005)
McHugh, M., Smeaton, A.F.: Event detection using audio in a smart home context. In: International Conference on Smart Homes and Health Telematics 2006 (ICOST’06), 26–28 June (2006) (submitted)
McKinney, M.F., Breebaart, J.: Features for audio and music classification. In: Proceedings of the 4th International Conference on Music Information Retrieval, ISMIR 2003, 26–30 October (2003)
O’Conaire, C., O’Connor, N., Cooke, E., Smeaton, A.F.: Detection thresholding using mutual information. In: International Conference on Computer Vision Theory and Applications 2006 (VISAPP’06), 25–28 February (2006)
O’Flynn, B., Bellis, S., Delaney, K., Barton, J., O’Mathuna, S., Barroso, A., Benson, J., Roedig, U., Sreenan, C.: The development of a novel minaturized modular platfrom for wireless sensor networks. In: Fourth International Symposium on Information Processing in Sensor Networks, 2005 (IPSN’05), pp. 370–375 (2005)
Vacher, M., Istrate, D., Besacier, L., Castelli, E., Serignat, J.-F.: Smart audio sensor for telemedecine. In: Smart Object Conference, Grenoble, France, pp. 222–225, 15–17 May (2003)
White H.E., White D.H. (1980) Physics and Music. Saunders College, Philadelphia
Yamazaki, T.: Ubiquitous home: real-life testbed for home context-aware service. In: First International Conference on Testbeds and Research Infrastructures for the DEvelopment of NeTworks and COMmunities (TRIDENTCOM’05), pp. 54–59 (2005)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Smeaton, A.F., McHugh, M. Event detection in an audio-based sensor network. Multimedia Systems 12, 179–194 (2006). https://doi.org/10.1007/s00530-006-0060-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00530-006-0060-y