Abstract
A major challenge in using multi-modal, distributed sensor systems for activity recognition is to maintain a temporal synchronization between individually recorded data streams. A common approach is to use well defined ‘synchronization actions’ performed by the user to generate, easily identifiable pattern events in all recorded data streams. The events are then used to manually align data streams. This paper proposes an automatic method for this synchronization.
We demonstrate that synchronization actions can be automatically identified and used for stream synchronization across widely different sensors such as acceleration, sound, force, and a motion tracking system. We describe fundamental properties and bounds of our event-based synchronization approach. In particular, we show that the event timing relation is transitive for sensor groups with shared members. We analyzed our synchronization approach in three studies. For a large dataset of 5 users and totally 308 data stream minutes we achieved a synchronization error of 0.3 s for more than 80% of the stream.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Amft, O., Tröster, G.: Recognition of dietary activity events using on-body sensors. Artificial Intelligence in Medicine 42(2), 121–136 (2008)
Bian, X., Abowd, G.D., Rehg, J.M.: Using Sound Source Localization in a Home Environment. In: Gellersen, H.-W., Want, R., Schmidt, A. (eds.) PERVASIVE 2005. LNCS, vol. 3468, pp. 19–36. Springer, Heidelberg (2005)
Coulouris, G., Dollimore, J., Kindberg, T.: Distributed systems. Addison-Wesley, Reading (2001)
Gupchup, J., Musaloiu-E, R., Szalay, A., Terzis, A.: Sundial: Using Sunlight to Reconstruct Global Timestamps. In: Roedig, U., Sreenan, C.J. (eds.) EWSN 2009. LNCS, vol. 5432, Springer, Heidelberg (2009)
Lester, J., Hannaford, B., Borriello, G.: ”Are You with Me?”-Using Accelerometers to Determine If Two Devices Are Carried by the Same Person. LNCS, pp. 33–50 (2004)
Lukac, M., Davis, P., Clayton, R., Estrin, D.: Recovering Temporal Integrity with Data Driven Time Synchronization. In: Proc. of The 8th Intl. Symposium on Information Processing in Sensor Networks (2009)
MacWilliams, P., Prasad, B., Khare, M., Sampath, D.: Source synchronous interface between master and slave using a deskew latch. US Patent 6209072 (March 2001)
Sivrikaya, F., Yener, B.: Time synchronization in sensor networks: a survey. IEEE Network 18(4), 45–50 (2004)
Su, W., Akyildiz, I.F.: Time-diffusion synchronization protocol for wireless sensor networks. IEEE/ACM Transactions on Networking 13(2), 384–397 (2005)
Sundararaman, B., Buy, U., Kshemkalyani, A.D.: Clock synchronization for wireless sensor networks: a survey. Ad Hoc Networks 3(3), 281–323 (2005)
Werner-Allen, G., Lorincz, K., Johnson, J., Lees, J., Welsh, M.: Fidelity and yield in a volcano monitoring sensor network. In: Proc. of The 7th USENIX Symposium on Operating Systems Design and Implementation (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bannach, D., Amft, O., Lukowicz, P. (2009). Automatic Event-Based Synchronization of Multimodal Data Streams from Wearable and Ambient Sensors. In: Barnaghi, P., Moessner, K., Presser, M., Meissner, S. (eds) Smart Sensing and Context. EuroSSC 2009. Lecture Notes in Computer Science, vol 5741. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04471-7_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-04471-7_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04470-0
Online ISBN: 978-3-642-04471-7
eBook Packages: Computer ScienceComputer Science (R0)