Chen Li
Skip Abstract Section
Abstract
The elderly living in smart homes can have their daily movement recorded and analyzed. As different elders can have their own living habits, a methodology that can automatically identify their daily activities and discover their daily routines will be useful for better elderly care and support. In this article, we focus on automatic detection of behavioral patterns from the trajectory data of an individual for activity identification as well as daily routine discovery. The underlying challenges lie in the need to consider longer-range dependency of the sensor triggering events and spatiotemporal variations of the behavioral patterns exhibited by humans. We propose to represent the trajectory data using a behavior-aware flow graph that is a probabilistic finite state automaton with its nodes and edges attributed with some local behavior-aware features. We identify the underlying subflows as the behavioral patterns using the kernel k-means algorithm. Given the identified activities, we propose a novel nominal matrix factorization method under a Bayesian framework with Lasso to extract highly interpretable daily routines. For empirical evaluation, the proposed methodology has been compared with a number of existing methods based on both synthetic and publicly available real smart home datasets with promising results obtained. We also discuss how the proposed unsupervised methodology can be used to support exploratory behavior analysis for elderly care.
- Radim Belohlavek and Marketa Krmelova. 2013. Beyond boolean matrix decompositions: Toward factor analysis and dimensionality reduction of ordinal data. In Proceedings of the IEEE 13th International Conference on Data Mining. IEEE, 961--966.Google Scholar
Cross Ref
- Oliver Brdiczka, James L. Crowley, and Patrick Reignier. 2009. Learning situation models in a smart home. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 39, 1 (2009), 56--63. Google ScholarDigital Library
- Deng Cai, Xiaofei He, Jiawei Han, and Thomas S. Huang. 2011. Graph regularized non-negative matrix factorization for data representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 8 (2011), 1548--1560. Google ScholarDigital Library
- Rafael C. Carrasco and José Oncina. 1994. Learning stochastic regular grammars by means of a state merging method. In International Colloquium on Grammatical Inference. Springer, 139--152. Google ScholarDigital Library
- Diane J. Cook. 2012. Learning setting-generalized activity models for smart spaces. IEEE Intelligent Systems 27, 1 (2012), 32--38. Google ScholarDigital Library
- Morris H. DeGroot. 2005. Optimal Statistical Decisions. Vol. 82. John Wiley 8 Sons.Google Scholar
- Inderjit S. Dhillon, Yuqiang Guan, and Brian Kulis. 2007. Weighted graph cuts without eigenvectors a multilevel approach. IEEE Transactions on Pattern Analysis and Machine Intelligence 29, 11 (2007), 1944--1957. Google ScholarDigital Library
- Charalampos Doukas, Ilias Maglogiannis, Philippos Tragas, Dimitris Liapis, and Gregory Yovanof. 2007. Patient fall detection using support vector machines. In Proceedings of the IFIP International Conference on Artificial Intelligence Applications and Innovations. Springer, 147--156.Google ScholarCross Ref
- Nathan Eagle and Alex Sandy Pentland. 2009. Eigenbehaviors: Identifying structure in routine. Behavioral Ecology and Sociobiology 63, 7 (2009), 1057--1066.Google ScholarCross Ref
- Mustafa Fanaswala and Vikram Krishnamurthy. 2013. Detection of anomalous trajectory patterns in target tracking via stochastic context-free grammars and reciprocal process models. IEEE Journal of Selected Topics in Signal Processing 7, 1 (2013), 76--90.Google ScholarCross Ref
- Nicolas Gillis and Stephen A. Vavasis. 2014. Fast and robust recursive algorithms for separable nonnegative matrix factorization. IEEE Transactions on Pattern Analysis and Machine Intelligence 36, 4 (2014), 698--714. Google ScholarDigital Library
- Marta C. Gonzalez, Cesar A. Hidalgo, and Albert-Laszlo Barabasi. 2008. Understanding individual human mobility patterns. Nature 453, 7196 (June 2008), 779--782.Google ScholarCross Ref
- Aditya Grover and Jure Leskovec. 2016. node2vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 855--864. Google ScholarDigital Library
- Pengyu Hong, Matthew Turk, and Thomas S. Huang. 2000. Constructing finite state machines for fast gesture recognition. In Proceedings of the 15th International Conference on Pattern Recognition, Vol. 3. IEEE, 691--694. Google ScholarDigital Library
- Kejun Huang, Nicholas D. Sidiropoulos, and Ananthram Swami. 2014. Non-negative matrix factorization revisited: Uniqueness and algorithm for symmetric decomposition. IEEE Transactions on Signal Processing 62, 1 (2014), 211--224. Google ScholarDigital Library
- Till Hülnhagen, Ingo Dengler, Andreas Tamke, Thao Dang, and Gabi Breuel. 2010. Maneuver recognition using probabilistic finite-state machines and fuzzy logic. In 2010 IEEE Intelligent Vehicles Symposium (IV). IEEE, 65--70.Google ScholarCross Ref
- Shan Jiang, Joseph Ferreira, and Marta C. González. 2012. Clustering daily patterns of human activities in the city. Data Mining and Knowledge Discovery 25, 3 (2012), 478--510.Google ScholarCross Ref
- Liping Jing, Peng Wang, and Liu Yang. 2015. Sparse probabilistic matrix factorization by Laplace distribution for collaborative filtering. In Proceedings of the 24th International Conference on Artificial Intelligence. 1771--1777. Google ScholarDigital Library
- Hilde Kuehne, Ali Arslan, and Thomas Serre. 2014. The language of actions: Recovering the syntax and semantics of goal-directed human activities. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 780--787. Google ScholarDigital Library
- Jennifer R. Kwapisz, Gary M. Weiss, and Samuel A. Moore. 2011. Activity recognition using cell phone accelerometers. ACM SigKDD Explorations Newsletter 12, 2 (2011), 74--82. Google ScholarDigital Library
- Daniel D. Lee and H. Sebastian Seung. 1999. Learning the parts of objects by nonnegative matrix factorization. Nature 401 (1999), 788--791.Google ScholarCross Ref
- Matthew L. Lee and Anind K. Dey. 2011. Reflecting on pills and phone use: Supporting awareness of functional abilities for older adults. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2095--2104. Google ScholarDigital Library
- Kang Li and Yun Fu. 2014. Prediction of human activity by discovering temporal sequence patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence 36, 8 (2014), 1644--1657. Google ScholarDigital Library
- Zhao Li, Xindong Wu, and Hong Peng. 2010. Nonnegative matrix factorization on orthogonal subspace. Pattern Recognition Letters 31, 9 (2010), 905--911. Google ScholarDigital Library
- Matthew M. Lin, Bo Dong, and Moody T. Chu. 2005. Integer Matrix Factorization and Its Application. Technical Report.Google Scholar
- Qiang Lin, Daqing Zhang, Dongsheng Li, Hongbo Ni, and Xingshe Zhou. 2013. Extracting intra-and inter-activity association patterns from daily routines of elders. In Proceedings of International Conference on Smart Homes and Health Telematics. Springer, 36--44.Google ScholarCross Ref
- Samuel Maurus and Claudia Plant. 2014. Ternary matrix factorization. In Proceedings of the IEEE International Conference on Data Mining. IEEE, 400--409. Google ScholarDigital Library
- Pauli Miettinen. 2012. Dynamic boolean matrix factorizations. In Proceedings of the 12th IEEE International Conference on Data Mining. IEEE, 519--528. Google ScholarDigital Library
- Ehsan Nazerfard, Parisa Rashidi, and Diane J. Cook. 2010. Discovering temporal features and relations of activity patterns. In Proceedings of the IEEE International Conference on Data Mining Workshops. IEEE, 1069--1075. Google ScholarDigital Library
- Ulrich Paquet, Blaise Thomson, and Ole Winther. 2012. A hierarchical model for ordinal matrix factorization. Statistics and Computing 22, 4 (2012), 945--957. Google ScholarDigital Library
- Christine Parent, Stefano Spaccapietra, Chiara Renso, Gennady Andrienko, Natalia Andrienko, Vania Bogorny, Maria Luisa Damiani, Aris Gkoulalas-Divanis, Jose Macedo, Nikos Pelekis, Yannis Theodoridis, and Zhixian Yan. 2013. Semantic trajectories modeling and analysis. Computing Surveys 45, 4 (2013), 42. Google ScholarDigital Library
- Kyungseo Park, Yong Lin, Vangelis Metsis, Zhengyi Le, and Fillia Makedon. 2010. Abnormal human behavioral pattern detection in assisted living environments. In Proceedings of the 3rd International Conference on Pervasive Technologies Related to Assistive Environments. ACM, 9. Google ScholarDigital Library
- Trevor Park and George Casella. 2008. The bayesian lasso. Journal of the American Statistical Association 103, 482 (2008), 681--686.Google ScholarCross Ref
- Katerina Pastra and Yiannis Aloimonos. 2012. The minimalist grammar of action. Philosophical Transactions of the Royal Society of London B: Biological Sciences 367, 1585 (2012), 103--117.Google ScholarCross Ref
- Huan-Kai Peng, Pang Wu, Jiang Zhu, and Joy Ying Zhang. 2011. Helix: Unsupervised grammar induction for structured activity recognition. In Proceedings of the IEEE 11th International Conference on Data Mining. IEEE, 1194--1199. Google ScholarDigital Library
- Hamed Pirsiavash and Deva Ramanan. 2014. Parsing videos of actions with segmental grammars. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 612--619. Google ScholarDigital Library
- Thor Prentow, Andreas Thom, Henrik Blunck, and Jan Vahrenhold. 2015. Making sense of trajectory data in indoor spaces. In Proceedings of the 16th IEEE International Conference on Mobile Data Management (MDM), Vol. 1. IEEE, 116--121. Google ScholarDigital Library
- Parisa Rashidi, Diane J. Cook, Lawrence B. Holder, and Maureen Schmitter-Edgecombe. 2011. Discovering activities to recognize and track in a smart environment. IEEE Transactions on Knowledge and Data Engineering 23, 4 (2011), 527--539. Google ScholarDigital Library
- Jérémie Saives, Clément Pianon, and Gregory Faraut. 2015. Activity discovery and detection of behavioral deviations of an inhabitant from binary sensors. IEEE Transactions on Automation Science and Engineering 12, 4 (2015), 1211--1224.Google ScholarCross Ref
- Ruslan Salakhutdinov and Andriy Mnih. 2007. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems, Vol. 20. 1257--1264. Google ScholarDigital Library
- Mikkel N. Schmidt, Ole Winther, and Lars Kai Hansen. 2009. Bayesian non-negative matrix factorization. In Proceedings of International Conference on Independent Component Analysis and Signal Separation. 540--547. Google ScholarDigital Library
- Christian M. Schneider, Vitaly Belik, Thomas Couronné, Zbigniew Smoreda, and Marta C. González. 2013. Unravelling daily human mobility motifs. Journal of the Royal Society Interface 10, 84 (2013), 20130246.Google ScholarCross Ref
- Chaoming Song, Zehui Qu, Nicholas Blumm, and Albert-Lszl Barabsi. 2010. Limits of predictability in human mobility. Science 327, 5968 (2010), 1018--1021.Google Scholar
- Feng-Tso Sun, Yi-Ting Yeh, Heng-Tze Cheng, Cynthia Kuo, and Martin Griss. 2014. Nonparametric discovery of human routines from sensor data. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom’14). IEEE, 11--19.Google ScholarCross Ref
- David Tacconi, Oscar Mayora, Paul Lukowicz, Bert Arnrich, Cornelia Setz, Gerhard Troster, and Christian Haring. 2008. Activity and emotion recognition to support early diagnosis of psychiatric diseases. In Proceedings of the 2nd International Conference on Pervasive Computing Technologies for Healthcare (Pervasive Health’08). IEEE, 100--102.Google ScholarCross Ref
- Franck Thollard, Pierre Dupont, and Colin de la Higuera. 2000. Probabilistic DFA inference using Kullback-Leibler divergence and minimality. In Proceedings of the 17th International Conference on Machine Learning. 975--982. Google ScholarDigital Library
- Robert Tibshirani. 1996. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological) 58 (1996), 267--288.Google ScholarCross Ref
- Enrique Vidal, Franck Thollard, Colin De La Higuera, Francisco Casacuberta, and Rafael C. Carrasco. 2005. Probabilistic finite-state machines part I. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 7 (2005), 1013--1025. Google ScholarDigital Library
- Xiangye Xiao, Yu Zheng, Qiong Luo, and Xing Xie. 2014. Inferring social ties between users with human location history. Journal of Ambient Intelligence and Humanized Computing 5, 1 (2014), 3--19.Google ScholarCross Ref
- Minjie Xu, Jun Zhu, and Bo Zhang. 2012. Nonparametric max-margin matrix factorization for collaborative prediction. In Advances in Neural Information Processing Systems, Vol. 12. 64--72. Google ScholarDigital Library
- Zhixian Yan, Dipanjan Chakraborty, Christine Parent, Stefano Spaccapietra, and Karl Aberer. 2013. Semantic trajectories: Mobility data computation and annotation. ACM Transactions on Intelligent Systems and Technology 4, 3 (2013), 49. Google ScholarDigital Library
- Nicholas Jing Yuan, Yu Zheng, Xing Xie, Yingzi Wang, Kai Zheng, and Hui Xiong. 2015. Discovering urban functional zones using latent activity trajectories. IEEE Transactions on Knowledge and Data Engineering 27, 3 (2015), 712--725.Google ScholarDigital Library
- Tingzhi Zhao, Hongbo Ni, Xingshe Zhou, Lin Qiang, Daqing Zhang, and Zhiwen Yu. 2014. Detecting abnormal patterns of daily activities for the elderly living alone. In Proceedings of the International Conference on Health Information Science. Springer, 95--108.Google ScholarCross Ref
- Jiangchuan Zheng, Siyuan Liu, and Lionel M. Ni. 2013. Effective routine behavior pattern discovery from sparse mobile phone data via collaborative filtering. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications. 29--37.Google Scholar
- Kai Zheng, Yu Zheng, Nicholas J. Yuan, Shuo Shang, and Xiaofang Zhou. 2014. Online discovery of gathering patterns over trajectories. IEEE Transactions on Knowledge and Data Engineering 26, 8 (2014), 1974--1988.Google ScholarCross Ref
Index Terms
- Automatic Extraction of Behavioral Patterns for Elderly Mobility and Daily Routine Analysis
Recommendations
Elderly daily activity habits or lifestyle in their natural environments
PETRA '11: Proceedings of the 4th International Conference on PErvasive Technologies Related to Assistive EnvironmentsA research and development innovation project partly funded by the French company EDF was conducted for the advancement of smart homes. The aim is to help elderly to live at home in safe conditions. The experiments were carried out in a long-term ...
Elderly Mobility and Daily Routine Analysis Based on Behavior-Aware Flow Graph Modeling
ICHI '15: Proceedings of the 2015 International Conference on Healthcare InformaticsWith the advent of ubiquitous computing and sensor technologies, indoor trajectory data of individuals can readily be collected to support analysis of their underlying movement behaviors. Different methods for activity recognition have been proposed ...
Daily Routine Recognition through Activity Spotting
LoCA '09: Proceedings of the 4th International Symposium on Location and Context AwarenessThis paper explores the possibility of using low-level activity spotting for daily routine recognition. Using occurrence statistics of low-level activities and simple classifiers based on their statistics allows to train a discriminative classifier for ...
Comments