Katrin Wolf
Yomna Abdelrahman
David Schmid
Tilman Dingler
Albrecht Schmidt
ABSTRACT
With an increasing number of new camera devices entering the market, lifelogging has turned into a viable everyday practice. The promise of comprehensively capturing our life's happenings has caused adoption rates to grow, but approaches to do so greatly differ. In this paper we evaluate existing visual lifelogging capture approaches through a user study with two main capture dimensions: (1) comparing the body position where a lifelogging camera is worn: head versus chest (2) comparing the media captures: video versus stills. We equipped 30 participants with cameras on their heads and chests. That data was evaluated by subjective user ratings as well as by objective image processing analysis. Our findings indicate that (1) chest-worn devices are more stable and contain less motion blur through which feature detection by image processing algorithms works better than from head-worn cameras; 2) head-worn video cameras, however, seem to be the better choice for lifelogging as they capture more important autobiographical cues than chest-worn devices, e.g., faces that have been shown to be most relevant for recall.
- Omid Aghazadeh, Josephine Sullivan, and Stefan Carlsson. 2011. Novelty detection from an ego-centric perspective. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. IEEE, 3297--3304. Google Scholar
Digital Library
- Richard C Atkinson and Richard M Shiffrin. 1968. Human memory: A proposed system and its control processes. Psychology of learning and motivation 2 (1968), 89--195.Google Scholar
- Lawrence W Barsalou. 1988. The content and organization of autobiographical memories. Remembering reconsidered: Ecological and traditional approaches to the study of memory (1988), 193--243.Google Scholar
- Ardhendu Behera, David C Hogg, and Anthony G Cohn. 2013. Egocentric activity monitoring and recovery. In Computer Vision--ACCV 2012. Springer, 519--532. Google ScholarDigital Library
- Christopher DB Burt. 1992. Retrieval characteristics of autobiographical memories: Event and date information. Applied Cognitive Psychology 6, 5 (1992), 389--404.Google ScholarCross Ref
- Yi Chen and Gareth JF Jones. 2010. Augmenting human memory using personal lifelogs. In Proceedings of the 1st Augmented Human International Conference. ACM, 24. Google ScholarDigital Library
- Aiden R Doherty, Daragh Byrne, Alan F Smeaton, Gareth JF Jones, and Mark Hughes. 2008. Investigating keyframe selection methods in the novel domain of passively captured visual lifelogs. In Proceedings of the 2008 international conference on Content-based image and video retrieval. ACM, 259--268. Google ScholarDigital Library
- Aiden R Doherty, Niamh Caprani, Ciarán Ó Conaire, Vaiva Kalnikaite, Cathal Gurrin, Alan F Smeaton, and Noel E OâĂŹConnor. 2011. Passively recognising human activities through lifelogging. Computers in Human Behavior 27, 5 (2011), 1948--1958. Google ScholarCross Ref
- Alireza Fathi, Ali Farhadi, and James M Rehg. 2011a. Understanding egocentric activities. In Computer Vision (ICCV), 2011 IEEE International Conference on. IEEE, 407--414. Google ScholarDigital Library
- Alireza Fathi, Xiaofeng Ren, and James M Rehg. 2011b. Learning to recognize objects in egocentric activities. In Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference On. IEEE, 3281--3288. Google ScholarDigital Library
- Jim Gemmell, Gordon Bell, and Roger Lueder. 2006. MyLifeBits: a personal database for everything. Commun. ACM 49, 1 (2006), 88--95. Google ScholarDigital Library
- Jim Gemmell, Lyndsay Williams, Ken Wood, Roger Lueder, and Gordon Bell. 2004. Passive capture and ensuing issues for a personal lifetime store. In Proceedings of the the 1st ACM workshop on Continuous archival and retrieval of personal experiences. ACM, 48--55. Google ScholarDigital Library
- Joydeep Ghosh, Yong Jae Lee, and Kristen Grauman. 2012. Discovering important people and objects for egocentric video summarization. In 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1346--1353. Google ScholarDigital Library
- Cathal Gurrin, Gareth JF Jones, Hyowon Lee, Neil O'Hare, Alan F Smeaton, and Noel Murphy. 2005. Mobile access to personal digital photograph archives. In Proceedings of the 7th international conference on Human computer interaction with mobile devices & services. ACM, 311--314. Google ScholarDigital Library
- Steve Hodges, Lyndsay Williams, Emma Berry, Shahram Izadi, James Srinivasan, Alex Butler, Gavin Smyth, Narinder Kapur, and Ken Wood. 2006. SenseCam: A retrospective memory aid. In UbiComp 2006: Ubiquitous Computing. Springer, 177--193. Google ScholarDigital Library
- Nebojsa Jojic, Alessandro Perina, and Vittorio Murino. 2010. Structural epitome: A way to summarize oneâĂŹs visual experience. In Advances in neural information processing systems. 1027--1035.Google Scholar
- Johannes Kopf, Michael F Cohen, and Richard Szeliski. 2014. First-person hyper-lapse videos. ACM Transactions on Graphics (TOG) 33, 4 (2014), 78. Google ScholarDigital Library
- Cheng Li and Kris M Kitani. 2013. Pixel-level hand detection in ego-centric videos. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on. IEEE, 3570--3577. Google ScholarDigital Library
- Zheng Lu and Kristen Grauman. 2013. Story-driven summarization for egocentric video. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on. IEEE, 2714--2721. Google ScholarDigital Library
- Steve Mann. 1997. Wearable computing: A first step toward personal imaging. Computer 30, 2 (1997), 25--32. Google ScholarDigital Library
- Steve Mann. 1998. 'WearCam'(The wearable camera): personal imaging systems for long-term use in wearable tetherless computer-mediated reality and personal photo/videographic memory prosthesis. In Wearable Computers, 1998. Digest of Papers. Second International Symposium on. IEEE, 124--131. Google ScholarDigital Library
- Hamed Pirsiavash and Deva Ramanan. 2012. Detecting activities of daily living in first-person camera views. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on. IEEE, 2847--2854. Google ScholarDigital Library
- John A Robinson. 1976. Sampling autobiographical memory. Cognitive Psychology 8, 4 (1976), 578--595.Google ScholarCross Ref
- Abigail J Sellen and Steve Whittaker. 2010. Beyond total capture: a constructive critique of lifelogging. Commun. ACM 53, 5 (2010), 70--77. Google ScholarDigital Library
- Willem A Wagenaar. 1986. My memory: A study of autobiographical memory over six years. Cognitive psychology 18, 2 (1986), 225--252.Google Scholar
- Katrin Wolf, Albrecht Schmidt, Agon Bexheti, and Marc Langheinrich. 2014. Lifelogging: You're Wearing a Camera? IEEE Pervasive Computing 13, 3 (2014), 8--12.Google ScholarCross Ref
- Zoran Zivkovic and Ferdinand van der Heijden. 2006. Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern recognition letters 27, 7 (2006), 773--780. Google ScholarDigital Library
Index Terms
- Effects of camera position and media type on lifelogging images
Recommendations
Enhancing Lifelogging Privacy by Detecting Screens
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsLow-cost, lightweight wearable cameras let us record (or 'lifelog') our lives from a 'first-person' perspective for purposes ranging from fun to therapy. But they also capture private information that people may not want to be recorded, especially if ...
Using visual lifelogs to automatically characterize everyday activities
Visual lifelogging is the term used to describe recording our everyday lives using wearable cameras, for applications which are personal to us and do not involve sharing our recorded data. Current applications of visual lifelogging are built around ...
Lifelogging user study: bystander privacy
HCI '16: Proceedings of the 30th International BCS Human Computer Interaction Conference: Companion VolumeAutomatically and passively taking pictures (using lifelogging devices such as wearable cameras) of people who don't know they're having their picture taken raises a number of privacy concerns (from a bystander's perspective). We conducted a study ...
Comments