Abstract
There is a long history of repeatable and comparable evaluation in Information Retrieval (IR). However, thus far, no shared test collection exists that has been designed to support interactive lifelog retrieval. In this paper we introduce the LSC2018 collection, that is designed to evaluate the performance of interactive retrieval systems. We describe the features of the dataset and we report on the outcome of the first Lifelog Search Challenge (LSC), which used the dataset in an interactive competition at ACM ICMR 2018.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Lifelog Search Challenge website: http://lsc.dcu.ie/. Last Visited 27th July 2018.
References
Alsina, A., Giró, X., Gurrin, C.: An interactive lifelog search engine for LSC2018. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 30–32. ACM, New York (2018)
Bush, V.: As we may think. Interactions 3(2), 35–46 (1996)
Dang-Nguyen, D.-T., Piras, L., Riegler, M., Boato, G., Zhou, L., Gurrin, C.: Overview of ImageCLEFlifelog 2017: lifelog retrieval and summarization. In: CLEF2017 Working Notes, Dublin, Ireland, 11–14 September 2017
Dang-Nguyen, D.-T., Piras, L., Riegler, M., Zhou, L., Lux, M., Gurrin, C.: Overview of ImageCLEFlifelog 2018: daily living understanding and lifelog moment retrieval. In: CLEF2018 Working Notes, CEUR Workshop Proceedings, Avignon, France, 10–14 September 2018. CEUR-WS.org (2018)
Dang-Nguyen, D.-T., Zhou, L., Gupta, R., Riegler, M., Gurrin, C.: Building a disclosed lifelog dataset:challenges, principles and processes. In: Content-Based Multimedia Indexing (CBMI) (2017)
Dodge, M., Kitchin, R.: Outlines of a world coming into existence: pervasive computing and the ethics of forgetting. Environ. Plan. B: Plan. Des. 34(3), 431–445 (2007)
Duane, A., Gurrin, C., Huerst, W.: Virtual reality lifelog explorer: lifelog search challenge at ACM ICMR 2018. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 20–23. ACM, New York (2018)
Gurrin, C., Joho, H., Hopfgartner, F., Zhou, L., Albatal, R.: NTCIR lifelog: the first test collection for lifelog research. In: Proceedings of SIGIR 2016 Conference, pp. 705–708. ACM (2016)
Gurrin, C., Joho, H., Hopfgartner, F., Zhou, L., Albatal, R.: Overview of NTCIR-12 lifelog task. In: Proceedings of the 12th NTCIR Conference, pp. 354–360 (2016)
Gurrin, C., et al.: Overview of NTCIR-13 lifelog-2 task. In: Proceedings of the 13th NTCIR Conference, pp. 6–11 (2017)
Gurrin, C., Schoeffmann, K., Joho, H., Dang-Nguyen, D.-T., Riegler, M., Piras, L. (eds.): LSC 2018: Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge. ACM, New York (2018)
Jones, W., Teevan, J.: Personal Information Management. University of Washington Press, Seattle (2011)
Kato, M.P., Liu, Y.: Overview of NTCIR-13, pp. 1–5 (2017)
Kim, P.H., Giunchiglia, F.: The open platform for personal lifelogging: the elifelog architecture. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2013, pp. 1677–1682. ACM, New York (2013)
Lee, Y.J., Ghosh, J., Grauman, K.: Discovering important people and objects for egocentric video summarization. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1346–1353. IEEE (2012)
Lokoc, J., Bailer, W., Schoeffmann, K., Muenzer, B., Awad, G.: On influential trends in interactive video retrieval: video browser showdown 2015–2017. IEEE Trans. Multimed. 20(12), 3361–3376 (2018)
Lokoč, J., Kovalčík, G., Souček, T.: Revisiting SIRET video retrieval tool. In: Schoeffmann, K., et al. (eds.) MMM 2018. LNCS, vol. 10705, pp. 419–424. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-73600-6_44
Münzer, B., Leibetseder, A., Kletz, S., Primus, M.J., Schoeffmann, K.: lifeXplore at the lifelog search challenge 2018. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 3–8. ACM, New York (2018)
Schoeffmann, K., Münzer, B., Primus, J., Leibetseder, A.: The diveXplore system at the video browser showdown 2018 - final notes. CoRR abs/1804.01863 (2018)
Sellen, A.J., Whittaker, S.: Beyond total capture. Commun. ACM 53(5), 70–77 (2010)
Sole, A.D.: Microsoft Computer Vision APIs Distilled: Getting Started with Cognitive Services. Apress, New York City (2017)
Song, S., Chandrasekhar, V., Cheung, N.-M., Narayan, S., Li, L., Lim, J.-H.: Activity recognition in egocentric life-logging videos. In: Jawahar, C.V., Shan, S. (eds.) ACCV 2014. LNCS, vol. 9010, pp. 445–458. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-16634-6_33
Talavera, E., Dimiccoli, M., Bolaños, M., Aghaei, M., Radeva, P.: R-clustering for egocentric video segmentation. In: Paredes, R., Cardoso, J.S., Pardo, X.M. (eds.) IbPRIA 2015. LNCS, vol. 9117, pp. 327–336. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19390-8_37
Truong, T.-D., Dinh-Duy, T., Nguyen, V.-T., Tran, M.-T.: Lifelogging retrieval based on semantic concepts fusion. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 24–29. ACM, New York (2018)
Zhou, L., Hinbarji, Z., Dang-Nguyen, D.-T., Gurrin, C.: Lifer: an interactive lifelog retrieval system. In: ACM Workshop on The Lifelog Search Challenge, LSC 2018, pp. 9–14. ACM, New York (2018)
Acknowledgements
We acknowledge the financial support of Science Foundation Ireland (SFI) under grant number SFI/12/RC/2289 and JSPS KAKENHI under Grant Number 18H00974.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Gurrin, C. et al. (2019). A Test Collection for Interactive Lifelog Retrieval. In: Kompatsiaris, I., Huet, B., Mezaris, V., Gurrin, C., Cheng, WH., Vrochidis, S. (eds) MultiMedia Modeling. MMM 2019. Lecture Notes in Computer Science(), vol 11295. Springer, Cham. https://doi.org/10.1007/978-3-030-05710-7_26
Download citation
DOI: https://doi.org/10.1007/978-3-030-05710-7_26
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05709-1
Online ISBN: 978-3-030-05710-7
eBook Packages: Computer ScienceComputer Science (R0)