ABSTRACT
Independently selecting food items while shopping, or storing and cooking food items correctly can be a very difficult task for people with special needs. Product labels on food packaging contain an ever-increasing amount of information, which can also be in a variety of languages. The amount of information and also the features of the text can make it difficult or impossible to read, in particular for those with visual impairments or the elderly. Several tools or applications are available on the market or have been proposed to support this type of activity (e.g. barcode or QR code reading), but they are limited and may require the user to have specific digital skills. Moreover, repeatedly using an application to read the label contents can require numerous steps on a touch-screen, and consequently be time-consuming. In this work, a portable tool is proposed to support people in reading the contents of labels and acquiring additional information, while they are using the item at home or shopping at the supermarket. The aim of our study is to propose a simple portable assistive technology tool which 1) can be used by anyone, regardless of their digital personal skills 2) does not require a smartphone or complex device, 3) is a low-cost solution for the user.
- Duarte, K., Cecílio, J., & Furtado, P. (2014, December). Overview of assistive technologies for the blind: Navigation and shopping. In 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV) (pp. 1929--1934). IEEE.Google ScholarCross Ref
- Gharpure, C. P., & Kulyukin, V. A. (2008). Robot-assisted shopping for the blind: issues in spatial cognition and product selection. Intelligent Service Robotics, 1(3), 237--251.Google ScholarCross Ref
- Kostyra, E., Żakowska-Biemans, S., Śniegocka, K., & Piotrowska, A. (2017). Food shopping, sensory determinants of food choice and meal preparation by visually impaired people. Obstacles and expectations in daily food experiences. Appetite, 113, 14--22.Google ScholarCross Ref
- Kulyukin, V., & Kutiyanawala, A. (2010). Accessible shopping systems for blind and visually impaired individuals: Design requirements and the state of the art. The Open Rehabilitation Journal, 3(1).Google Scholar
- Lanigan, P. E., Paulos, A. M., Williams, A. W., Rossi, D., & Narasimhan, P. (2006, October). Trinetra: Assistive Technologies for Grocery Shopping for the Blind. In ISWC (pp. 147--148).Google Scholar
- Leporini, B., & Buzzi, M. (2018). Home automation for an independent living: investigating the needs of visually impaired people. In Proceedings of the Internet of Accessible Things (pp. 1--9).Google ScholarDigital Library
- López-de-Ipiña, D., Lorido, T., & López, U. (2011, June). Indoor navigation and product recognition for blind people assisted shopping. In International Workshop on Ambient Assisted Living (pp. 33--40). Springer, Berlin, Heidelberg.Google ScholarCross Ref
- López-de-Ipiña, D., Lorido, T., & López, U. (2011, June). Blindshopping: enabling accessible shopping for visually impaired people through mobile technologies. In International Conference on Smart Homes and Health Telematics (pp. 266--270). Springer, Berlin, Heidelberg.Google Scholar
- Mathankumar, M., & Sugandhi, N. (2013, August). A low cost smart shopping facilitator for visually impaired. In 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI) (pp. 1088--1092). IEEE.Google ScholarCross Ref
- Microsoft (2020). Seeing AI, https://www.microsoft.com/en-us/seeingai [Accessed 16 March 2020].Google Scholar
- Nicholson, J., Kulyukin, V., & Coster, D. (2009). ShopTalk: independent blind shopping through verbal route directions and barcode scans. The Open Rehabilitation Journal, 2(1).Google Scholar
- RNIB (2020). PenFriend 3 audio labeler, https://www.rnib.org.uk/rnibconnect/technology/penfriend-3-audio-labeller. Accessed on 26 march 2020Google Scholar
- Yuan, C. W., Hanrahan, B. V., Lee, S., Rosson, M. B., & Carroll, J. M. (2019). Constructing a holistic view of shopping with people with visual impairment: a participatory design approach. Universal Access in the Information Society, 18(1), 127--140.Google ScholarDigital Library
- Zientara, P. A., Lee, S., Smith, G. H., Brenner, R., Itti, L., Rosson, M. B.,... & Narayanan, V. (2017). Third Eye: a shopping assistant for the visually impaired. Computer, 50(2), 16--24.Google ScholarDigital Library
Index Terms
- SelfLens: A Portable Tool to Facilitate All People in Getting Information on Food Items
Recommendations
SelfLens: A Personal Assistive Technology to Support the Independence of People with Special Needs in Reading Information on Food Items
Computers Helping People with Special NeedsAbstractGrocery shopping or handling food items (e.g. packets, boxes, etc.) can be a very difficult task for people with special needs. Object labels may contain much information that can be difficult to read because the data shown is a lot, and the text ...
Shoptalk: toward independent shopping by people with visual impairments
Assets '08: Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibilityShopTalk, a proof-of-concept system designed to assist individuals with visual impairments with finding shelved products in grocery stores, is built on the assumption that simple verbal route directions and layout descriptions can be used to leverage ...
Review on Smart Solutions for People with Visual Impairment
Computers Helping People with Special NeedsAbstractNowadays, over a billion people are estimated to be living with disabilities. The lack of support services make them overly dependent on their families and prevent them from being socially included. A good solution is to use Mobile Assistive ...
Comments