skip to main content
10.1145/3399715.3399941acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaviConference Proceedingsconference-collections
poster

SelfLens: A Portable Tool to Facilitate All People in Getting Information on Food Items

Published:02 October 2020Publication History

ABSTRACT

Independently selecting food items while shopping, or storing and cooking food items correctly can be a very difficult task for people with special needs. Product labels on food packaging contain an ever-increasing amount of information, which can also be in a variety of languages. The amount of information and also the features of the text can make it difficult or impossible to read, in particular for those with visual impairments or the elderly. Several tools or applications are available on the market or have been proposed to support this type of activity (e.g. barcode or QR code reading), but they are limited and may require the user to have specific digital skills. Moreover, repeatedly using an application to read the label contents can require numerous steps on a touch-screen, and consequently be time-consuming. In this work, a portable tool is proposed to support people in reading the contents of labels and acquiring additional information, while they are using the item at home or shopping at the supermarket. The aim of our study is to propose a simple portable assistive technology tool which 1) can be used by anyone, regardless of their digital personal skills 2) does not require a smartphone or complex device, 3) is a low-cost solution for the user.

References

  1. Duarte, K., Cecílio, J., & Furtado, P. (2014, December). Overview of assistive technologies for the blind: Navigation and shopping. In 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV) (pp. 1929--1934). IEEE.Google ScholarGoogle ScholarCross RefCross Ref
  2. Gharpure, C. P., & Kulyukin, V. A. (2008). Robot-assisted shopping for the blind: issues in spatial cognition and product selection. Intelligent Service Robotics, 1(3), 237--251.Google ScholarGoogle ScholarCross RefCross Ref
  3. Kostyra, E., Żakowska-Biemans, S., Śniegocka, K., & Piotrowska, A. (2017). Food shopping, sensory determinants of food choice and meal preparation by visually impaired people. Obstacles and expectations in daily food experiences. Appetite, 113, 14--22.Google ScholarGoogle ScholarCross RefCross Ref
  4. Kulyukin, V., & Kutiyanawala, A. (2010). Accessible shopping systems for blind and visually impaired individuals: Design requirements and the state of the art. The Open Rehabilitation Journal, 3(1).Google ScholarGoogle Scholar
  5. Lanigan, P. E., Paulos, A. M., Williams, A. W., Rossi, D., & Narasimhan, P. (2006, October). Trinetra: Assistive Technologies for Grocery Shopping for the Blind. In ISWC (pp. 147--148).Google ScholarGoogle Scholar
  6. Leporini, B., & Buzzi, M. (2018). Home automation for an independent living: investigating the needs of visually impaired people. In Proceedings of the Internet of Accessible Things (pp. 1--9).Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. López-de-Ipiña, D., Lorido, T., & López, U. (2011, June). Indoor navigation and product recognition for blind people assisted shopping. In International Workshop on Ambient Assisted Living (pp. 33--40). Springer, Berlin, Heidelberg.Google ScholarGoogle ScholarCross RefCross Ref
  8. López-de-Ipiña, D., Lorido, T., & López, U. (2011, June). Blindshopping: enabling accessible shopping for visually impaired people through mobile technologies. In International Conference on Smart Homes and Health Telematics (pp. 266--270). Springer, Berlin, Heidelberg.Google ScholarGoogle Scholar
  9. Mathankumar, M., & Sugandhi, N. (2013, August). A low cost smart shopping facilitator for visually impaired. In 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI) (pp. 1088--1092). IEEE.Google ScholarGoogle ScholarCross RefCross Ref
  10. Microsoft (2020). Seeing AI, https://www.microsoft.com/en-us/seeingai [Accessed 16 March 2020].Google ScholarGoogle Scholar
  11. Nicholson, J., Kulyukin, V., & Coster, D. (2009). ShopTalk: independent blind shopping through verbal route directions and barcode scans. The Open Rehabilitation Journal, 2(1).Google ScholarGoogle Scholar
  12. RNIB (2020). PenFriend 3 audio labeler, https://www.rnib.org.uk/rnibconnect/technology/penfriend-3-audio-labeller. Accessed on 26 march 2020Google ScholarGoogle Scholar
  13. Yuan, C. W., Hanrahan, B. V., Lee, S., Rosson, M. B., & Carroll, J. M. (2019). Constructing a holistic view of shopping with people with visual impairment: a participatory design approach. Universal Access in the Information Society, 18(1), 127--140.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Zientara, P. A., Lee, S., Smith, G. H., Brenner, R., Itti, L., Rosson, M. B.,... & Narayanan, V. (2017). Third Eye: a shopping assistant for the visually impaired. Computer, 50(2), 16--24.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. SelfLens: A Portable Tool to Facilitate All People in Getting Information on Food Items

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      AVI '20: Proceedings of the International Conference on Advanced Visual Interfaces
      September 2020
      613 pages
      ISBN:9781450375351
      DOI:10.1145/3399715

      Copyright © 2020 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 2 October 2020

      Check for updates

      Qualifiers

      • poster
      • Research
      • Refereed limited

      Acceptance Rates

      AVI '20 Paper Acceptance Rate36of123submissions,29%Overall Acceptance Rate107of408submissions,26%
    • Article Metrics

      • Downloads (Last 12 months)11
      • Downloads (Last 6 weeks)0

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader