Human–Machine Requirements’ Convergence for the Design of Assistive Navigation Software: Τhe Case of Blind or Visually Impaired People

Abstract

Autonomous navigation is a desirable capability for various types of “smart” devices or vehicles. The development of software designed for this purpose has become a central research field for major companies, as well as in academia. This trend is accompanied by a tendency to equip moving devices with artificial intelligence (AI) features. Interestingly, however, the most (and not artificially) intelligent unit which may require assistance from digital applications in order to achieve autonomous navigation is a blind or a visually impaired person (BVI). It is argued that as the capabilities of AI are being enhanced, convergence will occur among a significant subset of the requirements concerning assistive navigation software for the BVI and AI-equipped moving devices, respectively. The corresponding requirements which have been elicited through interviews with BVI people are presented. A subset of these requirements, which exhibit direct or prospective convergence with the corresponding requirements of AI devices is then outlined, with emphasis on possible opportunities for interaction between the two research topics.

Appendix A

QUESTIONNAIRE/QUESTIONS TO DISCUSS.

We are developing two systems that aim to assist blind people to navigate.

The first system concerns outdoor navigation and autonomous and safe pedestrian travel to predetermined destinations.

• 1. Description: The app is intended to be used by Android smartphones.

  Questions:

  • Are there any comparative advantages of the iPhone over the Android smartphones? If so, what are they?

  • Do you know smartphones specially designed for blind people (for example SmartVision 2)? What is the preferred operating system by blind people?

  • Do they opt for Apple iPhone? Will it be easy to switch to Android smartphones or to get a second smartphone that will use Android?

• 2. Description: Our system utilizes Google maps for voice-guided navigation.

  Question:

  • Are the voice capabilities of smartphones used by blind people and to what extent? Do you find Google Maps easy and functional to use?

• 3. Description: There will be used headphones that do not isolate both eardrums. We recommend the use of bone conduction headphones, or of a single ear headphone so that the ambient sounds are not dampened.

  Question:

  • Do BVI people use headsets connected to their smartphones? Is it easy for a blind person to simultaneously recognize sounds from different sound sources by each ear? Do you find this specification reasonable? Do you have anything else to recommend? What kind of handset do you prefer, Bluetooth or wired?

• 4. Description: A simple keypad will be used for the blind person to easily interact with the application, to select routes and other available functions.

  Question:

  • Do you think the keypad should have any specifications regarding its functionality, ease of use and usability? (that is, how good and easy it is to use).

• 5. Description: The app will use voice commands to inform the BVI for obstacles in the direction of their movement.

  Question:

  • Questions: How do you think obstacles should be reported and what instructions would be given to them along their route? Increasing continuous sound, interrupted sound, or vibration with increasing frequency as the obstacle approaches? Simultaneous or only voice reporting? How do you think the warning of the obstacle will be more user-friendly or practical?

• 6. Description: There will be a configuration activity that allows the user to create an extensive list of destinations to be selected from the keyboard.

  Question:

  • Do you find this easy for the BVI? Are there any examples of navigation in the options menu? Are options menu widely used? (e.g. smartphone Smartvision has an audio description function for the menu)

• 7. Description: It will be possible to synchronize the application with traffic lights. We recommend that the system will be implemented centrally through the traffic management system so that the BVI does not depend on whether or not each traffic light is equipped with a sound broadcasting system.

  Questions:

  • Do you have any suggestions concerning these features?

  • Is it sufficient that the mobile phone can produce a sound similar to that of traffic lights equipped with sound broadcast features for the blind people? Do you have any suggestions for improvements?

• 8. Description: Weather information will be provided so that the blind person can dress appropriately for the pedestrian route.

  Question:

  • How do you keep up to date with current weather?

• 9. Description: The app will send notifications to selected persons about the current position of the BVI in case of need

  Question:

  • Who should be informed about this relative, police, ambulance)? In the case of automatic activation, is there the nearest person who can receive a message? (It is logical that if no one answers the phone, there will be a hierarchy of options that will be called automatically). Note that the SmartVision 2 commercial smartphone has a SOS button that can send GPS coordinates (SmartVision 2, 2019).

• 10. Description: The app will use real-time information from the OASA telematics system for routes and stops for the development of complex routes that may include urban transport, etc.

  Question:

  • How does a BVI now choose the means of transport?

• 11. Description: The app will be connected to an external wearable subsystem, which could be fitted to e.g., a hat to ensure clearer reception of the GPS receiver and a sonar.

  Questions:

  • Is there an original to evaluate the ease of use?] Do you think a wearable device can easily be adopted by a BVI? What could be the type of wearable device that should be used/worn by the BVI to improve GPS accuracy (eg vest, hat, or embedded in a cane)?

• 12. Description: The application will be able to extract semantic information (along the way) which will be communicated to the BVI.

  Question:

  • What do you think are the objects of interest that a BVI would want to identify along the way (toilets, pedestrians, obstructed vehicles, shops/species identification)?—list completion.

The second application is a blind navigation system in public interior spaces with a pilot application to provide autonomous tours of museums.

• 1. Description: It is designed for Android smartphones

  Questions:

  • The question serves both versions of apps (indoor and outdoor).

• 2. Description: It will use voice guidance.

  Questions:

  • The question serves both versions of apps (indoor and outdoor).

• 3. Description: Guidance will be provided along the tour route.

  Question:

  • Which one of the following is preferred by a BVI? Voice guidance (speech), audio or a combination of both?

• 4. Description: The app will provide audio information about the exhibits the BVI has approached. It will also notify the user about whether it is allowed to touch the exhibit.

  Questions:

  • Do you have any suggestions for additional specifications?

  • The app will have the ability to give accurate voice guidance at any time on how to access the help desk, the exit, the WC or the restaurant. Are there any other similar points of interest?

• 5. Description: Ability to request assistance from the Museum staff at any time.

  Question:

  • The question serves both versions of apps (indoor and outdoor).

• 6. Description: Emergency call option.

  Question:

  • The question serves both versions of apps (indoor and outdoor).

• 7. Description: Design and implementation of an appropriate simple user interface on the touch screen of the smartphone.

  Question:

  • How do you propose to split the screen of the smartphone so that the blind can choose commands?

• 8. Description: Screen reading will support special reading functionality for the BVI.

  Question:

  • What is applicable today?

• 9. Description: The app will be used at the Tactual Museum - Lighthouse for the Blind of Greece, and after the completion of the project at the National Archaeological Museum and the Acropolis Museum.

  Question:

  • Is there another indoor destination you would like to visit?

• 10. Description: The implementation of a training version of the applications and the development of educational and training methods and strategies will be of high importance.

  Questions:

  • Do you find what those apps have to offer appealing?

  • Will we be able to have the BVI's massive participation in training on these apps, on the use of equipment, and by what means?

  • How long is a BVI going to spend on training in these applications?

  • What is the process and training that will allow the BVI to gain the confidence to navigate on his/her own?

  Questions:

  • Do you believe that a training version of the apps, which could be easily parametrized and applied by a sighted trainer to your routes or locations, would increase the rate of acceptance and involvement of the apps?

  • Do you think this could successfully replace the need for training in real conditions (for example, in a museum)?

  Questions:

  • Now that the main features of the assistive navigation apps have been described to you, do you believe that the presence of a sighted escort along your trip (outdoors or indoors) is still necessary, given that you have learned how to use the apps? To what extent can these apps support autonomous navigation of a BVI person?

• 11. Description: The operation of navigation aids for BVI depends on the external systems (such as beacons, signal recognition, NFC sensors, etc.) whose space must be equipped to support the operation of the application. In essence, these external systems determine how the application interacts with the environment. It cannot, therefore, be learned in places that are not equipped with such systems.

  Questions:

  • Would you be reluctant to use the app for the first time during your visit to the museum? What do you think about it?

  Questions:

  • Does learning the app detract from the main goal of the visitor, to enjoy and learn from the exhibits?

  • Does this happen also when navigating to an external destination which becomes complicated by learning the corresponding auxiliary application-utility?

  Questions:

  • Do you think an educational version of each application would be beneficial which could be tried with the help of an instructor, in familiar places first, before being used in conditions likely to be found in the outside world?