Dragan Ahmetovic
ABSTRACT
We present AudioFunctions.web, a web app that uses sonification, earcons and speech synthesis to enable blind people to explore mathematical function graphs. The system is designed for personalized access through different interfaces (touchscreen, keyboard, touchpad and mouse) on both mobile and traditional devices, in order to better adapt to different user abilities and preferences. It is also publicly available as a web service and can be directly accessed from the teaching material through a hypertext link.
An experimental evaluation with 13 visually impaired participants highlights that, while the usability of all the presented interaction modalities is high, users with different abilities prefer different interfaces to interact with the system. It is also shown that users with higher level of mathematical education are capable of better adapting to interaction modalities considered more difficult by others.
- Dragan Ahmetovic, Valeria Alampi, Cristian Bernareggi, Andrea Gerino, and Sergio Mascetti. 2017. Math Melodies: Supporting Visually Impaired Primary School Students in Learning Math. In Proceedings of the 14th Web for All Conference on The Future of Accessible Work. ACM, 26. Google Scholar
Digital Library
- Dragan Ahmetovic, Tiziana Armano, Cristian Bernareggi, Michele Berra, Anna Capietto, Sandro Coriasco, Nadir Murru, Alice Ruighi, and Eugenia Taranto. 2018. Axessibility: a LaTeX Package for Mathematical Formulae Accessibility in PDF Documents. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 352--354. Google ScholarDigital Library
- Nancy Alajarmeh. 2012. Doing Math: Mathematics Accessibility Issues. In Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A '12). ACM, New York, NY, USA, Article 23, 2 pages. Google ScholarDigital Library
- Tiziana Armano, Anna Capietto, Sandro Coriasco, Nadir Murru, Alice Ruighi, and Eugenia Taranto. 2018. An Automatized Method Based on LaTeX for the Realization of Accessible PDF Documents Containing Formulae. In Computers Helping People with Special Needs - 16th International Conference, ICCHP 2018, Linz, Austria, July 11-13, 2018, Proceedings, Part I. 583--589.Google Scholar
- Sandra Bardot, Marcos Serrano, Bernard Oriola, and Christophe Jouffrais. 2017. Identifying How Visually Impaired People Explore Raised-line Diagrams to Improve the Design of Touch Interfaces. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 550--555. Google ScholarDigital Library
- Cristian Bernareggi, Christian Comaschi, Andrea Marcante, Piero Mussio, Loredana Parasiliti Provenza, and Sara Vanzi. 2008. A Multimodal Interactive System to Create and Explore Graph Structures. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, New York, NY, USA, 2697--2702. Google ScholarDigital Library
- Meera M. Blattner, Denise A. Sumikawa, and Robert M. Greenberg. 1989. Earcons and Icons: Their Structure and Common Design Principles. SIGCHI Bull. 21, 1 (Aug. 1989), 123--140. Google ScholarDigital Library
- John Brooke and others. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189, 194 (1996), 4--7.Google Scholar
- Niccolò Cantù, Mattia Ducci, Dragan Ahmetovic, Cristian Bernareggi, and Sergio Mascetti. 2018. MathMelodies 2: a Mobile Assistive Application for People with Visual Impairments Developed with React Native. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 453--455. Google ScholarDigital Library
- Davide Cervone, Peter Krautzberger, and Volker Sorge. 2016. Towards Universal Rendering in MathJax. In Proceedings of the 13th Web for All Conference (W4A '16). ACM, New York, NY, USA, Article 4, 4 pages. Google ScholarDigital Library
- Catherine S Fichten, Jennison V Asuncion, Maria Barile, Vittoria Ferraro, and Joan Wolforth. 2009. Accessibility of e-learning and computer and information technologies for students with visual impairments in postsecondary education. Journal of Visual Impairment & Blindness 103, 9 (2009), 543.Google ScholarCross Ref
- John A. Gardner. 2002a. Access by Blind Students and Professionals to Mainstream Math and Science. In Proc. of the 8th Int. Conf. on Computers Helping People with Special Needs. Springer-Verlag. Google ScholarDigital Library
- John A Gardner. 2002b. Access by blind students and professionals to mainstream math and science. In International Conference on Computers for Handicapped Persons. Springer, 502--507. Google ScholarDigital Library
- John A. Gardner and Vladimir Bulatov. 2006. Scientific Diagrams Made Easy with IVEOTM. In Proc. of the 10th Int. Conf. on Computers Helping People with Special Needs. Springer-Verlag. Google ScholarDigital Library
- Andrea Gerino, Nicolo Alabastro, Cristian Bernareggi, Dragan Ahmetovic, and Sergio Mascetti. 2014. Mathmelodies: inclusive design of a didactic game to practice mathematics. In International Conference on Computers Helping People With Special Needs. Springer, Cham, 564--571.Google ScholarCross Ref
- Andrea Gerino, Lorenzo Picinali, Cristian Bernareggi, and Sergio Mascetti. 2015. Eyes-free Exploration of Shapes with Invisible Puzzle. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '15). ACM, New York, NY, USA, 425--426. Google ScholarDigital Library
- Cagatay Goncu and Kim Marriott. 2015. GraCALC: An Accessible Graphing Calculator. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '15). ACM, New York, NY, USA, 311--312. Google ScholarDigital Library
- T. Götzelmann. 2018. Visually Augmented Audio-Tactile Graphics for Visually Impaired People. ACM Trans. Access. Comput. 11, 2, Article 8 (June 2018), 31 pages. Google ScholarDigital Library
- João Guerreiro, Dragan Ahmetovic, Kris M Kitani, and Chieko Asakawa. 2017. Virtual navigation for blind people: Building sequential representations of the real-world. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 280--289. Google ScholarDigital Library
- Timothy Hickey, Qun Ju, and Maarten H Van Emden. 2001. Interval arithmetic: From principles to implementation. Journal of the ACM (JACM) 48, 5 (2001), 1038--1068. Google ScholarDigital Library
- Chandrika Jayant. 2006. A survey of math accessibility for blind persons and an investigation on text/math separation. Seattle: University of Washington (2006).Google Scholar
- Da-jung Kim and Youn-kyung Lim. 2011. Handscope: Enabling Blind People to Experience Statistical Graphics on Websites Through Haptics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2039--2042. Google ScholarDigital Library
- Edward Kim and Kathleen F McCoy. 2018. Multimodal Deep Learning using Images and Text for Information Graphic Classification. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 143--148. Google ScholarDigital Library
- Stephen E. Krufka and Kenneth E. Barner. 2005. Automatic Production of Tactile Graphics from Scalable Vector Graphics. In Proc. of the 7th Int. Conf. on Computers and Accessibility. ACM. Google ScholarDigital Library
- Richard E. Ladner, Melody Y. Ivory, Rajesh Rao, Sheryl Burgstahler, Dan Comden, Sangyun Hahn, Matthew Renzelmann, Satria Krisnandi, Mahalakshmi Ramasamy, Beverly Slabosky, Andrew Martin, Amelia Lacenski, Stuart Olsen, and Dmitri Groce. 2005. Automating Tactile Graphics Translation. In Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '05). ACM, New York, NY, USA, 150--157. Google ScholarDigital Library
- Sergio Mascetti, Andrea Gerino, Cristian Bernareggi, and Lorenzo Picinali. 2017. On the Evaluation of Novel Sonification Techniques for Non-Visual Shape Exploration. ACM Trans. Access. Comput. 9, 4, Article 13 (April 2017), 28 pages. Google ScholarDigital Library
- Priscilla Moraes, Gabriel Sina, Kathleen McCoy, and Sandra Carberry. 2014. Evaluating the accessibility of line graphs through textual summaries for visually impaired users. In Proceedings of the 16th international ACM SIGACCESS conference on Computers & accessibility. ACM, 83--90. Google ScholarDigital Library
- Arshad Nasser, Kening Zhu, and P. V.M Rao. 2018. ColorTact: A Finger Wearable Audio-tactile Device Using Customizable Color Tagging. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers (UbiComp '18). ACM, New York, NY, USA, 178--181. Google ScholarDigital Library
- Rameshsharma Ramloll, Wai Yu, Stephen Brewster, Beate Riedel, Mike Burton, and Gisela Dimigen. 2000. Constructing Sonified Haptic Line Graphs for the Blind Student: First Steps. In Proc. of the 4th Int. Conf. on Assistive Technologies. ACM. Google ScholarDigital Library
- Jeff Sauro. 2011. A practical guide to the system usability scale: Background, benchmarks & best practices. Measuring Usability LLC Denver, CO.Google Scholar
- Volker Sorge, Charles Chen, T. V. Raman, and David Tseng. 2014. Towards Making Mathematics a First Class Citizen in General Screen Readers. In Proceedings of the 11th Web for All Conference (W4A '14). ACM, New York, NY, USA, Article 40, 10 pages. Google ScholarDigital Library
- Ryo Suzuki, Abigale Stangl, Mark D. Gross, and Tom Yeh. 2017. FluxMarker: Enhancing Tactile Graphics with Dynamic Tactile Markers. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17). ACM, New York, NY, USA, 190--199. Google ScholarDigital Library
- Marzia Taibbi, Cristian Bernareggi, Andrea Gerino, Dragan Ahmetovic, and Sergio Mascetti. 2014. Audiofunctions: Eyes-free exploration of mathematical functions on tablets. In International Conference on Computers Helping People With Special Needs. Springer, Cham, 537--544.Google ScholarCross Ref
- Brianna J Tomlinson, Prakriti Kaini, Siyan Zhou, Taliesin L Smith, Emily B Moore, and Bruce N Walker. 2018. Design and Evaluation of a Multimodal Science Simulation. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility. ACM, 438--440. Google ScholarDigital Library
- Patrice Voss, Maryse Lassonde, Frederic Gougoux, Madeleine Fortin, Jean-Paul Guillemot, and Franco Lepore. 2004. Early-and late-onset blind individuals show supra-normal auditory abilities in far-space. Current Biology 14, 19 (2004), 1734--1738.Google ScholarCross Ref
- Bruce N Walker and Joshua T Cothran. 2003. Sonification Sandbox: A graphical toolkit for auditory graphs. Georgia Institute of Technology.Google Scholar
- Torsten Wörtwein, Boris Schauerte, Karin E Müller, and Rainer Stiefelhagen. 2015. Interactive web-based image sonification for the blind. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction. ACM, 375--376. Google ScholarDigital Library
Index Terms
- AudioFunctions.web: Multimodal Exploration of Mathematical Function Graphs
Recommendations
Multimodal Exploration of Mathematical Function Graphs with AudioFunctions.web
W4A '19: Proceedings of the 16th International Web for All ConferenceAudioFunctions.web is a web-based system that enables blind people to explore mathematical function graphs. It uses sonification, earcons and speech synthesis to convey the overall shape of a function graph, its key points of interest, and accurate ...
Assistive technology-based solutions in learning mathematics for visually-impaired people: exploring issues, challenges and opportunities
AbstractIn the absence of vision, visually impaired and blind people rely upon the tactile sense and hearing to obtain information about their surrounding environment. These senses cannot fully compensate for the absence of vision, so visually impaired ...
Impact of Expertise on Interaction Preferences for Navigation Assistance of Visually Impaired Individuals
W4A '19: Proceedings of the 16th International Web for All ConferenceNavigation assistive technologies have been designed to support individuals with visual impairments during independent mobility by providing sensory augmentation and contextual awareness of their surroundings. Such information is habitually provided ...
Comments