ABSTRACT
As the field of information visualization matures, the tools and ideas described in our research publications are reaching users. The reports of usability studies and controlled experiments are helpful to understand the potential and limitations of our tools, but we need to consider other evaluation approaches that take into account the long exploratory nature of users tasks, the value of potential discoveries or the benefits of overall awareness. We need better metrics and benchmark repositories to compare tools, and we should also seek reports of successful adoption and demonstrated utility.
- Borzo, Janet, Get the picture, Wall Street Journal, January 12 (2004).Google Scholar
- National Cancer Institute Cancer Mortality Maps and Graphs www3.cancer.gov/atlasplus.Google Scholar
- Sytadin. www.sytadin.tm.fr.Google Scholar
- Komlodi, A., Sears, A., Stanziola, E., Information Visualization Evaluation Review, ISRC Tech. Report, Dept. of Information Systems, UMBC. UMBC-ISRC-2004-1 http://www.research.umbc.edu/~komlodi/IV_eval (2004).Google Scholar
- Ahlberg, C., Shneiderman, B. The alphaslider: a compact and rapid selector, Proc. of the SIGCHI conference on Human factors in computing systems (1994) 365--371. Google ScholarDigital Library
- Irani, P., Ware, C., Diagramming information structures using 3D perceptual primitives, ACM Transactions on Computer-Human Interaction, 10, 1 (2003), 1--19. Google ScholarDigital Library
- Sutcliffe, A. G., Ennis, M., Hu, J., Evaluating the effectiveness of visual user interfaces for information retrieval. International Journal of Human Computer Studies, 53, 5 (2000), 741--763. Google ScholarDigital Library
- Byrd, D. (1999). A scrollbar-based visualization for document navigation. Proc. of the fourth ACM Conference on Digital Libraries (1999) 122--129. Google ScholarDigital Library
- Plaisant, C., Grosjean, J., and Bederson, B. B. SpaceTree: Supporting exploration in large node-link tree: design evolution and empirical evaluation IEEE Symposium on Information Visualization (2002), 57--64. Google ScholarDigital Library
- Trafton, J., Tsui, T., Miyamoto, R.; Ballas, J., Raymond, P., Turning pictures into numbers: extracting and generating information from complex visualizations. International Journal of Human Computer Studies, 53, 5 (2000), 827--850. Google ScholarDigital Library
- Moore, G., Crossing the Chasm, HarpersCollins Publishers, New York, NY (1991).Google Scholar
- Moore, G., Inside the Tornado, HarpersCollins Publishers, New York, NY (1995).Google Scholar
- Chen, C., Czerwinski, M. (Eds.) Introduction to the Special Issue on Empirical evaluation of information visualizations, International Journal of Human-Computer Studies, 53, 5, (2000), 631--635. Google ScholarDigital Library
- Plaisant, C., Information visualization and the challenge of universal access, in Exploring Geovisualization, Dykes, J., MacEachren, A. and Kraak, M.-J. (Eds.), Elsevier, Oxford (2004) in press.Google Scholar
- Zhao, H., Shneiderman, B., Image-based highly interactive web mapping for geo-referenced data publishing, Tech Report CS-TR-4431. (2003) www.cs.umd.edu/hcil.Google Scholar
- Brewster, S, A., Non-speech auditory output. In Jacko, J. and Sears, A. (Eds.), Human Computer Interaction Handbook, Lawrence Erlbaum Associates, Mahwah, NJ (2002), 220--239. Google ScholarDigital Library
- Zhao, H., Plaisant, C., Shneiderman, B., Duraiswani, R., Sonification of geo-referenced data for auditory information seeking: Design principle and pilot study, University of Maryland Tech. Report HCIL 2004-03 (2003) available at www.cs.umd.edu/hcil.Google Scholar
- Brewer, Cynthia, ColorBrewer, www.personal.psu.edu/faculty/c/a/cab38/ColorBrewerBeta.html.Google Scholar
- Dougherty, R., Wade, A. VisCheck: www.vischeck.comGoogle Scholar
- Shneiderman, B., Promoting universal usability with multilayer interface design, Proc. of ACM Conf. on Universal Usability (2003) 1--8. Google ScholarDigital Library
- Fekete, J-D and Plaisant, C., InfoVis 2003 Contest, www.cs.umd.edu/hcil/iv03contest (2003)Google Scholar
- Fekete, J.-D., Greinstein, G. and Plaisant, C., InfoVis 2004 Contest, www.cs.umd.edu/hcil/iv04contestGoogle Scholar
- Fekete, J-D and Plaisant, C., Information Visualization Benchmark Repository www.cs.umd.edu/hcil/InfovisRepositoryGoogle Scholar
- Munzner, T., Guimbretière, F., Tasiran, S., Zhang, L. and Zhou, Y., TreeJuxtaposer: Scalable tree comparison using Focus+Context with guaranteed visibility. ACM Transactions on Graphics, SIGGRAPH 03 (2003) 453--462. Google ScholarDigital Library
- Hong, J. Y., D'Andries, J., Richman, M., Westfall, M., Zoomology: Comparing Two Large Hierarchical Trees, in Poster Compendium of IEEE Information Visualization (2003) (also available at www.cs.umd.edu/hcil/iv03contest)Google Scholar
- Spenke, M., Beilken, C., InfoZoom - Analysing Formula One racing results with an interactive data mining and visualization tool, Ebecken, N. Data mining II, (2000), 455--464.Google Scholar
- Auber, D., Delest, M., Domenger, J-P., Ferraro, P., Strandh, R., EVAT - Environment for Visualization and Analysis of Trees, in Poster Compendium of IEEE Information Visualization (2003) (also available at www.cs.umd.edu/hcil/iv03contest).Google Scholar
- Morse, D. R., Ytow, N., Roberts, D. McL., Sato, A., Comparison of Multiple Taxonomic Hierarchies Using TaxoNote, in Poster Compendium of IEEE Information Visualization (2003) (also available at www.cs.umd.edu/hcil/iv03contest).Google Scholar
- Sheth, N., Börner, K., Baumgartner, J., Mane, K., Wernert, E., Treemap, Radial Tree, and 3D Tree Visualizations, in Poster Compendium of IEEE Information Visualization (2003) (also available at www.cs.umd.edu/hcil/iv03contest)Google Scholar
- Alexander, Dey, Return on investment resources, http://deyalexander.com/resources/roi.html.Google Scholar
- Dürsteler, Juan Carlos, www.infovis.net.Google Scholar
- Ahlberg, Christopher and Shneiderman, Ben, Visual information seeking: Tight coupling of dynamic query filters with starfield displays, Proc. CHI '94 Conference: Human Factors in Computing Systems, ACM, New York (1994), 313--321 and color plates. Google ScholarDigital Library
- Shneiderman, B. Dynamic queries, starfield displays, and the path to Spotfire, www.cs.umd.edu/hcil/spotfire.Google Scholar
- Shneiderman, B., Treemaps for space-constrained visualization of hierarchies, www.cs.umd.edu/hcil/treemapsGoogle Scholar
- Shneiderman, Ben, Tree visualization with treemaps: a 2-d space-filling approach, ACM Transactions on Graphics, 11, 1 (1992) 92--99. Google ScholarDigital Library
- Bederson, B. B., Shneiderman, B., and Wattenberg, M. Ordered and Quantum Treemaps: Making Effective Use of 2D Space to Display Hierarchies, ACM Transactions on Graphics, 21, 4 (2002) 833--854. Google ScholarDigital Library
- Plaisant, C., Facilitating Data Exploration: Dynamic Queries on a Health Statistics Map. Proc. of the Annual Meeting of the American Statistical Association (Government Statistics Section), ASA, Alexandria, VA (1993) 18--23.Google Scholar
- Li, Q., North, C., Empirical comparison of dynamic queries sliders and brushing histograms, Proc. IEEE Information Visualization (2003), 147--15. Google ScholarDigital Library
Index Terms
- The challenge of information visualization evaluation
Recommendations
A Generic Visualization Approach Supporting Task-Based Evaluation of Usability and User Experience
Human-Centered Software EngineeringAbstractAnalyzing evaluation results of usability and user experience studies has its limitations when it comes to personalized user interfaces, highly complex and connected systems, or internationally used services involving millions of users. To support ...
Information visualization tutorial
CHI EA '99: CHI '99 Extended Abstracts on Human Factors in Computing SystemsVisual representation of information requires merging of data visualization methods, computer graphics, design, and imagination. This course describes the emerging field of information visualization including visualizing retrieved information from large ...
Polyarchy visualization: visualizing multiple intersecting hierarchies
CHI '02: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe describe a new information structure composed of multiple intersecting hierarchies, which we call Polyarchies. Visualizing polyarchies enables use of novel views for discovery of relationships which are very difficult using existing hierarchy ...
Comments