A new field of research, visual analytics, has recently been introduced. This has been defined as “the science of analytical reasoning facilitated by visual interfaces." Visual analytic environments, therefore, support analytical reasoning using visual representations and interactions, with data representations and transformation capabilities, to support production, presentation and dissemination. As researchers begin to develop visual analytic environments, it will be advantageous to develop metrics and methodologies to help researchers measure the progress of their work and understand the impact their work will have on the users who will work in such environments. This paper presents five areas or aspects of visual analytic environments that should be considered as metrics and methodologies for evaluation are developed. Evaluation aspects need to include usability, but it is necessary to go beyond basic usability. The areas of situation awareness, collaboration, interaction, creativity, and utility are proposed as areas for initial consideration. The steps that need to be undertaken to develop systematic evaluation methodologies and metrics for visual analytic environments are outlined.
Revised: December 22, 2008 |
Published: October 29, 2006
Citation
Scholtz J. 2006.Beyond Usability: Evaluation Aspects of Visual Analytic Environments. In 2006 IEEE Symposium On Visual Analytics And Technology, Oct 31, 2006 - Nov 02, 2006, Baltimore, MD, United States, edited by Pak Chung Wong and Daniel Keim, 145-150. Piscataway, New Jersey:Institute of Electrical and Electronics Engineers (IEEE).PNNL-SA-50982.doi:10.1109/VAST.2006.261416