CCE Theses and Dissertations

Date of Award

2011

Document Type

Dissertation

Degree Name

Doctor of Philosophy in Computer Information Systems (DCIS)

Department

Graduate School of Computer and Information Sciences

Advisor

Maxine S Cohen

Committee Member

Timothy J Ellis

Committee Member

Sumitra Mukherjee

Keywords

Discrete-Event, Evaluation, Heuristic, Interface, Simulation, Usability

Abstract

This research outlines a study that was performed to determine the effects of user interface design variations on the usability and solution quality of complex, multivariate discrete-event simulations. Specifically, this study examined four key research questions: what are the user interface considerations for a given simulation model, what are the current best practices in user interface design for simulations, how is usability best evaluated for simulation interfaces, and specifically what are the measured effects of varying levels of usability of interface elements on simulation operations such as data entry and solution analysis. The overall goal of the study was to show the benefit of applied usability practices in simulation design, supported by experimental evidence from testing two alternative simulation user interfaces designed with varying usability.

The study employed directed research in usability and simulation design to support design of an experiment that addressed the core problem of interface effects on simulation. In keeping with the study goal of demonstrating usability practices, the experimental procedures were analogous to the development processes recommended in supporting literature for usability-based design lifecycles. Steps included user and task analysis, concept and use modeling, paper prototypes of user interfaces for initial usability assessment, interface development and assessment, and user-based testing of actual interfaces with an actual simulation model. The experimental tests employed two interfaces designed with selected usability variations, each interacting with the same core simulation model. The experimental steps were followed by an analysis of quantitative and qualitative data gathered, including data entry time, interaction errors, solution quality measures, and user acceptance data.

The study resulted in mixed support for the hypotheses that improvements in usability of simulation interface elements will improve data entry, solution quality, and overall simulation interactions. Evidence for data entry was mixed, for solution quality was positive to neutral, and for overall usability was very positive. As a secondary benefit, the study demonstrated application of usability-based interface design best practices and processes that could provide guidelines for increasing usability of future discrete-event simulation interface designs. Examination of the study results also provided suggestions for possible future research on the investigation topics.

Files over 10MB may be slow to open. For best results, right-click and select "Save as..."

Share Feedback

  Link to NovaCat

Share

COinS