Archive

A Pilot Study on Usability Analysis of Emergency Department Information System by Nurses

Journal: Applied Clinical Informatics
ISSN: 1869-0327
DOI: https://doi.org/10.4338/ACI-2011-11-RA-0065
Issue: Vol. 3: Issue 1 2012
Pages: 135-153

A Pilot Study on Usability Analysis of Emergency Department Information System by Nurses

Research Article

M. S. Kim (1, 2), J. S. Shapiro (2, 3), N. Genes (3), M. V. Aguilar (4), D. Mohrer (2), K. Baumlin (3), J. L. Belden (5)

(1) Department of Health Management and Informatics, University of Missouri School of Medicine, Columbia, MO, USA; (2) Center for Biomedical Informatics, Mount Sinai School of Medicine, New York, NY; (3) Emergency Department, Mount Sinai School of Medicine, New York, NY; (4) Information Technology, Mount Sinai Medical Center, New York, NY; (5) Family and Community Medicine, University of Missouri School of Medicine, Columbia, MO, USA

Keywords

Electronic health records, emergency department information system, EDIS, usability engineering

Summary

Objectives: Employing new health information technologies while concurrently providing quality patient care and reducing risk is a major challenge in all health care sectors. In this study, we investigated the usability gaps in the Emergency Department Information System (EDIS) as ten nurses differentiated by two experience levels, namely six expert nurses and four novice nurses, completed two lists of nine scenario-based tasks.

Methods: Standard usability tests using video analysis, including four sets of performance measures, a task completion survey, the system usability scale (SUS), and sub-task analysis were conducted in order to analyze usability gaps between the two nurse groups.

Results: A varying degree of usability gaps were observed between the expert and novice nurse groups, as novice nurses completed the tasks both less efficiently, and expressed less satisfaction with the EDIS. The most interesting finding in this study was the result of ‘percent task success rate,’ the clearest performance measure, with no substantial difference observed between the two nurse groups. Geometric mean values between expert and novice nurse groups for this measure were 60% vs. 62% in scenario 1 and 66% vs. 55% in scenario 2 respectively, while there were some marginal to substantial gaps observed in other performance measures. In addition to performance measures and the SUS, sub-task analysis highlighted navigation pattern differences between users, regardless of experience level.

Conclusion: This study will serve as a baseline study for a future comparative usability evaluation of EDIS in other institutions with similar clinical settings.

You may also be interested in...

1.

Section 5: Decision Support, Knowledge Representation and Management

Survey

T. Y. Leong (1), K. Kaiser (2), S. Miksch (2, 3)

Yearb Med Inform 2007 : 74-86

2.

S. Garde1 , P. Knaup2 , E. J. S. Hovenga1 , S. Heard 1, 3

Methods Inf Med 2007 46 3: 332-343

https://doi.org/10.1160/ME5001

3.

Reviews

D. Kalra

Yearb Med Inform 2006 : 136-144