Evacuation performance evaluation tool

Authors

  • Sharon Farra, PhD, RN, CNE
  • Elaine T. Miller, PhD, RN, CRRN, FAAN
  • Matthew Gneuhs, CHEP
  • Nathan Timm, MD
  • Gengxin Li, PhD
  • Ashley Simon, RN, MSN
  • Whittney Brady, DNP, RN

DOI:

https://doi.org/10.5055/ajdm.2016.0232

Keywords:

disaster exercise, performance tool, inter-rater reliability, instrument development, evacuation exercise

Abstract

Objective: Hospitals conduct evacuation exercises to improve performance during emergency events. An essential aspect in this process is the creation of reliable and valid evaluation tools. The objective of this article is to describe the development and implications of a disaster evacuation performance tool that measures one portion of the very complex process of evacuation.

Design: Through the application of the Delphi technique and DeVellis's framework, disaster and neonatal experts provided input in developing this performance evaluation tool. Following development, content validity and reliability of this tool were assessed.

Setting: Large pediatric hospital and medical center in the Midwest.

Participants: The tool was pilot tested with an administrative, medical, and nursing leadership group and then implemented with a group of 68 healthcare workers during a disaster exercise of a neonatal intensive care unit (NICU).

Results: The tool has demonstrated high content validity with a scale validity index of 0.979 and inter-rater reliability G coefficient (0.984, 95% CI: 0.948-0.9952).

Conclusions: The Delphi process based on the conceptual framework of DeVellis yielded a psychometrically sound evacuation performance evaluation tool for a NICU.

Author Biographies

Sharon Farra, PhD, RN, CNE

Assistant Professor, College of Nursing, Wright State University, Dayton, Ohio

Elaine T. Miller, PhD, RN, CRRN, FAAN

Professor of Nursing, College of Nursing, University of Cincinnati, Cincinnati, Ohio

Matthew Gneuhs, CHEP

Program Manager, Emergency Preparedness and Response, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio

Nathan Timm, MD

Attending Physician, Division of Emergency Medicine, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio, USA; Professor of Clinical Pediatrics, College of Medicine, University of Cincinnati, Cincinnati, Ohio

Gengxin Li, PhD

Assistant Professor, Department of Mathematics and Statistics, Wright State University, Dayton, Ohio

Ashley Simon, RN, MSN

Education Specialist II, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio

Whittney Brady, DNP, RN

Clinical Director, Newborn Intensive Care Unit, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio

References

The Joint Commission: Requirements for emergency management oversight. Available at http://www.jointcommission.org/assets/1/18/JCP0713_Emergency_Mgmt_Oversight.pdf. Accessed March 28, 2016.

Centers for Medicare and Medicaid: Emergency preparedness checklist recommended tool for effective health care facility planning. December 2013. Available at https://www.cms.gov/Medicare/Provider-Enrollment-and-Certification/SurveyCertEmergPrep/Downloads/SandC_EPChecklist_Provider.pdf. Accessed April 2, 2016.

Department of Homeland Security: Homeland Security Exercise and Evaluation Program (HSEEP). Available at http://www.fema.gov/media-library-data/20130726-1914-25045-8890/hseep_apr13_.pdf. Accessed March 26, 2016

Timm N, Gneuhs M: Pediatric Hospital Incident Command System (PHICS)—An innovative approach to hospital emergency management. J Trauma Injury Infection Crit Care. 2011; 71(5): S549-S554.

DeVellis RF: Scale Development: Theory and Applications. 3rd. ed. Los Angeles, CA: Sage, 2012.

Lynn MR: Determination and quantification of content validity. Nurs Res. 1986; 35: 382-385.

Gwet KL: The Handbook of Inter-Rater Reliability. 4th ed. Gaithersburg, MD: Advanced Analytics, LLC, 2014.

Crick J, Brennan R: GENOVA. Iowa City, IA: University of Iowa, 2001.

Brennan RL: Generalizability Theory. New York: Springer-Verlag, 2001.

Linacre JM: Many-Facet Rasch Measurement. Chicago, IL: MESA Press, 1989.

Lynch BK, McNamara TF: Using G-theory and many-facet Rasch measurement in the development of performance assessments of the ESL speaking skills of immigrants. Language Test. 1998; 15: 158-180.

Downloads

Published

04/01/2016

How to Cite

Farra, PhD, RN, CNE, S., E. T. Miller, PhD, RN, CRRN, FAAN, M. Gneuhs, CHEP, N. Timm, MD, G. Li, PhD, A. Simon, RN, MSN, and W. Brady, DNP, RN. “Evacuation Performance Evaluation Tool”. American Journal of Disaster Medicine, vol. 11, no. 2, Apr. 2016, pp. 131-6, doi:10.5055/ajdm.2016.0232.

Issue

Vol. 11 No. 2 (2016): Spring

Section

Articles

License

Copyright 2007-2023, Weston Medical Publishing, LLC 
All Rights Reserved