Open Access Open Access  Restricted Access Subscription or Fee Access

Evacuation performance evaluation tool

Sharon Farra, PhD, RN, CNE, Elaine T. Miller, PhD, RN, CRRN, FAAN, Matthew Gneuhs, CHEP, Nathan Timm, MD, Gengxin Li, PhD, Ashley Simon, RN, MSN, Whittney Brady, DNP, RN

Abstract


Objective: Hospitals conduct evacuation exercises to improve performance during emergency events. An essential aspect in this process is the creation of reliable and valid evaluation tools. The objective of this article is to describe the development and implications of a disaster evacuation performance tool that measures one portion of the very complex process of evacuation.

Design: Through the application of the Delphi technique and DeVellis's framework, disaster and neonatal experts provided input in developing this performance evaluation tool. Following development, content validity and reliability of this tool were assessed.

Setting: Large pediatric hospital and medical center in the Midwest.

Participants: The tool was pilot tested with an administrative, medical, and nursing leadership group and then implemented with a group of 68 healthcare workers during a disaster exercise of a neonatal intensive care unit (NICU).

Results: The tool has demonstrated high content validity with a scale validity index of 0.979 and inter-rater reliability G coefficient (0.984, 95% CI: 0.948-0.9952).

Conclusions: The Delphi process based on the conceptual framework of DeVellis yielded a psychometrically sound evacuation performance evaluation tool for a NICU.


Keywords


disaster exercise, performance tool, inter-rater reliability, instrument development, evacuation exercise

Full Text:

PDF

References


The Joint Commission: Requirements for emergency management oversight. Available at http://www.jointcommission.org/assets/1/18/JCP0713_Emergency_Mgmt_Oversight.pdf. Accessed March 28, 2016.

Centers for Medicare and Medicaid: Emergency preparedness checklist recommended tool for effective health care facility planning. December 2013. Available at https://www.cms.gov/Medicare/Provider-Enrollment-and-Certification/SurveyCertEmergPrep/Downloads/SandC_EPChecklist_Provider.pdf. Accessed April 2, 2016.

Department of Homeland Security: Homeland Security Exercise and Evaluation Program (HSEEP). Available at http://www.fema.gov/media-library-data/20130726-1914-25045-8890/hseep_apr13_.pdf. Accessed March 26, 2016

Timm N, Gneuhs M: Pediatric Hospital Incident Command System (PHICS)—An innovative approach to hospital emergency management. J Trauma Injury Infection Crit Care. 2011; 71(5): S549-S554.

DeVellis RF: Scale Development: Theory and Applications. 3rd. ed. Los Angeles, CA: Sage, 2012.

Lynn MR: Determination and quantification of content validity. Nurs Res. 1986; 35: 382-385.

Gwet KL: The Handbook of Inter-Rater Reliability. 4th ed. Gaithersburg, MD: Advanced Analytics, LLC, 2014.

Crick J, Brennan R: GENOVA. Iowa City, IA: University of Iowa, 2001.

Brennan RL: Generalizability Theory. New York: Springer-Verlag, 2001.

Linacre JM: Many-Facet Rasch Measurement. Chicago, IL: MESA Press, 1989.

Lynch BK, McNamara TF: Using G-theory and many-facet Rasch measurement in the development of performance assessments of the ESL speaking skills of immigrants. Language Test. 1998; 15: 158-180.




DOI: https://doi.org/10.5055/ajdm.2016.0232

Refbacks

  • There are currently no refbacks.