Intra-rater/inter-rater reliability of the air transport minimum data set

Abstract 

Introduction

The Air Transport Minimum Data Set consists of time-related terms proposed for use during rotor-wing transport. Reliable data collection is vital for monitoring safety, providing medical care, and meeting regulatory standards and financial constraints. The purpose of this research was to conduct a pilot study to investigate the intra-rater and inter-rater reliability of the ATMDS.

Setting

Three communication specialists at a rotor-wing air transport service in rural Nebraska participated.

Methods

This prospective study examined time data elements recorded during 11 rotor wing transports. At approximately 2 weeks, subjects again collected time data while listening to audio recordings of their original flights and while listening to four additional flights conducted by a colleague.

Results

Because of the small sample size, descriptive statistics rather than correlation coefficients were used to evaluate reliability. Data for both inter-rater and intra-rater reliability varied greatly across terms. As with previous research, Time Arrive Bedside and Time Depart Bedside were particularly problematic. Calculated times had less agreement than times for specific events.

Conclusions

The study results were limited by sample size but showed the need for clarification of definitions for specific terms. Further investigation is needed related to how time intervals are calculated.