Inter-observer agreement between physicians, nurses, and respiratory therapists for respiratory clinical evaluation in bronchiolitis

Pediatr Pulmonol. 2009 Aug;44(8):754-62. doi: 10.1002/ppul.21016.

Abstract

Care providers for children with bronchiolitis use various tools to evaluate respiratory status. The use of a single tool by different types of care provider requires a high level of inter-observer agreement, an aspect rarely studied. This study, involving 82 physicians, nurses, and respiratory therapists aimed to evaluate inter-observer agreement for clinical evaluations in children hospitalized for a first episode of bronchiolitis. Respiratory evaluation included three frequently reported parameters of respiratory status: respiratory rate, retraction signs, and wheezing. The frequency of concordance for observers from the same and from different care provider groups was assessed using a weighted kappa statistic and considering all possible combinations of care providers. We also calculated inter-provider agreement as a function of patient age, regardless of care provider type. Overall inter-observer agreement for all provider pairs was 93.1%, with a weighted kappa statistic of 0.72 (95% CI, 0.66-0.78), indicating substantial agreement, with no difference as a function of pair composition. Inter-observer agreements for the various age groups ranged from 87% to 93%, with kappa scores ranging from 0.62 to 0.78. We conclude that a simple clinical evaluation for respiratory status assessment has a high level of inter-observer agreement within and between physicians, nurses and respiratory therapists. Thus, once the validity of this test has been confirmed in a large population sample, it should be possible to use this test to monitor children hospitalized with bronchiolitis and as an endpoint in clinical trials.

MeSH terms

  • Bronchiolitis, Viral / diagnosis*
  • Humans
  • Infant
  • Nurses*
  • Observer Variation
  • Physicians*
  • Respiration
  • Respiratory Sounds
  • Respiratory Therapy*