Article Text

Change in practice after the Surfactant, Positive Pressure and Oxygenation Randomised Trial
  1. Jaclyn M LeVan1,2,
  2. Luc P Brion1,
  3. Lisa A Wrage3,
  4. Marie G Gantz3,
  5. Myra H Wyckoff1,
  6. Pablo J Sánchez1,4,
  7. Roy Heyne1,
  8. Mambarambath Jaleel1,
  9. Neil N Finer5,
  10. Waldemar A Carlo6,
  11. Abhik Das3,
  12. Barbara J Stoll7,
  13. Rosemary D Higgins8
  14. on behalf of the Eunice Kennedy Shriver NICHD Neonatal Research Network, Bethesda, MD
  1. 1Department of Pediatrics, University of Texas Southwestern Medical Center, Dallas, Texas, USA
  2. 2Pediatrix Medical Group, San Antonio, Texas, USA
  3. 3Social, Statistical and Environmental Sciences Unit, RTI International, Research Triangle Park, North Carolina, USA
  4. 4Nationwide Children's Hospital, The Ohio State University, Columbus, Ohio, USA
  5. 5Division of Neonatology, University of California, San Diego, California, USA
  6. 6Division of Neonatology, University of Alabama at Birmingham, Birmingham, Alabama, USA
  7. 7Department of Pediatrics, Emory University School of Medicine, Children's Healthcare of Atlanta, Atlanta, Georgia, USA
  8. 8Eunice Kennedy Shriver National Institute of Child, Health and Human Development, Bethesda, Maryland, USA
  1. Correspondence to Dr Luc P Brion, The University of Texas Southwestern Medical Center, 5323 Harry Hines Boulevard, STOP 9063, Dallas, TX 75390-9063, USA; luc.brion{at}utsouthwestern.edu

Abstract

Objective To test the hypothesis that the proportion of endotracheal intubation (ETI) in the delivery room (DR) decreased in Neonatal Research Network (NRN) centres after the National Institute of Child Health and Human Development NRN Surfactant, Positive Pressure, and Oxygenation Randomised Trial (SUPPORT).

Design Retrospective cohort study using the prospective NRN generic database.

Setting Eleven centres that participated in the SUPPORT trial and remained part of the NRN. Preterm neonates 240/7–276/7 weeks’ gestational age enrolled in the SUPPORT trial were randomised to: (1) DR continuous positive airway pressure or DR ETI with early surfactant administration; and (2) oxygen saturation targets of 85–89% or 91–95%. The prior NRN feasibility trial had assessed the feasibility of randomisation to continuous positive airway pressure versus ETI.

Patients Infants 240/7–276/7 weeks’ gestational age, excluding infants with syndromes or major malformations and those on comfort care only.

Main outcome measure Proportion of DR ETI.

Results The proportion of DR ETI decreased significantly in the group of infants from centres that had not participated in the feasibility trial (91% before vs 75% after SUPPORT, adjusted relative risk 0.86, 95% CI 0.83–0.89, p<0.0001) but not in the group of infants from the other centres, where the proportion of ETI was already lower prior to initiation of the SUPPORT trial (61% before vs 58% after SUPPORT, adjusted relative risk 0.96, 95% CI 0.89 to 1.05, p=0.40).

Conclusion This study shows that DR ETI changed after SUPPORT only in NRN centres that had not participated in a similar trial.

Trial registration number NCT00063063 (GDB) and NCT00233324 (SUPPORT).

  • Neonatology
  • Respiratory
  • Clinical Procedures
  • Data Collection

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

What is already known on this topic

  • A centre's participation in an unblinded randomised trial may affect the process of care of non-enrolled patients during the trial and before the release of its results.

What this study adds

  • The proportion of delivery room intubations (a process of care) decreased after the SUPPORT trial at centres that had not participated previously in a related trial, but not at other centres.

  • This study provides additional evidence suggesting that participation of a centre in unblinded randomised trials may affect the process of care of non-enrolled patients.

Introduction

The Eunice Kennedy Shriver National Institute of Child Health and Human Development Neonatal Research Network (NRN) Surfactant, Positive Pressure, and Oxygenation Randomised Trial (SUPPORT) was a multicentre randomised controlled trial (RCT), in which preterm infants of 240/7 to 276/7 weeks gestational age (GA) were randomised at birth to (1) either continuous positive airway pressure (CPAP) initiated in the delivery room (DR) and protocol-driven limited ventilation begun in the DR, or endotracheal intubation (ETI) with early surfactant administration followed by a conventional ventilation strategy, and (2) one of two oxygen saturation targets1 ,2 From 2005 through 2009, 1316 infants were enrolled in 20 centres.1 ,2 The results of SUPPORT were released to NRN centres in December 2009.1 ,2 The risk of the primary outcome of the CPAP trial (death or bronchopulmonary dysplasia (BPD) at 36 weeks postmenstrual age) was not significantly different between the CPAP and the ETI groups.1

The NRN previously conducted another trial in five centres, to determine the feasibility of randomisation to DR CPAP versus DR ETI and the GA range that would be most appropriate for SUPPORT.3

A previous study in one NRN centre that had not participated in the feasibility trial demonstrated that the proportion of DR ETI changed among eligible but non-enrolled neonates of 240/7 to 276/7 weeks and non-eligible neonates of 280/7 to 346/7 weeks during SUPPORT and before release of its results.4 Thus, a centre's participation in an unblinded RCT may affect process of care of non-enrolled patients. It is not known whether prior exposure of a centre to a RCT might affect the change in process of care associated with the conduct of an unblinded RCT involving a similar intervention.

The objective of this study was to determine if the proportion of DR ETI (a process of care) decreased after SUPPORT in participating centres. We hypothesised that after SUPPORT there would be a decrease in DR ETI in preterm infants 240/7 to 276/7 weeks GA. We hypothesised that the degree of change in proportion of DR ETI in each centre after SUPPORT would depend on the proportion before the trial. We also hypothesised that the change in DR ETI after SUPPORT would be less at centres that had participated in the feasibility trial than at the other centres.

Methods

Study design

This was a retrospective birth cohort analysis with before/after design. We extracted data from the National Institute of Child Health and Human Development Generic Database (GDB) (a registry of very low birthweight infants admitted to NRN centres) in one cohort of patients born before SUPPORT and in a second cohort born after release of the results of SUPPORT to NRN centres. The GDB collects detailed maternal pregnancy/delivery data and baseline, treatment and outcome data on infants using standardised protocols and forms. Data are collected to death, discharge or 120 days ‘status’, whichever comes first, and limited additional data are collected on infants who remain in the hospital at 120 days. We included the 11 centres that participated in SUPPORT and were part of the NRN during the entire study period (2003–2012). Of these centres, three had participated in the feasibility trial.

Study population

The first cohort includes patients born during a period preceding SUPPORT (1 January 2003–31 December 2004). The second cohort includes preterm patients born after release of the results of SUPPORT to NRN centres (1 January 2010–31 December 2012).

Eligibility and exclusion criteria

Criteria were similar to those used in SUPPORT.1 ,2 Specifically, eligible infants were 240/7 to 276/7 weeks GA at birth by best obstetrical estimate, delivered at a NRN centre participating in SUPPORT. Exclusion criteria were: known malformations, and respiratory support (first cohort) or medical therapy (second cohort) withheld or withdrawn at any time prior to death <12 h. The last criterion was different from SUPPORT, where patients were included if a decision had been made to provide full resuscitation.

Baseline variables

Neonatal and maternal characteristics included birth weight, GA, gender, race/ethnicity, prenatal steroid use, mode of delivery, multiple birth, prolonged rupture of membranes, maternal hypertension, diabetes or antibiotic use before delivery.

Outcome variables

The primary outcome variable was a practice variable, DR ETI, which was defined as ETI for ventilation (excluding intubation done for suctioning or to give surfactant and immediately removed).

Secondary outcomes of prime interest included (1) the composite of death or BPD (oxygen use at 36 weeks postmenstrual age, as defined in SUPPORT), (2) the composite of severe retinopathy of prematurity (ROP) (defined as ROP surgery, retinal detachment or treatment with a drug antivascular endothelial growth factor) or death before discharge and (3) death before discharge. The definitions of BPD and ROP for this study were those used in the GDB; however in SUPPORT primary outcomes also included the physiological definition of BPD, and severe ROP was determined using examinations continued until the outcome of SUPPORT was reached or resolution occurred.1 ,2

Additional outcomes are described in table 3 and in the online supplementary appendix. Outcome variables were selected a priori, except the proportion of babies who were never intubated (see online supplementary appendix).

Statistical analysis

Variables of interest were compared by study group using χ2 tests for categorical variables, Wilcoxon tests for Apgar scores and skewed continuous variables, and Student t tests for all other continuous variables. Robust Poisson regression models were used for dichotomous outcomes to obtain adjusted relative risks and 95% CIs. General linear models were used for continuous outcomes to obtain differences in adjusted means and 95% CI. All models included an indicator for study group (post-SUPPORT vs pre-SUPPORT), NRN centre, and prespecified prenatal covariates shown to affect outcomes in very preterm infants5 (GA, antenatal corticosteroids, gender, singleton vs multiple, birth weight by 100 g increment) as well as additional covariates that were significantly different by study group (p<0.10) in the unadjusted tests, and that preceded the outcome. The models for the primary and secondary outcomes, with the exception of BPD, included additional variables that preceded birth (race/ethnicity, caesarean section, rupture of membranes >24 h, maternal hypertension, maternal diabetes and NRN centre), but not postnatal variables to which some infants may not have been exposed before the outcome took place. The model for BPD contained the same variables that preceded birth as well as DR ETI, surfactant, fractional inspired oxygen (FiO2) at 24 h, patent ductus arteriosus ligation, patent ductus arteriosus indometacin treatment and late onset sepsis.6–15 To assess whether the change in proportion of DR ETI varied across the subgroups of infants in centres who did and did not participate in the feasibility trial we used stratified χ2 tests and also included an indicator for these subgroups and its interaction with the pre-SUPPORT versus post-SUPPORT indicators in the DR ETI model. Since we did not adjust p values for multiple comparisons, all secondary and tertiary analyses should be considered as exploratory. A Spearman correlation was used with aggregate centre data to assess whether the change in proportion of DR ETI from the first cohort to the second cohort was higher in centres with higher proportion of DR ETI during the first period.

Sample size analysis

In 1993–1997 the intubation rate among extremely low birthweight infants in the NRN was 80%. Based on available GDB data when the study was designed, a first 2-year cohort and a second 3-year cohort were expected to yield approximately 2400 neonates each. This sample size was sufficient for detecting a reduction in ETI from 80% to 60% with a type I error less than 5% and a power greater than 99%.

Approvals

The institutional review board of each participating centre has approved the GDB and SUPPORT. The protocol was approved by the NRN GDB and steering committees.

Results

Maternal and neonatal characteristics

The study population included 3849 inborn infants: 1617 infants in the pre-SUPPORT group and 2232 infants in the post-SUPPORT group (figure 1). The baseline maternal and neonatal characteristics of the pre-SUPPORT and post-SUPPORT groups are shown in table 1.

Table 1

Maternal and neonatal characteristics*

Figure 1

Flow diagram representing all infants in the Generic Database during the two study periods and those included in the study.

Primary outcome

Using aggregate centre data, figure 2 shows the proportion of infants intubated in the DR during the first and second study periods in all centres in the study. The correlation between the proportion of DR ETI during the first period and the change in proportion of DR ETI from the first period to the second period was not significant (Spearman correlation coefficient −0.44, p=0.18). The three centres with the lowest baseline proportion were those that had participated in the feasibility trial.

Figure 2

Per cent delivery room intubations in pre/post-SUPPORT periods for the eleven Neonatal Research Network (NRN) centres included in this study.

In the model for DR ETI the interaction term between the pre-SUPPORT versus the post-SUPPORT indicators and the indicator for the subgroups of centres that did and did not participate in the feasibility trial was statistically significant (p=0.01). This indicates that the change in proportion of DR ETI was different in the two subgroups, thus results for DR ETI are presented within subgroup (table 2). The proportion of DR ETI did not decrease significantly after SUPPORT among infants from centres that had participated in the feasibility trial but decreased significantly among infants from the other centres.

Table 2

Primary outcome

Other outcomes

The adjusted risks of BPD or death, severe ROP or death, severe ROP, and death or mechanical ventilation at day 7 of life were significantly lower in the post-SUPPORT group (table 3). Several processes of care and outcomes changed after SUPPORT (see online supplementary appendix). The proportion of babies who were never intubated increased from 5.6% before SUPPORT to 11.4% after SUPPORT (p<0.001).

Table 3

Secondary outcomes*

Discussion

Among infants 240/7 weeks to 276/7 weeks GA born in 11 centres participating in SUPPORT, the proportion of infants with DR ETI significantly decreased after SUPPORT at centres that had not participated in the feasibility trial, but not at the three centres that had participated in the feasibility trial, and thus had experience with unblinded randomisation to CPAP versus ETI in the DR. In one of these three centres, the proportion of ETI had already decreased in 2000, after prospective introduction of routine, early, bubble nasal CPAP.16

The strengths of this study include the large sample size; the use of a prospective data base of inborn patients; the use of multivariate analysis; inclusion and exclusion criteria that were similar to those in SUPPORT; inclusion of centres with or without prior participation in a similar trial; and inclusion of centres that remained in the NRN, thereby limiting bias due to large interinstitutional differences.

Limitations of this study include the observational before/after study design; the high percentage of exclusions; lack of information on DR CPAP, oxygen saturation and individual decisions about DR ETI; and lack of information on policies and practice guidelines in NRN centres. We decided against conducting a survey of clinical practices because information in queries is usually obtained from a single individual and may not be reflective of all practitioners at individual sites. The study lacked serial data and data from centres that did not participate in SUPPORT, thereby preventing analysis of secular trends and of the exact time when DR ETI changed in each centre. Nevertheless, in another study the proportion of DR ETI in one NRN centre decreased in non-enrolled patients during SUPPORT and before its publication, in the absence of any changes in DR policy or practice guidelines.4 In that centre, DR ETI decreased by 22% during/after SUPPORT. In contrast, DR ETI decreased by only 1.6% in another large contemporaneous cohort of infants participating in the Vermont Oxford Network.4

This study did not address how generalisable the study results might be to other centres. Centres participating in SUPPORT might have developed experience with T-piece connectors and with tight oxygen monitoring during SUPPORT. Further studies are needed to investigate how participating in a RCT might affect individual decisions about process of care. A trial in which centres are randomly allocated to participation in an unblinded RCT would allow to test whether such participation may affect process of care and outcomes in enrolled and non-enrolled patients during and after conducting a RCT.

Conclusion

The proportion of a process of care, DR ETI, decreased significantly after SUPPORT at centres that had not previously participated in a similar trial but not at other centres. This study suggests that participation of a centre in randomised trials may affect process of care of non-enrolled patients.

Acknowledgments

The National Institutes of Health, the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD), the National Center for Research Resources, and the National Center for Advancing Translational Sciences provided grant support for the Neonatal Research Network's Generic Database Study. The content of the publication is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

References

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Files in this Data Supplement:

Footnotes

  • Collaborators Data collected at participating sites of the NICHD Neonatal Research Network (NRN) were transmitted to RTI International, the data coordinating centre (DCC) for the network, which stored, managed and analysed the data for this study. One behalf of the NRN, AD (DCC Principal Investigator),LAW and MGG (DCC Statisticians) had full access to all of the data in the study, and with the NRN Center Principal Investigators, take responsibility for the integrity of the data and accuracy of the data analysis. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. We are indebted to our medical and nursing colleagues and the infants and their parents who agreed to take part in this study. The eleven NRN centres that remained in the NICHD NRN during the duration of this study included: Brown University; Case Western Reserve University; Cincinnati Children’s Hospital Medical Center; Duke University; Emory University; Indiana University; Stanford University; University of Alabama at Birmingham; University of Texas Health Science Center at Houston; University of Texas Southwestern Medical Center; Wayne State University. Preliminary data were presented as a poster. JML, LPB, LAW, on behalf of the NICHD NRN. Changes in therapy and outcomes associated with the SUPPORT Trial. Poster presentation at the Paediatric Academy Society Meeting, Washington DC, May 5, 2013. E-PAS2013:2924.474.

  • Contributors JML: designed the study, drafted the protocol and the initial manuscript, and approved the final manuscript as submitted. LPB: conceptualised and designed the study, edited the protocol and the initial manuscript, revised the manuscript and approved the final manuscript as submitted. He had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. LAW: edited the protocol, conducted the statistical analysis, edited the initial manuscript and approved the final manuscript as submitted. She had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. MGG, MHW, PJS, RH, MJ, NNF, WAC, AD, BJS and RDH: edited the protocol and the initial manuscript, and approved the final manuscript as submitted.

  • Funding The Study Sponsor, the National Institute of Child Health and Human Development (NICHD), did not have any role in the study design; in the collection, analysis and interpretation data; in the writing of the report; and in the decision to submit the paper for publication. Supported by grants from the Eunice Kennedy Shriver National Institute of Child Health and Human Development (U10 HD21364, U10 HD21373, U10 HD21385, U10 HD27851, U10 HD27853, U10 HD27856, U10 HD27880, U10 HD27904, U10 HD34216, U10 HD36790, U10 HD40461, U10 HD40492, U10 HD40689), the National Center for Research Resources (M01 RR30, M01 RR32, M01 RR39, M01 RR70, M01 RR80, M01 RR633, M01 RR750, M01 RR8084), and the National Center for Advancing Translational Sciences (UL1 TR6, UL1 TR77, UL1 TR93, UL1 TR371, UL1 TR454, UL1 TR1117).

  • Competing interests None.

  • Patient consent Obtained.

  • Ethics approval The IRB of each participating centre.

  • Provenance and peer review Not commissioned; externally peer reviewed.

Linked Articles

  • Fantoms
    Martin Ward Platt