Abstract
BACKGROUND: Tracheostomy practice in patients with acute respiratory failure (ARF) varies greatly among institutions. This variability has the potential to be reflected in the resources expended providing care. In various healthcare environments, increased resource expenditure has been associated with a favorable effect on outcome.
OBJECTIVE: To examine the association between institutional resource expenditure and mortality in ARF patients managed with tracheostomy.
METHODS: We developed analytic models employing the University Health Systems Consortium (Oakbrook, Illinois) database. Administrative coding data were used to identify patients with the principal diagnosis of ARF, procedures, complications, post-discharge destination, and survival. Mean resource intensity of participating academic medical centers was determined using risk-adjusted estimates of costs. Mortality risk was determined using a multivariable approach that incorporated patient-level demographic and clinical variables and institution-level resource intensity.
RESULTS: We analyzed data from 44,124 ARF subjects, 4,776 (10.8%) of whom underwent tracheostomy. Compared to low-resource-intensity settings, treatment in high-resource-intensity academic medical centers was associated with increased risk of mortality (odds ratio 1.11, 95% CI 1.05–1.76), including those managed with tracheostomy (odds ratio high-resource-intensity academic medical center with tracheostomy 1.10, 95% CI 1.04–1.17). We examined the relationship between complication development and outcome. While neither the profile nor number of complications accumulated differed comparing treatment environments (P > .05 for both), mortality for tracheostomy patients experiencing complications was greater in high-resource-intensity (95/313, 30.3%) versus low-resource-intensity (552/2,587, 21.3%) academic medical centers (P < .001).
CONCLUSIONS: We were unable to demonstrate a positive relationship between resource expenditure and outcome in ARF patients managed with tracheostomy.
- tracheostomy
- acute respiratory failure
- mechanical ventilation
- critical illness
- practice variation
- quality assurance
Introduction
Tracheostomy is one of the most commonly performed surgical procedures among patients with acute respiratory failure (ARF).1–4 Though a minority of all individuals requiring ventilatory support, tracheostomy patients place substantial demands on ventilator, ICU, hospital, and post-hospital discharge resources.5–7 Financial expenditures to support the care of tracheostomy patients are among the highest of any diagnostic or procedural group.8 Efforts to refine tracheostomy practice have the potential to affect both the quality of care provided this segment of the critically ill population, as well as the resources expended delivering this care.9–11
Despite decades of experience, the potential advantages of tracheostomy, relative to prolonged translaryngeal intubation, remain poorly defined, as do the risks associated with this procedure.2,9 The timing of tracheostomy has been particularly debated. Rodriguez et al reported that tracheostomy performed within the first week of ICU admission following major trauma was associated with significantly shorter duration of mechanical ventilation and ICU stay, compared with tracheostomy performed later in the course of respiratory failure.12 Other investigators have confirmed13,14 and contradicted15–17 the putative benefits of early tracheostomy. Three recently completed randomized controlled trials suggest that the timing of tracheostomy does not affect the incidence of infectious complications, duration of mechanical ventilation, or ICU or hospital stay.18–20 Currently, there are no well established standards to guide patient selection or other aspects of this procedure. Absent such standards, tracheostomy appears to be used in, at worst, an arbitrary, or, at best, a variable fashion.5,21,22
As is the case with critical care practice in general, variation in management of tracheostomy patients has the potential to be reflected in variability in the resources utilized in providing care.23 In some healthcare settings, increased resource expenditure appears to be associated with favorable effects on outcome.24–27 We undertook the current investigation to examine the hypothesis that increased resource expenditure associated with the management of tracheostomy patients—controlling for potentially confounding variables—is associated with a beneficial effect on mortality.
QUICK LOOK
Current knowledge
Tracheostomy is one of the most common surgeries in patients with acute respiratory failure. Tracheostomy patients place substantial demands on ICU, hospital, and post-hospital resources. The costs of care for tracheostomy patients are among the highest of any diagnostic or procedural group.
What this paper contributes to our knowledge
There was no positive relationship between resource expenditure and outcome in tracheostomy patients. It is imperative to identify clinically beneficial strategies related to tracheostomy, including patient selection, timing, technique, and post-procedure management, and to assess the cost-effectiveness of these strategies.
Methods
Description of Data Resource and Identification of Patients
This study is based on analysis of the University Health Systems Consortium, (Oakbrook, Illinois) data resource. The University Health Systems Consortium is a network of university-based tertiary care institutions and affiliated hospitals representing 90% of the nation's non-profit academic medical centers. University Health Systems Consortium has developed a highly detailed administrative database that enables comparative analysis in clinical, operational, financial, and patient safety domains among participants.
Adult patients (≥ 18 years of age) with the principal diagnosis of ARF (International Classification of Diseases, 9th Revision [ICD-9] diagnosis code 518.81) and requiring mechanical ventilation were identified through use of the ICD-9 procedure codes for ventilator support of any duration (96.70 Continuous invasive mechanical ventilation of unspecified duration, 96.71 Continuous invasive mechanical ventilation for less than 96 consecutive hours, 96.72 Continuous invasive mechanical ventilation for 96 consecutive hours or more, 96.7 Other continuous invasive mechanical ventilation). Patients undergoing tracheostomy were identified in a similar fashion (31.1 Temporary tracheostomy).
Risk Adjustment
The approach to risk adjustment used in this study has been previously described.28–30 Briefly, 2 independent models (hospital cost and probability of in-patient mortality) were constructed for each diagnosis-related group (DRG) or base Medicare severity DRG. Each model incorporated an all-patient-refined DRG severity of illness or risk of mortality category (severity of illness and risk of mortality each are assigned a score on a 4-point scale of 1 = “minor” to 4 = “extreme”), as well as 29 specific comorbidities identified by the Agency for Healthcare Research and Quality as influencing the outcome of interest.31
For model development, data were partitioned into derivation and validation data sets and assessed using standard diagnostics (concordance index, Hosmer-Lemeshow test, and R2). In the event that it was not possible to develop a stable model by this approach, each case in the DRG or base Medicare severity DRG was assigned the average observed value, stratified first by severity of illness or risk of mortality, and then by transfer status within each severity-of-illness or risk-of-mortality level. Cost of patient care was assessed using the ratio of cost to charges methodology. Detailed charges were collected at the revenue code level and were mapped into departments and cost centers, consistent with the Centers for Medicare and Medicaid Services descriptions. Centers for Medicare and Medicaid Services cost reports were used to obtain service line costs and charges, which were used to calculate a cost-to-charge ratio for each service. In addition, a cost-to-charge ratio for each cost center within the hospital, as well as a global cost-to-charge ratio for the hospital, was generated. These cost-to-charge ratios were used to estimate percentiles for refining or trimming the data, to eliminate outliers. Estimated service center costs were derived from multiplying charges by the cost-to-charge ratio. Total costs were computed by summing individual cost center estimates. A predicted value of cost and probability of mortality were assigned to each patient record in the data set.
Identification of Complications
The University Health Systems Consortium has developed and validated methodology to identify 25 specific complications based on diagnosis and procedural codes: postoperative stroke, aspiration pneumonia, postoperative pulmonary compromise, postoperative gastrointestinal hemorrhage or ulceration, postoperative urinary tract complication, cellulitis or decubitis ulcer, septicemia, postoperative/intra-operative shock due to anesthesia, reopening of surgical site, mechanical complication due to device or implant, miscellaneous complications, shock or respiratory arrest, central or peripheral nervous system complication, postoperative acute myocardial infarction, postoperative myocardial abnormality (excluding myocardial infarction), postoperative infections excluding pneumonia or wounds, procedure related perforations or lacerations, postoperative coma or stupor, postoperative pneumonia, postoperative physiologic or metabolic derangements, complications related to anesthetic or central nervous system agents, venous thrombosis/pulmonary embolism, wound infection, post-procedure hemorrhage or hematoma, and other complications of procedures.
Approach to Analysis
We evaluated the relationship between in-patient mortality, presence of tracheostomy, and resource-intensity using multivariable logistic regression. Resource intensity was operationalized for all ARF patients in a given facility: not for the individual patient. We took this approach because we have previously documented significant inter-institutional differences in tracheostomy practice (in terms of proportion of patients undergoing this procedure, as well as timing) and felt that institution-level resource intensity would reflect this variation.5 Average resource intensity was estimated for each facility by dividing total costs associated with providing care by expected cost, as predicted by the University Health Systems Consortium algorithm. We hypothesized that increased resource intensity would result in a beneficial effect on survival, and took 2 approaches to incorporating resource intensity into our analytic model. In the first approach, resource intensity was modeled as a dichotomous variable, such that a facility that consumed ≥ 25% of predicted resources (ie, a proportional expense ratio ≥ 1.25) was considered high resource intensity, while a facility providing care associated with a proportional expense ratio < 1.25 was considered low resource intensity. Institutional proportional expense ratio was stable over the years included in this study, so we pooled data over this time period for analysis (see the supplementary materials at http://www.rcjournal.com). Stratifying the institutions into high and low resource-intensity categories has the potential to introduce bias. To compensate for this potential bias, and to more generally examine the relationship between resource expenditure and outcome, we also modeled resource intensity as a continuous variable. Univariate analyses were conducted using logistic regression to identify variables that could confound the relationship between mortality and resource use. In building our multivariable model we controlled for the possibility that the relationship between mortality and tracheostomy might vary by level of resource intensity by including these 2 variables as an interaction term. All analyses were conducted using statistics software (SAS 9.2, SAS Institute, Cary North, Carolina). For ease of presentation, findings presented in the Results section represent the dichotomous model; the supplementary materials at http://www.rcjournal.com present the findings of resource intensity modeled as a continuous variable.
Human Subjects Protection
The data used in this analysis represented a limited data set (ie, contained no direct patient identifiers) that was originally collected for non-research purposes. As such, this study was classified as exempt by the Washington University School of Medicine Human Research Protection Office (ie, did not involve human subjects) (HRPO 10–1190).
Results
Characteristics of the Academic Medical Centers, Subjects, and Tracheostomy Practice
We analyzed data from 44,124 subjects with the principal diagnosis of ARF, cared for in 102 academic medical centers (mean ± SD 575 ± 218.1 licensed beds, 432.5 ± 258.5 subjects per center) over a 7-year period (2002 through 2008). Overall, 4,776 subjects (10.8%) underwent tracheostomy (rate per center 10.8 ± 3.0%). The tracheostomy and non-tracheostomy subjects differed significantly with respect to several baseline variables: age, ethnicity, admission status, comorbidity, and payer source (Table 1). The tracheostomy subjects also had a higher morbidity rate, but a lower mortality rate than the non-tracheostomy subjects. The tracheostomy subjects were also more resource-intensive to manage, as evidenced by longer ICU and hospital stay, higher total hospital costs, and greater likelihood of being discharged to an in-patient facility (long-term care facility, skilled nursing facility, rehabilitation facility) (Table 2).
Differences in Tracheostomy Subject Outcomes Analyzed by Resource Intensity of the Care Environment
We analyzed data from 102 university-affiliated academic medical centers. Twelve centers were designated as high resource intensity (ie, proportional expense ratio ≥ 1.25, 4,435 subjects, mean ± SD subjects per center 369.5 ± 200.6), and 90 centers as low resource intensity (ie, proportional expense ratio < 1.25, 39,689 subjects, mean ± SD subjects per center 441.0 ± 265.6). The high and low resource intensity institutions were similar with respect to number of licensed beds (603.6 ± 273.7 vs 571.5 ± 213.8, P = .64) and number of annual discharges of subjects with ARF (370 ± 200 vs 441 ± 265, P = .44). The rates of tracheostomy did not differ, comparing these 2 environments (510/4,435 [11.5%] in the high-resource-intensity institutions vs 4,246/39,689 [10.7%] in the low-resource-intensity institutions, P = .13) (Table 3).
Variables found to be associated with mortality in univariate analysis were age, sex, probability of in-patient mortality, ICU stay, non-ICU stay, ethnicity, admission status (emergency vs non-emergency), payer source, presence of complications, and comorbidities present on admission (Table 4). In our multivariable analysis we found that being cared for in a high-resource-intensity environment was associated with increased risk of mortality (odds ratio = 1.11, 95% CI 1.05–1.76), while use of tracheostomy had no mortality effect (odds ratio = 0.99, 95% CI 0.92–1.06). However, the interaction term in our multivariable model demonstrated that tracheostomy subjects managed in high-resource-intensity settings were at increased risk of death (odds ratio = 1.10, 95% CI 1.04 −1.17) (Table 5). Results were comparable whether resource intensity was modeled as a dichotomous or continuous variable (see the supplementary materials at http://www.rcjournal.com).
We explored possible reasons that might underlie our finding of an unfavorable relationship between resource intensity and outcome for tracheostomy subjects. To examine whether this relationship might be the result of early discharge of subjects at high risk of mortality from low-resource-intensity settings, we analyzed post-hospital discharge destination. We found that there was not a statistically significant trend toward high-resource-intensity settings being more likely to transfer subjects to other in-patient institutions following discharge (skilled nursing facilities 115/406 [28.5%], intermediate care facilities 156/406 [38.5%], rehabilitation centers 72/406 [17.7%], general hospitals 36/406 [8.9%], other environments 26/406 [6.4%], with low-resource-intensity settings being more likely to discharge subjects to home) (Table 6).
We considered whether the increased risk of mortality we observed may be related to an increased number or type of complications in high-resource-intensity settings. However, we found that the average number of complications per subject (1.54 ± 0.65 in low resource intensity vs 1.60 ± 0.22 in high resource intensity, P = .13), the incidence of complications per subject per day (0.036 ± 0.065 in low resource intensity vs 0.034 ± 0.072 in high resource intensity, P = .11), and profile of complications (P > .05 for all) were similar.
Finally, we examined the relationship between complications and mortality. We found that mortality for tracheostomy subjects experiencing complications was greater in the high-resource-intensity than in the low-resource-intensity environments: 95/313 (30.3%) vs 552/2587 (21.3%) (P < .001). In contrast, mortality rates in the tracheostomy subjects with no complications were similar: 41/197 (20.8%) vs 297/1679 (17.7%) (P = .33).
Discussion
The relationship between resource expenditure and outcome in healthcare settings is variable.23–27 Studies have found that higher expenditure was associated with lower 30-day mortality, 1-year mortality, and major cardiac events among patients presenting to acute care hospitals with a variety of diagnoses.24,25 In contrast, Garland et al reported that variation in discretionary resource use among individual medical intensivists did not translate into differences in in-hospital mortality or stay.23 Given the variability in tracheostomy utilization and the resource consumption associated with providing care to patients undergoing this procedure, we examined the effects of resource expenditure in this setting. Consistent with the findings of prior studies, the resource expenditure associated with providing care to this patient population was significant, with total aggregate costs exceeding $1.6 billion.1,3,4 Though representing only 10% of our sample, tracheostomy subjects accounted for 28.4% of these costs (collectively, $463 million). We limited our analysis to subjects with the principal diagnosis of ARF, assuming that indication for tracheostomy would be more consistent across institutions than if all individuals, irrespective of principal diagnosis, were included. Nonetheless, individuals in this study were complex, had substantial comorbidities, and had a death rate of > 25%. The tracheostomy subjects had a lower mortality rate than the non-tracheostomy subjects. Whether this resulted from practitioners targeting tracheostomy to individuals most likely to survive the acute episode of illness, or whether subjects undergoing tracheostomy survived until transfer to a non-acute hospital setting and then succumbed cannot be discerned from this analysis. Furthermore, the tracheostomy subjects had a higher complication rate, longer ICU and hospital stay, and higher overall costs than the non-tracheostomy subjects. We based institutional resource intensity on risk-adjusted estimates of costs associated with providing care. In contrast both to prior studies and our stated hypothesis, we found an inverse relationship between resource expenditure and outcome.23–27 Specifically, compared with low-resource-intensity settings, subjects managed in high-resource-intensity institutions had higher in-hospital mortality, and tracheostomy was associated with as great as 17% higher likelihood of death. Thus, not only did institutions appear to differ with respect to the costs of care, the additional resources expended in high-resource-intensity settings did not appear to positively affect outcome.
We took 2 complementary approaches to performing our analysis: one in which the institutions were stratified into high and low resource-intensity categories, and the second in which resource intensity was modeled as a continuous variable. The intent of this latter approach was to compensate for any bias that discrete modeling of this variable might introduce (ie, arbitrary assignment of the high and low designation). Both methodologies produced comparable findings. We explored reasons that might underlie the observed relationship between resource intensity and mortality. We reasoned that low-resource-intensity environments may appear to have more favorable outcomes for tracheostomy subjects because of more timely transfer to other in-patient settings (such as skilled nursing or long-term weaning facilities). Deaths occurring in such settings would not be captured as in-patient mortality. However, not only were the low and high resource-intensity environments similar with respect to post-hospital discharge destinations, there was a trend for low-resource-intensity environments to more commonly discharge subjects to home. We similarly reasoned that higher rates of complications may underlie the greater resource expenditure and higher mortality in high-resource-intensity environments. Again, we found that low and high-resource-intensity environments were similar with respect to the incidence and total number of complications. However, mortality for the tracheostomy subjects who had complications was greater in the high-resource-intensity environments, suggesting a limited ability to rescue subjects following the development of complications. Potentially, these findings result from important differences in the patient populations between the low and high resource-intensity settings, which were not adequately adjusted for in our analysis. Thus, high-resource-intensity institutions may have managed subjects of greater acuity, explaining more common discharge to in-patient settings and higher mortality following the occurrence of complications. Accordingly, one must be circumspect in these interpretations.
Recent studies examining tracheostomy implementation have focused on specific outcomes such as duration of mechanical ventilation, ICU stay, and sedative use.18–20 One interpretation of the current analysis is that it is difficult to disaggregate the use of tracheostomy from other facets of care. ICUs that apply differing approaches to ventilator weaning, sedation, venous thromboembolism prophylaxis, and other interventions may likewise differ significantly in the manner in which they apply tracheostomy.32–34 Furthermore, post-tracheostomy care (approaches to phonation, nutrition, re-conditioning, and decannulation) might differ among institutions and influence outcome.9 Our data set did not provide us with information on how care was provided, which limits our ability to identify factors and behaviors underlying the outcomes observed. We lack knowledge of factors that might prompt the decision for tracheostomy (eg, repetitive extubation failure, lack of progress on sequential weaning trial attempts). An appreciable proportion of the subjects described in this study had Medicare or Medicaid as a payer source; reimbursement considerations and similar non-clinical factors may have influenced the decision for tracheostomy in some contexts. Determining these factors (eg, through site visits or inventory of practices) and translating approaches effective at well-performing institutions to those that perform suboptimally would be one approach to enhancing patient safety and quality.
Our investigation has several additional limitations. The University Health Systems Consortium is a network of academic medical centers that may be self-selecting in terms of commitment to quality-assurance initiatives and other attributes. The severity of illness and complexity of patients cared for in these institutions may differ substantially from other settings (particularly non-academic institutions), limiting the ability to generalize these findings. In addition, this analysis is based on administrative coding data. These codes are designed to enable billing and are not necessarily a direct reflection of medical care received. Inaccuracy is potentially introduced through code attribution by non-clinical personnel. These shortcomings are partly offset by the fact that such codes are standardized, appropriately updated, and reasonably specific. Their availability in large numbers has the potential to “drown out” statistical noise and error. Also, our analysis might be confounded by the possibility that patient complexity is directly related to both resource intensity and likelihood of poor outcome. We structured our multivariable model so as to control for this possibility, stratifying hospitals based on previously validated risk-adjusted estimates of costs associated with providing care.28–30 Though this method was uniformly applied to all institutions in our sample, it might not adequately account for all factors critical to outcome. For instance, geography and setting (ie, urban, suburban) may be an influential demographic factor that we did not capture.
These and other types of limitations might be further magnified by the lack of inclusion of physiologic data (eg, Acute Physiology and Chronic Health Evaluation score) that might have allowed us to further refine our estimates of illness acuity. Similarly, while we identified a large number of complications, many were defined in the context of the postoperative state. Thus, some important adverse events might go undetected. Finally, we undertook an institution-wide assessment of tracheostomy practice, focusing on patients with ARF. This approach ignores the very real differences in tracheostomy utilization and critical care practice that might exist within specific hospital domains (eg, comparing surgical and medical ICUs), and our findings might not be reflective of other disease processes (eg, acute neurological insult or polytrauma).
Conclusions
We were unable to demonstrate a positive relationship between resource expenditure and outcome in ARF patients managed with tracheostomy. Given the exploratory nature of this study, one must be circumspect about any conclusions drawn. Our analysis does suggest several potential avenues of further inquiry. Among these are investigations that focus on identifying clinically beneficial strategies related to tracheostomy patient selection, timing, technique, and post-procedure management, and assessing the cost-effectiveness of these strategies when applied across diverse clinical environments.
Footnotes
- Correspondence: Bradley D Freeman MD, Department of Surgery, Washington University School of Medicine, 660 South Euclid Avenue, Box 8109, St Louis MO 63110.
Dr Freeman presented a version of this paper at the annual meeting of the United States Critical Illness and Injuries Trials Group, held November 6, 2012, in Bethesda, Maryland.
This research was partly supported National Institutes of Health grant UL1 RR02499. The authors have disclosed no conflicts of interest.
Supplementary material related to this paper is available at http://www.rcjournal.com.
See the Related Editorial on Page 1995
- Copyright © 2013 by Daedalus Enterprises