Abstract
Purpose
To evaluate, in adults, the diagnostic accuracy of the cuff-leak test for the diagnosis of upper airway obstruction secondary to laryngeal edema and for reintubation secondary to upper airway obstruction.
Methods
Systematic review without language restrictions based on electronic databases and manual review of the literature up to December 2008. When appropriate, a random-effects meta-analysis and meta-regression (Moses’ method) were performed.
Results
Upper airway obstruction was the outcome in nine studies with an overall incidence of 6.9%. There was significant heterogeneity among studies. The pooled sensitivity was 0.56 (95% confidence interval: 0.48–0.63), the specificity was 0.92 (95% CI: 0.90–0.93), the positive likelihood ratio was 5.90 (95% CI: 4.00–8.69), the negative likelihood ratio was 0.48 (95% CI: 0.33–0.72), and the diagnostic odds ratio was 18.78 (95% CI: 7.36–47.92). The area under the curve of the summary receiver-operator characteristic (SROC) was 0.92 (95% CI: 0.89–0.94). Only three studies have evaluated the accuracy of the cuff-leak test for reintubation secondary to upper airway obstruction. Overall incidence was 7%. The pooled sensitivity was 0.63 (95% CI: 0.38–0.84), the specificity was 0.86 (95% CI: 0.81–0.90), the positive likelihood ratio was 4.04 (95% CI: 2.21–7.40), the negative likelihood ratio was 0.46 (95% CI: 0.26–0.82), and the diagnostic odds ratio was 10.37 (95% CI: 3.70–29.13).
Conclusions
A positive cuff-leak test (absence of leak) should alert the clinician of a high risk of upper airway obstruction.
Similar content being viewed by others
Introduction
Airway obstruction, often secondary to laryngeal edema, is one of the primary causes of respiratory distress after extubation [1]. The frequency of this complication in patients in the intensive care unit is estimated to range between 3 and 30%, of which between 1 and 5% require re-intubation [2].
The occurrence of upper airway obstruction after extubation is difficult to predict. As the presence of an endotracheal tube precludes direct visualization of the upper airway prior to extubation, a cuff-leak test might be useful in an effort to screen for an airway obstruction before extubation. This test consists of deflating the balloon cuff of the endotracheal tube in order to assess the air leak around the tube, which can indirectly assess the upper airway patency. A small leak or the complete absence of one would be suggestive of an airway obstruction. The result of the test can be expressed as qualitative (presence or not of leak around the tube) or quantitative. Several studies have assessed the ability of the cuff-leak test to predict upper airway obstruction secondary to laryngeal edema. The results of these studies, individually considered, lack statistical precision to be used for making medical decisions. A systematic review and a meta-analysis might improve the precision of the individual studies and provide information on the consistency of results and sources of heterogeneity.
We performed a systematic review with meta-analysis to assess the diagnostic accuracy of the cuff-leak test in the diagnosis of upper airway obstruction secondary to laryngeal edema and for reintubation secondary to upper airway obstruction.
Methods
Search strategy and study selection
We searched the following electronic databases: Medline, Embase, CINAHL, CANCERLIT, Pascal-Biomed, ACP Journal Club, Cochrane Library (CDSR, DARE, CCTR), ISI Proceedings, Current Contents and Web of Science. We searched electronic databases updated to December 2008. For the electronic search, we used the following terms or MeSH subject headings: “respiration, artificial,” “intubation, intratracheal,” “airway, obstruction,” “laryngeal, edema,” “weaning,” “reintubation,” “cuff leak,” and "diagnosis," "sensitivity," "specificity," "predictive value," "likelihood ratio," "false positive" and "false negative." Search in Medline was limited to “adult-all” and “human.” No language restriction was used. Further searches were performed by manually reviewing abstracts, conference proceedings and review articles.
We included all studies that met the following criteria: including more than 50 patients, assessing the diagnostic accuracy of the cuff-leak test for upper airway obstruction secondary to laryngeal edema and/or reintubation due to upper airway obstruction, and providing sufficient information to construct the 2 × 2 contingency table for individual study subjects. Two reviewers (MEO and MCM) independently judged study eligibility while screening the references.
Data extraction
Three reviewers (MEO, MCM and FFV) independently extracted data from each study to obtain information on patient demographics, sample size, test methods, diagnostic cutoff points, participant characteristics, sensitivity and specificity of the data, and methodological quality. Each reviewer extracted the data to construct a 2 × 2 table. Any disagreements were resolved by consensus between them.
Quality assessment
The methodological quality of each study was assessed by two authors (MCM and FFV), using a checklist based on criteria adapted from the quality assessment for studies of diagnostic accuracy (QUADAS) tool (maximum score 14 × 2) [3, 4].
Statistical analysis
For each study, the sensitivity, specificity, positive and negative likelihood ratios, and a diagnostic odds ratio (OR) were calculated according to following formulas: Sensitivity = [number of true positives/(number of true positives + number of false negatives)]; specificity = [number of true negatives/(number of true negatives + number of false positives)]; positive likelihood ratio = [sensitivity/(1 − specificity)]; negative likelihood ratio [(1 − sensitivity)/specificity] and diagnostic odds ratio = [sensitivity/(1 − sensitivity)]/[(1 − specificity)/specificity].
The threshold effect derived from using different cutoff points was assessed using the method of Littenberg and Moses [5]. This method allows summary receiver-operator characteristic (SROC) curves to be drawn that summarize the study results, and to assess the impact of individual variables such as the quality of the study on the test accuracy. To detect heterogeneity, the likelihood ratios and diagnostic odds ratios were analyzed using Cochran’s Q test. To quantify the extent of heterogeneity, the I 2 statistic was used to measure the percentage of variability between summary indices that were due to heterogeneity rather than chance. A study with an I 2 greater than 50% indicated substantial heterogeneity. Pooling of the individual indices was performed using DerSimonian and Laird’s random-effects model. Publication bias was examined visually by inspecting funnel plots and statistically by using the Egger regression model [6]. Analyses were performed using Stata, MetaDisc [7] and StatsDirect.
Results
Studies included
With the defined search strategy, 26 studies were identified as potentially eligible. After abstract review we selected 13 studies [8–20] that evaluated the cuff-leak test. In a further analysis, one study [15], whose only objective was an evaluation of the methodology to perform the cuff-leak test, was excluded. Another study [20] was excluded from the analysis because if included fewer than 50 patients. A total of 11 studies [8–14, 16–19], including 2,303 patients, were included in the analysis (Fig. 1). Table 1 shows the characteristics of patients included in the studies and the methodological quality of the studies. The median QUADAS score was 12 points (interquartile range: 9, 14; for a maximum score of 28 points). Table 2 shows the methodology used to perform the cuff-leak test, and the results reported in each study are shown in Table 2.
Prediction of upper airway obstruction secondary to laryngeal edema
The leak cutoff value was different in every study, but the analysis of regression effect did not find a threshold effect (Spearman correlation coefficient = 0.55; P = 0.125 and beta coefficient in the Moses model = 0.38; P = 0.16).
Nine studies assessed the upper airway obstruction defined, in eight studies [9–11, 13, 14, 16, 18, 19], as the presence of an inspiratory stridor and, in one study [17], as laryngeal edema observed in the fibrobronchoscopy. The overall incidence of upper airway obstruction was 6.9% (range: 0.6–36.8%).
Operative characteristics (sensitivity, specificity, positive likelihood ratio, negative likelihood ratio) of the cuff-leak test in each study and overall are shown in Fig. 2. Although all characteristics showed a significant statistical heterogeneity (P < 0.05), the positive likelihood ratios were always higher than 3, indicating an increased risk of laryngeal edema in patients with a positive test (pooled positive likelihood ratio 6.79). The clinical relevance of a negative test, however, was more limited (pooled negative likelihood ratio 0.46).
The pooled diagnostic odds ratio was 18.78 (95% confidence interval: 7.36–47.92). There was a significant heterogeneity (P = 0.001; I 2 = 69%; 95% confidence interval: 24–83%).
The area under the SROC curve (Fig. 3) was 0.92 (95% confidence interval: 0.89–0.94) and the Q point 0.85, indicating a moderate level of overall accuracy.
Whereas the Egger test for the diagnostic odds ratio and positive likelihood ratios were not significant, the funnel plot of negative likelihood ratios was clearly asymmetric (Egger test P = 0.0023) strongly suggesting the presence of publication bias (Fig. 4).
Meta-regression analysis did not show a significant association between methodological quality (QUADAS score) and diagnostic accuracy of the cuff-leak test (diagnostic odds ratio 0.93; 95% confidence interval: 0.65–1.35; P = 0.67).
Prediction of reintubation secondary to upper airway obstruction
Only three studies [8, 11, 12] have evaluated the cuff-leak test to predict reintubation secondary to upper airway obstruction. The overall incidence of reintubation was 7%. The operating characteristics of the cuff-leak test for this outcome are shown in Fig. 5. Heterogeneity was only found for the specificity (P = 0.001). The overall diagnostic odds ratio was 10.37 (95% confidence interval: 3.70–29.13) without significant heterogeneity (P = 0.90).
Discussion
The cuff-leak test, in our systematic review, shows a moderate accuracy to predict upper airway obstruction and a low accuracy to predict reintubation secondary to upper airway obstruction. In the analysis of the studies that have evaluated the post-extubation upper airway obstruction, we have found significant statistical heterogeneity in all the operative descriptors. This result would make the application of this test difficult for medical decision-making. However, despite the statistical heterogeneity, the absence of leak (cuff leak test positive) showed an association with the presence of post-extubation upper airway obstruction (positive likelihood ratio between 5 and 10). If we take a pre-test probability of 15% (mean incidence reported in the control group of studies that have evaluated the effect of steroids in the prevention of the stridor [2]) and a positive likelihood ratio of 5.90, the post-test probability is increased to 51%. With a negative likelihood ratio of 0.48, the use of the cuff-leak test would reduce the post-test probability to 8%. However, from a clinical point of view, the outcome of most interest is the reintubation secondary to upper airway obstruction. This outcome has been evaluated in four studies [8, 11, 12, 20] from which we have excluded one [20] because if had a sample size of fewer than 50 patients. In addition, in this study [20], no patient was reintubated because of stridor, so there were neither false negatives nor true positives. We observed less heterogeneity in the operative characteristics, but the magnitude of the association between the cuff-leak and the reintubation was lower than with upper airway obstruction. So, for a reported incidence of reintubation secondary to upper airway obstruction of 5% [2], the absence of leak increases the probability for reintubation to 17%, and the presence of leak decreases the probability for reintubation to 2%.
Adderley and Mullins [21] had the original idea for using this test in a study including 31 scheduled extubations in 28 children with croup. After extubation, 13% of children with audible leak required reintubation vs. 38% in children without leak. In adults, after first being described in a case reported by Potgieter [22], the cuff-leak test has been evaluated in several studies with methodological limitations and design differences. Firstly, the method, originally described by Miller and Cole [9], is not standardized. Few of the authors reported the inspiratory tidal volume, which can influence the amount of the leak. Other ventilatory parameters (compliance, inspiratory flow) that can have an influence on the result of the test were not mentioned either [15]. Secondly, the way to express the leak changes between absolute value (milliliters) and proportion. The predictive cutoff point also changed in each study. Thirdly, there were differences in the cohorts included. The study with a lower incidence of post-extubation stridor [10] included patients in the cardiovascular surgery postoperative period with a short intubation time (median time: 13 h). Some of the studies included a proportion of females higher than that reported in studies on the epidemiology of mechanical ventilation [23]. In several studies, it was observed that female gender is a factor associated with a higher probability of post-extubation stridor [19, 24–26]. Lastly, the outcome evaluated in each study varies from stridor of any severity to reintubation secondary to upper airway obstruction. The lack of an operative and objective definition of stridor has led to significant differences in the incidence of upper airway obstruction among studies. In addition, except for three studies [8, 12, 17], the presence of laryngeal edema as a cause of the upper airway obstruction was not confirmed by an objective diagnostic test. In a recent study [27], it was shown that laryngeal ultrasound can be a reliable, non-invasive method for the evaluation of vocal cords, laryngeal morphology and the ease of airflow that passes through vocal cords or subglottic area because of laryngeal edema.
Our systematic review has some limitations. First, the number of eligible studies was small, especially for the prediction of reintubation, and this in turn limits the precision of the study. Second, the validity of the review is related to the quality of the included studies. It is significant that none of the studies could be given more than 10 points (cutoff point to define a good quality study) in the QUADAS score. Also, we have observed a significant publication bias that could overestimate the negative predictive value of the cuff-leak test.
In conclusion, in our systematic review of the cuff-leak test for prediction of upper airway obstruction, we have found a significant statistical heterogeneity between studies. Despite these limitations, the presence of a positive cuff-leak test (absence of leak) should alert the clinician to a higher risk of upper airway obstruction and re-intubation. On the other hand, the presence of a detectable leak has a low predictive value and does not rule out the occurrence of upper airway obstruction or the need for re-intubation.
References
Epstein SK, Ciubotaru RL (1998) Independent effects of etiology of failure and time to reintubation on outcome for patients failing extubation. Am J Respir Crit Care Med 158:489–493
Fan T, Wang G, Mao B, Xiong Z, Zhang Y, Liu X, Wang L, Yang S (2008) Prophylactic administration of parenteral steroids for preventing airway complications after extubation in adults: meta-analysis of randomised placebo controlled trials. BMJ 337:a1841
Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Kleijnen J (2003) The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol 3:25
Zamora J, Abraira V (2008) Análisis de la calidad de los estudios de evaluación de pruebas diagnósticas. Nefrología 28(Suppl 2):42–45
Littenberg B, Moses LE (1993) Estimating diagnostic accuracy from multiple conflicting reports: a new meta-analytic method. Med Decis Making 13:313–321
Egger M, Davey Smith G, Schneider M, Minder C (1997) Bias in meta-analysis detected by a simple, graphical test. Br Med J 315:629–634
Zamora J, Abraira V, Muriel A, Khan KS, Coomarasamy A (2006) Meta-disc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol 6:31
Fisher MM, Raper RF (1992) The “cuff-leak” test for extubation. Anaesthesia 47:10–12
Miller RL, Cole RP (1996) Association between reduced cuff leak volume and postextubation stridor. Chest 110:1035–1040
Engoren M (1999) Evaluation of the cuff-leak test in a cardiac surgery population. Chest 116:1029–1031
Sandhu RS, Pasquale MD, Miller K, Wasser TE (2000) Measurement of endotracheal tube cuff leak to predict postextubation stridor and need for reintubation. J Am Coll Surg 190:682–687
De Bast Y, De Backer D, Moraine JJ, Lemaire M, Vandenborght C, Vincent JL (2002) The cuff leak test to predict failure of tracheal extubation for laryngeal edema. Intensive Care Med 28:1267–1272
Jaber S, Chanques G, Matecki S, Ramonatxo M, Vergne C, Souche B, Perrigault PF, Eledjam JJ (2003) Post-extubation stridor in intensive care unit patients: risk factors evaluation and importance of the cuff-leak test. Intensive Care Med 29:69–74
Maury E, Guglielminotti J, Alzieu M, Qureshi T, Guidet B, Offenstadt G (2004) How to identify patients with no risk for postextubation stridor? J Crit Care 19:23–28
Prinianakis G, Alexopoulou C, Mamidakis E, Kondili E, Georgopoulos D (2005) Determinants of the cuff-leak test: a physiological study. Crit Care 9:R24–R31
Kriner EJ, Shafazand S, Colice GL (2005) The endotracheal tube cuff-leak test as a predictor for postextubation stridor. Respir Care 50:1632–1638
Chung YH, Chao TY, Chiu CT, Lin MC (2006) The cuff-leak test is a simple tool to verify severe laryngeal edema in patients undergoing long-term mechanical ventilation. Crit Care Med 34:409–414
Wang CL, Tsai YH, Huang CC, Wu YK, Ye MZ, Chou HM, Shu SC, Lin MC (2007) The role of the cuff leak test in predicting the effects of corticosteroid treatment on postextubation stridor. Chang Gung Med J 30:53–61
Sukhupanyarak S (2008) Risk factors evaluation and the cuff leak test as predictors for post-extubation stridor. J Med Assoc Thai 91:648–653
Shin SH, Heath K, Reed S, Collins J, Weireter LJ, Britt LD (2008) The cuff leak test is not predictive of successful extubation. Am Surg 74:1182–1185
Adderley RJ, Mullins GC (1987) When to extubate the croup patient: the “leak” test. Can J Anaesth 34:304–306
Potgieter PD, Hammond JM (1988) “Cuff” test for safe extubation following laryngeal edema. Crit Care Med 16:818
Esteban A, Ferguson ND, Meade MO, Frutos-Vivar F, Apezteguia C, Brochard L, Raymondos K, Nin N, Hurtado J, Tomicic V, González M, Elizalde J, Nightingale P, Abroug F, Pelosi P, Arabi Y, Moreno R, Jibaja M, D’Empaire G, Sandi F, Matamis D, Montañez AM, Anzueto A (2008) Evolution of mechanical ventilation in response to clinical research. Am J Respir Crit Care Med 177:170–177
Darmon JY, Rauss A, Dreyfuss D, Bleichner G, Elkharrat D, Schlemmer B, Tenaillon A, Brun-Buisson C, Huet Y (1992) Evaluation of risk factors for laryngeal edema after tracheal extubation in adults and its prevention by dexamethasone: a placebo-controlled, double-blind, multicenter study. Anesthesiology 77:245–251
Ho LI, Harn HJ, Lien TC, Hu PY, Wang JH (1996) Postextubation laryngeal edema in adults: risk factor evaluation and prevention by hydrocortisone. Intensive Care Med 22:933–936
François B, Bellissant E, Gissot V, Desachy A, Normand S, Boulain T, Brenet O, Preux PM, Vignon P (2007) 12-h pretreatment with methylprednisolone versus placebo for prevention of postextubation laryngeal oedema: a randomised double-blind trial. Lancet 369:1083–1089
Ding LW, Wang HC, Wu HD, Chang CJ, Yang PC (2006) Laryngeal ultrasound: a useful method in predicting post-extubation stridor: a pilot study. Eur Respir J 27:384–389
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ochoa, M.E., del Carmen Marín, M., Frutos-Vivar, F. et al. Cuff-leak test for the diagnosis of upper airway obstruction in adults: a systematic review and meta-analysis. Intensive Care Med 35, 1171–1179 (2009). https://doi.org/10.1007/s00134-009-1501-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00134-009-1501-9