Abstract
OBJECTIVE: To perform a systematic review and meta-analysis of prospectively conducted studies to define diagnostic performance of endobronchial ultrasound-guided transbronchial needle biopsy (EBUS-TBNB) in mediastinal and hilar lymphadenopathy.
METHODS: A comprehensive search was performed using the Embase, Ovid Medline, Ovid Medline In-Process and Other Non-Indexed Citations, All Evidence Based Medicine Reviews—Cochrane Database of Systematic Reviews, American College of Physicians Journal Club, Database of Abstracts of Reviews of Effects (DARE), Cochrane Central Register of Controlled Trials (CCTR), Health Technology Assessment (HTA), and SCOPUS databases, in the second week of November 2010. Studies were selected in 2 phases by 2 reviewers, independently. Data extraction from each study was performed using a standardized data extraction form. Quality assessment of study methodology was done using a checklist that was developed based on a Quality Assessment of Diagnostic Accuracy Studies tool and the nature of the test. Using the 2 × 2 tables, we computed the sensitivity, specificity, and likelihood ratios.
RESULTS: The 14 studies included for quantitative data synthesis had a pooled cohort of 1,658 patients, from 8 different countries. The EBUS-TBNB had excellent pooled specificity of 100% (95% CI 0.90–1.00) and a positive likelihood ratio of 5.1 (95% CI 2.7–9.7). The pooled sensitivity was 0.92 (95% CI 0.91–0.93), and the pooled negative likelihood ratio was 0.13 (95% CI 0.09–0.19). The sensitivity of this intervention was not dependent on rapid on-site evaluation use or size of needle used. The pooled diagnostic odds ratio was 62.7 (95% CI 25.7–153.0). Only one major complication was reported, which resulted in early termination of the procedure.
CONCLUSIONS: Evidence of moderate quality confirms the high diagnostic performance of EBUS-TBNB for mediastinal and hilar lymphadenopathy, both in malignant and non-malignant conditions. Available evidence also demonstrates the safety of this procedure.
- endobronchial ultrasound-guided transbronchial needle biopsy
- mediastinal lymphadenopathy
- diagnostic accuracy
Introduction
Endobronchial ultrasound-guided transbronchial needle biopsy (EBUS-TBNB) is a relatively new diagnostic procedure gaining popularity worldwide for the purpose of investigating mediastinal lymphadenopathy in both malignant as well as non-malignant etiologies.1–3 It is also used for staging and classification of lung cancer.4
Diagnosis of mediastinal lymphadenopathy can be made by both noninvasive and invasive techniques.5,6 Noninvasive methods include imaging techniques such as computed tomography (CT), magnetic resonance imaging (MRI), positron emission tomography (PET), and PET-CT. However, these modalities are devoid of sufficient sensitivity, specificity, and accuracy.7 For definitive etiological confirmation, a pathological specimen is required.8 Hence, invasive procedures like bronchoscopy, mediastinoscopy, traditional TBNB and EBUS-TBNB are performed.9,10
Several studies have reported the diagnostic performance of EBUS-TBNB in mediastinal lymphadenopathy, but there is no single large multicenter study published to date. In this project, we aimed to perform a systematic review and meta-analysis of prospective studies to define diagnostic performance of EBUS-TBNB in mediastinal and hilar lymphadenopathy, both in malignant and non-malignant etiologies. We calculated pooled sensitivity, specificity, and likelihood ratios to report diagnostic accuracy of EBUS-TBNB.
QUICK LOOK
Current knowledge
Endobronchial ultrasound guided-transbronchial needle biopsy (EBUS-TBNB) is a common diagnostic technique in mediastinal and hilar lymphadenopathy.
What this paper contributes to our knowledge
EBUS-TBNB has an acceptable safety profile and aids in reaching a definitive diagnosis in mediastinal and hilar lymphadenopathy for malignant and non-malignant disorders.
Methods
Eligibility Criteria
We included studies that prospectively defined diagnostic performance of EBUS-TBNB in patients with mediastinal and hilar lymphadenopathy. Studies were eligible if they had a prospective study design, were based on original research, reported diagnostic performance of EBUS-TBNB, and full text was available in English. We excluded retrospective studies, case reports, studies not based on original research, studies based on less than 20 patients, and studies where full text was not available in the English language.
Search Strategy
A comprehensive search strategy was designed and performed by the primary investigator (SC), with input from the clinical content expert (AM). The electronic search included the following electronic databases:
Embase: 1988 to July 2010 week 2
Ovid Medline: 1996 to July 2010 week 1
Ovid Medline In-Process and Other Non-Indexed Citations: July 14, 2010
All Evidence Based Medicine Reviews—Cochrane Database of Systematic Reviews
American College of Physicians Journal Club
Database of Abstracts of Reviews of Effects (DARE)
Cochrane Central Register of Controlled Trials (CCTR)
Health Technology Assessment (HTA)
SCOPUS: 1960 to July 14, 2010
The search was performed in the second week of November 2010 (see the supplementary materials at http://www.rcjournal.com). The following key words were used for search with using different operators (AND, OR, and NOT): “EBUS,” “endobronchial ultrasound,” “lymph node,” and “lymphadenopathy.” No language restrictions were applied to the search strategy, but the search was limited to adult human subjects. Conference proceedings from the American Thoracic Society, Chest, and the European Respiratory Society from 2007 to 2009, and reference lists of eligible articles were hand searched, and we consulted content experts to identify additional published reports (AM).
Study Selection
Two investigators (SC, MN) independently screened the titles and abstracts of all identified records (phase I) for predefined inclusion and exclusion criterion. Full text of records was obtained on agreement between these 2 investigators on possible inclusion in the review. The same 2 investigators then independently assessed the eligibility of each full text (phase II). Cohen's kappa was used to measure chance-corrected agreement between reviewers for each phase of study selection. All the disagreements were resolved by consensus.
Quality Assessment
A methodology quality assessment checklist for this study was developed considering the QUADAS (Quality Assessment of Diagnostic Accuracy Studies) tool and the nature of the diagnostic intervention.11 The QUADAS is a well validated quality assessment tool that covers the majority of bias and variability in methodology quality assessment for studies reporting diagnostic performance of a diagnostic test. Consecutive sampling and prospective study design were included in the methodology quality assessment checklist to address selection bias.12 Since insufficient and non-representative tissue sampling are the primary reasons for false negative results of TBNB and depend on physician experience, we included experience or expertise level of physician performed EBUS-TBNB for methodology quality assessment. The experience or expertise level was taken as reported by authors. The quality assessment criteria used are listed in Table 1. We have dropped a few of the items from the QUADAS tool. For example, item 2 in QUADAS (Were selection criteria clearly described?) was perceived as redundant and more of a reporting issue than methodology quality, and the first 3 items in our checklist cover subject selection explicitly. For this systematic review, the reference test was defined as combination of clinical follow-up, positive index test results, video-assisted thoracoscopy (VATS), mediastinoscopy, and open thoracotomy. Since the reference test was a combination of tests and follow-up, QUADAS item 4 (Is the time period between reference standard and index test short enough to be reasonably sure that the target condition did not change between the 2 tests?) was also not included in our checklist. Two reviewers (SC, MN), working independently, assessed the quality of included studies, and disagreements were resolved by consensus. We dichotomized answers as “yes” and “no/unclear” for the kappa calculations. Studies scoring less than 50% (arbitrarily defined based on consensus among investigators) on the methodology quality assessment checklist were excluded from quantitative data synthesis.
Quality Assessment Criteria*
Outcomes
Primary outcomes of interest of this study were number of true positives, false positives, false negatives, and true negatives on histological confirmation of tissue sample obtained from mediastinal or hilar lymphadenopathy using EBUS-TBNB. These numbers were either reported as is or were calculated from available data on diagnostic performance and number of subjects.
Data Extraction and End Points and Synthesis
Data exaction was done using a standardized data extraction form. The following data were extracted: author, country where study was performed, year of publication, study design, settings, subject selection, details of index (EBUS-TBNB) and reference test, diagnostic performance of index test, complications, feasibility of the index test, and other remarks made. Primary end points for diagnostic performance of EBUS-TBNB were true positive, true negative, false positive, and false negative, on a per-patient basis. If the data were not available in the original report or were unclear, we contacted the corresponding author for clarification. We used the following method for author contact: first, we sent an e-mail requesting primary data. If there was no response within 1 week, a second reminder e-mail was sent.
All the continuous data are presented as either mean with standard deviation or median with interquartile range, as reported in the primary study. Categorical data are presented as percent frequency of occurrence. Using the 2 × 2 tables, we computed sensitivity (true positive rate), specificity (true negative rate), and the likelihood ratios (the ratio of the probability of the specific test result in people who have the disease to the probability in people who do not) with 95% confidence intervals.9 The diagnostic performance of the EBUS-TBNB was assessed using Meta-DiSc software (Unit of Clinical Biostatistics, Ramon y Cajal Hospital, Madrid, Spain). Meta-analyses were performed combining the sensitivities, specificities, and likelihood ratios of individual studies. Likelihood ratios were pooled using a random effect model (DerSimonian and Laird). Positive likelihood ratios > 10 and negative likelihood ratios < 0.1 are considered strong diagnostic evidence.11 The I-square statistic was used to quantify statistical heterogeneity between studies.
Results
Study Selection
The comprehensive multiple database search produced 269 records, after de-duplication, 161 records were screened for study eligibility. Figure 1 demonstrates the flow of study selection. Phase I identified 25 potentially eligible studies (kappa = 0.65, 95% CI 0.50–0.81). For these 25 studies, full texts were obtained from the Mayo Clinic library. In phase II, a total of 14 studies were finalized to be included in this systematic review (kappa = 0.68, 95% CI 0.40–0.96). These 14 studies were included for methodology quality assessment and quantitative data synthesis.
Schematic presentation of study selection flow.
Characteristics of Included Studies
The 14 studies included for quantitative data synthesis had a pooled cohort of 1,658 patients, from 8 different countries. Table 2 describes important characteristics of the included studies. All the studies were conducted in urban academic settings. The most commonly used needle size was 22; two studies used needle size of 19, one study used 21, and another study did not report the needle size.15,19,20,21 Study subject selection and reference test varied between studies. Most studies included patients with lymph nodal size > 1 cm on CT scan as one of the inclusion criteria for performing EBUS. In most studies, TBNB was performed under real-time guidance, except in 3 studies where TBNB was performed after initial localization using EBUS.17,19,20 In included studies, a major complication was reported in one patient. This patient had hyperemia and edema of the airway and developed stridor and hypoxia during the procedure, which warranted early termination of the procedure.16 Minor complications like self-limiting hemorrhage were reported in 2 patients by Kanoh et al19 and one patient by Sun et al.23 The number of passes performed per lymph node was reported in 5 studies.1,13,21–23 The weighted mean number of passes per lymph node was 2, ranging from 1.2 to 3.8. Rapid on-site evaluation (ROSE) of the biopsy material was performed in only 5 studies.13–16,22
Characteristics of Included Studies
Methodology Quality Assessment
The score obtained by each study on the quality assessment checklist is described in Table 1. All the studies prospectively enrolled a consecutive cohort of patients. In all the studies, the results of EBUS-TBNB were interpreted without knowledge of the results of the reference standard. Except for 3 studies where the reference standard was independent of the index test, EBUS-TBNB was part of the reference standard in all the studies.1,9,23 In one study, the reference standard was unclear.15
Diagnostic Performance of EBUS-TBNB
The EBUS-TBNB had pooled specificity of 1.00 (95% CI 0.90–1.00) and the pooled sensitivity was 0.92 (95% CI 0.91–0.93) ranging from 69.0% in the study by Wallace et al4 to 100% in the study by Garwood et al16 (Table 3). The pooled positive likelihood ratio was 5.1 (95% CI 2.7–9.7), and the pooled negative likelihood ratio was 0.13 (95% CI 0.09–0.19) (Fig. 2). The pooled diagnostic odds ratio was 62.7 (95% CI 25.7–153.0).
Sensitivity and Specificity of Individual Studies and Pooled
Positive and negative likelihood ratios for each study and pooled values. LR = likelihood ratio.
Heterogeneity and Subgroup Analysis
On I-square statistics, specificity (chi-square = 0.00, P = 1.00) and positive likelihood ratio (Cochran Q = 12.5, P = .49) did not demonstrate significant heterogeneity, and negative likelihood ratio showed marginal inconsistency (Cochran Q = 24.1, P = .03) (see Fig. 2), but the sensitivity had shown significant heterogeneity (I-square = 71.4%, chi-square = 50.6, P = < .001). To investigate heterogeneity, subgroup analysis was done by grouping studies based on needle size and ROSE. Pooled sensitivity was higher in the studies that used ROSE than those that did not (0.94, 95% CI 0.91–0.96, versus 0.92, 95% CI 0.90–0.94). This difference did not, however, reach statistical significance, P = .14. There was no difference in sensitivities obtained by using 19 or 21 versus 22 gauge needles. The study by Wallace et al4 has reported sensitivity of 0.69. In this study, patients with suspicion of lung cancer on CT were enrolled irrespective of mediastinal lymphadenopathy. The results of this study contributed to the heterogeneity in pooled sensitivity, but exclusion of this study did not eliminate the heterogeneity completely. Another subgroup analysis was performed based on subjects with benign versus predominantly malignant etiologies for lymphadenopathy. Only 2 studies16,24 have included patients only with benign etiology of lymphadenopathy. The pooled sensitivity in this group was 0.93 (0.86–0.97), with pooled positive likelihood ratio of 7.2 (1.2–43.0) versus 0.92 (0.90–0.93) and 4.9 (2.4–9.9), respectively, for studies including predominantly malignant etiologies. This comparison is not optimal, as one group had 2 studies versus 12 in the other group. At the same time, a predominantly malignant etiology group of studies has included benign conditions.
Discussion
We conducted a comprehensive systematic review and meta-analysis of studies that defined diagnostic performance of EBUS-TBNB in mediastinal and hilar lymphadenopathy, prospectively. The studies included in this analysis were ranked medium to high on a quality assessment criteria checklist, indicating that the primary studies were of moderate to good methodological quality. Pooled analysis of diagnostic performance demonstrated that the EBUS-TBNB is 100% specific and 92% sensitive for histological confirmation of diagnosis in mediastinal and hilar lymphadenopathy. Significant inconsistency existed in the sensitivity of EBUS-TBNB, which was not found to be dependent on ROSE use or size of needle used. The selection of patients based on presence of mediastinal or hilar lymphadenopathy on radiographic examination seemed to be associated with higher sensitivity, but a definitive conclusion could not be made since only one study had an un-selected population. The existence of heterogeneity despite subgroup analysis based on ROSE and needle size indicates the presence of other derivers of inconsistency in the results. These potential derivers could be number of passes per lymph node, location, and lymph nodes. Analysis considering these variables was not possible in this review due to inconsistency in reporting of results.
The diagnostic yield of EBUS-TBNB had shown to increase with number of passes, till 3–5 passes per lymph node, with minimal increase thereafter.16,25 Hence, 3 passes per lymph node should be an acceptable practice. EBUS-TBNB possesses all the advantages (mortality and morbidity associated with surgery exploration and use of general anesthesia, time, etc) of being minimally invasive when compared to surgical intervention like mediastinoscopy or thoracotomy. Amount of sedation required was marginally higher for EBUS-TBNB than standard TBNB and added a few extra minutes in the procedure.17,20,21 EBUS-TBNB has extremely high patient satisfaction among bronchoscopic interventions. In a recent study, where patient satisfaction was measured by patient willingness to return for the procedure if required in the future, on a self administered questionnaire, after 3–4 hours of procedure, 98% choose “definitely return” and 2% “probably.”25
Strength and Limitations
Strengths of this study include a search strategy that involved 5 electronic databases, searching the bibliographies of included articles, and contact with content experts. This minimized the potential for publication bias, but we cannot exclude it completely, and no tests were attempted to quantify publication bias. We also used sound methodology in conducting the review, including assessment of inter-rater reliability for study selection. The study is limited by the relatively small number of studies included in the review. We have performed subgroup analysis based on ROSE and needle size, but subgroup analysis based on lymph node size, station, and number of passes was limited by inconsistency in reporting.
External Validity, Clinical Implications, and Future Research
The review included 14 validation studies conducted in 8 different countries, encompassing 1,658 patients. That the statistical estimates were derived from a large sample size including different patient populations suggests a high degree of external validity of the findings in this review. One of the major limitations of existing evidence on diagnostic accuracy of EBUS-TBNB is that most studies have included the results of the index test into the reference standard test. This overestimates the diagnostic performance. In the future, further studies are required in which the diagnostic performance of EBUS-TBNB is compared to the gold standard, histopathological confirmation of diagnosis. Also, a blinded multicenter randomized controlled trial will be helpful in accurate estimation of the diagnostic performance on EBUS-TBNB.
Conclusions
Evidence of moderate quality confirms excellent performance and safety profile of EBUS-TBNB in reaching a definitive diagnosis in mediastinal and hilar lymphadenopathy for other malignant and non-malignant disorders. Diagnostic performance was independent of ROSE by a cytopathologist and needle size used. The presence of inconsistency in sensitivity between different studies mandates a methodologically sound large multicenter randomized controlled trial for more accurate estimation of diagnostic performance.
Footnotes
- Correspondence: Anant Mohan MD, Associate Professor, Division of Pulmonary and Critical Care, Department of Medicine, All India Institute of Medical Sciences, New Delhi, India. E-mail: anantmohan{at}yahoo.com.
Supplementary material related to this paper is available at http://www.rcjournal.com.
The authors have disclosed no conflicts of interest.
- Copyright © 2012 by Daedalus Enterprises Inc.