Abstract
BACKGROUND: Lung ultrasound is a valuable imaging tool in the diagnosis of community-acquired pneumonia. However, its diagnostic accuracy in ventilator-associated pneumonia (VAP) has not been fully investigated. The aim of this study was to evaluate the diagnostic performance of the combination of a lung ultrasound with procalcitonin (PCT) in mechanically ventilated subjects with symptoms suggestive of pneumonia.
METHODS: A prospective study of 124 subjects with suspected VAP in 2 multidisciplinary ICUs was conducted between December 2016 and October 2017. Lower respiratory tract specimens were collected from all the subjects at enrollment and on the following 3 d. PCT assays were performed within 1 h of enrollment. Lung ultrasound and then computed tomography of the chest were performed within 24 h to detect lung consolidations. The subjects were divided into VAP and non-VAP groups according to the results of a computed tomography of the chest and semi-quantitative culture of the lower respiratory tract sample.
RESULTS: A total of 124 subjects were included (48 in the VAP group and 76 in the non-VAP group). A positive lung ultrasound result combined with PCT of ≥0.25 ng/mL diagnosed VAP, with a sensitivity and specificity of 81.3 and 85.5%, respectively. The area under the receiver operating characteristic curve was significantly higher for lung ultrasound combined with PCT than for a white blood cell count, PCT, C-reactive protein, or Clinical Pulmonary Infection Score alone.
CONCLUSIONS: A combination of lung ultrasound and PCT was accurate in the diagnosis of VAP. Lung ultrasound is a useful lung-imaging tool to assist VAP diagnosis.
Introduction
Ventilator-associated pneumonia (VAP) is the most common nosocomial infection in the ICU and affects one third of patients who require mechanical ventilation during a noninfectious admission.1 VAP is associated with longer ICU length of stays, prolonged mechanical ventilation, and increased use of antimicrobials, health-care costs, and mortality.2–4 VAP has been reported to increase the mortality of the underlying disease by ∼30%.5 An early diagnosis of VAP is crucial for prompt initiation of appropriate treatment. Currently, VAP is diagnosed based on a combination of clinical, radiologic, and microbiologic criteria.
Radiologic findings are intrinsic to most diagnostic VAP algorithms.6 Pulmonary imaging for a diagnosis of VAP lung consolidation still relies on chest radiography and computed tomography (CT) of the chest.7 However, several studies indicate that chest x-ray is unreliable for VAP diagnosis in patients who are critically ill,8,9 and, thus, its utility in the ICU is limited. Although CTs allow visualization of much smaller pulmonary abnormalities than chest radiography, CT cannot be routinely performed in patients who are critically ill because of the cost, radiation exposure, and risk of transportation.10 In this context, there is a need for a radiation-free, noninvasive, and easily repeatable bedside tool for detection of lung consolidation in patients who require mechanical ventilation. More recently, advances in ultrasound technology and its widespread use in patients who are critically ill have recommended lung ultrasound as a promising tool for assessing lung status in patients who are critically ill and on mechanical ventilation. A lung ultrasound was reported to have a high accuracy in many pathological lung conditions, such as consolidation, pleural effusion, interstitial syndrome, and pneumothorax.11–13
Procalcitonin (PCT) is a biomarker closely related to bacterial infection and has been used in the diagnosis of community-acquired infections, particularly lower respiratory tract infections.14 Moreover, studies reported that a PCT-guided strategy could shorten antimicrobial-treatment duration and reduce antibiotic prescriptions for patients with community-acquired lower respiratory tract infections.15,16 Despite its unquestionable role in community-acquired pneumonia diagnosis, the PCT level alone does not seem to be a good diagnostic biomarker for VAP. Gibot et al17 found no difference in serum PCT levels between subjects with and without VAP. However, a score that combined PCT and lung ultrasound was recently reported to outperform the Clinical Pulmonary Infection Score (CPIS) in a VAP diagnosis.18 Therefore, we carried out this prospective, observational study in 2 centers to confirm the diagnostic performance of the combination of lung ultrasound with PCT in subjects with suspected VAP. We hypothesized that the diagnostic performance of the combination of lung ultrasound and PCT would be better than other biomarkers.
QUICK LOOK
Current knowledge
Ventilator-associated pneumonia (VAP) is the most frequent ICU-acquired infection that is independently associated with mortality. Diagnosing VAP remains a challenge for clinicians.
What this paper contributes to our knowledge
In mechanically ventilated subjects with signs and symptoms of pneumonia, lung ultrasound patterns of lung consolidation combined with procalcitonin of ≥0.25 ng/mL showed a better diagnostic performance than did a lung ultrasound, procalcitonin, Clinical Pulmonary Infection Score, and other inflammatory biomarkers alone for VAP diagnosis. A lung ultrasound was a useful tool to assist in VAP diagnosis.
Methods
The study was approved by the Zhejiang Hospital Ethics Committee (201625K), and written informed consent was obtained from each subject's next of kin. We prospectively included 124 consecutive subjects with suspected VAP in ICUs at the Zhejiang Hospital and the Taizhou Municipal Hospital between December 2016 and October 2017. Inclusion criteria were as follows: (1) duration of mechanical ventilation of ≥48 h; (2) age ≥ 18 y; and (3) clinical suspicion of VAP based on two or more of the following criteria: body temperature of ≥38.0°C or <36.0°C, white blood cell count ≥10,000 or ≤4,000 cells/mm3, purulent tracheal secretions, and PaO2/FIO2 < 300 mmHg. Exclusion criteria were ongoing pneumonia, subcutaneous emphysema, thoracic dressings, or pregnancy.
The subjects were enrolled when VAP was suspected. Lower respiratory tract specimens were collected by deep bronchial suctioning or bronchoscopic lavage at inclusion and, thereafter, daily for 3 d. Blood samples were collected for PCT testing within 1 h after inclusion. We considered 2 PCT cutoffs, of 0.25 and 0.5 ng/mL, based on previous studies.14–16 The cutoff of ≤0.25 ng/mL PCT was used to rule out bacterial pneumonia in the subjects with suspected respiratory tract infections, and a PCT level of ≥0.5 ng/mL was used to indicate bacterial pneumonia and to recommend antibiotic therapy.
A CT of the chest was performed by using a Somatom Sensation (Siemens, Erlangen, Germany) and a GE Lightspeed 64 (GE, Boston, Massachusetts) within 24 h of inclusion. Two individual radiologists, unaware of the lung ultrasound findings, studied the images together, and diagnostic reporting was determined by consensus. For each subject, VAP was diagnosed according to 2 criteria: new or progressive infiltrates on a CT of the chest, and a positive semi-quantitative bacterial culture of lower respiratory tract sample. The semi-quantitative culture was determined by four-quadrant streak plate method and classified as follows: + = rare growth; ++ = light growth; +++ = moderate growth; ++++ = heavy growth. A positive semi-quantitative culture was defined as +++ or ++++.
A lung ultrasound was performed before the CT of the chest to minimize the bias induced by subjective judgment. The subjects were examined while they were in the supine and lateral positions. The following ultrasound machines were used: SonoSite M-Turbo (Fujifilm, Tokyo, Japan) and X-Porte (Fujifilm), with a 3.5–10 MHz convex array probe. A longitudinal scan was taken in 6 areas for each hemithorax (anterior, lateral, posterior regions by using anterior and posterior axillary lines as landmarks, and each region was divided into upper and lower halves by using the third intercostal spaces as landmarks). For each region of interest, the worst ultrasound abnormality detected was considered to characterize the region examined.
Four lung ultrasound patterns were defined as positive results (see the supplementary materials at http://www.rcjournal.com): (1) small subpleural consolidations: subpleural blurred, irregular margins echo-poor regions, diameter > 0.5 cm, with or without B lines; (2) lobar–hemilobar consolidation, defined by a tissue-like echotexture similar to that observed in liver or spleen parenchyma on ultrasound; (3) dynamic air bronchogram, defined as punctiform or linear hyperechoic artifacts within lobar–hemilobar consolidations and the hyperechoic images moving synchronously with inspiration; and (4) static air bronchogram: hyperechoic artifacts within lobar–hemilobar consolidations but not moving with inspiration. The investigators were 4 intensive care physicians (Song, Hu, Wang, Xiao) who had received standard training in point-of-care ultrasound and with at least 3 y of experience with lung ultrasound.
For each subject, the following data were collected: age, sex, APACHE II (Acute Physiology and Chronic Health Evaluation II) score, and where the patient was transferred from. The clinical and laboratory data included the following: body temperature, white blood cell count, plasma concentration of C-reactive protein, PCT, PaO2/FIO2, quality of bronchial secretions, and the results of lower respiratory tract specimen culture. CPIS, duration of mechanical ventilation, ICU length of stay, ICU mortality, and results of the lung ultrasound examination were also recorded.
Statistics
Statistical analysis was performed by using SPSS 20.0 software (IBM Corporation, Armonk, New York). All data are expressed as mean ± SD when normally distributed or as median (25–75% interquartile range) when non-normally distributed. The normality of data distribution was assessed by using the Kolmogorov-Smirnov test. The Student t test was used for comparison of normally distributed continuous data, and the Mann-Whitney U test was used for comparison of skewed continuous data. The chi-square test or the Fisher exact test was used to compare categorical variables. A 2-tailed P < .05 was considered to indicate statistical significance.
The diagnostic performance of a lung ultrasound, CPIS, PCT, and the combination of lung ultrasound and PCT were assessed by sensitivity, specificity, positive predictive value, negative predictive value, and likelihood ratios. The McNemar test were used to evaluate the significance of differences in the sensitivity and specificity of lung ultrasound, CPIS, PCT, and the combination of lung ultrasound and PCT. Receiver operating characteristic curves were constructed to evaluate the ability of the white blood cell count, PCT, C-reactive protein, CPIS, and combination of lung ultrasound and PCT to predict VAP. The areas under the receiver operating characteristic curves were compared by using the Hanley-McNeil test.19
Results
A total of 150 patients fulfilled inclusion criteria during the study period. Eighteen patients could not undergo CT examination within 24 h after enrollment due to an unstable clinical condition. Six patients did not get the PCT test, and 2 patients refused to participate in the study. As a result, a total of 124 subjects were included in the final analysis (Fig. 1). The subjects were divided into VAP (n = 48) and non-VAP groups (n = 76) according to CT results and semi-quantitative cultures of respiratory tract secretions. Baseline and clinical characteristics are shown in Table 1. More postoperative subjects (postoperative subjects percentage of 34.2 vs 16.7%; P = .033) were categorized into the non-VAP group, and their PCT levels (median 0.3 vs 1.07 ng/mL, P = .001) and CPIS (median 5.6 vs 6.9, P = .002) were significantly lower than in the VAP group. Furthermore, more subjects in the VAP group had purulent airway secretions (subjects have purulent airway secretions percentage of 77.1 vs 43.4%, P < .001) and strongly positive semi-quantitative cultures (strongly positive semi-quantitative cultures percentage of 62.5 vs 13.2%, P < .001). Both the duration of mechanical ventilation (median 8.5 vs 12 d, P = .003) and ICU length of stay (median 11.5 vs 17 d, P < .001) were significantly longer in the VAP group than in the non-VAP group. The ICU mortality (the ICU mortality percentage of 28.9 vs 41.7%, P = .15) did not differ significantly between the 2 groups.
Performance of a lung ultrasound, PCT, CPIS, and lung ultrasound combined with PCT in diagnosing VAP are presented in Table 2. Forty four of 72 subjects (61.1%) with positive lung ultrasound results were diagnosed with VAP. False-negative results were found in 4 subjects (3.2%), with a sensitivity of 91.7% (95% CI 79.1–97.3%), a negative predictive value of 92.3% (95% CI 80.6–97.5%), and a negative likelihood ratio of 0.13 (95% CI 0.05–0.34). Sensitivity and the specificity of PCT ≥ 0.25 ng/mL were 85.4% (95% CI 71.6–93.5%) and 46.1% (95% CI 34.7–57.8%), respectively, whereas sensitivity and the specificity of PCT ≥ 0.5 ng/mL were 58.3% (95% CI 43.3–72.1%) and 71.1% (95% CI 59.4–80.6%), respectively.
CPIS ≥ 6 had a sensitivity of 70.8% (95% CI 55.7–82.6%) and a specificity of 57.9% (95% CI 46.0–69.0%). Thirty nine of 50 subjects (78%) with a positive lung ultrasound result and PCT ≥ 0.25 ng/mL had a final diagnosis of VAP, false-negative results were 9 (7.3%). The sensitivity, negative predictive value, and negative likelihood ratio were 81.3% (95% CI 66.9–90.6%), 87.8% (95% CI 77.7–93.9%), and 0.22 (95% CI 0.12–0.40), respectively. In 74 subjects (59.7%), a lung ultrasound was negative and/or PCT < 0.25 ng/mL. False-positive results were found in 11 subjects (8.9%). The specificity, positive predictive value, and positive likelihood ratio were 85.5% (95% CI 75.2–92.2%), 78.0% (95% CI 63.7–88.0%), and 5.61 (95% CI 3.20–9.86), respectively.
A lung ultrasound diagnosed VAP more sensitively than did PCT ≥ 0.5 ng/mL (χ2 = 12.5, P < .001) and CPIS (χ2 = 5.79, P = .02). However, it was comparable in subjects with PCT ≥ 0.25 ng/mL (χ2 = 0.57, P = .45) and those with positive lung ultrasound result and PCT ≥ 0.25 ng/mL (χ2 = 3.2, P = .07). The specificity of a positive lung ultrasound result combined with PCT ≥ 0.25 ng/mL was significantly higher than a lung ultrasound (χ2 = 15.06, P < .001), PCT ≥ 0.5 (χ2 = 4.0, P = .046), PCT ≥ 0.25 (χ2 = 28.03, P < .001), and CPIS (χ2 = 13.79, P < .001) alone. Sonographic patterns for lung ultrasound evaluation of the study subjects are described in Table 3.
Areas under the receiver operating characteristic curves of white blood cell count, PCT, C-reactive protein, CPIS, and PCT combined with lung ultrasound were 0.625 (95% CI 0.525–0.726), 0.674 (95% CI 0.581–0.768), 0.620 (95% CI 0.521–0.720), 0.665 (95% CI 0.567–0.762), and 0.865 (95% CI 0.794–0.936), respectively (Fig. 2). The area under the receiver operating characteristic curve of PCT combined with lung ultrasound was significantly higher than those of white blood cell count (P < .001), PCT (P = .001), C-reactive protein (P < .001), and CPIS (P = .001).
Discussion
In the present study, we validated the diagnostic value of a combination of a lung ultrasound and with PCT in the subjects who were on ventilation and with signs and symptoms of VAP. Lung ultrasound patterns of lung consolidation combined with PCT ≥ 0.25 ng/mL showed better diagnostic performance than a lung ultrasound, PCT, CPIS, and other inflammatory biomarkers alone for VAP diagnosis. The Centers for Disease Control define VAP as a pneumonia that arises within the 48-h period of the placement of an artificial airway.20 A diagnosis of VAP in patients who are critically ill remains challenging, and there is a lack of consensus regarding the diagnostic criteria for VAP.21 Traditional diagnostic criteria for VAP are based on medical history, physical examination, and radiographic findings. As an important lung imaging tool, bedside chest x-ray is routinely used for VAP diagnosis. However, it lacks both accuracy and reliability for the diagnosis of pneumonia in the ICU.22 In one report, 38% of subjects undergoing mechanical ventilation had abnormal chest radiography findings on ICU admission.23 In addition, in patients who are bedridden and with suspected pneumonia, a normal chest x-ray cannot rule out the diagnosis.24 Another diagnostic tool, the CT of the chest, is considered as the accepted standard for the diagnosis of pneumonia. Therefore, we used a CT of the chest as the accepted standard for the confirmation of VAP. However, we acknowledge that the routine use of CT is limited. In this study, 18 subjects were excluded due to unstable hemodynamics because a CT of the chest could not be performed.
A number of studies reported the value of a lung ultrasound for the diagnosis and management of community-acquired pneumonia, and it seemed to be more accurate than chest radiography.25–27 In a prospective, multi-center study designed to define the accuracy of a lung ultrasound in the diagnosis of community-acquired pneumonia,25 a lung ultrasound showed an excellent sensitivity and specificity, of 94% and 98%, respectively, which was comparable with that of a chest x-ray in 2 planes. Cortellaro et al28 found that the lung ultrasound had a sensitivity and specificity of 98% and 95%, respectively, higher than that of a chest x-ray whose sensitivity and specificity were 67% and 85%, respectively. In spite of the differences in pathogenesis between community-acquired pneumonia and VAP, both conditions eventually lead to lung consolidation with loss of aeration.29 Therefore, they share common lung ultrasound features.
Previous reports show that almost all VAPs cause various degrees of lung consolidation, whereas a lung ultrasound can be sensitive for the detection of these pathological abnormalities,30,31 which explains the excellent sensitivity of lung ultrasound in our study. Of the 48 subjects finally diagnosed with VAP, 44 showed signs of lung consolidation in a lung ultrasound, which resulted in a sensitivity of 91.7% and a negative predictive value of 92.3% in the VAP diagnosis. We can argue that a negative result of the lung ultrasound examination may rule out VAP with a sufficient level of certainty. Of note, we also found a lower diagnostic specificity of lung ultrasound alone than in community-acquired pneumonia.
In the ICU, lung consolidations detected by lung ultrasound in patients on ventilation can be caused by numerous factors other than inflammation.32,33 Pleural effusion, pulmonary hemorrhage, pulmonary embolism, post-obstructive atelectasis, or other pathological abnormalities are also characterized by lung consolidation as detected by a lung ultrasound. The presence of a lung ultrasound cannot be used to accurately differentiate between inflammatory and non-inflammatory lung consolidation. Therefore, lung consolidation in lung ultrasound imaging is not specific for VAP diagnosis. When taking this into consideration, a lung ultrasound combined with other inflammatory biomarkers may exclude consolidations caused by non-inflammatory factors and may be able to improve the specificity of lung ultrasound.
PCT is secreted as part of the systemic inflammatory response to bacterial infections and has been considered to be a valuable biomarker for the diagnosis and follow-up of patients with sepsis and community-acquired pneumonia.34 Despite its definitive role in the confirmation of sepsis and community-acquired pneumonia, its usefulness as a diagnostic marker in hospital-acquired infections, particularly those with VAP, remains controversial.35 Several studies showed that PCT was a low-sensitivity diagnostic marker for VAP.36,37 Similarly, in our study, PCT alone could not diagnose VAP sufficiently accurately, whether using a threshold of 0.25 or 0.5 ng/mL. Efforts have been made to overcome these limitations. For example, Zagli et al18 developed a novel score, CEPPIS (chest echography and procalcitonin pulmonary infection score), based on a combination of PCT and lung ultrasound for a VAP diagnosis.
The new proposed score differed from the traditional CPIS in 2 aspects: the white blood cell count was replaced by PCT, and chest x-ray was replaced by a lung ultrasound. The sensitivity of CEPPIS (80.5%) was reportedly greater than that of CPIS (39.8%) for a VAP diagnosis, whereas the specificity was comparable (specificity 85.2 vs 83.3%). In our study, the specificity of a positive lung ultrasound examination combined with a PCT of ≥0.25 ng/mL was 85.5%, which was significantly higher than a lung ultrasound, PCT, and CPIS alone. The combination of positive lung ultrasound and positive PCT results significantly improved the specificity of a lung ultrasound for a VAP diagnosis, which reduced the occurrence of false positives because a positive PCT result can exclude most of the consolidations caused by non-infectious factors.
However, our study showed that, when a lung ultrasound identified a typical consolidation pattern, the sensitivity for a VAP diagnosis was not significantly influenced by the addition of PCT. Based on our results, the combination of a lung ultrasound and PCT had a better diagnosis value than clinically used inflammatory biomarkers or CPIS. Furthermore, a lung ultrasound can track the progression of the pneumonia treated by antibiotics. In the study by Bouhemad et al,33 they compared the accuracy of chest x-ray and a lung ultrasound for measuring lung re-aeration that resulted from the administration of antibiotics in subjects with VAP. A lung ultrasound seems to be an accurate diagnostic tool for assessing the respiratory effects of antimicrobial therapy in patients with VAP. It allows the early detection of antibiotic-induced lung re-aeration or the extension of lung infection in cases of antimicrobial therapy failure.
Several limitations should be acknowledged in the study. First, airway secretion specimens obtained from endotracheal aspiration were at risk of contamination by upper respiratory tract colonization, and the accuracy of semi-quantitative culture was inferior to quantitative culture. Bronchoscopic bronchoalveolar lavage or protected specimen brush may be superior, but Bronchoscopy is an invasive technique and requires highly skilled operators. Furthermore, Bronchoscopy is not possible to use in all patients.38 In addition, due to logistical reasons, many institutions in China cannot carry out quantitative culture of bacteria. Therefore, semi-quantitative culture of endotracheal aspiration is more applicable in clinical practices. Second, a lung ultrasound is just an alternative to other lung-imaging techniques, it should always be combined with the patient's history, physical examination, and laboratory analysis. Third, a lung ultrasound is highly operator dependent, and the accuracy of the results depend on the skills of the operator. In our study, a lung ultrasound was performed by experienced physicians, all of whom received standard training in point-of-care ultrasound. Fourth, some conditions may exclude an examination with a lung ultrasound, for example, patients who are obese, those who had thoracic surgery, and those with severe chest trauma. Fifth, our study was a pilot, exploratory study, and more clinical studies will be needed to confirm the diagnostic accuracy of a lung ultrasound in VAP.
Conclusions
The combination of a lung ultrasound and PCT showed a better diagnostic performance than a lung ultrasound, PCT, CPIS, and other inflammatory biomarkers alone for a VAP diagnosis in the subjects who were on ventilation and with signs and symptoms of pneumonia. As a useful lung imaging tool in the diagnosis of VAP, examination with a lung ultrasound should be encouraged, especially in the ICU.
Footnotes
- Correspondence: Jia Song MD, Department of Critical Care Medicine, Zhejiang Hospital, 12 Lingyin Road, Hangzhou, Zhejiang 310013, China. E-mail: songjia9a{at}163.com.
This work was supported by the scientific research fund of the National Health and Family Planning Commission of PRC-Major science (WKJ-ZJ-1601), and Zhejiang medical and health science and technology plan project (2017KY182).
The authors have disclosed no conflicts of interest.
Supplementary material related to this paper is available at http://www.rcjournal.com.
- Copyright © 2019 by Daedalus Enterprises