Abstract
Objective
Early detection of acute lung injury (ALI) is essential for timely implementation of evidence-based therapies and enrollment into clinical trials. We aimed to determine the accuracy of computerized syndrome surveillance for detection of ALI in hospitalized patients and compare it with routine clinical assessment.
Design
Using a near-real time copy of the electronic medical records, we developed and validated a custom ALI electronic alert (ALI “sniffer”) based on the European-American Consensus Conference Definition and compared its performance against provider-derived documentation.
Patients and setting
A total of 3,795 consecutive critically ill patients admitted to nine multidisciplinary intensive care units (ICUs) of a tertiary care teaching institution were included.
Measurements and main results
ALI developed in 325 patients and was recognized by bedside clinicians in only 86 (26.5%). Under-recognition of ALI was associated with not implementing protective mechanical ventilation (median tidal volumes of 9.2 vs. 8.0 ml/kg predicted body weight, P < 0.001). ALI “sniffer” demonstrated excellent sensitivity of 96% (95% CI 94–98) and moderate specificity of 89% (95% CI 88–90) with a positive predictive value ranging from 24% (95% CI 13–40) in the heart–lung transplant ICU to 64% (95% CI 55–71) in the medical ICU.
Conclusions
The computerized surveillance system accurately identifies critically ill patients who develop ALI syndrome. Since the lack of ALI recognition is a barrier to the timely implementation of best practices and enrollment into research studies, computerized syndrome surveillance could be a useful tool to enhance patient safety and clinical research.
Similar content being viewed by others
References
Brun-Buisson C, Minelli C, Bertolini G, Brazzi L, Pimentel J, Lewandowski K, Bion J, Romand JA, Villar J, Thorsteinsson A, Damas P, Armaganidis A, Lemaire F (2004) Epidemiology and outcome of acute lung injury in European intensive care units. Results from the ALIVE study. Intensive Care Med 30:51–61
Rubenfeld GD, Caldwell E, Peabody E, Weaver J, Martin DP, Neff M, Stern EJ, Hudson LD (2005) Incidence and outcomes of acute lung injury. N Engl J Med 353:1685–1693
Ferguson ND, Frutos-Vivar F, Esteban A, Fernandez-Segoviano P, Aramburu JA, Najera L, Stewart TE (2005) Acute respiratory distress syndrome: underrecognition by clinicians and diagnostic accuracy of three clinical definitions. Crit Care Med 33:2228–2234
Rubenfeld GD, Cooper C, Carter G, Thompson BT, Hudson LD (2004) Barriers to providing lung-protective ventilation to patients with acute lung injury. Crit Care Med 32:1289–1293
Umoh NJ, Fan E, Mendez-Tellez PA, Sevransky JE, Dennison CR, Shanholtz C, Pronovost PJ, Needham DM (2008) Patient and intensive care unit organizational factors associated with low tidal volume ventilation in acute lung injury. Crit Care Med 36:1463–1468
Mullon J, Gajic O, Afessa B (2006) Compliance with evidence-proven mechanical ventilation strategy in acute lung injury. Proc Am Thorac Soc A570
Chambrin MC (2001) Alarms in the intensive care unit: how can the number of false alarms be reduced? Crit Care 5:184–188
Chambrin MC, Ravaux P, Calvelo-Aros D, Jaborska A, Chopin C, Boniface B (1999) Multicentric study of monitoring alarms in the adult intensive care unit (ICU): a descriptive analysis. Intensive Care Med 25:1360–1366
Finlay HE, Cassorla L, Feiner J, Toy P (2005) Designing and testing a computer-based screening system for transfusion-related acute lung injury. Am J Clin Pathol 124:1–9
Hripcsak G, Friedman C, Alderson PO, DuMouchel W, Johnson SB, Clayton PD (1995) Unlocking clinical data from narrative reports: a study of natural language processing. Ann Intern Med 122:681–688
Herasevich V, Yilmaz M, Khan H, Chute CG, Gajic O (2007) Rule base system for identification of patients with specific critical care syndromes: the “sniffer” for acute lung injury. Proc AMIA Symp 972
Afessa B, Keegan MT, Hubmayr RD, Naessens JM, Gajic O, Long KH, Peters SG (2005) Evaluating the performance of an institution using an intensive care unit benchmark. Mayo Clin Proc 80:174–180
Herasevich V, Keegan MT, Tines D, Malinchoc MM, Hanson AC, Katyal P, Hubmayr RD, Afessa B, Gajic O (2007) “ICU of the future”: informatics infrastructure for syndrome surveillance, decision support, data mining, and modeling of critical illness. J Crit Care 22:340
Bernard GR, Artigas A, Brigham KL, Carlet J, Falke K, Hudson L, Lamy M, Legall JR, Morris A, Spragg R (1994) The American-European Consensus Conference on ARDS. Definitions, mechanisms, relevant outcomes, and clinical trial coordination. Am J Respir Crit Care Med 149:818–824
Iapichino G, Albicini M, Umbrello M, Sacconi F, Fermo I, Pavlovich R, Paroni R, Bellani G, Mistraletti G, Cugno M, Pesenti A, Gattinoni L (2008) Tight glycemic control does not affect asymmetric-dimethylarginine in septic patients. Intensive Care Med 34:1843–1850
Moran JL, Bersten AD, Solomon PJ (2005) Meta-analysis of controlled trials of ventilator therapy in acute lung injury and acute respiratory distress syndrome: an alternative perspective. Intensive Care Med 31:227–235
Miller GA (1956) The magical number seven plus or minus two: some limits on our capacity for processing information. Psychol Rev 63:81–97
Cowan N (2001) The magical number 4 in short-term memory: a reconsideration of mental storage capacity. Behav Brain Sci 24:87–114 discussion 114–185
Wolthuis EK, Korevaar JC, Spronk P, Kuiper MA, Dzoljic M, Vroom MB, Schultz MJ (2005) Feedback and education improve physician compliance in use of lung-protective mechanical ventilation. Intensive Care Med 31:540–546
Evans RS, Pestotnik SL, Classen DC, Bass SB, Menlove RL, Gardner RM, Burke JP (1991) Development of a computerized adverse drug event monitor. Proc Annu Symp Comput Appl Med Care 23–27
Kilbridge PM, Campbell UC, Cozart HB, Mojarrad MG (2006) Automated surveillance for adverse drug events at a community hospital and an academic medical center. J Am Med Inform Assoc 13:372–377
Schoenberg R, Sands DZ, Safran C (1999) Making ICU alarms meaningful: a comparison of traditional vs. trend-based algorithms. Proc AMIA Symp 379–383
Tsien CL, Fackler JC (1997) Poor prognosis for existing monitors in the intensive care unit. Crit Care Med 25:614–619
Acknowledgments
This publication was made possible by grant no. 1 KL2 RR024151 from the National Center for Research Resources (NCRR), a component of the National Institutes of Health (NIH), the NIH Roadmap for Medical Research and the Mayo Foundation. Its contents are solely the responsibility of the authors and do not necessarily represent the official view of the NCRR or NIH. Information on NCRR is available at http://www.ncrr.nih.gov/. Information on Reengineering the Clinical Research Enterprise can be obtained from http://nihroadmap.nih.gov/clinicalresearch/overviewtranslational.asp. This study was supported in part by NHLBI K23 HL78743-01A1 and NIH KL2 RR024151.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Herasevich, V., Yilmaz, M., Khan, H. et al. Validation of an electronic surveillance system for acute lung injury. Intensive Care Med 35, 1018–1023 (2009). https://doi.org/10.1007/s00134-009-1460-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00134-009-1460-1