Abstract
BACKGROUND: The RAD-57 pulse CO-oximeter is a lightweight device allowing noninvasive measurement of blood carboxyhemoglobin (SpCO). We assessed the diagnostic value of pulse CO-oximetry, comparing SpCO values from the RAD-57 to standard laboratory blood carboxyhemoglobin (COHb) measurement in emergency department patients with suspected carbon monoxide (CO) poisoning.
METHODS: This was a prospective, diagnostic accuracy study according to the Standards for the Reporting of Diagnostic Accuracy Studies criteria in consecutive adult emergency department patients with suspected CO poisoning. SpCO was measured with the RAD-57 simultaneously with blood sampling for laboratory blood gas analysis. We made no changes to our standard management of CO poisoning. Blood COHb > 5% for non-smokers, and > 10% for smokers were applied as the reference standard.
RESULTS: We included 93 subjects: 37 smokers and 56 non-smokers. CO poisoning was diagnosed in 26 subjects (28%). The SpCO values ranged from 1% to 30%, with a median of 4% (IQR 2.7–7.3%). The COHb values ranged from 0% to 34%, with a median of 5% (IQR 2–9%). The mean differences between the COHb and SpCO values were −0.2% ± 3.3% (95% limits of agreement of −6.7% and 6.3%) for the whole cohort, −0.7% (limits of agreement −7.7% and 6.2%) for the non-smokers, and 0.6% (limits of agreement −5.0% and 6.2%) for the smokers. The optimal thresholds for detecting CO poisoning were SpCO of 9% and 6% for smokers and non-smokers, respectively.
CONCLUSIONS: SpCO measured with the RAD-57 was not a substitute for standard blood COHb measurement. However, noninvasive pulse CO-oximetry could be useful as a first-line screening test, enabling rapid detection and management of CO-poisoned patients in the emergency department.
Introduction
Carbon monoxide (CO) poisoning is the main cause of death by poisoning in Europe and the United States.1,2 In France approximately 6,000 patients are treated annually for suspected or confirmed CO exposure, of whom 2,500 are admitted to hospital and 300 die.3 Due to potential severity and the necessity of immediate therapy, there is an urgent need for rapid, reliable screening and management of CO poisoning.4,5 However, the clinical signs are polymorphic, nonspecific, and vary in time and from one patient to another.6,7 The diagnosis of CO poisoning remains a challenge, especially in the context of occult CO poisoning, in the absence of specific symptoms, or in an evocative context (fire, failing heating systems, unhealthy housing environment, presence of other victims, including animals).
Besides the clinical signs and circumstances, the diagnosis of CO poisoning relies on measurement of blood carboxyhemoglobin (COHb) via venous or arterial blood gas analysis.8 A lightweight pulse CO-oximeter enabling noninvasive CO measurement (SpCO) through a fingertip sensor has been approved for use in clinical practice since 2005 (RAD-57, Masimo, Irvine, California). However, clinical data supporting the use of noninvasive pulse CO-oximetry in patients with suspected CO poisoning in the actual clinical context is still sparse. Most of the published studies have evaluated population-based screening or small populations of patients with suspected CO poisoning, with relatively low levels or range of CO exposure, and the results from accurate comparisons between RAD-57 measurements and laboratory blood gas analysis in emergency department (ED) patients with suspected CO poisoning are debated.9
The first preliminary study of the RAD-57 in ED patients with CO poisoning showed good agreement between the RAD-57 and laboratory blood gas analysis.10 This was further confirmed in 64 ED patients included regardless of the cause of ED admission.11 An acceptable difference between RAD-57 and laboratory analysis has also been reported in other clinical settings, including a hyperbaric center and a burn unit, in studies with small numbers of poisoned patients with high COHb levels.12,13
However, 3 recent and better powered ED studies found either poor or acceptable concordance between RAD-57 and laboratory analysis. The reliability of the RAD-57 in detecting CO poisoning was advocated in one study.14–16 Acceptable agreement and reliability of the RAD-57 have been reported in laboratory studies with human volunteers.17,18 This raises the need for more clinical testing of the RAD-57 in real ED conditions.
Rapid and noninvasive detection of elevated COHb could improve diagnosis and management of CO poisoning in emergency medicine, so we evaluated the reliability and accuracy of the RAD-57 as a screening tool for acute CO poisoning in ED patients with suspected CO poisoning.
QUICK LOOK
Current knowledge
Carbon monoxide (CO) poisoning is the main cause of poisoning death in the western world. The potential severity and need for immediate treatment require a rapid and reliable screening technique for CO poisoning, which is currently guided by suspicion based on vague symptoms and knowledge of the potential exposure. The gold standard for diagnosis of CO poisoning is blood carboxyhemoglobin (COHb) measurement via laboratory CO-oximetry.
What this paper contributes to our knowledge
Noninvasive measurement of COHb with the RAD-57 device cannot be used as a substitute for standard blood COHb measurement in emergency department patients with suspected CO poisoning. However, the RAD-57 may allow rapid detection of CO-poisoned patients, among emergency department patients with suspected CO poisoning.
Methods
This study was approved by our local ethics committee, which waived the requirement for written informed consent.
Study Design and Setting
This was a prospective, diagnostic accuracy study according to the Standards for the Reporting of Diagnostic Accuracy Studies. The study was conducted in an urban-based university hospital ED, with a census of 50,000 visits per year. Consecutive adult patients presenting with suspected CO poisoning were included over a 19-month period. SpCO was measured with the RAD-57, and simultaneously venous blood was sampled for standard laboratory blood gas analysis. We made no changes to our standard CO poisoning management.
Subjects and Interventions
Subjects were consecutive patients, ≥ 18 years old, admitted to the ED for suspected CO exposure. Suspicion of CO poisoning was evoked according to clinical symptoms or circumstances. After complete physical examination, the subjects underwent venous blood sampling for standard laboratory COHb measurement, according to our standard ED management procedures for CO poisoning, and, simultaneously, CO-oximetry with the RAD-57. The following data were prospectively collected: reason for admission, age, sex, physiologic variables, smoking status, heart rate, blood pressure, SpO2, SpCO, standard laboratory tests (including blood COHb), and electrocardiography. The timing of the blood sampling and RAD-57 measurements were also recorded. Data were entered into a database (Excel, Microsoft, Redmond, Washington).
Pulse CO-Oximetry
Pulse CO-oximetry was carried out by nursing staff trained in the use of the RAD-57, with the adult size sensor on the 3rd or 4th digit, according to the manufacturer's recommendations. Nail polish was removed if necessary. SpCO is expressed as a percentage of the total hemoglobin.
Standard Blood Gas Analysis
Venous blood was collected into ethylenediaminetetraacetic acid (EDTA) treated tubes (Beckton Dickinson) and sent to the toxicology laboratory for COHb testing. Blood COHb was analyzed by derivative spectrophotometry, using an automated CO-oximeter (IL 682, Instrumentation Laboratory, Milan, Italy), which measured COHb within a range of 0–100%, with an accuracy of ± 0.5% and is reported as a percentage of the total hemoglobin.
Diagnosis of CO poisoning was deemed confirmed when the laboratory COHb value was > 5% in non-smokers, or > 10% in smokers.4
Primary Data Analysis
Descriptive statistics were used to describe the variables, including mean ± SD and median and range. The time interval between the RAD-57 measurement and blood sampling was calculated as an absolute value and is reported in hours and minutes. Correlation between SpCO and COHb was tested using intraclass correlation coefficient, along with 95% CI based on Fisher transformation. Agreement between the 2 methods was assessed according to Bland-Altman.19 Differences between the measurements were calculated as COHb minus SpCO. The mean ± SD and range values were calculated for the differences between measurements to assess bias and imprecision. Upper and lower limits of agreement were calculated as the mean difference ± 1.96 SD.
The overall diagnostic value of SpCO was quantified by calculating the area under the receiver operating characteristic curve, using the trapezoidal method, with 95% CI. SpCO thresholds for the identification of CO poisoning were calculated using receiver operating characteristic curve analysis, based on normal COHb cutoffs (5% in non-smokers and 10% in smokers). Optimal thresholds for the best combined sensitivity and specificity were determined using the Youden index. Diagnostic parameters (sensitivity, specificity, and predictive values) were calculated for each SpCO threshold, along with 95% CI, based on normal approximation. The significance level was set at P ≤ .05 for all tests. Statistical analysis was performed by author GM at Département d'information Médicale, Centre Hospitalier Régional Universitaire Lapeyronie, with statistics software (SAS 9, SAS Institute, Cary, North Carolina).
Results
Subjects
During the 19-month study, 95 patients with suspected CO poisoning were eligible for inclusion. Two patients were excluded for missing data, and 93 subjects were included (Table 1). A diagnosis of CO-poisoning was retained for 26 subjects (28%) (21 non-smokers and 5 smokers), based on the widely accepted 5% and 10% COHb thresholds for non-smokers and smokers, respectively. The median COHb levels were 7.8% (IQR 6.6−11.8%) and 12.0% (IQR 10.8–15.5%) in the non-smokers and smokers, respectively.
Agreement Between COHb and SpCO
The RAD-57 measurements and blood sampling were performed within a mean of 19 min (95% CI 10–29 min). RAD-57 measurement and blood sampling were performed simultaneously in 33% of cases. SpCO was tested before blood sampling in 46% of cases. The SpCO values ranged from 1% to 30%, and the COHb values ranged from 0% to 34%. The median values are shown in Table 1.
Moderate correlation was found between the COHb and SpCO values: r = 0.70 (95% CI 0.58–0.79) (Fig. 1). Agreement between SpCO and COHb was assessed with the Bland-Altman method. The mean ± SD bias (COHb minus SpCO) and precision were −0.2 ± 3.3% (95% CI −0.44 to 0.02%, limits of agreement −6.7% and 6.3%) for the entire cohort (Fig. 2). For the non-smokers the mean bias and precision were −0.7 ± 3.6% (95% CI −1.04 to −0.41, limits of agreement −7.7% and 6.2%, see Fig. 2). For the smokers the mean bias and precision were 0.6 ± 2.8% (95% CI −0.34 to 1.48, limits of agreement −5.0% and 6.2%, see Fig. 2).
Diagnostic Performance of SpCO
Receiver operating characteristic curves were used to identify SpCO thresholds to discriminate between poisoned and non-poisoned subjects, with the best combined sensitivity and specificity. The area under the receiver operating characteristic curve was 0.84 (95% CI 0.74–0.94) for the entire cohort. An SpCO of 9% provided the optimal threshold for detecting subjects with COHb > 10% in the entire cohort. The area under the curve of SpCO was 0.83 (95% CI 0.71–0.95) for non-smokers, and 0.98 (95% CI 0.89–1) for smokers.
The optimal SpCO threshold was 6% for non-smokers, and 9% for smokers (Fig. 3). The performance characteristics for each SpCO threshold are shown in Table 2. Seven false negatives were found.
Discussion
Our results confirm that the RAD-57's SpCO measurements cannot be used as a substitute for standard blood COHb measurement in ED subjects with suspected CO poisoning. However, our results, obtained in real ED conditions, also show that noninvasive pulse CO-oximetry allows rapid detection of CO-poisoned subjects, among ED subjects with suspected CO poisoning.
We found SpCO, with a bias of −0.2%, to slightly underestimate the blood COHb levels in our entire ED subject cohort. However, SpCO tended to overestimate COHb in smokers, with a bias of 0.6%. The precision of the RAD-57 measurements was 3.3% in our study cohort, which closely matches the measurement precision claimed by the manufacturer (3%), supporting the reliability of the noninvasive RAD-57 in actual ED conditions.
The limits of agreement between SpCO and COHb were −6.7% to 6.3%, which are similar to most limits of agreement previously reported from EDs, burn centers, hyperbaric centers, and respiratory departments, and in healthy volunteers.10–12,17,18 Our Bland-Altman analysis shows that the higher the COHb value, the more the SpCO value tends to overestimate the COHb value.
We found 6 subjects (6%) with COHb levels higher than 15% in our ED subject cohort. The accuracy and reliability of SpCO for detecting COHb > 15% have been explored in a physiological study that included 10 healthy volunteers under experimental conditions. A good correlation was found: limits of agreement −5.5% to 3.1%, bias 1.2%, and accuracy ± 2.2%, which is close to what we found in ED subjects with suspected CO poisoning, further supporting our findings.17
Multiple factors may influence the discrepancy between SpCO and COHb measurements. Besides the SpCO value, smoking, age, and time interval between measurements have been identified as independent influencing factors.15 Methemoglobin, body temperature, and blood pressure may also influence SpCO accuracy.16 Additionally, factors related to the use of the RAD-57 device may alter SpCO measurements, including an incorrectly positioned fingertip sensor, or the presence of false nails, or nail polish or dye such as henna on the nails and fingertips. Nonetheless, our study shows that pulse CO-oximetry may be an effective tool in detecting CO-poisoning in subjects with suspected CO poisoning, in real ED conditions, and with an acceptable level of accuracy.
Using commonly accepted blood COHb thresholds for the diagnosis of CO poisoning (> 10% in smokers or 5% in non-smokers), our study identified 2 SpCO thresholds that can be used to distinguish CO poisoned subjects from non-poisoned ones, with good sensitivity, specificity, and predictive values, when considering the subject's smoking status: SpCO threshold ≥ 9% in smokers, and ≥ 6% in non-smokers. The optimal SpCO threshold derived from our ED cohort (9%) is slightly higher than that reported by Roth et al.15 They reported an SpCO upper limit of normal cutoff of 6.6% in a large screening for occult CO poisoning in the ED. Their analysis was based on a limited number of subjects with a diagnosis of CO poisoning, and the normal COHb cutoff used for confirming the diagnosis of CO poisoning was not disclosed.
Furthermore, our findings support the possibility of developing an algorithm for sorting and prioritizing subjects with suspected CO poisoning upon arrival at the ED. Risk stratification could then be based on pulse CO-oximetry result and subject smoking status. Subjects with suspected CO poisoning and first-line, positive RAD-57 testing (SpCO ≥ 9% in smokers, or ≥ 6% in non-smokers) could benefit from immediate care. However, a negative RAD-57 test will not exclude standard blood COHb measurement to confirm CO poisoning.
A feature of CO poisoning is its collective nature. Rapid detection and prioritizing of patients with suspected CO poisoning could prove crucial in the ED, allowing time optimization with a strategy that includes detection, prioritizing, and care. More rapid diagnosis and initiation of hyperbaric oxygen therapy in CO poisoned patients evaluated by pulse CO-oximetry, compared with laboratory CO-oximetry, have recently been shown in a retrospective study.20 Further studies are needed to optimize the diagnostic value of pulse CO-oximetry according to the clinical setting, especially the pre-hospital screening.
Limitations
The study was conducted in a single center. The results may not be directly extrapolated to other patient populations and clinical settings, including in-hospital conditions. The COHb measurements were performed upon admission to the ED, following CO exposure. There was a 19-min median time interval between blood sampling and SpCO measurement. This time interval remained below the COHb half-life, even for patients treated with normobaric 100% oxygen, with a limited systematic bias regarding timing of either measurement. The time-lapse from the end of CO exposure, as well as the possible oxygen therapy provided by pre-hospital emergency services, prior to ED management, may explain the relatively low COHb values in our entire subject cohort. Nevertheless, this reflects real ED conditions, with patients presenting to the ED with various time lapses after CO exposure. Based on the thresholds of > 10% in smokers and > 5% in non-smokers, 28% of our cohort were diagnosed with CO poisoning. Few subjects presented with high (> 15%) or very high (> 25%) COHb.
The time between the end of CO exposure and ED admission, and the use and duration of oxygen therapy were not recorded. Methemoglobinemia, which could also be a source of error in the detection of COHb levels, was not assessed.
Conclusions
SpCO measurements from the RAD-57 cannot be used as a substitute for standard blood COHb measurement in ED patients with suspected CO poisoning. However, pulse CO-oximetry could be useful as a first-line screening test, enabling rapid detection and management of CO-poisoned patients in the ED.
Acknowledgments
We thank Dr Vahid Hosseini for contributing to the study. We thank the emergency department nurses, physicians, and other staff for their kind support of the study, and Josh Rubenovitch MD, Julie Carr MD, and Jonathan Clarke MD for contributing to English translation.
Footnotes
- Correspondence: Mustapha Sebbane MD PhD, Département des Urgences, Centre Hospitalier Régional Universitaire Lapeyronie, 371 Avenue du Doyen Gaston Giraud, 34295 -Montpellier, Cedex 5, France. E-mail: m-sebbane{at}chu-montpellier.fr.
Dr Sebbane presented a version of this paper at the fourth annual conference of the French Society for Emergency Medicine, held June 2–4, 2010, in Paris, France, and at the French Society for Anesthesia and Intensive Care, held September 22–25, 2010, in Paris, France.
The authors have disclosed no conflicts of interest.
- Copyright © 2013 by Daedalus Enterprises