Abstract
BACKGROUND: Mechanically assisted cough devices are used in patients with impaired cough to avoid secretion accumulation. We compared 5 mechanically assisted cough devices by bench testing using a breathing simulator and assessed their user-friendliness.
METHODS: We measured inspiratory and expiratory airway pressures and peak expiratory flow, the strongest indicator of cough efficacy. We performed 2 bench tests: 1) to ascertain the differences between preset and actual settings in 3 different machines of each mechanically assisted cough device and 2) to assess the effects of varying respiratory impedance and air leaks on performance of the devices. We also evaluated the user-friendliness of the devices by measuring the time required and errors in accomplishing 4 tasks by 10 physicians unfamiliar with mechanically assisted cough devices compared with product specialists from the distributing companies. Physicians also scored the ease of use.
RESULTS: Four mechanically assisted cough devices during insufflation and all 5 during exsufflation showed differences between preset and actual airway pressures. All but one device showed uneven actual pressure values between models of the same type. Peak expiratory flow was significantly influenced by the mechanical properties in 2 devices and by air leaks in 4 devices. The median time to accomplish all tasks by the product specialist (10 [interquartile range of 2–29] s) was overall significantly shorter compared with all physicians (from 19 [14–65] to 36 [19–116] s). The number of procedural errors, but not the perceived ease of use, differed significantly between the devices.
CONCLUSIONS: The performance of different mechanically assisted cough devices was erratic and included variance between models from the same manufacturer; it was affected by respiratory system impedance and air leaks. Time and rate of errors for performing procedures were elevated. These findings indicate that the devices are not interchangeable and that the settings should be targeted for each patient with the specific machine being used. Improvements in reliability, performance, and user-friendliness are advisable.
- cough
- physical therapy modalities
- respiratory therapy
- pulmonary medicine
- mechanical ventilators
- critical care
Introduction
Impaired cough with retention of tracheobronchial secretions is a common complication of neuromuscular disorders. Ineffective cough can lead to tracheotomy for the sole purpose of airway suctioning in patients with severe respiratory failure.1 Accordingly, intensive chest physical therapy, including cough assistance, is often prescribed to enhance secretion clearance.2,3
Cough assistance is traditionally based on inspiratory volume increase and manual abdominal thrust and/or chest compression. Mechanically assisted cough devices can also be used for this purpose, with either an endotracheal artificial airway4 or a mask.5 These devices sequentially apply positive and negative (subatmospheric) pressure to the airway, creating a pressure gradient to promote a peak expiratory flow (PEF) sufficient to remove secretions from the large airways. Several studies have demonstrated the effectiveness of mechanically assisted cough devices and, in some cases, superiority to manual techniques6–8 in achieving secretion clearance in both acute9,10 and chronic11,12 subjects with ineffective cough with shorter periods of treatment.13 As a result, these devices are being increasingly used, and their commercial availability in Europe has risen concomitantly. The use of mechanically assisted cough devices has been proposed for ICU patients as a means to facilitate successful extubation.9
Despite the increased availability of mechanically assisted cough devices, to our knowledge, no study has evaluated and compared different devices to ascertain whether their performances are equivalent. As the performances of other devices such as home ventilators have been shown in bench studies to vary significantly,14 we designed this bench study to evaluate and compare 5 mechanically assisted cough devices that are commercially available in Europe with respect to reliability, intra-device reproducibility, and response to varying respiratory mechanics and presence of air leaks. Moreover, considering the lack of homogeneity among mechanically assisted cough devices with respect to control screens and buttons, we also evaluated the user-friendliness of these 5 devices for ICU physicians.
QUICK LOOK
Current knowledge
Impaired cough with retention of secretions is a common complication of neuromuscular disease. Ineffective cough can lead to tracheostomy to facilitate airway suctioning in patients with respiratory failure. Intensive chest physical therapy, including cough assistance, is indicated to enhance secretion clearance. Mechanically assisted cough devices sequentially apply positive and negative pressure to the airway, creating a pressure gradient and enhancing peak expiratory flow to remove airway secretions.
What this paper contributes to our knowledge
The performance of different mechanically assisted cough devices in a model system varied widely. Devices from the same manufacturers performed differently. Changes in respiratory system impedance and air leaks significantly impacted device performance. Ease of use and time to set up the devices also differed greatly. Improved reliability of mechanically assisted cough devices is needed.
Methods
The study was performed on 2 consecutive days in November 2012 in the laboratory of the Department of Clinical Engineering at the Niguarda Cà Granda Hospital in Milan, Italy. The 5 mechanically assisted cough devices tested are listed in Table 1. The devices were connected to a breathing simulator (ASL 5000, IngMar Medical, Pittsburgh, Pennsylvania). Two different bench tests were conducted. Both tests were performed in automatic mode, with the inspiratory and expiratory airway pressures (Paw) set at −40 and +40 cm H2O, respectively, and the inspiratory (TI) and expiratory (TE) times both set 3 s, without pause in between. Immediately after the first cycle of insufflation-exsufflation, 5 consecutive respiratory cycles were recorded and averaged. Both bench tests were performed once by the same bioengineer in the Laboratory of Clinical Engineering, without familiarity with the devices under evaluation. In addition, we performed a test to evaluate the user-friendliness of the 5 devices.
Bench Test 1
Three different machines of each mechanically assisted cough device were tested in a single experimental condition (simulated compliance of 40 mL/cm H2O, simulated resistance of 10 cm H2O/L/s, no air leaks).
Bench Test 2
We used the best performing of the 3 machines evaluated in bench test 1 for each mechanically assisted cough device. The response to varying simulated respiratory mechanical properties, with and without air leaks, was evaluated mimicking 4 conditions: (1) compliance of 40 mL/cm H2O and resistance of 10 cm H2O/L/s without air leaks, (2) compliance of 40 mL/cm H2O and resistance of 10 cm H2O/L/s with air leaks, (3) compliance of 60 mL/cm H2O and resistance of 20 cm H2O/L/s without air leaks, and (4) compliance of 60 mL/cm H2O and resistance of 20 cm H2O/L/s with air leaks.
User-Friendliness Test
One product specialist for each mechanically assisted cough device, indicated by the company distributors, and 10 physicians, randomly drawn by lot from the neuro-ICU medical staff and without previous experience with any of the 5 devices under evaluation, were selected to test user-friendliness. One week before the test, the physicians received information on the functions of all 5 devices.15 Physicians were asked to perform a 4-task test for each mechanically assisted cough device. The order of evaluation of the devices was randomized for each physician. The test consisted of 4 separate phases: (1) start-up (starting the assembled device), (2) recognizing parameters (inspiratory and expiratory Paw, TI, TE, and the pause in between, requested according to a randomized sequence), (3) varying settings (inspiratory Paw of 40 cm H2O, expiratory Paw of −40 cm H2O, TI of 4 s, TE of 3 s, pause of 1 s), and (4) stop (ie, turning off the machine and activating the standby mode, if available).
Data Analysis
Data of the 2 bench tests were recorded from the ASL 5000 data output array and analyzed offline. TI, TE, PEF, and inspiratory tidal volume (VT) were obtained from the flow tracing, whereas inspiratory and expiratory Paw and time to reach 90% of preset inspiratory and expiratory Paw (T90I and T90E, respectively) were obtained from the Paw tracing.
In bench test 1, inspiratory and expiratory Paw were analyzed to evaluate whether the difference between preset and actual values was in accordance with the 4% tolerance limit indicated by the European Commission requirements (51.104-CEI EN 60601-2-12).16 To assess variability of each model, the test was performed on 3 machines obtained from the commercial distributors.
In bench test 2, we evaluated the performance of the mechanically assisted cough devices under different simulated conditions. Inspiratory and expiratory Paw, PEF, VT, T90I, and T90E were determined for each device and compared.
In the user-friendliness test, the time required to perform tasks was measured with a precision stopwatch by a second bioengineer in the laboratory of the Department of Clinical Engineering with extensive knowledge of all 5 mechanically assisted cough devices and awareness of the tasks to be accomplished. For all tasks, the time measurement was interrupted upon achievement of the specific objective or at a maximum limit of 5 min. In addition, the physicians graded the ease of use of each device, both overall and separately for each single task, using a visual analog scale on a 10-cm line marked with 0 on the left for very difficult and 10 on the right for very easy. Finally, the errors made by the physicians during test execution were counted and expressed both as absolute values and percent of the overall actions required during the test.
Statistical Analysis
Data are expressed as median (interquartile range) unless specified otherwise and were compared by analysis of variance on ranks (Kruskal-Wallis test). The Dunn post hoc test was used to ascertain differences between either selected pairs of conditions (bench test 2) or all mechanically assisted cough devices (user-friendliness test), as appropriate. We considered P < .05 to be significant.
Results
Bench Test 1
As shown in Figure 1A, the discrepancy between preset and actual inspiratory and expiratory Paw was within the 4% tolerance limits for 2 mechanically assisted cough devices (Nippy and Pulsar) only. Furthermore, all devices but one (Nippy) showed uneven inspiratory and expiratory Paw with the 3 machines tested. As shown in Figure 1B, discrepancies were observed between preset and actual TI and TE. All devices but one (Pulsar) for TI and all but 2 devices (Nippy and Pulsar) for TE showed erratic values with the 3 machines tested.
Bench Test 2
Figure 2A shows inspiratory Paw, VT, and T90I, and Figure 2B shows expiratory Paw, PEF, and T90E. Inspiratory Paw was significantly affected by mechanical properties with one device only (Pegaso) and to varying extents by the presence of air leaks with the other 4 devices. VT was affected by the simulated mechanical properties with the Nippy device and to varying extents by air leaks with the other 4 devices. T90I was unaffected by mechanical properties or air leaks with the CoughAssist; by mechanical properties with the Pegaso, Mini Pegaso, and Pulsar; and by air leaks with the Nippy. Expiratory Paw was affected by mechanical properties with the Pegaso and to varying extents by air leaks with the other 4 devices. PEF was influenced by mechanical properties with the Mini Pegaso and Pulsar and by air leaks with the Nippy, CoughAssist, Pegaso and Mini Pegaso. T90E was affected by mechanical properties with the Mini Pegaso and by air leaks with the other 4 devices.
User-Friendliness Test
All 10 physicians completed all 4 tasks. Table 2 shows (1) the median (interquartile range) of the time spent by the 10 physicians to accomplish the 4 tasks individually and overall, (2) the scores on the ease of accomplishment of the tasks by the physicians, and (3) the errors made by the physicians during task execution. Overall, the Pegaso and Pulsar showed the shortest and longest times of execution, respectively. In addition, there were wide and significant differences between the mechanically assisted cough devices with respect to the individual tasks. The scores on the ease of use were no different overall and showed significant differences only for the start-up and recognizing-parameters tasks. The CoughAssist resulted in significantly more errors overall, as opposed to the Pegaso (P = .04), Mini Pegaso (P = .04), and Pulsar (P = .03). This was due primarily to the recognizing-parameters task. The Nippy showed no significant difference with respect to all tasks compared with the other devices.
As shown in Figure 3, the overall median time spent to accomplish the 4 tasks by the product specialists using each of the 5 devices (gray bar) was significantly shorter compared with that achieved by the 10 physicians (white bars) (P = .02).
Discussion
In this study, we found that only 2 of the 5 mechanically assisted cough devices complied with the 4% tolerance limit for the discrepancy between preset and actual inspiratory and expiratory Paw. Moreover, for all devices but one, the actual inspiratory and expiratory Paw of the 3 machines tested were discrepant. In addition, the performance of the 5 devices was affected differently by the simulated mechanical properties, the air leaks, or both. Finally, the time spent to accomplish 4 tasks (separately and overall) assigned to 10 ICU physicians was largely and significantly different between devices. The ease of accomplishment of the tasks was not significantly different between the devices overall, whereas there were relatively small significant differences between devices with respect to 2 individual tasks (ie, start-up and recognizing parameters).
Our bench study is the first to evaluate and compare several mechanically assisted cough devices. In a previously published bench study comparing the Nippy and CoughAssist operating with varying mechanical properties (but without considering air leaks), PEF was found to be greater with the Nippy.17 It is of note that in a previous bench evaluation performed to assess the impact of various artificial airways on the performance of the CoughAssist, the same authors reported quite different PEF values with an identical setup.18 In keeping with these contradictory findings,17,18 we found uneven inspiratory and expiratory Paw (see Fig. 1A) and TI and TE (see Fig. 1B) between the 3 machines tested for each device. Furthermore, though all 5 devices had the European Conformity mark, only 2 devices conformed overall to the European Community 4% tolerance limit for mechanical ventilators with respect to the difference between preset and actual Paw. In addition, although the 4% tolerance limit corresponds in our study to a difference between preset and actual inspiratory and expiratory Paw of only 1.6 cm H2O (a relatively small value of limited clinical importance), some machines markedly exceeded the 4% limit (see Fig. 1A). These discrepancies may be more relevant in particular scenarios, such as when the mechanically assisted cough device is applied with a tracheotomy or endotracheal tube rather than delivered via a face mask or mouthpiece. Furthermore, we do not know whether the variance between actual and preset values is greater or less marked at insufflation-exsufflation pressure settings other than +40 to −40 cm H2O.
In a bench test of one mechanically assisted cough device (CoughAssist) at 3 different preset inspiratory and expiratory Paw with 4 simulated mechanical properties, Guérin et al18 showed that varying the size of the artificial airway (ie, the additional airway resistance imposed by the tube) affects PEF, which is the strongest indicator of cough efficacy. Our study expands this observation, demonstrating that the performance of these devices is affected by the mechanical properties of the respiratory system and by the presence of air leaks. In fact, we found not only PEF, but also VT, the actual inspiratory and expiratory Paw, T90I, and T90E to fluctuate with all mechanically assisted cough devices, although to remarkably varying extents. As shown in Figure 4, VT, actual inspiratory and expiratory Paw, T90I, and T90E are all determinants of PEF.
Gonzalez-Bermejo et al19 reported the limited user-friendliness of home ventilators and stressed the importance of this considering the increasing number of medical and nonmedical health-care professionals required to manage the technical aspects of these machines when caring for patients receiving home ventilation. The authors found that for most ventilators, the ICU physicians were slower than the specialist technician in completing the required tasks. Furthermore, the physicians scored the overall ease of use as no different between ventilators. With a similar study design, the present study extends those observations to mechanically assisted cough devices. The time taken by each task differed between devices, and overall, ICU physicians were slower than the product specialist. Also, consistent with the former study, physicians scored ease of use overall as no different between devices. Importantly, however, the only device with an analog interface (CoughAssist) produced the highest incidence of errors in the recognizing-parameters task and received the lowest score.
Our study has limitations. First, it has the intrinsic limitation of any bench evaluation that attempts in a strictly controlled environment to simulate situations that are definitely more complex and dynamically variable in the clinical setting. Although no recommendation or specific requirement exists for bench evaluations,20 in particular for these devices, we attempted to mimic the most common clinical settings and scenarios. It is clear that the huge discrepancies we found between preset and actual values and the inhomogeneous behavior of machines of the same model indicate that some mechanically assisted cough devices might not produce PEF high enough to achieve adequate airway clearance.1,9,21 Second, we extended the 4% tolerance limit (originally intended for mechanical ventilators) to mechanically assisted cough devices, which may be considered arbitrary and potentially unfair. Lacking specific criteria, we chose the evaluation regulations in force for the instruments more closely resembling these devices. Third, a blinded assessment of mechanically assisted cough devices is not feasible; nonetheless, neither the bioengineer who performed the bench testing nor the physicians involved in the user-friendliness test had previous experience with any of the devices under evaluation. Fourth, we differ from North America but are similar to many other European countries in that we do not have respiratory therapists in our hospitals and thus performed our user-friendliness evaluation by interviewing ICU physicians. Therefore, the results of our evaluation might not be applicable to other health-care professionals or nonprofessional caregivers. Considering ICU physicians' familiarity with similar but more complex devices such as mechanical ventilators, the user-friendliness of mechanically assisted cough devices might be even worse for other categories of users. Finally, we tested all of the devices available in our country at the time the study was performed. It is notable that only one device is presently available for clinical use in North America. We are aware that some new mechanically assisted cough devices have since been introduced in the market, and the manufacturers have updated some of those evaluated here. Although we share this limitation with any study evaluating medical devices, we believe that the message of this study remains valid for both clinicians and manufacturers.
Conclusions
The performance of different mechanically assisted cough devices was extremely variable, even between machines of the same model, and is affected by respiratory system impedance and air leaks. The time taken to set up and operate the devices and the number of procedural errors made by the ICU physicians were high. These findings indicate that the devices are not interchangeable and that the settings should be targeted for each patient with the specific machine utilized. A substantial improvement in reliability, reproducibility of performance, and user-friendliness is advised.
Footnotes
- Correspondence: Paolo Navalesi MD, Department of Translational Medicine, Eastern Piedmont University A. Avogadro, Via Solaroli 17, 28100 Novara, Italy. E-mail: paolo.navalesi{at}med.unipmn.it.
Supplementary material related to this paper is available at http://www.rcjournal.com.
Dr Navalesi has disclosed relationships with Intersurgical, Maquet, Dräger, Breas, Covidien, GlaxoSmithKline, Hill-Rom, and Linde AG. Dr Simonds has disclosed a relationship with ResMed. The other authors have disclosed no conflicts of interest.
See the Related Editorial on Page 1081
- Copyright © 2015 by Daedalus Enterprises