|
|
||||||||
| Abstract |
|---|
|
|
|---|
Objective To validate the Critical-Care Pain Observation Tool.
Methods A total of 105 cardiac surgery patients in the intensive care unit, recruited in a cardiology health center in Quebec, Canada, participated in the study. Following surgery, 33 of the 105 were evaluated while unconscious and intubated and 99 while conscious and intubated; all 105 were evaluated after extubation. For each of the 3 testing periods, patients were evaluated by using the Critical-Care Pain Observation Tool at rest, during a nociceptive procedure (positioning), and 20 minutes after the procedure, for a total of 9 assessments. Each patients self-report of pain was obtained while the patient was conscious and intubated and after extubation.
Results The reliability and validity of the Critical-Care Pain Observation Tool were acceptable. Interrater reliability was supported by moderate to high weighted
coefficients. For criterion validity, significant associations were found between the patients self-reports of pain and the scores on the Critical-Care Pain Observation Tool. Discriminant validity was supported by higher scores during positioning (a nociceptive procedure) versus at rest.
Conclusions The Critical-Care Pain Observation Tool showed that no matter their level of consciousness, critically ill adult patients react to a noxious stimulus by expressing different behaviors that may be associated with pain. Therefore, the tool could be used to assess the effect of various measures for the management of pain.
Preliminary research1820 has been conducted to validate instruments that include behavioral and/or physiological indicators. Use of these instruments in critical care practice is restricted because of the limitations of the studies. Limitations include small sample sizes (<40 patients),1820 lack of validation in intubated patients,18 use of a subjective scale (eg, absence, slight, moderate, and extreme intensity of behaviors),18 confusion in the definition of behaviors (eg, body movements and muscle rigidity), and use of dependent observations (ie, statistical analysis of the observations rather than of the sample of patients).19 The aim of our study was to examine the reliability and validity of a newly developed instrument for pain assessment: the Critical-Care Pain Observation Tool (CPOT).
| Behavioral and physiological indicators are important indices for assessment of pain in patients unable to self-report.
|
| Method |
|---|
|
|
|---|
This study was approved by the human research committee of the health center. Recruitment was done the day before the surgery; the study was explained to eligible patients, and informed consent was obtained. At this time, patients were taught how to use the pain intensity descriptive scale.
Instruments
Critical-Care Pain Observation Tool.
The CPOT, developed in French, has 4 sections, each with different behavioral categories: facial expression, body movements, muscle tension, and compliance with the ventilator for intubated patients or vocalization for extubated patients (Table 1
). Items in each section are scored from 0 to 2, with a possible total score ranging from 0 to 8. The CPOT was developed as follows. Some items and their operational definitions were derived from previously described instruments for pain assessment.1821 In addition, pain indicators were described by using findings from a chart review of the medical files of 52 critically ill patients22 and from 9 focus groups with 48 critical care nurses and interviews of 12 physicians.23
|
Pain Intensity Descriptive Scale. A previously validated pain intensity descriptive scale (0=none, 1=mild, 2= moderate, 3 = severe, 4 = unbearable) was used. This scale has been used in previous studies18,25 in acute and critical care.
Confusion Assessment Method for the Intensive Care Unit. The Confusion Assessment Method for the Intensive Care Unit (CAM-ICU) was used to assess delirium. The instrument has good sensitivity and specificity for assessing delirium in critically ill patients.26,27 Two modifications were made in the CAM-ICU to adapt it to the sedation scale used in our study and to facilitate assessment of patients inattention. First, the Ramsay Scale28 was used to assess the level of sedation. Second, patients inattention was verified by assessing their capacity to concentrate on the pain intensity descriptive scale used in our study.
Procedure
Three testing periods, each including 3 assessments for a total of 9 pain assessments (T1T9) with the CPOT, were completed during each patients early postoperative course (Figure 1
). For each patient, the first 3 assessments (T1T3) were done while the patient was intubated and still unconscious (ie, with a sedation score of 5 or 6 on the Ramsay Scale). T1 was done with the patient at rest, approximately 2 hours after the end of surgery. T2 was completed a few minutes after T1 during positioning of the patient. Positioning represented a previously confirmed nociceptive procedure.9 On the basis of the patients needs, endotracheal suctioning often was performed at the same time as positioning. Finally, T3 was done at recovery, 20 minutes after the positioning procedure.
|
Finally, the third testing period (assessments T7T9) was after the patient was extubated, approximately 5 hours after the second testing period. The positioning procedure at T8 sometimes occurred with ambulation and/or respiratory exercises, which were part of the postoperative care protocol.
For each of the 3 testing periods, patients were evaluated with the CPOT for 1 minute at rest both before and after positioning and for the duration of the positioning procedure. This standardization of procedures was based on the work of Puntillo et al.9 One of us (C.G.) and a critical care nurse (G.N.) evaluated the patients. Upon completion of the CPOT during the second testing period (ie, assessments T4T6), intubated patients communicated the presence or absence of pain by nodding their heads (yes or no) to the question, Do you have pain? This procedure was selected because many intubated patients during this phase of their recovery were unable to use the pain intensity descriptive scale. Before the third testing period, at T7, patients were evaluated by using the CAM-ICU to determine the presence of delirium. Three patients were excluded because of delirium. During the third testing period (ie, assessments T7T9) after completion of the CPOT, the extubated patients used the pain intensity descriptive scale to grade their pain.
Data Analysis
Statistical analyses were completed by using version 11.5 of SPSS for Windows (SPSS Inc, Chicago, Ill). Descriptive statistics were computed for all variables. Interrater reliability was examined. Weighted
coefficients were calculated for all assessments (T1T9).29 To test validity of the CPOT, we determined criterion and discriminant validity (Table 2
). Criterion validity was examined by measuring the relationship between the CPOT scores and the patients self-reports, the gold standard measure of pain. Analysis of variance was used to examine the differences between the intubated patients self-reports of pain (yes or no) and the CPOT scores (assessments T4T6). Also, Spearman correlations31 were calculated between the extubated patients self-reports of pain intensity (ordinal descriptive scale) and the CPOT scores (assessments T7T9). Finally, discriminant validity31 was examined by performing paired t tests between assessments with the CPOT taken at rest and during positioning (T1 with T2, T4 with T5, and T7 with T8).
|
| Results |
|---|
|
|
|---|
|
Sample at the 3 Testing Periods
First Testing Period.
For assessments T1 to T3, data were collected on 33 of the 105 intubated patients who were unconscious, a criterion for testing during this period. CPOT scores were higher during the positioning procedure (T2) than during rest (T1) or recovery (T3; Figure 2
).
|
Third Testing Period.
Finally, for assessments T7 to T9, all 105 patients were assessed after they were extubated. The CPOT scores were similar to those of the 2 previous testing periods (Figure 2
).
Interrater Reliability
Together, the principal investigator and the critical care nurse (C.G. and G.N.) completed the CPOT at all 9 assessments and were blinded to each others scores. The sample sizes for interrater reliability differed for each time, reflecting the times when both were present. Weighted
coefficients were moderate to high at all assessments (Table 4
).
|
|
.001) at T7 to T9 showed that the patients self-reported pain intensity scores were moderately correlated with the CPOT scores.
Discriminant Validity
At the 3 testing periods, CPOT scores were significantly higher during positioning than during the rest periods. Table 6
gives the results of the paired t tests.
|
| Discussion |
|---|
|
|
|---|
coefficient of 0.74 when they compared behavioral pain scores between pairs of evaluators. A total of 46 nurses and nurses aides, 1 physical therapist, and 1 physician participated in that study.19 In our study, only 2 evaluators used the instrument, which is a limitation to the examination of interrater reliability, and results cannot be generalized to other ICU nurses.
| CPOT scores were associated with patients self-reports of pain.
|
When patients were intubated during the second testing period, CPOT scores differed significantly between those who reported pain and those who did not. Moreover, when patients were extubated during the third testing period, the higher a patients self-report of pain was, the higher was the patients score on the CPOT. These results are consistent with those of previous studies18,32 in which self-reports of pain of patients in a postanesthesia care unit were moderately related to pain behaviors. Our results support the criterion validity of the CPOT because the indicators were tested against the most valid measurement of pain; that is, the patients self-reports.
| CPOT scores were higher during painful procedures, lending support to its validity.
|
Discriminant validity was supported by the finding that CPOT scores were higher during positioning than at rest in the 3 testing periods. Payen et al19 also found higher behavioral scores during positioning than at rest in unconscious critically ill patients. Such results emphasize that pain behaviors are observable even if a patient cannot report pain.
Our study, however, is the first to document differences in pain behavior scores according to levels of activity during different states of consciousness and intubation: unconscious and intubated, conscious and intubated, and then awake and extubated. These results suggest that patients, whatever their levels of consciousness, may demonstrate pain behaviors in response to a nociceptive procedure. Whether a behavioral response to a noxious procedure is accompanied by perception of pain in an unconscious patient is unknown. Until there is evidence to the contrary, experts recommend that healthcare providers assume that unconscious patients may have pain, especially if behavioral responses to a known noxious stimulus occur. The experts33,34 recommend that these patients be treated the same way as conscious patients when the patients are exposed to sources of pain.
| Experts recommend we assume that unconscious patients have pain, especially if behavioral responses to noxious stimuli occur.
|
Indeed, in a study by Lawrence,35 formerly unconscious patients revealed that they could hear, understand, and respond emotionally to what was being said while they were unconscious. In light of this finding, perhaps the CPOT can be used to assess pain in other populations of critical care patients. This hypothesis requires confirmation in future studies.
Interestingly, patients seemed to have higher CPOT scores when they were conscious and intubated than they did when they were unconscious or extubated. The presence of the endotracheal tube as a potential source of pain6,36 for cardiac surgery patients, in addition to the sternal incision,5,8 may help to explain these findings. Moreover, mechanical ventilation modes provided a positive inspiratory pressure to allow distribution of oxygen throughout the lungs.17 This pressure may cause stretching of the sternal incision, which does not occur in nonsurgical patients, and which can be painful to some patients.
In our study, 65 conscious intubated patients had endotracheal suctioning while they were being positioned. However, when conscious intubated patients were positioned during assessment T5, 18 of them who did not report pain had high CPOT scores (mean 2.11, SD 0.90). Perhaps for these patients the positioning was a distressful or an uncomfortable experience1,9,37 rather than a painful one. Also, the endotracheal tube may have caused coughing during the positioning procedure, leading to higher CPOT scores in the absence of reported pain. This finding suggests that behaviors observed by using the CPOT may be an indicator of more than pain. Further research is warranted to determine the sensitivity and specificity of the CPOT as a measure of pain.
| Behaviors observed by using the CPOT may indicate more than pain.
|
We also found that CPOT scores were similarly low for both unconscious and conscious extubated patients. This result may have occurred because the patients were highly sedated while unconscious and may have been experiencing the residual effects of anesthesia.19 Once extubated, they could have experienced less severe pain than they did when they were intubated.
Data collection in this study was completed in the 8 hours after surgery, a period when intermittent drowsiness can be expected. Previous studies79,12,20 in which intubated patients provided self-reports of pain were conducted in periods varying from 12 to 72 hours after the end of surgery. Those patients might have had more time to recuperate from the residual effects of anesthesia than our patients did. In the study by Ferguson et al,5 patients self-reports of pain after coronary artery bypass graft surgery were collected more than 8 hours after the end of surgery, and 9 (21%) of 43 patients were unable to communicate their self-report of pain because of drowsiness. The occurrence of the same inability to communicate in the patients in our study is not surprising.
Limitations
This study was not without limitations. First, data were collected by only 2 persons. More raters should be used in tests of interrater reliability in subsequent evaluations of the CPOT. Second, data could be collected for only 33 of the 105 patients while the patients were unconscious. Third, postoperative drowsiness led to missing data for some patients. Finally, cardiac surgery patients are a relatively healthy ICU group and may not represent most ICU patients, who are much sicker. Future research on the effectiveness of the CPOT as a nonverbal measure of pain in other sicker ICU patients is warranted.
Despite these limitations, this study was innovative in several aspects. First, development of the CPOT was based on previous research of others as well as on descriptive data from 2 preliminary studies that led to selection of the behavioral indicators. Second, the relationship between intubated patients self-reports of pain and behavioral indicators was explored for the second time. Finally, data were obtained from patients at different levels of consciousness.
Future research should be conducted to determine if CPOT scores can be used to differentiate pain from other conditions. Also, receiver operating characteristic curve analysis could be performed to examine the specificity and the sensitivity of the CPOT as a measure of pain. This further testing could substantiate the CPOT as a valid, reliable, and useful tool for measuring pain in critically ill patients who are unable to self-report.
| Conclusions |
|---|
|
|
|---|
| ACKNOWLEDGMENTS |
|---|
To purchase electronic or print reprints, contact The InnoVision Group, 101 Columbia, Aliso Viejo, CA 92656. Phone, (800) 809-2273 or (949) 362-2050 (ext 532); fax, (949) 362-2049; e-mail, reprints{at}aacn.org.
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
C. N. Sessler and K. Varney Patient-Focused Sedation and Analgesia in the ICU Chest, February 1, 2008; 133(2): 552 - 565. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |