- Research article
- Open Access
Development, validation, and results of a survey to measure understanding of cardiopulmonary resuscitation choices among ICU patients and their surrogate decision makers
BMC Anesthesiology volume 14, Article number: 15 (2014)
Shared-decision-making about resuscitation goals of care for intensive care unit (ICU) patients depends on a basic understanding of cardiopulmonary resuscitation (CPR). Our objective was to develop and validate a survey to assess comprehension of CPR among ICU patients and surrogate decision-makers.
We developed a 12-item verbally-administered survey incorporating input from patients, clinicians, and expert focus groups.
We administered the survey to 32 ICU patients and 37 surrogates, as well as to 20 resident physicians to test discriminative validity. Median (interquartile range) total knowledge scores were 7 (5-10) for patients, 9 (7-12) for surrogates, and 14.5 (14-15) for physicians (p <.001). Forty-four percent of patients and 24% of surrogates could not explain the purpose of CPR. Eighty-eight percent of patients and 73% of surrogates could not name chest compressions and breathing assistance as two components of CPR in the hospital. Forty-one percent of patients and 24% of surrogates could not name a single possible complication of CPR. Forty-three percent of participants could not specify that CPR would be performed with a full code order and 25% of participants could not specify that CPR would not be performed with a do-not-resuscitate order. Internal consistency (Cronbach’s alpha = 0.97) and test-retest reliability (Pearson correlation = 0.96, p < .001) were high.
This easily administered survey, developed to measure knowledge of CPR and resuscitation preference options among ICU patients and surrogates, showed strong face validity, content validity, internal consistency, test-retest reliability, and discriminative validity. A substantial proportion of ICU patients and surrogates decision-makers have poor knowledge of CPR and basic resuscitation options.
Health care providers should discuss cardiopulmonary resuscitation (CPR) preferences with patients who are at risk of requiring CPR, in order to ensure that this intervention is in accordance with the patient’s goals of care [1, 2]. Nevertheless, such code status discussions occur with varying frequency, even for hospitalized and critically ill patients [3–6]. Discussions regarding resuscitation preferences can be difficult and confusing for patients, surrogates, and providers . While conversations about resuscitation preferences should optimally occur prior to the development of critical illness, this is often not the case and discussions occur in the context of acute critical illness and emotional distress. In addition, discussions about CPR are often unnecessarily obscured by medical jargon and do not contain the elements suggested by professional societies and bioethicists .
Knowledge of CPR and resuscitation choices is one key component of shared medical decision making . While previous survey instruments have been utilized to measure knowledge of CPR components and success rates [3, 4, 10–16], their measurement of resuscitation choices and other CPR-related terminology, as well as validation and testing in intensive care unit (ICU) populations, is limited. For this study our objectives were to: 1) Develop and validate a survey to measure patient and surrogate decision-maker understanding of resuscitation terminology and resuscitation options, and 2) Use the validated survey to measure the understanding of resuscitation terminology and resuscitation options in a cohort of ICU patients and surrogates. We hypothesized that patients and surrogates would have limited knowledge of CPR and CPR choices in the hospital, and that surrogates’ understanding would be comparatively better.
A list of possible survey items regarding CPR and resuscitation preferences was generated from interviews with patients, surrogates, internal medicine resident physicians, ICU nurses, ICU attending physicians, palliative care physicians, patient education specialists, as well as a literature review of existing resuscitation surveys [3, 4, 10–16]. This comprehensive list was then refined based on item content and usability by expert consensus of a group of five ICU physicians, five ICU nurses, and three patient education specialists. This group determined that, due to critical illness, ICU patients and their surrogates would best be served by a verbally administered questionnaire. The survey instrument assessed knowledge of the possible components of CPR in the hospital, the definition of CPR related terms and acronyms, as well as the various resuscitation preference options for hospitalized patients (see Figure 1). The survey assessed patients’ core level of knowledge of CPR (such as “What is the purpose of CPR” and “What treatments are used in CPR?”) as well as the meaning of commonly used medical terms (such as “What does intubation mean?”). The survey consisted of 12 questions with one point being awarded for each correct response. Question four had a total of four possible correct answers. Thus the score survey score ranged from 0–15 points, with higher scores representing increased knowledge.
Face and content validity
Face validity (the extent to which the survey appeared to measure its intended domain) and content validity (the extent to which the survey measured all aspects of its intended domain) were assessed via two thirty minute focus group sessions with ICU physician and nurse participants. The focus groups assessed the items for accuracy, clarity, relevance, completeness, breadth, and usability in an ICU population. We then pilot tested this survey in a small group of ten ICU patients and ten surrogates, recording their answers and any misunderstandings about the questions. We then modified the survey questions based on this feedback.
Discriminative validity (the extent to which the survey distinguished between two groups of subjects who were expected to perform differently) was measured by comparing the survey results of the patients and surrogate cohorts to a cohort of internal medicine resident physicians, who were expected to demonstrate an increased knowledge.
Test-retest reliability (the extent to which survey results were similar under different conditions or periods of time) was measured by repeating the survey in patients and surrogates 24 hours after the initial survey. Physician surveys were repeated two weeks apart.
The revised survey (see Figure 1) was then verbally administered verbatim by a single survey administrator to patients and surrogates in one surgical ICU and one mixed medical/surgical ICU in a single medical center. The survey administrator was trained in survey administration and result interpretation. The survey administrator approached the medical team (physicians and nurses) of consecutive patients admitted to the ICUs in the previous 48 hours. If the medical team determined that patients were making their own medical decisions and were not delirious, then patients were approached to enroll in the study. Patient orientation to month, year, and place was then objectively verified and informed consent was obtained. If patients with decision making capacity were unavailable to participate (such as away at testing) on two occasions, then they were excluded from the study. If patients were disoriented or were assessed not to be making their own medical decisions, then the patients’ surrogate decision makers (as named by the medical team) were approached to enroll in the study. Excluded groups included minors, prisoners, pregnant women, and non-English speakers. For the purpose of testing discriminative validity, the survey was also administered to 20 internal medicine resident physicians after informed consent was obtained. The Mayo Clinic Institutional Board of Review approved the study protocol.
Paired Student’s t-tests, the Wilcoxon’s rank-sum test, and the chi-square test were used as appropriate for univariate comparisons. Test-retest reliability was performed using a Pearson correlation for total knowledge scores. Internal consistency was measured using Cronbach’s alpha. P values < 0.05 were considered statistically significant. Statistical analysis was performed with JMP (JMP, Version 9, SAS Institute Inc.).
One hundred four ICU patients were approached for participation in the study, of which thirty two met exclusion criteria (Figure 2). In total, the survey was verbally administered to 32 patients and 37 surrogate decision members, as well as to 20 internal medicine residents test discriminative validity (Table 1).
Survey results and discriminative validity
Median (interquartile range) total knowledge scores were 7 (5-10) out of 15 for patients, 9 (7-12) for surrogates, and 14.5 (14-15) for physicians with a p value of <0.001, representing excellent discriminative validity (Table 2).
Fifty six percent of patients and 76% of surrogates could explain the purpose of CPR. Only 12% percent of patients and 27% of surrogates could name chest compressions and breathing assistance as components of CPR. Forty one percent of patients and 24% of surrogates could not name a single possible complication of CPR. Similarly, 37% of patients and 49% of surrogates were unable to conclude that CPR would be performed if the patient chose to have a Full Code status and 31% of patients and 19% of surrogates were unable to conclude that CPR would not be performed if the patient chose to have a Do Not Resuscitate code status. Two out of 20 internal medicine residents did not answer correctly the question “What do the letters CPR stand for?” and one out of 20 residents who had just started his/her training had not previously performed CPR.
Factors associated with lower knowledge scores for patients and surrogates include: advanced age, male sex, widowed or divorced marital status, and lower education level. Patients with lower self-perceived health literacy and lack of prior health care experience also had lower total knowledge scores. There was no observed association between total knowledge scores and race, prior experience performing CPR, primary ICU service, Acute physiology and chronic health evaluation III (APACHE III) score, or admission code status order (Table 3).
Internal consistency and test-retest reliability
Cronbach’s alpha for the total knowledge score was 0.97, with values > 0.7 representing acceptable internal consistency. Test-retest reliability was performed on 36 study participants. The correlation between pretest and posttest total knowledge scores was high with a Pearson correlation of 0.96 with a 95% confidence interval of 0.92-0.99 (p < .001).
This survey was developed to measure CPR knowledge in critically ill patients and their surrogate decision makers. The survey showed strong face and content validity, as well as internal consistency, test-retest reliability, and discriminative validity. The survey was easily administered to a cohort of ICU patients and surrogates by a survey administrator who read the survey verbatim. Initial survey results showed that patients and surrogate decision makers had relatively poor knowledge of CPR terminology, components, complications, and available preference options. While our results confirm prior studies that have shown patients’ limited understanding of the definition of CPR and its components [3, 4, 10–16], our survey showed these results in a validated format in an ICU population and incorporated additional questions to extend the assessment of knowledge of resuscitation preferences (ie Full Code, Do Not Resuscitate, and Do Not Intubate).
In the hospital, patient instruction regarding CPR and resuscitation preference options occurs primarily during code status discussions. These circumstances of these discussions–often brief, laden with medical jargon, occurring under stressful circumstances with providers at various levels of training–may actually contribute to poor knowledge among patients and their families . Furthermore, code status discussions also occur with varying frequency [3–6] and contain variable content . The impact of critical illness, age, and patients’ perceived health literacy may also contributed to limited comprehension. Additionally, some patients may avoid discussing CPR with their health care providers, delaying complex decision making and potentially impairing knowledge acquisition . It should be noted that code status discussions should not occur in isolation, and are part of a larger assessment of the patients’ preferences, values, and goals of medical treatment. Discussions about resuscitation preferences should ideally occur as part of advance care planning in the outpatient setting.
As we hypothesized, surrogate decision makers had somewhat higher total knowledge scores than did patients. Potential reasons to explain this observed difference include, surrogates were younger, predominantly female, had more health care experience, and had greater perceived health and self-reported health literacy. Although having a family member hospitalized in the ICU has been associated with high rates of psychologic distress and burnout among surrogate decision makers [18, 19] our survey was not designed to determine if this impacted surrogates’ knowledge scores. In addition, cognitive factors such as emotional distress, pain, anxiety, and depression in ICU patients with decision making capacity may impact decision making about complex and sensitive issues such as resuscitation preferences.
Although nearly all internal medicine resident physician participants answered every survey question correctly, some physicians did not know what the letters CPR stood for, could not name all of the components of CPR in the hospital, or had not previously performed CPR on a patient. These findings reveal that some physicians in training have a degree of unfamiliarity with CPR. In a system where a majority of code status discussions occur between patients and physicians in training, physician unfamiliarity may impact patient knowledge and decision making . Code status discussions should occur with clinicians who have received sufficient training and experience in resuscitation decision making.
Our study has several limitations. The survey instrument did not attempt to measure respondents’ understanding of CPR survival rates, which has been shown to be an important factor in patient and surrogate CPR decision making [6, 12, 13, 15]. We did not control for participant recollection of occurrence or content of CPR discussions with health care providers, which may have impacted knowledge scores. We did not control for socioeconomic status. Patient race has been shown to introduce variability in ICU decision making, and our study participants were mostly Caucasian and entirely English speaking . We also did not measure patient/surrogate satisfaction with the survey. The survey was tested in a single center with a limited number of participants. Additionally, it was only tested in internal medicine residents, and not in a larger population of physicians at various stages in their careers.
According to the current prevailing paradigm of patient-centered care, treatment decisions are ideally made using a shared decision-making model between patients, their surrogate decision makers, and their medical providers. Patient education regarding CPR and available CPR options is an essential step in this shared decision making process. This study confirms that patients and surrogates have a limited understanding of CPR in the hospital and highlights the need to develop interventions that can improve CPR knowledge and decision making, especially since prior interventions such as information leaflets have shown limited impact [22, 23].
A verbally administered survey to measure CPR knowledge among critically ill patients and their surrogate decision makers showed strong face and content validity, as well as internal consistency, test-retest reliability, and discriminative validity in an ICU population. Results from our initial survey administration showed relatively poor knowledge of CPR as well as CPR preference options among both ICU patients and their surrogates. This survey instrument can be used in intervention studies seeking to improve knowledge of CPR and CPR resuscitation choices in the ICU.
ICU patients and surrogates have poor understanding of basic resuscitation choices and knowledge of CPR.
Our validated survey can be utilized in future studies to measure to assess patient and surrogate understanding of CPR and resuscitation choices.
Intensive care unit
- APACHE III:
Acute physiology and chronic health evaluation III
Do not resuscitate
Do not intubate.
Guidelines for the appropriate use of do-not-resuscitate orders. Council on Ethical and Judicial Affairs, American Medical Association. JAMA. 1991, 265: 1868-1871.
2005 American Heart Association Guidelines for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care. Circulation. 2005, 112: IV1-IV203. 10.1161/CIRCULATIONAHA.104.479915.
Gehlbach TG, Shinkunas LA, Forman-Hoffman VL, Thomas KW, Schmidt GA, Kaldjian LC: Code status orders and goals of care in the medical ICU. Chest. 2011, 139: 802-809. 10.1378/chest.10-1798.
Heyland DK, Frank C, Groll D, Pichora D, Dodek P, Rocker G, Gafni A: Understanding cardiopulmonary resuscitation decision making: perspectives of seriously ill hospitalized patients and family members. Chest. 2006, 130: 419-428. 10.1378/chest.130.2.419.
Hofmann JC, Wenger NS, Davis RB, Teno J, Connors AF, Desbiens N, Lynn J, Phillips RS: Patient preferences for communication with physicians about end-of-life decisions. SUPPORT Investigators. Study to Understand Prognoses and Preference for Outcomes and Risks of Treatment. Ann Intern Med. 1997, 127: 1-12. 10.7326/0003-4819-127-1-199707010-00001.
Kaldjian LC, Erekson ZD, Haberle TH, Curtis AE, Shinkunas LA, Cannon KT, Forman-Hoffman VL: Code status discussions and goals of care among hospitalised adults. J Med Ethics. 2009, 35: 338-342. 10.1136/jme.2008.027854.
von Gunten CF, Ferris FD, Emanuel LL: The patient-physician relationship. Ensuring competency in end-of-life care: communication and relational skills. JAMA. 2000, 284: 3051-3057. 10.1001/jama.284.23.3051.
Anderson WG, Chase R, Pantilat SZ, Tulsky JA, Auerbach AD: Code status discussions between attending hospitalist physicians and medical patients at hospital admission. J Gen Intern Med. 2011, 26: 359-366. 10.1007/s11606-010-1568-6.
Charles C, Gafni A, Whelan T: Decision-making in the physician-patient encounter: revisiting the shared treatment decision-making model. Soc Sci Med. 1999, 49: 651-661. 10.1016/S0277-9536(99)00145-8.
Kerridge IH, Pearson SA, Rolfe IE, Lowe M, McPhee JR: Impact of written information on knowledge and preferences for cardiopulmonary resuscitation. Med J Aust. 1999, 171: 239-242.
Miller DL, Jahnigen DW, Gorbien MJ, Simbartl L: Cardiopulmonary resuscitation: how useful? Attitudes and knowledge of an elderly population. Arch Intern Med. 1992, 152: 578-582. 10.1001/archinte.1992.00400150098018.
Murphy DJ, Burrows D, Santilli S, Kemp AW, Tenner S, Kreling B, Teno J: The influence of the probability of survival on patients’ preferences regarding cardiopulmonary resuscitation. N Engl J Med. 1994, 330: 545-549. 10.1056/NEJM199402243300807.
Schonwetter RS, Teasdale TA, Taffet G, Robinson BE, Luchi RJ: Educating the elderly: cardiopulmonary resuscitation decisions before and after intervention. J Am Geriatr Soc. 1991, 39: 372-377.
Schonwetter RS, Walker RM, Kramer DR, Robinson BE: Resuscitation decision making in the elderly: the value of outcome data. J Gen Intern Med. 1993, 8: 295-300. 10.1007/BF02600139.
Thorevska N, Tilluckdharry L, Tickoo S, Havasi A, Amoateng-Adjepong Y, Manthous CA: Patients’ understanding of advance directives and cardiopulmonary resuscitation. J Crit Care. 2005, 20: 26-34. 10.1016/j.jcrc.2004.11.002.
Yamada R, Galecki AT, Goold SD, Hogikyan RV: A multimedia intervention on cardiopulmonary resuscitation and advance directives. J Gen Intern Med. 1999, 14: 559-563. 10.1046/j.1525-1497.1999.11208.x.
Deep KS, Griffith CH, Wilson JF: Communication and decision making about life-sustaining treatment: examining the experiences of resident physicians and seriously-ill hospitalized patients. J Gen Intern Med. 2008, 23: 1877-1882. 10.1007/s11606-008-0779-6.
Azoulay E, Pochard F, Kentish-Barnes N, Chevret S, Aboab J, Adrie C, Annane D, Bleichner G, Bollaert PE, Darmon M, Fassier T, Galliot R, Garrouste-Orgeas M, Goulenok C, Goldgran-Toledano D, Haydon J, Jourdain M, Kaidomar M, Laplace C, Larché J, Liotier J, Papazian L, Poisson C, Reignier J, Saidi F, Schlemmer B, FAMIREA Study Group: Risk of post-traumatic stress symptoms in family members of intensive care unit patients. Am J Respir Crit Care Med. 2005, 171: 987-994. 10.1164/rccm.200409-1295OC.
Cook D, Rocker G, Marshall J, Sjokvist P, Dodek P, Griffith L, Freitag A, Varon J, Bradley C, Levy M, Finfer S, Hamielec C, McMullin J, Weaver B, Walter S, Guyatt G, for the Level of Care Study Investigators and the Canadian Critical Care Trials Group: Withdrawal of mechanical ventilation in anticipation of death in the intensive care unit. N Engl J Med. 2003, 349: 1123-1132. 10.1056/NEJMoa030083.
Smith AK, Ries AP, Zhang B, Tulsky JA, Prigerson HG, Block SD: Resident approaches to advance care planning on the day of hospital admission. Arch Intern Med. 2006, 166: 1597-1602. 10.1001/archinte.166.15.1597.
Muni S, Engelberg RA, Treece PD, Dotolo D, Curtis JR: The influence of race/ethnicity and socioeconomic status on end-of-life care in the ICU. Chest. 2011, 139: 1025-1033. 10.1378/chest.10-3011.
Gates RA, Weaver MJ, Gates RH: Patient acceptance of an information sheet about cardiopulmonary resuscitation options. J Gen Intern Med. 1993, 8: 679-682. 10.1007/BF02598286.
Sivakumar R, Knight J, Devlin C, Keir P, Ghosh P, Khan S: Communicating information on cardiopulmonary resuscitation to hospitalised patients. J Med Ethics. 2004, 30: 311-312. 10.1136/jme.2002.002915.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2253/14/15/prepub
The authors would like to thank David Eton, PhD, Division of Health Care Policy & Research, Department of Health Sciences Research, Mayo Clinic, Rochester, Minnesota for his thoughtful review and guidance. Financial Support was provided by Mayo Clinic and Mayo Foundation, which did not participate in the collection, analysis, or interpretation of data, in the writing of the manuscript or in the decision to submit the manuscript for publication.
The authors declare that they have no competing interests.
MW participated in study design, survey distribution, statistical analysis, and drafted the manuscript. AK and RH participated in survey distribution, study coordination, and statistical analysis. JL participated in study design and manuscript preparation. OG and KK participated in study design, oversight, and manuscript review. All authors read and approved the final manuscript.
About this article
Cite this article
Wilson, M.E., Akhoundi, A., Krupa, A.K. et al. Development, validation, and results of a survey to measure understanding of cardiopulmonary resuscitation choices among ICU patients and their surrogate decision makers. BMC Anesthesiol 14, 15 (2014). https://doi.org/10.1186/1471-2253-14-15
- Cardiopulmonary resuscitation
- Health knowledge
- Intensive care unit