Skip to main content

Lack of association between intraoperative handoff of care and postoperative complications: a retrospective observational study

Abstract

Background

The significance of intraoperative anesthesia handoffs on patient outcomes are unclear. One aspect differentiating the disparate results is the treatment of confounding factors, such as patient comorbidities and surgery time of day. We performed this study to quantify the significance of confounding variables on composite adverse events during intraoperative anesthesia handoffs.

Methods

In this retrospective study, we analyzed data from the American College of Surgeons National Surgical Quality Improvement Project (ACS NSQIP). We examined the effects of intraoperative handoffs between anesthesia personnel. A total of 12,111 cases performed examined at two hospitals operated by a single healthcare system that were that included in the ACS NSQIP database performed. The presence of attending and anesthetist or resident handoffs, patient age, sex, body mass index, American Society of Anesthesiologists Physical Status (ASA-PS) classification, case length, surgical case complexity, and evening/weekend start time were measured.

Results

A total of 2586 of all cases in the NSQIP dataset experienced a handoff during the case. When analyzed as a single variable, attending handoffs were associated with higher rates of adverse outcomes. However, once confounding variables were added into the analysis, attending handoffs and complete care transitions were no longer statistically significant.

Conclusions

Inclusion of significant covariates is essential to fully understanding the impact provider handoffs have on patient outcomes. Case timing and lengthy case duration are more likely to result in both a handoff and an adverse event. The impact of handoffs on patient outcomes seen in the literature are likely due, in part, to how covariates were addressed.

Peer Review reports

Background

Intraoperative transitions of anesthetic care, also referred to as handoffs or handovers, are a potential source of adverse events [1,2,3]. Handoffs represent both an opportunity for better-rested providers to heighten vigilance but also are a potential source of medical errors and heterogeneous clinical care [2, 3]. Examining their impact is important to identify opportunities to improve patient safety but potentially fraught by confounding. For example, surgical case length has been associated both with handoffs and adverse postoperative events [4, 5].

Previous large retrospective investigations exploring the association between handoffs and adverse clinical outcomes have found conflicting results, potentially owing to differences in care models or the analytic approach to confounders [6]. In a recent examination of retrospective data from over 300,000 anesthetics in Ontario, Canada, handoffs were associated with an increased risk of death, readmission, and major complications within 30 days [1]. In contrast, a prior examination of over 140,000 anesthetics within a large American university hospital, adjusted for case severity, duration, surgical complexity, and patient comorbidities, found no association between handoffs and adverse outcomes [7]. Effect estimates vary widely within other similar investigations [2, 8, 9].

We sought to further examine the association between handoffs of anesthetic care in our care team model and a composite measure of adverse postoperative outcomes using The American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP), as its definitions have been validated [10]. Measures included in the NSQIP composite outcome are: progressive or acute renal failure, cardiac arrest requiring cardiopulmonary resuscitation, stroke, any type of surgical site infection or sepsis, myocardial infarction, unplanned intubation, mechanical ventilation greater than 48 h, pneumonia, deep vein thrombosis, venous thromboembolism, urinary tract infection, or readmission within 30 days.

Methods

This study was approved by the Emory University Institutional Review Board (IRB00108382) prior to data acquisition and analysis, including a waiver of written informed consent. Our data analysis plan, including variables to include as confounders, was included with our IRB submission. This manuscript was prepared in accordance with the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement and guidelines for improved reporting of observational studies and propensity score analyses [11].

Setting

Data for the present work were drawn from two academic hospitals (Emory University Hospital and Emory University Hospital Midtown) within Emory Healthcare (EHC), which share a common anesthesia information management system (AIMS). AIMS and other electronic medical record data are consolidated nightly into the EHC Clinical Data Warehouse (CDW). At both sites, anesthetic care is delivered via the care-team model. For each surgical case, a combination of attending physician anesthesiologists, trainee physicians (i.e. residents and fellows), and non-physician anesthetists (i.e. certified registered nurse anesthetists and anesthesiologist assistants) provide care in concert. The attending physician anesthesiologist maintains responsibility for one or more concurrent patients, supervising a trainee physician or anesthetist who maintains continuous presence in the operating room. Attendings prescribe and medically direct the anesthetic plan. Only one attending anesthesiologist is responsible for the care of a patient at a time; handoffs may occur amongst attendings and/or non-attendings indicating a transfer of responsibility.

There is no mandatory handoff communication tool that is required from attending to attending. Anesthetists and residents at both hospitals are requested to complete a paper communications tool that is used for both provider and recovery room transfers of care. However, compliance is not mandatory, and no data exists to evaluate the frequency this communications tool is utilized.

Data collection

Both studied EHC hospitals are participants in NSQIP, which entails collection and reporting of structured, high quality patient-level demographic and outcomes data by abstractors hired and trained specifically for this purpose. Data from January 2014 through December 2017 were combined with patient-level data from the EHC CDW for analysis. All cases reported to NSQIP utilizing intraoperative EMR were included in this analysis.

NSQIP reporting

NSQIP reporting and sampling procedures are defined and monitored by the American College of Surgeons [12]. EHC reports both targeted and sampled data to NSQIP. Specific targeted surgeries, with 100% reporting of data from cases performed include: breast, colon, hepatobiliary, thyroid, and vascular. All other NSQIP reported cases are sampled utilizing an 8-day sampling technique where the first 40 cases performed in a rolling 8-day period are reported.

Design

This study is a retrospective analysis of routinely collected clinical data in the anesthesia record combined with the aforementioned NSQIP data, which is also collected routinely (using the aforementioned case sampling strategy) as part of surgical quality improvement monitoring at our institution. Due to the retrospective nature of the planned work, no a priori power analysis or sample size calculation was performed; the research protocol called for inclusion of all NSQIP data available within the study period.

Primary outcome

The primary outcome (dependent variables) for this study was a composite outcome of NSQIP postoperative occurrences. Specifically, any patient flagged as having any of the following occurrences was considered to have experienced the composite outcome: progressive or acute renal failure, cardiac arrest requiring cardiopulmonary resuscitation, stroke, any type of surgical site infection or sepsis, myocardial infarction, unplanned intubation, mechanical ventilation greater than 48 h, pneumonia, deep vein thrombosis, venous thromboembolism, urinary tract infection, or readmission within 30 days.

Primary and secondary exposures

The primary exposure (independent variable) of interest was handoff at the attending level. This was defined as the presence of more than one attending recorded on the anesthetic record via the AIMS.

The secondary exposure of interest was a complete handover of care. This was defined as the presence of more than one attending and more than one non-attending documented on the electronic anesthetic record. At the studied institutions, breaks for non-attending providers are documented through a separate mechanism; as such, routine breaks were not considered when determining complete handovers.

Independent variables

The independent variables included in the present analysis were patient age, sex, body mass index (BMI), ASA-PS classification, case length, surgical case complexity, and evening/weekend start time. Total case length was recorded in NSQIP; missing values were calculated as the difference between the routinely recorded anesthesia start and stop times. Surgical case complexity was defined as the quantity of American Society of Anesthesiologists Relative Value Guide base units ascribed to the case [13]. Evening/weekend start time was a binary determination based on surgery start time occurring (on Monday through Friday) prior to 7 A.M. or after 7 P.M., or occurring any time on a Saturday or Sunday. Normality was assessed via visual inspection of normalized quantile-quantile plots; case length and surgical complexity were logarithmically transformed to improve normality.

Statistical analysis

Statistical analysis was performed in R v3.3.2 (R Core Team, Vienna, Austria) using the RStudio platform v1.1.423 (R Studio Team, Boston, MA) [14, 15]. Baseline characteristics were compared on a single variable basis between those exposed to a handoff and those not exposed. Chi-square test was used for sex, ASA-PS classification, evening/weekend case, surgical specialty, and the presence of a composite NSQIP adverse event. Wilcoxon rank-sum test was used for age, BMI, and case length.

The association of the composite outcome with the primary and the secondary exposures of interest was tested in multiple ways. In addition to chi-square analysis described above, a single variable logistic regression model (binomial logistic regression with one Y/dependent variable with two levels, one X/independent variable) was constructed to test the unadjusted association of the outcome with the exposure. Additionally, two multiple variable logistic regression models were constructed (binomial logistic regression with one Y/dependent variable with two levels, multiple X/independent variables). The simpler model contained the exposure of interest plus age, sex, and ASA-PS classification. The final model contained these independent variables plus case length, surgical case complexity, and evening/weekend start time.

Results

Following exclusions (Fig. 1), 12,111 (98.2%) of 12,330 available NSQIP cases were analyzed. As seen in Table 1, 2,586 (21.3%) were exposed to an attending handoff and 1320 (10.9%) were exposed to a complete handoff. This data represented the practice of 46 attending anesthesiologists, 76 anesthetists, and 52 residents or fellows. There were significant differences between the groups, including sex, ASA-PS classification, case length, BMI, and surgical specialty. In both cases, the single variable analysis showed that there was a significant increase in the rate of composite NSQIP adverse events amongst those exposed to either type of handoff. Due to these exploratory statistical differences in multiple baseline characteristics that were found on a single variable basis, further modeling was performed using binomial multivariable logistic regression to assess whether these potential associations with NSQIP adverse events were independently associated on a multivariable basis.

Fig. 1
figure1

Diagram of cases

Table 1 Baseline characteristics of the study population

On unadjusted logistic regression, an attending handoff was associated with an odds ratio (OR) of 1.58 (95% CI, 1.41 to 1.77) of an adverse event. Complete handoff was associated with an OR of 1.89 (95% CI, 1.64 to 2.17) of an adverse event. After adjusting for only the confounding variables of patient age, sex, and ASA-PS classification (1/2, 3, or 4/5), the OR for attending handoff and complete handoff decreased slightly (1.51 [95% CI, 1.35 to 1.70] and 1.76 [95% CI, 1.53 to 2.03], respectively) but remained significant. Added adjustment for case duration and evening or weekend case status resulted in the OR of an adverse event becoming nonsignificant for both attending handoff and complete handoff (1.05 [95% CI, 0.92 to 1.19] and 1.12 [95% CI, 0.96 to 1.31], respectively). The complete results from these models are presented in Figs. 2 and 3.

Fig. 2
figure2

Complete results from a single variable, b four variable, and c six variable logistic regression analysis of the effect of attending handoff on the risk of experiencing a composite of NSQIP adverse events

Fig. 3
figure3

Complete results from a single variable, b four variable, and c six variable logistic regression analysis of the effect of complete handoff on the risk of experiencing a composite of NSQIP adverse events

Discussion

Our study demonstrated that anesthesia handoffs were associated with an increased rate of adverse events when examined in isolation. However, when accounting for all confounders, neither attending or complete handoffs of anesthesia care were associated with a composite measure of adverse postoperative outcomes. Comorbid conditions, case length, and case timing (i.e. evenings or weekends) were found to be important explanatory factors when examining the association between handoffs and adverse outcomes.

Given the complexity of perioperative care, attributing outcomes to any single intraoperative event, such as handoffs of anesthetic care, is problematic. Handoffs represent a potential entry point for error in patient care, and the Joint Commission estimates that 80% of serious medical errors involve failure of communication between caregivers [16, 17]. Changes in care team members may also introduce heterogeneity in clinical care. Conversely, handoffs allow for rested personnel to assume care, heighten vigilance and performance, and therefore possibly mitigate these risks. Estimates of handoff effects have varied widely in prior investigations; however, estimates of their effect in larger, more robust investigations have been modest [1, 2, 7, 8]. Effect estimates may therefore be influenced by sample size, case mix, and the relative balance of error introduction versus harm mitigation influenced by local practice.

Various structured tools have been proposed to mitigate the risk of communication lapses during handoffs [18, 19]. In our healthcare system, a structured communication tool is available for the providers in the operating room, however handoffs occurring between providers outside the operating room do not have readily available checklists. While various studies have demonstrated improved retention of elements of the patient’s care [20, 21], none have demonstrated differences in patient outcomes. One potential explanation for this is the immediate availability of the electronic medical record. Examining the patient’s medical record is frequently the most common task that an incoming provider performs [22], which mitigates communication lapses involving medication administration or pertinent past medical history. Another explanation could be the availability of structured communications tools, although implementation and use of these tools are highly context-dependent and with a great deal of potential variability in actual use.

Another potential explanation for the incongruity of our results with prior investigations may be that local practice patterns or experience surrounding handoffs and postoperative care can mitigate their potential harm. Our rates of attending-only and complete handoffs (21.3 and 10.9%, respectively) exceeded that of prior large investigations [1, 8, 9]. Differences in care team model, care team composition, or the conduct of handoffs may also influence their impact on clinical outcomes. Intraoperative handoffs may influence clinical outcomes by compromising the integrity of transitions to the post-anesthesia care unit (PACU) or intensive care unit through progressive knowledge loss. Our implementation of structured PACU handoffs or model of PACU care, with a dedicated attending anesthesiologist and trainee during daytime hours, may therefore mitigate the hypothetical negative impact of intraoperative handoffs.

Strengths of our study include congruence with the known literature. The explicitly performed analyses examining the impact of comorbid conditions, case length, and case timing, which are factors known to influence postoperative complications, yielded expected results. As noted by prior investigators, this type of investigation and analytic approach may be valuable means by which to assess the impact of local practice [9]. Similarly, the limited predictive ability of age and BMI in our model argue against overt residual confounding.

Our study has important limitations. Inherent to a retrospective, single-center study are the broad limitations that the work should be viewed as hypothesis-generating rather than hypothesis-testing, and that the results obtained from our center may not generalize to other contexts. In additionour sample size is based on the NSQIP sampling technique; although well-established, this may have served to introduce bias. NSQIP does not capture all potential clinical outcomes of interest, and not all outcomes are readily attributable to intraoperative anesthetic care. Surgical case volumes and types were heterogeneous, and although we attempted to adjust for surgical complexity, the strength of the observed association may vary within these categories. More broadly, residual confounding cannot be excluded despite appropriate sensitivity analyses. We conceptualized handoffs as being binary with respect to whether they occurred at the attending physician or entire anesthesia care team level. As such, our findings may not be comparable to prior studies utilizing stratified analyses of handoff counts. We did not account for the effect of staff breaks in our analysis because these may be inconsistently documented. While we utilize a structured handoff tool, we did not include this in our analysis because we were unable to assess utilization compliance. As previously discussed, local practice patterns regarding care team models and the conduct of handoffs are likely important but difficult to quantify, and therefore the generalizability of our findings to dissimilar settings is limited.

Conclusions

Transitions of intraoperative anesthetic care are common, and controversy is likely to persist regarding their impact on clinical outcomes of interest. The balance between their potential to either introduce or mitigate harm may be heavily influenced by numerous elements of local practice that are difficult to quantify. Prior investigations suggest that intraoperative handoffs are associated with a sequential, nonzero risk for unintentional harm. However, the magnitude of these effect estimates has been variable. We posit that one significant source of variability in the literature is the accounting for confounders. Our investigation builds on prior work by examining the local impact of handoffs within the context of our care team model, conduct of care transitions, and approach to perioperative care. Additional work is needed to delineate how practice patterns or other factors, such as the use of structured communication tools, influence the impact of intraoperative anesthetic handoffs on postoperative outcomes.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request. Public access to the NSQIP database is closed.

Abbreviations

ACS NSQIP:

American College of Surgeons National Surgical Quality Improvement Project

AIMS:

Anesthesia information management system

ASA-PS:

American Society of Anesthesiologists Physical Status

BMI:

Body mass index BMI

CDW:

Clinical Data Warehouse

EHC:

Emory Healthcare

OR:

Odds ratio

PACU:

Post-anesthesia care unit

STROBE:

Strengthening the Reporting of Observational Studies in Epidemiology

References

  1. 1.

    Jones PM, Cherry RA, Allen BN, et al. Association between handover of anesthesia care and adverse postoperative outcomes among patients undergoing major surgery. J Am Med Assoc. 2018;319(2):143–53.

    Article  Google Scholar 

  2. 2.

    Saager L, Hesler BD, You J, Turan A, Mascha EJ, Sessler DI, et al. Intraoperative transitions of anesthesia care and postoperative adverse outcomes. Anesthesiology. 2014;121(4):695–706.

    Article  Google Scholar 

  3. 3.

    Bagian JP, Paull DE. Handovers during anesthesia care: patient safety risk or opportunity for improvement? J Am Med Assoc. 2018;319(2):125–7.

    Article  Google Scholar 

  4. 4.

    Daley BJ, Cecil W, Clarke PC, Cofer JB, Guillamondegui OD. How slow is too slow? Correlation of operative time to complications: an analysis from the Tennessee surgical quality collaborative. J Am Coll Surg. 2015;220(4):550–8.

    Article  Google Scholar 

  5. 5.

    Jackson TD, Wannares JJ, Lancaster RT, Rattner DW, Hutter MM. Does speed matter? The impact of operative time on outcome in laparoscopic surgery. Surg Endosc. 2011;25(7):2288–95.

    Article  Google Scholar 

  6. 6.

    O’Reilly-Shah VN, Lynde GC, Jabaley CS. Anesthesia care handovers and risk of adverse outcomes. J Am Med Assoc. 2018;319(21):2235.

    Article  Google Scholar 

  7. 7.

    Terekhov MA, Ehrenfeld JM, Dutton RP, Guillamondegui OD, Martin BJ, Wanderer JP. Intraoperative care transitions are not associated with postoperative adverse outcomes. Anesthesiology. 2016;125(4):690–9.

    Article  Google Scholar 

  8. 8.

    Hudson CC, McDonald B, Hudson JK, Tran D, Boodhwani M. Impact of anesthetic handover on mortality and morbidity in cardiac surgery: a cohort study. J Cardiothorac Vasc Anesth. 2015;29(1):11–6.

    Article  Google Scholar 

  9. 9.

    Hyder JA, Bohman JK, Kor DJ, Subramanian A, Bittner EA, Narr BJ, et al. Anesthesia care transitions and risk of postoperative complications. Anesth Analg. 2016;122(1):134–44.

    Article  Google Scholar 

  10. 10.

    Khuri SF, Daley J, Henderson W, Hur K, Demakis J, Aust JB, et al. The Department of Veterans Affairs’ NSQIP: the first national, validated, outcome-based, risk-adjusted, and peer-controlled program for the measurement and enhancement of the quality of surgical care. National VA Surgical Quality Improvement Program. Ann Surg. 1998;228(4):491.

    CAS  Article  Google Scholar 

  11. 11.

    Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Int J Surg. 2014;12(12):1495–9.

    Article  Google Scholar 

  12. 12.

    User guide for the 2017 ACS NSQIP procedure targeted participant use data file (PUF)2018 8/23/2019. Available from: https://www.facs.org/-/media/files/quality-programs/nsqip/pt_nsqip_puf_userguide_2017.ashx?la=en.

  13. 13.

    The Joint Commission. Relative Value Guide 2019 Book. Schaumburg, IL, USA: American Society of Anesthesiologists; 2018. https://www.jointcommission.org/assets/1/6/tst_hoc_persp_08_12.pdf.

  14. 14.

    Team RC. R: a language and environment for statistical computing [computer software]. Vienna: R Foundation for Statistical Computing; 2016.

    Google Scholar 

  15. 15.

    RStudio Team. RStudio: Integrated Development for R. Boston: RStudio, Inc.; 2015. http://www.rstudio.com/.

  16. 16.

    The Joint Commission. Joint Commission Center for Transforming Healthcare releases targeted solutions tool for hand-off communications. Jt Comm Perspect. 2012;32(8):1 3. https://www.jointcommission.org/assets/1/6/tst_hoc_persp_08_12.pdf.

  17. 17.

    Hand-off communications Targeted Solutions Tool project detail. Joint Commission Center for Transforming Healthcare website. 2018.

    Google Scholar 

  18. 18.

    Segall N, Bonifacio AS, Schroeder RA, Barbeito A, Rogers D, Thornlow DK, et al. Can we make postoperative patient handovers safer? A systematic review of the literature. Anesth Analg. 2012;115(1):102–15.

    Article  Google Scholar 

  19. 19.

    Patterson ES, Roth EM, Woods DD, Chow R, Gomes JO. Handoff strategies in settings with high consequences for failure: lessons for health care operations. Int J Qual Health Care. 2004;16(2):125–32.

    Article  Google Scholar 

  20. 20.

    Agarwala AV, Firth PG, Albrecht MA, Warren L, Musch G. An electronic checklist improves transfer and retention of critical information at intraoperative handoff of care. Anesth Analg. 2015;120(1):96–104.

    Article  Google Scholar 

  21. 21.

    Jullia M, Tronet A, Fraumar F, Minville V, Fourcade O, Alacoque X, et al. Training in intraoperative handover and display of a checklist improve communication during transfer of care: an interventional cohort study of anaesthesia residents and nurse anaesthetists. Eur J Anaesthesiol. 2017;34(7):471.

    CAS  Article  Google Scholar 

  22. 22.

    Jurewicz K, Alfred M, Neyens DM, Catchpole K, Joseph A, Reeves ST, editors. Investigating Intraoperative and Intraprofessional Handoffs in Anesthesia. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Los Angeles: SAGE Publications Sage; 2018.

    Google Scholar 

Download references

Acknowledgments

The authors would like to acknowledge the contributions of Lisa Cogdill, MPH, Emory University Department of Libraries and Information Technology, Atlanta, GA, USA, for her assistance in performing the EHC CDW queries. We would also like to acknowledge the contribution of Benjamin Amoateng, MPH, Emory University Department of Anesthesiology, Atlanta, GA, USA, for his assistance in merging the NSQIP and EHC CDW datasets.

Funding

This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. The Emory University Department of Anesthesiology generously supported the time of the authors in producing this work.

Author information

Affiliations

Authors

Contributions

VNOS: This author acquired the data, wrote the statistical analysis plan, cleaned and analyzed the data, drafted and critically revised the manuscript, and approved the final version. VGM: This author interpreted the data, drafted the manuscript and approved the final version. CLS: This author interpreted the data, critically revised the manuscript and approved the final version. CSJ: This author interpreted the data, critically revised the manuscript and approved the final version. GCL: This author conceived the work, acquired the data, interpreted the data, drafted and critically revised the manuscript, and approved the final version. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Grant C. Lynde.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Emory University Institutional Review Board and received a complete waiver of consent. Registration number IRB00108382. The authors received administrative permission to access and use the American College of Surgeons National Surgical Quality Improvement Project data.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

O’Reilly-Shah, V.N., Melanson, V.G., Sullivan, C.L. et al. Lack of association between intraoperative handoff of care and postoperative complications: a retrospective observational study. BMC Anesthesiol 19, 182 (2019). https://doi.org/10.1186/s12871-019-0858-8

Download citation

Keywords

  • Patient safety
  • Communication
  • Patient handoff