Skip to main content
  • Research article
  • Open access
  • Published:

Predictors of the accuracy of pulse-contour cardiac index and suggestion of a calibration-index: a prospective evaluation and validation study

Abstract

Background

Cardiac Index (CI) is a key-parameter of hemodynamic monitoring. Indicator-dilution is considered as gold standard and can be obtained by pulmonary arterial catheter or transpulmonary thermodilution (TPTD; CItd). Furthermore, CI can be estimated by Pulse-Contour-Analysis (PCA) using arterial wave-form analysis (CIpc). Obviously, adjustment of CIpc to CItd initially improves the accuracy of CIpc. Despite uncertainty after which time accuracy of CIpc might be inappropriate, recalibration by TPTD is suggested after a maximum of 8 h.

We hypothesized that accuracy of CIpc might not only depend on time to last TPTD, but also on changes of the arterial wave curve detectable by PCA itself. Therefore, we tried to prospectively characterize predictors of accuracy and precision of CIpc (primary outcome). In addition to “time to last TPTD” we evaluated potential predictors detectable solely by pulse-contour-analysis.

Finally, the study aimed to develop a pulse-contour-derived “calibration-index” suggesting recalibration and to validate these results in an independent collective.

Methods

In 28 intensive-care-patients with PiCCO-monitoring (Pulsion Medical-Systems, Germany) 56 datasets were recorded. CIpc-values at baseline and after intervals of 1 h, 2 h, 4 h, 6 h and 8 h were compared to CItd derived from immediately subsequent TPTD. Results from this evaluation-collective were validated in an independent validation-collective (49 patients, 67 datasets).

Results

Mean bias values CItd-CIpc after different intervals ranged between -0.248 and 0.112 L/min/m2. Percentage-error after different intervals to last TPTD ranged between 18.6% (evaluation, 2 h-interval) and 40.3% (validation, 6 h-interval). In the merged data, percentage-error was below 30% after 1 h, 2 h, 4 h and 8 h, and exceeded 30% only after 6 h. “Time to last calibration” was neither associated to accuracy nor to precision of CIpc in any uni- or multivariate analysis.

By contrast, the height of CIpc and particularly changes in CIpc compared to last thermodilution-derived CItd(base) univariately and independently predicted the bias CItd-CIpc in both collectives.

Relative changes of CIpc compared to CItd(base) exceeding thresholds derived from the evaluation-collective (-11.6% < CIpc-CItd(base)/CItd(base) < 7.4%) were confirmed as significant predictors of a bias |CItd-CIpc| ≥ 20% in the validation-collective.

Conclusion

Recalibration triggered by changes of CIpc compared to CItd(base) derived from last calibration should be preferred to fixed intervals.

Peer Review reports

Background

Cardiac index (CI) is a key-parameter of hemodynamic monitoring. Indicator-dilution is considered as gold standard and can be obtained by pulmonary arterial catheter or transpulmonary thermodilution (TPTD; CItd) [1-4].

Furthermore, CI can be estimated by Pulse-Contour-Analysis (PCA) using arterial wave-form analysis to derive stroke volume. Pulse-Contour-Analysis has been introduced in the early 1970s [5,6] and can be used for “beat by beat”-tracking of CI after initial calibration with indicator dilution or other techniques [7-13]. Finally, Pulse-Contour-Analysis combined with biometric and empirical data can provide an uncalibrated estimate of CI [14-18].

There is consensus that indicator dilution techniques provide best accuracy. However, due to rapid and unpredictable changes in hemodynamics in critically ill, the usefulness of intermittent CI-determinations has been questioned, and continuous CI-monitoring might enhance sensitivity of CI-monitoring [19].

Although numerous studies have demonstrated appropriate correlation of PCA-derived CI (CIpc) immediately after calibration [7-13], the need for recalibration and the interval to the next calibration still are matter of debate [20-24]. As a minimum consensus, most manufacturers recommend recalibration after a maximum of 8 h.

However, some data suggest more frequent recalibration with intervals as short as one hour [20,21]. Nevertheless, there are a number of reasons to limit the frequency of TPTDs:

TPTD requires a certain amount of time of qualified personal.

Furthermore, calibration with a limited number of TPTDs carries a certain risk of imprecision that might sum up in case of repeated measurements. At least three TPTDs are required to provide acceptable precision ≤10% and detection of changes in CI ≥15% that are generally considered as clinically relevant [25-27].

However, repeated TPTDs with at least 45 ml per triplicate measurement might result in a substantial fluid load with impact on hemodynamics itself.

With the data available being not fully consistent and in part retrospective, there is a lack of studies prospectively evaluating the impact of pre-defined periods without calibration and other possible predictors of imprecision, all systematically determined within the same patient.

We hypothesized that accuracy of CIpc might not only depend on time to last TPTD, but also on changes of the arterial wave curve detectable by PCA itself.

Therefore, the aims of our study were

  • to prospectively investigate accuracy and precision of CIpc after pre-defined intervals of 1 h, 2 h, 4 h, 6 h and 8 h after the last TPTD,

  • to evaluate the impact of “time to the last TPTD-calibration” and other factors on the agreement of CIpc and CItd,

  • to derive a “calibration index” solely from PCA- parameters comprising a formula predicting the disagreement of CIpc and CItd and an alarming-function suggesting recalibration when predicted disagreement exceeds user-defined limits (e.g. >15% or >0.5 L/min/m2), and

  • to validate these results in an independent second collective.

Methods

The study was approved by the institutional review board (Ethikkommission der Fakultät für Medizin der Technischen Universität München; Ismaninger Straße 22; 81675 München). The need of informed consent was waived.

In 28 consecutive patients (evaluation collective) with PiCCO-monitoring treated in a general intensive care unit (ICU) or a toxicology ICU, 56 data-sets each including a total of 6 triplicate TPTDs at baseline and after intervals of 1 h, 2 h, 4 h, 6 h and 8 h after the last TPTD were recorded within 21 hours. Since follow-up TPTDs re-calibrated CItd, these measurements also provided the baseline CItd for the next interval. The sequence of intervals was randomized.

Results derived from this evaluation-collective were validated in an independent validation-collective of 49 patients with 67 datasets. Due to practical reasons (e.g. transport, external intervention) 21/615 (3%) of measurements could not be performed within ±10 min of the scheduled time and could not be included in the final analysis. A total of 123 datasets with 594 measurements were finally analyzed.

CIpc and CItd were determined using the PiCCO-System (Pulsion Medical Systems, Munich, Germany) as described before [21,28]. Briefly, a 5-French thermistor-tipped arterial line (Pulsiocath, Pulsion Medical Systems) placed in the femoral artery and a hemodynamic monitor (PiCCO-Plus; PiCCO-2, Pulsion Medical Systems) were used for analysis of pulse-contour and a thermodilution curve after injection of a cold indicator-bolus (15 mL saline 0.9%) through a central-venous catheter (CVC).

CIpc recorded immediately before recalibration with triplicate TPTD was compared to CItd derived from the new TPTD.

Primary endpoint: Analysis of parameters independently associated with the bias CItd-CIpc. These parameters included “time to last calibration” as well as factors continuously provided by pulse contour analysis and their changes compared to baseline.

Secondary endpoints: Analysis of parameters associated with bias CItd-CIpc exceeding pre-defined thresholds (20%, 15% of CItd and 0.5 L/min/m2) and development of a “calibration-index” suggesting recalibration based on parameters derived from pulse-contour-analysis and/or last thermodilution.

Statistics

To describe accuracy and precision of CIpc compared to CItd after different intervals, we performed analyses according to Bland-Altman [29]. To avoid analysis of repeated measurements and different numbers of measurements, Bland-Altman-analyses included only one dataset per patient (first series) and were performed separately for each interval. Percentage-error was calculated as described previously [30].

All other analyses were performed including all datasets except as indicated. For appropriate consideration of multiple measurements per patient in these analyses, uni- and multivariable regression models were fitted in a “Generalized Linear Mixed Model” (GLMM) framework. ROC-analyses were performed to assess discriminative ability of predictor variables regarding pre-defined thresholds of the bias CItd-CIpc (exceeding 20%, 15% of CItd or 0.5 L/min/m2). Percentages were calculated based on the measurements with valid data. In the course of GLMM-analysis, standard-errors of regression coefficients were reported. In order to consider repeated measurements per individual, partial correlation-coefficients (rpart) were calculated for bivariate correlation.

Predictors of bias exceeding critical thresholds derived from the evaluation-collective were analysed in the validation-collective based on ROC- and percentage-error-analysis.

All statistical analyses were performed by statistician co-author TS using IBM SPSS Statistics 21 (SPSS Inc., Chicago, IL, USA).

Results

Patients characteristics and interventions

Patients characteristics are demonstrated in Table 1.

Table 1 Patients characteristics and interventions

About 50% of all TPTD-measurements were performed during the use of catecholamines, 59% during mechanical ventilation. Within 123 series of measurements, there were changes in the use of vasoactive drugs in 71/123 (58%), in positioning (prone vs. supine) in 4/123 (3%), initiation or termination of renal replacement-therapy (RRT) in 18/123 (15%) and some kind of other intervention (volume challenge, cardiopulmonary resuscitation, endoscopy, tracheotomy) in 31/123 (25%) datasets.

Mean bias of CItd and CIpc

Neither in the evaluation-collective (4.15 ± 1.46 vs. 4.09 ± 1.41 L/min/m2; p = 0.265) nor in the validation-collective (4.07 ± 1.27 vs. 4.07 ± 1.21 L/min/m2; p = 0.555) there was a significant difference between CIpc and CItd. Mean bias values were -0.0606 ± 0.603 and 0.00261 ± 0.610 L/min/m2, respectively.

Bias values exceeding pre-defined thresholds

Despite low mean bias values, “CItd-CIpc” exceeded critical thresholds in a relevant number of single comparisons (Table 2). In the merged data, bias values exceeding ±20%, ±15% and ±0.5 L/min/m2 were observed in 85/594 (14.3%), 138/594 (23.2%) and 166/594 (27.9%) of measurements.

Table 2 Percentages of bias (CItd-CIpc)*-values exceeding critical thresholds

Impact of interval to last TPTD calibration

Figure 1 and Table 3 demonstrate mean bias and percentage-error values of CIpc vs. CItd 1 h, 2 h, 4 h, 6 h and 8 h after the last TPTD calibration.

Figure 1
figure 1

Notched boxplots demonstrate that bias CItd-CIpc did not increase over time and did not differ after various times to last calibration. Only if the notches of two boxplots do not overlap, this is ‘strong evidence’ that the two medians differ [31,32]. CItd: Thermodilution-derived Cardiac Index. CIpc: Pulse-contour-derived Cardiac Index. TPTD: Transpulmonary thermodilution.

Table 3 Percentage-error and bias CItd-CIpc values after 1 h, 2 h, 4 h, 6 h and 8 h without thermodilution (one data set per patient)

Mean bias values in general were low and ranged between -0.248 (evaluation-collective, after 6 h-interval) and 0.112 L/min/m2 (validation-collective after 2 h-interval). In both collectives mean bias values were not dependent on time to last calibration (Table 3, Figure 1). Notched boxplots further support that bias CItd-CIpc did not increase over time and did not differ after various times to last calibration: Only if the notches of two boxplots do not overlap, the two medians differ [31,32].

Percentage-error values ranged between 18.6% (evaluation, 2 h-interval) and 40.3% (validation, 6 h-interval; Table 3).

Bland-Altman-diagrams (one data set per patient; Figure 2) with lower and upper limits of agreement and bias-values demonstrate comparable accuracy and precision for the different intervals to last TPTD.

Figure 2
figure 2

Bland-Altman plots performed separately for each interval and including only one data set per patient demonstrate low bias CItd-CIpc (solid line) and comparable limits of agreement (dashed lines) 1 h, 2 h, 4 h, 6 h and 8 h after the last thermodilution. CItd: Thermodilution-derived Cardiac Index. CIpc: Pulse-contour-derived Cardiac Index.

Univariate analysis of potential predictors of bias CItd-CIpc including “time to last TPTD”

Similarly to the data based on one data set per patient (Figures 1 and 2 and Table 3), the interval to last TPTD was not associated to the bias CItd-CIpc when including repeated data sets for correlation analysis. Comparison of bias CItd-CIpc to “time to last calibration” provided poor coefficients of partial correlation rpart and p-values in evaluation-collective (rpart = -0.09; p = 0.536), validation-collective (rpart =0.083; p = 0.605) and merged data (rpart = 0.076; p = 0.363). As demonstrated in Table 4 and Figure 3, bias CItd-CIpc was most strongly associated to the difference CIpc-CItd(base) (rpart = -0.592 (evaluation-collective), rpart = -0.630 (validation-collective) and rpart = -0.606 (merged data); p < 0.001 for both collectives and merged data). The second strongest predictor of the bias CItd-CIpc was CIpc itself (rpart = -0.367 (evaluation), rpart = -0.573 (validation) and rpart = -0.466 (merged data; p < 0.001 for both collectives and merged data; Table 4; Figure 4).

Table 4 Partial correlation of predictors of absolute and relative bias (relative bias: CItd-CIpc/CItd)* (all data)
Figure 3
figure 3

CItd-CIpc was significantly associated to the difference CIpc-CItd(base): r part = -0.606; p < 0.001 (merged data). CItd: Thermodilution-derived Cardiac Index. CIpc: Pulse-contour-derived Cardiac Index. CItd(base): Cardiac index measured at previous (baseline) thermodilution. Dashed lines represent the limits of the 95%-bootstrap-confidence-intervals for the regression line (solid line).

Figure 4
figure 4

CItd-CIpc was also significantly associated to CIpc itself: r part = -0.466; p < 0.001 (merged data). CItd: Thermodilution-derived Cardiac Index. CIpc: Pulse-contour-derived Cardiac Index. CItd(base): Cardiac index measured at previous (baseline) thermodilution. Dashed lines represent the limits of the 95%-bootstrap-confidence-intervals for the regression line (solid line).

Among the other predictors, a modest association to the bias CItd-CIpc was found for changes in Pulse Pressure (PP) which was significant in evaluation- (r = -0.356; p < 0.001), validation- (r = -0.188; p = 0.023) and merged collective (r = -0.260; p < 0.001).

In addition to these associations of absolute bias CItd-CIpc to absolute changes in the above-mentioned predictors, relative bias (CItd-CIpc)/CItd was similarly associated to relative changes in the predictors (Table 4).

Multivariate analysis regarding prediction of absolute bias CItd-CIpc

In multivariate GLMM-analysis, absolute bias CItd-CIpc was independently associated to CIpc-CItd(base) (p < 0.001) and to CIpc itself (p < 0.001), but not the interval to the last TPTD. These findings were consistent for evaluation, validation and merged data. Similar results were obtained for “relative bias” CItd-CIpc/CItd (data not shown).

Univariate ROC-analysis regarding critical thresholds of bias CItd-CIpc

Bias values exceeding ±15%, ±20% and ±0.5 L/min/m2 in general were best predicted by absolute or relative changes in CIpc compared to CItd derived from the previous TPTD (CIpc-CItd(base)). Figure 5 (thermoplot) demonstrates ROC-AUCs regarding bias values exceeding ±20%.

Figure 5
figure 5

Thermoplot demonstrating “Area under the Curve” (AUC) values from Receiver Operating Characteristic (ROC)-analyses regarding bias CIt-CIpc exceeding ≥20% of CItd. Y-axis ranges from 0.5 (worthless for prediction; intense blue) to 1.0 (best prediction; intense red). The variables were aligned according to merged data. CItd: Thermodilution-derived Cardiac Index. CIpc: Pulse-contour-derived Cardiac Index. CItd(base): Cardiac index measured at previous (baseline) thermodilution. dPmax: “Index of Left Ventricular Contractility”. PP: Pulse Pressure. TPTD: Transpulmonary thermodilution. MAP: mean arterial pressure. RRsyst, RRdiast: systolic and diastolic pressure. HR: Heart rate. Δ-values compare data to corresponding values at the time of the last TPTD. [rel]: relative changes compared to time of the last TPTD. [abs]: absolute changes compared to time of the last TPTD.

E.g. a decrease in CIpc-CItd(base) of at least 11.62% provided a sensitivity, specificity and accuracy of 85%, 89% and 89% to predict a bias CItd-CIpc ≥20% in the evaluation-collective. An increase of at least 7.43% in CIpc-CItd(base) provided a sensitivity, specificity and accuracy of 76%, 76% and 76% to predict a bias CItd-CIpc ≤ -20%.

Multivariate ROC-analysis regarding critical thresholds of bias CItd-CIpc

Multivariate analysis demonstrated independent association of relative changes in CIpc-CItd(base) to relative bias (CItd-CIpc)/CItd exceeding ±15%, 20% and 0.5 L/min/m2. By contrast, “interval to last TPTD” was not independently associated to relative bias (CItd-CIpc)/CItd exceeding these thresholds.

Predictive capabilities of relative changes in “CIpc-CItd(base)” regarding several thresholds could be further improved by also including changes in “Index of Left Ventricular Contractility” (dPmax) (Figure 6) or changes in PP in a GLMM-derived multivariate model.

Figure 6
figure 6

Receiver Operating Characteristic (ROC)-analyses regarding bias CIt-CIpc exceeding ≥15%. Solid lines represent predictuion by CIpc-CItd(base), dashed lines are derived from a multivariate model including changes in CIpc-CItd(base) and in dPmax in the evaluation-collective. Red lines: Evaluation-collective. Blue lines: Validation-collective. CItd: Thermodilution-derived Cardiac Index. CIpc: Pulse-contour-derived Cardiac Index. CItd(base): Cardiac index measured at previous (baseline) thermodilution.

E.g. a model derived from the evaluation-collective including changes in CIpc-CItd(base) and in dPmax slightly improved ROC-AUC regarding relative bias exceeding ≥15% in the evaluation-collective (AUC 0.883 vs. 0.857) as well as in the validation-collective (0.761 vs. 0.720) (Figure 6).

Validation of predictors of substantial bias derived from the evaluation collective in the validation collective

Analysis of evaluation data demonstrated that a decrease in CIpc-CItd(base) of at least 11.62% or an increase of at least 7.43% significantly predicted a bias CItd-CIpc exceeding ±20% (see above).

To assess the potential practical use of these thresholds derived from the evaluation-collective in the validation-collective, we compared the 8 h percentage-error of patients in the validation-collective staying within and without these critical thresholds. In case of repeated inclusion, only the first 8 h-observation- period was analysed. 8 h-measurements in 26 validation-patients staying within the critical evaluation-thresholds of relative changes in CIpc compared to CItd(base) (-11.62% < (CIpc-CItd(base)/CItd(base) < 7.43%) provided a percentage-error of 22.6% compared to 44.0% for those 16 validation-patients outside of these evaluation-thresholds. Similar analysis of the validation-data after a 1 h-interval demonstrated a percentage-error of 9.7% in 29 patients staying within the critical thresholds of relative changes in CIpc compared to CItd(base) compared to 36.7% for patients outside of these thresholds.

Suggestion for a calibration-index-formula

To provide a first suggestion for a future calibration-index, we finally performed multiple regression analysis of the merged data resulting in a formula predicting bias CItd-CIpc:

$$ \mathrm{Estimated}\ \mathrm{absolute}\ \mathrm{bias}:\ 0.208 - 0.528*\Big(\mathrm{CIpc}-\mathrm{CItd}\left(\mathrm{base}\right) - 0.052*\mathrm{CIpc}. $$

CIpc (p = 0.003) and CIpc-CItd(base) (p < 0.001) were independently associated to CItd-CIp, whereas the other parameters included in the GLMM-analysis (time to last calibration, changes in PP and in dPmax) failed sig0nificance.

Discussion

Repeated calibration of Pulse-Contour-Analysis-derived CIpc by thermodilution is considered to improve accuracy and precision of CIpc [3-13,20-27,31]. However, frequent recalibration is time-consuming, might result in inaccuracies itself and in a substantial fluid-load. Current suggestion to repeat calibration after a maximum of 8 h is in part based on a lack of studies investigating longer calibration-free periods. Several studies suggest more frequent TPTD up to once per hour [20,21]. However, “time to last calibration” so far has not been independently associated with the bias CIpc-CItd in a prospective study.

Therefore, we prospectively evaluated the accuracy of CIpc after pre-defined calibration-free periods. The main results of this study can be summarized as follows:

Mean bias of CIpc vs. CItd was acceptable after all time-periods. However, about 23% of CIpc-values deviated ≥15% from immediately subsequent CItd. This emphasizes the need for repeated recalibration.

Adaptation of recalibration to a fixed time-based scheme is not substantiated by our data, since “time to last calibration” was neither associated to accuracy nor precision of CIpc.

By contrast, relative and absolute changes in CIpc compared to the last TPTD-derived CItd(base) were independent predictors of relative and absolute bias CItd-CIpc.

Critical thresholds of changes in CIpc compared to CItd(base) derived from the evaluation-collective were confirmed as predictors of the bias CItd-CIpc in the validation-collective.

Multivariate analyses suggest that more complex mathematical models also including CIpc itself, changes in PP and dPmax might further improve prediction of disagreement between CIpc and CItd.

In our study CIpc provided appropriate accuracy irrespective of the interval to last TPTD with mean bias values between -0.21and 0.068 L/min/m2 (merged data). These low mean bias values in all subgroups are in accordance with two studies evaluating PiCCO-derived CIpc with mean bias values of 0.03-0.16 L/min/m2 [20] and 0.06-0.29 L/min/m2 [24] after different intervals to last TPTD [20,24] and different dosages of noradrenalin [24].

Most of the other previous studies similarly demonstrated appropriate accuracy of PiCCO-derived CIpc [3-13,21-24]. However, data on precision of CIpc are more conflicting. This might be in part related to the setting of the studies: While early studies were aimed at “feasibility” of CIpc and global percentage-error evaluation in selected collectives [3-9], more recent trials analysed more heterogeneous populations also allowing subgroup-analyses regarding precision [20,24].

Driven by the practical need to define “when” to re-calibrate, time-dependency of CIpc-accuracy is an obvious hypothesis. However, this is neither well substantiated by previous investigations nor by our study: Although percentage-error was within the critical threshold of 30% only within the 1st hour in Hamzaoui’s study, time to last TPTD was not an independent predictor of precision in multivariate analysis [20].

In our merged data, percentage-error was below 30% within the first 4 hours and after 8 hours and exceeded 30% only after 6 hours. In addition to percentage-error comparison after different times to last TPTD, we performed univariate and multivariate analysis regarding agreement of single CIpc-values with CItd in two different collectives and in the merged data. Furthermore, we performed notched box-plot-analyses- favouring comparison of medians over means - for pre-defined intervals to last TPTD. None of these analyses provided evidence for time-dependency of the agreement of CIpc and CItd.

This is also in accordance with a study by Gruenewald et al. who did not find any hints for an association of CIpc-precision with interval to last TPTD [24].

In general, assessment of CIpc is mainly based on the assumption that left-ventricular stroke-volume is proportional to the area under the systolic portion of the arterial pressure-curve (AUSPC). Depending on compliance and systemic vascular resistance, identical AUSPC-values result in different stroke-volumes. Therefore, most of the pulse-contour-technologies try to correct for these individual factors. These individual factors can be assumed to be composed of static (individual biometry: age, gender, height, weight etc.) and dynamic components (changes in compliance and resistance/impedance).

Early pulse-contour-approaches were mainly based on intermittent re-adjustment. More recent approaches also tried continuous correction based on more sophisticated waveform-analysis also including shape of the waveform, position of the dicrotic notch and analysis of the post-systolic area behind the dicrotic notch. This part represents passive emptying of the aorta due to the Windkessel-effect [10]. Additionally, pulse-contour-algorithms include empirical and biometric data to a different extent. This finally resulted in approaches of CIpc-assessment exclusively based on pulse-contour-analysis, empiric and biometric data, thus totally rejecting any calibration [14-18].

The algorithm used in recent PiCCO-devices is based on intermittent recalibration as well as continuous adjustment. With the exact algorithm being proprietary, it can be assumed that TPTD-derived calibration has impact on a “patient-specific calibration-factor” remaining constant until the next calibration (“cal”; Figure 7). Furthermore, calibration intermittently modifies continuous adjustment of Systemic Vascular Resistance (SVR) and compliance (“C(p)”).

Figure 7
figure 7

Pulse-contour algorithm of the PiCCO-device. CIpc: Pulse-contour-derived Cardiac Index. SVR: Systemic Vascular Resistance. P(t): arterial pressure at any time. C(p): arterial compliance continuously adjusted for arterial pressure (proprietary algorithm).

This might in part explain that parameters adjustable by the above-mentioned formula such as changes in heart rate and arterial pressure were not substantially associated to the deviation of CIpc in our study. By contrast, changes in CIpc compared to CItd(base) and CIpc itself were independently associated with the deviation of CIpc. Independent association of CIpc to the bias CItd-CIpc suggests a systematic deviation which offers potential of systematic correction for an improved algorithm.

CIpc-CItd(base) was - by far - the most important predictor of inaccuracy of CIpc. With these changes being easily and continuously detectable by pulse-contour itself, our data suggest this parameter as a main component of a “calibration-index” triggering recalibration. Prediction of CIpc-deviation exceeding pre-defined thresholds was - in part - improved by including changes in PP and/or dPmax.

However, even a calibration-index restricted to this single predictor “CIpc-CItd(base)” provided ROC-AUCs between 0.75 and 0.81 in the prediction of CIpc-deviation exceeding several critical thresholds.

To investigate reproducibility of these data, we validated a calibration-index based on cut-offs derived from 28 evaluation-patients: PE-values were markedly lower for validation-patients-measurements within evaluation-measurements-derived thresholds (changes in CIpc compared to CItd(base) between -11.6% and +7.4%) 8 h after TPTD (22.6% vs. 44.0%), and even 1 h after TPTD (9.7% vs. 36.7%).

In addition to our findings of an association of inaccuracy of CIpc to CIpc-CItd(base) and CIpc itself, a number of clinical and/or non-hemodynamic predictors might be associated with reduced accuracy of CIpc.

Data on the impact of (changes in) vasopressor-therapy are -in part- conflicting: In an animal model, Bein and co-workers demonstrated marked deteriorated accuracy and precision after haemorrhage and application of noradrenalin [23]. In a recent study in 73 ICU-patients, the authors demonstrated improved accuracy of CIpc in patients with high doses of noradrenalin (>0.1 μg/kg/min) compared to lower doses of noradrenalin or no noradrenalin [24]. This might be explained by noradrenalin -induced arterial stiffness stabilizing compliance and resistance.

Furthermore, changes in SVR have been suggested as predictors of inaccuracy of CIpc. Rodig et al. demonstrated marked impaired bias and precision of CIpc after marked changes in SVR >60% induced by phenylephrine [7]. Yamashita et al. showed reduced accuracy and precision of CIpc after SVR-decreases induced by prostaglandin [33]. However, in Hamzaoui’s study neither univariate nor multivariate analysis demonstrated an association of changes in SVR to the agreement of CIpc and CItd [20].

Among several other parameters and interventions, increased IAP [22], haemorrhage [23] and volume resuscitation [22] have been associated with decreased accuracy of CIpc.

Practical implications

The present recommendation to recalibrate after “8 h or in case of instability or events probably associated with inaccuracy of CIpc” is difficult to perform: Even under study conditions TPTD-intervals frequently exceed 8 h [24].

Regarding an increasing number of factors and interventions (see Table 1) potentially associated to inaccuracy of CIpc, permanent screening for these factors is cumbersome and hardly feasible.

Furthermore, many of the above-mentioned events associated to CIpc-inaccuracy (vasopressors, hemorrhage, increased intra-abdominal pressure etc.) can be assumed to result in changes in arterial pulse-wave. Our data support that a calibration-index derived solely and continuously from pulse-contour-analysis might be a useful tool to improve the yield of relevant TPTD-measurements and to reduce “routine”-measurements passed down from devices incapable of combining intermittent and continuous monitoring. Summarizing different analyses of this study, re-calibration should be considered in case of changes of CIpc of more than 10% compared to the last CItd.

Limitations of the study

Despite inclusion of two independent collectives our data are derived from only two ICUs. Although our data suggest that the (in) accuracy of CIpc is predominantly associated to changes in CIpc compared to baseline CItd, we cannot definitely rule out a certain impact of time to last calibration due to the limited number of patients.

Regarding ethical considerations we did not extend the calibration-free observation-period above the maximum interval of 8 h suggested by the manufacturers.

At first glance the study design not including a pre-defined sequence of interventions (e.g. fluid-challenge, changes in vasoactive drugs) might be considered to be observational. However, based on clinical requirements most of the patients experienced substantial changes in treatment modalities during the 21 h observation-period including onset and termination of renal-replacement-therapy, changes in ventilator-settings and vasoactive drugs (Table 1).

Conclusion

At present recalibration of CIpc by TPTD is suggested after a maximum of 8 h, although there is an ongoing debate to which extent accuracy of CIpc depends on the “time to last calibration”. By contrast, this study suggests that recalibration triggered by changes of the CIpc itself compared to the last calibration should be preferred to fixed intervals to last TPTD.

Key messages

  1. 1)

    At present recalibration of CIpc by TPTD is suggested after a maximum of 8 h, although there is an ongoing debate to which extent accuracy of CIpc depends on the time to last calibration.

  2. 2)

    None of several analyses of this study supports that accuracy and/or precision of CIpc depend on the time to last calibration by TPTD.

  3. 3)

    By contrast, our data suggest that recalibration triggered by changes of CIpc itself compared to CItd(base) derived from the previous TPTD should be preferred to fixed intervals.

  4. 4)

    A “calibration-index” derived solely and continuously from pulse-contour-analysis might be a useful tool to improve the yield of relevant TPTD-measurements and to reduce “routine”-measurements after rigid intervals.

  5. 5)

    In addition to CIpc-CItd(base), changes in pulse pressure and/or dPmax might further improve a continuously derived “calibration-index” suggesting recalibration.

Abbreviations

AUC:

Area under the curve

AUSPC:

Area under the systolic portion of the arterial pressure-curve

CO:

Cardiac output

CI:

Cardiac index

CIpc:

Cardiac index derived from pulse contour analysis

CItd:

Cardiac index derived from transpulmonary thermodilution

CItd(base):

Cardiac index derived from the last (previous) transpulmonary thermodilution

CVC:

Central venous catheter

dPmax:

Index of left ventricular contractility

EVLWI:

Extravascular lung-water index

GEDVI:

Global end-diastolic volume index

GLMM:

Generalized Linear Mixed Model

ICU:

Intensive care unit

PCA:

Pulse-Contour-Analysis

PE:

Percentage error

PP:

Pulse pressure

RRT:

Renal replacement-therapy

ROC:

Receiver operating characteristics

rpart:

Coefficient of correlation r derived from partial correlation analysis

TPTD:

Transpulmonary thermodilution

References

  1. Reuter DA, Huang C, Edrich T, Shernan SK, Eltzschig HK. Cardiac output monitoring using indicator-dilution techniques: basics, limits, and perspectives. Anesth Analg. 2010;110:799–811.

    Article  PubMed  Google Scholar 

  2. Marx G, Schuerholz T, Sumpelmann R, Simon T, Leuwer M. Comparison of cardiac output measurements by arterial trans-cardiopulmonary and pulmonary arterial thermodilution with direct Fick in septic shock. Eur J Anaesthesiol. 2005;22:129–34.

    Article  CAS  PubMed  Google Scholar 

  3. Felbinger TW, Reuter DA, Eltzschig HK, Bayerlein J, Goetz AE. Cardiac index measurements during rapid preload changes: a comparison of pulmonary artery thermodilution with arterial pulse contour analysis. J Clin Anesth. 2005;17:241–8.

    Article  PubMed  Google Scholar 

  4. Friedman Z, Berkenstadt H, Margalit N, Sega E, Perel A. Cardiac output assessed by arterial thermodilution during exsanguination and fluid resuscitation: experimental validation against a reference technique. Eur J Anaesthesiol. 2002;19:337–40.

    Article  CAS  PubMed  Google Scholar 

  5. Wesseling KH, Smith NT, Nichols WW, De Wit B, Beneken JEW. Beat to beat cardiac output from the arterial pressure pulse contour. In: Feldman SA, Leigh JM, Spierdijk J, editors. Measurement anaesthesia. Leiden: Leiden University Press; 1974. p. 148–64.

    Google Scholar 

  6. Wesseling KH, Purschke R, Ty Smih N, Wuest HJ, de Wit B, Weber AP. A computer module for the continuous monitoring of cardiac output in the operating theatre and the ICU. Acta Anaesth Belgica. 1976;27:87–102.

    Google Scholar 

  7. Rodig G, Prasser C, Keyl C, Liebold A, Hobbhahn J. Continuous cardiac output measurement: pulse contour analysis vs thermodilution technique in cardiac surgical patients. Br J Anaesth. 1999;82:525–30.

    Article  CAS  PubMed  Google Scholar 

  8. Buhre W, Weyland A, Kazmaier S, Hanekop GG, Baryalei MM, Sydow M, et al. Comparison of cardiac output assessed by pulse-contour analysis and thermodilution in patients undergoing minimally invasive direct coronary artery bypass grafting. J Cardiothorac Vasc Anesth. 1999;13:437–40.

    Article  CAS  PubMed  Google Scholar 

  9. Goedje O, Hoeke K, Lichtwarck-Aschoff M, Faltchauser A, Lamm P, Reichart B. Continuous cardiac output by femoral arterial thermodilution calibrated pulse contour analysis: comparison with pulmonary arterial thermodilution. Crit Care Med. 1999;27:2407–12.

    Article  CAS  PubMed  Google Scholar 

  10. Goedje O, Hoke K, Goetz AE, Felbinger TW, Reuter DA, Reichart B, et al. Reliability of a new algorithm for continuous cardiac output determination by pulse-contour analysis during hemodynamic instability. Crit Care Med. 2002;30:52–8.

    Article  Google Scholar 

  11. Felbinger TW, Reuter DA, Eltzschig HK, Moerstedt K, Goedje O, Goetz AE. Comparison of pulmonary arterial thermodilution and arterial pulse contour analysis: evaluation of a new algorithm. J Clin Anesth. 2002;14:296–301.

    Article  PubMed  Google Scholar 

  12. Della Rocca G, Costa MG, Pompei L, Coccia C, Pietropaoli P. Continuous and intermittent cardiac output measurement: pulmonary artery catheter versus aortic transpulmonary technique. Br J Anaesth. 2002;88:350–6.

    Article  CAS  PubMed  Google Scholar 

  13. Della Rocca G, Costa MG, Coccia C, Pompei L, Di Marco P, Vilardi V, et al. Cardiac output monitoring: aortic transpulmonary thermodilution and pulse contour analysis agree with standard thermodilution methods in patients undergoing lung transplantation. Can J Anaesth. 2003;50:707–11.

    Article  PubMed  Google Scholar 

  14. Button D, Weibel L, Reuthebuch O, Genoni M, Zollinger A, Hofer CK. Clinical evaluation of the FloTrac/Vigileo system and two established continuous cardiac output monitoring devices in patients undergoing cardiac surgery. Br J Anaesth. 2007;99:329–36.

    Article  CAS  PubMed  Google Scholar 

  15. Sakka SG, Kozieras J, Thuemer O, van Hout N. Measurement of cardiac output: a comparison between transpulmonary thermodilution and uncalibrated pulse contour analysis. Br J Anaesth. 2007;99:337–42.

    Article  CAS  PubMed  Google Scholar 

  16. De Backer D, Marx G, Tan A, Junker C, Van Nuffelen M, Hüter L, et al. Arterial pressure-based cardiac output monitoring: a multicenter validation of the third-generation software in septic patients. Intensive Care Med. 2011;37:233–40.

    Article  PubMed  Google Scholar 

  17. Broch O, Renner J, Höcker J, Gruenewald M, Meybohm P, Schöttler J, et al. Uncalibrated pulse power analysis fails to reliably measure cardiac output in patients undergoing coronary artery bypass surgery. Crit Care. 2011;15:R76.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Peetermans M, Verlinden W, Jacobs J, Verrijcken A, Pilate S, Van Regenmortel N, et al. Validation of less-invasive hemodynamic monitoring with Pulsioflex in critically ill patients. Crit Care. 2012;16:226.

    Article  Google Scholar 

  19. Jellema WT, Wesseling KH, Groeneveld AB, Stoutenbeek CP, Thijs LG, van Lieshout JJ. Continuous cardiac output in septic shock by simulating a model of the aortic input impedance: A comparison with bolus injection thermodilution. Anesthesiology. 1999;90:1317–28.

    Article  CAS  PubMed  Google Scholar 

  20. Boyle M, Murgo M, O’Brien M. Assessment of drift of pulse contour cardiac output over varying recalibration intervals. Intensive Care Med. 2007;33:2032–3.

    Article  PubMed  Google Scholar 

  21. Hamzaoui O, Monnet X, Richard C, Osman D, Chemla D, Teboul JL. Effects of changes in vascular tone on the agreement between pulse contour and transpulmonary thermodilution cardiac output measurements within an up to 6-hour calibration-free period. Crit Care Med. 2008;36:434–40.

    Article  PubMed  Google Scholar 

  22. Gruenewald M, Renner J, Meybohm P, Höcker J, Scholz J, Bein B. Reliability of continuous cardiac output measurement during intra-abdominal hypertension relies on repeated calibrations: an experimental animal study. Crit Care. 2008;12:R132.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Bein B, Meybohm P, Cavus E, Renner J, Tonner PH, Steinfath M, et al. The reliability of pulse contour-derived cardiac output during hemorrhage and after vasopressor administration. Anesth Analg. 2007;105:107–13.

    Article  PubMed  Google Scholar 

  24. Gruenewald M, Meybohm P, Renner J, Broch O, Caliebe A, Weiler N, et al. Effect of norepinephrine dosage and calibration frequency on accuracy of pulse contour-derived cardiac output. Crit Care. 2011;15:R22.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Monnet X, Persichini R, Ktari M, Jozwiak M, Richard C, Teboul JL. Precision of the transpulmonary thermodilution measurements. Crit Care. 2011;15:R204.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Squara P, Cecconi M, Rhodes A, Singer M, Chiche JD. Tracking changes in cardiac output: methodological considerations for the validation of monitoring devices. Intensive Care Med. 2009;35:1801–8.

    Article  PubMed  Google Scholar 

  27. Cecconi M, Rhodes A, Poloniecki J, Della Rocca G, Grounds RM. Bench-to-bedside review: the importance of the precision of the reference technique in method comparison studies--with specific reference to the measurement of cardiac output. Crit Care. 2009;13:201.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Huber W, Umgelter A, Reindl W, Franzen M, Schmidt C, von Delius S, et al. Volume assessment in patients with necrotizing pancreatitis: a comparison of intrathoracic blood volume index, central venous pressure, and hematocrit, and their correlation to cardiac index and extravascular lung water index. Crit Care Med. 2008;36(8):2348–54.

    Article  PubMed  Google Scholar 

  29. Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8:135–60.

    Article  CAS  PubMed  Google Scholar 

  30. Critchley LA, Critchley JA. A meta-analysis of studies using bias and precision statistics to compare cardiac output measurement techniques. J Clin Monit Comput. 1999;15:85–91.

    Article  CAS  PubMed  Google Scholar 

  31. Chambers JM, Cleveland WS, Kleiner B, Tukey PA. Graphical methods for data analysis. Wadsworth & Brooks/Cole, Monterey, California; 1983.

  32. McGill R, Tukey JW, Larsen WA. Variations of Box Plots. Am Stat. 1978;32:12–6.

    Google Scholar 

  33. Yamashita K, Nishiyama T, Yokoyama T, Abe H, Manabe M. The effects of vasodilation on cardiac output measured by PiCCO. J Cardiothorac Vasc Anesth. 2008;22:688–92.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wolfgang Huber.

Additional information

Competing interests

Wolfgang Huber and Bernd Saugel collaborate with Pulsion Medical Systems AG as members of the Medical Advisory Board.

All authors declare that they have no competing interests.

Authors’ contributions

WH performed conception and design of the study, participated in the analysis of the data, drafted the manuscript and finally approved the manuscript. JK performed the majority of measurements in the evaluation collective, participated in analysis of the data and in drafting the manuscript and finally approved the manuscript. SM performed the majority of measurements in the validation collective, participated in analysis of the data and in drafting the manuscript and finally approved the manuscript. TS participated in acquisition of the data, performed the statistical analyses, participated in drafting the manuscript and finally approved the manuscript. BS participated in conception and design of the study, participated in drafting the manuscript and finally approved the manuscript. FE performed measurements in the toxicology ICU, participated in analysis of the data and in drafting the manuscript and finally approved the manuscript. VP participated in acquisition and analysis of the data, participated in drafting the manuscript and finally approved the manuscript. CS participated in acquisition and analysis of the data, participated in drafting the manuscript and finally approved the manuscript. PT participated in acquisition and analysis of the data, participated in drafting the manuscript and finally approved the manuscript. UM participated in acquisition and analysis of the data, participated in drafting the manuscript and finally approved the manuscript. HE participated in concept and design of the study, participated in acquisition and analysis of the data, participated in drafting the manuscript and finally approved the manuscript. MT participated in acquisition and analysis of the data, participated in drafting the manuscript and finally approved the manuscript. JH participated in acquisition and analysis of the data, participated in drafting the manuscript and finally approved the manuscript. RS substantially contributed to conception and design of the study, participated in the analysis of the data, participated in drafting the manuscript and finally approved the manuscript. All authors read and approved the final manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huber, W., Koenig, J., Mair, S. et al. Predictors of the accuracy of pulse-contour cardiac index and suggestion of a calibration-index: a prospective evaluation and validation study. BMC Anesthesiol 15, 45 (2015). https://doi.org/10.1186/s12871-015-0024-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12871-015-0024-x

Keywords