Background
Doppler echocardiography (DE) is widely used as a surrogate for right heart catheterization (RHC), the gold standard, to assess and monitor elevated right heart pressure in children. However, its accuracy has not been prospectively validated in children. The objectives of this study were to evaluate the accuracy of DE in predicting simultaneously measured right ventricular (RV) pressure by RHC in pediatric patients and to determine if the degree of RV hypertension affects the accuracy of DE in assessing right heart pressure.
Methods
Eighty children (age range, 0–17.9 years; median age, 5.5 years) with two-ventricle physiology and a wide range of right heart pressures underwent simultaneous DE and RHC. The pressure gradient between the right ventricle and the right atrium was directly measured by RHC and simultaneously estimated by DE using tricuspid regurgitation. Patients were then grouped on the basis of RHC-measured RV systolic pressure (RVSP): group 1 ( n = 43), with RVSP < 1/2 systemic systolic blood pressure (SBP); group 2 ( n = 37), with RVSP ≥ 1/2 SBP; group 3 ( n = 56), with RVSP < 2/3 SBP; and group 4 ( n = 24), with RVSP ≥ 2/3 SBP. Correlation and Bland-Altman analyses were performed on all groups. Accuracy was predefined as 95% limits of agreement within ±10 mm Hg.
Results
Despite a reasonable correlation between DE and RHC in all groups, there was poor agreement between techniques as RVSP/SBP increased. DE was inaccurate in one of 43 patients in group 1 (2%) versus nine of 37 in group 2 (24%) and was inaccurate in one of 56 patients in group 3 (2%) versus eight of 24 in group 4 (33%). Overestimation and underestimation occurred equally in all groups.
Conclusion
DE inaccurately estimates RV pressure in children with elevated right heart pressure. It should not be relied on as the sole method of assessing right heart hemodynamics in children with RV hypertension.
A wide variety of cardiopulmonary disease processes can lead to the elevation of right heart pressure. In broad categories, elevation of right ventricular (RV) pressure can result from RV outflow tract obstruction, branch pulmonary artery obstruction, pulmonary vascular obstructive disease, pulmonary venous obstruction, or left ventricular inflow obstruction. Right heart catheterization (RHC) remains the gold standard for evaluating right heart hemodynamics in these patients. The risk for exposure to radiation and the invasive nature of RHC prompted investigators in the 1980s to introduce noninvasive methods of assessing right heart hemodynamics, specifically Doppler echocardiography (DE). These studies showed excellent correlation between DE-estimated RV pressure using tricuspid regurgitation (TR) and direct RHC-measured RV pressure. Because of its widespread availability and noninvasive nature, DE is now a widely used surrogate for RHC to determine and monitor right heart pressure in a wide variety of disease processes.
Recently, the accuracy of DE in estimating right heart hemodynamics has come into question. The initial studies comparing DE and RHC to assess right heart hemodynamics used correlation and regression analysis. This type of statistical analysis has its shortcomings, as highlighted by Bland and Altman in their seminal report in 1986. Bland and Altman argued that a high degree of correlation between two methods of measurement should not be interpreted as indicating accuracy and interchangeability of the two methods. Instead, they advocated using bias and precision statistics to compare different techniques of measuring the same physiologic variable. Bland-Altman analysis is now the accepted statistical method of comparing two methods of measuring the same physiologic variable, superseding correlation and regression. Recent studies in adults comparing DE and RHC using Bland-Altman analyses have suggested that DE is not as accurate as previously described for the assessment of right heart hemodynamics. A prospective, simultaneous study comparing DE and RHC using Bland-Altman analyses has not been performed in children.
In a prospective, simultaneous DE and RHC study in children, we sought to analyze the accuracy of DE in estimating right heart pressure. We further sought to determine if the degree of RV hypertension affects the accuracy of DE in assessing right heart pressure.
Methods
Patient Population
All children aged 0 to 17.9 years who presented to the St. Louis Children’s Hospital cardiac catheterization laboratory for clinically indicated RHC between November 2011 and November 2012 were considered for enrollment. Inclusion criteria were two-ventricle physiology, adequate TR envelope on precatheterization echocardiography, and sinus rhythm. Exclusion criteria were single-ventricle physiology, the presence of a subpulmonary morphologic left ventricle, and the presence of a mechanical tricuspid valve. Informed, written parental consent was obtained for all subjects. Informed, written assent was obtained for all subjects >12 years of age. The study was approved by the institutional review board for human studies at Washington University School of Medicine.
Catheterization Data
All patients underwent simultaneous measurement of the peak RV–to–right atrial (RA) pressure gradient (ΔP) by RHC and by DE. All data collection was done with the patient in the supine position and under the usual sterile conditions of the catheterization laboratory. RV and RA pressure tracings were recorded using a standard fluid-filled, end-hole catheter in pullback fashion. RV and RA pressure tracings were recorded simultaneous to the performance of DE. RHC-measured ΔP (ΔP C ) was calculated by subtracting the RA V-wave pressure from the peak RV systolic pressure (RVSP) at end-expiration. Cardiac output was calculated using the Fick method and indexed to body surface area. Simultaneous systemic blood pressure was obtained by arterial catheterization in patients in whom arterial access was clinically indicated and by upper extremity noninvasive cuff measurement in those in whom arterial access was not clinically indicated. Interpretation of RHC data was done by a single, experienced interventional cardiologist (J.J.M.) to exclude interobserver variability. The interventional cardiologist was blinded to the patients’ diagnoses and Doppler echocardiographic data.
Echocardiographic Data
Two-dimensional and color DE was performed using commercially available ultrasound equipment (Vivid 9; GE Medical Systems, Milwaukee, WI). With the patient in the supine position, continuous-wave Doppler recordings of the maximal TR jet velocity (V) were obtained in standard apical or parasternal windows (whichever produced the highest velocity signal). The Doppler beam was kept in parallel alignment with the direction of the TR jet as visualized by color Doppler. The majority (80%) of echocardiographic studies were performed by a single cardiac sonographer. The remainder of the studies was performed by two additional cardiac sonographers. No saline or contrast injection was used to enhance weak signals. Patients were excluded from the study if there was no measurable TR by color Doppler at the time of data acquisition. DE-estimated ΔP (ΔP E ) was calculated using the modified Bernoulli equation, ΔP E = 4V 2 . An average of three consecutive cardiac cycles was used to account for respiratory variation. Interpretation of Doppler echocardiographic data was done by a single, experienced echocardiographer (G.K.S.) to exclude interobserver variability. The echocardiographer was blinded to the patients’ diagnoses and RHC data.
Assessment of TR Envelope Quality
To minimize the effect of TR spectral envelope quality on the accuracy of DE, the data were analyzed using only patients with optimal TR envelopes. A TR envelope was deemed “optimal” by the interpreting cardiologist (G.K.S.) when the spectral Doppler envelope edge was clearly identifiable in at least the first three quarters of systole. Optimal envelopes had sharp, rounded edges clearly demonstrating the peak of the TR velocity. The remainder were deemed “suboptimal” and were not included in data analysis. Examples of TR envelope quality are shown in Figure 1 . An independent assessment of TR envelope quality was also done in 20 randomly selected patients by a separate, blinded observer (G.K.G.), and interobserver reliability was assessed using Cohen’s κ method.
Stratification of Patients on the Basis of RV Pressure
Patients were categorized on the basis of the ratio between RHC-measured RVSP and simultaneously measured systemic systolic blood pressure (SBP). In patients with left heart obstruction, a simultaneous catheter-measured left ventricular systolic pressure was used as the SBP. Two clinically relevant thresholds were used to define RV hypertension and subsequently categorize patients: (1) RVSP ≥ 1/2 SBP and (2) RVSP ≥ 2/3 SBP. Group 1 included patients with RVSP < 1/2 SBP, and group 2 included those with RVSP ≥ 1/2 SBP. Group 3 included patients with RVSP < 2/3 SBP, and group 4 included those with RVSP ≥ 2/3 SBP.
Statistical Analysis
Values for descriptive statistics are reported as mean ± SD for normally distributed data and as median (interquartile range) for data not normally distributed. Correlation coefficients between RHC-derived and DE-derived pressures were calculated using Pearson’s correlation method, and the relationship of the methods was assessed using linear regression. Agreement between methods was assessed using Bland-Altman analysis. Accuracy of Doppler echocardiographic measurements was predefined as 95% limits of agreement within ±10 mm Hg. Fisher’s exact test was used to compare categorical data between groups. Receiver operating characteristic analysis was used to assess the associations between high RVSP (the reference standard) and ΔP E . The previously used clinically relevant thresholds were used to define RV hypertension: (1) RVSP ≥ 1/2 SBP and (2) RVSP ≥ 2/3 SBP. Binomial exact confidence intervals were calculated for the area under the curve. Youden’s index was used to determine on the receiver operating characteristic curve the point maximizing the difference between the true-positive ratio and the false-positive ratio. Bootstrapped (1,000 replications) confidence intervals were calculated for this point (criterion value). On the basis of the criterion value, sensitivity, specificity, positive predictive value, negative predictive value, and their 95% confidence intervals were calculated. For the calculation of positive and negative predictive values, the ratio of cases in the positive and negative groups was used to represent disease prevalence. P values < .05 were considered statistically significant. Statistical analyses were performed using SPSS version 19 (SPSS, Inc, Chicago, IL), JMP Statistical Software release 10.0.0 (SAS Institute Inc, Cary, NC), and MedCalc Statistics for Biomedical Research version 12.3.0.0 (MedCalc Software, Mariakerke, Belgium).
Results
Patient Characteristics
A total of 395 patients aged 0 to 17.9 years underwent medically indicated RHC during the study period. Forty patients were excluded because of single-ventricle physiology, two patients were excluded because of mechanical tricuspid valves, and two patients were excluded because of subpulmonary morphologic left ventricles. Of the remaining 351 patients, 153 had measurable TR on precatheterization echocardiography and were deemed eligible for enrollment. Ten patients declined to participate, and 19 patients were unable to be consented in time to participate. A total of 124 patients with a wide variety of cardiopulmonary disease processes were consented for the study. Doppler echocardiographic images could not be acquired in eight patients because of hemodynamic instability at the time of RHC and in 12 patients because of logistic difficulties. A total of 104 patients underwent simultaneous RHC and DE. Four patients had no detectable TR at the time of RHC. Twenty patients were deemed to have suboptimal TR envelopes and were excluded. A total of 80 patients had simultaneous RHC and Doppler echocardiographic data obtained and analyzed. The median age was 5.5 years (1.6–10.4 years). Patients’ demographic data are summarized in Table 1 . RHC-measured RVSPs ranged from 17 to 89 mm Hg and RA V-wave pressures from 4 to 20 mm Hg. The DE-measured maximal TR jet velocity ranged from 1.7 to 5 m/sec. ΔP C ranged from 6 to 81 mm Hg and ΔP E from 11 to 100 mm Hg. Baseline hemodynamic data are summarized in Table 2 .
Variable | All patients | Group 1 | Group 2 | Group 3 | Group 4 |
---|---|---|---|---|---|
( n = 80) | ( n = 43) | ( n = 37) | ( n = 56) | ( n = 24) | |
Age (y) | 5.5 (1.57–10.37) | 6.8 (3.3–13.6) | 4.9 (0.9–9.2) | 6.2 (2.5–12.3) | 3 (0.7–8.1) |
Male (%) | 48 | 51 | 43 | 46 | 50 |
Caucasian, (%) | 75 | 79 | 70 | 75 | 75 |
Weight (kg) | 16.8 (9–32.3) | 21 (14.5–45.8) | 12.7 (7.2–23.6) | 20.2 (12.7–42.8) | 10.8 (6.9–23.2) |
BSA (m 2 ) | 0.7 (0.42–1.12) | 0.85 (0.6–1.46) | 0.53 (0.36–0.93) | 0.81 (0.53–1.3) | 0.47 (0.34–0.92) |
Hemoglobin (g/dL) | 11.2 ± 1.6 | 11.3 ± 1.3 | 11.1 ± 1.9 | 11.3 ± 1.3 | 11.1 ± 2.2 |
Diagnosis | |||||
OHT | 22 | 19 | 3 | 22 | 0 |
ASD | 6 | 5 | 1 | 6 | 0 |
RVOTO/PS | 19 | 3 | 16 | 7 | 12 |
Branch PS | 10 | 2 | 8 | 5 | 5 |
PAH | 5 | 1 | 4 | 1 | 4 |
PVS | 3 | 1 | 2 | 1 | 2 |
LHO | 6 | 4 | 2 | 6 | 0 |
Other ∗ | 9 | 8 | 1 | 8 | 1 |
Reason for RHC | |||||
Diagnostic | 5 | 1 | 4 | 1 | 4 |
RV biopsy | 22 | 19 | 3 | 22 | 0 |
ASD device | 6 | 5 | 1 | 6 | 0 |
Balloon/stent | 47 | 18 | 29 | 27 | 20 |
∗ Complete atrioventricular canal ( n = 2), dilated cardiomyopathy ( n = 2), Kawasaki disease ( n = 2), patent ductus arteriosus ( n = 2), scimitar syndrome ( n = 1).
Variable | All patients | Group 1 | Group 2 | Group 3 | Group 4 |
---|---|---|---|---|---|
SBP (mm Hg) | 80.2 ± 11.9 | 84.5 ± 12.1 | 75.1 ± 9.7 | 83.6 ± 11.7 | 72.1 ± 8.2 |
DBP (mm Hg) | 49.8 ± 10 | 53.4 ± 12.1 | 45.5 ± 8 | 52.4 ± 9.8 | 43.7 ± 7.7 |
MAP (mm Hg) | 61.9 ± 10.4 | 64.5 ± 10.2 | 58.8 ± 8.7 | 64.2 ± 10.7 | 56.3 ± 7.2 |
CI (L/min/m 2 ) | 3.8 ± 1.1 | 4.1 ± 1.2 | 3.4 ± 0.9 | 4 ± 1.2 | 3.3 ± 0.8 |
HR (beats/min) | 105 ± 25 | 102 ± 23 | 109 (90–125) | 103 (83–115) | 111 ± 29 |
RVSP (mm Hg) | 35 (27–55) | 28 ± 5.83 | 57 (46–70) | 30 (25–38) | 66 (54–77) |
RVEDP (mm Hg) | 9.9 ± 3.1 | 8.9 ± 3.3 | 11 ± 2.4 | 9.3 ± 3 | 10.5 (10–12) |
Mean RA pressure (mm Hg) | 8.9 ± 3.2 | 8.3 ± 3.3 | 9 (7–11) | 8.4 ± 3.1 | 9.5 (8–11) |
RA A-wave (mm Hg) | 10.3 ± 3.3 | 9.5 ± 3.6 | 11 (9–12) | 9.5 (7–11) | 11 (10–13) |
RA V-wave (mm Hg) | 10.5 ± 3.4 | 9.9 ± 3.5 | 10 (9–13) | 10 (8–12) | 11 (9–14) |
RVSP/SBP ratio | 0.45 (0.34–0.7) | 0.34 ± 0.08 | 0.7 (0.6–1) | 0.36 (0.3–0.49) | 0.9 (0.7–1) |
ΔP C (mm Hg) | 25 (17–46) | 17 (14–22) | 47 (37–60) | 20 (15–27) | 51.5 (45–67) |
ΔP E (mm Hg) | 27 (20–45) | 20 (17–25) | 46 (36–59) | 23 (18–29) | 53.5 (40–73) |