Background
Accurate localization of mitral valve prolapse (MVP) is crucial for surgical planning. Despite improved visualization of the mitral valve by three-dimensional transesophageal echocardiography, image interpretation remains expertise dependent. Manual construction of mitral valve topographic maps improves diagnostic accuracy but is time-consuming and requires substantial manual input. A novel computer-learning technique called Anatomical Intelligence in ultrasound (AIUS) semiautomatically tracks the annulus and leaflet anatomy for parametric analysis. The aims of this study were to examine whether AIUS could improve accuracy and efficiency in localizing MVP among operators with different levels of experience.
Methods
Two experts and four intermediate-level echocardiographers (nonexperts) retrospectively performed analysis of three-dimensional transesophageal echocardiographic images to generate topographic mitral valve models in 90 patients with degenerative MVP. All echocardiographers performed both AIUS and manual segmentation in sequential weekly sessions. The results were compared with surgical findings.
Results
Manual segmentation by nonexperts had significantly lower sensitivity (60% vs 90%, P < .001), specificity (91% vs 97%, P = .001), and accuracy (83% vs 95%, P < .001) compared with experts. AIUS significantly improved the accuracy of nonexperts (from 83% to 89%, P = .003), particularly for lesions involving the A3 (from 81% to 94%, P = .006) and P1 (from 78% to 88%, P = .001) segments, presumably related to anatomic variants of the annulus that made tracking more challenging. AIUS required significantly less time for image analysis by both experts (1.9 ± 0.7 vs 9.9 ± 3.5 min, P < .0001) and nonexperts (5.0 ± 0.5 vs 13 ± 1.5 min, P < .0001), especially for complex lesions.
Conclusions
Anatomic assessment of mitral valve pathology by three-dimensional transesophageal echocardiography is experience dependent. A semiautomated algorithm using AIUS improves accuracy and efficiency in localizing MVP by less experienced operators.
Preoperative assessment of the mitral valve (MV) is crucial for planning surgical repair strategy for mitral regurgitation. Accurate localization of segmental MV prolapse (MVP) has implications in reparability and thus timing of surgery and choice of surgeons. Three-dimensional (3D) transesophageal echocardiographic (TEE) imaging has been shown to be superior to two-dimensional (2D) TEE imaging in localizing MVP with good surgical agreement. However, visual diagnosis of MVP on the volume-rendered images requires training and experience to distinguish normal anatomy, pathology, and artifact. In particular, interpretation of prolapse involving A1, P1, A3, and P3 is often erroneous by readers with less experience with 3D echocardiography.
The interpretation of MV topographic maps has been shown to improve the diagnostic accuracy of less experienced readers, surpassing 2D and 3D (volume-rendered) TEE images. Nevertheless, the process of construction of an MV topographic map is cumbersome and time-consuming, requiring operators to be familiar with the many variations of normal MV anatomy and pathology. Because the process involves many manual steps to define anatomic landmarks, substantial measurement bias, errors, and variability could be introduced. Therefore, 3D topographic maps of the MV, despite their potential diagnostic utility, have not been routinely adopted for clinical use.
Recently, a novel computer-learning algorithm called Anatomical Intelligence in ultrasound (AIUS) was developed, which can segment the images obtained by using an ultrasound device in a semiautomatic manner on the basis of an individual patient’s anatomy. AIUS has been reported to provide accurate, reproducible, and rapid quantification of MV anatomy by minimizing manual input. Accordingly, the aims of this study were (1) to examine whether AIUS improves diagnostic accuracy and efficiency in localizing MVP compared with a manual approach and (2) to determine whether the operator’s level of training in echocardiography influences the usefulness of AIUS on the accuracy of the 3D TEE localization of MVP.
Methods
Patient Population
This was a retrospective study of patients with severe mitral regurgitation who were referred clinically to our echocardiography laboratory for preoperative TEE evaluation for MV repair. At our institution, detailed preoperative 3D TEE study of valve morphology is performed for preoperative planning in all patients undergoing MV repair within 2 weeks before surgery. From January 2009 to December 2013, a total of 106 patients at our institution underwent preoperative TEE evaluation for MV repair. Of these 106 patients, 16 were excluded from the present study because of associated mitral stenosis, functional mitral regurgitation, aortic valve disease, and/or previous endocarditis. The final analysis included 90 patients (mean age, 60 ± 10 years; 38 women) undergoing MV repair for severe symptomatic mitral regurgitation due to MVP. The feasibility of AIUS was reported in 33 patients with MVP in our previous study. Of these initial 33 patients, 24 patients underwent MV repair and were included in the present analysis. The localization of MV pathology in the patients with mitral regurgitation was confirmed by surgical exploration. The institutional review board approved the study.
Three-Dimensional Image Acquisition
A standardized 3D TEE imaging protocol for MV evaluation has been in place in our echocardiography laboratory since late 2008. An iE33 or EPIQ7 ultrasound system (Philips Healthcare, Andover, MA) equipped with a fully sampled matrix transducer (X7-2t) was used to obtain real-time 3D TEE images of the MV. Midesophageal zoomed 3D TEE images of the MV apparatus were acquired. The region of interest was adjusted to the smallest pyramidal volume that encompassed the MV. Multibeat gated acquisition mode was used in patients in sinus rhythm. If there was stitching artifact in the initial 3D data sets, acquisition was repeated until optimal images without stitching artifact were obtained. All images were stored digitally in raw-data format. The high–volume rate single-beat acquisition protocol was used in patients with atrial fibrillation to avoid stitching artifact as a result of irregular rhythm while maintaining adequate volume rate. The index-beat method proposed by Kusunose et al. was used to select the cardiac cycle for analysis in patients with atrial fibrillation: five to 10 beats of volumetric data sets were captured for atrial fibrillation, and the beat with roughly equal preceding and pre-preceding beat intervals was used for 3D analysis. Volume rates for both techniques was maximized to >15 Hz.
MV Topographic Model Construction and Interpretation
All 3D TEE images were transferred to two independent Xcelera workstations (Philips Healthcare) for construction of the MV topographic models, with a software package using the manual technique (Mitral Valve Quantification) installed on one and an AIUS software package (Mitral Valve Navigation) installed on another. The manual approach for MV reconstruction involved manual definition of the end-systolic frame, manual alignment of the image planes, placement of annular markers on multiple radial planes, and tracing of leaflet contour and coaptation on multiple parallel planes, as previously described. The semiautomatic creation of the MV topographic model by AIUS begins with automatic end-systolic frame identification on the basis of waveform analysis of the electrocardiogram. After image alignment under schematic guidance, four mitral annular reference points, the aorta, and the coaptation nadir were tagged to initiate a semiautomatic annular track and leaflet trace. The line of coaptation was delineated by manual placement of markers on the coaptation points on multiple parallel long-axis planes. A color-coded topographic map of the MV was then generated. The colors were coded to display leaflet displacement into the left atrium from the annular plane at end-systole, with red indicating leaflet position above the annular plane and blue indicating leaflet position below the annular plane. The parametric map also displays the amplitude and location of the maximal leaflet displacement into the left atrium. The more displacement a lesion has, the brighter the red color is on the parametric map. Prolapse is defined as leaflet displacement > 1 mm above the annular plane, as previously validated against surgical inspection. Similarly, in multisegment prolapse, AIUS detects the entire leaflet surface and color-codes all lesions with >1 mm systolic displacement above the 3D annular plane as red. When there is a coaptation gap due to flail leaflet, the coaptation markers can be manually edited to separately locate the two tips of anterior and posterior leaflets ( Figure 1 ).
Two experienced American Society of Echocardiography level 3 (or equivalent) echocardiographers (experts) with extensive 3D experience (having performed Mitral Valve Quantification in >500 cases) and four intermediate-level operators (nonexperts) with level 2 or equivalent training with minimal (<10 cases) previous 3D MV analysis experience were asked to perform offline MV topographic model construction using both the manual and AIUS techniques. The nonexperts underwent brief training on the operation of both Mitral Valve Quantification and Mitral Valve Navigation in 10 separate cases. All investigators were blinded to the measurements performed by others and to the clinical data. Manual and AIUS analyses were separately performed ≥1 week apart. The total time spent on each method for each case was recorded for both approaches. In 30 randomly selected data sets, two nonexperts performed AIUS and manual analysis to assess interobserver variability. One of the operators repeated the analyses 1 week later to assess intraobserver variability. Two experts repeated the same process to determine reproducibility among experts.
Surgical Inspection
The surgeons intraoperatively examined the MV anatomy and the relative position of each leaflet segment to the annular plane and to adjacent normal segments ( Figure 2 ). Location of pathology was described using the Carpentier classification. The surgeons had access to the clinical echocardiography reports (which only include interpretation of the 2D and volume-rendered 3D data sets) but were unaware of the interpretations of the topographic maps made for this study. Surgical findings were used as the standard of reference for assessing the accuracy of AIUS in localizing MVP.
Statistical Analysis
Data are expressed as mean ± SD or as number (percentage) as appropriate. The sensitivity and specificity of AIUS and manual methods for localization of the involved scallops were calculated with surgical findings as a reference. Accuracy between the methods and surgery was defined as the sum of true-positive and true-negative results divided by the number of scallops. Differences in diagnostic accuracy among the methods and readers were assessed using the McNemar statistic. Reproducibility among experts and intermediate-level operators was assessed using the κ statistic. Average time used for manual and AIUS MV reconstruction was compared using Student’s t test. Analyses were performed with SPSS version 20.0 (IBM, Armonk, NY) and JMP version 9.0 (SAS Institute, Cary, NC). A two-tailed P value < .05 was considered to indicate statistical significance.
Results
Construction of the MV topographic model by AIUS was feasible in all patients. A total of 540 MV segments were analyzed, of which 148 segments had surgically defined prolapse; the remaining 392 segments were surgically defined as normal. Nonexpert readers did not perform any editing of the AIUS topographic models, while expert echocardiographers performed annular editing in nine (10%) cases. Table 1 shows the anatomic characteristics of MVP in the study population on the basis of surgical findings. Half of the patients ( n = 45) had multisegment prolapse involving more than one scallop.
Characteristics | n |
---|---|
Isolated A1 | 1 |
Isolated A2 | 3 |
Isolated A3 | 5 |
Isolated P1 | 6 |
Isolated P2 | 15 |
Isolated P3 | 15 |
Anterior leaflet (>1 scallop) | 8 |
Posterior leaflet (>1 scallop) | 27 |
Anterior and posterior leaflets | 10 |
Associated lesions | |
Chordal rupture | 66 |
Cleft | 23 |
Accuracy and Efficiency of the AIUS and Manual Techniques
The sensitivity, specificity, and accuracy of the manual and AIUS techniques for the overall and segmental lesions are reported in Tables 2 and 3 . Overall, the nonexperts had significantly lower sensitivity, specificity, and accuracy (all P < .01) when using the manual technique. Of note, the sensitivity of the manual approach by nonexperts was only 60%. The use of AIUS significantly improved the diagnostic performance of nonexperts (sensitivity and accuracy P < .01 vs manual), particularly for pathology involving the A2 (sensitivity P < .05 vs manual), A3 (sensitivity P < .05, accuracy P < .01 vs manual), and P1 (sensitivity P < .05, accuracy P < .01 vs manual) segments ( Table 3 ). In cases in which nonexpert readers incorrectly diagnosed the location of the prolapse, errors were made during manual tracking of the annulus, in particular at the A3 and P1 segments. Manual localization of the annulus at A3, and occasionally also A2, is challenging because the annulus often does not appear as a discrete point but a band of tissue that blends into the central fibrous body in that region. On the other hand, inaccurate manual localization of the annulus at P1 (and sometimes also P2) is caused by superior displacement of the posterior annulus in some patients, a condition known as annular disjunction, not uncommonly seen in diffuse myxomatous disease. In annular disjunction, the atrial wall–MV posterior leaflet junction is pathologically separated from the left ventricular attachment such that the base of the posterior leaflet is superiorly displaced (atrialization). AIUS is able to track the annulus at these sites more precisely and consistently than the manual method by nonexperts ( Figure 3 ).
Sensitivity (%) | Specificity (%) | Accuracy (%) | ||||
---|---|---|---|---|---|---|
Nonexpert | Expert | Nonexpert | Expert | Nonexpert | Expert | |
Overall | ||||||
Manual | 60 | 90 † | 91 | 97 † | 83 | 95 † |
AIUS | 76 § | 89 † | 94 | 97 | 89 § | 95 † |
Anterior leaflet | ||||||
Manual | 71 | 100 ∗ | 89 | 97 | 86 | 98 † |
AIUS | 88 | 100 | 90 | 97 | 90 | 98 ∗ |
Posterior leaflet | ||||||
Manual | 83 | 100 † | 67 | 93 ∗ | 78 | 98 † |
AIUS | 90 | 98 | 89 | 96 | 90 ‡ | 98 |
Sensitivity (%) | Specificity (%) | Accuracy (%) | ||||
---|---|---|---|---|---|---|
Nonexpert | Expert | Nonexpert | Expert | Nonexpert | Expert | |
A1 | ||||||
Manual | 60 | 80 | 94 | 99 | 92 | 98 |
AIUS | 100 | 100 | 94 | 96 | 94 | 97 |
A2 | ||||||
Manual | 50 | 93 ∗ | 95 | 93 | 88 | 93 |
AIUS | 86 ‡ | 86 | 95 | 99 | 93 | 97 |
A3 | ||||||
Manual | 47 | 90 † | 71 | 100 ∗ | 81 | 98 † |
AIUS | 79 ‡ | 90 | 99 ‡ | 97 | 94 § | 96 |
P1 | ||||||
Manual | 20 | 87 † | 89 | 96 | 78 | 94 † |
AIUS | 60 ‡ | 73 | 92 | 95 | 88 § | 91 |
P2 | ||||||
Manual | 79 | 96 ∗ | 95 | 95 | 87 | 96 ∗ |
AIUS | 83 | 96 ∗ | 91 | 98 | 87 | 97 ∗ |
P3 | ||||||
Manual | 60 | 85 † | 81 | 98 ∗ | 70 | 91 † |
AIUS | 69 | 85 | 88 | 98 | 78 | 91 ∗ |