Clinical Indications and Quality Assurance

5


Clinical Indications and Quality Assurance





Approach to the Diagnostic Use of Echocardiography



Reliability of a Diagnostic Test


The reliability of a diagnostic test includes two components: accuracy and precision. Accuracy is the ability of the test to make a correct numerical measurement—for example, left ventricular (LV) volume—or to correctly diagnose the presence or absence of a condition (for example, coronary artery disease). Precision reflects the agreement of repeated evaluations, including the acquisition, measurement, and interpretation of data. The combination of accuracy and precision determines the value of echocardiography in different clinical situations.



Accuracy


The accuracy of a numerical measurement, such as wall thickness, aortic jet velocity, or aortic diameter, is expressed as the agreement between the echocardiographic measurement and a reference standard. These measurements reflect continuous variables; there is a continuous range of values from the smallest to largest seen in clinical practice. For example, aortic jet velocity ranges from <1 m/s to as high as 6 m/s. The numerical reference standard may be an anatomic measurement at surgery or autopsy, direct measurements in an experimental model, or comparison of echocardiography to other imaging techniques or hemodynamic recordings. Published data on the accuracy of echocardiography are shown in tables in each chapter of this book and typically are expressed by a correlation coefficient and regression equation with standard errors. Alternatively, an approach called Bland-Altman analysis, which compares the deviation of each measurement (echocardiography and the reference standard) from the mean of both measurements, can be used.


For echocardiographic diagnoses that are either present or absent (called categorical variables), accuracy reflects the certainty with which a specific diagnosis can be confirmed or excluded based on the test results (Fig. 5-1). An example is echocardiography for the diagnosis of endocarditis: the patient either has or does not have endocarditis; there is no range of values. Accuracy for this type of test is described in terms of sensitivity and specificity. The sensitivity of a test is the degree to which it identifies all patients with the disease; specificity is the degree to which a test identifies all patients without the disease.




Accuracy indicates the percentage of patients in whom the test results are correct in identifying the presence or absence of disease.



Using a diagnostic test to determine whether a disease is present or absent depends on the “cutoff” value or breakpoint used to define the test as abnormal. Sensitivity and specificity are related inversely to each other; in general, the higher the sensitivity, the lower is the specificity and vice versa. Whether a higher sensitivity is preferable to a higher specificity depends on the clinical question. If the goal of the test is identification of all patients with the disease, a high sensitivity is preferable. If the goal is confirmation of the diagnosis in an individual patient, a high specificity is preferable.


The relationship between sensitivity and specificity can be evaluated quantitatively for any given diagnostic test by graphing the sensitivity (y-axis) versus 1 − specificity (x-axis), with each point on the curve representing a different breakpoint defining the test as abnormal. The area under the curve reflects the clinical value of the test, with a larger area indicating a more reliable diagnostic test. The point on the receiver-operator curve, where sensitivity and specificity are maximized, indicates an appropriate breakpoint (Fig. 5-2).




Precision


The reproducibility of echocardiographic imaging and Doppler data is affected by variability in:



In addition, variability can occur both when the same person repeats the data acquisition or measurement at a different time (intraobserver variability) and when data acquisition or measurement is performed by different people (interobserver variability). These sources of imprecision are a major limitation of echocardiography in clinical practice. There are several approaches to improving the precision, and thus reliability, of echocardiographic data. Appropriate training and experience help ensure correct acquisition of data, including correctly aligned image planes and Doppler recordings, optimization of instrument parameters, and standardized study protocols. Measurement precision is improved with adherence to published standards, quality control in each laboratory, and comparison with reference standards when possible. Interpretation variability is minimized by using standard terminology and diagnostic criteria, developing a consensus approach to reporting in each laboratory, and comparing images and Doppler data to previous recordings in that patient whenever possible; that is, the report should specify whether there is a change from previous studies based on direct comparison of the recorded data, with side-by-side measurements as needed. Measurement variability is reported in each chapter when this information is available.



Expertise


The quality of an echocardiographic examination is highly dependent on the expertise of the sonographer performing the study, the physician interpreting the data, and the expertise of the laboratory. Optimal acquisition of image and Doppler data require experience, in addition to education and training. Physician interpretation is affected both by the data acquired (e.g., if images of a ventricular thrombus are not recorded, the physician will not see it) and by the education, training, and experience of the physician. Laboratory expertise affects data quality in terms of study protocols, time allocation and efficiency, instrumentation, and the group expertise of the sonographers and physicians. Thus, echocardiographic studies performed in different laboratories are not always comparable, and published studies on the accuracy of echocardiographic diagnosis may not apply to all diagnostic examinations.



Integration of Clinical Data and Test Results



Predictive Value


A major limitation of applying sensitivity-specificity data to an individual patient is the problem of whether a particular patient has a “true” or a “false” test result. Predictive values indicate the percentage of patients with a positive test result who have the suspected disease and the percentage with a negative test result who do not have the suspected disease:



However, predictive values are determined by the prevalence of disease in the population studied and also by the sensitivity and specificity of the test. Intuitively, this is obvious comparing the use of echocardiography to “screen” healthy young subjects for endocarditis (many false-positive results because of ultrasound imaging artifacts) versus the same test in patients who have a new murmur, fever, and positive blood cultures, with a high prevalence of disease. The finding of a valvular vegetation on echocardiography in the latter group has a much higher predictive value for a diagnosis of endocarditis than in the healthy subjects, even though the sensitivity and specificity of echocardiography for diagnosing endocarditis are the same in both groups. Thus, the positive or negative predictive value of a test reflects disease prevalence as well as test accuracy.



Likelihood Ratio


The likelihood ratio indicates the relative likelihood of disease in an individual patient, based on a positive or negative test result. The likelihood ratio for a positive test result is calculated as:


image


or


image


A positive likelihood ratio >10 indicates an excellent test, and 5-10 indicates a good test.


The likelihood ratio for a negative test result is calculated as:


image


or


image


A negative likelihood ratio <0.1 indicates an excellent test, and a ratio of 0.1-0.2 indicates a reasonably good test.


For example, diagnosis of left ventricular (LV) thrombus by echocardiography, assuming a sensitivity of 95% and a specificity of 88%, has a positive likelihood of 7.9 (a good diagnostic test) and a negative likelihood ratio of 0.06 (an excellent diagnostic test). The positive likelihood is not excellent because ultrasound artifacts may be mistaken for a ventricular thrombus. The excellent negative likelihood depends on a high-quality echocardiographic study and the expertise of the sonographer to ensure that an apical thrombus is not missed by echocardiographic imaging.



Pre- and Post-Test Probability


Another approach to the use of sensitivity- specificity data in patient management is to consider relevant clinical data along with the test result (Fig. 5-3). The value of a diagnostic test increases when the pre-test likelihood of disease is integrated with the test results to derive a post-test likelihood of disease. This approach is known as Bayesian analysis. For example, the pre-test likelihood of severe aortic stenosis in an asymptomatic 30-year-old woman without a systolic murmur is very low. An echocardiogram purporting to show severe aortic stenosis most likely is an erroneous interpretation (a false-positive test result). In this setting, the result does not increase the post-test likelihood of disease very much. In contrast, in an elderly man with a 4/6 aortic stenosis murmur and symptoms of angina, syncope, and heart failure, the diagnosis of severe valvular aortic stenosis can be made with a high level of certainty even before any test is performed. The echocardiogram serves only to confirm the diagnosis and define the severity of obstruction. In general, diagnostic tests are most helpful when the pre-test likelihood of disease is intermediate so that the test result will substantially change the post-test likelihood of disease.



The most comprehensive approach to the evaluation of a diagnostic test is clinical decision analysis. Clinical decision analysis incorporates several rigorous approaches to the problem of clinical prediction, with the method most applicable to a diagnostic test (such as echocardiography) being the threshold approach. The basic tenet of clinical decision analysis as applied to a diagnostic test is that the test results should have an impact on patient care by either:



This basic assumption is formalized in the threshold model of decision analysis. In this approach, two disease probability thresholds are defined for the diagnostic test:



The intermediate range—in which the risk of treating or not treating the patient is greater than the risk of the diagnostic test—is known as the testing zone (Fig. 5-4). For any specific indication, the testing zone for echocardiography generally is wide because of the low risk and high accuracy of this technique. However, both an upper and lower threshold still are definable for echocardiography. The upper threshold is reached in situations in which the diagnosis is clear, and echocardiographic examination would only delay appropriate treatment. For example, a patient with a classic presentation of an ascending aortic dissection (chest pain, wide mediastinum, peripheral pulse loss) requires prompt surgery. Any delay caused by unnecessary diagnostic testing could result in additional morbidity or mortality.



It is tempting to assume that there is no lower end to the test zone for echocardiography given the absence of known adverse biologic effects of this procedure. However, the risk of the test also includes the risks of additional diagnostic tests or even erroneous treatment choices resulting from a false-positive or false-negative echocardiographic finding. For example, an echocardiogram is not indicated to evaluate for aortic dissection in a young patient with atypical chest pain and a normal physical examination, electrocardiogram, and chest radiograph. If a false-positive echocardiographic diagnosis leads to further evaluation with cardiac catheterization, any complications from the invasive procedure ultimately can be considered a consequence of the echocardiographic results. Thus, a lower limit to the test zone does exist for echocardiography and can be defined for each specific diagnostic indication by applying decision analysis techniques. Other clinical decision analysis approaches have been applied to specific clinical problems that use echocardiographic data as a branch point in the decision analysis tree.




Clinical Outcomes


The most important measure of the value of a diagnostic test is its impact on subsequent clinical outcome (Fig. 5-5). While the first step in evaluation of the clinical utility of a test includes various measures of diagnostic accuracy in comparison to some accepted standard, the more important assessment is whether the diagnostic test changes the subsequent diagnostic or therapeutic plan in each patient. The definitive value of echocardiography depends on its ability to predict prognosis, for example, survival in patients with dilated cardiomyopathy, timing of valve surgery in patients with chronic regurgitation, or the rate of hemodynamic progression in patients with valvular stenosis. Echocardiographic data are increasingly used in clinical outcome studies, as referenced in the suggested readings throughout this textbook.




Indications and Appropriateness Criteria


The indications for echocardiography are based on the reliability of this approach for diagnosis in a wide range of cardiovascular diseases and are summarized in consensus guidelines developed by the American Heart Association and the American College of Cardiology. In addition, specific recommendations on the use of echocardiography often are included in disease-specific guidelines, for example, guidelines for the management of valvular heart disease and for heart failure.


Appropriateness criteria go beyond indications to consider the clinical setting in which a diagnostic test is appropriate. For example, exercise echocardiography is sensitive and specific for the diagnosis of coronary artery disease, but it should not be used as a routine screening test in all patients. Appropriateness criteria have been developed by the American College of Cardiology in collaboration with other organizations that provide helpful guidance. However, these guidelines do not include all possible clinical situations.


Ideally, the echocardiogram request should indicate an appropriate clinical question (not “evaluate heart”) and, when possible, an estimate of the probability of the diagnosis in that patient. Next, the reliability of echocardiography for that diagnosis and the likelihood that the echocardiographic results will alter patient management are considered before performing the study. Often it is helpful to consider the specific branch point in the diagnostic and therapeutic plans that the echocardiographic results will be applied to in the clinical decision process.


With these considerations in mind, there are certain situations in which the use of echocardiography clearly changes patient management. These situations include:



There are numerous other settings in which echocardiography is considered to be clinically appropriate.


Throughout this text, the accuracy (sensitivity and specificity) of echocardiography for each specific diagnosis will be indicated, if known. The clinician then should integrate these data with the pre-test likelihood of disease in each patient. Critical evaluations of the diagnostic utility of echocardiography in specific patient populations and clinical settings will be highlighted, including evaluation of chest pain in the emergency room (Chapter 8), decision making in adults with aortic stenosis (Chapter 11) and aortic regurgitation (Chapter 12), the diagnosis and prognosis of endocarditis (Chapter 14), and intraoperative assessment of mitral valve repair (Chapter 18).



Definitions and Classification of Echocardiographic Studies


Diagnostic echocardiography is defined as an echocardiographic examination performed under the supervision of a cardiologist with expertise in echocardiography (Level 2 or 3 Training) for the purposes of diagnosis, measurement of disease severity, evaluation of disease progression, or assessment of response to therapy. A diagnostic echocardiogram includes a formal interpretation in the medical record that meets American Society of Echocardiography quality standards and archiving of a complete set of diagnostic images. Diagnostic echocardiography typically is performed in the context of a medical center-based echocardiography service or outpatient cardiology practice with established technical standards, imaging protocols, and quality control measures.


Echocardiographic imaging also is used to monitor cardiac interventions for the evaluation of procedural results and the detection of complications (Table 5-1). For example, transesophageal echocardiography (TEE) to monitor interventions in the operating room and interventional suite usually are performed and simultaneously interpreted by cardiac anesthesiologists or cardiologists participating in the procedure (see Chapter 18). Intracardiac echocardiographic (ICE) monitoring typically is done by the interventional cardiologist or electrophysiologist who is performing the primary procedure (see Chapter 4). The results of monitoring studies are included in the procedure report, and selected images may be archived.


Jun 12, 2016 | Posted by in CARDIOLOGY | Comments Off on Clinical Indications and Quality Assurance

Full access? Get Clinical Tree

Get Clinical Tree app for offline access