Chapter 7
The importance of quality tests
Assessment of test quality is an essential step in the interpretation strategy. A suboptimal quality result reported as a good quality result may result in misclassification and incorrect management of a patient. Some might say a lung function test that has been done poorly is worse than not having the test done at all.
Test quality may be impacted by patient-related factors and/or equipment-related/technical factors (Table 7.1).
Table 7.1 Examples of factors that affect test quality.
Patient related | Equipment/technical related |
Patient cooperation | Lack of calibration |
Patient coordination | Incorrect ambient conditions entered |
Patient cognition | Poor linearity of analysers/flow sensors |
Patient effort | Inaccurate/imprecise devices |
Language barriers | Drift |
Pain | Leak |
Inability to meet test acceptability criteria | Operator-related issues |
Inability to meet test repeatability criteria |
|
Assessment of test quality depends on the following:
- Ability and skills of test operator
- Accurate technical comments regarding test quality from test operator
- Reporter’s knowledge of the principles of test measurement
- Reporter’s knowledge of the impact of suboptimal quality test on interpretation of results
The test operator’s role in test quality includes the following:
- Ensuring the equipment is calibrated and performing within its specifications
- Having a sound knowledge of the test methodologies and the within-test acceptability and repeatability criteria
- Providing instruction to the subject to elicit maximal effort, inspecting the raw data for acceptability and repeatability criteria and providing feedback to the subject to maximise test quality
- Knowledge of between-test quality indicators
- Documenting the test quality and specific factors that may affect test quality, often referred to as a technical comment. To promote consistency between test operators, some laboratories use quality rating scales (Table 7.2) (1, 2).
Table 7.2 An example of a spirometry quality rating scale (1,2).
Rating | Description | Interpretation |
Good | 3 acceptable efforts AND, of these acceptable efforts: | Good representation of the patient’s true lung function |
| ||
Fairly good | 2 acceptable efforts AND, of these acceptable efforts: | Fairly good representation of the patient’s true lung function |
| ||
Fair | ≥2 acceptable efforts AND, of these acceptable efforts: | Fair representation of the patient’s true lung function—interpret using some caution |
| ||
Fairly poor | Only one acceptable test | Use caution in interpretation of the results—not satisfied that results are representative of the patient’s true lung function |
Poor | No acceptable tests | Interpretation of the results is probably not possible, but may be able to say, for example, ‘VC is at least …’ |
The reporter’s role in assessment of test quality includes the following:
- Inspection of raw data and/or inspection of technical comments
- Understanding the principles of measurement
- Understanding the within-test quality factors (see test-specific chapters for details)
- Knowledge of between-test quality indicatorsSome simple between-test indicators of good quality (spirometry, TLCO, static lung volumes) include the following:
- The inspiratory vital capacity (IVC) (from TLCO) should be within 85% of the maximum vital capacity (VC) measured. If IVC < 85% of maximum VC, this may impact on VA and TLCO (see Case 5).
- The slow vital capacity (SVC) measured as part of static lung volumes (total lung capacity (TLC)-residual volume (RV)) should be greater than FVC-150 mL. This is a check of repeatability—that the SVC and the FVC are similar. In individuals with significant airflow limitation, SVC ≫ FVC, but it is unusual for FVC ≫ SVC, and when seen, this often reflects suboptimal test performance or technical issues (see Case 4).
- The TLC-RV should be greater than VI (from TLCO)-150 mL. As for the point earlier, this is a check of repeatability.
- The TLC should be greater than VA (from TLCO), especially in patients with airflow obstruction. Because of differences between devices and test methodologies, VA may occasionally be just larger than TLC. However, if VA is markedly higher than TLC, test performance or technical issues should be considered.
- The inspiratory vital capacity (IVC) (from TLCO) should be within 85% of the maximum vital capacity (VC) measured. If IVC < 85% of maximum VC, this may impact on VA and TLCO (see Case 5).
- Identifying the impact of suboptimal quality tests on interpretation of results in the report.
To report or not to report suboptimal quality tests?
Although tests of good quality are said to provide a good representation of a patient’s true lung function, tests of suboptimal quality may not.
Sometimes, no test results are better than providing suboptimal test results that may lead to misclassification. However, some aspects of a suboptimal quality result may provide useful information that is worth reporting.
For example: A patient with cognitive impairment has difficulties producing maximal expiratory efforts during a spirometry test. The patient is unable to blow fast, but seems to be blowing from TLC to RV. As the patient is not blowing maximally, the FEV1 reported is unlikely to be a true FEV1 (as the manoeuvre is not forced), so it should not be reported. However, the total volume exhaled indicates that the VC is at least a certain amount.
If considering using tests of suboptimal quality, then consider the following:
- The risk of misclassification
- The impact of the quality on the interpretation
Use cautionary statements in the report to make it clear to the reader that there is an issue that may impact the interpretation. If you are able to determine the size and direction of the impact, then this should also be noted.
Examples of assessment of test quality
Steps in assessing test quality:
- Read technical comment
- Perform the simple between-test assessments of quality described earlier
- Inspect raw data if able or where necessary
- Evaluate impact of suboptimal quality on interpretation of results
- Include a statement regarding test quality in the report based on the evidence
- Where suboptimal quality is present—the statement should be cautionary and describe the impact of the issue on the interpretation of results.