archived

Modeling Study

Colorectal Cancer: Screening

June 15, 2016

Recommendations made by the USPSTF are independent of the U.S. government. They should not be construed as an official position of the Agency for Healthcare Research and Quality or the U.S. Department of Health and Human Services.

Estimation of Benefits, Burden, and Harms of Colorectal Cancer Screening Strategies: Modeling Study for the US Preventive Services Task Force

By Amy B. Knudsen, PhD; Ann G. Zauber, PhD; Carolyn M. Rutter, PhD; Steffie K. Naber, MSc; V. Paul Doria-Rose, DVM, PhD; Chester Pabiniak, MS; Colden Johanson, BA; Sara E. Fischer, MPH; Iris Lansdorp-Vogelaar, PhD; and Karen M. Kuntz, ScD

The information in this article is intended to help clinicians, employers, policymakers, and others make informed decisions about the provision of health care services. This article is intended as a reference and not as a substitute for clinical judgment.

This article may be used, in whole or in part, as the basis for the development of clinical practice guidelines and other quality enhancement tools, or as a basis for reimbursement and coverage policies. AHRQ or U.S. Department of Health and Human Services endorsement of such derivative products may not be stated or implied.

This article was first published in the Journal of the American Medical Association on June 15, 2016.

Return to Table of Contents

Importance: The US Preventive Services Task Force (USPSTF) is updating its 2008 colorectal cancer (CRC) screening recommendations.

Objective: To inform the USPSTF by modeling the benefits, burden, and harms of CRC screening strategies; estimating the optimal ages to begin and end screening; and identifying a set of model-recommendable strategies that provide similar life-years gained (LYG) and a comparable balance between LYG and screening burden.

Design, Setting and Participants: Comparative modeling with 3 microsimulation models of a hypothetical cohort of previously unscreened US 40-year-olds with no prior CRC diagnosis.

Exposures: Screening with sensitive guaiac-based fecal occult blood testing, fecal immunochemical testing (FIT), multitarget stool DNA testing, flexible sigmoidoscopy with or without stool testing, computed tomographic colonography (CTC), or colonoscopy starting at age 45, 50, or 55 years and ending at age 75, 80, or 85 years. Screening intervals varied by modality. Full adherence for all strategies was assumed.

Main Outcomes and Measures: Life-years gained compared with no screening (benefit), lifetime number of colonoscopies required (burden), lifetime number of colonoscopy complications (harms), and ratios of incremental burden and benefit (efficiency ratios) per 1000 40-year-olds.

Results: The screening strategies provided LYG in the range of 152 to 313 per 1000 40-year-olds. Lifetime colonoscopy burden per 1000 persons ranged from fewer than 900 (FIT every 3 years from ages 55–75 years) to more than 7500 (colonoscopy screening every 5 years from ages 45–85 years). Harm from screening was at most 23 complications per 1000 persons screened. Strategies with screening beginning at age 50 years generally provided more LYG as well as more additional LYG per additional colonoscopy than strategies with screening beginning at age 55 years. There were limited empirical data to support a start age of 45 years. For persons adequately screened up to age 75 years, additional screening yielded small increases in LYG relative to the increase in colonoscopy burden. With screening from ages 50 to 75 years, 4 strategies yielded a comparable balance of screening burden and similar LYG (median LYG per 1000 across the models): colonoscopy every 10 years (270 LYG); sigmoidoscopy every 10 years with annual FIT (256 LYG); CTC every 5 years (248 LYG); and annual FIT (244 LYG).

Conclusions and Relevance: In this microsimulation modeling study of a previously unscreened population undergoing CRC screening that assumed 100% adherence, the strategies of colonoscopy every 10 years, annual FIT, sigmoidoscopy every 10 years with annual FIT, and CTC every 5 years performed from ages 50 through 75 years provided similar LYG and a comparable balance of benefit and screening burden.

Return to Table of Contents

Randomized clinical trials (RCTs) have demonstrated that colorectal cancer (CRC) screening reduces CRC mortality.1-8 However, although there are multiple screening modalities, trial data are available only for screening with low-sensitivity guaiac-based fecal occult blood tests (gFOBT)1-4 and with flexible sigmoidoscopy (SIG)5-8 and only for select ages and intervals of screening. No trials have reported long-term findings of direct comparisons of the various screening methods. Recognizing that simulation models provide a way to extrapolate available evidence and predict long-term outcomes, the US Preventive Services Task Force (USPSTF) requested simulation modeling to assess the benefits, burden, and harms of various screening strategies for the general population for its update to the 2008 CRC screening recommendations.

Return to Table of Contents

Three independently created microsimulation models of CRC developed within the National Cancer Institute–funded Cancer Intervention and Surveillance Modeling Network (CISNET) were used to evaluate 204 screening strategies for the US general population without a prior CRC diagnosis. The goals were to model different ages to begin and end screening and screening intervals and to identify a set of recommendable strategies that are estimated to provide similar clinical benefit and a comparable balance of benefit and screening burden.

Model Descriptions

Three models were used for this analysis: Simulation Model of CRC (SimCRC), Microsimulation Screening Analysis (MISCAN) for CRC, and CRC Simulated Population Model for Incidence and Natural History (CRC-SPIN). The 2008 analysis for the USPSTF9 used SimCRC and MISCAN, although MISCAN has since been revised10 based on findings from a joint model validation study.11 Each model consists of a natural history component and a screening component, which were used to simulate individual life histories from birth to death under alternative CRC screening strategies. These components are described briefly below and in more detail in a full report to the USPSTF12 (http://www.uspreventiveservicestaskforce.org/Page/Document/UpdateSummaryFinal/colorectal-cancer-screening2) and in the CISNET model registry.13

Each model simulates the natural history of CRC based on the adenoma-carcinoma sequence (Figure 1). Simulated persons enter the models free of disease, and over time they may develop 1 or more adenomas. Adenomas may grow, and some may transition to preclinical CRC. A preclinical CRC may become symptomatic, leading to clinical detection. Simulated persons may die of other causes at any age, and those with clinically detected CRC may die from the disease. Post-diagnosis survivorship depends on age and stage at diagnosis and tumor location. Each model's natural history component was calibrated to data on adenoma prevalence14-23 and CRC incidence24 from a period before the dissemination of CRC screening. The models use all-cause mortality rates from the 2009 US life table25 and stage-specific CRC relative survival estimates from analysis of data from the Surveillance, Epidemiology, and End Results (SEER) Program.26 Further details on the natural history structures of the models are provided in eTable 1 in the Supplement.

Each model also has a screening component that allows a simulated lifetime to be altered because of detection of a preclinical CRC or detection and removal of an adenoma. The effect of screening depends on the test performed; its sensitivity and specificity; how frequently it is repeated; and, for endoscopic tests, the reach of the scope (Table 1).9, 27-39 The models incorporate the risk of complications from colonoscopy with polypectomy,30, 31 including the potential for death from perforation.32 Further assumptions on risk of colonoscopy complications (eFigure 1 in the Supplement) and test characteristics (Table 1) can be found in the full report.12 The models have been validated11 against the findings from the UK Flexible Sigmoidoscopy Screening (UKFSS) Trial of once-only SIG.5 All 3 models predicted CRC mortality reductions 10 years after SIG screening that were within the trial's 95% confidence interval. Two models (SimCRC and CRC-SPIN) also predicted CRC incidence reductions that were within the trial's 95% confidence interval. The MISCAN model underestimated the incidence reduction. The natural history component of the MISCAN model has since been recalibrated10 and now yields predictions that are consistent with both the mortality and incidence reductions of the UKFSS Trial.11 In this analysis, the validated and recalibrated models were used.

Screening Strategies

Eight screening modalities were evaluated: high-sensitivity gFOBT (HSgFOBT), fecal immunochemical testing (FIT) with a cutoff for positivity of 100 ng or more of hemoglobin (Hb) per mL of buffer (≥20 μg Hb/g of feces), multitarget stool DNA testing (FIT-DNA), SIG alone or with interval HSgFOBT or FIT, computed tomographic colonography (CTC), and colonoscopy. For each modality, multiple ages to begin screening (45, 50, or 55 years) and end screening (75, 80, or 85 years) and multiple screening intervals were evaluated (Table 2). It was assumed that no screening occurs after the stopping age, but that colonoscopy surveillance of persons with a history of adenomas continues through at least age 85 years. In addition, it was assumed that screening, follow-up, and surveillance procedures are performed regardless of the simulated person's life expectancy; that is, they do not cease among persons with limited life expectancy. In all, 204 unique strategies were evaluated, including a strategy with no screening. It was assumed that there is 100% adherence to all procedures. As a result, predicted outcomes from the models reflect the potential lifetime benefits, burden, and harms of screening among a 40-year-old US population with full willingness to participate.

Screening Outcomes

Benefit of screening was measured by the number of life-years gained (LYG) from the prevention or delay of CRC death. The life-years lost as a result of death from screening complications were also accounted for. As in the 2008 analysis for the USPSTF,9 the number of required colonoscopies was used as a measure of the burden of screening and includes colonoscopies for screening, follow-up, surveillance, and the diagnosis of symptomatic cancers. The number of screening tests as a measure of the burden of screening has been used for modeling analyses for the USPSTF for mammography for breast cancer screening,40, 41 computed tomography for lung cancer screening,42 and colposcopies for cervical cancer screening.43, 44 Harms from screening were measured by the number of complications from colonoscopy, including serious gastrointestinal events (perforations, gastrointestinal bleeding, or transfusions), other gastrointestinal events (paralytic ileus, nausea and vomiting, dehydration, or abdominal pain), and cardiovascular events (myocardial infarction or angina, arrhythmias, congestive heart failure, cardiac or respiratory arrest, syncope, hypotension, or shock) (eFigure 1 in the Supplement).30, 31 For each outcome, the range of findings across the 3 models is reported.

Analysis

Efficient and Near-Efficient Screening Strategies

As in the 2008 analysis for the USPSTF,9 it was decided a priori that it was important to consider not only the LYG from screening but also the burden of testing required to achieve those gains. Because the measure of burden—the number of required colonoscopies—does not capture the burden of other testing, direct comparisons of the benefit and burden across screening strategies were limited to those with similar noncolonoscopy burden. This was accomplished by grouping comparable tests, which resulted in 5 classes of screening modalities: stool-based modalities (ie, HSgFOBT, FIT, and FIT-DNA), SIG with stool-based modalities (ie, SIG + HSgFOBT and SIG + FIT), SIG alone, CTC, and colonoscopy.

Within each class of screening modality, the LYG and the colonoscopy burden were plotted for each screening strategy, creating an efficient frontier, the line connecting the strategies that provide the largest incremental increase in LYG per additional colonoscopy performed (eFigure 2 in the Supplement). All of the screening strategies that composed the frontier were considered efficient screening options.45, 46 As in the 2008 analysis,9 it was decided a priori that weakly dominated strategies that fell below the frontier but had LYG within 98% of the efficient frontier would be defined as near-efficient (eFigure 2 in the Supplement). All other strategies that fell below the efficient frontier were considered inefficient. For efficient and near-efficient strategies, the incremental number of colonoscopies (ΔCOL), the incremental number of LYG (ΔLYG), and the efficiency ratio (ie, ΔCOL/ΔLYG) relative to the next less effective efficient strategy were calculated.

Model-Recommendable Screening Strategies

It was assumed that model-recommendable screening strategies would be efficient or near-efficient options within their class of screening modality; all other strategies were eliminated from consideration. For ease of clinical implementation, it was assumed that a set of recommendable strategies would have the same ages to begin and end screening. For each combination of screening initiation and cessation ages, a benchmark strategy was selected, defined as a colonoscopy strategy with predicted (benchmark) LYG that are at least as large as the predicted LYG for colonoscopy every 10 years from ages 50 to 75 years, the colonoscopy strategy included in the 2008 CRC screening recommendation.47 This ensured that the model-recommendable colonoscopy strategy was no less effective than the previously recommended colonoscopy strategy. Within each class of screening modalities, the number of strategies under consideration was narrowed by eliminating those that were not efficient or near-efficient, those that resulted in LYG that were less than 90% of the benchmark LYG, and those that required more additional colonoscopies per LYG than the benchmark strategy (ie, strategies with a larger efficiency ratio than the benchmark strategy). The 90% threshold was selected before analysis of simulation results and was intended to yield model-recommendable strategies with similar LYG. The focus was on strategies with efficiency ratios less than or equal to that of the benchmark strategy because all noncolonoscopy strategies require use of additional tests, and hence impose additional burden, while colonoscopy strategies do not. The final set of model-recommendable strategies included all those that were recommendable by at least 2 of the 3 models. It was possible to have no recommendable strategy within a class of screening modalities. If more than 1 strategy within a class was recommendable by at least 2 models, then only the strategy yielding the most LYG was included in the final set of model-recommendable strategies.

Sensitivity Analyses

Additional simulations were conducted using best-case and worst-case values for test sensitivity (Table 1) for the model-recommendable screening strategies; the time frame for the USPSTF recommendation process precluded evaluation of all 204 unique screening strategies with best-case and worst-case analyses. In addition, FIT was evaluated with a lower cutoff for positivity (eTable 2 in the Supplement). Because the number of colonoscopies does not fully capture the burden of CRC screening, particularly in terms of bowel preparation (required for colonoscopy and for CTC), the number of procedures requiring cathartic bowel preparation was considered as an alternative measure of the burden of screening (continuing to assume that harms arise only from colonoscopy with polypectomy30, 31, 34). It was assumed that follow-up colonoscopy for a positive CTC finding would be performed on the same day,48 eliminating the need for 2 bowel preparations.

SimCRC was programmed in C++, MISCAN in Delphi, and CRCSPIN in C#. Output from each model was analyzed in RStudio version 0.98.1103.

Return to Table of Contents

Modeled Natural History for an Unscreened Cohort of 40-Year-Olds

In the absence of screening, the models simulated nearly identical life expectancy among 40-year-olds: 39.6 years with SimCRC and 40.0 years with MISCAN and CRC-SPIN. Estimated adenoma prevalence among an unscreened population ranged from 11% to 13% across models at age 40 years, 26% to 36% at age 60 years, and 43% to 50% at age 80 years, with highest prevalence at younger ages with MISCAN and highest prevalence at older ages with SimCRC (Figure 2A).14-23, 49 Although adenoma prevalence was comparable across models, the models differed in the distribution of adenomas by location within the colon and rectum (Table 3). The proportion of adenomas in the distal colon (ie, descending or sigmoid colon) or rectum ranged from 38% to 63%, with a higher proportion in MISCAN compared with SimCRC and CRC-SPIN. The models also differed in the distribution of the size of the largest adenoma (Table 3). Compared with MISCAN and CRC-SPIN, persons with adenomas in SimCRC were less likely to have a 1- to 5-mm adenoma as the largest adenoma, while persons in CRC-SPIN were more likely to have an adenoma of at least 10 mm as the largest adenoma.

Prior to age 75 years, the models reproduced age-specific CRC incidence rates from SEER from 1975–1979,24 a period with little to no CRC screening (Figure 2B). At older ages, SimCRC and CRC-SPIN predicted incidence rates that were higher than those observed in SEER. The models generally replicated the stage distribution observed in SEER among a largely unscreened population, although the proportion of cases diagnosed at stage IV was lower with CRCSPIN (19% of cases vs 25% of cases in SEER) (Table 3).

In the absence of screening, the models estimate that 67 to 72 per 1000 40-year-olds will be diagnosed with CRC in their lifetimes and that 27 to 28 per 1000 40-year-olds will die from CRC (eTable 3 in the Supplement).

Outcomes Among a Cohort of 40-Year-Olds Undergoing CRC Screening

Outcomes for all screening strategies are shown in eTables 3 through 10 in the Supplement. Although the models differed slightly in terms of absolute benefits, burden, and harms of screening, overall they yielded consistent relative predictions across screening modalities and similar rankings of strategies within each class of modalities. All strategies yielded clinically important LYG compared with no screening (range, 152–313 per 1000 40-year-olds). Lifetime colonoscopy burden ranged from fewer than 900 per 1000 persons (FIT every 3 years from ages 55–75 years) to more than 7500 per 1000 persons (colonoscopy screening every 5 years from ages 45–85 years). The lifetime number of harms from screening (ie, colonoscopy-related complications) was low, with at most 23 per 1000 40-year-olds with colonoscopy screening every 5 years from ages 45 to 85 years.

The LYG relative to the number of colonoscopies required and the efficient frontier for all colonoscopy strategies are presented in Figure 3. Across the 3 models, the LYG and colonoscopy burden were lowest with colonoscopy screening every 15 years from ages 55 to 75 years (range of LYG, 214-236 per 1000 persons; range of colonoscopy burden, 2968-3079 per 1000 persons) and highest with colonoscopy screening every 5 years from ages 45 to 85 years (range of LYG, 282–313 per 1000 persons; range of colonoscopy burden, 7552–7630 per 1000 persons). Similar plots for the other modalities are presented in eFigures 3 through 9 in the Supplement. For all modalities, strategies with screening beginning at age 45 years predominated on the efficient frontier; that is, they generally provided additional LYG at a lower number of additional colonoscopies than strategies with screening beginning at later ages. However, the additional LYG from starting screening at age 45 years instead of 50 years were small relative to the additional number of colonoscopies. For example, with colonoscopy screening every 10 years to age 75 years, lowering the age to begin screening from age 50 to age 45 years yielded 15 to 28 additional LYG per 1000 and required an additional 827 to 856 colonoscopies per 1000. Given this small increase in LYG and the limited empirical data to support lowering the recommended age to begin CRC screening from 50 to 45 years, subsequent analyses presented are limited to strategies with age to begin screening of 50 or 55 years. Within this subset, strategies with screening beginning at age 50 years predominated among those that were on or near the efficient frontier, suggesting that age 50 years would be a reasonable age to begin screening.

Unlike with the age to begin screening, no age to end screening predominated on the efficient frontier. However, the LYG associated with extending the age to end screening were generally small relative to the number of additional colonoscopies required. For example, with colonoscopy every 10 years from age 50 years, raising the age to end screening from 75 to 80 or 85 years (so an additional screening colonoscopy was performed at age 80 years) increased LYG by 2 to 3 per 1000 persons (a 1% change for each model) and the number of colonoscopies by 384 to 414 per 1000 (a 9%–10% change for each model). This suggests that 75 years would be a reasonable age to end screening.

Figure 4 shows the efficient frontiers for the stool-based modalities. When HSgFOBT, FIT, and FIT-DNA were evaluated together, FIT strategies comprised the majority of those that were efficient or near-efficient (efficient strategies are on the efficient frontier and near-efficient strategies have LYG within 98% of the efficient frontier [eFigure 2 in the Supplement]). Strategies involving FIT-DNA with annual screening from age 50 years to age 75, 80, or 85 years were also efficient or near-efficient options in all 3 models, while FIT-DNA strategies with screening every 3 years (the interval at which the test is currently reimbursed by the Centers for Medicare & Medicaid Services50) or every 5 years were dominated in all 3 models. With 2 models (SimCRC and MISCAN), no HSgFOBT strategies were included among those that were efficient or near-efficient, and in 1 model (CRC-SPIN) only 1 HSgFOBT strategy—annual HSgFOBT from ages 50 to 85 years—was near efficient (eTable 11 in the Supplement).

When strategies combining SIG and stool-based testing were evaluated as a group, SIG-plus-FIT strategies predominated among those that were efficient or near-efficient. For all models, efficient and near-efficient strategies included SIG plus FIT; 1 model (CRC-SPIN) also included 1 SIG-plus-HSgFOBT strategy as efficient: SIG every 10 years with annual HSgFOBT from ages 50 to 85 years (eFigure 10 and eTable 12 in the Supplement).

Model-Recommendable Strategies

In light of the limited benefits from extending the age to end screening beyond 75 years, the predominance of earlier ages to begin screening on the efficient frontier, and the lack of empirical evidence to support lowering the recommended age to begin screening from 50 to 45 years, only strategies with CRC screening from ages 50 to 75 years were eligible for model recommendation. There were 3 efficient or near-efficient colonoscopy strategies from age 50 to 75 years: colonoscopy at a 5-, 10-, or 15-year interval (Figure 3). The 15-year interval was eliminated because it yielded fewer LYG than colonoscopy every 10 years from ages 50 to 75 years (the colonoscopy strategy included in the 2008 USPSTF recommendation).47 Model-recommendable strategies with the selection of colonoscopy with a 10-year interval as the benchmark strategy are described below, and model recommendable strategies with a 5-year colonoscopy interval as the benchmark are shown in eTable 13 in the Supplement. Focus is on the 10-year interval benchmark because moving from a 10-year to a 5-year colonoscopy interval had a small effect on LYG (a 3%–7% increase) relative to the effect on the colonoscopy burden (a 45%–49% increase).

With colonoscopy every 10 years from ages 50 to 75 years selected as the benchmark strategy, the benchmark number of LYG (per 1000 persons) and efficiency ratio against which other strategies were compared equaled 275 and 55, respectively, for SimCRC; 248 and 39 for MISCAN; and 270 and 65 for CRC-SPIN (Table 4).

Selecting strategies from the other classes of screening modalities that were efficient or near-efficient and that had LYG at least 90% of the benchmark colonoscopy strategy, while requiring a lower efficiency ratio than the benchmark, resulted in the following set of model-recommendable strategies in addition to colonoscopy every 10 years (the benchmark strategy): annual FIT; SIG every 10 years with annual FIT; and CTC every 5 years (Table 4). Findings were consistent across models. Flexible sigmoidoscopy alone was not selected because, for each model and each SIG strategy, LYG were less than 90% of the benchmark LYG. The strategies of SIG every 10 years with either annual or biennial FIT met the criteria for being a recommendable strategy in at least 2 models, but only 10-yearly SIG with annual FIT was included in the final set of model-recommendable strategies because it yielded more LYG. No HSgFOBT strategy was selected because no strategies with screening from ages 50 to 75 years were efficient or near-efficient. Although annual screening with FIT-DNA from ages 50 to 75 years was near-efficient in all 3 models, it was not selected because its efficiency ratio exceeded that of the benchmark.

Among the 4 model-recommendable strategies (with colonoscopy screening every 10 years from ages 50–75 years as the benchmark), median LYG across the 3 models ranged from 244 per 1000 with annual FIT to 270 per 1000 persons with colonoscopy every 10 years (the benchmark strategy); median colonoscopy burden ranged from 1743 per 1000 persons with CTC every 5 years to 4049 per 1000 persons with colonoscopy every 10 years (Table 4). The median reduction in the lifetime risk of dying from CRC across the 3 models was 81% with annual FIT (eTable 5 in the Supplement), 82% with CTC every 5 years (eTable 10), 85% with SIG every 10 years with annual FIT (eTable 9), and 87% with colonoscopy every 10 years (eTable 3).

Sensitivity Analyses

Model predictions for the sensitivity analysis using the best-case and worst-case assumptions for test sensitivity are presented in eTable 14 in the Supplement for the set of model-recommendable strategies with screening from ages 50 to 75 years with colonoscopy every 10 years selected as the benchmark strategy. The percent change in numbers of colonoscopies, noncolonoscopy tests, LYG, complications, and CRC deaths averted relative to the base-case analysis ranged from −2% to 3% for the colonoscopy strategy, −6% to 6% for the FIT strategy, −4% to 5% for the SIG-plus-FIT strategy, and −5% to 7% for the CTC strategy. Overall conclusions for stool-based testing did not change with the inclusion of FIT strategies with a lower cutoff for positivity. Annual FIT with a high positivity threshold continued to be the model-recommendable stool-based strategy in all models (eTable 15 in the Supplement).

Findings were sensitive to the measure used for the burden of screening. When the number of procedures requiring cathartic bowel preparation was used, rather than the number of colonoscopies, CTC was no longer included as a model-recommendable strategy (eTable 16 in the Supplement).

Return to Table of Contents

In these analyses of a general population of US 40-year-olds without prior diagnosis of CRC undergoing screening, the following screening strategies from ages 50 to 75 years were estimated to provide comparable LYG and a comparable balance of benefit and burden: colonoscopy every 10 years, annual FIT, SIG every 10 years with annual FIT, and CTC every 5 years. With these strategies, median LYG across the 3 models ranged from 244 per 1000 persons with FIT to 270 per 1000 persons with colonoscopy; median colonoscopy burden ranged from more than 1700 per 1000 persons with CTC to approximately 4000 per 1000 persons with colonoscopy. The median reduction in the lifetime risk of dying from CRC was 81% with annual FIT, 82% with CTC every 5 years, 85% with SIG every 10 years with annual FIT, and 87% with colonoscopy every 10 years. Although the model-recommendable strategies are based on beginning screening at age 50 years, model results suggested that starting screening at age 45 years was more effective and provided a more favorable balance between LYG and screening burden than starting at age 50 years. However, empirical evidence is lacking to support lowering the age to begin screening. Consistent with the 2008 analysis,9 continuing screening beyond age 75 years for regularly screened persons in whom no adenomas or CRCs have been detected was estimated to provide limited benefit relative to the increase in the number of colonoscopies required.

There are some important differences between the current analysis and the 2008 analysis.9 In the current analysis, screening modalities with similar noncolonoscopy burden were grouped. The gFOBT Hemoccult II was not considered because of its low sensitivity,51 which resulted in lower LYG than with other stool-based modalities.9 HSgFOBT and FIT were again considered, although there are now empirical data to suggest that FIT has higher sensitivity and specificity for CRC than HSgFOBT.34 Also considered was the newly developed FIT-DNA test, which has higher sensitivity for CRC and for advanced adenomas than a FIT with a positivity cutoff of 100 ng or more of Hb/mL of buffer (≥20 μg Hb/g of feces) alone.33 Among the stool-based tests, FIT strategies predominated on the efficient frontier; HSgFOBT strategies were consistently below the frontier. Strategies including FIT-DNA with annual testing were on or near the frontier but were not among the model-recommendable strategies because their efficiency ratios were larger than that of the benchmark colonoscopy strategy. The strategy of FIT-DNA every 3 years (the interval currently reimbursed by the Centers for Medicare & Medicaid Services50) provided fewer LYG than that of the benchmark colonoscopy strategy and was dominated by other stool-based modalities. Flexible sigmoidoscopy alone provided fewer LYG than other strategies, but SIG every 10 years combined with annual FIT emerged as a model-recommendable strategy in all models. The latter strategy may be attractive to persons who opt for annual FIT but who also want reassurance from endoscopic testing. However, combined SIG and stool testing is nearly obsolete in the United States.52

Computed tomographic colonography strategies were also included in the current analysis, whereas CTC was excluded from the 2008 analysis. A strategy involving CTC was model-recommendable provided that the number of colonoscopies, rather than the number of procedures requiring cathartic bowel preparation, was used as the measure of screening burden. When cathartic bowel preparations were included as part of the burden metric, there was an optimistic assumption that colonoscopy for the follow-up of a positive CTC finding would be performed on the same day, thereby eliminating the need for 2 bowel preparations. Same-day follow-up colonoscopy requires integration between radiology and gastroenterology units and is available at some specialized centers in the United States.53 Although the burden of bowel preparation with CTC was included in the sensitivity analysis, none of the analyses accounted for the harms associated with the small risk of radiation-induced cancer from CTC, nor did the analyses account for the harms (or potential benefits) from the follow-up of extracolonic findings detected at CTC. Accounting for these benefits, harms, and burdens might have the potential to alter whether CTC was a model-recommendable strategy, but evidence is insufficient to reliably quantify the magnitude of these effects.34

Having multiple independently developed models that provide similar findings despite differences in underlying assumptions provides a stronger case for model results. Each model simulates a different averaged well time from adenoma to clinical cancer,11, 54 reflecting uncertainty in clinical understanding of these unobservable processes. Using 3 distinct models provides a range of outcomes based on different assumptions, similar to a sensitivity analysis. In general, while the models differed slightly in terms of absolute outcomes (eg, number of LYG from screening, number of colonoscopies required, and number of CRC deaths averted), they yielded consistent relative predictions across screening modalities and similar rankings within classes of screening modalities.

This study should be interpreted in the context of several limitations. First, the models assumed perfect adherence to screening regimens, including all screening, follow-up, and surveillance tests, resulting in a prediction of the maximum achievable benefit for each strategy. Adherence to screening is a crucial component of screening effectiveness. Currently there is limited empirical evidence on test-specific adherence over multiple rounds of screening.55 Furthermore, there are no data describing screening adherence over an extended period (such as the 40-year period from ages 45–85 years, as simulated by the models), making it impossible to inform the models with empirical evidence. The 2008 analysis for the USPSTF9 included a sensitivity analysis examining the effect of adherence, with the expected result that reducing adherence resulted in fewer LYG and lower colonoscopy burden. However, adherence was not incorporated into selection of model recommendable strategies in 2008 (nor was it in the current analysis), because identifying model-recommendable strategies based on imperfect adherence could result in selection of strategies with short intervals to make up for suboptimal population-level adherence; it could also lead to overscreening for those individuals who adhere to recommendations, potentially at the cost of unnecessary risks and burden.

Second, this analysis is meant to inform population guidelines. It is based on simulation of the general US population and is not intended for individual-level decision making, which would incorporate information about personal risk and patient preferences. Evaluation of personalized screening scenarios was beyond the scope of this analysis. However, screening strategies tailored to family history,56 comorbidity status,57 and screening history10 have been evaluated in other analyses.

Third, although the results provide a framework for evaluating a program of screening, much of the empirical data on test sensitivity and specificity are based on a single round of screening. Additional studies with multiple rounds of screening are needed to inform whether and how test performance varies at repeat screenings. In the absence of data to suggest otherwise, conditional independence of repeat screenings was assumed, meaning there were no systematic false-negative results for adenomas and cancers. This assumption would not hold for HSgFOBT, FIT, or the FIT component of the FIT-DNA test if some lesions never bleed. There is no evidence to inform whether that is the case, or whether the DNA assay component of the FIT-DNA test would also be subject to systematic false-negative findings. Colonoscopy and CTC might also have systematic false-negative findings due to lesions located behind a colonic fold or flat lesions. If test sensitivity is lower at subsequent rounds of screening, estimates of the benefits of screening might be overstated.

Fourth, adenoma size was used as an indicator for advanced adenomas, but the models did not explicitly simulate adenoma histology, largely because it is correlated with size. The models did not include the serrated polyp pathway58, 59 due to insufficient evidence on the prevalence of sessile-serrated polyps by age, size, and location; their malignant potential; and the ability of screening tests to detect them.

Fifth, it was assumed that, conditional on size, colonoscopy sensitivity is the same for each adenoma within reach of the endoscope, regardless of its location. Observational studies suggest a smaller mortality reduction for proximal than for distal or rectal cancer with colonoscopy,60-68 implying that test sensitivity (and natural history) might differ by location.

Sixth, the effect of uncertainty in model input parameters on the model-recommendable screening strategies was not evaluated with a probabilistic sensitivity analysis. The USPSTF recommendation process necessitated the completion of the systematic evidence review prior to estimation of screening effects by the models. The time frame for presentation of model findings to the USPSTF did not allow for completion of a probabilistic sensitivity analysis, which, with 204 unique screening strategies, would have required at least 200,000 additional simulations per model. The uncertainty in the deep natural history parameters is captured to some degree by the use of 3 models that have different assumptions with respect to natural history.54 To the extent that the 3 models yield similar conclusions, the results appear to be less sensitive to the natural history parameters. The most important external parameters are the test sensitivity estimates, which were varied.

Seventh, the measures of the benefits and burden of screening used in the analysis were imperfect. The benefits of screening were measured by LYG and did not account for quality of life. Utility weights have been estimated for diagnosed CRC states,69 but utility weights have not been estimated for the 8 CRC screening tests, nor for colonoscopy complications. Had quality of life been accounted for in this analysis, alternative model-recommendable screening strategies might have emerged. In addition, the number of required colonoscopies was used as the measure of the burden of screening. This was chosen because colonoscopy is the only burden shared by all modalities. All tests are burdensome but in different ways.70 Ideally, a metric would have been identified that accounts for the burden of all testing, but doing so requires subjective assumptions about how many of one test is equivalent to one of another (eg, x stool tests are equivalent to y SIGs and to z colonoscopies, etc). The relative burden of different tests likely varies across patients according to different preferences. In a sensitivity analysis in which the number of cathartic bowel preparations was used as an alternative measure of the burden of screening, CTC every 5 years was no longer included as a model-recommendable strategy, suggesting that the recommendable strategies are sensitive to the measure of screening burden. Future work should consider alternative measures of test burden that would enable direct comparison across all screening strategies.

Return to Table of Contents

In this microsimulation modeling study of a previously unscreened population undergoing CRC screening that assumed 100% adherence, the strategies of colonoscopy every 10 years, annual FIT, SIG every 10 years with annual FIT, and CTC every 5 years performed from ages 50 to 75 years provided similar LYG and a comparable balance of benefit and screening burden.

Return to Table of Contents

Source: This article was first published in the Journal of the American Medical Association on June 15, 2016 (JAMA. 2016;315(23):2595-609).

Conflict of Interest Disclosures: All authors have completed and submitted the ICMJE Form for Disclosure of Potential Conflicts of Interest and none were reported.

Funding/Support: This analysis was supported by the National Cancer Institute (NCI) of the National Institutes of Health (NIH) (through a supplement from the Agency for Healthcare Research and Quality [AHRQ]) under award U01CA152959. Dr. Zauber was also supported in part by a NCI Cancer Center Support Grant under award P30CA008748.

Role of the Funder/Sponsor: Investigators worked with AHRQ staff and members of the USPSTF to define the scope of the project and specific questions to be addressed. AHRQ and NCI staff reviewed the manuscript prior to submission to ensure that the analysis met methodological standards. The authors are solely responsible for the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Disclaimer: The views expressed are those of the authors only and do not represent any official position of the NIH, NCI, or AHRQ.

An Interactive Resource for many of the figures shown in the text and in the Supplement is available at https://resources.cisnet.cancer.gov/projects/#crcr/uspstf/.

Additional Contributions: We thank Jennifer Croswell, MD, MPH, from AHRQ, for assistance, support, and feedback throughout the project; members of the USPSTF for comments on earlier versions of this research; the Kaiser Permanente Research Affiliates Evidence-based Practice Center for sharing early drafts of their review of the literature for incorporation in this analysis; the peer reviewers noted in the Additional Information section for suggestions on earlier versions of this study; James Allison, MD, University of California, San Francisco, for addressing questions about fecal immunochemical tests; and Eric "Rocky" Feuer, PhD, NCI, for leadership of CISNET. None of these individuals were compensated in association with their respective contribution to this article.

Additional Information: A draft version of this modeling report underwent external peer review from 3 content experts (Jason Dominitz, MD, MHS, University of Washington and the Department of Veterans Affairs; Russell Harris, MD, University of North Carolina; and David Ransohoff, MD, University of North Carolina) and 3 federal partners (Paul Pinsky, PhD, NCI; Marion Nadel, PhD, MPH, Centers for Disease Control and Prevention; and Jean Shapiro, PhD, Centers for Disease Control and Prevention). Comments were presented to the USPSTF during its deliberation of the evidence and were considered in preparing the final modeling report.

Return to Table of Contents

1. Mandel JS, Bond JH, Church TR, et al. Reducing mortality from colorectal cancer by screening for fecal occult blood: Minnesota Colon Cancer Control Study. N Engl J Med. 1993;328(19):1365-1371.
2. Hardcastle JD, Chamberlain JO, Robinson MH, et al. Randomised controlled trial of faecal-occult-blood screening for colorectal cancer. Lancet. 1996;348(9040):1472-1477.
3. Kronborg O, Fenger C, Olsen J, Jørgensen OD, Søndergaard O. Randomised study of screening for colorectal cancer with faecal-occult-blood test. Lancet. 1996;348(9040):1467-1471.
4. Shaukat A, Mongin SJ, Geisser MS, et al. Long-term mortality after screening for colorectal cancer. N Engl J Med. 2013;369(12):1106-1114.
5. Atkin WS, Edwards R, Kralj-Hans I, et al; UK Flexible Sigmoidoscopy Trial Investigators. Once-only flexible sigmoidoscopy screening in prevention of colorectal cancer: a multicentre randomised controlled trial. Lancet. 2010;375(9726):1624-1633.
6. Segnan N, Armaroli P, Bonelli L, et al; SCORE Working Group. Once-only sigmoidoscopy in colorectal cancer screening: follow-up findings of the Italian Randomized Controlled Trial: SCORE. J Natl Cancer Inst. 2011;103(17):1310-1322.
7. Schoen RE, Pinsky PF, Weissfeld JL, et al; PLCO Project Team. Colorectal-cancer incidence and mortality with screening flexible sigmoidoscopy. N Engl J Med. 2012;366(25):2345-2357.
8. Holme Ø, Løberg M, Kalager M, et al. Effect of flexible sigmoidoscopy screening on colorectal cancer incidence and mortality: a randomized clinical trial. JAMA. 2014;312(6):606-615.
9. Zauber AG, Lansdorp-Vogelaar I, Knudsen AB, Wilschut J, van Ballegooijen M, Kuntz KM. Evaluating test strategies for colorectal cancer screening: a decision analysis for the US Preventive Services Task Force. Ann Intern Med. 2008;149(9):659-669.
10. van Hees F, Habbema JD, Meester RG, Lansdorp-Vogelaar I, van Ballegooijen M, Zauber AG. Should colorectal cancer screening be considered in elderly persons without previous screening? A cost-effectiveness analysis. Ann Intern Med. 2014;160(11):750-759.
11. Rutter CM, Knudsen AB, Marsh TL, et al. Validation of models used to inform colorectal cancer screening guidelines: accuracy and implications. Med Decis Making. 2016;36(5):604-614.
12. Zauber A, Knudsen A, Rutter CM, Lansdorp-Vogelaar I, Kuntz KM. Evaluating the Benefits and Harms of Colorectal Cancer Screening Strategies: A Collaborative Modeling Approach. AHRQ Publication No. 14-05203-EF-2. Rockville, MD: Agency for Healthcare Research and Quality; 2015.
13. Cancer Intervention and Surveillance Modeling Network (CISNET) Model Registry. National Cancer Institute. https://resources.cisnet.cancer.gov/registry. Accessed May 25, 2016.
14. Clark JC, Collan Y, Eide TJ, et al. Prevalence of polyps in an autopsy series from areas with varying incidence of large-bowel cancer. Int J Cancer. 1985;36(2):179-186.
15. Blatt L. Polyps of the colon and rectum: incidence and distribution. Dis Colon Rectum. 1961;4(4):277-282.
16. Vatn MH, Stalsberg H. The prevalence of polyps of the large intestine in Oslo: an autopsy study. Cancer. 1982;49(4):819-825.
17. Jass JR, Young PJ, Robinson EM. Predictors of presence, multiplicity, size and dysplasia of colorectal adenomas: a necropsy study in New Zealand. Gut. 1992;33(11):1508-1514.
18. Johannsen LG, Momsen O, Jacobsen NO. Polyps of the large intestine in Aarhus, Denmark: an autopsy study. Scand J Gastroenterol. 1989;24(7):799-806.
19. Bombi JA. Polyps of the colon in Barcelona, Spain: an autopsy study. Cancer. 1988;61(7):1472-1476.
20. Williams AR, Balasooriya BA, Day DW. Polyps and cancer of the large bowel: a necropsy study in Liverpool. Gut. 1982;23(10):835-842.
21. Rickert RR, Auerbach O, Garfinkel L, Hammond EC, Frasca JM. Adenomatous lesions of the large bowel: an autopsy survey. Cancer. 1979;43(5):1847-1857.
22. Chapman I. Adenomatous polypi of large intestine: incidence and distribution. Ann Surg. 1963;157(2):223-226.
23. Arminski TC, McLean DW. Incidence and distribution of adenomatous polyps of the colon and rectum based on 1,000 autopsy examinations. Dis Colon Rectum. 1964;7(4):249-261.
24. SEER*Stat Database: Incidence–SEER 9 Regs Public-Use, Nov 2003 Sub (1973-2001).Surveillance, Epidemiology, and End Results (SEER) Program. Updated released April 2004, based on the November 2003 submission. https://www.seer.cancer.gov. Accessed May 8, 2019.
25. Life tables. National Center for Health Statistics. http://www.cdc.gov/nchs/products/life _tables.htm. Accessed May 25, 2016.
26. Rutter CM, Johnson EA, Feuer EJ, Knudsen AB, Kuntz KM, Schrag D. Secular trends in colon and rectal cancer relative survival. J Natl Cancer Inst. 2013;105(23):1806-1813.
27. Schroy PC III, Coe A, Chen CA, O'Brien MJ, Heeren TC. Prevalence of advanced colorectal neoplasia in white and black patients undergoing screening colonoscopy in a safety-net hospital. Ann Intern Med. 2013;159(1):13-20.
28. van Rijn JC, Reitsma JB, Stoker J, Bossuyt PM, van Deventer SJ, Dekker E. Polyp miss rate determined by tandem colonoscopy: a systematic review. Am J Gastroenterol. 2006;101(2):343-350.
29. Johnson CD, Chen MH, Toledano AY, et al. Accuracy of CT colonography for detection of large adenomas and cancers. N Engl J Med. 2008;359 (12):1207-1217.
30. van Hees F, Zauber AG, Klabunde CN, Goede SL, Lansdorp-Vogelaar I, van Ballegooijen M. The appropriateness of more intensive colonoscopy screening than recommended in Medicare beneficiaries: a modeling study. JAMA Intern Med. 2014;174(10):1568-1576.
31. Warren JL, Klabunde CN, Mariotto AB, et al. Adverse events after outpatient colonoscopy in the Medicare population. Ann Intern Med. 2009;150(12):849-857,W152.
32. Gatto NM, Frucht H, Sundararajan V, Jacobson JS, Grann VR, Neugut AI. Risk of perforation after colonoscopy and sigmoidoscopy: a population-based study. J Natl Cancer Inst. 2003;95(3):230-236.
33. Imperiale TF, Ransohoff DF, Itzkowitz SH, et al. Multitarget stool DNA testing for colorectal-cancer screening. N Engl J Med. 2014;370(14):1287-1297.
34. Lin JS, Piper M, Perdue LA, et al. Screening for Colorectal Cancer: A Systematic Review for the US Preventive Services Task Force. Evidence Synthesis No. 135. AHRQ Publication No. 14-05203-EF-1. Rockville, MD: Agency for Healthcare Research and Quality; 2016.
35. Levi Z, Birkenfeld S, Vilkin A, et al. A higher detection rate for colorectal cancer and advanced adenomatous polyp for screening with immunochemical fecal occult blood test than guaiac fecal occult blood test, despite lower compliance rate: a prospective, controlled, feasibility study. Int J Cancer. 2011;128(10):2415-2424.
36. Allison JE, Tekawa IS, Ransom LJ, Adrain AL. A comparison of fecal occult-blood tests for colorectal-cancer screening. N Engl J Med. 1996;334(3):155-159.
37. Weissfeld JL, Schoen RE, Pinsky PF, et al; PLCO Project Team. Flexible sigmoidoscopy in the PLCO cancer screening trial: results from the baseline screening examination of a randomized trial. J Natl Cancer Inst. 2005;97(13):989-997.
38. Atkin WS, Cook CF, Cuzick J, Edwards R, Northover JM, Wardle J; UK Flexible Sigmoidoscopy Screening Trial Investigators. Single flexible sigmoidoscopy screening to prevent colorectal cancer: baseline findings of a UK multicentre randomised trial. Lancet. 2002;359(9314):1291-1300.
39. Painter J, Saunders DB, Bell GD, Williams CB, Pitt R, Bladen J. Depth of insertion at flexible sigmoidoscopy: implications for colorectal cancer screening and instrument design. Endoscopy. 1999;31(3):227-231.
40. Mandelblatt JS, Cronin KA, Bailey S, et al; Breast Cancer Working Group of the Cancer Intervention and Surveillance Modeling Network. Effects of mammography screening under different screening schedules: model estimates of potential benefits and harms. Ann Intern Med. 2009;151(10):738-747.
41. Mandelblatt JS, Stout NK, Schechter CB, et al. Collaborative modeling of the benefits and harms associated with different US breast cancer screening strategies. Ann Intern Med. 2016;164(4):215-225.
42. de Koning HJ, Meza R, Plevritis SK, et al. Benefits and harms of computed tomography lung cancer screening strategies: a comparative modeling study for the US Preventive Services Task Force. Ann Intern Med. 2014;160(5):311-320.
43. Kulasingam SL, Havrilesky L, Ghebre R, Myers ER. Screening for Cervical Cancer: A Decision Analysis for the US Preventive Services Task Force: Evidence Synthesis No. 86S. AHRQ Report No. 11-05157-EF-1. Rockville, MD: Agency for Healthcare Research and Quality; 2011.
44. Kulasingam SL, Havrilesky LJ, Ghebre R, Myers ER. Screening for cervical cancer: a modeling study for the US Preventive Services Task Force. J Low Genit Tract Dis. 2013;17(2):193-202.
45. Mark DH. Visualizing cost-effectiveness analysis. JAMA. 2002;287(18):2428-2429.
46. Owens DK, Qaseem A, Chou R, Shekelle P; Clinical Guidelines Committee of the American College of Physicians. High-value, cost-conscious health care: concepts for clinicians to evaluate the benefits, harms, and costs of medical interventions. Ann Intern Med. 2011;154(3):174-180.
47. US Preventive Services Task Force. Screening for colorectal cancer: US Preventive Services Task Force recommendation statement. Ann Intern Med. 2008;149(9):627-637.
48. Pickhardt PJ, Taylor AJ, Kim DH, Reichelderfer M, Gopal DV, Pfau PR. Screening for colorectal neoplasia with CT colonography: initial experience from the 1st year of coverage by third-party payers. Radiology. 2006;241(2):417-425.
49. Rutter CM, Yu O, Miglioretti DL. A hierarchical non-homogenous Poisson model for meta-analysis of adenoma counts. Stat Med. 2007;26(1):98-109.
50. Decision memo for screening for colorectal cancer: stool DNA testing (CAG-00440N). Centers for Medicare & Medicaid Services. http://www.cms.gov/medicare-coverage-database/details/nca-decision-memo.aspx?NCAId=277. Accessed May 25, 2016.
51. Whitlock EP, Lin JS, Liles E, Beil TL, Fu R. Screening for colorectal cancer: a targeted, updated systematic review for the US Preventive Services Task Force. Ann Intern Med. 2008;149(9):638-658.
52. Klabunde CN, Cronin KA, Breen N, Waldron WR, Ambs AH, Nadel MR. Trends in colorectal cancer test use among vulnerable populations in the United States. Cancer Epidemiol Biomarkers Prev. 2011;20(8):1611-1621.
53. Pickhardt PJ. CT colonography for population screening: ready for prime time? Dig Dis Sci. 2015;60(3):647-659.
54. Kuntz KM, Lansdorp-Vogelaar I, Rutter CM, et al. A systematic comparison of microsimulation models of colorectal cancer: the role of assumptions about adenoma progression. Med Decis Making. 2011;31(4):530-539.
55. Jensen CD, Corley DA, Quinn VP, et al. Fecal immunochemical test program performance over 4 rounds of annual screening: a retrospective cohort study. Ann Intern Med. 2016;164(7):456-463.
56. Wilschut JA, Steyerberg EW, van Leerdam ME, Lansdorp-Vogelaar I, Habbema JD, van Ballegooijen M. How much colonoscopy screening should be recommended to individuals with various degrees of family history of colorectal cancer? Cancer. 2011;117(18):4166-4174.
57. Lansdorp-Vogelaar I, Gulati R, Mariotto AB, et al. Personalizing age of cancer screening cessation based on comorbid conditions: model estimates of harms and benefits. Ann Intern Med. 2014;161(2):104-112.
58. Rex DK, Ahnen DJ, Baron JA, et al. Serrated lesions of the colorectum: review and recommendations from an expert panel. Am J Gastroenterol. 2012;107(9):1315-1329.
59. Snover DC. Update on the serrated pathway to colorectal carcinoma. Hum Pathol. 2011;42(1):1-10.
60. Lakoff J, Paszat LF, Saskin R, Rabeneck L. Risk of developing proximal versus distal colorectal cancer after a negative colonoscopy: a population-based study. Clin Gastroenterol Hepatol. 2008;6(10):1117-1121.
61. Singh H, Turner D, Xue L, Targownik LE, Bernstein CN. Risk of developing colorectal cancer following a negative colonoscopy examination: evidence for a 10-year interval between colonoscopies. JAMA. 2006;295(20):2366-2373.
62. Baxter NN, Goldwasser MA, Paszat LF, Saskin R, Urbach DR, Rabeneck L. Association of colonoscopy and death from colorectal cancer. Ann Intern Med. 2009;150(1):1-8.
63. Singh H, Nugent Z, Demers AA, Kliewer EV, Mahmud SM, Bernstein CN. The reduction in colorectal cancer mortality after colonoscopy varies by site of the cancer. Gastroenterology. 2010;139(4):1128-1137.
64. Brenner H, Hoffmeister M, Arndt V, Stegmaier C, Altenhofen L, Haug U. Protection from right- and left-sided colorectal neoplasms after colonoscopy: population-based study. J Natl Cancer Inst. 2010;102(2):89-95.
65. Brenner H, Chang-Claude J, Seiler CM, Rickert A, Hoffmeister M. Protection from colorectal cancer after colonoscopy: a population-based, case-control study. Ann Intern Med. 2011;154(1):22-30.
66. Nishihara R, Wu K, Lochhead P, et al. Long-term colorectal-cancer incidence and mortality after lower endoscopy. N Engl J Med. 2013;369(12):1095-1105.
67. Doubeni CA, Weinmann S, Adams K, et al. Screening colonoscopy and risk for incident late-stage colorectal cancer diagnosis in average-risk adults: a nested case-control study. Ann Intern Med. 2013;158(5 pt 1):312-320.
68. Baxter NN, Warren JL, Barrett MJ, Stukel TA, Doria-Rose VP. Association between colonoscopy and colorectal cancer mortality in a US cohort according to site of cancer and colonoscopist specialty. J Clin Oncol. 2012;30(21):2664-2669.
69. Ness RM, Holmes AM, Klein R, Dittus R. Utility valuations for outcome states of colorectal cancer. Am J Gastroenterol. 1999;94(6):1650-1657.
70. Jones RM, Woolf SH, Cunningham TD, et al. The relative importance of patient-reported barriers to colorectal cancer screening. Am J Prev Med. 2010;38(5):499-507.

Return to Table of Contents

The opportunity to intervene in the natural history through screening is noted in red. Screening can either remove an adenoma, thus moving a person to the “no lesion” state, or diagnose a preclinical cancer, which, if detected at an earlier stage, may be more amenable to treatment.
a The SimCRC and MISCAN models simulate discrete adenoma size categories (ie, 1–5 mm, 6–9 mm, 10 mm). The CRC-SPIN model simulates continuous adenoma size.
b Screening may allow for detection of cancer at an earlier stage than symptom-detected cancer and therefore create the conditions necessary for a better prognosis.

Text Description.

Figure 1 is a graphical representation of the natural history of colorectal cancer and the effects of screening as simulated by SimCRC, MISCAN, and CRC-SPIN. Simulated persons begin in a disease-free “no lesion” state and may progressively transition to an adenoma state, a preclinical (undiagnosed) colorectal cancer state, and a clinical (diagnosed) colorectal cancer state, from which they may die from colorectal cancer. Persons may die from other causes at any time. Screening can either result in adenoma removal, thus moving a person back to the “no lesion” state, or diagnose a preclinical cancer, which if detected earlier, may be at a more treatable stage.

Return to Table of Contents

Screening Test Sensitivity Analysis
Test Characteristic Base-Case Value Source Worst-Case Value Best-Case Value Source
Colonoscopy (within reach, per lesion)a
Specificity, % 86b Schroy et al, 201327 Not varied Not varied Not varied
Sensitivity for adenomas 1–5 mm, % 75 van Rijn et al, 200628 70 79 Zauber et al, 20089
Sensitivity for adenomas 6–9 mm, % 85 van Rijn et al, 200628 80 92 Zauber et al, 20089
Sensitivity for adenomas ≥10 mm, % 95 van Rijn et al, 200628 93.1 99.5 Johnson et al, 200829
Sensitivity for colorectal cancer, % 95 By assumption 93.1 99.5 By assumption
Reach, % 95 to end of cecum, remainder between rectum and cecum By assumption Not varied Not varied Not varied
Risk of complications (serious gastrointestinal, other gastrointestinal, and cardiovascular complications) Age-specific risksc van Hees et al, 201430
Warren et al, 200931
Gatto et al, 200332
Not varied Not varied Not varied
FIT (per person)   Imperiale et al, 201433     Imperiale et al, 201433
Specificity, % 96.4   Not varied Not varied Not varied
Sensitivity for adenomas 1–5 mm, % 7.6d   6.7d 8.6d 27e
Sensitivity for adenomas 6–9 mm, %
Sensitivity for adenomas ≥10 mm, % 23.8e   20.8e    
Sensitivity for colorectal cancer, % 73.8   62.3 83.3  
Reach Whole colorectum By assumption Not varied Not varied Not varied
Risk of complications, % 0 Lin et al, 201534 Not varied Not varied Not varied
HSgFOBT (per person)   Zauber et al, 20089      
Specificity, % 92.5   Not varied Not varied Not varied
Sensitivity for adenomas 1–5 mm, % 7.5f   7.5f 7.5f Zauber et al, 20089
Sensitivity for adenomas 6–9 mm, % 12.4   10 26.2 Zauber et al, 20089
Sensitivity for adenomas ≥10 mm, % 23.9   17.7 49.4 Zauber et al, 20089
Sensitivity for colorectal cancer, % 70   61.5 79.4 Levi et al, 201135
Allison et al, 199636
Reach Whole colorectum By assumption Not varied Not varied Not varied
Risk of complications, % 0 Lin et al, 201534 Not varied Not varied Not varied
FIT-DNA (per person)   Imperiale et al, 201433     Imperiale et al, 201433
Specificity, % 89.8   Not varied Not varied Not varied
Sensitivity for adenomas 1–5 mm, % 17.2d   15.9d 18.6d  
Sensitivity for adenomas 6–9 mm, %
Sensitivity for adenomas ≥10 mm, % 42.4e   38.7e 46.2e  
Sensitivity for colorectal cancer, % 92.3   84 97  
Reach Whole colorectum By assumption Not varied Not varied Not varied
Risk of complications, % 0 Lin et al, 201534 Not varied Not varied Not varied
Sigmoidoscopy (within reach, per lesion)         By assumption
Specificity, % 87b Weissfeld et al, 200537 Not varied Not varied Not varied
Sensitivity for adenomas 1–5 mm, % 75 By assumption 70 79.0  
Sensitivity for adenomas 6–9 mm, % 85 By assumption 80 92.0  
Sensitivity for adenomas ≥10 mm, % 95 By assumption 93.1 99.5  
Sensitivity for colorectal cancer, % 95 By assumption 93.1 99.5  
Reach 76–88 to sigmoid-
descending junction; 0 beyond the splenic flexure
Atkin et al, 200238
Painter et al, 199939
Not varied Not varied Not varied
Risk of complications, % 0 By assumptiong
van Hees et al, 201430
Warren et al, 200931
Not varied Not varied Not varied
CTC (per lesion)   Johnson et al, 200829     Johnson et al, 200829
Specificity, % 88h   Not varied Not varied Not varied
Sensitivity for adenomas 1–5 mm, % NP   NP NP  
Sensitivity for adenomas 6–9 mm, % 57   48.9 71.6  
Sensitivity for adenomas ≥10 mm, % 84   75.6 92.4  
Sensitivity for colorectal cancer, % 84   75.6 92.4  
Reach Whole colorectum By assumption Not varied Not varied Not varied
Risk of complications, % 0 Lin et al, 201534 Not varied Not varied Not varied

Abbreviations: CTC, computed tomographic colonography; FIT, fecal immunochemical test with a positivity cutoff of 100 ng of hemoglobin (Hb) per mL of buffer (20 μg Hb/g of feces); FIT-DNA, multitarget stool DNA test (fecal immunochemical test with a DNA stool test); HSgFOBT, high-sensitivity guaiac-based fecal occult blood test; NP, sensitivity not provided because only persons with a 6-mm lesion visualized at CTC are deemed to have a positive test.
a It was assumed that the same test characteristics for screening colonoscopies applied to colonoscopies for diagnostic follow-up or for surveillance. It was assumed that there was no correlation in findings between CTC or sigmoidoscopy and subsequent diagnostic colonoscopy.
b The lack of specificity with endoscopy reflects the detection of nonadenomatous polyps, which, in the case of sigmoidoscopy, may lead to unnecessary diagnostic colonoscopy, and in the case of colonoscopy, leads to unnecessary polypectomy, which is associated with an increased risk of colonoscopy complications.
c See eFigure 1 in the Supplement for details on age-specific risks.
d Sensitivity for persons with nonadvanced adenomas. For persons with 1–5 mm adenomas, it was assumed that the sensitivity is equal to the positivity rate in persons without adenomas. The sensitivity for persons with 6–9 mm adenomas was chosen such that the weighted average sensitivity for persons with 1–5 mm and with 6–9 mm adenomas is equal to that for nonadvanced adenomas.
e Sensitivity for persons with advanced adenomas (ie, adenomas 10 mm or adenomas with advanced histology). Sensitivity was not reported for the subset of persons with 10 mm adenomas.
f It was assumed that 1–5 mm adenomas do not bleed and therefore cannot cause a positive stool test. It was also assumed that HSgFOBT can be positive because of bleeding from other causes, the probability of which is equal to positivity rate in persons without adenomas.
g The risk of complications with colonoscopy is conditional on polypectomy.30, 31 Sigmoidoscopy is modeled without biopsy or polypectomy of detected lesions. The risk of complications with sigmoidoscopy was therefore assumed to be 0.
h The lack of specificity with CTC reflects the detection of 6-mm nonadenomatous lesions, artifacts, stool, and adenomas smaller than the 6-mm threshold for referral to colonoscopy that are measured as 6 mm.

Return to Table of Contents

Screening Modality Screening
Interval, ya
Age to Begin
Screening, y
Age to End
Screening, y
No. of (Unique)
Strategiesb
No screening       1 (1)
Fecal immunochemical test (FIT) 1, 2, 3 45, 50, 55 75, 80, 85 27 (27)
High-sensitivity guaiac-based fecal occult blood test (HSgFOBT) 1, 2, 3 45, 50, 55 75, 80, 85 27 (27)
Multitarget stool DNA test (FIT-DNA) 1, 3, 5 45, 50, 55 75, 80, 85 27 (27)
Flexible sigmoidoscopy (SIG) 5, 10 45, 50, 55 75, 80, 85 18 (15)
SIG+FITc 5_2, 5_3,
10_1, 10_2
45, 50, 55 75, 80, 85 36 (36)
SIG+HSgFOBTc 5_2, 5_3,
10_1, 10_2
45, 50, 55 75, 80, 85 36 (36)
Computed tomographic colonography (CTC) 5, 10 45, 50, 55 75, 80, 85 18 (15)
Colonoscopy (COL) 5, 10, 15 45, 50, 55 75, 80, 85 27 (20)
Total number of (unique) screening strategies evaluated with the models       217 (204)

a For SIG+FIT and SIG+HSgFOBT, the first interval is for SIG and the second interval is for the stool test.
b The number of unique strategies excludes those with overlap (eg, COL every 10 years from ages 50–80 years and from ages 50–85 years both include colonoscopies at ages 50, 60, 70, and 80 years so are not unique strategies).
c If the 2 tests are due in the same year, the stool test is performed first. Those with a positive stool test result are referred for a diagnostic colonoscopy and do not have SIG. Those with a negative stool test result go on to have SIG.

Return to Table of Contents

The calibrated models were used to project estimates for ages for which calibration data were not available. A, Adenoma prevalence from autopsy studies14-23 and as predicted by the models. Multiple observations at each data point reflect estimates from different studies. The SimCRC and MISCAN models were each simultaneously calibrated to adenoma prevalence estimates from 10 autopsy studies.14-23 The CRC-SPIN model incorporates the distribution of adenoma risk based on a Bayesian meta-analysis49 of the 10 autopsy studies.14-23 B, Colorectal cancer cases per 100,000 from the Surveillance, Epidemiology, and End Results (SEER) program (1975–1979)24 and as predicted by the models. The models were calibrated to SEER colorectal cancer incidence rates in 1975–1979 because this period represents colorectal cancer incidence in the United States when there was little or no screening for the disease. (SEER data do not distinguish between screen-detected cancer and clinically detected cancer.)

Text Description.

Figure 2a shows the prevalence of adenomas by age from autopsy studies and as predicted by the SimCRC, MISCAN, and CRC-SPIN models. The data from autopsy studies show adenoma prevalence generally increases with age, with wide variation across studies in the prevalence at a given age. The model-predicted age-specific adenoma prevalence generally falls within the range of prevalence estimates from the autopsy studies. Figure 2b shows the predicted incidence of colorectal cancer by age and model compared with incidence rates from the Surveillance, Epidemiology, and End Results (SEER) Program. The models were calibrated to SEER colorectal cancer incidence rates in 1975–1979 because this period represents colorectal cancer incidence in the United States when there was little or no screening for the disease.

 

Return to Table of Contents

Outcome SimCRC MISCAN CRC-SPIN SEER
(1975–1979)24
Adenoma location distribution (ages 40–100 y), %a
Rectum 8 21 9  
Sigmoid colon 21 36 24  
Descending colon 9 6 12  
Transverse colon 29 13 24  
Ascending colon 23 9 23  
Cecum 10 5 8  
Adenoma size distribution by age, %a,b
Age 40 y
   1-5 mm 56 80 73  
   6-9 mm 34 12 19  
   ≥10 mm 11 9 8  
Age 60 y
   1–5 mm 42 61 46  
   6–9 mm 40 20 24  
   ≥10 mm 18 19 30  
Age 80 y
   1–5 mm 30 51 31  
   6–9 mm 44 22 21  
   ≥10 mm 26 27 48  
CRC stage distribution (ages 40100 y), %a
Stage I 18 18 18 18
Stage II 34 34 36 33
Stage III 23 24 27 24
Stage IV 25 25 19 25
Lifetime risks of CRC (ages 40100 y), outcomes per 1000 40-year-olds
CRC incidence 70 67 72  
CRC mortality 28 28 27  

Abbreviations: CRC, colorectal cancer; CRC-SPIN, CRC Simulated Population Model for Incidence and Natural History; MISCAN, Microsimulation Screening Analysis; SEER, Surveillance, Epidemiology, and End Results Program; SimCRC, Simulation Model of CRC.
a Distributions may not sum to 100% due to rounding.
b Of the largest adenoma.

Return to Table of Contents

Labeled strategies are efficient or near-efficient with an age to begin screening of 50 or 55 years. aStrategy is near-efficient (it is weakly dominated and its life-years gained [LYG] are within 98% of the efficient frontier).

Text Description.

Figure 3 shows the total number of colonoscopies required (x-axis) and life-years gained compared with no screening (y-axis) for a cohort of 40-year-olds for colonoscopy screening strategies that vary by age to begin, age to end, and screening interval. A separate graph is provided for each of the three models (SimCRC, MISCAN, CRC-SPIN). Each screening strategy is represented by a point. Points that are higher on the graph provide more life-years and points further to the right require more colonoscopies. The strategies that comprise the outer envelope of the points are the subset of efficient strategies, and the line that connects these strategies is called the efficient frontier. The strategies on the efficient frontier are those for which no other strategy or combination of strategies provide more life-years for fewer colonoscopies. Two efficient frontiers are shown. One frontier considers all strategies, noted by a grey line. The other, noted by a black line, only considers strategies with age to begin screening of 50 or 55.

Return to Table of Contents

Labeled strategies are efficient or near-efficient with an age to begin screening of 50 or 55 years. aStrategy is near-efficient (it is weakly dominated and its life-years gained [LYG] are within 98% of the efficient frontier).

Text Description.

Figure 4 shows the total number of colonoscopies required (x-axis) and life-years gained compared with no screening (y-axis) for a cohort of 40-year-olds for stool-based screening strategies (FIT, FIT-DNA, high-sensitivity gFOBT) that vary by age to begin, age to end, and screening interval. A separate graph is provided for each of the three models (SimCRC, MISCAN, CRC-SPIN). Each screening strategy is represented by a point. Points that are higher on the graph provide more life-years and points further to the right require more colonoscopies. The strategies that comprise the outer envelope of the points are the subset of efficient strategies, and the line that connects these strategies is called the efficient frontier. The strategies on the efficient frontier are those for which no other strategy or combination of strategies provide more life-years for fewer colonoscopies. One efficient frontier is shown, the frontier considering strategies with age to begin screening of 50 or 55.

Return to Table of Contents

and the Recommendable Strategies by Model When the Colonoscopy Strategy With a 10-Year Interval Is the Benchmark Strategya

Model Outcomes per 1000 40-Year-Olds Efficiency
Ratiob
Efficiency
Ratio
<Benchmark
LYG
≥90% of
Benchmark
Model-
Recommendable
Strategy
Modality, Age to Begin-Age to End, y, Interval, y Stool
Tests
SIGs CTCs COLs LYG Complications CRC
Deaths
Averted
SimCRC
   Colonoscopy
COL 50-75, 10 0 0 0 4007 275 14 24 55 Benchmark strategy   Yes
   Stool test
     FIT 50-75, 3 6887 0 0 971 212 6 18 5 Yes No  
     FIT 50-75, 2 9326 0 0 1215 234 7 20 12 Yes No  
     HSgFOBT          50-75, 3 6456 0 0 1286 212 7 18 DominatedS ND No  
     FIT-DNA 50-75, 5 4391 0 0 1364 224 8 20 DominatedS ND No  
     HSgFOBT 50-75, 2 8388 0 0 1597 235 9 20 DominatedS ND No  
     FIT-DNA 50-75, 3 5990 0 0 1701 250 9 22 DominatedW ND Yes  
     FIT 50-75, 1 15,778 0 0 1739 260 10 23 24c Yes Yes Yes
     HSgFOBT 50-75, 1 12,914 0 0 2230 261 11 23 DominatedS ND Yes  
     FIT-DNA 50-75, 1 11,041 0 0 2601 271 12 24 155c No Yes  
   Sigmoidoscopy
     SIG 50-75, 10 0 2480 0 1345 200 8 18 3 Yes No  
     SIG 50-75, 5 0 4111 0 1820 227 10 21 18 Yes No  
   Sigmoidoscopy + stool testd
     SIG+FIT 50-75, 10_2 7942 2196 0 1917 262 10 23 6 Yese Yese  
     SIG+FIT 50-75, 5_3 5367 3700 0 2127 263 11 23 DominatedS ND Yes  
     SIG+HSgFOBT 50-75, 10_2 7212 2042 0 2190 262 11 23 DominatedS ND Yes  
     SIG+FIT 50-75, 5_2 7296 3559 0 2224 267 11 24 DominatedS ND Yes  
     SIG+FIT 50-75, 10_1 13,393 2097 0 2248 270 11 24 54c Yes Yes Yes
     SIG+HSgFOBT 50-75, 5_3 5099 3425 0 2294 263 12 23 DominatedS ND Yes  
     SIG+HSgFOBT 50-75, 5_2 6689 3211 0 2431 267 12 24 DominatedS ND Yes  
     SIG+HSgFOBT 50-75, 10_1 11,100 1926 0 2616 271 12 24 DominatedS ND Yes  
   CT colonography
     CTC 50-75, 10 0 0 2458 1460 239 9 21 3 Yes No  
     CTC 50-75, 5 0 0 4069 1927 265 11 24 18 Yes Yes Yes
MISCAN
   Colonoscopy
     COL 50-75, 10 0 0 0 4101 248 15 22 39 Benchmark
strategy
  Yes
   Stool test
     FIT 50-75, 3 6795 0 0 995 176 7 15 7 Yes No  
     FIT 50-75, 2 9342 0 0 1243 200 8 17 12c Yes No  
     HSgFOBT 50-75, 3 6302 0 0 1296 175 8 15 DominatedS ND No  
     FIT-DNA 50-75, 5 4380 0 0 1402 193 9 17 DominatedS ND No  
     HSgFOBT 50-75, 2 8408 0 0 1636 200 9 18 DominatedS ND No  
     FIT-DNA 50-75, 3 5779 0 0 1714 215 9 19 DominatedS ND No  
     FIT 50-75, 1 15,843 0 0 1757 231 10 20 21c Yes Yes Yes
     HSgFOBT 50-75, 1 12,927 0 0 2287 232 11 20 DominatedS ND Yes  
     FIT-DNA 50-75, 1 11,025 0 0 2662 246 12 21 120c No Yes  
   Sigmoidoscopy
     SIG 50-75, 10 0 2356 0 1881 201 11 18 9 Yes No  
     SIG 50-75, 5 0 3807 0 2287 11 12 20 20 Yes No  
   Sigmoidoscopy + stool testd
     SIG+FIT 50-75, 10_2 7306 1886 0 2157 232 11 20 10 Yese Yese  
     SIG+HSgFOBT 50-75, 10_2 6594 1677 0 2374 231 12 20 DominatedS ND Yes  
     SIG+FIT 50-75, 5_3 4737 3380 0 2451 239 13 21 DominatedS ND Yes  
     SIG+FIT 50-75, 10_1 12,642 1903 0 2490 246 12 22 24 Yes Yes Yes
     SIG+FIT 50-75, 5_2 6523 3221 0 2501 241 13 21 DominatedS ND Yes  
     SIG+HSgFOBT 50-75, 5_3 4462 3146 0 2587 238 13 21 DominatedS ND Yes  
     SIG+HSgFOBT 50-75, 5_2 5947 2882 0 2667 240 13 21 DominatedS ND Yes  
     SIG+HSgFOBT 50-75, 10_1 10,562 1633 0 2814 245 13 21 DominatedS ND Yes  
  CT colonography
     CTC 50-75, 10 0 0 2485 1293 184 8 16 6 Yes No  
     CTC 50-75, 5 0 0 4171 1743 226 10 20 11 Yes Yes Yes
CRC-SPIN
   Colonoscopy
     COL 50-75, 10 0 0 0 4049 270 15 24 65 Benchmark strategy   Yes
   Stool test
     FIT 50-75, 3 6857 0 0 1081 178 7 16 7 Yes No  
     HSgFOBT 50-75, 3 6498 0 0 1317 183 8 16 DominatedS ND No  
     FIT 50-75, 2 9241 0 0 1346 207 9 18 9 Yes No  
     FIT-DNA 50-75, 5 4370 0 0 1473 195 9 18 DominatedS ND No  
     HSgFOBT 50-75, 2 8448 0 0 1626 212 9 19 DominatedS ND No  
     FIT-DNA 50-75, 3 5927 0 0 1827 226 10 20 DominatedS ND No  
     FIT 50-75, 1 15,444 0 0 1899 244 11 22 17 Yes Yes Yes
     HSgFOBT 50-75, 1 13,026 0 0 2253 247 11 22 DominatedS ND Yes  
     FIT-DNA 50-75, 1 10,745 0 0 2729 261 13 23 87c No Yes  
   Sigmoidoscopy
     SIG 50-75, 10 0 2515 0 1161 165 7 15 6 Yes No  
     SIG 50-75, 5 0 4298 0 1493 181 9 16 22 Yes No  
    Sigmoidoscopy + stool testd
     SIG+FIT 50-75, 10_2 8033 2192 0 1905 239 11 21 9 Yes No  
     SIG+FIT 50-75, 5_3 5559 3780 0 1984 235 11 21 DominatedS ND No  
     SIG+FIT 50-75, 5_2 7506 3611 0 2125 244 11 22 DominatedS ND Yes  
     SIG+HSgFOBT 50-75, 10_2 7386 2062 0 2125 241 11 21 DominatedS ND No  
     SIG+HSgFOBT 50-75, 5_3 5314 3531 0 2132 237 11 21 DominatedS ND No  
     SIG+FIT 50-75, 10_1 13,404 2079 0 2289 256 12 23 25 Yes Yes Yes
     SIG+HSgFOBT 50-75, 5_2 6949 3297 0 2305 246 12 22 DominatedS ND Yes  
     SIG+HSgFOBT 50-75, 10_1 11,376 1940 0 2581 258 12 23 DominatedS ND Yes  
   CT colonography
     CTC 50-75, 10 0 0 2500 1304 224 9 20 3 Yes No  
     CTC 50-75, 5 0 0 4254 1654 248 10 22 14 Yes Yes Yes

Abbreviations: COL, colonoscopy; CRC, colorectal cancer; CTC, computed tomographic colonography; FIT, fecal immunochemical test with a positivity cutoff of 100 ng of hemoglobin per mL of buffer (20 μg Hb/g of feces); FIT-DNA, multitarget stool DNA test (fecal immunochemical test with a DNA stool test); HSgFOBT, high-sensitivity guaiac-based fecal occult blood test; LYG, life-years gained compared with no screening; ND, indicates efficiency ratio is not defined because the strategy is not efficient or near-efficient; S, strategy is strongly dominated (ie, another screening strategy within the modality requires fewer colonoscopies and provides more LYG [eFigure 2 in the Supplement]); SIG, flexible sigmoidoscopy; W, strategy is weakly dominated (ie, another more burdensome strategy within the modality provides more LYG and has a lower efficiency ratio) and does not meet the criterion for near-efficiency.
a The final set of model-recommendable strategies are those recommendable by at least 2 of the 3 models: COL 10 y (benchmark strategy); FIT 1 y; SIG 10 y + FIT 1 y; and CTC 5 y. Within a class of screening modalities, strategies are ordered by the number of colonoscopies required.
Efficiency ratios (ΔCOL/ΔLYG) are from the within-class analysis of all strategies with age to begin screening of 50 or 55 years and age to end screening of 75, 80, or 85 years. See eTables 11–12 and 17–19 in the Supplement.
c Indicates the strategy is near-efficient (ie, it is weakly dominated and its LYG are within 98% of the within-class efficient frontier).
For SIG+FIT and SIG+HSgFOBT, the first interval is for SIG and the second interval is for the stool test.
e This strategy was not among the recommendable strategies with this model because an alternative within-class strategy also met the criteria for being a recommendable strategy and provided more LYG.

Return to Table of Contents