Impact of Patient Adherence and Test Performance on the Cost-Effectiveness of Cervical Cancer Screening in Developing Countries

The Case of Honduras
Published:November 30, 2009DOI:https://doi.org/10.1016/j.whi.2009.09.001

      Objective

      We examined the impact of patient adherence and screening test performance on the cost-effectiveness of visual inspection with acetic acid (VIA) and Pap smears when used with colposcopy for diagnosis.

      Materials and Methods

      Cost-effectiveness analysis was performed using computer modeling. The primary outcome was cancer prevalence in the 10 years after screening. Three hypothetical populations of 35-year-old women were compared: never-screened women, women screened with VIA, and women screened with Pap smears. We used community-based data from our screening program in Honduras to estimate screening test sensitivity and specificity, adherence to follow-up, and costs of screening and colposcopy services. Published data were used to model disease outcomes.

      Results

      VIA was more sensitive than Pap smears (70% vs. 4%), less expensive (U.S. $0.23 vs. $3.17), and the 2-vist VIA system had a higher rate of adherence to follow-up than the 3-visit Pap smear system (84% vs. 38%). VIA had a higher false-positive rate than Pap smears resulting in higher colposcopy referral rates, but more dysplasia was detected and treated. Cost-effectiveness analysis revealed that screening with VIA would cost U.S. $3,198 per cancer case avoided and reduce cancer cases by 42%, versus U.S. $36,802 and 2% for Pap screening. Although Pap smear quality was low in Honduras, sensitivity analysis showed that VIA was more cost-effective than Pap smears, even when test accuracy was equivalent.

      Conclusion

      In developing countries, systems barriers can limit the cost-effectiveness of Pap smears. VIA may be a cost-effective alternative for some resource-poor settings, although systems barriers, quality control, and feasibility issues must be considered.

      Introduction and Background

      Cervical cancer is the most common cancer among women in developing countries, with an estimated lifetime risk of 2%–4% (
      • Denny L.
      The prevention of cervical cancer in developing countries.
      ). Because health care resources are scarce; however, the cost-effectiveness of screening programs must be considered. Screening with Papanicolaou (Pap) smears, followed by colposcopy with biopsy for diagnosis and loop electrosurgical-excision procedure (LEEP) for treatment has become the standard of care for developed countries (
      • Wright Jr., T.C.
      • Massad L.S.
      • Dunton C.J.
      • Spitzer M.
      • Wilkinson E.J.
      • Solomon D.
      2006 consensus guidelines for the management of women with abnormal cervical cancer screening tests.
      ) owing to its effectiveness in reducing the population-wide incidence of invasive cervical cancer (
      • Laara E.
      • Day N.E.
      • Hakama M.
      Trends in mortality from cervical cancer in the Nordic countries: Association with organised screening programmes.
      ) and its overall cost-effectiveness in this setting (
      • Christopherson W.M.
      Lucy Wortham James Award. Cytologic detection and diagnosis of cancer. Its contributions and limitations.
      ). However, there is currently no consensus regarding medical standards for cervical cancer screening in developing countries. Many developing countries in Latin America have existing Pap smear, colposcopy, and pathology services, and physicians follow the standards of care set in developing countries (
      • Agurto I.
      • Sandoval J.
      • De La Rosa M.
      • Guardado M.E.
      Improving cervical cancer prevention in a developing country.
      ,
      • Lazcano-Ponce E.C.
      • Moss S.
      • Alonso de Ruiz P.
      • Salmeron Castro J.
      • Hernandez Avila M.
      Cervical cancer screening in developing countries: Why is it ineffective? The case of Mexico.
      ,
      • Robles S.C.
      • White F.
      • Peruga A.
      Trends in cervical cancer mortality in the Americas.
      ). Unfortunately, cervical cancer mortality has remained high in Latin America, despite significant health care expenditures, owing to poor quality services and limited population coverage (
      • Agurto I.
      • Sandoval J.
      • De La Rosa M.
      • Guardado M.E.
      Improving cervical cancer prevention in a developing country.
      ,
      • Lazcano-Ponce E.C.
      • Moss S.
      • Alonso de Ruiz P.
      • Salmeron Castro J.
      • Hernandez Avila M.
      Cervical cancer screening in developing countries: Why is it ineffective? The case of Mexico.
      ,
      • Robles S.C.
      • White F.
      • Peruga A.
      Trends in cervical cancer mortality in the Americas.
      ).
      Visual inspection with acetic acid (VIA) has been proposed as an alternative to Pap smear screening in developing countries. VIA involves washing the cervix with 3%–5% acetic acid and then looking for changes indicative of precancerous lesions. The attractive features of VIA include low cost, simple administration, immediate availability of results, and accuracy comparable to that of good quality Pap smears (
      • Denny L.
      • Kuhn L.
      • De Souza M.
      • Pollack A.E.
      • Dupree W.
      • Wright Jr., T.C.
      Screen-and-treat approaches for cervical cancer prevention in low-resource settings: A randomized controlled trial.
      ,
      • Megevand E.
      • Denny L.
      • Dehaeck K.
      • Soeters R.
      • Bloch B.
      Acetic acid visualization of the cervix: An alternative to cytologic screening.
      ,
      • Sankaranarayanan R.
      • Basu P.
      • Wesley R.S.
      • Mahe C.
      • Keita N.
      • Mbalawa C.C.
      • et al.
      Accuracy of visual screening for cervical neoplasia: Results from an IARC multicentre study in India and Africa.
      ,
      University of Zimbabwe/JHPIEGO Cervical Cancer Project
      Visual inspection with acetic acid for cervical-cancer screening: Test qualities in a primary-care setting.
      ). VIA is typically recommended as part of a “see-and-treat” algorithm. The “see-and-treat” approach involves screening women with VIA and treating those with abnormal examinations using cryotherapy ablation in the same visit. This is very inexpensive, maximizes adherence to follow-up therapy, and has been shown to be more cost-effective than screening with Pap smears in low resource settings (
      • Goldie S.J.
      • Gaffikin L.
      • Goldhaber-Fiebert J.D.
      • Gordillo-Tobar A.
      • Levin C.
      • Mahe C.
      • et al.
      Cost-effectiveness of cervical-cancer screening in five developing countries.
      ,
      • Goldie S.J.
      • Kuhn L.
      • Denny L.
      • Pollack A.
      • Wright T.C.
      Policy analysis of cervical cancer screening strategies in low-resource settings: Clinical benefits and cost-effectiveness.
      ,
      • Legood R.
      • Gray A.M.
      • Mahe C.
      • Wolstenholme J.
      • Jayant K.
      • Nene B.M.
      • et al.
      Screening for cervical cancer in India: How much will it cost? A trial based analysis of the cost per case detected.
      ).
      “See-and-treat” falls below the current standard of care in developed countries (
      • Wright Jr., T.C.
      • Massad L.S.
      • Dunton C.J.
      • Spitzer M.
      • Wilkinson E.J.
      • Solomon D.
      2006 consensus guidelines for the management of women with abnormal cervical cancer screening tests.
      ), however, because no pathologic diagnosis is obtained to ensure the adequacy of treatment. Physicians in developing countries who currently provide Pap smear, colposcopy, and LEEP services may be reluctant to adopt a “see-and-treat” system that falls below their standard of care, even if it is more cost effective (
      • Suba E.J.
      • Murphy S.K.
      • Donnelly A.D.
      • Furia L.M.
      • Huynh M.L.
      • Raab S.S.
      Systems analysis of real-world obstacles to successful cervical cancer prevention in developing countries.
      ). To maintain local standards of care, VIA can be used instead of Pap smears for initial screening, with colposcopy and LEEP performed to for diagnosis and treatment. VIA is a less expensive screening test than the Pap smear, but its false-positive rate is higher, resulting in more colposcopy referrals, which could limit cost savings. To date, no study has examined whether VIA is cost effective when used with colposcopy and LEEP services.
      Existing studies comparing the cost effectiveness of VIA and Pap smears primarily used data from large research projects (
      • Goldie S.J.
      • Gaffikin L.
      • Goldhaber-Fiebert J.D.
      • Gordillo-Tobar A.
      • Levin C.
      • Mahe C.
      • et al.
      Cost-effectiveness of cervical-cancer screening in five developing countries.
      ,
      • Goldie S.J.
      • Kuhn L.
      • Denny L.
      • Pollack A.
      • Wright T.C.
      Policy analysis of cervical cancer screening strategies in low-resource settings: Clinical benefits and cost-effectiveness.
      ,
      • Legood R.
      • Gray A.M.
      • Mahe C.
      • Wolstenholme J.
      • Jayant K.
      • Nene B.M.
      • et al.
      Screening for cervical cancer in India: How much will it cost? A trial based analysis of the cost per case detected.
      ) and incorporated good quality Pap smears in their models. During our community-based screening and treatment project in Honduras (
      • Perkins R.B.
      • Langrish S.M.
      • Stern L.J.
      • Figueroa J.
      • Simon C.J.
      Comparison of visual inspection and Papanicolaou (PAP) smears for cervical cancer screening in Honduras: should PAP smears be abandoned?.
      ), we found that factors including lack of communication infrastructure (telephone, postal services), routine supplies (spatulas, fixative, laboratory dyes), and up-to-date cytopathologist training and certification negatively impacted both Pap smear quality and patient adherence. The impact of these local factors may be important when comparing the cost effectiveness of Pap smear and VIA screening programs. The purpose of our study is two-fold: 1) to compare the cost effectiveness of VIA and Pap smears when colposcopy is used for diagnosis, and 2) to examine the impact of systems barriers such as screening test performance and adherence to follow-up on cost effectiveness.

      Methods

      Primary data collection: Cervical cancer screening project in Honduras

      Honduras is the second poorest country in the Western Hemisphere; two thirds of the population lives below the poverty line and half lacks basic sanitation and potable water. The average person receives 2–3 years of schooling, and 30% of the population is illiterate (

      Secretary of State of Honduras. (2004). Presidential report: Information by department and municipality (appendix 4; pp. 1–37). Honduran State Department, Tegucigalpa, Honduras.

      ). The cervical cancer incidence in Honduras is 39.1/100,000 and the mortality is 16.8/100,000 (
      • Arrossi S.
      • Sankaranarayanan R.
      • Parkin D.M.
      Incidence and mortality of cervical cancer in Latin America.
      ). These rates are over four times higher than in the United States and over 10 times higher than in Finland (
      • Aareleid T.
      • Pukkala E.
      • Thomson H.
      • Hakama M.
      Cervical cancer incidence and mortality trends in Finland and Estonia: A screened vs. an unscreened population.
      ,
      U.S. Department of Health And Human Services
      Healthy people 2010.
      ). Honduras has no nationwide cervical cancer screening program, but Pap smears are widely available through local health centers, private clinics, or special screening days organized by a variety of private organizations. VIA is available in a handful of clinics nationwide.
      The primary data for this cost effectiveness analysis were collected during our cervical cancer screening and treatment project which took place in Honduras between June 2003 and September 2004 (
      • Perkins R.B.
      • Langrish S.M.
      • Stern L.J.
      • Figueroa J.
      • Simon C.J.
      Comparison of visual inspection and Papanicolaou (PAP) smears for cervical cancer screening in Honduras: should PAP smears be abandoned?.
      ). During the project, we provided no-cost screening and treatment services to women in an underserved region of Honduras. We screened 1,370 women with Pap smears alone and an additional 339 women with both Pap smears and VIA. Women with abnormal results on either test underwent colposcopy with colposcopic-directed biopsy for diagnosis, and treatment with LEEP excision when appropriate. All pathologic specimens were processed, interpreted, and reported through the main government-associated laboratory in the capital city of Honduras. All Pap smears were taken by Honduran personnel and processed through local laboratories. All 339 Pap smears from the women who underwent Pap smear and VIA as well as 50 Pap smears from the group of 1,370 women who underwent Pap screening only were reviewed at an academic medical center in the United States to determine the quality of slide preparation and interpretation. Sensitivity and specificity calculations for Pap smear and VIA used data from the 339 women who underwent both tests. Diagnostic and treatment services were provided by a local cancer center that routinely provided outreach services in the area. The data collected during this project were used to estimate the prevalence of different precancerous lesions, to compare the accuracy of VIA and Pap smears for detecting cervical dysplasia, and to determine the costs of screening and treatment.

      Overview of cost-effectiveness model

      Standard methods of cost-effectiveness analysis were used, and a societal perspective was taken. Using commercially available cost-effectiveness software (TreeAge Pro 2006, Williamstown, MA), we simulated the natural history of human papilloma virus–induced cervical dysplasia and the procedures used in the screening, diagnosis, and treatment of precancerous lesions of the cervix. The model incorporated primary data from our cervical cancer screening program in Honduras as well as data from the literature (
      • Goldie S.J.
      • Gaffikin L.
      • Goldhaber-Fiebert J.D.
      • Gordillo-Tobar A.
      • Levin C.
      • Mahe C.
      • et al.
      Cost-effectiveness of cervical-cancer screening in five developing countries.
      ,
      • Melnikow J.
      • Nuovo J.
      • Willan A.R.
      • Chan B.K.
      • Howell L.P.
      Natural history of cervical squamous intraepithelial lesions: A meta-analysis.
      ,
      • Ostor A.G.
      Natural history of cervical intraepithelial neoplasia: a critical review.
      ). We assessed alternative strategies by determining the incremental cost-effectiveness ratio, defined as the additional cost of a strategy divided by its additional clinical benefit, as compared with the next-less-expensive strategy. The numerator (cost) represented the average expense of screening for and treating precancerous lesions in a population of 1,000 women. The denominator (effectiveness) represented the number of cancer cases avoided over 10 years. Base case values and ranges for sensitivity analyses are detailed in Table 1.
      Table 1Cost-Effectiveness Model Comparing VIA and Pap Smears: Parameters, Base Case Values, and Ranges for Sensitivity Analysis
      ParameterBase Case (Range)
      Prevalence of cervical dysplasia
       Healthy88.5% (75%–95%)
       Cervical intraepithelial neoplasia grade 110.2% (5%–11%)
       Cervical intraepithelial neoplasia grade 2 or 31.15% (1%–5%)
       Cancer0.115% (0.5%–2%)
      Progression to Cancer without treatment over 10 years
       Healthy0%
       Cervical intraepithelial neoplasia grade 12.4% (1–10%)
       Cervical intraepithelial neoplasia grade 2 or 318% (5–30%)
       Cancer100%
      Disease Recurrence after treatment with LEEP excision
       HealthyN/A
       Cervical intraepithelial neoplasia grade 110% (2%–30%)
       Cervical intraepithelial neoplasia grade 2 or 310% (2%–30%)
       CancerN/A
      Sensitivity and Specificity of Screening Measures
       No screening
        SensitivityN/A
        SpecificityN/A
       Pap smear
        Sensitivity4% (4%–100%)
        Specificity99% (80%–100%)
       VIA
        Sensitivity70% (60%–70%)
        Specificity96% (66%–96%)
      Adherence to recommendation for follow-up colposcopy
       Pap smear (3 visits required)38% (33%–100%)
       VIA (2 visits required)84% (33%–100%)
      Costs
       Pap smear60 L
      “L” represents Lempiras, the currency of Honduras.
      /$3.18 U.S. ($0.23–$3.18)
       VIA4.33 L/$0.23 U.S. ($0.23–$4.06)
       Colposcopy300 L/$15.88 U.S. ($5–$15.88)
       LEEP2000 L/$105.88 U.S. ($20–$105.88)
      “L” represents Lempiras, the currency of Honduras.

      Natural history of cervical disease

      Health states among subjects included: healthy (no cervical lesion), cervical intraepithelial neoplasia grades 1, 2, and 3, and invasive cancer. Based on the literature (
      • Goldie S.J.
      • Gaffikin L.
      • Goldhaber-Fiebert J.D.
      • Gordillo-Tobar A.
      • Levin C.
      • Mahe C.
      • et al.
      Cost-effectiveness of cervical-cancer screening in five developing countries.
      ,
      • Arrossi S.
      • Sankaranarayanan R.
      • Parkin D.M.
      Incidence and mortality of cervical cancer in Latin America.
      ) and our primary data, we estimated that 11.5% of the population had cervical disease at baseline. Among women with cervical disease, we estimated that 90% of lesions were cervical intraepithelial neoplasia grade 1, 10% were cervical intraepithelial neoplasia grades 2 or 3, and 1% were cancer.
      In our model, subjects progressed from cervical intraepithelial neoplasia grades 1, 2, and 3 to cancer at rates consistent with the published literature: 2.4% of women with cervical intraepithelial neoplasia grade 1 progressed to cancer over 10 years, and 18% of women with cervical intraepithelial neoplasia grades 2 and 3 progressed to cancer (
      • Melnikow J.
      • Nuovo J.
      • Willan A.R.
      • Chan B.K.
      • Howell L.P.
      Natural history of cervical squamous intraepithelial lesions: A meta-analysis.
      ,
      • Ostor A.G.
      Natural history of cervical intraepithelial neoplasia: a critical review.
      ). Treatment was assumed to be 90% effective in curing cervical intraepithelial neoplasia grades 1, 2, and 3 (
      • Nuovo J.
      • Melnikow J.
      • Willan A.R.
      • Chan B.K.
      Treatment outcomes for squamous intraepithelial lesions.
      ). Subjects who were healthy at the time of initial screening were assumed to remain cancer-free throughout the 10-year period (
      • Melnikow J.
      • Nuovo J.
      • Willan A.R.
      • Chan B.K.
      • Howell L.P.
      Natural history of cervical squamous intraepithelial lesions: A meta-analysis.
      ). Disease prevalence and rates of progression of precancerous lesions to invasive cancer were varied during sensitivity analysis. Because all costs of screening and treatment occurred within 1 year, discounting of costs was not required.

      Screening strategies and adherence to follow-up

      Screening strategies included no screening, screening with Pap smears, and screening with VIA. Each screening strategy was applied to a hypothetical population of 1,000 women. Women were screened once at age 35 and followed for 10 years for the development of cervical cancer. The Pap smear screening strategy included three visits: 1) for the initial Pap test, 2) to obtain results, and 3) for diagnosis via colposcopy and immediate treatment using LEEP when indicated. A separate clinic visit for the communication of results is necessary in Honduras and many other low-resource settings because telephone and postal services are rudimentary and face-to-face communication with a health care provider is the only reliable and confidential means of obtaining results. The VIA screening strategy included two visits: 1) for the initial VIA screen and communication of results, and 2) for colposcopy with immediate treatment using LEEP excision when indicated. A single-visit strategy with screening and colposcopy services provided in 1 day was not modeled because this is not currently available in Honduras. Nurses perform Pap smears and VIA at local health outposts, and colposcopy is performed by physicians either in hospital settings or on special outreach days when hospital staff travel to local clinics.
      The baseline rates of adherence to follow-up colposcopy were taken directly from our screening and treatment project. Eighty-four percent of women completed follow-up in the two-visit VIA protocol, compared with 38% in the three-visit Pap smear protocol. The decrease in compliance with additional visits is consistent with published literature (
      • Gaffikin L.
      • Blumenthal P.D.
      • Emerson M.
      • Limpaphayom K.
      Safety, acceptability, and feasibility of a single-visit approach to cervical-cancer prevention in rural Thailand: A demonstration project.
      ,
      University of Zimbabwe/JHPIEGO Cervical Cancer Project
      Visual inspection with acetic acid for cervical-cancer screening: Test qualities in a primary-care setting.
      ). Adherence rates were varied during sensitivity analysis.

      Test characteristics

      The sensitivity and specificity of VIA and Pap smears in Honduras were estimated based on data from our screening and treatment project and the literature (
      • Perkins R.B.
      • Langrish S.M.
      • Stern L.J.
      • Figueroa J.
      • Simon C.J.
      Comparison of visual inspection and Papanicolaou (PAP) smears for cervical cancer screening in Honduras: should PAP smears be abandoned?.
      ,
      • Goldie S.J.
      • Gaffikin L.
      • Goldhaber-Fiebert J.D.
      • Gordillo-Tobar A.
      • Levin C.
      • Mahe C.
      • et al.
      Cost-effectiveness of cervical-cancer screening in five developing countries.
      ). All Pap smears were processed through the central laboratories in the capital city of Honduras, which receive the majority of Pap smears taken throughout the country. Pap smear sensitivity was estimated at 4% and specificity at 100%, compared with a sensitivity of 70% and specificity of 96% for VIA.
      We found the Pap smears in Honduras to be of very low quality, and therefore significantly less accurate than VIA in this setting (
      • Perkins R.B.
      • Langrish S.M.
      • Stern L.J.
      • Figueroa J.
      • Simon C.J.
      Comparison of visual inspection and Papanicolaou (PAP) smears for cervical cancer screening in Honduras: should PAP smears be abandoned?.
      ). Pathologic review in the United States highlighted deficiencies in both slide preparation and interpretation. Many clinics lacked spatulas, cytobrushes, and fixative, and instead used tongue depressors, Q-tips, and hair spray. Specimens were often stored in warm, humid conditions for 1 or more weeks before transport to the central processing facility, resulting in fungal contamination. The central laboratory facilities lacked the resources to purchase new supplies on a regular basis, so dyes and stains were re-used and recycled to extend their use; this resulted in poor quality staining. At the time that this study was performed, Honduras had no cytopathologist training facilities. The 14 cytopathologists who were employed in Honduras at that time were trained in neighboring countries and did not have regular access to continuing education. We reviewed all 339 slides from the study group that underwent both Pap smear and VIA as well as 50 additional slides from the 1,370 women who underwent Pap smear only at an American teaching hospital. The pathologists commented on the poor quality of slide preparation and staining, but were also able to identify a number of abnormal Pap smears that had been read as negative for intraepithelial lesion or malignancy in Honduras.
      VIA was performed by a nurse practitioner working within the Honduran Ministry of Health clinic system who was trained in VIA before initiating the study protocol. The accuracy of VIA in our study (
      • Perkins R.B.
      • Langrish S.M.
      • Stern L.J.
      • Figueroa J.
      • Simon C.J.
      Comparison of visual inspection and Papanicolaou (PAP) smears for cervical cancer screening in Honduras: should PAP smears be abandoned?.
      ) was consistent with other published studies from Latin America (
      • Claeys P.
      • De Vuyst H.
      • Gonzalez C.
      • Garcia A.
      • Bello R.E.
      • Temmerman M.
      Performance of the acetic acid test when used in field conditions as a screening test for cervical cancer.
      ,
      • Jeronimo J.
      • Morales O.
      • Horna J.
      • Pariona J.
      • Manrique J.
      • Rubinos J.
      • et al.
      Visual inspection with acetic acid for cervical cancer screening outside of low-resource settings.
      ).

      Cost data

      Costs are presented in both Honduran Lempiras and in U.S. dollars (April 2008 exchange rate) Pap smear costs used in our model included the cost of the nurse visit to collect specimen, disposable supplies (spatula, slide fixative), specimen transport, and specimen processing and analysis. These costs were incorporated into a single global Pap smear fee (US$3.17). VIA costs included the costs of the nurse visit and disposable supplies (acetic acid, cotton swabs), which were also included as a single global VIA fee (US$0.23). The cost of colposcopy (US$15.88) included physician's time, supplies, and the cost for processing one biopsy specimen (We included the cost of processing one specimen because this was the median number of biopsies per colposcopy in our project). The cost of LEEP (US$105.88) includes the physician's time, supplies, and pathology costs. The costs associated with clinic visits, including nurses' time, Pap smear, and VIA supplies were obtained from the Ministry of Health clinic staff with whom we worked. Costs of colposcopy, biopsy, and LEEP services were obtained from the private referral hospital that performed these procedures and the pathology laboratory that processed the specimens during our screening and treatment project. Because cost-effectiveness analysis focuses on cost differences, expenses that were common to both screening tests (private examination areas, speculums [including costs of sterilization], and light sources) were excluded from the final analysis. The costs of both screening and treatment services were varied during sensitivity analysis.

      Results

      Screening with VIA reduced the 10-year cancer rate by 42%, from 5.7 to 3.3 per 1,000. The cost to avoid one cancer case was U.S. $3,198. Screening with Pap smears reduced the cancer rate by only 2%, from 5.7 to 5.6 per 1,000. The cost to avoid one cancer case was U.S. $36,802. Thus, VIA screening was more cost-effective than Pap smear screening by an order of magnitude. Population-wide screening with VIA was more costly than screening with Pap smears because more women received treatment. However, the cost per cancer case avoided was far lower because VIA was much more successful at detecting precancerous lesions (extended dominance; Figure 1).
      Figure thumbnail gr1
      Figure 1Cost-effectiveness analysis of VIA and Pap smears. The cost effectiveness of no screening, screening with Pap smears (three visits), and screening with VIA (two visits). Effectiveness is measured as the percentage of cancer cases avoided in the 10 years after screening. Costs are represented in U.S. dollars. VIA demonstrated extended dominance over the Pap smear.

      Sensitivity analysis

      One-way sensitivity analysis did not change results. The following parameters were varied (see ranges in Table 1): baseline cervical dysplasia rate, relative proportions of cervical intraepithelial neoplasia grades 1, 2, and 3 and cancer among the abnormal results, proportions of women with cervical intraepithelial neoplasia 1, 2, and 3 progressing to cancer, recurrence of disease after LEEP excision, sensitivity and specificity of VIA and Pap smears, adherence to follow-up colposcopy after VIA and Pap smears, and the costs of VIA, Pap smears, colposcopy, and LEEP.
      Two-way sensitivity analysis was undertaken to determine the effects of simultaneously changing the cost, adherence to follow-up, and sensitivity of the Pap smear. The Pap smear cost varied from U.S. $0.23 to 3.17, Pap smear sensitivity and specificity varied from 4% to 100%, and adherence to follow-up varied from 33% to 100%. VIA remained more cost effective than Pap smears even when the cost of the Pap smear was reduced to that of VIA and the adherence to follow-up was increased to 100%. This is due to the low sensitivity of the test. Even when the Pap smear was made into a “perfect” test (both sensitivity and specificity of 100%) and the cost was decreased to that of VIA, VIA still remained superior to the Pap smear owing to low adherence to follow-up.

      Discussion

      This study demonstrates the impact of systems barriers on the cost effectiveness of cervical cancer screening methods. Although Pap smears are considered the standard of care for cervical cancer screening in countries with adequate resources (

      World Health Organization. (2009). Comprehensive cervical cancer control, a guide to essential practice. Available: http://www.who.int/reproductive-health/publications/cervical_cancer_gep/text.pdf. Accessed July 28, 2006.

      ), the use of Pap smears in Latin America over the past several decades has failed to lower cervical cancer rates (
      • Agurto I.
      • Sandoval J.
      • De La Rosa M.
      • Guardado M.E.
      Improving cervical cancer prevention in a developing country.
      ,
      • Lazcano-Ponce E.C.
      • Moss S.
      • Alonso de Ruiz P.
      • Salmeron Castro J.
      • Hernandez Avila M.
      Cervical cancer screening in developing countries: Why is it ineffective? The case of Mexico.
      ;
      • Robles S.C.
      • White F.
      • Peruga A.
      Trends in cervical cancer mortality in the Americas.
      ). In our model, VIA was more cost effective than Pap smears, even when combined with expensive diagnostic and treatment options such as colposcopy and LEEP. The key advantages of VIA were its high sensitivity (70% vs. 4%), low cost per woman screened (U.S. $0.23 vs. $3.17) and high rate of adherence to follow-up (84% vs. 38%). We found the Pap smears in Honduras to be of extremely low quality (
      • Perkins R.B.
      • Langrish S.M.
      • Stern L.J.
      • Figueroa J.
      • Simon C.J.
      Comparison of visual inspection and Papanicolaou (PAP) smears for cervical cancer screening in Honduras: should PAP smears be abandoned?.
      ), so VIA performed well in comparison. However, VIA was more cost effective even when good quality Pap smears were modeled owing to other systems barriers, including relatively high cost and low adherence to follow-up.
      Systems factors are largely responsible for the failure of Pap smears in the developing world, and systems factors relevant to VIA must be considered when determining whether screening programs using VIA could be viable alternatives. The accuracy of VIA has primarily been tested in large, well-designed research studies (
      • Megevand E.
      • Denny L.
      • Dehaeck K.
      • Soeters R.
      • Bloch B.
      Acetic acid visualization of the cervix: An alternative to cytologic screening.
      ,
      University of Zimbabwe/JHPIEGO Cervical Cancer Project
      Visual inspection with acetic acid for cervical-cancer screening: Test qualities in a primary-care setting.
      ), the results of which may be difficult to replicate in community settings. In fact, some experts fear that the quality of visual screening methods will be more difficult to control than the quality of Pap smears (
      • Wright Jr., T.C.
      Cervical cancer screening using visualization techniques. Review.
      ). Because VIA is based entirely on the provider's visual impression of the cervix, VIA programs must have systems in place to ensure screening quality (
      • Jeronimo J.
      • Morales O.
      • Horna J.
      • Pariona J.
      • Manrique J.
      • Rubinos J.
      • et al.
      Visual inspection with acetic acid for cervical cancer screening outside of low-resource settings.
      ,

      World Health Organization. (2009). Comprehensive cervical cancer control, a guide to essential practice. Available: http://www.who.int/reproductive-health/publications/cervical_cancer_gep/text.pdf. Accessed July 28, 2006.

      ). VIA training should be limited to practitioners who see an adequate volume of screen-eligible patients, practitioners should be formally certified through programs with both didactic and clinical proficiency requirements; regular, ongoing training should occur. Didactic materials and training programs are available through international agencies (

      International Agency for Research on Cancer. (2009). [homepage on the Internet]. Available: http://www.iarc.fr/en/about/index.php. Accessed July 28.

      ,

      JHPIEGO. (2009). Regional single visit approach using VIA and cryotherapy clinical training course. Available: http://www.jhpiego.org/media/featarticles/ft20081218.htm. Accessed July 28, 2009.

      ). Pap smears will still be required in postmenopausal women, for whom VIA is inappropriate (

      World Health Organization. (2009). Comprehensive cervical cancer control, a guide to essential practice. Available: http://www.who.int/reproductive-health/publications/cervical_cancer_gep/text.pdf. Accessed July 28, 2006.

      ). Other innovations not currently being used in Honduras, such as two-visit Pap smear protocols rather than the current three-visit protocols, could also be developed and tested.
      If colposcopy is to be used for the triage of positive VIA results, one must also consider the potential for overwhelming existing colposcopy resources owing to the higher false-positive rate of VIA when compared with Pap smears (
      • Perkins R.B.
      • Langrish S.M.
      • Stern L.J.
      • Figueroa J.
      • Simon C.J.
      Comparison of visual inspection and Papanicolaou (PAP) smears for cervical cancer screening in Honduras: should PAP smears be abandoned?.
      ,
      University of Zimbabwe/JHPIEGO Cervical Cancer Project
      Visual inspection with acetic acid for cervical-cancer screening: Test qualities in a primary-care setting.
      ). Although options exist for overcoming this systems barrier, each has limitations. The least expensive option is to combine VIA with immediate cryotherapy, the traditional “see-and-treat” model. Although this system compares favorably with Pap smears in terms of cost and efficacy (
      • Goldie S.J.
      • Gaffikin L.
      • Goldhaber-Fiebert J.D.
      • Gordillo-Tobar A.
      • Levin C.
      • Mahe C.
      • et al.
      Cost-effectiveness of cervical-cancer screening in five developing countries.
      ,
      • Legood R.
      • Gray A.M.
      • Mahe C.
      • Wolstenholme J.
      • Jayant K.
      • Nene B.M.
      • et al.
      Screening for cervical cancer in India: How much will it cost? A trial based analysis of the cost per case detected.
      ,
      • Mandelblatt J.S.
      • Lawrence W.F.
      • Gaffikin L.
      • Limpahayom K.K.
      • Lumbiganon P.
      • Warakamin S.
      • et al.
      Costs and benefits of different strategies to screen for cervical cancer in less-developed countries.
      ), no pathologic diagnosis is obtained to assess the adequacy of treatment, and providers may not accept what they view as a reduced level of care (
      • Suba E.J.
      • Murphy S.K.
      • Donnelly A.D.
      • Furia L.M.
      • Huynh M.L.
      • Raab S.S.
      Systems analysis of real-world obstacles to successful cervical cancer prevention in developing countries.
      ). Another option would be to limit the number of women screened each year to avoid overburdening existing colposcopy systems. For example, 10% of the highest risk female population (ages 35–45) could be screened annually with the goal of screening the entire population each decade. Although each woman would undergo fewer examinations, overall mortality should still be reduced; one lifetime screening with VIA is estimated to reduce the population-wide cervical cancer incidence by one third and two screenings by up to 70% (
      • Goldie S.J.
      • Gaffikin L.
      • Goldhaber-Fiebert J.D.
      • Gordillo-Tobar A.
      • Levin C.
      • Mahe C.
      • et al.
      Cost-effectiveness of cervical-cancer screening in five developing countries.
      ). An important challenge would be ensuring the equitable distribution of limited screening resources. A third option would be a see–biopsy–treat model, in which the midlevel provider performing VIA biopsies suspicious lesions at the time of the VIA exam (visit 1), and then performs cryotherapy if necessary based on biopsy results (visit 2). This algorithm would reduce costs by eliminating the need for physicians and colposcopic equipment, comply with health care standards by providing pathologic confirmation of the diagnosis, and improve practitioners' VIA skills through ongoing comparison of their visual impressions with pathologic diagnoses. The disadvantages of this system include the need for additional training of midlevel providers in taking cervical biopsies, the increased cost of the additional equipment (reusable biopsy forceps, Monsel's solution, and jars of formalin), and the potential to overwhelm existing pathology services with large numbers of biopsies.
      These obstacles are substantial, but the alternative is the status quo: a screening system that is expensive in itself yet fails to lower the cervical cancer rate (
      • Agurto I.
      • Sandoval J.
      • De La Rosa M.
      • Guardado M.E.
      Improving cervical cancer prevention in a developing country.
      ,
      • Lazcano-Ponce E.C.
      • Moss S.
      • Alonso de Ruiz P.
      • Salmeron Castro J.
      • Hernandez Avila M.
      Cervical cancer screening in developing countries: Why is it ineffective? The case of Mexico.
      • Robles S.C.
      • White F.
      • Peruga A.
      Trends in cervical cancer mortality in the Americas.
      ). VIA requires a substantial investment in provider training and ongoing education, but it has the advantages of requiring fewer disposable resources and providing immediate results. Although systems barriers must be considered before implementing a VIA system, VIA may be a potentially cost- and life-saving alternative to Pap smears in some resource-poor settings.
      Cost-effectiveness analysis is subject to a number of limitations. Data must be combined from various sources with different study designs, and values that cannot be calculated directly must be estimated. During our project, colposcopy was not offered to women with negative screening tests. Therefore, we extrapolated the results of relevant studies to estimate the baseline rate of cervical dysplasia and the sensitivity of VIA (
      • Arrossi S.
      • Sankaranarayanan R.
      • Parkin D.M.
      Incidence and mortality of cervical cancer in Latin America.
      ,
      • Goldie S.J.
      • Gaffikin L.
      • Goldhaber-Fiebert J.D.
      • Gordillo-Tobar A.
      • Levin C.
      • Mahe C.
      • et al.
      Cost-effectiveness of cervical-cancer screening in five developing countries.
      ) and used primary data to calculate the sensitivity of Pap smears, the specificities of both methods, adherence to follow-up, and costs. The combination of primary and secondary data is a well-established technique in cost-effectiveness analysis (
      • Goldie S.J.
      • Gaffikin L.
      • Goldhaber-Fiebert J.D.
      • Gordillo-Tobar A.
      • Levin C.
      • Mahe C.
      • et al.
      Cost-effectiveness of cervical-cancer screening in five developing countries.
      ,
      • Goldie S.J.
      • Kuhn L.
      • Denny L.
      • Pollack A.
      • Wright T.C.
      Policy analysis of cervical cancer screening strategies in low-resource settings: Clinical benefits and cost-effectiveness.
      ).

      Conclusion

      In developing countries, systems barriers can limit the cost-effectiveness of Pap smears. VIA may be a cost-effective alternative for some resource-poor settings, although systems barriers, quality control and feasibility issues must be considered.

      References

        • Aareleid T.
        • Pukkala E.
        • Thomson H.
        • Hakama M.
        Cervical cancer incidence and mortality trends in Finland and Estonia: A screened vs. an unscreened population.
        European Journal of Cancer. 1993; 29A: 745-749
        • Agurto I.
        • Sandoval J.
        • De La Rosa M.
        • Guardado M.E.
        Improving cervical cancer prevention in a developing country.
        International Journal for Quality in Health Care. 2006; 18: 81-86
        • Arrossi S.
        • Sankaranarayanan R.
        • Parkin D.M.
        Incidence and mortality of cervical cancer in Latin America.
        Salud publica de Mexico. 2003; 45: S306-S314
        • Christopherson W.M.
        Lucy Wortham James Award. Cytologic detection and diagnosis of cancer. Its contributions and limitations.
        Cancer. 1983; 51: 1201-1208
        • Claeys P.
        • De Vuyst H.
        • Gonzalez C.
        • Garcia A.
        • Bello R.E.
        • Temmerman M.
        Performance of the acetic acid test when used in field conditions as a screening test for cervical cancer.
        Tropical Medicine and International Health. 2003; 8: 704-709
        • Denny L.
        The prevention of cervical cancer in developing countries.
        British Journal of Obstetrics and Gynaecology. 2005; 112: 1204-1212
        • Denny L.
        • Kuhn L.
        • De Souza M.
        • Pollack A.E.
        • Dupree W.
        • Wright Jr., T.C.
        Screen-and-treat approaches for cervical cancer prevention in low-resource settings: A randomized controlled trial.
        Journal of the American Medical Association. 2005; 294: 2173-2181
        • Gaffikin L.
        • Blumenthal P.D.
        • Emerson M.
        • Limpaphayom K.
        Safety, acceptability, and feasibility of a single-visit approach to cervical-cancer prevention in rural Thailand: A demonstration project.
        Lancet. 2003; 361: 814-820
        • Goldie S.J.
        • Gaffikin L.
        • Goldhaber-Fiebert J.D.
        • Gordillo-Tobar A.
        • Levin C.
        • Mahe C.
        • et al.
        Cost-effectiveness of cervical-cancer screening in five developing countries.
        New England Journal of Medicine. 2005; 353: 2158-2168
        • Goldie S.J.
        • Kuhn L.
        • Denny L.
        • Pollack A.
        • Wright T.C.
        Policy analysis of cervical cancer screening strategies in low-resource settings: Clinical benefits and cost-effectiveness.
        Journal of the American Medical Association. 2001; 285: 3107-3115
      1. International Agency for Research on Cancer. (2009). [homepage on the Internet]. Available: http://www.iarc.fr/en/about/index.php. Accessed July 28.

      2. JHPIEGO. (2009). Regional single visit approach using VIA and cryotherapy clinical training course. Available: http://www.jhpiego.org/media/featarticles/ft20081218.htm. Accessed July 28, 2009.

        • Jeronimo J.
        • Morales O.
        • Horna J.
        • Pariona J.
        • Manrique J.
        • Rubinos J.
        • et al.
        Visual inspection with acetic acid for cervical cancer screening outside of low-resource settings.
        Revista panamericana de salud publica. 2005; 17: 1-5
        • Laara E.
        • Day N.E.
        • Hakama M.
        Trends in mortality from cervical cancer in the Nordic countries: Association with organised screening programmes.
        Lancet. 1987; 1: 1247-1249
        • Lazcano-Ponce E.C.
        • Moss S.
        • Alonso de Ruiz P.
        • Salmeron Castro J.
        • Hernandez Avila M.
        Cervical cancer screening in developing countries: Why is it ineffective? The case of Mexico.
        Archives of Medical Research. 1999; 30: 240-250
        • Legood R.
        • Gray A.M.
        • Mahe C.
        • Wolstenholme J.
        • Jayant K.
        • Nene B.M.
        • et al.
        Screening for cervical cancer in India: How much will it cost? A trial based analysis of the cost per case detected.
        International Journal of Cancer. 2005; 117: 981-987
        • Mandelblatt J.S.
        • Lawrence W.F.
        • Gaffikin L.
        • Limpahayom K.K.
        • Lumbiganon P.
        • Warakamin S.
        • et al.
        Costs and benefits of different strategies to screen for cervical cancer in less-developed countries.
        Journal of the National Cancer Institute. 2002; 94: 1469-1483
        • Megevand E.
        • Denny L.
        • Dehaeck K.
        • Soeters R.
        • Bloch B.
        Acetic acid visualization of the cervix: An alternative to cytologic screening.
        Obstetrics and Gynecology. 1996; 88: 383-386
        • Melnikow J.
        • Nuovo J.
        • Willan A.R.
        • Chan B.K.
        • Howell L.P.
        Natural history of cervical squamous intraepithelial lesions: A meta-analysis.
        Obstetrics and Gynecology. 1998; 92: 727-735
        • Nuovo J.
        • Melnikow J.
        • Willan A.R.
        • Chan B.K.
        Treatment outcomes for squamous intraepithelial lesions.
        Internation Journal of Gynaecology and Obstetrics. 2000; 68: 25-33
        • Ostor A.G.
        Natural history of cervical intraepithelial neoplasia: a critical review.
        International Journal of Gynecologic Pathology. 1993; 12: 186-192
        • Perkins R.B.
        • Langrish S.M.
        • Stern L.J.
        • Figueroa J.
        • Simon C.J.
        Comparison of visual inspection and Papanicolaou (PAP) smears for cervical cancer screening in Honduras: should PAP smears be abandoned?.
        Tropical Medicine and International Health. 2007; 12: 1018-1025
        • Robles S.C.
        • White F.
        • Peruga A.
        Trends in cervical cancer mortality in the Americas.
        Bulletin of the Pan American Health Organ. 1996; 30: 290-301
        • Sankaranarayanan R.
        • Basu P.
        • Wesley R.S.
        • Mahe C.
        • Keita N.
        • Mbalawa C.C.
        • et al.
        Accuracy of visual screening for cervical neoplasia: Results from an IARC multicentre study in India and Africa.
        International Journal of Cancer. 2004; 110: 907-913
      3. Secretary of State of Honduras. (2004). Presidential report: Information by department and municipality (appendix 4; pp. 1–37). Honduran State Department, Tegucigalpa, Honduras.

        • Suba E.J.
        • Murphy S.K.
        • Donnelly A.D.
        • Furia L.M.
        • Huynh M.L.
        • Raab S.S.
        Systems analysis of real-world obstacles to successful cervical cancer prevention in developing countries.
        American Journal of Public Health. 2006; 96: 480-487
        • U.S. Department of Health And Human Services
        Healthy people 2010.
        (Available at) Author, Washington, DC2000
        • University of Zimbabwe/JHPIEGO Cervical Cancer Project
        Visual inspection with acetic acid for cervical-cancer screening: Test qualities in a primary-care setting.
        Lancet. 1999; 353: 869-873
      4. World Health Organization. (2009). Comprehensive cervical cancer control, a guide to essential practice. Available: http://www.who.int/reproductive-health/publications/cervical_cancer_gep/text.pdf. Accessed July 28, 2006.

        • Wright Jr., T.C.
        • Massad L.S.
        • Dunton C.J.
        • Spitzer M.
        • Wilkinson E.J.
        • Solomon D.
        2006 consensus guidelines for the management of women with abnormal cervical cancer screening tests.
        American Journal of Obstetrics and Gynecology. 2007; 197: 346-355
        • Wright Jr., T.C.
        Cervical cancer screening using visualization techniques. Review.
        Journal of the National Cancer Institute Monographs. 2003; 31: 66-71

      Biography

      R.B. Perkins is an Assistant Professor of Obstetrics and Gynecology at Boston University Medical Center. She is currently studying HPV vaccination in underserved populations in the United States and abroad.
      S.M. Langrish is a Nurse Practitioner specializing in women's health and cervical cancer prevention. She is currently working with Ministry of Health Clinics in rural Honduras.
      L.J. Stern was the director of PROMESA, a non-profit community health organization in rural Honduras through which our cervical cancer prevention program was run. She is currently a healthcare administrator in Boston, Massachusetts.
      J.F. Burgess is an Associate Professor of Health Policy and Management at the Boston University School of Public Health, where he currently directs the master's and doctoral programs in Health Services Research and the Health Economics Program.
      C.J. Simon is an Associate Professor of Health Policy and Management at the Boston University School of Public Health, where she formerly directed the Health Economics Program. She is currently a managing director at the Lewin Group.