- Research article
- Open Access
- Open Peer Review
Quality of screening with conventional Pap smear in Austria – a longitudinal evaluation
BMC Public Healthvolume 13, Article number: 998 (2013)
In recent decades, the incidence of cervical cancer and cervical cancer mortality in Austria has declined by varying degrees. The Pap smear is to be considered a causal factor for this decline.
This longitudinal analysis is based on a data set of Pap smear assessments collected by the Committee for Quality Assurance of the Austrian Society of Cytology. Data from 15 laboratories participating in a voluntary self-monitoring program was analyzed for the time span 2004–2008. The data was analyzed in terms of smear quality and assessment quality.
A rank-correlation-test for a monotonic trend analysis in the proportion of the three parameters Pap 0, “satisfactory, but limited/SBL”, and Pap IIID/IV for the timespan 2004 to 2008 was carried out.
For this study, we analyzed an average number of 730,000 smears per year over a five-year period. Specimens from all but two laboratories, i.e. < 2% of all smears, met the quality criterion for Pap 0 (Bethesda 2001 equivalent: Specimen processed and examined, but unsatisfactory for evaluation of epithelial abnormality), whilst only four laboratories, i.e. < 10% of all smears, reached the national requirement for smears classified as “satisfactory, but limited/SBL”.
When using the Pap IIID/IV ratio (LSIL: HSIL/AIS ratio) of 3:1 to 8:1 as a surrogate quality marker for the interpretation of smears, only five laboratories met this criterion during the survey period.
The trend analysis indicated only that an increasing number of samples per year is correlated with an increased proportion of Pap 0 and “satisfactory, but limited/SBL” smears.
Although participants get regular feedback about their results, no general improvements in smear taking or assessment were observed over the years, so mandatory quality management, including the possibility of sanctions, is suggested in order to reduce adverse health effects for women.
In recent decades, the incidence of cervical cancer in the industrialized world, as in Austria, has declined . From 1983 to 2009 the age-standardized incidence declined by 65%, from 19.2 to 6.6 per 100,000 women; in absolute numbers: from 954 to 394 women . During the same period, the specific mortality rate dropped by 54% (from 4.4 to 2.0 per 100,000 women; in absolute numbers: from 265 to 141 women). For women aged up to 75, the life-time prevalence of contracting the disease is 1.9%, and the risk of dying from it is 0.5% . Between 1980 and 2010 the cumulative likelihood for women aged 15 to 79 of developing cervical cancer dropped from 2.8% (1.3-2.6 [95% confidence interval]) to 1.0% (0.7-1.6 [95% confidence interval]) . Although a diagnosis of cervical cancer puts enormous strain on the women affected, cervical cancer from a public health perspective is actually not considered to be a major risk for the female population at large, not least because primary and secondary preventive measures are available.
The Austrian Federal Ministry of Health recommends, as a primary preventive measure, the vaccination of both girls and boys aged between 9 and 12 years against Human Papillomavirus/HPV . In most Austrian provinces, the costs for HPV vaccination are borne by the consumer, i.e. generally the parents. Therefore, the vaccination rate in Austria is only approximately 2–5%, although it varies from province to province. Experts agree that early detection measures will still be necessary even after individual HPV vaccination. For this purpose, smear tests according to Papanicolaou will remain an important tool. Although the effectiveness of conventional cytology for cancer screening has never been tested in randomized studies, the results of cohort studies are considered to be sufficient proof . Screening should discover dysplasia at an early stage and with the subsequent interventions morbidity and specific mortality rates will be reduced.
Austria has been providing Pap smear testing to women through opportunistic screening since the 1970s [6, 7]. Austrian medical societies recommend an annual smear test for all women from the age of 19, as part of their gynecological examination . The costs for these examinations are borne by the statutory health insurance as part of the “new prevention program” regardless of individual insurance coverage. The Pap smears are mainly taken by gynecologists in their offices. The taking and assessment of smears is mostly done using the “conventional” rather than the “liquid-based” method, because the latter is not covered by health insurance providers. HPV testing is funded by statutory health insurances only in certain specified cases, varying from province to province.
Since the introduction of cancer early detection programs and in particular since the European Commission Directive 2003/878/RG regarding screening, quality assuring measures have been widely discussed throughout Europe. The European Union drafted guidelines on quality assurance [9–11] for screening procedures which, according to the EU, provide demonstrable benefits. Members of the European Parliament signed a resolution that the “fight against cancer” should include program screening .
In Austria, the Guideline of the European Commission recommending program screening with centralized monitoring has so far not been implemented [10, 13]. Both the Austrian Society of Cytology and the Austrian Society of Gynecology and Obstetrics recommend tools for smear taking and assessment in accordance with the European Guidelines [14, 15]. However, a continuous systematic quality control is lacking . Only a small number of scientific articles have hitherto studied the quality of opportunistic screening in Austria. These publications identified failures in Pap smear taking as well as in the interpretation of the smears [16–18]. The results have led the statutory health insurance providers of some provinces to implement a number of measures in order to improve Pap smear taking [19, 20]. Furthermore, the Quality Assurance Committee of the Austrian Society of Cytology initiated a database for cytology results commencing in 1998. This initiative aims to improve screening quality . Evaluating the data sets allows a yearly benchmarking for the participating laboratories based on their data concerning Pap smear taking and interpretation. The guidelines of the Austrian Society of Cytology require that the laboratories give gynecologists regular quality feedback. Each gynecologist submitting more than 100 smears annually for testing should receive a report on the smears taken, comparing them with the anonymized list of all smear takers using the cytological laboratory. The reason for introducing this inclusion criterion of a minimum of 100 smears is to reduce statistical variability.
The database of the Austrian Society of Cytology provides the basis for our first longitudinal analysis of Austrian data. Evaluating the quality of Pap smear taking and interpretation is important in order to ensure that women receive reliable results regarding cervical lesions. In addition, evaluation of the present opportunistic screening provides baseline data for a program screening in the future. The longitudinal analysis also allows us to assess the quality trend over the years. Without improvements in quality including systematically collecting data the targeted reduction in cervix cancer morbidity and mortality can not be achieved.
The Quality Assurance Committee of the Austrian Society of Cytology has been gathering data on Pap smear taking and assessment since 1998. All cytological laboratories in Austria are invited to participate in the program. The participating cytological laboratories report their data on a voluntary basis. Although the number of participating laboratories increased in recent years, not all laboratories participate in this voluntary self-monitoring program. Currently 35 laboratories, i.e. approximately 80% of all Austrian laboratories, take part .
The anonymized data set allow the evaluation of Pap smear taking and interpretation over an extended period of time. For our analysis we chose a period of five years: 2004 to 2008. Data for this period existed for 15 (covering 0.73 million smears) of the 35 participating laboratories (in total 1.03 to 1.65 million smears). These 15 laboratories reported their results annually for at least four years in the chosen period. This study covers laboratories that appraised more than 10,000 screening tests each per year.
Pap classification and classification of smear quality was done in accordance with the national guidelines of the Austrian Society of Cytology (see the Additional file 1). Smear quality is given as i) satisfactory, ii) satisfactory, but limited/SBL, or iii) Pap 0 – unsatisfactory. All three categories are defined in detail by the Austrian Society of Cytology . Despite reduced smear quality, e.g. a lack of endocervical cells or a moderately reduced number of squamous cells, the second category leaves room for Pap classification. Although the Austrian quality categories are similar to the Bethesda 2001 classification, a one-to-one conversion to the Bethesda 2001 categories for smear adequacy is not possible.
As an indicator for the quality of smears, we selected the proportion of all specimens sent in and those assessed as i) Pap 0 (Bethesda 2001 best fitting equivalent: Specimen processed and examined, but unsatisfactory for evaluation of epithelial abnormality) or ii) “satisfactory, but limited/SBL”. This indicator is strongly dependent on the quality of smear taking and is therefore strongly dependent on the gynecologist taking the smear. On the other hand, the interpretation of the cytological features with the well-known intra- and interobserver variability is dependent on the cytologist, even though variability can be minimized by using detailed definitions of smear adequacy interpretation . The quality standard for the indicator as set by the Austrian Society of Cytology provides for a maximum of 2% Pap 0 classifications (Bethesda 2001 equivalent: Specimen processed and examined, but unsatisfactory for evaluation of epithelial abnormality) in relation to all smears taken . The national standard, also set by the Austrian Society of Cytology, requires that the category “satisfactory, but limited/SBL” should apply to less than 10% of all smears taken. Quality improvement was assumed to have taken place if the number of both classifications decreased over the survey period. The assumption being that if appropriate information is given, if smear takers and cytological appraisers communicate with each other, then improvement can take place.
In order to evaluate smear interpretation quality we chose a specific Pap IIID/IV ratio (LSIL : HSIL/AIS ratio) as quality indicator. It provides a simple surrogate parameter for morphologic interpretation, classifying dysplastic cells as either Pap IIID (LSIL) or Pap IV (HSIL/AIS). This indicator is strongly dependent on the interpretation of the cytomorphological features and on the age of the screened population. This ratio is higher for women under 25 years of age. Although age is a strong confounding factor with regard to this ratio, we assume that the age distribution of women, whose smears were taken, is rather similar across the participating laboratories. For this purpose we postulated a benchmark of 3:1 to 8:1, which corresponds to the anticipated natural distribution of low-grade to high-grade cervical intraepithelial neoplasm/CIN of 4:1 . About 20% of the CIN1 cases progress to CIN2/3, whilst 80% of all cytologically detected CINs ought to fall into group Pap IIID and 20% into group Pap IV [24–26]. In other words, a ratio of 3:1 implies that 75% of all cytologically detected CINs are classified as Pap IIID (LSIL), and a ratio of 8:1 implies that 89% are classified as Pap IIID (LSIL). A German study found Pap IIID (LSIL) in 1.05% of the smears and Pap IV (HSIL) in 0.135%, which corresponds to a ratio of 8,8:1 . The central point to realize is reducing the number of CIN2/3 in screened populations. In this light, a higher ratio seems less problematic. A ratio higher than 8:1 or lower than 3:1 could point to interpretation errors. A limitation of this ratio (Pap IIID/IV) (LSIL : HSIL/AIS) is that CIN2 is assignable to both the Pap IIID group (LSIL) and the Pap IV group (HSIL/AIS), depending on the amount of CIN2 cells found in relation to low-grade dysplastic cells.
We also carried out a rank-correlation-test in order to test for a monotonic trend in the proportion of the parameters Pap 0, “satisfactory, but limited/SBL”, and Pap IIID/IV for the timespan 2004 to 2008 . Spearman’s rank correlation was performed between these parameters and the year of evaluation, separately for each laboratory. A positive correlation indicates an increase in the proportion over the five years, whereas a negative coefficient indicates a decrease. In order to aggregate the findings of the 15 laboratories, summary statistics (minimum, maximum, median, and inter quartile-range) and a meta-analysis of the rank-correlation coefficients according to the random effect model were performed . In this meta-analysis, the mean correlation coefficient of the 15 laboratories and a test for homogeneity among the correlations were calculated. A statistically significant p-value in this homogeneity test indicates that the correlations obtained from the different laboratories differ in magnitude. Because the number of samples analyzed in the laboratories differed from laboratory to laboratory and from year to year, we also tested for a possible relation between the proportions of the parameters Pap 0, “satisfactory, but limited/SBL”, and Pap IIID/IV and the number of samples analyzed per year for the timespan 2004 to 2008. Spearman’s rank correlation was performed separately for each laboratory and then aggregated as described above. Finally, a partial correlation between the proportions of the parameters Pap 0, “satisfactory, but limited/SBL”, and Pap IIID/IV and the year of evaluation, was carried out in order to test for a monotonic trend from 2004 to 2008 while controlling for the number of samples.
In Austria, with an overall population of 8.4 million, the potential target population (women over 20 years of age) is 3.48 million . In the period from 2004 to 2008 gynecologists took an estimated average of 2 to 2.2 million Pap smears per year (personal information from the Main Association of Austrian Social Security Institutions). These Austrian figures are, however, not precise because a large number of smears are taken in private gynecologists’ offices and are thus not counted by the statutory health insurance. Overall, the 15 selected laboratories included in this analysis appraised a total of 730,000 Pap smears on average per year (Table 1), representing approximately one third of all Pap smears taken in Austria.
The number of specimens entered per laboratory ranges from somewhat more than 10,000 to almost 200,000 per year. Certain individual laboratories had large changes in the number of smears submitted over the 5-year period, although half of the laboratories had stable numbers (Table 1).
Table 2 presents the percentage of all Pap smears sent to the laboratory and assessed as Pap 0 (“Specimen processed and examined, but unsatisfactory for evaluation of epithelial abnormality”). All in all, only two out of 15 laboratories failed to meet the quality standards . Unlike the Bethesda classification, the Austrian Pap classification entails remarks on minor quality deficiencies in an own smear quality category as “satisfactory, but limited” (SBL). Smears assessed as SBL still allow Pap classification. However, a false negative result is more likely in such case, compared to smears assessed as “satisfactory” [30–32]. When considering the proportion of specimens that were classified as SBL a different picture emerges (Table 3). Only four out of 15 laboratories were actually below the required 10% limit concerning their annual results across all smears submitted by gynecologists in the survey period. When considering only those laboratories that supplied data throughout the entire survey period, only one (out of six) complied with the national standard. Over the whole period, two of the laboratories had even more than 30% of their smears classified as SBL. The results of the trend analysis for the period 2004 to 2008 showed that no conclusion can be reached about a positive or negative trend in relation to lower or higher proportions of Pap 0 and SBL categories. This is due to the heterogeneity of laboratory sample sizes and the proportion of Pap 0 and SBL. Nonetheless, we assumed that the recommended feedback of cytologists to gynecologists regarding a possible modification of their smear taking practice has no influence on quality improvement.
Table 4 presents the Pap IIID/IV ratios (LSIL : HSIL/AIS ratios) of the specimens sent in to the laboratories. The surrogate interpretation quality indicator, the Pap IIID/IV ratio (LSIL: HSIL/AIS ratio) was achieved by five laboratories. For every given Pap IV (HSIL/AIS), more than twice the number of Pap IIID (LSIL) was found.
The summary statistics and the test for homogeneity of the correlations show, in most cases, a great variation in trend between the 15 laboratories (Additional file 1). The averaged correlation between the proportion of all the three parameters of interest and the year of observation was rather low (Spearman’s rho ranged from 0.12 to 0.35). There was also little change in magnitude of the correlation after controlling for the number of samples. The highest averaged correlations were found between the proportion of the parameter and the number of samples analyzed per year for Pap 0 (rho = 0.56) and for the “satisfactory, but limited/SBL” (rho = 0.48), indicating that the proportion of Pap 0 and of the “satisfactory, but limited/SBL” rose as the number of samples analyzed per year increased. However, a statistically significant deviation from homogeneity was found for both parameters, indicating a substantial variation between the laboratories.
The purpose of this analysis was to assess the quality of opportunistic screening by evaluating a nationwide data set. In Austria, only a small number of studies on the quality of opportunistic Pap screening have been conducted so far [16–18]. Our study shows again that failures in Pap smear taking and interpretation of smears exist. We therefore emphasize the relevance of regular feedback and systematic data collection, monitoring and evaluation to improve the quality of Pap screening. Without regular, systematic and mandatory quality checks adverse effects of screening on women cannot be assessed. Reducing further cervical cancer morbidity and mortality will be impossible.
The validity of this study is limited by the fact that not all Austrian laboratories participate in this voluntary self-monitoring program initiated and implemented by the Austrian Society of Cytology. Another limiting factor for the validity of this paper is that only 15 out of the 35 participating laboratories regularly reported data in the study period, meaning they provided data for at least four annual reports and were thus included in this evaluation. This low level of participation and reporting can be partly explained by the fact that reporting requires specific resources and IT support in the laboratories.
Even when accounting for these limitations, the high proportion of Pap smears assessed as “satisfactory, but limited/SBL” is particularly alarming. Heterogeneity of sample sizes across the laboratories and proportions of Pap 0 and SBL categories during the study period limited the conclusiveness of the study performed. Trend analysis only showed that laboratories carrying out a higher number of smear tests had higher proportions of Pap 0 and SBL smears, meaning a larger number of gynecologists failed to meet the quality requirements.
Since the data set is based on voluntary reporting, the actual number of failures may even be higher than shown in this evaluation. These deficiencies need to be corrected as soon as possible. Decision-makers are advised in the strongest possible terms to take action. In order to assess and eventually eliminate existing quality deficiencies, mandatory reporting seems to be an absolute necessity. Statutory health insurance providers should by any means ensure that their contractual partners (gynecologists and laboratories) sign a binding agreement concerning their active involvement in such quality assurance measures. The best option to start with would be rolling out a tried and tested model quality assurance project in all Austrian provinces [19, 20]. Workshops on Pap smear quality and Pap smear taking practice performed in the past effectively lowered “satisfactory, but limited/SBL” rates over longer time periods .
Given that the surrogate ratio has limitations and that we have no information on the age of the women of whom the Pap smears have been taken, deficiencies in the interpretation of the Pap smear results are evident. Regarding the IIID/IV ratio (LSIL : HSIL/AIS ratio) under these premises, our results show shortcomings across the whole survey period. To enhance assessment quality, health professionals should be given advanced training. An additional option would be to establish mandatory external audits for all cytological laboratories evaluating smear tests. Their participation in monitoring processes should be remunerated accordingly.
Reimbursing only those services that meet the quality standards and enhancing continuous and continuing education of the service providers will not suffice to ensure that the European Guidelines are met. These guidelines recommend program screening which includes the definition of a target population, a standardized approach to smear taking and subsequent diagnostic procedures, quality standards for the interpretation of smears and monitoring of the entire screening process, e.g. data collection and analysis. Competing interests of stakeholders in the field impede the establishing of a standardized program for cervical cancer screening. Given the failures in the present opportunistic screening, there is an urgent need for action in order to rapidly improve Pap smear taking in the short term. The longitudinal evaluation shows that feedback from cytologists to gynecologists regarding smear taking quality and benchmarking of gynecologists’ smear results on a voluntary basis have not led to changes in professional behavior. The voluntary self-monitoring program in Austria has proven to be insufficient when it comes to improving quality. There have been no appreciable improvements in any of the measures over the time period studied and at any individual laboratory. Therefore, monitoring should take place on a mandatory basis. This seems to be crucial since due to the low uptake of a population-wide HPV vaccination Austria currently has no cohorts of lower-risk young women.
In conclusion and despite the limitations of this study, we found strong indications concerning the shortcomings of conventional Pap screening in Austria, in Pap smear taking, assessment, and in gathering relevant data. It was beyond the scope of this study to assess how many women have been harmed by these failures. The real extent of the deficiencies will only become visible upon introducing mandatory participation for all laboratories and gynecologists. Sanctions for non-compliant laboratories and gynecologists are necessary to enforce their adhesion to the quality assurance process. In particular health insurance providers and the Federal Ministry of Health are called upon, for example to develop quality indicators and implement effective controlling. It is essential that the Austrian Federal Minister of Health decree a legally binding federal quality guideline as the most effective means of addressing the concerns raised in this study. This standard should also cover the potential for a future change in cervical screening test from cytology to a primary HPV test [33–35]. A further delay in taking action is harming women with overdiagnosis and overtreatment, or by detecting cervical cancer at a late stage.
No voting required, secondary analysis of anonymized data.
Zielonke N: Krebsinzidenz und Krebsmortalität in Österreich. 2010, Vienna: Statistics Austria, 65-67.
Statistics Austria: Krebserkrankungen. 2012, Vienna: Statistics Austria, http://www.statistik.at/web_de/statistiken/gesundheit/krebserkrankungen/gebaermutterhals/index.html; accessed 28th October 2013
Forouzanfar MH, Foreman KJ, Delossantos AM, Lozano R, Lopez AD, Murray CJ, Naghavi M: Breast and cervical cancer in 187 countries between 1980 and 2010: a systematic analysis. Lancet. 2011, 378: 1461-1484. 10.1016/S0140-6736(11)61351-2.
BMG / Federal Ministry of Health: Österreichischer Impfplan. 2013, Vienna: BMG, http://bmg.gv.at/cms/home/attachments/3/3/6/CH1100/CMS1327680589121/impfplan2013.pdf; accessed 3th July 2013
USPSTF / US Preventive Services Task Force: Guide to clinical preventive services. 1996, Washington DC: US Department of Health and Human Services
Breitenecker G, Wiener H, Stani J: Cervical cancer screening in Austria. Eur J Cancer. 2000, 36: 2189-2190. 10.1016/S0959-8049(00)00322-1.
Wiener HG, Rásky É, Horvat R: Description of the national situation of cervical cancer – Austria. Eur J Cancer. 2009, 45: 2686-
Breitenecker G, Dinges HP, Regitnig P, Wiener H, Vutuc C: Cytopathology in Austria. Cytopathology. 2004, 15: 113-118. 10.1111/j.1365-2303.2004.00125.x.
European Commission / EC: European guidelines for quality assurance in mammography screening. 2006, Luxembourg: EC
European Commission / EC: European guidelines for quality assurance in cervical screening. 2008, Luxembourg: EC
European Commission / EC: European guidelines for quality assurance in colorectal cancer screening and diagnosis. 2011, Luxembourg: EC
European Parliament: Resolution of 10 April 2008 on combating cancer in the enlarged European Union, P6_TA(2008)0121. 2008, Brussels: EU, http://www.europarl.europa.eu/sides/getDoc.do?type=TA&reference=P6-TA-2008-0121&format=XML&language=EN; accessed 28th October 2013, April on combating cancer in the enlarged European Union, P6_TA(2008)0121
European Commission / EC: Cancer screening in the European Union. Report on the implementation of the Council Recommendation on cancer screening. 2008, Luxembourg: EC
Breitenecker G, Dinges HP, Regitnig P: Zervixzytologische Nomenklatur und Befundwiedergabe – Neue Leitlinie der Österreichischen Gesellschaft für Zytologie. Gyn-aktiv. 2006, 4: 36-37. http://www.cytology.at/pdf/Leitlinien_Nomenklatur.pdf; accessed 16th Oct 2013
Regitnig P, Breitenecker G, Dinges HP, et al: Leitlinie zur Qualität in der gynäkologischen Zytologie. ARGE Qualitätssicherung der Österreichischen Gesellschaft für Zytologie und Österreichische Gesellschaft für Pathologie. 2013, http://www.cytology.at/pdf/20130401_OEGZ_OEGP_Leitlinie_zur_Qualitaet_in_der_gynaekologischen_Zytologie_2013.pdf; accessed 3th July 2013
Dinges HP, Regitnig P, Ropp E, Fladerer H, Moinfar F, Breitenecker G: Früherkennung des Zervixkarzinoms: das Kärntner Qualitätssicherungsprogramm Ergebnisse der Nachkontrolle gynäkologisch-zytologischer Abstriche von Patientinnen mit invasiven Zervixkarzinomen. Frauenarzt. 2006, 47: 724-729.
Rásky É: Report “Qualitätsoffensive PAP-Abstrich”, by contract for the Association of Social Insurance Providers. 2007, Vienna: HSV
Regitnig P, Dinges HP, Ropp E, Fladerer H, Moinfar F, Breitenecker G: Reevaluation of cytological smears in patients with cervical cancer. Regional quality assurance program with the cooperation of the Austrian Society of Cytology, the Carinthian Medical Association and the Carinthian Ministry of Health. Pathologe. 2007, 28 (5): 339-345. 10.1007/s00292-007-0931-9.
Regitnig P, Wilfing C: WGKK Projekt zur PAP-Abstrich-Optimierung. 2008, Vienna: WGKK
Regitnig P, Nader A, Wiener H: Quality of conventional Pap smears. Quality assessment and motivation for improvement. Pathologe. 2012, 33 (4): 293-300. 10.1007/s00292-012-1574-z.
ÖGZ / Österreichische Gesellschaft für Zytologie: Jahresbericht. 2010
Reiner-Concin A: Der PAP-Abstrich. Österreichische Ärztezeitung. 2011, 7: 26-38.
Petry KU, Breugelmann JG, Bénard S, Lamure E, Littlewood KJ, Hillemanns P: Cost of screening and treatment of cervical dyscaryosis in Germany. Eur J Gynaecol Oncol. 2008, 29 (4): 345-349.
Siebert U, Sroczynski G, Hillemanns P, Engel J, Stabenow R, Stegmaier C, Voigt K, Gibis B, Hölzel D, Goldie SJ: The German Cervical Cancer Screening Model: development and validation of a decision-analytic model for cervical cancer screening in Germany. Eur J Public Health. 2006, 16 (2): 185-92.
Sroczynski G, Schnell-Inderst P, Mühlberger N, Lang K, Aidelsburger P, Wasem J, Mittendorf T, Engel J, Hillemanns P, Petry KU, Krämer A, Sibert U: Cost-effectiveness of primary HPV screening for cervical cancer in Germany – a desicion analysis. Eur J Cancer. 2011, 47: 1633-1646. 10.1016/j.ejca.2011.03.006.
Mühlhauser I, Filz M: Screening auf Zervixkarzinom. arznei-telegramm. 2008, 3: 1-38.
Bortz J, Lienert GA, Böhnke K: Verteilungsfreie Methoden in der Biostatistik. 1990, Berlin, Heidelberg: Springer Verlag
Hedges LV, Vevea JL: Fixed- and random-effects models in meta-analysis. Psychol Methods. 1998, 3: 486-504.
Statistics Austria: Bevölkerung nach Geschlecht. 2013, Vienna: Statistics Austria, http://www.statistik.at/web_de/statistiken/bevoelkerung/bevoelkerungsstruktur/bevoelkerung_nach_alter_geschlecht/index.html; accessed 3th July 2013
Wilkinson EJ: Pap smears and screening for cervical neoplasia. Clin Obstet Gynecol. 1990, 33: 817-825. 10.1097/00003081-199012000-00017.
Stenkvist B, Soderstrom J: Reasons for cervical cancer despite extensive screening. J Med Screen. 1996, 3: 204-207.
McCrory D, Matchar D, Bastian L, Datta S, Hasselblad V, Hickey J, Myers E, Nanda K: Evaluation of cervical cytology. Evid Rep Technol Assess (Summ). 1999, 5: 1-6.
Canfell K, Barnabas R, Patnick J, Beral V: The predicted effect of changes in cervical screening practice in the UK: results from a modeling study. Br J Cancer. 2004, 91 (3): 530-536. 10.1038/sj.bjc.6602002.
Creighton P, Lew JB, Clements M, Smith M, Howard K, Dyer S, Lord S, Canfell K: Cervical cancer screening in Australia: modelled evaluation of the impact of changing the recommended interval from two to three years. BMC Public Health. 2010, 10: 734-10.1186/1471-2458-10-734. doi:10.1186/1471-2458-10-734
Arbyn M, Sasieni P, Meijer CJ, Clavel C, Koliopoulos G, Dillner J: Chapter 9: Clinical applications of HPV testing: a summary of meta-analyses. Vaccine. 2006, 24 (Suppl 3): 78-89.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/13/998/prepub
We should like to thank the Austrian Society of Cytology for granting access to their data set. Laboratory teams are acknowledged for sending their data to this voluntary assessment. Our thanks also go to Prof. DDr. Helene Wiener, Prim. Doz. Dr. Martin Tötsch, and Prof. Dr. Hans Peter Dinges for critically proofreading this manuscript. Last but not least many thanks to the reviewers for their most helpful comments.
The authors declare that they have no competing interests.
ER conceptualizing, designing, interpreting of data and drafting the article; PR conceptualizing, designing the article, acquisitioning of data, analyzing data; MS analyzing data; NB revising the article for important intellectual content; WF designing data analysis, revising manuscript critically for important intellectual content. All authors read and approved the final manuscript.