Variability in the performance of preventive services and in the degree of control of identified health problems: A primary care study protocol
© Bolíbar et al; licensee BioMed Central Ltd. 2008
Received: 14 July 2008
Accepted: 08 August 2008
Published: 08 August 2008
Preventive activities carried out in primary care have important variability that makes necessary to know which factors have an impact in order to establish future strategies for improvement. The present study has three objectives: 1) To describe the variability in the implementation of 7 preventive services (screening for smoking status, alcohol abuse, hypertension, hypercholesterolemia, obesity, influenza and tetanus immunization) and to determine their related factors; 2) To describe the degree of control of 5 identified health problems (smoking, alcohol abuse, hypertension, hypercholesterolemia and obesity); 3) To calculate intraclass correlation coefficients.
Multi-centered cross-sectional study of a randomised sample of primary health care teams from 3 regions of Spain designed to analyse variability and related factors of 7 selected preventive services in years 2006 and 2007. At the end of 2008, we will perform a cross-sectional study of a cohort of patients attended in 2006 or 2007 to asses the degree of control of 5 identified health problems. All subjects older than16 years assigned to a randomised sample of 22 computerized primary health care teams and attended during the study period are included in each region providing a sample with more than 850.000 subjects. The main outcome measures will be implementation of 7 preventive services and control of 5 identified health problems. Furthermore, there will be 3 levels of data collection: 1) Patient level (age, gender, morbidity, preventive services, attendance); 2) Health-care professional level (professional characteristics, years working at the team, workload); 3) Team level (characteristics, electronic clinical record system). Data will be transferred from electronic clinical records to a central database with prior encryption and dissociation of subject, professional and team identity. Global and regional analysis will be performed including standard analysis for primary health care teams and health-care professional level. Linear and logistic regression multilevel analysis adjusted for individual and cluster variables will also be performed. Variability in the number of preventive services implemented will be calculated with Poisson multilevel models. Team and health-care professional will be considered random effects. Intraclass correlation coefficients, standard error and variance components for the different outcome measures will be calculated.
The Spanish National Health Service (NHS) provides universal cover and is financed, essentially, by general taxes. The system is divided into primary and secondary care. Primary care (PC) is organized as a network of primary health care teams (PHCT) that behave as geographical and administrative units where PC services are planned, managed and provided for a population ranging from 5,000 to 25,000 citizens. The PHCT staff includes: general practitioners (GPs), paediatricians, nurses, social workers, dentists and ancillary staff. GPs care for individuals older than 14 years (except in rural areas where they look after all members of the local population) and paediatricians look after those between 0 and 14 or 16 years, depending on the region. These clinicians act as gate-keepers for the rest of the public health care system. The PHCT works usually in a single health care centre but in rural areas there may have other small offices.
Secondary care includes out-patient and in-patient hospital care and out-patient care in multi-disciplinary clinics.
The Spanish NHS has been strongly decentralized into 17 Autonomous Communities or regions that configure the Spanish State. Each of these regions has its own governmental structure which, among other responsibilities, provides health-care services to the population. There are minor differences between them with respect to structure and administration. For example, in Aragon and Navarra all services are provided by the State-funded regional service while in Catalonia, the provision of primary care services is offered by different providers (state and non-state funded) among which the Catalan Health Institute (ICS) manages almost 80% of all PHCT. According to latest census of the year 2002, Aragon had a population of 1,209,888 inhabitants while Navarra had 560,235 inhabitants and Catalonia 6,418,387.
Preventive services in Primary Care
PC is the most accessible health-care level to the general population. In Spain, more than 95% of the population visit their GP at least once in every 5 years. No other health-care level is in a better position to evaluate the global health status of the individual and to decide when to act and what are the ideal measures to take in each specific situation .
There is an increasing evidence of the health benefits achieved from the implementation of preventive measures in normal clinical practice. In the last quarter of the century several groups of experts such as the Canadian Task Force on Periodic Health Examination in 1979  and the US Task Force in 1980 [3, 4] have published evidence-based recommendations regarding the relevance and the outcomes of the implementation of preventive interventions. Prestigious institutions such as WHO and the Royal College of General Practitioners  have highlighted the valuable role of health-care professionals within PCHTs in developing these services.
In Spain, the Spanish Society of Family and Community Medicine [Sociedad Española de Medicina de Familia y Comunitaria; semFYC] launched in 1988 the Preventive Activities and Health Promotion Program [Programa de Actividades Preventivas y de Promoción de la Salud; PAPPS] that have as main objective promoting the implementation of preventive and health promotion services in PC . The EUROPREV (European Network for Prevention and Health Promotion in Family Medicine and General Practice) was created to extend and coordinate the experiences from this program and to promote preventive services at the European level.
In the period between 1989 and 2003 PAPPS program carried out biennial evaluations of a representative sample of patients attending the PHCTs participating in the program (671 PHCT since the beginning of the program). These evaluations have been the only evaluations of preventive services carried out nation-wide and provide information on the progress and effectiveness of the program over its 15 years of existence [7–9]. From the studies we know that the best-implemented group of preventive services is the minimum package of the adult sub-program which includes screening for hypertension, smoking status and alcohol consumption (done in 92.8% of patients), followed by a second group that includes anti-influenza vaccination, screening for hypercholesterolemia and obesity and anti-tetanus vaccination (done in more than 70% of patients) .
However, the progressive implementation of systematic evaluations of primary care performance promoted by the Autonomous health administrations and the progressive computerization of clinical records has brought-about a re-thinking of this evaluation model. The computerization of clinical records provides rich information based on individual data (not centre aggregated data) on a wider and more representative sample that avoids manual and voluntary recording of data. This allows a better study of the clinical practice variability (CPV) and its determining factors.
Clinical practice variability in preventive services in Primary Care
In Spain, there have been few nation-wide population studies evaluating CPV in PC. This has been due, in part, to the lack of reliable information systems. These studies have often been performed at a hospital level because of the existence of minimum basic data sets (MBDS) provided on discharge from hospital. Nevertheless, from the existing evaluations, PAPPs studies [8, 9] and other national [10–13]and international [14–16] studies it is clear that there are important difficulties with respect to the correct implementation of preventive services and health promotion interventions and there is a high variability in their implementation. There is extensive literature on factors related to prevention of specific diseases but less related to implementation of a combination of preventive services as routine clinical practice in PC that may have a profound effect on different diseases. These factors vary considerably, depending on the type of study, the country and type of preventable disease. There are different factors associated with the supply and demand of services that result in elevated variability between and within centres: patient-related factors (socio-demographic and clinical factors), health professional associated factors (specialty, training and professional competence, number of years working with the PHCT), team related factors (existence of specific registries, workload, frequency of doctors encounters, teaching centre) and other health-care provision system characteristics .
High CPV translates into problems of clinical effectiveness and social efficiency in health-care provision and, as such, is of concern to health-care providers and to Society in general [17, 18]. An analysis of CPV is therefore essential in decision making in the health-care provision politics and prioritization in clinical management (e.g. to generate guidelines for implementation in those areas of high clinical variability).
Hence, it is essential to have studies that include a territory-wide sampling in order to achieve greater representativeness and which take into account methods of design and statistical analysis (e.g. cluster-based analyses) to obtain valid estimates and to explore the influence of patient, health-care professional and PHCT characteristics on the CPV of preventive services in Spain.
Sources of information in Primary Care: the computerization of clinical records
Primary Care uses electronic clinical records (ECRs) to monitor health problems and to register preventive care services. Although information collection intends to be comprehensive, the ECR systems are different for each region.
Routinely-collected data have undisputed advantages in the study of CPV; they are available almost instantaneously and provide information on a large number of patients. The creation of registries or databases of health-care interest in PC was given a considerable boost with the computerization of clinical records. Spain, contrary to other countries [19–23], has little experience in the use of nation-wide databases containing electronic clinical records in PC. Recently, projects such as the BIFAP project in pharmacoepidemiological research http://www.bifap.org have been initiated in Spain.
However, there are certain difficulties in their use: 1) The data was originally collected for a function different from current research requirements; 2) ECR systems are different in each region, with different standards and computer programs; 3) The heterogeneous degree of implementation in PHCTs; and 4) The degree of exhaustivity of data recorded (for example, some activities are carried out but are not registered). Nevertheless, the potential of this type of registry has been confirmed by different European experiences mentioned earlier [25–27]. As such, the advantages associated to computerization of clinical records are beginning to be appreciated by the different regions and the richness of information provides enormous potential for the study of CPV in primary care.
Intraclass correlation coefficient
Reports of cluster randomised studies  should include sample size calculations and statistical analyses that take clustering into account. The intraclass correlation coefficient (ICC) is a measure of the relatedness of clustered data . Compared with individual randomisation, cluster randomisation may substantially increase the sample size required to maintain adequate statistical power .
One of the problems that needs to be faced in designing cluster-based studies (area or organization-based studies) is that estimates of ICC and components of variance for the outcomes of interest need to be obtained from previous studies in order to determine the required sample size for the cluster design [30–32]. There have been repeated calls for publication of ICCs for these types of studies to help others who are planning cluster-based studies [29, 33–35].
The differences  in ICCs among potential outcome variables, the paucity of appropriate information  concerning components of variance or ICC and the lack of data obtained from PC settings reinforce the need for valid estimates that would ensure proper study design.
The planned objectives in the present study are:
- To describe the variability in the performance of 7 preventive services (detection of smoking status and excessive alcohol consumption; screening for hypertension, obesity and hypercholesterolemia; anti-influenza and anti-tetanus immunization) in a population older than 16 years of age receiving attention in years 2006 or 2007 and to analyse factors related to their implementation.
- To analyse the evolution of 5 identified health problems (decrease in consumption or abstention from tobacco and alcohol and degree of control of hypertension, hypercholesterolemia and obesity) up to December 2008 in the population older than16 years of age attended by the reference PHCT at least once between 2006 and 2007 and followed up during 2008.
- Estimate the ICC, together with the within-cluster and between-cluster components of variance for each of the outcome measures of interest at the PC level.
This is a multi-centered cross-sectional study of a randomised sample of PHCT stratified by region to describe the variability in the implementation of 7 preventive services and their related factors in the period of 2006 or 2007. In 2008, using another cross-sectional study, the evolution or degree of control of 5 of the identified health problems will be assessed, together with the determinants of variability. We use a longer period of study because we need more time to evaluate the impact on the degree of control of these health problems due to changes on life styles.
The study is set in PHCTs computerized prior to 1st of January 2005 in the regions of Aragón, Navarra, and Catalonia. So far computerization had occurred in 19% of 121 PHCTs in Aragón, 76% of 54 PHCTs in Navarra, and 97.5% of 278 PHCTs in Catalonia (at the Catalan Health Institute).
Study population: PHCT and patients
We performed random cluster sampling stratified by region with computerized PHCT used as unit of randomisation.
The inclusion criteria of the PHCT are: 1) computerization of the clinical records before the 1st of January 2005 to ensure familiarity with the system's use; 2) wide use of ECR, and 3) agreement to participate in the study by most of the health-care professionals working in each PHCT (> 80%).
For each computerized PHCT we select the ECRs of all subjects older than16 years as the unit of data collection. For the assessment of variability, the ECR of subjects receiving attention at least once in each of the study years will be extracted from the database. It is estimated that the average number of subjects receiving attention per year is around 70%. Thus in a PHCT in Aragon this figure would be around 10,000 patients, in Navarra around 7,500 and in Catalonia around 12,000. For the analysis of the evolution of health problems and related factors, subjects visited at least on one occasion during the 2006–2007 period and on a further occasion in 2008 will be included.
Sample size and randomisation
To achieve the equivalent power of a patient-randomised design, in a cluster randomised design the effective sample size will need to be the standard sample size of a single random sampling multiplied by the design effect [31, 37, 38]. The design effect is a function of the average cluster (computerized PHCT) size and the (intraclass correlation coefficient (ICC) of the outcome:
design effect = 1 + (n-1)*ICC
where n is the average number of individuals sampled per cluster .
sWith the cluster design we set an ICC of 0.05 on the assumption that the ICCs estimated for outcome variables from PC are less than 0.05 [28, 36, 39] and that the average number of individuals sampled per centre is at least of 2,500. Therefore 20 computerized PHCTs are necessary from each region to guarantee a statistical power of 80%, assuming a 50% event rate with an alpha two-tailed significance level of 0.05. Finally, to allow any of the randomised computerized PHCTs declining our offer to participate, we increased the number of computerized PHCTs selected from each region to 22. As such, the total number of subjects included will be more than 300,000 in Aragón, 200,000 in Navarra and 350,000 in Catalunya i.e. more than 850,000 subjects in total. This volume of subjects ensures a good estimate of the different outcome measures in the sub-groups of each cluster.
The selection of computerized PHCT to participate in the study is by a simple random sample within each region. Sample size calculation and computerized PHCT selection is performed with Epidat 3.1.
Outcomes and others measures
Primary outcome measures
The primary outcome measures relating to objective 1 include the description of the implementation of preventive services according to the PAPPS criteria .
Screening for smoking status: if there is information on the consumption of tobacco over the last two years in members of the population who previously were non-smokers.
Screening for excessive alcohol consumption: if there is information on the consumption of alcohol over the last two years in members of the population who previously were not high consumers of alcohol.
Screening for obesity: if there have been measurements of height and weight or body mass index (BMI) over the last 4 years in members of the population who previously were non-obese.
Screening for hypertension: if there is information on systolic blood pressure (BPS) and diastolic blood pressure (BPD) during the last 4 years in members of the population aged between 16 and 40 years who previously did not have the diagnosis of hypertension; or over the past 2 years in members of the population older than 40 years who previously did not have the diagnosis of hypertension.
Screening for hypercholesterolemia: if there is information on total blood cholesterol corresponding to the following criteria of age and gender: 1 measurement in males between 16–35 years old; 1 measurement in females between 16–45 years old; 1 measurement every 5 years in males between 35–75 years old; 1 measurement every 5 years in females between 45–75 years old; 1 measurement if there has not been a previous measurement in those older than 75; all of these performed in population that previously did not have the diagnosis of hypercholesterolemia.
Anti-tetanus vaccination (ATV): if there is a registry of anti-tetanus vaccination over the previous 10 years.
Anti-influenza vaccination (AIV): if there is a registry of annual anti-influenza vaccination in those older than 59 years of age.
The primary outcome measures relating to objective 2 describes the clinical follow-up of the five health problems identified up to December 31st 2007 and evaluated up to December 31st 2008:
Evolution of tobacco consumption: quit smoking or remaining an ex-smoker.
Evolution of excessive alcohol consumption: cessation of consumption or decrease below the definition of excessive consumption (28 alcohol units/week in males and 17 alcohol units/week in females, where 1 alcohol unit = 10 grams of alcohol).
Evolution of obesity: decrease in BMI to <30 kg/m2 or change in the diagnosis to non-obese.
Evolution of hypertension: mean of the last 2 determinations of systolic BP/diastolic BP registered as being ≤ 130/80 mmHg in patients of high risk (diagnosed with diabetes, renal or cardiac insufficiency) and ≤ 140/90 mmHg in the rest of the population.
Evolution of hypercholesterolemia: last measurement of LDL cholesterol registered as being ≤ 100 mg/dL in high-risk patients (diagnosed with diabetes, ischaemic heart disease or cerebrovascular accident) and ≤ 130 mg/dL in the rest of the population.
Secondary outcome measures
Number of different preventive services (among the 7 of the study) registered for each individual during the 2006 and 2007 year periods.
We assess the following factors related to the outcome measures according to the levels of analysis:
Computerized PHCT: variables of structure and organization of the PHCT (number of GPs and nurses, presence of specialists), adherence to PAPPS, training centre for family doctors, ECR system and starting year, assigned population.
Health-care professionals (GPs, nurses): gender, age, specialty, years of employment in PC and in the PHCT, workload (mean number of visits/day), years of experience with ECR.
The individual data will be extracted directly from the central computer servers of the ECRs of the subjects included in the study. In Navarra and Aragón the system used is OMI-AP and in Catalonia the eCAP system. The data related to health-care professionals and to PHCT will be obtained from an on-line database for health-care professionals and from a person responsible in each centre.
Data extraction and processing
Using the specific interface for each specific computer system (OMI-AP and eCAP), each region will extract the study data and transfer them to a central database where they will be homogenized and processed into a specially-constructed final database.
Confidentiality of data
Data confidentiality will be assured during and subsequent to the extraction using encryption and dissociation of the individual's identification, health-care professionals, and of PHCTs.
The study has been favourably evaluated by the Research Committee of the IDIAP Jordi Gol.
Quality controls will be carried out in the 2 extractions of data comparing agreement between the central database and the original data of some centres as for: number of patient, visits and diagnoses as well as data of prevalence of certain diseases. It will also be checked if the population data is appropriate by comparing it with data from the census and other official sources. In the case of items related to clinical activities (for example blood pressure measurement), any register with missing values will be considered as not performed.
For the first two objectives all the analyses will be performed on a global level and each region separately. Cluster level analysis (computerized PHCT and health-care professional) will be performed using standard parametric or non-parametric analytical methods, with cluster means or proportions as observations [37, 42]. For the adjusted analysis we will perform regression analysis of individual level data using methods for clustered data, multilevel, hierarchical or random effects models [37, 43]. This methodology facilitates simultaneous analyses of the effects of individual and cluster variables in order to evaluate whether the relationship between variables at the individual level varies in accordance with the characteristics of the cluster and whether the individual and cluster variability can be attributed to factors of the cluster and/or to the factors related to the individual. Analysis will be performed at 3 levels: PHCT, health-care professional and individual subjects.
Multilevel linear (for continuous outcome variables) or logistic (for dichotomous outcome variables) regression analyses will be performed for the first two objectives. The analyses will be adjusted for explanatory factors at individual, health-care professional and PHCT level and for other variables that are clinically relevant. We will also adjust for possible confounders checking whether they will affect the outcomes. A nested or hierarchical structure will be considered: the attended individuals are nested within the health-care professional and the health-care professional within PHCT. The PHCT and the health-care professional will be considered random effects.
Multilevel Poisson regression models will be used to evaluate the number of preventive activities recorded for each individual.
For the third objective, the ICCs, their standard errors and the components of variance [36, 37, 42, 43] for the different outcome measures will be calculated using methods that enable adjustment for covariables, together with random effect methods (health-care professionals and PHCT). Initially, we will estimate the coefficients of variance and ICCs using the outcome as the dependent variable and the health-care professional/PHCT as random effects. Subsequently, we will perform an adjusted analysis for the characteristics of the individual, the health-care professional and the PHCT.
We will study interactions and collinearity. The collinearity of the maximal models will be evaluated using the criteria proposed by Belsley . We will set the significance level at 1% (two-tailed).
Analysis will be carried out using the SPSS statistical package for Windows, version 15 (SPSS Inc., Chicago, IL) and the SAS package 9.1.3 for Windows (SAS Institute Inc., Cary, NC, USA).
The project results will provide very useful information on the degree of registration and performance of the 7 preventive services selected. These 7 activities have been widely implemented and have a high impact on the health of our population [2–6]. The large population database of the study, with more than 850,000 people recorded, will increase considerably the external validity of the results and will reflect usual clinical practice at the Primary Care settings in the Spanish NHS.
This fact may help to overcome the current limitations and to investigate CPV and the factors that have an impact on the implementation of preventive services.
Certainly the source of information used and the ECRs may have limitations. The heterogeneity of current computer systems may complicate the extraction of outcomes and of variables. However, the design of the data extraction interfaces and data transfer will minimize the problems. The lack of exhaustivity in data recording may introduce some distortions in the information. Nevertheless, stability of computer systems at the centres will help to minimize this problem and the quality control measures will help to identify the magnitude of the problem.
Studies based on cluster sampling allow important reduction in costs and greater easiness in administration but require knowledge of the ICCs. For this study ICCs has been estimated from studies conducted in other countries. In our study we will provide information concerning the magnitude of the ICC, evaluate factors that influence their magnitude, estimate within-cluster and between-cluster components of variance for the outcome measures under consideration and determine the sample size; all of these factors will aid the design and statistical analysis of future cluster-based studies set in PC.
In conclusion, the present study will provide new knowledge in:
- The identification of factors related to the variability in the implementation of preventive services, which will facilitate the design of strategies for improvement in the planning and administration of services in PC.
- The assessment of the evolution of the detected health problems will improve the degree of existent evidence taking into account the results of screening and the control of those problems. This will be very useful for the evaluation of the PAPPS and other studies based on this source of information.
- The estimation of the ICC will be of considerable help in the design, calculation of sample size and analysis of future studies based on the randomisation of clusters in our environment.
- Finally, although not being an aim of the project, information will be obtained on the characteristics of the different computer systems and this information will generate recommendations for the standardization of systems for future applications.
This study was carried out with financial help from the Network of Preventive Activities and Health Promotion in Primary Care [Red de Actividades Preventivas y Promoción de la Salud en Atención Primaria; redIAPP] granted by the Carlos III Health Institute [Instituto de Salud Carlos III] (RD06/0018) and from another project grant (PI061737) in 2006 also from the Carlos III Health Institute. Financial help for translation was provided by the IDIAP Jordi Gol and editorial assistance by Josep Vidal Alaball.
- Martín Zurro A CPJF: Atención Primaria. 2003, Madrid, Harcourt Brace, 5ªGoogle Scholar
- The periodic health examination. Canadian Task Force on the Periodic Health Examination. Can Med Assoc J. 1979, 121: 1193-1254.
- Medical evaluations of healthy persons. Council on Scientific Affairs. JAMA. 1983, 249: 1626-1633. 10.1001/jama.249.12.1626.
- U.S. Preventive Task Force Report. Guide to clinical preventive services. An assessment of the effectiveness of 169 interventions. 1996, Baltimore, Williams and Wilkins, 2ond
- Royal College of General Practitioners: Combine reports on prevention. Reports from general practice. 2008, London, 18-21-Google Scholar
- PAPPS: Actualización 2007. Aten Primaria. 2007, 39: 1-161.Google Scholar
- Brotons C, Iglesias M, Martin-Zurro A, Martin-Rabadan M, Gene J: Evaluation of preventive and health promotion activities in 166 primary care practices in Spain. The Coordinating Group For Prevention and Health Promotion in Primary Care in Spain. Fam Pract. 1996, 13: 144-151. 10.1093/fampra/13.2.144.View ArticlePubMedGoogle Scholar
- Subias-Loren PJ, Perula de Torres LA, J M, M MR, A LM, Iglesias M: Programa de actividades preventivas y de promoción de la salud. Evaluación 2001. 2002, Barcelona, Sociedad Española de Medicina de Familia y ComunitariaGoogle Scholar
- PAPPS. Evaluaciones; estudios de evaluación 1995, 1997, 1999, 2001, 2003. Available from: . 2004, [http://www.papps.org/evaluaciones_estudios/evaluaciones/index.html]
- Lopez-de-Munain J, Torcal J, Lopez V, Garay J: Prevention in routine general practice: activity patterns and potential promoting factors. Prev Med. 2001, 32: 13-22. 10.1006/pmed.2000.0777.View ArticlePubMedGoogle Scholar
- Schwarz Chávarri H, Ortuño López JL, Lattur Vílchez A, Pedrera Carbonell V, Orozco Beltrán D, Gil Guillén V: ¿Podemos mejorar la tasa de vacunación antigripal en la población anciana con enfermedades crónicas?. Aten Primaria. 2005, 35: 178-183. 10.1157/13072586.View ArticlePubMedGoogle Scholar
- Fuste J, Rue M: [Variability in preventive activities among primary care teams in Catalonia. Application of a multilevel analysis]. Gac Sanit. 2001, 15: 118-127.View ArticlePubMedGoogle Scholar
- Seculi E, Brugulat P, Medina A, Junca S, Tresserras R, Salleras L: [Detection of cardiovascular risk factors in the reformed primary care network in Catalonia. Comparison between the years 1995 and 2000]. Aten Primaria. 2003, 31: 156-162. 10.1157/13044291.View ArticlePubMedGoogle Scholar
- Weingarten S, Stone E, Hayward R, Tunis S, Pelter M, Huang H, Kristopaitis R: The adoption of preventive care practice guidelines by primary care physicians: do actions match intentions?. J Gen Intern Med. 1995, 10: 138-144. 10.1007/BF02599668.View ArticlePubMedGoogle Scholar
- Solberg LI, Kottke TE, Brekke ML: Variation in clinical preventive services. Eff Clin Pract. 2001, 4: 121-126.PubMedGoogle Scholar
- Wennberg JE: Unwarranted variations in healthcare delivery: implications for academic medical centres. BMJ. 2002, 325: 961-964. 10.1136/bmj.325.7370.961.View ArticlePubMedPubMed CentralGoogle Scholar
- Marion BJ, Peiro S, Marquez CS, Meneu G: [Variations in medical practice: importance, causes, and implications]. Med Clin (Barc ). 1998, 110: 382-390.Google Scholar
- Fisher ES, Wennberg DE, Stukel TA, Gottlieb DJ, Lucas FL, Pinder EL: The implications of regional variations in Medicare spending. Part 1: the content, quality, and accessibility of care. Ann Intern Med. 2003, 138: 273-287.View ArticlePubMedGoogle Scholar
- Carey IM, Cook DG, De Wilde S, Bremner SA, Richards N, Caine S, Strachan DP, Hilton SR: Developing a large electronic primary care database (Doctors' Independent Network) for research. Int J Med Inform. 2004, 73: 443-453. 10.1016/j.ijmedinf.2004.02.002.View ArticlePubMedGoogle Scholar
- Mansson J, Nilsson G, Bjorkelund C, Strender LE: Collection and retrieval of structured clinical data from electronic patient records in general practice. A first-phase study to create a health care database for research and quality assessment. Scand J Prim Health Care. 2004, 22: 6-10. 10.1080/02813430310003660.View ArticlePubMedGoogle Scholar
- van Weel C, Smith H, Beasley JW: Family practice research networks - Experiences from 3 countries. Journal of Family Practice. 2000, 49: 938-943.PubMedGoogle Scholar
- Walley T, Mantgani A: The UK General Practice Research Database. Lancet. 1997, 350: 1097-1099. 10.1016/S0140-6736(97)04248-7.View ArticlePubMedGoogle Scholar
- Observatoire de la Medicine General de la Societé Française de Médecine Genérale. Available from: . 2008, [http://omg.sfmg.org/]
- Salvador RA, Moreno Perez JC, Sonego D, Garcia Rodriguez LA, de A I: [The BIFAP project: database for pharmaco-epidemiological research in primary care]. Aten Primaria. 2002, 30: 655-661.View ArticleGoogle Scholar
- Hippisley-Cox J, Pringle M, Cater R, Wynn A, Hammersley V, Coupland C, Hapgood R, Horsfield P, Teasdale S, Johnson C: The electronic patient record in primary care--regression or progression? A cross sectional study. BMJ. 2003, 326: 1439-1443. 10.1136/bmj.326.7404.1439.View ArticlePubMedPubMed CentralGoogle Scholar
- Green LA, Dovey SM: Practice based primary care research networks - They work and are ready for full development and support. Br Med J. 2001, 322: 567-568. 10.1136/bmj.322.7286.567.View ArticleGoogle Scholar
- Sanderson H, Adams T, Budden M, Hoare C: Lessons from the central Hampshire electronic health record pilot project: evaluation of the electronic health record for supporting patient care and secondary analysis. Br Med J. 2004, 328: 875-878. 10.1136/bmj.328.7444.875.View ArticleGoogle Scholar
- Parker DR, Evangelou E, Eaton CB: Intraclass correlation coefficients for cluster randomized trials in primary care: The cholesterol education and research trial (CEART). Contemp Clin Trials. 2005, 26: 260-267. 10.1016/j.cct.2005.01.002.View ArticlePubMedGoogle Scholar
- Killip S, Mahfoud Z, Pearce K: What is an intracluster correlation coefficient? Crucial concepts for primary care researchers. Ann Fam Med. 2004, 2: 204-208. 10.1370/afm.141.View ArticlePubMedPubMed CentralGoogle Scholar
- Cosby RH, Howard M, Kaczorowski J, Willan AR, Sellors JW: Randomizing patients by family practice: sample size estimation, intracluster correlation and data analysis. Fam Pract. 2003, 20: 77-82. 10.1093/fampra/20.1.77.View ArticlePubMedGoogle Scholar
- Donner A, Birkett N, Buck C: Randomization by cluster. Sample size requirements and analysis. Am J Epidemiol. 1981, 114: 906-914.PubMedGoogle Scholar
- Simpson JM, Klar N, Donnor A: Accounting for cluster randomization: a review of primary prevention trials, 1990 through 1993. Am J Public Health. 1995, 85: 1378-1383.View ArticlePubMedPubMed CentralGoogle Scholar
- Campbell MK, Grimshaw JM: Cluster randomised trials: time for improvement. The implications of adopting a cluster design are still largely being ignored. BMJ. 1998, 317: 1171-1172.View ArticlePubMedPubMed CentralGoogle Scholar
- Campbell MK, Grimshaw JM, Elbourne DR: Intracluster correlation coefficients in cluster randomized trials: empirical insights into how should they be reported. BMC Med Res Methodol. 2004, 4: 9-10.1186/1471-2288-4-9.View ArticlePubMedPubMed CentralGoogle Scholar
- Kerry SM, Bland JM: The intracluster correlation coefficient in cluster randomisation. BMJ. 1998, 316: 1455-View ArticlePubMedPubMed CentralGoogle Scholar
- Adams G, Gulliford MC, Ukoumunne OC, Eldridge S, Chinn S, Campbell MJ: Patterns of intra-cluster correlation from primary care research to inform study design and analysis. J Clin Epidemiol. 2004, 57: 785-794. 10.1016/j.jclinepi.2003.12.013.View ArticlePubMedGoogle Scholar
- Ukoumunne OC, Gulliford MC, Chinn S, Sterne JA, Burney PG: Methods for evaluating area-wide and organisation-based interventions in health and health care: a systematic review. Health Technol Assess. 1999, 3: iii-92.PubMedGoogle Scholar
- Kish L: Survey Sampling. 1965, New York, John Wiley & Sons, Inc.Google Scholar
- Campbell MK, Mollison J, Grimshaw JM: Cluster trials in implementation research: estimation of intracluster correlation coefficients and sample size. Stat Med. 2001, 20: 391-399. 10.1002/1097-0258(20010215)20:3<391::AID-SIM800>3.0.CO;2-Z.View ArticlePubMedGoogle Scholar
- Weiner JP, Starfield BH, Steinwachs DM, Mumford LM: Development and application of a population-oriented measure of ambulatory care case-mix. Med Care. 1991, 29: 452-472. 10.1097/00005650-199105000-00006.View ArticlePubMedGoogle Scholar
- Juncosa S, Bolíbar B, Roset M, Tomás R: Performance of an ambulatory casemix measurement system in primary care in Spain. Eur J Public Health. 1999, 9: 27-35. 10.1093/eurpub/9.1.27.View ArticleGoogle Scholar
- Fleiss JL: Statistical Methods for Rates and Proportions. 1981, New York, John Wiley & Sons, Inc., 2ndGoogle Scholar
- Harvey G, Perello del Rio MJ: Multilevel Statistical Models. 2003, Great Britain, Arnold, Tercera ediciónGoogle Scholar
- Belsley DA: Conditioning Diagnostics: Collinearity and Weak Data in Regression. 1991, New York, John Wiley & SonsGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/8/281/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.