- Study protocol
- Open Access
ELSID-Diabetes study-evaluation of a large scale implementation of disease management programmes for patients with type 2 diabetes. Rationale, design and conduct – a study protocol [ISRCTN08471887]
BMC Public Health volume 5, Article number: 99 (2005)
Diabetes model projects in different regions of Germany including interventions such as quality circles, patient education and documentation of medical findings have shown improvements of HbA1c levels, blood pressure and occurrence of hypoglycaemia in before-after studies (without control group). In 2002 the German Ministry of Health defined legal regulations for the introduction of nationwide disease management programs (DMP) to improve the quality of care in chronically ill patients. In April 2003 the first DMP for patients with type 2 diabetes was accredited. The evaluation of the DMP is essential and has been made obligatory in Germany by the Fifth Book of Social Code. The aim of the study is to assess the effectiveness of DMP by example of type 2 diabetes in the primary care setting of two German federal states (Rheinland-Pfalz and Sachsen-Anhalt).
The study is three-armed: a prospective cluster-randomized comparison of two interventions (DMP 1 and DMP 2) against routine care without DMP as control group. In the DMP group 1 the patients are treated according to the current situation within the German-Diabetes-DMP. The DMP group 2 represents diabetic care within ideally implemented DMP providing additional interventions (e.g. quality circles, outreach visits). According to a sample size calculation a sample size of 200 GPs (each GP including 20 patients) will be required for the comparison of DMP 1 and DMP 2 considering possible drop-outs. For the comparison with routine care 4000 patients identified by diabetic tracer medication and age (> 50 years) will be analyzed.
This study will evaluate the effectiveness of the German Diabetes-DMP compared to a Diabetes-DMP providing additional interventions and routine care in the primary care setting of two different German federal states.
Diabetes is a major and growing health care problem. The number of diabetes patients is expected to increase globally from 135 to 300 million between 1995 and 2025 , the vast majority will have type 2 diabetes . The quality of care for diabetic patients in Germany was like in many western countries criticized for more than two decades. The Expert Committee of the Government therefore recommended in 2003 diabetes as a priority area . Epidemiological data from primary care was mostly lacking, although recently published data showed that performance of practices and diabetes control in patients could be better than suggested [4–6]. Quality of care is expected to improve within disease management programs (DMP) by the implementation of evidence-based clinical practice, by means of guidelines, quality circles, educational meetings, outreach visits, patient education and by improving coordination among different health care providers [7, 8]. Consequently, clinical guidelines and DMPs for primary care have been developed to improve quality and cost-effectiveness of health care for chronic conditions such as diabetes.
In the reform law of 2002 the German Ministry of Health defined a complicated process for the introduction of DMPs and on 27 February 2003 the Federal Insurance Office accredited the first DMP for type 2 diabetes . Several patient- and provider-oriented interventions within the German-style DMP aiming at decreasing mortality and morbidity of patients with type 2 diabetes reducing micro- and macrovascular complications and increasing quality of life of diabetes patients. The underlying criteria therefore have been developed by the newly formed Coordinating Committee and have gone through a tough process of certification before they have been regulated by law by the Ministry of Health in 2002 . The German DMP structure is tightly linked to financial incentives for the sickness funds, i.e. it is linked with the risk structure compensation (= RSC) which was introduced to compensate for differences in the risk structure of the insured population. . Besides the requirement of a comprehensive documentation and the obligation to provide guideline-oriented healthcare the statutory health insurances are obliged to evaluate DMPs by the Fifth Book of Social Code [9, 11].
However, until now valid scientific data showing the effectiveness of the German Diabetes-DMP are missing. Recently published data of diabetes model projects in the region of Nordrhein, Sachsen-Anhalt and Baden-Wuerttemberg show improvements of HbA1c levels, blood pressure and occurrence of hypoglycaemia [12–14]. However, the duration of these model projects was too short to draw conclusions concerning clinical endpoints (i.e. a cardiovascular events, amputation rate) and bias because of the preferred inclusion of highly motivated patients can not be excluded .
Aim and design of the study
The aim of the study is to assess the effectiveness of DMP compared to routine care in the primary care setting of two different German federal states (Rheinland-Pfalz and Sachsen-Anhalt). Since DMPs are liable to an implementation process ongoing at the moment which is differing considerably depending on several criteria (e.g. region of Germany, rural/urban area, health insurance) three groups will be observed: a "routine care group without DMP" (= control group; CG), a "DMP real group" (= DMP 1) and a group of patients participating in an (within the scope of the German law regulations) optimally in practices implemented DMP (= DMP 2).
The study is designed as a prospective cluster-randomized comparison of the two intervention groups (DMP 1 and DMP 2) against routine care as control group (Fig 1). The cluster randomization was chosen because this has optimal internal validity (absence of confounders) while avoiding contamination of interventions associated with patient randomisation.
• The German-Diabetes-DMP (DMP 1) is more effective than routine diabetes care (CG)
• An optimally implemented form of the Diabetes-DMP (DMP 2) is more effective than the German-Diabetes-DMP (DMP 1).
Sample size calculation
Sample size calculations for cluster randomized trials differ from sample size calculations for common RCTs requiring a larger number of patients. Based on the main outcome parameters we performed a power calculation with the Cluster Randomization Sample Size Calculator ver.1.02 of the University of Aberdeen on the basis of an ICC of 0,05. Considering possible drop-outs a sample size of 200 GPs will be required (each GP including 20 patients).
Selection of participants
500 GPs in Rheinland-Pfalz and 500 GPs in Sachsen-Anhalt participating in the Diabetes-DMP will be recruited by an invitation letter giving information about the study project. From those who will accept to participate, 100 GPs will be randomized in the DMP group 1 and 100 in the DMP group 2. All patients with a type 2 diabetes out of these practices insured at the general regional health funds (Allgemeine Ortskrankenkassen = AOK) and participating in the DMP will be included in the study then. Incomplete participation in the interventions will be an exclusion criterion in the DMP group 2.
For the control group 4000 AOK patients out of practices not participating in the DMP will be detected through diabetes tracer medication and age (> 50 years) and will be matched. Participation in a DMP offered by another health fund is an exclusion criterion in the control group.
Data collection and analysis
All data will be provided by the AOK. Data of the DMP groups are retrieved by the DMP documentation forms which have to be completed routinely every 3 to 6 months during the scheduled DMP visits of participating patients. The information about the tracer medication identifying patients of the control group is also provided by the AOK. The data reporting will follow the CONSORT recommendations for cluster randomized trials .
Data analysis will be performed according to the intention-to-treat (ITT) method. For missing data the 'last observation carried forward' -method will be used.
Outcome parameters were defined considering best available evidence, legal regulations and feasibility. According to our two scientific hypotheses two groups of outcome parameters were defined: "outcome parameters I" for the comparison of the DMP groups and "outcome parameters II" for the comparison of DMP and routine care. This differentiation of the outcome parameters is essential because in the control group availability of patient data will be limited to process indicators only. The outcome parameters are displayed in Table 1.
The minimum requirements for the Diabetes-DMP are regulated by law and defined in the RSAV . According to the legal regulations the intervention in the DMP1 group comprises consultations at 3- or 6-months intervals. During these consultations a detailed diabetes-specific anamnesis and physical examination incl. taking blood pressure and an analysis of HbA1c are carried out. Furthermore agreements are made concerning further treatment, e.g. target values for HbA1c and blood pressure and participation on patient education programs for diabetes or hypertension. All medical findings as well as the current medication have to be documented within structured, standardized documentation sheets at each consultation. If required a referral to a specialist (e.g. ophthalmologist) will be arranged. Furthermore the GPs get a special diabetes-handbook including current, evidence-based information about diabetes therapy. The GPs participating in the DMP1 group will receive no additional intervention.
There are major difficulties introducing new evidence into general practice requiring comprehensive implementation support at different levels (patients, doctors, practice team) [17, 18]. Therefore, in the DMP 2 group implementation support at the level of doctors and practice team will be provided. In addition to the clinical interventions at patients level in the DMP group 1 several components aiming at optimizing the implementation process are provided in this group (= implementation interventions) (Table 2).
The control group represents routine care without DMP. There will be no intervention at all.
Timeframe of the study
The study team will start to invite GPs at the end of September 2005. After receiving a written declaration of their willingness to participate in the study and to accept random assignment to the different groups GPs will be randomized.
Patient inclusion and pre-data collection will start in 2005. The observation period will be 24 months.
Description of risks
Since the interventions aim at the evidence based improvement of skills of GPs and practice teams serious risks or undesired effects for patients are not to be expected. There are no specific risks related to the study.
Patient informed consent
Previous to DMP participation patients already receive written and oral information about the content and extent of the DMP by their treating GPs, i.e. about potential benefits for their health and potential risks. Furthermore, patients are informed that DMP data including medical data will be analyzed. In case of acceptance they have to sign a special DMP participation form.
Ethical principles and vote of the ethics committee
The study is being conducted in accordance with medical professional codex and the Helsinki Declaration as of 1996 as well as the German Federal Data Security Law (BDSG). DMP participation of patients is voluntary and can be cancelled at any time without provision of reasons and without negative consequences for their future medical care.
The study protocol was approved by the ethics committee of the University of Heidelberg in April 2005 (Approval-Nr. 098-2005). Furthermore the evaluation of the DMP is regulated by law in the Fifth Book of Social Code (§137 f. Abs. 4 SGB V).
Data security/disclosure of original documents
The patient names and all other confidential information fall under medical confidentiality rules and are treated according to German Federal Data Security Law (BDSG).
Data management will be performed by the AQUA-Institute, Goettingen. All study related data are stored on a protected central server. Only direct members of the internal study team can access the respective files. Intermediate and final reports are stored at the office of the Department of General Practice and Health Services Research at the Heidelberg University Clinic.
There are specific difficulties in evaluating the effectiveness of complex interventions such as disease management programs , particularly, in our case that implementation process has already started . At the moment it is not conceivable to which phase of the implementation process the DMP actually has preceded. However, the DMP group 2 represents an ideal implementation of the DMP within the scope of the German law regulation.
To adapt the evaluation design to the real conditions of diabetes care in Germany at the moment, but also to consider the ongoing implementation process we have chosen the design of a prospective randomized-controlled comparison of the two DMP groups embedded in the quasi-experimental design of a controlled before-after study with a blinded control group. The quasi-experimental design is predetermined because allocation to the control group can not be perfomed randomly and because baseline values for patients participating in the DMP have not been documented.
A fully experimental design with a randomized control group was rejected by the authors, because this could create an artificial care situation. That is informing patients and GPs of the control group about the study and probably asking for completing any questionnaires would introduce an enormous bias.
According to the theoretical model for design and evaluation of complex interventions by Campbell et al the presented study can be assigned to phase III and IV (15, 20). However, pilot projects have shown that an observation period of 24 months will be too short to show significant differences in severe clinical endpoints (i.e. amputations, diabetic renal insufficiency, cardio-vascular events). Therefore it was decided to have a combination of HbA1c and blood pressure as primary endpoint in the randomized part of the trail and prescriptions in the quasi-experimental part of the trial.
King H, Aubert RE, Herman WH: Global burden of diabetes, 1995-2025: prevalence, numerical estimates, and projections. Diabetes Care. 1998, 21: 1414-1431.
Amos AF, McCarty DJ, Zimmet P: The rising global burden of diabetes and its complications: estimates and projections to the year 2010. Diabet Med. 1997, 14 Suppl 5: S1-85.
Sachverständigenrat zur Begutachtung der Entwicklung im Gesundheitswesen: Finanzierung, Nutzerorientierung und Qualität . 2003, [http://www.svr-gesundheit.de]
T U, Szecsenyi, J S, HD K: The Sinsheim Diabetes Study A Representative Cross-Sectional Study on the Quality of the Care of Type-2-Diabetics in General Practices[Eine repräsentative Querschnittstudie zur Versorgungsqualität von Typ-2-Diabetikern in der Hausarztpraxis]. Z Allg Med. 2004, 80: 497-502.
Rothenbacher D, Ruter G, Saam S, Brenner H: [Management of patients with type 2 diabetes. Results in 12 practices of general practitioners]. Dtsch Med Wochenschr. 2002, 127: 1183-1187. 10.1055/s-2002-31940.
Rothenbacher D, Ruter G, Saam S, Brenner H: Younger patients with type 2 diabetes need better glycaemic control: results of a community-based study describing factors associated with a high HbA1c value. Br J Gen Pract. 2003, 53: 389-391.
Renders CM, Valk GD, Griffin S, Wagner EH, Eijk JT, Assendelft WJ: Interventions to improve the management of diabetes mellitus in primary care, outpatient and community settings. Cochrane Database Syst Rev. 2001, CD001481-
Weingarten SR, Henning JM, Badamgarav E, Knight K, Hasselblad V, Gano AJ, Ofman JJ: Interventions used in disease management programmes for patients with chronic illness-which ones work? Meta-analysis of published reports. BMJ. 2002, 325: 925-10.1136/bmj.325.7370.925.
Busse R: Disease management programs in Germany's statutory health insurance system. Health Aff (Millwood ). 2004, 23: 56-67. 10.1377/hlthaff.23.3.56.
Bundesausschuß G: Anforderungen an die Ausgestaltung von Disease-Management-Programmen für Patienten mit Diabetes mellitus Typ 2. 2002, [http://www.g-ba.de]
M M, U K: Demands on the Evaluation of Complex Healthcare Programs - Disease Management in Germany. Z Arztl Fortbild Qualitatssich. 2005, 99: 179-184.
A E, M S: Improved Diabetes Care in Saxony -Anhalt-results of the Evaluation of the Diabetes Model project (First Quarter 2001-Last Quarter 2002). Z Arztl Fortbild Qualitatssich. 2005, 99:
G B, HK S: Evaluation of the Pilot Project for the Gradula Area-Wide Outpatient Medical Care of Patients with Diabetes Mellitus in Southern Wuerttemberg. Z Arztl Fortbild Qualitatssich. 2005, 99: 185-189.
L A, W H, J O, G B: Modernes Diabetesmanagement in der ambulanten Versorgung. Ergebnisse der wissenschaftlichen Begleitung der Diabetesvereinbarungen in der Kassenärztlichen Vereinigung Nordrhein. 2002, Köln, Deutscher Ärzte-Verlag, [http://www.zi-berlin.de]
Gerlach FM, Beyer M, Szecsenyi J, Raspe H: [Evaluation of disease management programs--current deficits, demands and methods]. Z Arztl Fortbild Qualitatssich. 2003, 97: 495-501.
Campbell MK, Elbourne DR, Altman DG: CONSORT statement: extension to cluster randomised trials. BMJ. 2004, 328: 702-708. 10.1136/bmj.328.7441.702.
Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.
Grol R WMEM: Improving Patient Care. The implementation of change in clinical practice., . 2005, Oxford, Elsevier
Øvretveit J: Evaluating health interventions. 2000, London, Open University Press
Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/5/99/prepub
The study is funded by the AOK, the general regional health funds (= Allgemeine Ortskrankenkassen), Germany.
The authors declare that they have no competing interests. A contract between the authors and the funder (who might have an interest to show the effectiveness of DMP in this context) ensures that the authors have the full scientific responsiblility and will publish the results in any case.
SJ, TR, JS and MW conceived the study and draft the manuscript. SL, MH, JG and PKK participated in designing the study. All authors read and approved the final version of the manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Joos, S., Rosemann, T., Heiderhoff, M. et al. ELSID-Diabetes study-evaluation of a large scale implementation of disease management programmes for patients with type 2 diabetes. Rationale, design and conduct – a study protocol [ISRCTN08471887]. BMC Public Health 5, 99 (2005). https://doi.org/10.1186/1471-2458-5-99
- Routine Care
- Disease Management Program
- German Federal State
- Quality Circle
- Practice Team