This article has Open Peer Review reports available.
Implementation salvage experiences from the Melbourne diabetes prevention study
© Dunbar et al.; licensee BioMed Central Ltd. 2012
Received: 24 April 2012
Accepted: 17 September 2012
Published: 19 September 2012
Many public health interventions based on apparently sound evidence from randomised controlled trials encounter difficulties when being scaled up within health systems. Even under the best of circumstances, implementation is exceedingly difficult. In this paper we will describe the implementation salvage experiences from the Melbourne Diabetes Prevention Study, which is a randomised controlled trial of the effectiveness and cost-effectiveness nested in the state-wide Life! Taking Action on Diabetes program in Victoria, Australia.
The Melbourne Diabetes Prevention Study sits within an evolving larger scale implementation project, the Life! program. Changes that occurred during the roll-out of that program had a direct impact on the process of conducting this trial. The issues and methods of recovery the study team encountered were conceptualised using an implementation salvage strategies framework. The specific issues the study team came across included continuity of the state funding for Life! program and structural changes to the Life! program which consisted of adjustments to eligibility criteria, referral processes, structure and content, as well as alternative program delivery for different population groups. Staff turnover, recruitment problems, setting and venue concerns, availability of potential participants and participant characteristics were also identified as evaluation roadblocks. Each issue and corresponding salvage strategy is presented.
The experiences of conducting such a novel trial as the preliminary Melbourne Diabetes Prevention Study have been invaluable. The lessons learnt and knowledge gained will inform the future execution of this trial in the coming years. We anticipate that these results will also be beneficial to other researchers conducting similar trials in the public health field. We recommend that researchers openly share their experiences, barriers and challenges when conducting randomised controlled trials and implementation research. We encourage them to describe the factors that may have inhibited or enhanced the desired outcomes so that the academic community can learn and expand the research foundation of implementation salvage.
Traditionally randomised controlled trials (RCTs) are scientific experiments that utilise controlled environments to allocate a treatment to the intervention group, while the control group receives a placebo or no treatment at all . RCTs are considered to be the most reliable method for gathering evidence about the efficacy of public health interventions, as they uphold high standards of internal validity inherent in their methodological design [1–3]. Internal validity is defined as the extent to which the independent variable (health intervention; drug trial or lifestyle changes program) produces the desired effect or outcome . Although RCTs provide reliable evidence about the efficacy of an intervention, they lack the ability to examine external validity which ascertains whether the results or effects seen in a small population can be expanded to or generalised to other populations or settings . External validity is a measure of the effectiveness of an intervention in the real world .
The primary reason for conducting RCTs of public health interventions is to translate them into scaled up, system-wide programs . A missing link between science and practice called implementation science or research has emerged through studying the process of implementing evidence-based programs and practices in the real world [6–8]. Implementation research is the study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice, to improve the quality and effectiveness of health services . It includes the study of influences on healthcare professionals and organisational behaviour including processes, barriers and facilitators .
Many policies based on apparently sound evidence from RCTs encounter difficulties when being scaled up within health systems. Even under the best circumstances, implementation is exceedingly difficult. The road is likely to be full of unexpected detours, blind alleys, new opportunities and changing constraints. These constraints may vary over time leading to a trial and error approach to discover feasible solutions .
Not as well discussed in the literature is the process of evaluating an RCT alongside an already established and operational health intervention or program occurring in a real world, primary or community health care setting. We did not find any evidence in the literature of this particular evaluation methodology or the specific problems or issues that may be encountered when embarking on such an evaluation.
Implementation Salvage Strategies is a framework proposed by Hoagwood et al. (2011) to describe and understand the possible factors that can influence the conduct of a trial within real world circumstances and the possible solutions to such problems . This model highlights specific factors that can impede on different phases of a trial, and is used to analyse, describe and promote strategies to rescue a study where it otherwise might be terminated.
In this paper we will describe the implementation salvage experiences for the Melbourne Diabetes Prevention Study (MDPS), which is an RCT of the effectiveness and cost-effectiveness nested within the Life! Taking Action on Diabetes program (Life!) conducted in Victoria, Australia. This state-wide type 2 diabetes prevention program for high risk individuals is funded by the Victorian Government Department of Health Victoria and delivered by Diabetes Australia – Victoria (DA–Vic), a non-government organisation (NGO), peak consumer body and leading charity representing all people affected by diabetes and those at risk.
We now describe how the need for adjustments to the real world Life! program created challenges for the nested RCT and our implementation salvage for the MDPS.
It was estimated that approximately 366 million adults, 8.3% of the adult population worldwide, had diabetes in 2011. This is expected to increase to 552 million adults, 9.9% of the expected population worldwide by 2030 . These alarming statistics provide evidence for the need to prevent type 2 diabetes (T2D). Several recent clinical trials have demonstrated that lifestyle modifications with weight loss combined with dietary change and moderate exercise can reduce the incidence of T2D by up to 58% for people at high risk [13–15]. Indeed, these have been shown to be even more effective than drug treatment in clinical trials, and have a prolonged impact [13, 16, 17]. The challenge has been to translate these findings into the real world.
Encouraging results from small efficacy evaluative trials conducted in the US, Finland and our own Greater Green Triangle Diabetes Prevention Program (GGT DPP) in Australia, have contributed to an emerging evidence base in this field [18–20]. While there have been some positive results and lessons learnt about preventing diabetes in the real world, there were limitations in these studies. The samples were in some cases self-selected, were often small, some lacking a formal comparison group (control), and follow-up was generally short with the intervention remaining relatively intensive . Understanding how to implement interventions on a large-scale is the next step in the process of translating diabetes prevention into multiple and multi-level population strategies that span the state or national stage . There have been reported accounts in the literature of the challenges of translating clinical trials into effective population programmes, along with the development of recommendations and guidelines for prevention of type 2 diabetes [23, 24]. These frameworks are useful for evaluation and implementation processes. In addition more research is required to understand the effectiveness of interventions, their acceptability, uptake, reach, cost and how they work in different population sub-groups and via which mechanisms. This is particularly important for public health research, practice and policy . Evaluations of this nature can determine program intensity, fidelity and sustainability in the long term.
Finland was the first country to undertake a large-scale diabetes prevention intervention. The national Development Programme for the Prevention and Care of Diabetes (DEHKO 2000–2010) was the first of its kind aiming to improve the quality of diabetes care, the support for self-care and the prevention of T2D and its complications . One of the three main goals was to develop a community-based high risk program in primary and occupational care to prevent T2D, called the National Type 2 Diabetes Prevention Programme in Finland: FIN-D2D . Other large scale diabetes prevention projects include the Diabetes in Europe – Prevention using Lifestyle, Physical Activity and Nutritional Intervention (DE-PLAN study) across Europe , and the Life! Taking Action on Diabetes program (Life!) in the Australian state of Victoria [28, 29].
Life! taking action on diabetes program
Life! is a state-wide, group based, lifestyle change program with the aim of targeting Victorians aged 50 years or over at high risk of developing T2D. The goals of the program are based on modifications to diet and physical activity. The program is conducted by Life! facilitators who are certified health professionals. Life! has direct lineage from the Finnish Diabetes Prevention Study (DPS) , the Good Ageing in Lahti region (GOAL) Implementation trial  and is the scaled-up version of the GGT DPP . In addition, the Victorian Government’s Healthy Living Course randomised controlled trial in 2005 examined the feasibility of a six session group-based lifestyle intervention in a Victorian population , which also informed the development of the Life! program. The Life! program optimises intervention fidelity through a rigorous annual training and accreditation program for facilitators .
The Melbourne diabetes prevention study (MDPS)
The Melbourne Diabetes Prevention Study (MDPS) is a research project set up to study in detail a cohort of individuals undertaking the Life! program in order to evaluate the effectiveness of a large-scale prevention program, and importantly the cost-effectiveness. There is a paucity of data to assess the long-term clinical and economic impact of diabetes prevention programs. While there have been some modelling studies that have determined that lifestyle intervention is cost-effective for those with impaired glucose regulation [32, 33], uncertainties exist about model parameters, real costs and benefits of screening, and practical considerations about the affordability, acceptability and feasibility of interventions [21, 32–34].
The MDPS is an RCT which aims to evaluate the efficacy and effectiveness of Life! by monitoring participants’ clinical and behavioural outcomes before and after the Life! intervention, as previously reported . An economic assessment of Life! is also included in the MDPS to determine its ‘value-for-money’. The MDPS also provides the opportunity to utilise implementation research methodology to examine the process of implementing an evidence-based diabetes prevention program in the real world.
In brief, the MDPS intends to recruit 796 participants for this open randomised clinical trial, 398 will be allocated to the intervention arm and 398 to the usual care arm. Several methods of recruitment will be used in order to maximise the number of participants. Individuals aged 50 to 75 years will be screened with a risk tool (AUSDRISK) to detect those at high risk of developing T2D. Those with existing diabetes will be excluded. Intervention participants will undergo anthropometric and laboratory tests, and comprehensive surveys at baseline, at three months (following the main part of the intervention) and 12 months, while control participants will undergo testing at baseline and 12 months only.
The intervention consists of an initial individual session followed by a series of five structured-group sessions. The first four group sessions will be carried out at two week intervals and the fifth session will occur eight months after the first group session. The intervention is based on the Health Action Process Approach (HAPA) model [37–39] and sessions empower and enable participants to follow the five goals of the Life! program. The intervention fidelity is maintained through a thorough accreditation and training process for facilitators as outlined above. It is also achieved through employing a single facilitator to run all of the MDPS groups. This minimises the variability in course delivery and content participants will receive.
The primary outcomes under investigation are changes in diabetes and cardiovascular disease (CVD) risk as determined by changes in weight, waist circumference, fasting plasma and 2 h glucose, blood pressure and lipids at the baseline, 3 and 12 month assessments. The reduction in diabetes risk is calculated from the reduction in weight and waist circumference and the reduction in cardiovascular risk from changes to the Framingham risk score which incorporates the changes in the individual risk factors. Secondary outcomes consist of changes in psychosocial and quality of life measurements.
Encountering unexpected problems while conducting clinical trials is an inherent part of research, as discussed in detail by many authors [1, 40–45]. Translating evidence-based practices and process from RCTs to large-scale implementation projects can be an even bigger test, and evaluation of the effectiveness of such projects can be an enormous task as public health interventions are often complex and difficult to evaluate. This evaluation is complicated in the MDPS as it is an RCT being conducted within an already established and operational, large-scale health intervention program.
The MDPS intervention arm sits within an evolving larger scale implementation project, the Life! program. Changes that occurred in the roll-out of that program had a direct impact on the process of conducting this trial. Life! is an evolving and changing program that is subject to modifications made at a political and environmental level beyond the control of the MDPS researchers. The nature of the Life! intervention was changing over time. This custom-tailoring of the Life! program was essential for its progress and success, and to assist with community engagement, promoting risk assessment, program entry, and sustainability. Such changes have implications on the fidelity and usefulness of the MDPS.
Life! was initiated in 2007, with the MDPS starting approximately 15 months later. From inception of the Life! program until 2010 numerous adjustments were made to the eligibility criteria, referral process, structure and content, as well as alternative program delivery for different population groups. These adjustments are outlined in detail below.
Ethics approval for the MDPS was obtained from Deakin University Human Research Ethics Committee (Project Code 2009–066).
Lessons learnt from MDPS
It was decided by the research team in 2009–10 to pause the MDPS after a total of n = 92 individuals completed the study and then to decide how to proceed further. This initial phase we now refer to as the preliminary MDPS study (pMDPS) . This situation arose due to difficulties with recruiting participants into the RCT and due to uncertainties about what version of the Life! intervention was actually being evaluated. This break has given the study team the opportunity to reflect upon the study, to process the available information, to report preliminary results , and to learn from the experiences of undertaking implementation research in this ever changing context.
We have now started again and the new study called MDPS is informed by the pMDPS experience. As there were changes to the intervention and other things, the pMDPS and MDPS and their participants are being treated as separate entities to avoid threats to internal validity in both studies.
Melbourne diabetes prevention study evaluation roadblocks and salvage strategies
MDPS evaluation roadblock
Threat to trial validity
Logistical implementation issue
High turnover of staff in the initial stages of conducting the trial led to lack of communication, inconsistency in trial management, inadequate resource allocation, and time delays to recruit participants.
· A strategic leadership and management role was created to oversee the trial and provide an essential link between external stakeholders and the study team.
· Effort and time was allocated to identify and employ a study coordinator, who wasexperienced in research coordination with a local knowledge of health care organisations/referral pathways/the Life! Program and who could successfully manage the trial.
Under-recruitment and contamination of control group
Recruitment for MDPS had to replicate what was happening in the real world. Life! recruitment strategies included referral sources such as the community. This took away resources and time from establishing relationships and partnerships with local general practice clinics and divisions.
· MDPS reallocated resources and effort to source casual ‘recruiting’ staff and mobilize them to develop a presence at local community organisations such as health clubs/gymnasiums, pharmacies, local churches, University of the Third Age campuses and community fetes and expos.
Additionally, earlier than expected state wide roll out of Life! meant that MDPS had to compete with Life! providers for participants.
· The study team closely monitors recruitment activities and adapts and refines the recruitment processes at regular intervals.
Logistical and procedural implementation issue
In order to conduct the trial research staff needed a venue to perform clinical tests and the group sessions. Venue hire was expensive and general practice and division staff, and Life! Providers were not directly involved in the trial.
· The study team engaged front line agencies (community venues and Life! providers) through establishing a partnership agreement that outlines the benefits for each party and the roles and responsibilities expected throughout the duration of the trial (including clear referral pathways to refer patients to MDPS and provision of venues).
Under-recruitment and under-estimation of effectiveness,
After investigating the recruitment profile of the regions targeted in this study it was recognized that there is a tight and not necessarily readily accessible pool of potential participants over the age of 50 at high risk of diabetes (approximately 8,000 people [60, 61]). Therefore recruitment procedures need to efficiently capture and engage the population at risk.
· In addition to expanding recruitment sources from the community, recruitment was also extended to community pharmacies in the local area.
· Approaches to creating and maintain effective collaborations and partnerships can be rolled out to other divisions of general practices or community health services throughout eastern metropolitan Melbourne, as a method to increase the catchment area of potential study participants.
Many factors influence recruitment at the participant- level. These factors include low perception of diabetes risk  and low motivation to participate in trials.
· Risk awareness increased through social media and marketing from DA-Vic at a local level to promote the Life! program.
· Promotional materials have been developed for the study to engage health professionals, organisations and the general public. These materials have utilised local area facts to enhance personalisation of the program to potential participants of the trial.
Continuity of State funding for Life! program
Logistical implementation issue
Life! was dependent on the State health department’s continued funding beyond the period 2007–11. This funding was not automatically guaranteed. Therefore MDPS was reliant on this funding as well, which caused study delays whilst waiting to receive confirmation about ongoing funding.
Although in May 2011 Life! was granted further funding for another four years, the MDPS research team developed contingency plans during this time of uncertainty that consisted of:
· Strengthening already established relationships with partner organisation (DA-Vic) to mobilise strategic advocacy for the program.
· Proposing to self-fund or source alternative funding to run the intervention for trial participants.
Structural changes to Life!
Life! is a real world program that continually changes and evolves through time. This made it difficult to accurately assess what was being implemented in the real world and therefore difficult to evaluate the intervention effect.
· To maintain fidelity of the intervention, the MDPS research team improved communication with DA-Vic to have more input over what was being delivered to trial participants. This included a partnership agreement between local Life! providers who would run a specified modified version of the Life! program for the forthcoming MDPS.
Implementation salvage strategies
Issue: sample selection
Two major challenges of conducting an RCT are recruitment and retention of participants. Inadequate recruitment is deleterious to RCTs, with consequences being reduction of power to detect intervention effects if target numbers are not achieved, and/or protracted recruitment. Delays may result which affect the generalisability of findings, and increase costs due to extension of time, which can all lead to premature termination of the trial [40, 43, 45]. Puffer and Torgerson (2003) state that in a survey of studies conducted from 2000–2001 approximately 60% of clinical trials had failed to meet their intended recruitment target or required time extensions to do so . Furthermore, evidence suggests that response rates can be as low as 1% in intervention studies . The success of clinical research is dependent on recruitment and retention of study participants.
As the MDPS aim is to evaluate the effectiveness and cost-effectiveness of the Life! program, recruitment strategies had to be concurrent with what was happening in the real world. In addition to GP recruitment, program referral occurred through accredited Life! Facilitators, the local community, partner agencies, the general public and the workplace. The political and environmental context influenced recruitment strategies. One was Victorian state-wide roll out of Life! which impacted on specific areas of metropolitan Melbourne that were originally reserved for MDPS recruitment only. This left the MDPS to compete within its allocated recruitment area with the Life! program. It is probable that when competing side by side like this, potential participants would prefer to enrol in the Life! program as they are guaranteed to receive the intervention .
General Practitioners (GPs) were required to confirm eligibility for the Life! program through completion of a referral form that included biochemical and anthropometric measures. Newly diagnosed T2D was a specific exclusion criterion. During this process GPs may have experienced some degree of ‘clinical equipoise’  whereby their preference was to enrol participants into the Life! program over the MDPS as they wanted their patients to receive and benefit from the intervention immediately, believing that it would be ethically unjust not to do so. Clinical equipoise has been demonstrated to have a detrimental effect on recruitment . When clinicians are uncertain about a treatment or they believe one treatment is more favourable than another, it can result in them not referring patients into trials where the ‘unfavoured or uncertain’ treatment is being studied .
MDPS salvage strategies have centred on establishing a systematic process for monitoring the success of recruitment streams at regular intervals and adapting recruitment activities accordingly. While the preliminary MDPS demonstrated that direct community recruitment yielded the highest numbers of recruits , a more targeted approach to recruitment in community and pharmacies has refined this process and reduced the financial burden to the study. The study team has broadened the geographic area for recruitment, and has utilised health professionals (such as Pharmacists) with current links to health care agencies in these areas to act as recruiters for the study. In addition, the study team has invested considerable time and resources into enhancing GP recruitment through educational seminars outlining the benefits of the MDPS, the newly revised content and structure, and differences between MDPS and the Life! program in order to prevent further clinical equipoise from occurring.
Potential contamination of control participants by them receiving the intervention (Life! program) is being monitored and will be taken into account during the analysis. Further analysis may also be undertaken to determine if there are any effects of selection bias. This will be done by comparisons between recruitment areas and between groups with different patient characteristics (such as motivation or perceived risk of diabetes) to see if there are any substantial differences.
The MDPS utilised messages promoting free clinical tests. Our observations indicated that this may not have been an effective incentive to attract participants. This is in contrast to literature from the US that suggests that free health checks are an incentive to participate in clinical trials [19, 51]. This could be true in the US context where health care is not free or is otherwise heavily subsidized for most US citizens, unlike the universal health care coverage provided in Australia.
Also the perceived importance of diabetes prevention by the public is low. Berryman et al. (2009) have shown that diabetes is not regarded as an issue of great concern compared with other diseases, that perceived personal risk of contracting diabetes is low, and the seriousness of diabetes is underestimated because management appears straightforward .
Changing attitudes towards diabetes and participation in its prevention is difficult. Motivating individuals to attend a diabetes prevention program and change lifestyle behaviours requires more than an advertising message. Recruitment strategies used in RCTs require personalisation of the risk message by a suitable health professional as they are a trusted source of information and advice , but GP involvement is time-consuming and impractical in some contexts [47, 53]. Additionally, GPs own beliefs relating to the efficacy, effectiveness and side-effects of a program have been shown to influence both doctor and patient screening and recruitment in clinical trials [47, 48].
Although many of the participant characteristics that influence recruitment into clinical trials were outside of the control of the study investigators, there are some ways to overcome these challenges. Reallocating resources and effort to source ‘recruiting’ staff and mobilise them to develop a presence at local community organisations such as health clubs/gymnasiums, local churches, University of the Third Age campuses and community fetes and expos is a method to try and increase familiarity, trust and knowledge of the study with community members. Recruitment was also extended to community pharmacies in the local area. Strengthening relationships with potential participants is a method to reduce the barriers participants encounter when receiving health advice from a non-trusted source.
It has been demonstrated that strategies focusing on increasing potential participants’ awareness of the health problem, its impact on health, and their engagement in the learning process may increase recruitment into trials . These points will be taken into account when tailoring how recruiters approach and explain the study to potential participants in the community. The use of AUSDRISK as a screening tool is an effective way to personalise risk of T2D at an individual level, as demonstrated in the GGT DPP efficacy trial . The introduction of the new individual session for MDPS anticipated in future for the Life! program should overcome some of these difficulties.
Issue: structural changes to Life!
The Life! facilitator and participant workbooks were adapted from the course content delivered in the GGT DPP , GOAL Implementation Trial  and Finnish DPS . Originally the course consisted of six group sessions that offered participants skills, knowledge, support and advice needed to make lifestyle changes in order to prevent T2D. The content of the course sessions were developed using health psychology theories of health behaviour change [37–39, 55, 56] and the Health Action Process Approach (HAPA) [38, 57]. A trained facilitator  conducted each of the six sessions, the first five over three months and the final session at eight months. A physiotherapist/exercise physiologist and dietitian co-facilitated sessions three and four related to physical activity and nutrition respectively.
In early 2010, new participant manuals were introduced to accommodate individuals from various culturally and linguistically diverse backgrounds and those with low literacy levels. This new version included use of more illustrations to convey messages and supplementary materials for specific cultural needs. Additionally a more ‘streamlined’ approach was undertaken with regards to the structure of the sessions, with some changes made to content appearance and timing, to avoid repetition of curriculum. The dietitian and a physiotherapist/exercise physiologist changed to co-facilitating sessions two and four. This modification was made in response to requests from participants to have dietary information appear earlier in the course.
Originally individuals at high risk of developing T2D aged 50 years or over were eligible for Life! High risk was defined as scoring 15 or over on the AUSDRISK tool . Those of Aboriginal or Torres Strait Islander (ATSI) descent, aged 18 years and over with an AUDRISK score of 12 more were also eligible.
Eligibility criteria were revised in July 2010 to include individuals aged 50 years or over at high risk of T2D, who score 12 or more on the AUSDRISK, and additionally, any individual over the age of 18, regardless of AUSDRISK score, who were of ATSI descent or had previously been diagnosed with either gestational diabetes mellitus or cardiovascular disease (specifically ischemic heart disease). In addition, individuals who had received an occupational health assessment , and had an AUSDRISK score of 12 or more and aged 18–39 were funded to participate in the Life! program from a separate source.
Due to the numerous adjustments made to the eligibility criteria, referral processes, structure and content as described above, it was decided to make a small number of modifications to the MDPS intervention, to ensure consistency between the number of sessions offered to the future MDPS participants, and the content within those sessions. When re-started, MDPS will examine the version of Life! that we anticipate will be implemented in 2012.
One of the major changes to the MDPS version of Life! is that instead of running a six group-session program, the MDPS version of Life! will be modified to consist of an individual session at the beginning of the intervention phase and five group sessions. This parallels the Life! Program, which has a separately funded ‘first visit’. Participants will still receive the intervention from Facilitators employed or contracted through accredited Life! providers using the current Life! materials and manuals. It will be delivered using a standardised approach for all MDPS participants. To achieve this, required partnership agreements between local service providers of the Life! program and Life! facilitators were created, and they will run the new agreed version of MDPS. Approval for this was given by DA-Vic. It is hoped that this approach can be rolled out as a successful model to efficiently and systematically create partnerships with other sites who may be involved in the trial, therefore becoming a multi-site trial.
Although there were these changes to the Life! eligibility criteria, the MDPS research team decided to stay with the original criteria of adults aged 50 years or over with an AUSDRISK score of 15 or more, as this was what the funding body had endorsed and would contribute information on the cost-effectiveness of alternate design options.
Discussion of salvage strategies
What roadblocks were identified before starting the MDPS?
Although the MDPS research team did not perform a formal risk analysis, some potential roadblocks were identified when designing the MDPS. These included issues such as recruitment and dropout rates, and the impact of these were based on previous experience of implementing DPPs. Also, the issues surrounding usual care and other potential government or community diabetes initiatives impacting on the study were outlined in the study proposal and are monitored by the study now. Monitoring occurs through policies and procedures to identify potential roadblocks in the form of risk registries which are managed by the MDPS study board and implementation team.
However, the nature of implementing prevention programs in the real world means that some of the roadblocks could not be predicted at any early stage and the study team had to deal with issues as they arose. Furthermore, once the Life! program was implemented as part of government policy, time pressures and program momentum impacted on the ability to do a detailed risk analysis.
Do the roadblocks identified relate to what others have found?
The issues encountered when implementing the MDPS are similar to those outlined by leaders in population level diabetes prevention initiatives [23, 24]. They argue that in order for successful execution and sustainability of large population wide diabetes prevention programs consideration needs to be given to factors such as cost and resources, expertise of the research and implementation team, effective participant screening and uptake of the intervention, maintained investment from funding sources, ensuring management systems are of high quality and results are disseminated and utilised in an efficient way to all levels of government, the wider community and individuals.
The experiences of conducting such a novel trial as the MDPS have been invaluable. Table 1 provides a full list of barriers encountered in the implementation of the MDPS and proposed solutions. The lessons learnt and knowledge gained will inform the future execution of this trial in the coming years and enhance its potential to contribute to the ongoing Life! program. We anticipate that these results will also be beneficial to other researchers conducting similar trials in the public health field. Like Vedelø (2011), we also recommend that researchers openly share their experiences, barriers and challenges when conducting RCTs and implementation research . We encourage them to describe the factors that may have inhibited or enhanced the desired outcomes so that the academic community can learn and expand the research foundation of implementation salvage.
This study was funded by the National Health and Medical Research Council, grant number: 533819. We would like to acknowledge the Victorian Government Department of Health Victoria who funded Life! program and Diabetes Australia Victoria for implementing Life!, as well as MDPS project team members: Hayley Hellinger, Bridie Murphy, Prof Prasuna Reddy, Dr Deb Rankins, study nurses and recruiters.
The views expressed in this manuscript are those of the authors and do not necessarily represent, or should be attributed to, the views of the National Health and Medical Research Council, the Victorian Government Department of Health Victoria or Diabetes Australia Victoria.
- Stolberg HO, Norman G, Trop I: Randomized controlled trials. Am J Roentgenol. 2004, 183 (6): 1539-View ArticleGoogle Scholar
- Glasgow RE, Lichtenstein E, Marcus AC: Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003, 93 (8): 1261-1267. 10.2105/AJPH.93.8.1261.View ArticlePubMedPubMed CentralGoogle Scholar
- Rychetnik L, Frommer M, Hawe P, Shiell A: Criteria for evaluating evidence on public health interventions. J Epidemiol Community Health. 2002, 56 (2): 119-10.1136/jech.56.2.119.View ArticlePubMedPubMed CentralGoogle Scholar
- Salkind N: Internal and external validity. The SAGE Dictionary of Quantitative Management Research. Edited by: Moutinho L, Hutcheson G. 2011, London: SAGE Publications Ltd, 147-149.Google Scholar
- Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998, 317 (7156): 465-468. 10.1136/bmj.317.7156.465.View ArticlePubMedPubMed CentralGoogle Scholar
- Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B: Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009, 36 (1): 24-34. 10.1007/s10488-008-0197-4.View ArticlePubMedGoogle Scholar
- Stetler CB, McQueen L, Demakis J, Mittman BS: An organizational framework and strategic implementation for system-level change to enhance research-based practice: QUERI Series. Implement Sci. 2008, 3 (1): 30-10.1186/1748-5908-3-30.View ArticlePubMedPubMed CentralGoogle Scholar
- Tansella M, Thornicroft G: Implementation science: understanding the translation of evidence into practice. Br J Psychiatry. 2009, 195 (4): 283-285. 10.1192/bjp.bp.109.065565.View ArticlePubMedGoogle Scholar
- Mittman B: Implementation research: Using science to guide implementation of evidence-based practices. 34th Annual National Conference, "PREP for the New Decade – Policy Research Education and Practice", Association for Medical Education and Research in Substance Abuse (AMERSA). 2010, Maryland US, http://www.amersa.org/Mittman-Implementation%20Research.ppt,Google Scholar
- Pressman G, Wildavsky A: Implementation: how great expectations in Washington are dashed in Oakland. 1984, Berkley and Los Angeles: University of California Press, 3Google Scholar
- Hoagwood K, Chaffin M, Chamberlain P, Bickman L, Mittman B: Implementation salvage strategies: maximizing methodological flexibility in children's mental health research. 4th Annual NIH Conference on the Science of Dissemination and Implementation: Policy and Practice. Edited by: Hoagwood K, Chaffin M, Chamberlain P, Bickman L, Mittman B. 2011, Maryland US, http://obssr.od.nih.gov/scientific_areas/translation/dissemination_and_implementation/DI2011/resources/1C%20Hoagwood%20Session%20Implementation%20Salvage%20Strategies%20NIH%20DI%20Conference%20FINAL%20%5BRead-Only%5D.pdf,Google Scholar
- International Diabetes Federation 5th Edition, The Global Burden 5th Edition, The Burden. http://www.idf.org/diabetesatlas/5e/the-global-burden,
- Knowler WC, Barrett-Connor E, Fowler SE, Hamman RF, Lachin JM, Walker EA, Nathan DM: Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. N Engl J Med. 2002, 346 (6): 393-403.View ArticlePubMedGoogle Scholar
- Pan XR, Li GW, Hu YH, Wang JX, Yang WY, An ZX, Hu ZX, Lin J, Xiao JZ, Cao HB, et al: Effects of diet and exercise in preventing NIDDM in people with impaired glucose tolerance. The Da Qing IGT and Diabetes Study. Diabetes Care. 1997, 20 (4): 537-544.View ArticleGoogle Scholar
- Tuomilehto J, Lindstrom J, Eriksson JG, Valle TT, Hamalainen H, Ilanne-Parikka P, Keinanen-Kiukaanniemi S, Laakso M, Louheranta A, Rastas M, et al: Prevention of type 2 diabetes mellitus by changes in lifestyle among subjects with impaired glucose tolerance. N Engl J Med. 2001, 344 (18): 1343-1350. 10.1056/NEJM200105033441801.View ArticlePubMedGoogle Scholar
- Diabetes Prevention Program Research G: 10-year follow-up of diabetes incidence and weight loss in the Diabetes Prevention Program Outcomes Study. Lancet. 2009, 374 (9702): 1677-1686. 10.1016/S0140-6736(09)61457-4.View ArticleGoogle Scholar
- Gillies CL, Abrams KR, Lambert PC, Cooper NJ, Sutton AJ, Hsu RT, Khunti K: Pharmacological and lifestyle interventions to prevent or delay type 2 diabetes in people with impaired glucose tolerance: systematic review and meta-analysis. BMJ. 2007, 334 (7588): 299-302. 10.1136/bmj.39063.689375.55.View ArticlePubMedPubMed CentralGoogle Scholar
- Absetz P, Valve R, Oldenberg B, Heinonen H, Nissinen A, Fogelholm M, Ilvesmaki V, Talja M, Uutela A: Type 2 diabetes prevention in the “real world” - one-year results of the GOAL implementation trial. Diabetes Care. 2007, 30 (10): 2465-2470. 10.2337/dc07-0171.View ArticlePubMedGoogle Scholar
- Ackermann RT, Finch EA, Brizendine E, Zhou H, Marrero DG: Translating the diabetes prevention program into the community: The DEPLOY Pilot study. Am J Prev Med. 2008, 35 (4): 357-363. 10.1016/j.amepre.2008.06.035.View ArticlePubMedPubMed CentralGoogle Scholar
- Laatikainen T, Dunbar J, Chapman A, Kilkkinen A, Vartiainen E, Heistaro S, Philpot B, Absetz P, Bunker S, O'Neil A, et al: Prevention of type 2 diabetes by lifestyle intervention in an Australian primary health care setting: Greater Green Triangle (GGT) diabetes prevention project. BMC Public Health. 2007, 7 (1): 249-10.1186/1471-2458-7-249.View ArticlePubMedPubMed CentralGoogle Scholar
- Simmons RK, Unwin N, Griffin SJ: International diabetes federation: an update of the evidence concerning the prevention of type 2 diabetes. Diabetes Research and Clinical Practice. 2010, 87 (2): 143-149. 10.1016/j.diabres.2009.10.003.View ArticlePubMedGoogle Scholar
- Venkat Narayan K, Benjamin E, Gregg E, Norris S, Engelgau M: Diabetes translation research: where are we and where do we want to be?. Ann Intern Med. 2004, 140 (11): 958-View ArticleGoogle Scholar
- Lindström J, Neumann A, Sheppard K, Gilis-Januszewska A, Greaves C, Handke U, Pajunen P, Puhl S, Pölönen A, Rissanen A: Take action to prevent diabetes - the IMAGE toolkit for the prevention of type 2 diabetes in Europe. Horm Metab Res. 2010, 42: 37-10.1055/s-0029-1240975.View ArticleGoogle Scholar
- Schwarz PE, Greaves CJ, Lindström J, Yates T, Davies MJ: Nonpharmacological interventions for the prevention of type 2 diabetes mellitus. Nat Rev Endocrinol. 2012, 8: 363-373.PubMedGoogle Scholar
- Finnish Diabetes Association: Programme for the Prevention and Care of Diabetes in Finland 2003–2010 (DEHKO). 2003, Jyväskylä, Finland: Finnish Diabetes AssociationGoogle Scholar
- Saaristo T, Peltonen M, Keinanen-Kiukaanniemi S, Vanhala M, Saltevo J, Niskanen L, Oksa H, Korpi-Hyovalti E, Tuomilehto J: National type 2 diabetes prevention programme in Finland: FIN-D2D. Int J Circumpolar Health. 2007, 66 (2): 101-112.View ArticlePubMedGoogle Scholar
- Schwarz P, Lindström J, Kissimova-Scarbeck K, Szybinski Z, Barengo N, Peltonen M, Tuomilehto J: The European perspective of type 2 diabetes prevention: diabetes in Europe-prevention using lifestyle, physical activity and nutritional intervention (DE-PLAN) project. Exp Clin Endocrinol Diabetes. 2008, 116 (3): 167-172. 10.1055/s-2007-992115.View ArticlePubMedGoogle Scholar
- Dunbar J, Colagiuri S, Reddy P, Vita P, Timoshanko A, Audehm R, Milat A: Scaling up type 2 diabetes prevention programs: national and state interventions in Australia. Diabetes Prevention in Practice. Edited by: Schwarz P, Reddy P, Greaves C, Dunbar J, Schwarz J. 2010, Dresden: Tumaini Institute for Prevention ManagementGoogle Scholar
- Reddy P, Rankins D, Timoshanko A, Dunbar JA: Life! in Australia: translating prevention research into a large-scale intervention. Br J Diabetes Vasc Dis. 2011, 11 (4): 193-197. 10.1177/1474651411410724.View ArticleGoogle Scholar
- Moore SM, Hardie EA, Hackworth NJ, Critchley CR, Kyrios M, Buzwell SA, Crafti NA: Can the onset of type 2 diabetes be delayed by a group-based lifestyle intervention? A randomised control trial. Psychol Health. 2011, 26 (4): 485-499. 10.1080/08870440903548749.View ArticlePubMedGoogle Scholar
- Reddy P, Vaughan C, Dunbar J: Training facilitators of group-based diabetes prevention programs: recommendations from a public health intervention in Australia. Diabetes Prevention in Practice. Edited by: Schwarz P, Reddy P, Greaves C, Dunbar J, Schwarz J. 2010, Dresden: Tumaini Institute for Prevention ManagementGoogle Scholar
- Gillies CL, Lambert PC, Abrams KR, Sutton AJ, Cooper NJ, Hsu RT, Davies MJ, Khunti K: Different strategies for screening and prevention of type 2 diabetes in adults: cost effectiveness analysis. BMJ. 2008, 336 (7654): 1180-10.1136/bmj.39545.585289.25.View ArticlePubMedPubMed CentralGoogle Scholar
- Vos T, Carter R, Barendregt J, Mihalopoulos C, Veerman J, Magnus A, Cobiac L, Bertram M, Wallace A: Assessing cost-effectiveness in prevention (ACE-Prevention): final report. ACE–Prevention Team: Assessing cost-effectiveness in prevention (ACE-Prevention): final report. 2010, Brisbane and Deakin University, Melbourne: University of Queensland,Google Scholar
- Goyder EC: Screening for and prevention of type 2 diabetes. BMJ. 2008, 336 (7654): 1140-10.1136/bmj.39553.480706.80.View ArticlePubMedPubMed CentralGoogle Scholar
- Janus E, Best JD, Davis-Lameloise N, Philpot B, Hernan A, Bennett C, O'Reilly S, Carter R, Vartiainen E, Dunbar J: Scaling-up from an implementation trial to state-wide coverage: results from the preliminary Melbourne diabetes prevention study. Trials. 2012, Accepted in pressGoogle Scholar
- Chen L, Magliano D, Balkau B, Colagiuri S, Zimmet P, Tonkin A, Mitchell P, Phillips P, Shaw J: AUSDRISK: an Australian type 2 diabetes risk assessment tool based on demographic, lifestyle and simple anthropometric measures. Med J Aust. 2010, 192 (4): 197-202.PubMedGoogle Scholar
- Bandura A: Self-efficacy: The exercise of control. 1997, New York: FreemanGoogle Scholar
- Schwarzer R: Self-efficacy in the adoption and maintenance of health behaviors: theoretical approaches and a new model. Self-efficacy: thought control of action. Edited by: Schwarzer R. 1992, Washington, DC: Hemisphere, 217-242.Google Scholar
- Schwarzer R, Fuchs R: Self efficacy and health behaviors. Predicting health behavior: Research and practice with social cognition models. Edited by: Connor M, Norman P. 1996, Buckingham, U.K: Open University Press, 163-196.Google Scholar
- Caldwell PHY, Hamilton S, Tan A, Craig JC: Strategies for increasing recruitment to randomised controlled trials: systematic review. PLoS Med. 2010, 7 (11): e1000368-10.1371/journal.pmed.1000368.View ArticlePubMedPubMed CentralGoogle Scholar
- Gul RB, Ali PA: Clinical trials: the challenge of recruitment and retention of participants. J Clin Nurs. 2010, 19 (12): 227-233.View ArticlePubMedGoogle Scholar
- Netta-Turner D, Bucher L, Dixon L, Layton NJ: Riding the research roller coaster: what went right, what went wrong?. J Wound Ostomy Continence Nurs. 2008, 35 (5): 469-10.1097/01.WON.0000335957.52935.38.View ArticlePubMedGoogle Scholar
- Thomson CL, Morley KC, Teesson M, Sannibale C, Haber PS: Issues with recruitment to randomised controlled trials in the drug and alcohol field: a literature review and Australian case study. Drug Alcohol Rev. 2008, 27 (2): 115-122. 10.1080/09595230701829561.View ArticlePubMedGoogle Scholar
- Vedelø TW, Lomborg K: Reported challenges in nurse led randomised controlled trials: an integrative review of the literature. Scand J Caring Sci. 2011, 25 (1): 194-200. 10.1111/j.1471-6712.2010.00816.x.View ArticlePubMedGoogle Scholar
- Watson J, Torgerson D: Increasing recruitment to randomised trials: a review of randomised controlled trials. BMC Med Res Methodol. 2006, 6 (1): 34-10.1186/1471-2288-6-34.View ArticlePubMedPubMed CentralGoogle Scholar
- Puffer S, Torgerson D: Recruitment difficulties in randomised controlled trials. Control Clin Trials. 2003, 24 (3): 214-215.Google Scholar
- Wilson S, Delaney BC, Roalfe A, Roberts L, Redman V, Wearn AM, Hobbs F: Randomised controlled trials in primary care: case study. BMJ. 2000, 321 (7252): 24-View ArticlePubMedPubMed CentralGoogle Scholar
- Freedman B: Equipoise and the ethics of clinical research. N Engl J Med. 1987, 317 (3): 141-145. 10.1056/NEJM198707163170304.View ArticlePubMedGoogle Scholar
- Chard J, Lilford R: The use of equipoise in clinical trials. Soc Sci Med. 1998, 47 (7): 891-898. 10.1016/S0277-9536(98)00153-1.View ArticlePubMedGoogle Scholar
- Rankins D, Hellinger H, Murphy B, Reddy P, Dunbar J: Effective recruitment in the Melbourne diabetes prevention study. 2010 PHCRED Tri-State Conference: 16–17 September 2010. 2010, Warrnambool Victoria Australia, http://www.greaterhealth.org/resources/635/,Google Scholar
- Aby JS, Pheley AM, Steinberg P: Motivation for participation in clinical trials of drugs for the treatment of asthma, seasonal allergic rhinitis, and perennial nonallergic rhinitis. Ann Allerg Asthma Im. 1996, 76 (4): 348-354. 10.1016/S1081-1206(10)60036-1.View ArticleGoogle Scholar
- Berryman D, Gill M, Pietsch J, Halloran H: Consulting consumers to develop marketing and recruitment strategies for a diabetes prevention program. Aust J Prim Health. 2009, 15 (2): 173-179. 10.1071/PY08062.View ArticleGoogle Scholar
- Page M, French S, McKenzie J, O'Connor D, Green S: Recruitment difficulties in a primary care cluster randomised trial: investigating factors contributing to general practitioners' recruitment of patients. BMC Med Res Methodol. 2011, 11 (1): 35-10.1186/1471-2288-11-35.View ArticlePubMedPubMed CentralGoogle Scholar
- Walker C, Reddy P, Hernan A, Dunbar J: What works in diabetes prevention programs: A qualitative evaluation of consumers responses. 2010 Primary Health Care Research Conference: 30 June - 2 July 2010. 2010, Darwin, Australia, http://www.greaterhealth.org/resources/595,Google Scholar
- Bandura A: Social foundations of thought and action: A social cognitive theory. 1986, Upper Saddle River, New Jersey, USA: Prentice HallGoogle Scholar
- Schwarzer R, Renner B: Social-cognitive predictors of health behavior: action self-efficacy and coping self-efficacy. Health Psychol. 2000, 19 (5): 487-495.View ArticlePubMedGoogle Scholar
- Schwarzer R: Modeling health behavior change: how to predict and modify the adoption and maintenance of health behaviors. Appl Psychol - Int Rev. 2008, 57 (1): 1-29. 10.1111/j.1464-0597.2007.00325.x.View ArticleGoogle Scholar
- Vaughan C, Reddy P, Dunbar J: From rural beginnings to statewide roll out: Evaluation of facilitator training for a group based diabetes prevention program. Aust J Rural Health. 2010, 18 (2): 59-65. 10.1111/j.1440-1584.2010.01126.x.View ArticlePubMedGoogle Scholar
- WorkHealth - Home. http://www.workhealth.vic.gov.au/,
- City of Knox - How old are we?. http://profile.id.com.au/Default.aspx?id=114&pg=102&gid=10&type=enum,
- Who is at risk of diabetes?. http://www.diabetesvic.org.au/diabetes-prevention/are-you-at-risk,
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/12/806/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.