Skip to main content
  • Correspondence
  • Open access
  • Published:

Implementation salvage experiences from the Melbourne diabetes prevention study

Abstract

Background

Many public health interventions based on apparently sound evidence from randomised controlled trials encounter difficulties when being scaled up within health systems. Even under the best of circumstances, implementation is exceedingly difficult. In this paper we will describe the implementation salvage experiences from the Melbourne Diabetes Prevention Study, which is a randomised controlled trial of the effectiveness and cost-effectiveness nested in the state-wide Life! Taking Action on Diabetes program in Victoria, Australia.

Discussion

The Melbourne Diabetes Prevention Study sits within an evolving larger scale implementation project, the Life! program. Changes that occurred during the roll-out of that program had a direct impact on the process of conducting this trial. The issues and methods of recovery the study team encountered were conceptualised using an implementation salvage strategies framework. The specific issues the study team came across included continuity of the state funding for Life! program and structural changes to the Life! program which consisted of adjustments to eligibility criteria, referral processes, structure and content, as well as alternative program delivery for different population groups. Staff turnover, recruitment problems, setting and venue concerns, availability of potential participants and participant characteristics were also identified as evaluation roadblocks. Each issue and corresponding salvage strategy is presented.

Summary

The experiences of conducting such a novel trial as the preliminary Melbourne Diabetes Prevention Study have been invaluable. The lessons learnt and knowledge gained will inform the future execution of this trial in the coming years. We anticipate that these results will also be beneficial to other researchers conducting similar trials in the public health field. We recommend that researchers openly share their experiences, barriers and challenges when conducting randomised controlled trials and implementation research. We encourage them to describe the factors that may have inhibited or enhanced the desired outcomes so that the academic community can learn and expand the research foundation of implementation salvage.

Peer Review reports

Background

Traditionally randomised controlled trials (RCTs) are scientific experiments that utilise controlled environments to allocate a treatment to the intervention group, while the control group receives a placebo or no treatment at all [1]. RCTs are considered to be the most reliable method for gathering evidence about the efficacy of public health interventions, as they uphold high standards of internal validity inherent in their methodological design [13]. Internal validity is defined as the extent to which the independent variable (health intervention; drug trial or lifestyle changes program) produces the desired effect or outcome [4]. Although RCTs provide reliable evidence about the efficacy of an intervention, they lack the ability to examine external validity which ascertains whether the results or effects seen in a small population can be expanded to or generalised to other populations or settings [4]. External validity is a measure of the effectiveness of an intervention in the real world [2].

The primary reason for conducting RCTs of public health interventions is to translate them into scaled up, system-wide programs [5]. A missing link between science and practice called implementation science or research has emerged through studying the process of implementing evidence-based programs and practices in the real world [68]. Implementation research is the study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice, to improve the quality and effectiveness of health services [9]. It includes the study of influences on healthcare professionals and organisational behaviour including processes, barriers and facilitators [9].

Many policies based on apparently sound evidence from RCTs encounter difficulties when being scaled up within health systems. Even under the best circumstances, implementation is exceedingly difficult. The road is likely to be full of unexpected detours, blind alleys, new opportunities and changing constraints. These constraints may vary over time leading to a trial and error approach to discover feasible solutions [10].

Not as well discussed in the literature is the process of evaluating an RCT alongside an already established and operational health intervention or program occurring in a real world, primary or community health care setting. We did not find any evidence in the literature of this particular evaluation methodology or the specific problems or issues that may be encountered when embarking on such an evaluation.

Implementation Salvage Strategies is a framework proposed by Hoagwood et al. (2011) to describe and understand the possible factors that can influence the conduct of a trial within real world circumstances and the possible solutions to such problems [11]. This model highlights specific factors that can impede on different phases of a trial, and is used to analyse, describe and promote strategies to rescue a study where it otherwise might be terminated.

In this paper we will describe the implementation salvage experiences for the Melbourne Diabetes Prevention Study (MDPS), which is an RCT of the effectiveness and cost-effectiveness nested within the Life! Taking Action on Diabetes program (Life!) conducted in Victoria, Australia. This state-wide type 2 diabetes prevention program for high risk individuals is funded by the Victorian Government Department of Health Victoria and delivered by Diabetes Australia – Victoria (DA–Vic), a non-government organisation (NGO), peak consumer body and leading charity representing all people affected by diabetes and those at risk.

We now describe how the need for adjustments to the real world Life! program created challenges for the nested RCT and our implementation salvage for the MDPS.

Context

Diabetes prevention

It was estimated that approximately 366 million adults, 8.3% of the adult population worldwide, had diabetes in 2011. This is expected to increase to 552 million adults, 9.9% of the expected population worldwide by 2030 [12]. These alarming statistics provide evidence for the need to prevent type 2 diabetes (T2D). Several recent clinical trials have demonstrated that lifestyle modifications with weight loss combined with dietary change and moderate exercise can reduce the incidence of T2D by up to 58% for people at high risk [1315]. Indeed, these have been shown to be even more effective than drug treatment in clinical trials, and have a prolonged impact [13, 16, 17]. The challenge has been to translate these findings into the real world.

Encouraging results from small efficacy evaluative trials conducted in the US, Finland and our own Greater Green Triangle Diabetes Prevention Program (GGT DPP) in Australia, have contributed to an emerging evidence base in this field [1820]. While there have been some positive results and lessons learnt about preventing diabetes in the real world, there were limitations in these studies. The samples were in some cases self-selected, were often small, some lacking a formal comparison group (control), and follow-up was generally short with the intervention remaining relatively intensive [21]. Understanding how to implement interventions on a large-scale is the next step in the process of translating diabetes prevention into multiple and multi-level population strategies that span the state or national stage [22]. There have been reported accounts in the literature of the challenges of translating clinical trials into effective population programmes, along with the development of recommendations and guidelines for prevention of type 2 diabetes [23, 24]. These frameworks are useful for evaluation and implementation processes. In addition more research is required to understand the effectiveness of interventions, their acceptability, uptake, reach, cost and how they work in different population sub-groups and via which mechanisms. This is particularly important for public health research, practice and policy [21]. Evaluations of this nature can determine program intensity, fidelity and sustainability in the long term.

Finland was the first country to undertake a large-scale diabetes prevention intervention. The national Development Programme for the Prevention and Care of Diabetes (DEHKO 2000–2010) was the first of its kind aiming to improve the quality of diabetes care, the support for self-care and the prevention of T2D and its complications [25]. One of the three main goals was to develop a community-based high risk program in primary and occupational care to prevent T2D, called the National Type 2 Diabetes Prevention Programme in Finland: FIN-D2D [26]. Other large scale diabetes prevention projects include the Diabetes in Europe – Prevention using Lifestyle, Physical Activity and Nutritional Intervention (DE-PLAN study) across Europe [27], and the Life! Taking Action on Diabetes program (Life!) in the Australian state of Victoria [28, 29].

Life! taking action on diabetes program

Life! is a state-wide, group based, lifestyle change program with the aim of targeting Victorians aged 50 years or over at high risk of developing T2D. The goals of the program are based on modifications to diet and physical activity. The program is conducted by Life! facilitators who are certified health professionals. Life! has direct lineage from the Finnish Diabetes Prevention Study (DPS) [15], the Good Ageing in Lahti region (GOAL) Implementation trial [18] and is the scaled-up version of the GGT DPP [20]. In addition, the Victorian Government’s Healthy Living Course randomised controlled trial in 2005 examined the feasibility of a six session group-based lifestyle intervention in a Victorian population [30], which also informed the development of the Life! program. The Life! program optimises intervention fidelity through a rigorous annual training and accreditation program for facilitators [31].

The Melbourne diabetes prevention study (MDPS)

The Melbourne Diabetes Prevention Study (MDPS) is a research project set up to study in detail a cohort of individuals undertaking the Life! program in order to evaluate the effectiveness of a large-scale prevention program, and importantly the cost-effectiveness. There is a paucity of data to assess the long-term clinical and economic impact of diabetes prevention programs. While there have been some modelling studies that have determined that lifestyle intervention is cost-effective for those with impaired glucose regulation [32, 33], uncertainties exist about model parameters, real costs and benefits of screening, and practical considerations about the affordability, acceptability and feasibility of interventions [21, 3234].

The MDPS is an RCT which aims to evaluate the efficacy and effectiveness of Life! by monitoring participants’ clinical and behavioural outcomes before and after the Life! intervention, as previously reported [35]. An economic assessment of Life! is also included in the MDPS to determine its ‘value-for-money’. The MDPS also provides the opportunity to utilise implementation research methodology to examine the process of implementing an evidence-based diabetes prevention program in the real world.

In brief, the MDPS intends to recruit 796 participants for this open randomised clinical trial, 398 will be allocated to the intervention arm and 398 to the usual care arm. Several methods of recruitment will be used in order to maximise the number of participants. Individuals aged 50 to 75 years will be screened with a risk tool (AUSDRISK[36]) to detect those at high risk of developing T2D. Those with existing diabetes will be excluded. Intervention participants will undergo anthropometric and laboratory tests, and comprehensive surveys at baseline, at three months (following the main part of the intervention) and 12 months, while control participants will undergo testing at baseline and 12 months only.

The intervention consists of an initial individual session followed by a series of five structured-group sessions. The first four group sessions will be carried out at two week intervals and the fifth session will occur eight months after the first group session. The intervention is based on the Health Action Process Approach (HAPA) model [3739] and sessions empower and enable participants to follow the five goals of the Life! program. The intervention fidelity is maintained through a thorough accreditation and training process for facilitators as outlined above. It is also achieved through employing a single facilitator to run all of the MDPS groups. This minimises the variability in course delivery and content participants will receive.

The primary outcomes under investigation are changes in diabetes and cardiovascular disease (CVD) risk as determined by changes in weight, waist circumference, fasting plasma and 2 h glucose, blood pressure and lipids at the baseline, 3 and 12 month assessments. The reduction in diabetes risk is calculated from the reduction in weight and waist circumference and the reduction in cardiovascular risk from changes to the Framingham risk score which incorporates the changes in the individual risk factors. Secondary outcomes consist of changes in psychosocial and quality of life measurements.

Discussion

Evaluation roadblocks

Encountering unexpected problems while conducting clinical trials is an inherent part of research, as discussed in detail by many authors [1, 4045]. Translating evidence-based practices and process from RCTs to large-scale implementation projects can be an even bigger test, and evaluation of the effectiveness of such projects can be an enormous task as public health interventions are often complex and difficult to evaluate. This evaluation is complicated in the MDPS as it is an RCT being conducted within an already established and operational, large-scale health intervention program.

The MDPS intervention arm sits within an evolving larger scale implementation project, the Life! program. Changes that occurred in the roll-out of that program had a direct impact on the process of conducting this trial. Life! is an evolving and changing program that is subject to modifications made at a political and environmental level beyond the control of the MDPS researchers. The nature of the Life! intervention was changing over time. This custom-tailoring of the Life! program was essential for its progress and success, and to assist with community engagement, promoting risk assessment, program entry, and sustainability. Such changes have implications on the fidelity and usefulness of the MDPS.

Life! was initiated in 2007, with the MDPS starting approximately 15 months later. From inception of the Life! program until 2010 numerous adjustments were made to the eligibility criteria, referral process, structure and content, as well as alternative program delivery for different population groups. These adjustments are outlined in detail below.

Ethics approval for the MDPS was obtained from Deakin University Human Research Ethics Committee (Project Code 2009–066).

Lessons learnt from MDPS

It was decided by the research team in 2009–10 to pause the MDPS after a total of n = 92 individuals completed the study and then to decide how to proceed further. This initial phase we now refer to as the preliminary MDPS study (pMDPS) [35]. This situation arose due to difficulties with recruiting participants into the RCT and due to uncertainties about what version of the Life! intervention was actually being evaluated. This break has given the study team the opportunity to reflect upon the study, to process the available information, to report preliminary results [35], and to learn from the experiences of undertaking implementation research in this ever changing context.

We have now started again and the new study called MDPS is informed by the pMDPS experience. As there were changes to the intervention and other things, the pMDPS and MDPS and their participants are being treated as separate entities to avoid threats to internal validity in both studies.

The summary in Table 1, with a few key examples explained in more detail below, outlines the issues the study team encountered in the pMDPS and methods of recovery that were and will be employed in the future execution of the MDPS. Implementation salvage strategies and techniques as discussed by Hoagwood et al. (2011) were used as a basis for conceptualising the issues and solutions outlined below [11].

Table 1 Melbourne diabetes prevention study evaluation roadblocks and salvage strategies

Implementation salvage strategies

Issue: sample selection

Two major challenges of conducting an RCT are recruitment and retention of participants. Inadequate recruitment is deleterious to RCTs, with consequences being reduction of power to detect intervention effects if target numbers are not achieved, and/or protracted recruitment. Delays may result which affect the generalisability of findings, and increase costs due to extension of time, which can all lead to premature termination of the trial [40, 43, 45]. Puffer and Torgerson (2003) state that in a survey of studies conducted from 2000–2001 approximately 60% of clinical trials had failed to meet their intended recruitment target or required time extensions to do so [46]. Furthermore, evidence suggests that response rates can be as low as 1% in intervention studies [41]. The success of clinical research is dependent on recruitment and retention of study participants.

As the MDPS aim is to evaluate the effectiveness and cost-effectiveness of the Life! program, recruitment strategies had to be concurrent with what was happening in the real world. In addition to GP recruitment, program referral occurred through accredited Life! Facilitators, the local community, partner agencies, the general public and the workplace. The political and environmental context influenced recruitment strategies. One was Victorian state-wide roll out of Life! which impacted on specific areas of metropolitan Melbourne that were originally reserved for MDPS recruitment only. This left the MDPS to compete within its allocated recruitment area with the Life! program. It is probable that when competing side by side like this, potential participants would prefer to enrol in the Life! program as they are guaranteed to receive the intervention [47].

General Practitioners (GPs) were required to confirm eligibility for the Life! program through completion of a referral form that included biochemical and anthropometric measures. Newly diagnosed T2D was a specific exclusion criterion. During this process GPs may have experienced some degree of ‘clinical equipoise’ [48] whereby their preference was to enrol participants into the Life! program over the MDPS as they wanted their patients to receive and benefit from the intervention immediately, believing that it would be ethically unjust not to do so. Clinical equipoise has been demonstrated to have a detrimental effect on recruitment [49]. When clinicians are uncertain about a treatment or they believe one treatment is more favourable than another, it can result in them not referring patients into trials where the ‘unfavoured or uncertain’ treatment is being studied [48].

Salvage strategy

MDPS salvage strategies have centred on establishing a systematic process for monitoring the success of recruitment streams at regular intervals and adapting recruitment activities accordingly. While the preliminary MDPS demonstrated that direct community recruitment yielded the highest numbers of recruits [50], a more targeted approach to recruitment in community and pharmacies has refined this process and reduced the financial burden to the study. The study team has broadened the geographic area for recruitment, and has utilised health professionals (such as Pharmacists) with current links to health care agencies in these areas to act as recruiters for the study. In addition, the study team has invested considerable time and resources into enhancing GP recruitment through educational seminars outlining the benefits of the MDPS, the newly revised content and structure, and differences between MDPS and the Life! program in order to prevent further clinical equipoise from occurring.

Potential contamination of control participants by them receiving the intervention (Life! program) is being monitored and will be taken into account during the analysis. Further analysis may also be undertaken to determine if there are any effects of selection bias. This will be done by comparisons between recruitment areas and between groups with different patient characteristics (such as motivation or perceived risk of diabetes) to see if there are any substantial differences.

Issue: recruitment

The MDPS utilised messages promoting free clinical tests. Our observations indicated that this may not have been an effective incentive to attract participants. This is in contrast to literature from the US that suggests that free health checks are an incentive to participate in clinical trials [19, 51]. This could be true in the US context where health care is not free or is otherwise heavily subsidized for most US citizens, unlike the universal health care coverage provided in Australia.

Also the perceived importance of diabetes prevention by the public is low. Berryman et al. (2009) have shown that diabetes is not regarded as an issue of great concern compared with other diseases, that perceived personal risk of contracting diabetes is low, and the seriousness of diabetes is underestimated because management appears straightforward [52].

Changing attitudes towards diabetes and participation in its prevention is difficult. Motivating individuals to attend a diabetes prevention program and change lifestyle behaviours requires more than an advertising message. Recruitment strategies used in RCTs require personalisation of the risk message by a suitable health professional as they are a trusted source of information and advice [52], but GP involvement is time-consuming and impractical in some contexts [47, 53]. Additionally, GPs own beliefs relating to the efficacy, effectiveness and side-effects of a program have been shown to influence both doctor and patient screening and recruitment in clinical trials [47, 48].

Salvage strategy

Although many of the participant characteristics that influence recruitment into clinical trials were outside of the control of the study investigators, there are some ways to overcome these challenges. Reallocating resources and effort to source ‘recruiting’ staff and mobilise them to develop a presence at local community organisations such as health clubs/gymnasiums, local churches, University of the Third Age campuses and community fetes and expos is a method to try and increase familiarity, trust and knowledge of the study with community members. Recruitment was also extended to community pharmacies in the local area. Strengthening relationships with potential participants is a method to reduce the barriers participants encounter when receiving health advice from a non-trusted source.

It has been demonstrated that strategies focusing on increasing potential participants’ awareness of the health problem, its impact on health, and their engagement in the learning process may increase recruitment into trials [40]. These points will be taken into account when tailoring how recruiters approach and explain the study to potential participants in the community. The use of AUSDRISK as a screening tool is an effective way to personalise risk of T2D at an individual level, as demonstrated in the GGT DPP efficacy trial [54]. The introduction of the new individual session for MDPS anticipated in future for the Life! program should overcome some of these difficulties.

Issue: structural changes to Life!

The Life! facilitator and participant workbooks were adapted from the course content delivered in the GGT DPP [20], GOAL Implementation Trial [18] and Finnish DPS [15]. Originally the course consisted of six group sessions that offered participants skills, knowledge, support and advice needed to make lifestyle changes in order to prevent T2D. The content of the course sessions were developed using health psychology theories of health behaviour change [3739, 55, 56] and the Health Action Process Approach (HAPA) [38, 57]. A trained facilitator [58] conducted each of the six sessions, the first five over three months and the final session at eight months. A physiotherapist/exercise physiologist and dietitian co-facilitated sessions three and four related to physical activity and nutrition respectively.

In early 2010, new participant manuals were introduced to accommodate individuals from various culturally and linguistically diverse backgrounds and those with low literacy levels. This new version included use of more illustrations to convey messages and supplementary materials for specific cultural needs. Additionally a more ‘streamlined’ approach was undertaken with regards to the structure of the sessions, with some changes made to content appearance and timing, to avoid repetition of curriculum. The dietitian and a physiotherapist/exercise physiologist changed to co-facilitating sessions two and four. This modification was made in response to requests from participants to have dietary information appear earlier in the course.

Originally individuals at high risk of developing T2D aged 50 years or over were eligible for Life! High risk was defined as scoring 15 or over on the AUSDRISK tool [36]. Those of Aboriginal or Torres Strait Islander (ATSI) descent, aged 18 years and over with an AUDRISK score of 12 more were also eligible.

Eligibility criteria were revised in July 2010 to include individuals aged 50 years or over at high risk of T2D, who score 12 or more on the AUSDRISK, and additionally, any individual over the age of 18, regardless of AUSDRISK score, who were of ATSI descent or had previously been diagnosed with either gestational diabetes mellitus or cardiovascular disease (specifically ischemic heart disease). In addition, individuals who had received an occupational health assessment [59], and had an AUSDRISK score of 12 or more and aged 18–39 were funded to participate in the Life! program from a separate source.

Salvage strategy

Due to the numerous adjustments made to the eligibility criteria, referral processes, structure and content as described above, it was decided to make a small number of modifications to the MDPS intervention, to ensure consistency between the number of sessions offered to the future MDPS participants, and the content within those sessions. When re-started, MDPS will examine the version of Life! that we anticipate will be implemented in 2012.

One of the major changes to the MDPS version of Life! is that instead of running a six group-session program, the MDPS version of Life! will be modified to consist of an individual session at the beginning of the intervention phase and five group sessions. This parallels the Life! Program, which has a separately funded ‘first visit’. Participants will still receive the intervention from Facilitators employed or contracted through accredited Life! providers using the current Life! materials and manuals. It will be delivered using a standardised approach for all MDPS participants. To achieve this, required partnership agreements between local service providers of the Life! program and Life! facilitators were created, and they will run the new agreed version of MDPS. Approval for this was given by DA-Vic. It is hoped that this approach can be rolled out as a successful model to efficiently and systematically create partnerships with other sites who may be involved in the trial, therefore becoming a multi-site trial.

Although there were these changes to the Life! eligibility criteria, the MDPS research team decided to stay with the original criteria of adults aged 50 years or over with an AUSDRISK score of 15 or more, as this was what the funding body had endorsed and would contribute information on the cost-effectiveness of alternate design options.

Discussion of salvage strategies

What roadblocks were identified before starting the MDPS?

Although the MDPS research team did not perform a formal risk analysis, some potential roadblocks were identified when designing the MDPS. These included issues such as recruitment and dropout rates, and the impact of these were based on previous experience of implementing DPPs. Also, the issues surrounding usual care and other potential government or community diabetes initiatives impacting on the study were outlined in the study proposal and are monitored by the study now. Monitoring occurs through policies and procedures to identify potential roadblocks in the form of risk registries which are managed by the MDPS study board and implementation team.

However, the nature of implementing prevention programs in the real world means that some of the roadblocks could not be predicted at any early stage and the study team had to deal with issues as they arose. Furthermore, once the Life! program was implemented as part of government policy, time pressures and program momentum impacted on the ability to do a detailed risk analysis.

Do the roadblocks identified relate to what others have found?

The issues encountered when implementing the MDPS are similar to those outlined by leaders in population level diabetes prevention initiatives [23, 24]. They argue that in order for successful execution and sustainability of large population wide diabetes prevention programs consideration needs to be given to factors such as cost and resources, expertise of the research and implementation team, effective participant screening and uptake of the intervention, maintained investment from funding sources, ensuring management systems are of high quality and results are disseminated and utilised in an efficient way to all levels of government, the wider community and individuals.

Summary

The experiences of conducting such a novel trial as the MDPS have been invaluable. Table 1 provides a full list of barriers encountered in the implementation of the MDPS and proposed solutions. The lessons learnt and knowledge gained will inform the future execution of this trial in the coming years and enhance its potential to contribute to the ongoing Life! program. We anticipate that these results will also be beneficial to other researchers conducting similar trials in the public health field. Like Vedelø (2011), we also recommend that researchers openly share their experiences, barriers and challenges when conducting RCTs and implementation research [44]. We encourage them to describe the factors that may have inhibited or enhanced the desired outcomes so that the academic community can learn and expand the research foundation of implementation salvage.

References

  1. Stolberg HO, Norman G, Trop I: Randomized controlled trials. Am J Roentgenol. 2004, 183 (6): 1539-

    Article  Google Scholar 

  2. Glasgow RE, Lichtenstein E, Marcus AC: Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. Am J Public Health. 2003, 93 (8): 1261-1267. 10.2105/AJPH.93.8.1261.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Rychetnik L, Frommer M, Hawe P, Shiell A: Criteria for evaluating evidence on public health interventions. J Epidemiol Community Health. 2002, 56 (2): 119-10.1136/jech.56.2.119.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Salkind N: Internal and external validity. The SAGE Dictionary of Quantitative Management Research. Edited by: Moutinho L, Hutcheson G. 2011, London: SAGE Publications Ltd, 147-149.

    Google Scholar 

  5. Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA: Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998, 317 (7156): 465-468. 10.1136/bmj.317.7156.465.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B: Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009, 36 (1): 24-34. 10.1007/s10488-008-0197-4.

    Article  PubMed  Google Scholar 

  7. Stetler CB, McQueen L, Demakis J, Mittman BS: An organizational framework and strategic implementation for system-level change to enhance research-based practice: QUERI Series. Implement Sci. 2008, 3 (1): 30-10.1186/1748-5908-3-30.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Tansella M, Thornicroft G: Implementation science: understanding the translation of evidence into practice. Br J Psychiatry. 2009, 195 (4): 283-285. 10.1192/bjp.bp.109.065565.

    Article  PubMed  Google Scholar 

  9. Mittman B: Implementation research: Using science to guide implementation of evidence-based practices. 34th Annual National Conference, "PREP for the New Decade – Policy Research Education and Practice", Association for Medical Education and Research in Substance Abuse (AMERSA). 2010, Maryland US, http://www.amersa.org/Mittman-Implementation%20Research.ppt,

    Google Scholar 

  10. Pressman G, Wildavsky A: Implementation: how great expectations in Washington are dashed in Oakland. 1984, Berkley and Los Angeles: University of California Press, 3

    Google Scholar 

  11. Hoagwood K, Chaffin M, Chamberlain P, Bickman L, Mittman B: Implementation salvage strategies: maximizing methodological flexibility in children's mental health research. 4th Annual NIH Conference on the Science of Dissemination and Implementation: Policy and Practice. Edited by: Hoagwood K, Chaffin M, Chamberlain P, Bickman L, Mittman B. 2011, Maryland US, http://obssr.od.nih.gov/scientific_areas/translation/dissemination_and_implementation/DI2011/resources/1C%20Hoagwood%20Session%20Implementation%20Salvage%20Strategies%20NIH%20DI%20Conference%20FINAL%20%5BRead-Only%5D.pdf,

    Google Scholar 

  12. International Diabetes Federation 5th Edition, The Global Burden 5th Edition, The Burden. http://www.idf.org/diabetesatlas/5e/the-global-burden,

  13. Knowler WC, Barrett-Connor E, Fowler SE, Hamman RF, Lachin JM, Walker EA, Nathan DM: Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. N Engl J Med. 2002, 346 (6): 393-403.

    Article  CAS  PubMed  Google Scholar 

  14. Pan XR, Li GW, Hu YH, Wang JX, Yang WY, An ZX, Hu ZX, Lin J, Xiao JZ, Cao HB, et al: Effects of diet and exercise in preventing NIDDM in people with impaired glucose tolerance. The Da Qing IGT and Diabetes Study. Diabetes Care. 1997, 20 (4): 537-544.

    Article  CAS  Google Scholar 

  15. Tuomilehto J, Lindstrom J, Eriksson JG, Valle TT, Hamalainen H, Ilanne-Parikka P, Keinanen-Kiukaanniemi S, Laakso M, Louheranta A, Rastas M, et al: Prevention of type 2 diabetes mellitus by changes in lifestyle among subjects with impaired glucose tolerance. N Engl J Med. 2001, 344 (18): 1343-1350. 10.1056/NEJM200105033441801.

    Article  CAS  PubMed  Google Scholar 

  16. Diabetes Prevention Program Research G: 10-year follow-up of diabetes incidence and weight loss in the Diabetes Prevention Program Outcomes Study. Lancet. 2009, 374 (9702): 1677-1686. 10.1016/S0140-6736(09)61457-4.

    Article  Google Scholar 

  17. Gillies CL, Abrams KR, Lambert PC, Cooper NJ, Sutton AJ, Hsu RT, Khunti K: Pharmacological and lifestyle interventions to prevent or delay type 2 diabetes in people with impaired glucose tolerance: systematic review and meta-analysis. BMJ. 2007, 334 (7588): 299-302. 10.1136/bmj.39063.689375.55.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Absetz P, Valve R, Oldenberg B, Heinonen H, Nissinen A, Fogelholm M, Ilvesmaki V, Talja M, Uutela A: Type 2 diabetes prevention in the “real world” - one-year results of the GOAL implementation trial. Diabetes Care. 2007, 30 (10): 2465-2470. 10.2337/dc07-0171.

    Article  PubMed  Google Scholar 

  19. Ackermann RT, Finch EA, Brizendine E, Zhou H, Marrero DG: Translating the diabetes prevention program into the community: The DEPLOY Pilot study. Am J Prev Med. 2008, 35 (4): 357-363. 10.1016/j.amepre.2008.06.035.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Laatikainen T, Dunbar J, Chapman A, Kilkkinen A, Vartiainen E, Heistaro S, Philpot B, Absetz P, Bunker S, O'Neil A, et al: Prevention of type 2 diabetes by lifestyle intervention in an Australian primary health care setting: Greater Green Triangle (GGT) diabetes prevention project. BMC Public Health. 2007, 7 (1): 249-10.1186/1471-2458-7-249.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Simmons RK, Unwin N, Griffin SJ: International diabetes federation: an update of the evidence concerning the prevention of type 2 diabetes. Diabetes Research and Clinical Practice. 2010, 87 (2): 143-149. 10.1016/j.diabres.2009.10.003.

    Article  CAS  PubMed  Google Scholar 

  22. Venkat Narayan K, Benjamin E, Gregg E, Norris S, Engelgau M: Diabetes translation research: where are we and where do we want to be?. Ann Intern Med. 2004, 140 (11): 958-

    Article  Google Scholar 

  23. Lindström J, Neumann A, Sheppard K, Gilis-Januszewska A, Greaves C, Handke U, Pajunen P, Puhl S, Pölönen A, Rissanen A: Take action to prevent diabetes - the IMAGE toolkit for the prevention of type 2 diabetes in Europe. Horm Metab Res. 2010, 42: 37-10.1055/s-0029-1240975.

    Article  Google Scholar 

  24. Schwarz PE, Greaves CJ, Lindström J, Yates T, Davies MJ: Nonpharmacological interventions for the prevention of type 2 diabetes mellitus. Nat Rev Endocrinol. 2012, 8: 363-373.

    CAS  PubMed  Google Scholar 

  25. Finnish Diabetes Association: Programme for the Prevention and Care of Diabetes in Finland 2003–2010 (DEHKO). 2003, Jyväskylä, Finland: Finnish Diabetes Association

    Google Scholar 

  26. Saaristo T, Peltonen M, Keinanen-Kiukaanniemi S, Vanhala M, Saltevo J, Niskanen L, Oksa H, Korpi-Hyovalti E, Tuomilehto J: National type 2 diabetes prevention programme in Finland: FIN-D2D. Int J Circumpolar Health. 2007, 66 (2): 101-112.

    Article  PubMed  Google Scholar 

  27. Schwarz P, Lindström J, Kissimova-Scarbeck K, Szybinski Z, Barengo N, Peltonen M, Tuomilehto J: The European perspective of type 2 diabetes prevention: diabetes in Europe-prevention using lifestyle, physical activity and nutritional intervention (DE-PLAN) project. Exp Clin Endocrinol Diabetes. 2008, 116 (3): 167-172. 10.1055/s-2007-992115.

    Article  CAS  PubMed  Google Scholar 

  28. Dunbar J, Colagiuri S, Reddy P, Vita P, Timoshanko A, Audehm R, Milat A: Scaling up type 2 diabetes prevention programs: national and state interventions in Australia. Diabetes Prevention in Practice. Edited by: Schwarz P, Reddy P, Greaves C, Dunbar J, Schwarz J. 2010, Dresden: Tumaini Institute for Prevention Management

    Google Scholar 

  29. Reddy P, Rankins D, Timoshanko A, Dunbar JA: Life! in Australia: translating prevention research into a large-scale intervention. Br J Diabetes Vasc Dis. 2011, 11 (4): 193-197. 10.1177/1474651411410724.

    Article  Google Scholar 

  30. Moore SM, Hardie EA, Hackworth NJ, Critchley CR, Kyrios M, Buzwell SA, Crafti NA: Can the onset of type 2 diabetes be delayed by a group-based lifestyle intervention? A randomised control trial. Psychol Health. 2011, 26 (4): 485-499. 10.1080/08870440903548749.

    Article  PubMed  Google Scholar 

  31. Reddy P, Vaughan C, Dunbar J: Training facilitators of group-based diabetes prevention programs: recommendations from a public health intervention in Australia. Diabetes Prevention in Practice. Edited by: Schwarz P, Reddy P, Greaves C, Dunbar J, Schwarz J. 2010, Dresden: Tumaini Institute for Prevention Management

    Google Scholar 

  32. Gillies CL, Lambert PC, Abrams KR, Sutton AJ, Cooper NJ, Hsu RT, Davies MJ, Khunti K: Different strategies for screening and prevention of type 2 diabetes in adults: cost effectiveness analysis. BMJ. 2008, 336 (7654): 1180-10.1136/bmj.39545.585289.25.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Vos T, Carter R, Barendregt J, Mihalopoulos C, Veerman J, Magnus A, Cobiac L, Bertram M, Wallace A: Assessing cost-effectiveness in prevention (ACE-Prevention): final report. ACE–Prevention Team: Assessing cost-effectiveness in prevention (ACE-Prevention): final report. 2010, Brisbane and Deakin University, Melbourne: University of Queensland,

    Google Scholar 

  34. Goyder EC: Screening for and prevention of type 2 diabetes. BMJ. 2008, 336 (7654): 1140-10.1136/bmj.39553.480706.80.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Janus E, Best JD, Davis-Lameloise N, Philpot B, Hernan A, Bennett C, O'Reilly S, Carter R, Vartiainen E, Dunbar J: Scaling-up from an implementation trial to state-wide coverage: results from the preliminary Melbourne diabetes prevention study. Trials. 2012, Accepted in press

    Google Scholar 

  36. Chen L, Magliano D, Balkau B, Colagiuri S, Zimmet P, Tonkin A, Mitchell P, Phillips P, Shaw J: AUSDRISK: an Australian type 2 diabetes risk assessment tool based on demographic, lifestyle and simple anthropometric measures. Med J Aust. 2010, 192 (4): 197-202.

    PubMed  Google Scholar 

  37. Bandura A: Self-efficacy: The exercise of control. 1997, New York: Freeman

    Google Scholar 

  38. Schwarzer R: Self-efficacy in the adoption and maintenance of health behaviors: theoretical approaches and a new model. Self-efficacy: thought control of action. Edited by: Schwarzer R. 1992, Washington, DC: Hemisphere, 217-242.

    Google Scholar 

  39. Schwarzer R, Fuchs R: Self efficacy and health behaviors. Predicting health behavior: Research and practice with social cognition models. Edited by: Connor M, Norman P. 1996, Buckingham, U.K: Open University Press, 163-196.

    Google Scholar 

  40. Caldwell PHY, Hamilton S, Tan A, Craig JC: Strategies for increasing recruitment to randomised controlled trials: systematic review. PLoS Med. 2010, 7 (11): e1000368-10.1371/journal.pmed.1000368.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Gul RB, Ali PA: Clinical trials: the challenge of recruitment and retention of participants. J Clin Nurs. 2010, 19 (12): 227-233.

    Article  PubMed  Google Scholar 

  42. Netta-Turner D, Bucher L, Dixon L, Layton NJ: Riding the research roller coaster: what went right, what went wrong?. J Wound Ostomy Continence Nurs. 2008, 35 (5): 469-10.1097/01.WON.0000335957.52935.38.

    Article  PubMed  Google Scholar 

  43. Thomson CL, Morley KC, Teesson M, Sannibale C, Haber PS: Issues with recruitment to randomised controlled trials in the drug and alcohol field: a literature review and Australian case study. Drug Alcohol Rev. 2008, 27 (2): 115-122. 10.1080/09595230701829561.

    Article  PubMed  Google Scholar 

  44. Vedelø TW, Lomborg K: Reported challenges in nurse led randomised controlled trials: an integrative review of the literature. Scand J Caring Sci. 2011, 25 (1): 194-200. 10.1111/j.1471-6712.2010.00816.x.

    Article  PubMed  Google Scholar 

  45. Watson J, Torgerson D: Increasing recruitment to randomised trials: a review of randomised controlled trials. BMC Med Res Methodol. 2006, 6 (1): 34-10.1186/1471-2288-6-34.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Puffer S, Torgerson D: Recruitment difficulties in randomised controlled trials. Control Clin Trials. 2003, 24 (3): 214-215.

    Google Scholar 

  47. Wilson S, Delaney BC, Roalfe A, Roberts L, Redman V, Wearn AM, Hobbs F: Randomised controlled trials in primary care: case study. BMJ. 2000, 321 (7252): 24-

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  48. Freedman B: Equipoise and the ethics of clinical research. N Engl J Med. 1987, 317 (3): 141-145. 10.1056/NEJM198707163170304.

    Article  CAS  PubMed  Google Scholar 

  49. Chard J, Lilford R: The use of equipoise in clinical trials. Soc Sci Med. 1998, 47 (7): 891-898. 10.1016/S0277-9536(98)00153-1.

    Article  CAS  PubMed  Google Scholar 

  50. Rankins D, Hellinger H, Murphy B, Reddy P, Dunbar J: Effective recruitment in the Melbourne diabetes prevention study. 2010 PHCRED Tri-State Conference: 16–17 September 2010. 2010, Warrnambool Victoria Australia, http://www.greaterhealth.org/resources/635/,

    Google Scholar 

  51. Aby JS, Pheley AM, Steinberg P: Motivation for participation in clinical trials of drugs for the treatment of asthma, seasonal allergic rhinitis, and perennial nonallergic rhinitis. Ann Allerg Asthma Im. 1996, 76 (4): 348-354. 10.1016/S1081-1206(10)60036-1.

    Article  CAS  Google Scholar 

  52. Berryman D, Gill M, Pietsch J, Halloran H: Consulting consumers to develop marketing and recruitment strategies for a diabetes prevention program. Aust J Prim Health. 2009, 15 (2): 173-179. 10.1071/PY08062.

    Article  Google Scholar 

  53. Page M, French S, McKenzie J, O'Connor D, Green S: Recruitment difficulties in a primary care cluster randomised trial: investigating factors contributing to general practitioners' recruitment of patients. BMC Med Res Methodol. 2011, 11 (1): 35-10.1186/1471-2288-11-35.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Walker C, Reddy P, Hernan A, Dunbar J: What works in diabetes prevention programs: A qualitative evaluation of consumers responses. 2010 Primary Health Care Research Conference: 30 June - 2 July 2010. 2010, Darwin, Australia, http://www.greaterhealth.org/resources/595,

    Google Scholar 

  55. Bandura A: Social foundations of thought and action: A social cognitive theory. 1986, Upper Saddle River, New Jersey, USA: Prentice Hall

    Google Scholar 

  56. Schwarzer R, Renner B: Social-cognitive predictors of health behavior: action self-efficacy and coping self-efficacy. Health Psychol. 2000, 19 (5): 487-495.

    Article  CAS  PubMed  Google Scholar 

  57. Schwarzer R: Modeling health behavior change: how to predict and modify the adoption and maintenance of health behaviors. Appl Psychol - Int Rev. 2008, 57 (1): 1-29. 10.1111/j.1464-0597.2007.00325.x.

    Article  Google Scholar 

  58. Vaughan C, Reddy P, Dunbar J: From rural beginnings to statewide roll out: Evaluation of facilitator training for a group based diabetes prevention program. Aust J Rural Health. 2010, 18 (2): 59-65. 10.1111/j.1440-1584.2010.01126.x.

    Article  PubMed  Google Scholar 

  59. WorkHealth - Home. http://www.workhealth.vic.gov.au/,

  60. City of Knox - How old are we?. http://profile.id.com.au/Default.aspx?id=114&pg=102&gid=10&type=enum,

  61. Who is at risk of diabetes?. http://www.diabetesvic.org.au/diabetes-prevention/are-you-at-risk,

Pre-publication history

Download references

Acknowledgements

This study was funded by the National Health and Medical Research Council, grant number: 533819. We would like to acknowledge the Victorian Government Department of Health Victoria who funded Life! program and Diabetes Australia Victoria for implementing Life!, as well as MDPS project team members: Hayley Hellinger, Bridie Murphy, Prof Prasuna Reddy, Dr Deb Rankins, study nurses and recruiters.

The views expressed in this manuscript are those of the authors and do not necessarily represent, or should be attributed to, the views of the National Health and Medical Research Council, the Victorian Government Department of Health Victoria or Diabetes Australia Victoria.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to James Dunbar.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contribution

JD, EJ and RC and were responsible for the research question, design of the study, and for obtaining funding. AH and NDL wrote the first draft of this manuscript and were responsible for the revisions, along with EJ and JD. DA, SO, AT, ES, CB and GJ contributed to specific sections of the manuscript. RC is the team's expert in economic evaluations and was involved in the design of the study. JD is the general supervisor of the study and was involved in revising the article. All authors read and approved the final version of the manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Dunbar, J., Hernan, A., Janus, E. et al. Implementation salvage experiences from the Melbourne diabetes prevention study. BMC Public Health 12, 806 (2012). https://doi.org/10.1186/1471-2458-12-806

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2458-12-806

Keywords