A knowledge management tool for public health: health-evidence.ca
- Maureen Dobbins1Email author,
- Kara DeCorby1,
- Paula Robeson1,
- Heather Husson†1,
- Daiva Tirilis†1 and
- Lori Greco1
© Dobbins et al; licensee BioMed Central Ltd. 2010
Received: 1 July 2009
Accepted: 18 August 2010
Published: 18 August 2010
The ultimate goal of knowledge translation and exchange (KTE) activities is to facilitate incorporation of research knowledge into program and policy development decision making. Evidence-informed decision making involves translation of the best available evidence from a systematically collected, appraised, and analyzed body of knowledge. Knowledge management (KM) is emerging as a key factor contributing to the realization of evidence-informed public health decision making. The goal of health-evidence.ca is to promote evidence-informed public health decision making through facilitation of decision maker access to, retrieval, and use of the best available synthesized research evidence evaluating the effectiveness of public health interventions.
The systematic reviews that populate health evidence.ca are identified through an extensive search (1985-present) of 7 electronic databases: MEDLINE, EMBASE, CINAHL, PsycINFO, Sociological Abstracts, BIOSIS, and SportDiscus; handsearching of over 20 journals; and reference list searches of all relevant reviews. Reviews are assessed for relevance and quality by two independent reviewers. Commonly-used public health terms are used to assign key words to each review, and project staff members compose short summaries highlighting results and implications for policy and practice.
As of June 2010, there are 1913 reviews in the health-evidence.ca registry in 21 public health and health promotion topic areas. Of these, 78% have been assessed as being of strong or moderate methodological quality. Health-evidence.ca receives approximately 35,000 visits per year, 20,596 of which are unique visitors, representing approximately 100 visits per day. Just under half of all visitors return to the site, with the average user spending six minutes and visiting seven pages per visit. Public health nurses, program managers, health promotion workers, researchers, and program coordinators are among the largest groups of registered users, followed by librarians, dieticians, medical officers of health, and nutritionists. The majority of users (67%) access the website from direct traffic (e.g., have the health-evidence.ca webpage bookmarked, or type it directly into their browser).
Consistent use of health-evidence.ca and particularly the searching for reviews that correspond with current public health priorities illustrates that health-evidence.ca may be playing an important role in achieving evidence-informed public health decision making.
The ultimate goal of knowledge translation and exchange (KTE) activities is to facilitate the incorporation of research knowledge into program and policy development decision making processes. The term implies that effective strategies are all that are needed to achieve this end. It is also understood that research knowledge, if only effectively translated, could inform policy and practice decisions and subsequently improve health outcomes . In fact, more than ten years ago a key recommendation arising from the Canadian National Forum on Health  was the development of an evidence informed health care system in Canada where policies and clinical decisions are influenced by high quality research knowledge. Evidence-informed decision making involves the translation of the best available evidence from a systematically collected, appraised, and analyzed body of knowledge . It is defined as a process characterized by: 1) clearly articulating a research question derived from a practice-based issue; 2) searching for and accessing relevant evidence; 3) appraising methodological rigor and choosing evidence of the highest quality with relevance to the practice issue and setting; 4) extracting evidence and interpreting it with consideration given to local context and resources; 5) incorporating it into practice, program, and policy decisions; and 6) evaluating the results [3, 4]. Despite political will, significant challenges in the past decade have impeded efforts in the realization of evidence-informed public health decision making in Canada.
Numerous barriers to evidence-informed decision making and the information needs of decision makers have been identified [5, 6]. Barriers include: difficulty keeping current with the large volume of evidence available; lack of access to full texts of journal articles; difficulty locating information specific and relevant to public health; difficulty accessing available evidence given the variations in search terms across databases; and difficulty tracking and saving search strategies and results . User needs include: a one-stop-shop for evidence; automatic notification of updates regarding newly available evidence; and high quality synthesized evidence .
The best ways to attain an evidence-informed public health system in Canada have not been identified, despite numerous studies on the effectiveness of KTE strategies. The evidence suggests that KTE strategies need to be interactive [7–9] and involve face-to-face interaction [10–12]. Involvement of decision-makers in the research process has also been associated with higher degrees of uptake [13, 14], and when the results or 'actionable messages' of research results are tailored to the specific needs of decision-makers then reported uptake is higher [1, 4, 7, 15, 16].
Knowledge management (KM) is emerging as a key factor contributing to the reduction of barriers to evidence-informed public health decision making [17–19]. KM is the systematic processes and resources used by individuals and organizations to identify, capture, store, retrieve, share, adapt, and (re)use tacit and explicit knowledge produced and/or needed by an organization [20, 21]. A good KM strategy provides a multitude of functions that respond directly to the needs of its intended users ; is transparent; and adheres to a rigorous process. Technology, in particular Internet-based technology, has not only emerged in the past decade as a key tool in realizing KM but also as a popular strategy to promote evidence-informed decision making [5, 23]. Certainly the potential of the Internet to reach large numbers of decision makers in a timely and cost-efficient manner is high, but whether Internet-enabled tools can facilitate evidence-informed decision making has yet to be determined.
One Canadian study evaluating the impact of the Internet as a KTE activity found that the dissemination of best practices information via the Internet to public health professionals encouraged participants to access information at other online sites compared to print-based dissemination . Participants in this same study cited easy access to relevant information as a major benefit, saving managers from having to identify, access, and retrieve their own literature. When traveling to face-to-face meetings is not possible (as is the case for many front line public health professionals due to the current economic status), the Internet provides a valuable communication and networking opportunity , while facilitating research collaboration .
The purpose of this paper is to describe http://www.health-evidence.ca a knowledge management tool, which is one component of a more comprehensive knowledge management strategy being developed to facilitate evidence-informed public health decision making in Canada.
Health-evidence.ca: A Knowledge Management Tool for Public Health
Systematic reviews and meta-analyses can be particularly powerful tools to inform and influence public health policy and practice decisions [27–29]. Furthermore, synthesized evidence provides a more consistent and conservative estimate of effect in comparison to individual studies [30–32]. Health Evidence is an organization whose mandate is to facilitate access to all systematic reviews and meta-analyses published since 1985 evaluating public health and health promotion interventions, as well as contribute to the development of capacity and culture for evidence-informed decision making. The website, http://www.health-evidence.ca is a key component of this developing KM system in Canada for front line public health professionals, policy-makers, research funders, researchers and students.
Work on the site began in April 2001 and the site was officially launched on March 10, 2005. A number of funded studies informed its development [12, 33, 34] and identified key functions and components preferred by public health decision makers. Results from these studies demonstrated a strong desire among Canadian public health decision makers for a national repository of research evidence, assessed for methodological quality and which could be accessed easily online [12, 15]. Lapelle et al  reported similar findings among American public health decision makers in the year following the launch of health-evidence.ca.
When health-evidence.ca was launched, the short term (1-3 years) objectives were to: a) provide an easily-accessible source of published, reliable, up-to-date reviews evaluating the effectiveness of public health and health promotion interventions; b) act as a communication tool to facilitate exchange among Canadian public health and health promotion decision makers and researchers; c) build familiarity with the interpretation and integration of research evidence into the decision-making process; d) provide decision makers with tools to enhance their critical appraisal skills; e) customize the content received by decision makers to their specified areas of interest; and f) improve strategic networking and partnership building among researchers, decision makers, and practitioners, by providing opportunities for interaction. The long term objectives (5-10 years) included: a) being the go-to source for published reviews of public health and health promotion effectiveness; b) to host various online communities of practice (Canadian and international in scope) to promote knowledge translation and exchange; and c) to provide a mechanism for evaluating innovative KTE strategies.
Embedded functions of health-evidence.ca include:
a user registration process that allows users to tailor the information they receive to particular areas of interest;
a free-text search system that enables the use of commonly-used public health and health promotion terms;
an assessment of the methodological quality of each review in health-evidence.ca;
a sorting system that allows users to narrow search results by review quality (strong, moderate, or weak), topic area, intervention location, or type;
a standardized short summary template (2-4 pages) for each review. Each summary frames the issue within a Canadian context and provides implications for policy and practice corresponding to each evidence point;
a built-in feedback mechanism provides users with the opportunity to give suggestions for ongoing site improvement.
In addition to national consultation with public health decision makers, a search was conducted to determine if an evidence resource like http://www.health-evidence.ca already existed. Two organizations at that time had developed evidence resources that were particularly noteworthy. The Centre for Reviews and Dissemination had developed a number of databases including the Database of Abstracts of Reviews of Effects (DARE), the Economic Evaluation Database, and a database of Health Technology Assessments. The Evidence for Policy and Practice Information and Coordinating Centre (EPPI Centre) also had developed a database of reviews covering a broad list of topic areas. However, closer examination determined that these databases did not address a number of challenges experienced by public health decision makers. For example, public health decision makers wanted a database specifically focused on public health services and interventions and furthermore a database that housed reviews that evaluated public health interventions. While the above databases included reviews evaluating public health interventions, a significant portion of the sites' content was not public health related. This increased the likelihood that users of the site would find evidence not directly applicable to public health. Given that finding public health relevant evidence was a key challenge identified by public health decision makers in North America, this supported, at least in part, the need for developing a public health specific resource.
A second challenge identified by public health decision makers at the time was a lack of skill in critically appraising reviews and the desire to have a credible resource conduct the appraisal for them. Exploration of the databases above illustrated that DARE appraises methodological quality of systematic reviews in the database, and makes this assessment available to users of the site. However, an explicit assessment of the methodological quality of the reviews housed in the EPPI Centre database was not provided.
Finally, a key challenge expressed by public health decision makers in finding reviews of effectiveness was in identifying the correct keywords and MeSH terms to include as part of a search strategy. Assessment of the available databases in 2000 demonstrated a need for an evidence resource that provided an easy to use search alternative - one that did not require the use of MeSH terms and preferably provided a drop-down list of known terms to choose from. Since the available evidence resources in 2000 did not address a number of the key challenges and barriers identified by public health decision makers, the development of http://www.health-evidence.ca seemed necessary and warranted, if movement toward EIDM was to be achieved at some point in the future, at least in Canada.
Development Phase (April 2000 to March 2005)
The systematic reviews that populate health evidence.ca are identified through an extensive search (1985-present) that includes electronic searches of 7 databases: MEDLINE, EMBASE, CINAHL, PsycINFO, Sociological Abstracts, BIOSIS, and SportDiscus. For MEDLINE, EMBASE, and PsycINFO, the systematic review hedge used in PUBMED, which includes the following terms: systematic review.tw., meta-analysis.pt., and intervention$.ti (Medline version) or/1-4, was used. The effectiveness of this hedge and others has been shown by others to significantly reduce the number of articles retrieved while maintaining a high level of sensitivity for finding articles that are relevant [35, 36]. We modified the hedge strategy slightly for EMBASE and CINAHL. When we compared the results of searches using the systematic review hedge to results of searches using the more general public health strategy, the systematic review hedge outperformed the latter [Lee, E., DeCorby, K., Dobbins, M.: Searching for reviews in the public health literature, unpublished]. For example, the systematic review hedge yielded 13259 articles in Medline and captured 186 of the 207 relevant articles indexed (sensitivity 89.9), compared to the general public health search which resulted in 46619 articles, and 191 relevant articles (sensitivity 92.3). Both searches resulted in a high number of relevant articles being identified. However, there was an almost four-fold difference between the precision scores between the two searches (1.1 vs. 0.3), meaning that the systematic reviews hedge captured a higher number of relevant articles while keeping the number of non-relevant articles captured low. This reduction in articles retrieved significantly decreased the number of articles needed to read from 244.9 down to 71.4 articles, meaning that only 72 articles rather than 245 articles would need to be screened in order to locate 1 relevant review. As a result, a decision was made to use this systematic review hedge as the basis for the search strategy and has been used since 2008.
While there are many quality assessment tools for appraising systematic reviews , this one was chosen because it had been tested and found to have acceptable reliability , and included key criteria as recently suggested by Moher . Hearty debate continues concerning the assignment of overall quality ratings (e.g. strong, moderate weak), with some strongly encouraging ratings not be provided but rather an assessment of each component of the process of conducting a systematic review. Proponents of this latter approach suggest decision makers should decide for themselves if a review merits use after being made aware of its strengths and weaknesses . However, our experience with public health decision makers is that they lack the necessary skills to interpret quality assessments that provide a commentary  per criterion rather than an overall score; and in fact, that they want someone credible, whom they trust to indicate if a review is 'good enough' to use in practice . In responding to this identified need an overall assessment rating is provided for each review on the site. However, in addressing the controversy related to an overall rating, the completed quality assessment tool for each review is also provided so that users can assess for themselves how each criterion has been scored.
Maintenance Phase (March 2005 - Present)
Between March 2005 and the present, http://www.health-evidence.ca has been updated quarterly through ongoing electronic searches, reference list searches, and handsearches. Each quarter, approximately 9,500 titles and abstracts are screened and the set of potentially relevant reviews is reduced to approximately 200-250 references, which are retrieved in full text. Searches have been programmed in four of the electronic health databases (MEDLINE, EMBASE, CINAHL, and PsycINFO) to be executed automatically upon database update (every 1-2 weeks). Links to the automatically generated results are emailed to the project manager for importing and tracking of the results sets. The three remaining electronic health databases (BIOSIS, SportDiscus and Sociological Abstracts) continue to be searched annually. Handsearching is also done annually over the summer months, due to its human resource intensiveness, and accessibility of 4th year undergraduate students or new graduates to assist in this activity. Students undergo extensive training in the process and all work is double rated by the project coordinator.
The functionality of http://www.health-evidence.ca continues to be upgraded in response to user feedback, emerging evidence of effective knowledge translation strategies, and changing technology. One such upgrade involved updating the keywording tool. Public health services, in Canada and elsewhere, continue to evolve. As a result, the keywording tool requires periodic updating. Between 2005 and 2006 feedback on the keywording tool from site users, librarians, and others was accumulated. In 2006 we identified a handful of terms that had to be added to the keywording tool, including Social Determinants of Health, Men's Health, and Reproductive Health. Once a final list of new terms was decided upon and checked for correctness and acceptability, all reviews in http://www.health-evidence.ca at that time (approximately 1000) were re-keyworded and uploaded to the live site. This time-intensive activity was conducted by two staff members under the supervision of the project manager and took approximately two months to complete. The currency of keywords is important and represents a significant challenge to evidence resources like http://www.health-evidence.ca. While it is important for the keywords to adequately reflect the scope of public health practice, this must be paired with the human resource costs of completing this work. Furthermore, if the new keyword term is one that requires new database searches to be conducted, this has considerable resource implications. Fortunately, new database searches were not required during the keyword tool upgrade in 2006. However, if new database searches had been required, additional funding sources to support this activity would need to have been acquired.
A controlled vocabulary has also been added as a key function to the site. Feedback from users illustrated that decision makers with different educational or philosophical backgrounds use different terminology for the same phenomenon. We often are asked to change a keyword or add a new one. Given the resources required to re-keyword, we have developed a controlled vocabulary system that allows these additional terms to be integrated into one's search. For example, a user may have typed in the word breastfeeding in the free text search box. When the results are displayed a separate box will also appear asking the user if they would like to include a list of similar terms in their search; for example, a search for breastfeeding will also ask the user if they would like to search for lactation, infant nutrition, infant feeding and breast milk.
Additional tips on searching have also been built into the system. For example, if a search produced a large number of results or very few results, a message pops up stating "Having trouble with your search?. Click here to view some useful tips on searching". The 'tips' page makes suggestions on what to do if too many or too few results were found, as well as an additional section if more help is wanted. If users click on the link for more help, we suggest sending us their search question via the feedback loop. Staff conduct the search, and respond within one business day not only with the results but suggestions on the optimal combination of search terms.
Other improvements made to the site since its launch include: the ability to save in one's user file up to 50 search strategies; the ability to use AND, OR, NOT, for combining search terms; additional information on the search results page allowing users to see at a glance the title, author, year of publication and quality assessment rating for each review found; and a pop-up glossary function that can be turned on/off using a toggle switch located on the top menu bar. When enabled, common terms used throughout the site appear underlined and will have a definition pop up when scrolled over. This includes terms such as evidence-informed decision making, confidence interval, odds ratio, and relative risk, which help users optimally understand the site content.
Numbers of Review by Topic Area
Focus of Review
Chronic Diseases (All)
Adult Health (All)
Addiction/Substance Use (All)
Physical Activity (All)
Mental Health (All)
Parenting, Infants and Children (All)
Injury Prevention/Safety (All)
Communicable Disease/Infection (All)
Reproductive Health (All)
Sexually Transmitted Infections (All)
Sexual Health (All)
Senior Health (All)
Healthy Communities (All)
Environmental Health (All)
Social Determinants of Health (All)
Dental Health (All)
Food Safety & Inspection (All)
Site Usage Statistics 2005 versus 2009
Website Visits Overview
March 10, 2005 - December 14, 2005
March 10, 2009 - December 14, 2009
Total Unique Visitors
Total Site Visits
Average visits per day
Average visit duration
Visits from Canada
Feedback from users has generally been positive. We are aware of the site being referenced in peer reviewed journals as either highlighting the site as a reference for public health decision makers [6, 41–44] or identifying various tools available on the site of interest to public health decision makers [45–47]. Furthermore, the site was recently recommended for use in the Institute of Health Economics' annual report .
Recent efforts to move toward more active rather than passive knowledge translation strategies have been implemented. For example newsletters are disseminated quarterly to both individual users, as well as those who belong to other networks with whom health-evidence.ca is partnered. Electronic dissemination of the newsletter coincides with completion of the quarterly updates of new content being added to the site. This electronic newsletter summarizes the new content posted to health-evidence.ca, as well as categorizes links to reviews assessed as being of strong or moderate methodological quality according to the 21 main topic areas. This facilitates easier access to relevant evidence for any given user. More recently, tailored messages have been implemented whereby registered users receive emails with links only to those new reviews that relate to topic areas identified in their user profiles. Other active knowledge translation strategies recently implemented include a webcast which saw more the 200 registrants, a Fireside chat (online webinar), and video clips of User stories (users of health-evidence were interviewed and video clips of these interviews are posted on the site).
Monitoring of usage statistics over the past year indicates that important increases in site visits occur immediately following the release of the electronic newsletter and tailored messages. For example, the release of the March 2008 newsletter resulted in more than 500 site visits daily in the two weeks following its release in comparison to the annual average daily site visit rate of 100. These user statistics identify health-evidence.ca as an established key resource for public health and health promotion decision makers in Canada. While these statistics do not allow inference concerning the incorporation of this evidence into public health policy and practice decisions, the fact that many users return to the site multiple times each year suggests that this knowledge management tool is fulfilling a need identified among this target population. In addition, it is also worth noting that the most highly-accessed reviews coincide with some of the most pressing policy and practice issues faced by public health decision makers from front-line practitioners to senior policy makers. Reviews related to chronic disease detection, prevention, and management, including obesity prevention, the promotion of healthy eating, diabetes prevention, and cancer screening interventions have been the most frequently downloaded. This coincides with priority public health topics identified by the Canadian Public Health Association .
Of course an evidence resource such as this is not without its challenges. While adherence to quarterly updates is an ambitious goal this means that at any given time the site is not completely current. At best, users can be confident that a very high percentage of reviews evaluating public health interventions published from 1985 to four months prior to accessing the site are present. While strategies to reduce this time lag are continually ongoing (e.g. the online collaboration system reduced the time lag from six months to four months), four months is the best attainable given current resource levels. In addition, requests are received to expand the content of the site beyond public health. However, users of the site tell us that the value added of this site is that it includes only public health evidence. A significant challenge we face however is the constant change and structure of public health services. For example, emerging areas in public health include the built environment, climate control, and geospatial analysis. As new areas of public health emerge, so must the scope of the searches employed by http://www.health-evidence.ca. However, funding for such activities may be challenging to obtain and it is not entirely clear at this time who would be best suited to fund such activities.
Another significant challenge for health-evidence, as we reflect on the past five years and contemplate the next five years, is technological advances. In 2005 when http://www.health-evidence.ca was launched, the system was built using state of the art technology at the time. However, within two years this technology was already outdated. Significant investment in the site in 2007/2008 led to the introduction of many new features and functions that were enabled by moving to emerging technology. However, in 2010, we are faced yet again with significant improvements in technology (Web 2.0) and failure to keep up with technology will hamper our efforts to interact actively with an audience that is constantly becoming more computer savvy. However, to remain current with technology requires resources that are often not available in publically funded environments.
Finally, long term stable funding for http://www.health-evidence.ca and similar evidence resources represents a significant challenge and cause for concern. Currently in Canada there exists limited opportunities to obtain infrastructure funding to sustain such resources, despite evidence of use among target users. Efforts to develop sustainable funding partnerships in the long term are ongoing so as to ensure this resource and other similar resources in different disciplines remain freely accessible. However, long term funding is an issue that should be addressed prior to the creation of similar such evidence resources in the future.
Future Plans for Site Development
Future goals for health-evidence.ca are to catalogue and make available the full text of all published review evidence on the effectiveness of public health interventions and to provide summaries of that evidence in both English and French. While health-evidence.ca provides all static content pages such as Additional Resources, site information, and tools, in French as well as English, funding has not yet been available to translate all of the reference material on the site, nor to screen, appraise, and summarize any French-language reviews encountered in the electronic database searching. However, efforts are ongoing to secure the resources to conduct this work. Health-evidence.ca is also prioritizing the translation of summaries for well-done (strong or moderate quality) reviews housed in the registry. Upcoming improvements to health-evidence.ca include expansion of the static content on the site, particularly related to evidence-informed decision making resources, and the exploration of search strategies for the published literature in zoonoses and causation questions for public health decision making. Research proposals have been submitted to national and provincial funding bodies to systematically and rigorously evaluate the impact of the site on evidence-informed public health decision making.
Knowledge management has recently been recognized as necessary for the delivery of effective public health services, and as a significant factor in the realization of evidence-informed public health decision making. This paper describes one example of a knowledge management tool for public health in Canada. It is encouraging to see the level of site usage by public health decision makers in Canada and abroad, as well as the accessing of reviews that correspond with current public health priorities. While this does not imply that http://www.health-evidence.ca is influencing public health policy and practice, it does illustrate awareness of this resource by the intended audience, which is a first step in the evidence-informed decision making process. However, it is important that knowledge management tools such as these be evaluated rigorously to determine not only if they are being accessed and used, but that they impact policy and program planning. Ongoing efforts to evaluate the site are underway and will be reported upon as results become available.
The authors gratefully acknowledge funding of the research project from the Canadian Institutes of Health Research, the Public Health Agency of Canada, the National Collaborating Centres for Public Health, the National Collaborating Centre for Methods and Tools, the City of Hamilton Public Health Services, Peel Public Health, and in-kind support from the Institut national de santé publique du Québec.
- Lavis JN, Robertson D, Woodside JM, McLeod CB, Abelson J, Knowledge Transfer Study Group: How can research organizations more effectively transfer research knowledge to decision makers?. The Milbank Quarterly. 2003, 81: 221-48. 10.1111/1468-0009.t01-1-00052.View ArticlePubMedPubMed CentralGoogle Scholar
- National Forum on Health: Canada Health Action: Building on the Legacy. 1997, OttawaGoogle Scholar
- Brownson RC, Fielding J, Maylahn C: Evidence based public health: A fundamental concept for public health practice. Annu Rev Public Health. 2009, 30: 175-201. 10.1146/annurev.publhealth.031308.100134.View ArticlePubMedGoogle Scholar
- Lomas J, Culyer T, McCutcheon C, McAuley L, Law S: Conceptualizing and combining evidence for health system guidance: Final report. 2005, Canadian Health Services Research FoundationGoogle Scholar
- Revere D, Turner AM, Madhavan A, Rambo N, Bugni PF, Kimball AM, Fuller SS: Understanding the information needs of public health practitioners: A literature review to inform design of an interactive digital knowledge management system. Journal of Biomedical Informatics. 2007, 40: 410-421. 10.1016/j.jbi.2006.12.008.View ArticlePubMedGoogle Scholar
- LaPelle NR, Luckmann R, Hatheway Simpson E, Martin ER: Identifying strategies to improve access to credible and relevant information for public health professionals: A qualitative study. BMC Public Health. 2006, 6: 89-101. 10.1186/1471-2458-6-89.View ArticlePubMedPubMed CentralGoogle Scholar
- Lavis J, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E: Towards systematic reviews that inform health care management and policy-making. Journal of Health Services Research & Policy. 2005, 10: 35-48.View ArticleGoogle Scholar
- Oxman AD, Thomson MA, Davis DA, Haynes RB: No magic bullets: A systematic review of 102 trials of interventions to improve professional practice. Can Med Assoc J. 1995, 153: 1423-1431.Google Scholar
- Bowen S, Zwi AB: Pathways to "evidence-informed" policy and practice: A framework for action. PLoS Medicine. 2005, 2: e166-10.1371/journal.pmed.0020166.View ArticlePubMedPubMed CentralGoogle Scholar
- Lavis J, Becerra Pasada F, Haines A, Osei E: Use of research to inform public policymaking. Lancet. 2004, 364: 1615-1621. 10.1016/S0140-6736(04)17317-0.View ArticlePubMedGoogle Scholar
- Lavis JN, Ross SE, Hurley JE, Hohenadel JM, Stoddart GL, Woodward CA, Abelson J: Examining the role of health services research in public policymaking. The Millbank Quarterly. 2002, 80: 125-154. 10.1111/1468-0009.00005.View ArticleGoogle Scholar
- Dobbins M, DeCorby K, Twiddy T: A knowledge transfer strategy for public health decision makers. Worldviews on Evidence-Based Nursing. 2004, 1: 120-128. 10.1111/j.1741-6787.2004.t01-1-04009.x.View ArticlePubMedGoogle Scholar
- Kothari A, Birch S, Charles C: "Interaction" and research utilisation in health policies and programs: Does it work?. Health Policy. 2005, 71: 117-125. 10.1016/j.healthpol.2004.03.010.View ArticlePubMedGoogle Scholar
- Kothari A, Edwards N, Brajtman S, Campbell B, Hamel N, Legault F, Mill J, Valaitis R: Fostering interactions: The networking needs of community health nursing researchers and decision makers. Evidence and Policy. 2005, 1: 291-304.View ArticleGoogle Scholar
- Dobbins M, Hanna S, Ciliska D, Thomas H, Manske S, Cameron R, Mercer S, O'Mara L, DeCorby K, Robeson P: A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies. Implementation Science. 2009, 4:Google Scholar
- Mitton C, Adair CE, McKenzie E, Patten SB, Waye Perry B: Knowledge transfer and exchange: Review and synthesis of the literature. The Milbank Quarterly. 2007, 85: 729-768. 10.1111/j.1468-0009.2007.00506.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Armstrong R, Waters E, Roberts H, Oliver S, Popay J: The role and theoretical evolution of knowledge translation and exchange in public health. J Public Health. 2006, 28: 384-389. 10.1093/pubmed/fdl072.View ArticleGoogle Scholar
- Kelly MP, Speller V, Meyrick J: Getting evidence into practice in public health. 2004, NHS Health Development Agency, ISSN 1-84279-267-9Google Scholar
- World Health Organization: Bridging the "know-do" gap in global health. 2006, Accessed 10-16-0008, [http://www.who.int/kms/en/]Google Scholar
- Nutley S, Davies H, Walter I: Learning from Knowledge Management: Conceptual Synthesis 2. 2004, University of St. Andrews: Research Unit for Research UtilisationGoogle Scholar
- Rumizen MC, Prusak L: The complete idiot's guide to knowledge management. 2002, Madison: CWL Publishing EnterprisesGoogle Scholar
- Davies P: Scoping the challenge: A systems approach. Canadian Health Services Research Foundation National Forum on Knowledge Transfer and Exchange; 10-24-2006. Toronto, ONGoogle Scholar
- Korner EJ, Oinonen MJ, Browne RC: The power of collaboration: using internet-based tools to facilitate networking and benchmarking within a consortium of academic health centers. J Med Syst. 2003, 27: 47-56. 10.1023/A:1021057128835.View ArticlePubMedGoogle Scholar
- Edwards N, Lockett D, Gurd G, Leonard L: Effectiveness of internet-based dissemination of best practices for public health professionals. 2000, University of Ottawa: Ottawa, ONGoogle Scholar
- McCartney P: The new networking. American Journal of Maternal/Child Nursing. 1998, 23: 159-160. 10.1097/00005721-199805000-00012.View ArticleGoogle Scholar
- Song S: Guidelines on the use of electronic networking to facilitate regional or global research networks. Edited by: Smith OB. 1999, International Development Research Centre, 162-168.Google Scholar
- Rychetnik L, Frommer M: A schema for evaluating evidence on public health interventions. 2002, Accessed 3-18-2008, [http://www.dhs.vic.gov.au/nphp/publications/phpractice/schemaV4.pdf]Google Scholar
- Conn VS, Armer JM: Meta-analysis and public policy: Opportunity for nursing impact. Nurs Outlook. 1996, 44: 267-271. 10.1016/S0029-6554(96)80082-0.View ArticlePubMedGoogle Scholar
- Cook DJ, Mulrow CD, Haynes RB: Systematic reviews: synthesis of best evidence for clinical decisions. Ann Intern Med. 1997, 126: 376-380.View ArticlePubMedGoogle Scholar
- Fineout-Overholt E, O'Mathuna DP, Kent B: How systematic reviews can foster evidence-based clinical decisions. Worldviews on Evidence-Based Nursing. 2008, 5: 45-48. 10.1111/j.1741-6787.2008.00116.x.View ArticlePubMedGoogle Scholar
- McAuley L, Pham B, Tugwell P, Moher D: Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses?. Lancet. 2000, 356: 1228-1231. 10.1016/S0140-6736(00)02786-0.View ArticlePubMedGoogle Scholar
- Ciliska D, Dobbins M, Thomas H: Using systematic reviews in health services. Reviewing research evidence for nursing practice: Systematic reviews. Edited by: Webb C, Roe B. 2007, Malden, MA, USA: Wiley-Blackwell, 245-253.Google Scholar
- Dobbins M, Cockerill R, Barnsley J, Ciliska D: Factors of the innovation, organization, environment, and individual that predict the influence five systematic reviews had on public health decisions. Int J Technol Assess Health Care. 2001, 17: 467-478. 10.1017/S0266462300105069.View ArticlePubMedGoogle Scholar
- Dobbins M, Thomas H, O'Brien MA, Duggan M: The use of systematic reviews in the development of new provincial public health policies in Ontario. Int J Technol Assess Health Care. 2004, 20: 399-404. 10.1017/S0266462304001278.View ArticlePubMedGoogle Scholar
- Hunt DL, McKibbon KA: Locating and appraising systematic reviews. Ann Intern Med. 1997, 126: 532-538.View ArticlePubMedGoogle Scholar
- Montori VM, Wilczynski NL, Morgan D, Haynes RB: Optimal search strategies for retrieving systematic reviews from Medline: Analytical survey. BMJ. 2005, 330: 68-73. 10.1136/bmj.38336.804167.47.View ArticlePubMedPubMed CentralGoogle Scholar
- Oxman AD, Guyatt GH: Validation of an index of the quality of review articles. J Clin Epidemiol. 1991, 44: 1271-1278. 10.1016/0895-4356(91)90160-B.View ArticlePubMedGoogle Scholar
- Katrak P, Bialocerkowski AE, Massy-Westropp N, Saravana Kumar VS, Grimmer KA: A systematic review of the content of critical appaisal tools. BMC Medical Research Methodology. 2004, 4: 1-11. 10.1186/1471-2288-4-22.View ArticleGoogle Scholar
- Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ. 2009, 339: 10.1136/bmj.b2535.Google Scholar
- Higgins JPT, Green S: Assessing risk of bias in included studies. Cochrane Handbook for Systematic Reviews of Interventions. Edited by: Higgins JPT, Altman DG. 2008, The Cochrane Collaboration, [http://www.cochrane-handbook.org]5.0.1View ArticleGoogle Scholar
- Dooris M: Healthy settings: Challenges to generating evidence of effectiveness. Health Promot Int. 2006, 21: 55-65. 10.1093/heapro/dai030.View ArticlePubMedGoogle Scholar
- Doyle J, Waters E, Yach D, McQueen D, De Francisco A, Stewart T, Reddy P, Gulmezoglu AM, Galea G, Portela A: Global priority setting for Cochrane systematic reviews of health promotions and public health research. J Epidemiol Community Health. 2005, 59: 193-197. 10.1136/jech.2003.019547.View ArticlePubMedPubMed CentralGoogle Scholar
- Lavis J: How can we support the use of systamatic reviews in policymaking?. PLoS Medicine. 2009, 6: e1000141-10.1371/journal.pmed.1000141.View ArticlePubMedPubMed CentralGoogle Scholar
- Lavis JN, Wilson MG, Oxman AD, Grimshaw J, Lewin S, Fretheim A: SUPPORT tools for evidence-informed health policymaking (STP) 5: Using research evidence to frame options to address a problem. Health Research Policy & Systems. 2009, 7 (suppl 1):Google Scholar
- Heller RF, Verma A, Gemmell I, Harrison R, Hart J, Edwards R: Critical appraisal for public health: A new checklist. Public Health. 2008, 122: 92-98. 10.1016/j.puhe.2007.04.012.View ArticlePubMedGoogle Scholar
- Kiefer L, Frank J, Di Ruggiero E, Dobbins M, Manuel D, Gully PR, Mowat D: Fostering evidence-based decision-making in Canada: Examining the need for a Canadian Population and Public Health Evidence Centre and Research Network. Can J Public Health. 2005, 96: I-1-I-19.Google Scholar
- McKibbon KA, Lokker C: Searching for research findings in KT literature. Knowledge translation in health care: Moving from evidence to practice. Edited by: Straus SE, Tetroe J, Graham ID. 2009, Hoboken: Wiley-BlackwellGoogle Scholar
- Chatterley T, Dennett L: Health technology on the Net: A guide to internet sources of information. 2009, Institute of Health Economica: AlbertaGoogle Scholar
- Canadian Public Health Association: Canadian Public Health Association Centennial Conference: Key priority areas. Public Health in Canada: Shaping the Future Together; 6-14-2010. Toronto, ONGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/10/496/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.