Educational intervention to improve physician reporting of adverse drug reactions (ADRs) in a primary care setting in complementary and alternative medicine
© Tabali et al; licensee BioMed Central Ltd. 2009
Received: 27 November 2008
Accepted: 31 July 2009
Published: 31 July 2009
Recent studies have shown that adverse drug reactions (ADRs) are underreported. This may be particularly true of ADRs associated with complementary and alternative medicine (CAM). Data on CAM-related ADRs, however, are sparse.
Objective was to evaluate the impact of an educational intervention and monitoring programme designed to improve physician reporting of ADRs in a primary care setting.
A prospective multicentre study with 38 primary care practitioners specialized in CAM was conducted from January 2004 through June 2007. After 21 month all physicians received an educational intervention in terms of face-to-face training to assist them in classifying and reporting ADRs. The study centre monitored the quantity and quality of ADR reports and analysed the results.
To measure changes in the ADR reporting rate, the median number of ADR reports and interquartile range (IQR) were calculated before and after the educational intervention. The pre-intervention and post-intervention quality of the reports was assessed in terms of changes in the completeness of data provided for obligatory items. Interrater reliability between the physicians and the study centre was calculated using Cohen's kappa with a 95% confidence interval (CI). We used Mann Whitney U-test for testing continuous data and chi-square test was used for categorical data. The level of statistical significance was set at P < 0.05.
A total of 404 ADRs were reported during the complete study period. An initial 148% increase (P = 0.001) in the number of ADR reports was observed after the educational intervention. Compared to baseline the postinterventional number of ADR reportings was statistically significant higher (P < 0.005) through the first 16 months after the intervention but not significant in the last 4-month period (median: 8.00 (IQR [2.75; 8.75]; P = 0.605). The completeness of the ADR reports increased from 80.3% before to 90.7% after the intervention. The completeness of the item for classifying ADRs as serious or non-serious increased significantly (P < 0.001) after the educational intervention. The quality of ADR reports increased from kappa 0.15 (95% CI: 0.08; 0.29) before to 0.43 (95% CI: 0.23; 0.63) after the intervention.
The results of the present study demonstrate that an educational intervention can increase physician awareness of ADRs. Participating physicians were able to incorporate the knowledge they had gained from face-to-face training into their daily clinical practice. However, the effects of the intervention were temporary.
The World Health Organization defines adverse drug reactions (ADRs) as 'a reaction which is noxious and unintended and which occurs at doses normally used in humans for prevention, diagnosis or therapy of disease, or for the modification of physiological functions' . ADRs are considered to be a leading cause of morbidity and mortality . Indeed, it has been shown that approximately 5.3% of hospital admissions were associated with ADRs .
Although conventional clinical studies on efficacy and safety are suitable for recognizing frequent ADRs and are required for the approval of a new drug, they often fail to detect rare ADRs . As a result, a number of spontaneous reporting systems have been developed in recent decades to help detect serious, rare, and unexpected ADRs. These systems are characterized, however, by a high rate of underreporting, which varies depending on the types of ADRs and drugs in question . A systematic review about determinants of under-reporting found that a large proportion of physicians did not report ADRs because they felt that these were well known or too trivial . However the knowledge and attitudes of health professionals appear to be strongly related with reporting and are potentially modifiable factors .
Educational interventions have been shown to influence reporting rates [8–10]. In a cluster-randomized controlled trial in Portugal, a 10-fold increase in the rate of ADR reports was observed following an educational intervention . In contrast to the targeted outreach visits employed in the Portuguese study, however, a solely passive method of dissemination based on mailing educational materials to selected clinicians did not lead to any improvements in the reporting of ADRs in another study .
Over the past 20 years, the use of complementary and alternative medicine (CAM), including homeopathic, anthroposophic, and herbal treatment, has increased markedly in Western industrialized nations [12, 13]. This has created a challenging situation when it comes to detecting, evaluating, and reporting ADRs, because many patients – and, remarkably, even CAM physicians – believe that these kinds of treatments are not associated with risk . Patient surveys have suggested that this assumption may be traced to the belief that CAM products are 'natural' and therefore harmless . Assumptions like these have led to a discrepancy between the growing interest in CAM remedies and the limited data on their potential to cause ADRs [13, 15–17]. The seriousness of this situation is compounded by the poor quality of most individual ADR reports .
The aim of the present study was therefore to analyse the impact of a face-to-face educational intervention and on the quantity and quality of ADR reports filed by a network of 38 CAM physicians working in the primary care sector in Germany. To assess the sustainability of this intervention we also assessed the duration of the effect of this intervention and analysed the impact of the intervention with regards to CAM and non CAM drugs.
The present study was designed as a prospective multicentre observational study within the EvaMed Pharmacovigilance Network, which aims to evaluate complementary remedies in primary care with regard to prescribing patterns, efficacy, and safety . As the study is based on anonymised data on adverse drug reactions which are obligatory to report in Germany and no experimental research or intervention on patients were applied, no ethical approval was needed. Physicians were recruited through the German National Association of Anthroposophic Physicians (Gesellschaft Anthroposophischer Ärzte in Deutschland; GAÄD). A total of 362 physicians were contacted and informed about the EvaMed Network by standard mail and, in case of non-response, four weeks later by telephone. For a physician to be eligible to participate in the study, his or her medical practice had to meet a number of technical requirements, including the presence of a special computerized patient documentation system (DocExpert, DocConcept, TurboMed, Duria, AdamedPlus, Medistar), a local area network (LAN) connection, and Microsoft Windows and Internet Explorer (i.e. as client software). A total of 38 physicians from 12 of 16 German states fulfilled the technical requirements, gave informed consent and agreed to participate. None of them was working in a health centre. For electronic documentation the QuaDoSta system already known by the physicians was used, which has been described in detail elsewhere [20, 21]. The QuaDoSta system was free for all physicians.
Anthroposophic medicine is a whole medical system founded in the 1920s by Rudolf Steiner and Ita Wegman. As a form of complementary medicine, it is regarded as an extension to conventional treatment, requiring that a physician work together with his or her patients to understand the meaning of their illness by carefully exploring the physical, mental, and spiritual aspects of their biography. Thus, although anthroposophic physicians employ conventional medical treatments such as surgery and medicine as needed, they also seek to stimulate patients' salutogenetic capacities by using unique anthroposophic therapies and remedies. Anthroposophic remedies include preparations of mineral, botanical, or zoological origin, as well as chemical substances that are either undiluted or based on the homeopathic principle of high dilution. Data on patients who were treated with any kind of drug (i.e. conventional, anthroposophic, homeopathic, or herbal) during the study period were included in the current analysis.
The educational intervention was divided into a theoretical and a practical part. The theoretical part consisted of a presentation on the economic and epidemiological importance of ADRs, as well as on the definition and classification of ADRs (i.e. in terms of seriousness, severity, and causality). Physicians were instructed to report all ADRs, including those that were mild or anticipated. Every physician received a manual summarizing the main points of the training session. The practical part of the intervention included a problem-based learning course that provided practical examples of how to document ADRs using their QuaDoSta software package. Each year, all physicians received two newsletters with details about the study and were invited to a meeting to discuss their experiences.
Two weeks after the educational intervention, physicians were called and asked if they had encountered any problems; if so, they were provided with support. A telephone hotline was available on weekdays during normal business hours.
The study period lasted from January 2004 through June 2007. During the study period, the participating physicians continued to follow their routine documentation procedures, recording diagnoses and prescriptions for each consecutive patient using their existing, computerized patient documentation system. These data were exported electronically to a QuaDoSta system hosted in each practice by an on-site server to avoid double documentation. All ADRs that occurred during the study period were recorded by the physicians using a separate input mask.
Because many anthroposophic physicians often prefer not to use computers to take notes or enter data during patient consultations, a short paper version of the computerized ADR report form was developed. This allowed physicians to collect data by hand and transfer these to the QuaDoSta system after the consultation. Every ADR reported to the QuaDoSta was compensated with € 15.
Obligatory and voluntary items on the adverse drug reaction (ADR) report
Week of pregnancy
Date of birth*
Name of drug*
If used previously, was the drug tolerated at the time?
Was the drug continued or read ministered after onset of ADR?
Date drug started
Date drug stopped
Suspected of causing ADR (yes/no/unsure)
Type of diagnose (primary, concomitant, secondary)
Diagnosis confirmed on date
Initial worsening of symptom
Severity according to WHO-ART
Serious or non-serious according to ICH
If serious, why?
Date ADR started
Date ADR stopped
Treatment of ADR completed? (yes/no)
Reason for not completing treatment of ADR
Causality was assessed according to Uppsala Monitoring Centre (UMC) criteria as certain, probable/likely, possible, unlikely, conditional/unclassified, or unassessable/unclassifiable . Causality assessment was based on the nature of the ADR; the association in time between drug administration and the ADR; possible confounding factors; the clinical plausibility of the ADR; dechallenge or rechallenge effects; expectancy according to the information given in the package leaflet.
An ADR report was regarded as complete if information had been provided for all obligatory items. Physicians were required to send their data to the study centre every two months. In the event of a serious ADR, they had to inform the study centre within 24 hours.
All ADR reports were monitored by the study centre and checked for
• completeness (i.e. data provided for all obligatory items)
• plausibility (e.g. association in time between drug administration and ADR)
• classification of ADR seriousness and severity according to ICH and WHO-ART criteria
• assessment of causality according to UMC criteria
To assess the quality of reports, the study centre performed its own assessment of reported ADRs according to ICH, WHO-ART, and UMC criteria. These steps took place independently of the participating physicians. Subsequently, the study centre phoned the physicians to confirm that their reports had been received and asked them to supply any missing data. The study centre also provided the physicians with information about ADRs that had been reported in the past or described in the literature in association with the drug in question. The whole data collection period lasted for 42 months (i.e. 21 months before and 21 months after the educational intervention).
To measure changes in the ADR reporting rate, the median number of ADR reports and interquartile range (IQR) were calculated before and after the educational intervention. The pre-intervention and post-intervention quality of the reports was assessed in terms of changes in the completeness of data provided for obligatory items. Interrater reliability between the physicians and the study centre was calculated using Cohen's kappa with a 95% confidence interval (CI). For the analysis of the duration of the effect, we followed the line of Figueiras et al.  and aggregated five categories: baseline period of the first 21 month, first 4-month after intervention and respective groups for each ensuing 4-month period respectively. The intervention effect in each 4-month period after the educational intervention was then compared to the baseline value. Finally we evaluated the intervention effect with regards to the quantities of ADRs in CAM and non-CAM medication. Changes in the classification and assessment behaviour of physicians in terms of the severity and causality of ADRs completed our analysis.
We used Mann Whitney U-test for testing continuous data (i.e. Number of ADRs) and chi-square test was used for categorical data (i.e. data on ADR completeness). The level of statistical significance was set at P < 0.05. Due to the pre-post study design in a small group of physicians we abstained from using additional adjusting techniques.
All analyses were performed using SPSS 15 for Windows.
From January 2004 through June 2007, a total of 38 primary care practitioners participated in the study. The average age of the physicians was 48.0 (SD ± 6.1) years and 55% were male. Of the participating physicians, 55% were general practitioners (GPs) and 45% were specialized GPs (23% paediatrics, 11% internal medicine, 11% other).
Adverse drug reactions
A total of 404 ADRs were reported in 381 patients during the study period. Twenty-three patients had two ADRs. Altogether, 20 ADRs were classified as serious and 384 as non-serious according to ICH criteria. Of the reported ADRs, 157 were classified according to WHO-ART as grade 1; 203 as grade 2; 40 as grade 3; and four as grade 4. All 20 of the serious ADRs were associated with conventional drugs.
Number of ADR reports
Before the educational intervention, the median monthly reporting rate was 4.00 (IQR [3.00; 7.50]). The median number of ADRs per physician was 3.00 (IQR [0.00; 10.00]). The highest pre-intervention reporting rate (14 ADRs per month) was observed in the 21st month – i.e. after physicians had received a newsletter reminding them of their upcoming training session.
A subgroup analysis of the number of ADR reports finally revealed that the increment in ADR-reporting was solely and highly significant (P < 0.001) related to ADRs of non CAM drugs. While the number of ADRs of CAM remained stable (45 pre- intervention versus 45 post- intervention), the number of non CAM ADRs increased from 71 before intervention to 243 after intervention.
Completeness and quality of ADR reports
Completeness of obligatory items on adverse drug reaction (ADR) reports
Before educational intervention
After educational intervention
Name of drug
Date drug started
Date drug stopped
Suspected of causing ADR
Severity according to WHO-ART
Serious or non-serious according to ICH
Date ADR started
Date ADR stopped
Treatment of ADR completed?
Changes in quantity and quality of ADR reports
Before educational intervention
After educational intervention
ICH classification ( P = 0.566)
WHO-ART classification ( P = 0.015*)
Grade 1 = mild
Grade 2 = moderate
Grade 3 = severe
Grade 4 = life threatening
Causality ( P < 0.001*)
In total, 57.8% of the reports before and 77.4% of the reports after the intervention involved expected ADRs.
This prospective, multicentre study in primary care in Germany shows the effects of an educational intervention designed to improve ADR reporting in a primary care setting of CAM physicians. A significant increase both in the quantity and quality of ADR reports was observed after physicians took part in the intervention. This finding indicates that the intervention increased physicians' awareness of ADRs and that the physicians were able to transfer the knowledge they had gained from face-to-face training into their everyday clinical practice. The impact of the intervention, however, was temporary.
Physicians' enhanced awareness of ADRs was reflected by an increase in the number of ADR reports submitted immediately after they had received the first newsletter. During the 16 months following the educational intervention, the ADR reporting rate was higher than it had been before the intervention. Subsequently, however, the reporting rate began to decrease and continued to do so, on the average, throughout the remaining study period. Similar results were found by Figueiras et al, who examined the effectiveness of educational outreach visits for improving ADR reporting by physicians. The maximal effect in their study was observed during the first four months after the intervention, and the differences remained statistically significant for 12 months . In a study of an educational initiative in drug safety, Bracchi et al. found that training improved the rate and quality of ADR reporting, but the effect was also of only short duration .
In the literature, a lack of knowledge about ADRs is often considered to be a cause of underreporting [6, 24, 25]. The results of the present study show that the degree to which physicians were able to put the knowledge they had gained from face-to-face training into practice was remarkably high. This is demonstrated by an increase in the completeness of ADR reports from 80.3% before to 90.7% after the intervention. Nevertheless, a need for improvement was seen for the item 'Severity according to WHO-ART', as this was complete in only 59.0% of ADR reports after the intervention.
One focus of the educational intervention was on causality assessment. Improvements in this area were observed following the intervention, as can be seen in the shift that occurred from a predominance of reports indicating certain causality to reports in which causality was judged to be probable or possible. The present study was also able to provide some insight into ADR reporting in CAM. Quite interestingly, the intervention did not result in an increment in the number of reported CAM associated ADRs but to a triplication of non CAM related ADRs. Among patients and even CAM practitioners, there appears to be a widespread belief that CAM is 'natural' and therefore safe , which may lead to underreporting of ADRs associated with herbal remedies . The results of the present study show that none of the ADRs associated with CAM were serious. A very low rate of serious ADRs might be one explanation for the low reporting rate observed among CAM physicians.
Spontaneous reporting systems have been developed to detect serious, rare, and unexpected ADRs. The results of the present study show that the proportion of expected ADRs reported by physicians was larger after an educational intervention. Expected ADRs can be used to help assess the safety of a drug, because they are not likely to be reported to the spontaneous reporting systems.
Cosentino et al. recommend including pharmacovigilance as a topic in continuing education programmes . Our data suggests that continuing education is an important tool for increasing physicians' awareness of ADRs. Based on our results and the findings of Figueras et al. , we would recommend a yearly repetition of such educational interventions.
To date, ADRs have been reported primarily by physicians, but nurses and pharmacists can also play an important role [27–29]. However, in a similar interventional program in pharmacists the study of Herdeiro et al. showed that educational outreach visits improved ADR reporting in terms of quantity and relevance .
This study has several important limitations. Firstly, although the reporting rate decreased towards the end of the study, the study period was too short to evaluate long-term effects. In future studies, it would be helpful to determine whether annual training sessions might lead to improved results. Secondly, the study did not evaluate the total number of prescriptions in relation to the total number of ADR reports. Thirdly, reporting even mild and expected ADRs requires a great deal of motivation on the part of physicians; however, factors related to motivation were not evaluated (e.g. by questionnaire). Finally our study design with a concurrent control group and a small sample size did not allow to control for external interventions on the individual level (i.e. individual courses in continuing medical education) which could possibly have influence our results.
In conclusion, the results of the present study demonstrate that an educational intervention can increase physician awareness of ADRs, and that physicians were able to incorporate the knowledge they gained from face-to-face training into their everyday clinical practice. The effects of the educational intervention, however, were temporary. Further research is needed to determine whether extended or continuous educational measures might lead to more durable improvements in ADR reporting rates in everyday practice. This may be particularly important considering the growing popularity of CAM.
This study received grants from the Software AG-Foundation and financially supported by Wala Heilmittel GmbH and Weleda AG. The sponsors had no influence on design and conduct of the study; collection, management, analysis of the data; or preparation, review or approval of the manuscript. We would like to thank Matthew D. Gaskins for his expertise in editing the English version of this manuscript. Special thanks to all physicians who participate in the EvaMed network.
- WHO: Safety Monitoring of Medicinal Products: Guidelines for Setting Up and Running a Pharmacovigilance Centre. Accessed May 16, 2005, [http://www.who.int/medicinedocs]
- Lazarou J, Pomeranz BH, Corey PN: Incidence of adverse drug reactions in hospitalized patients: a meta-analysis of prospective studies. JAMA. 1998, 279: 1200-1205. 10.1001/jama.279.15.1200.View ArticlePubMedGoogle Scholar
- Kongkaew C, Noyce PR, Ashcroft DM: Hospital admissions associated with adverse drug reactions: a systematic review of prospective observational studies. Ann Pharmacother. 2008, 42: 1017-1025. 10.1345/aph.1L037.View ArticlePubMedGoogle Scholar
- WHO: Safety of Medicines: A guide to detecting and reporting adverse drug reactions. Why health professionals need to take action?. [http://apps.who.int/medicinedocs]
- ISDB: EU: Berliner Deklaration zur Pharmakovigilanz Wie sich die Sicherheit von Arzneimitteln verbessern lässt. Accessed May 16, 2005, [http://www.isdbweb.org]
- Lopez-Gonzalez E, Herdeiro MT, Figueiras A: Determinants of under-reporting of adverse drug reactions: a systematic review. Drug Saf. 2009, 32: 19-31. 10.2165/00002018-200932010-00002.View ArticlePubMedGoogle Scholar
- Herdeiro MT, Figueiras A, Polonia J, Gestal-Otero JJ: Physicians' attitudes and adverse drug reaction reporting: a case-control study in Portugal. Drug Saf. 2005, 28: 825-833. 10.2165/00002018-200528090-00007.View ArticlePubMedGoogle Scholar
- Figueiras A, Herdeiro MT, Polonia J, Gestal-Otero JJ: An educational intervention to improve physician reporting of adverse drug reactions: a cluster-randomized controlled trial. JAMA. 2006, 296: 1086-1093. 10.1001/jama.296.9.1086.View ArticlePubMedGoogle Scholar
- Bracchi RC, Houghton J, Woods FJ, Thomas S, Smail SA, Routledge PA: A distance-learning programme in pharmacovigilance linked to educational credits is associated with improved reporting of suspected adverse drug reactions via the UK yellow card scheme. Br J Clin Pharmacol. 2005, 60: 221-223. 10.1111/j.1365-2125.2005.02419.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Cosentino M, Leoni O, Banfi F, Lecchini S, Frigo G: Attitudes to adverse drug reaction reporting by medical practitioners in a Northern Italian district. Pharmacol Res. 1997, 35: 85-88. 10.1006/phrs.1996.0138.View ArticlePubMedGoogle Scholar
- Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, Grilli R, Harvey E, Oxman A, O'Brien MA: Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001, 39: II2-45. 10.1097/00005650-200108002-00002.View ArticlePubMedGoogle Scholar
- Hartel U, Volger E: [Use and acceptance of classical natural and alternative medicine in Germany – findings of a representative population-based survey]. Forsch Komplementarmed Klass Naturheilkd. 2004, 11: 327-334. 10.1159/000082814.View ArticlePubMedGoogle Scholar
- Tindle HA, Davis RB, Phillips RS, Eisenberg DM: Trends in use of complementary and alternative medicine by US adults: 1997–2002. Altern Ther Health Med. 2005, 11: 42-49.PubMedGoogle Scholar
- Myers SP, Cheras PA: The other side of the coin: safety of complementary and alternative medicine. Med J Aust. 2004, 181: 222-225.PubMedGoogle Scholar
- Shenfield G, Lim E, Allen H: Survey of the use of complementary medicines and therapies in children with asthma. J Paediatr Child Health. 2002, 38: 252-257. 10.1046/j.1440-1754.2002.00770.x.View ArticlePubMedGoogle Scholar
- Levenson D: Physicians should increase knowledge of herbal remedies. Rep Med Guidel Outcomes Res. 2001, 12: 7-9.Google Scholar
- Linde K, Willich SN: How objective are systematic reviews? Differences between reviews on complementary medicine. J R Soc Med. 2003, 96: 17-22. 10.1258/jrsm.96.1.17.View ArticlePubMedPubMed CentralGoogle Scholar
- Mills S: Monitoring herbal safety: Current debate and resources Symposium report: Pharmacovigilance of herbal medicines: Curent state and future direction. London, 24–26 April 2006. Phystomedicine. 2006Google Scholar
- Matthes H, Tabali M, Jeschke E: Ein Pharmakovigilanzsystem für Arzneimittel der besonderen Therapierichtungen. EHK. 2008, 57: 34-10.1055/s-2008-1044005.View ArticleGoogle Scholar
- Jeschke E, Schad F, Pissarek J, Matthes B, Albrecht U, Matthes H: QuaDoSta – ein frei konfigurierbares System zur Unterstützung multizentrischer Datenerhebungen in medizinischer Versorgung und Forschung. GMS Medizinische Informatik, Biometrie und Epidemiologie. 2007, 3: 10-Google Scholar
- Jeschke E, Luke C, Ostermann T, Tabali M, Hubner J, Matthes H: [Prescribing practices in the treatment of upper respiratory tract infections in anthroposophic medicine]. Forsch Komplement Med (2006). 2007, 14: 207-215. 10.1159/000104171.View ArticleGoogle Scholar
- ICH: E2A: Clinical Safety Data Management: Definitions and Standards for Expedited Reporting. Accessed January 15, 2003, [http://www.ich.org]
- UMC: Safety Monitoring of Medicinal Products: Guidelines for Setting Up and Running a Pharmacovigilance Centre. Accessed January 15, 2003, [http://www.who.int/medicinedocs]
- Eland IA, Belton KJ, van Grootheest AC, Meiners AP, Rawlins MD, Stricker BH: Attitudinal survey of voluntary reporting of adverse drug reactions. Br J Clin Pharmacol. 1999, 48: 623-627. 10.1046/j.1365-2125.1999.00060.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Hasford J, Goettler M, Munter KH, Muller-Oerlinghausen B: Physicians' knowledge and attitudes regarding the spontaneous reporting system for adverse drug reactions. J Clin Epidemiol. 2002, 55: 945-950. 10.1016/S0895-4356(02)00450-X.View ArticlePubMedGoogle Scholar
- Barnes J: Pharmacovigilance of herbal medicines: a UK perspective. Drug Saf. 2003, 26: 829-851. 10.2165/00002018-200326120-00001.View ArticlePubMedGoogle Scholar
- Backstrom M, Mjorndal T, Dahlqvist R: Spontaneous reporting of adverse drug reactions by nurses. Pharmacoepidemiol Drug Saf. 2002, 11: 647-650. 10.1002/pds.753.View ArticlePubMedGoogle Scholar
- van Grootheest AC, van Puijenbroek EP, de Jong-van den Berg LT: Contribution of pharmacists to the reporting of adverse drug reactions. Pharmacoepidemiol Drug Saf. 2002, 11: 205-210. 10.1002/pds.702.View ArticlePubMedGoogle Scholar
- Herdeiro MT, Figueiras A, Polonia J, Gestal-Otero JJ: Influence of pharmacists' attitudes on adverse drug reaction reporting: a case-control study in Portugal. Drug Saf. 2006, 29: 331-340. 10.2165/00002018-200629040-00004.View ArticlePubMedGoogle Scholar
- Herdeiro MT, Polonia J, Gestal-Otero JJ, Figueiras A: Improving the reporting of adverse drug reactions: a cluster-randomized trial among pharmacists in Portugal. Drug Saf. 2008, 31: 335-344. 10.2165/00002018-200831040-00007.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2458/9/274/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.