Skip to main content
  • Research article
  • Open access
  • Published:

Assessment of factors affecting vaccine cold chain management practice in public health institutions in east Gojam zone of Amhara region

Abstract

Background

Maintaining quality of vaccines is one of the main challenges of immunization programs in Ethiopia. The objective of this study is to assess the factor affecting vaccine cold chain management practice in immunization health institutions in East Gojam zone of Amhara region, Ethiopia.

Method

An institutional based cross-sectional study was conducted from March to April 2017 in ten districts of East Gojam zone of Amhara Region. Descriptive statistics and Logistic regression analysis were carried out to identify factors related to the practice of cold chain management.

Result

Among 60 health institutions, only 46(76.7%) had functional refrigerators. Twenty-one (35%) had a functional generator for backup service and 28(46.6%) had a car/motorbike for transportation of vaccines in case of refrigerator/power failure. Twenty-nine (48.3%) had known the correct vaccine storage temperature (2 °C – 8 °C) in the refrigerator and the results of this study revealed that only 23(38.3%) of respondents had sufficient knowledge about vaccine cold chain management. The finding of this study also revealed that 35(58.3%) had appropriate vaccine cold chain management practice and the rest 25(41.7%) had inappropriate practice. Logistic regression showed us the knowledge gap and profession were significantly associated with vaccine cold chain management practice at P < 0.05.

Conclusion

This study indicates that there was a knowledge gap of health workers who are working on cold chain management. There is an urgent need to improve knowledge and practice on cold chain management through improved supervision and training at a different level of health care system.

Peer Review reports

Background

Vaccination is the intervention used to prevent or eradicate childhood diseases. It is the most cost-effective health intervention. A set of practice guidelines for different service levels were created by the World Health Organization (WHO), which include vaccine monitoring, immunization techniques, cold chain management and reporting systems [1, 2]. Cold chain is system for storing and transporting vaccines in a potent state (within an acceptable temperature range) from the manufacturer to users [3]. Throughout the chain, primary health care providers must have adequate knowledge to manage the cold chain [4, 5]. The cold chain guidelines recommend the following: the vaccine storage should be maintained in the temperature range of 2–8 °C, the use of minimum/maximum thermometers, temperature charts, and the shake test [6,7,8]. However, these guidelines are often practically quite difficult to implement in field situations due to various factors like infrastructure problems and workload pressures [9,10,11].

Achieving high coverage rates is considered one of the parameters to measure the success of the immunization program. However, disease reduction which is the ultimate goal of the Expanded Program on Immunizations (EPI) depends mainly on the provision of potent vaccines to the children. Vaccine potency is ensured, among other things, by maintaining a functional cold chain system at all levels [12, 13].

The cold chain system is assumed to be at greatest risk, particularly in tropical countries where a power supply is unreliable and facilities for its maintenance are not well developed. In these areas, it is common to observe 30–50% of the refrigerators and freezers being out of order [14, 15]. Even a study done in the United States indicated that there is a lack of refrigerator temperatures that fell within the acceptable range which means 63% fell below minimum, 59% fell above maximum, and 93% fell either above or below or both [16].

In 1980s Immunization Supply Chain and Logistics (ISCL) systems supported acceptable vaccination coverage by using coping mechanisms to overcome problems in vaccine distribution, storage and management. As immunization programs grow, supply systems have coped with increased volume and complexity in several ways [17].

Cold chain management weaknesses are often observed during transportation and storage of the vaccines. Some factors contributing to weaknesses of the cold chain are delays during transportation, quality of refrigerators, a method of storage, too long storage at the health unit, improper use of refrigerators, power interruption, equipment breakage, and lack of trained personnel capable of managing the cold chain [5, 13, 18,19,20,21].

Cold chain system consists of a series of storage and transport links, all designed to keep vaccines within an acceptable temperature range until it reaches the users. The cold chain remains a highly vulnerable point for national immunization programs in developing countries especially those with tropical climates [1, 22, 23].

In Ethiopia, there is a real problem of vaccines losing their potency during storage at these centers even if they were potent on arrival. In the study area of the Amhara region, there are high immunization coverage rates, but there are still a number of reported outbreaks from different zones of the region. The aim of this study is to assess the factors affecting management and quality of the cold chain in immunization health institutions in East Gojam zone. Ethical clearance was obtained from the Research and Ethical Committee of Bahir Dar University, Ethiopia.

Methods

The institution-based cross-sectional study design was conducted from March to April 2017 in East Gojam zone of Amhara region. East Gojam is one of the zone administrations of Amhara region. It has 18 districts and two town administrations. It was selected for this study because most of the districts are known for the frequent outbreak of vaccine-preventable diseases and frequent breakage of the cold chain.

The sample size was estimated using a single population proportion formula for a cross-sectional study. It was calculated by assuming 50% prevalence, marginal error (d) 0.05, and with 95% CI. Finally, the correction factor for the finite population was applied and the final sample was 60 health institutions.

Ten study districts were selected from 18 districts and two town administrations by simple random sampling. From the selected districts, 10 were districts health offices, 30 health centers and 20 health posts which have refrigerators for vaccine storage and the cold chain storekeeper were interviewed at district level, the under-five focal person (responsible person at immunization ward) was interviewed at the health center, and the health extension workers (community health workers) were interviewed at health post level until we reached final sample size.

The data was collected by using a structured questionnaire prepared for this study as shown in Additional file 1, which consists of four main categories namely socio-demographic variables, cold room infrastructure status, cold chain management knowledge which contain 7 items, and cold chain management practice variables which contain 13 items. The level of knowledge computed by considering the normal distribution of the data, a mean value 5 or above (≥75%) was considered as an appropriate cut-off point to classify knowledge as sufficient or insufficient. The level of practice was computed by considering the normal distribution of the data, a mean value 10 or above (≥75%) was considered as an appropriate cut-off point to classify cold chain practice as proper or improper practice [24].

English version of the questionnaire was translated into Amharic and back to English to check its conceptual equivalence. The Amharic version of the questionnaire was pre-tested in a non-sample health facility to assess for its clarity and correction were made accordingly.

The collected data were re-translated to English, entered into Epi Data software version-3.1 and transferred to SPSS software version-24, and analyzed according to the different variables. Binary and multivariate logistic regression analysis was performed to explore independent variables that are predictors of vaccine cold chain management practice were considered as significant when P < 0.05.

Results

General characteristics of health facilities

All 60 health facilities were participated (overall response rate was 100%). Among a total of 60 health facilities, 46(76.7%) had functional refrigerators, 21(35%) had a functional generator for backup service, and 28(46.6%) had a car/motorbike for transportation of vaccines in case of refrigerator/power failure. Fuel was available for only 43% generators, 57.1% car/motorbikes and 21.7% refrigerators. From the 60 health facilities with refrigerators, 63.3% had trained personnel and 20% had spare parts for minor maintenance.

General characteristics of vaccine managers in the study health institutions

Among the vaccine providers included in the study, 34(56.7%) were females, 31 (51.6%) were nurses, 10(16.7%) were pharmacy personnel’s and 19 (31.7%) were health extension workers and 35 (58.3%) of the respondents were diploma graduates. Among these health care providers, 63.3% of the respondents had 2–5 years of total experience. The minimum and maximum years of service were 6 months and 12 years respectively. Out of the total respondents, 38 (63.3%) had received EPI training.

Vaccine cold room storage status

Forty-nine (86.7%) of the health facilities hadn’t separate vaccine storage room and only 8 (13.3%) of them had a separate room for vaccine storage. About 15(25%) had sufficient storage capacity, 21(35%) were cleaned, 43(71.7%) had dry floors, 44(73.3%) were free of a roof leak and all storage area had secured windows and doors as shown in Table 1.

Table 1 Health worker reported status of vaccine cold room in health institutions

Knowledge of health care workers on vaccine cold chain management

Fifty-eight (96.7%) of the respondents knew that vaccines are heat sensitive drugs and half of the health care workers knew that freezing is harmful to vaccine storage, although only 21(35%) of storekeepers knew the correct placing of the thermometer. More than half (58%) of respondents had correctly interpreted the vaccine vial monitor (VVM) reading of each vaccine. Also, about 23(38.3%) of respondents had sufficient knowledge about vaccine cold chain management as shown in Table 2.

Table 2 Health workers response to questions around vaccine cold chain management

Vaccine cold chain management practice

Regarding vaccine cold chain management practice, based on the recommended vaccine storage temperature range (+ 2 °C to + 8 °C), 25% of health facilities had a functional thermometer. From 60 health institutions, most of them (90%) had a functional thermometer, 66.6% of them had vaccines in good VVM status, and 46.7% of them had sufficient vaccine storage capacity. More than half of the refrigerators of the 60 health institutions used to store other material, and only 43.3% apply First Expiry First Out (FEFO) principle (the method of vaccine management involves issuing products with the earliest expiry date first, regardless of the order in which they are received) to reduce vaccine wastage. About 58.3% of health institutions had recorded cold room temperature twice daily continuously, and 80% of the health institutions had vaccine transaction recording practice as shown in Fig. 1.

Fig. 1
figure 1

Vaccine cold chain management practice of health care workers

Factors associated with vaccine cold chain management practice

The finding of this study revealed that 35(58.3%) had cold chain management that conforms to the required standards and the rest 25(41.7%) has improper practice. Among the factors, only professional qualification and overall knowledge on vaccine cold chain management had a statistically significant association with the practice of health workers on cold chain management. Professional qualification, years of experience, overall knowledge of respondents on cold chain management, sufficient storage area was included in the regression model. The adjusted model indicated that respondents who had sufficient knowledge were 2 times more likely to have proper cold chain management practice as compared with those who had not. Nurses were about 17 times more likely to have proper practice on cold chain management compared to Health Extension Workers (AOR = 17.13 (2.58–11.34)). In addition, health workers who had sufficient overall knowledge were about 2 times more likely to have appropriate practice on cold chain management (AOR = 2.14 (0.03–1.72) as shown in Table 3.

Table 3 Bivariate and multivariate analysis of providers’ Cold Chain Management practice

Discussion

This study identified the gaps related to cold chain system management. There were gaps in following the cold chain management principles such as use of EEFO principle, recording damaged vaccine, recording temperature twice daily, and recording VVM status for each vaccine. Also, there was a gap in using requisition form for reporting and ordering vaccine. Based on the descriptive analysis, the majority of the health facilities did not have a separate room for vaccine storage. Their storage capacities were insufficient to accommodate all vaccines and its consumable supplies, even though all storage area had secured windows and doors. Infrastructures were not fulfilled in room to handle the vaccine properly. This inappropriate handling of the vaccine has a negative effect on its potency. This study identified only 35 health facilities (58.3%) which had proper vaccine cold chain management practice. This finding is very low when compare with study done in Saudi which showed that handling and usage of vaccines during immunization sessions at government health facilities was more than 90% appropriate [25]. The possible reasons could be the educational and income difference of the countries.

The availability of vaccine storage equipment was found to be unacceptable in East Gojam zone of Amhara Region. These are enough to attend the desired level of vaccination coverage if appropriately utilized. However, the availability of the power sources and an alternative source were not sufficient. The number of health facilities using electricity as their primary power source predominates but the major challenge of this type of power supply was an irregularity in the power supply. Availability of necessary spare parts and conducting cold room maintenance were very low.

In this study, 76.7% of health facilities had functional refrigerators, which is much better as compared to the study conducted in central Ethiopia which reported that only 19% had functional refrigerators [10]. The possible reason may be an unequal distribution of health facilities or improper handling.

According to the recommended vaccine storage temperature range (+ 2 °C to + 8 °C), 25% of health facilities had a functional thermometer in current study which is consistent with a study done in central Ethiopia, [18] and lower as compared with the study done in Cameroon which had 32.7% functioning thermometers, [9]. Even if both are developing counties, the possible reason may be due to unequal distribution of health facilities and inappropriate handling of thermometer.

The cold chain monitoring status in the East Gojam Zone of Amhara Region was inadequate to ensure proper vaccine storage. In this study, health personnel knowledge and practices being inadequate to support maintenance of effective cold chain standards, which means there were cold chain management knowledge and practice gaps as per effective vaccine management standards. The results of this study revealed that only 38.3% of respondents had sufficient knowledge about vaccine cold chain management which is much lower than a study done on cold chain status for immunization in central Ethiopia in which 56% of health workers had satisfactory knowledge on cold chain management [18]. Potential factors associated which likely to be responsible for this low level of cold chain management practices include insufficient knowledge or training, and insufficient support.

Since the study was conducted in 60 health institutions due to time and resource limitation, there was a reduced statistical power, caution is needed in generalizing these results. The cross-sectional design investigates prevalence and associations rather than causality. Thus, future research needs to replicate these findings using a large-scale sample size to generalize and using qualitative and quantitative study design producer at different levels of the health system.

Conclusions

In general, the findings of this study indicate that there are important knowledge gaps for health workers in managing the cold chain management. Most cold rooms have insufficient storage capacity and incomplete equipment for adequate cold chain maintenance. Vaccine cold chain management was significantly associated with the overall cold chain management knowledge and profession of a health care worker in health institutions. To maintain a safe and effective cold chain further efforts are needed both in education and training with improving health worker knowledge and with improving both infrastructure capacity and appropriate equipment. In addition, the regional health bureau and district health office should work on different capacity building activities to health professionals in order to address the knowledge gap at a different level of the health institution.

Availability of data and materials

The datasets collected and analyzed for the current study is available from the corresponding author and can be obtained on a reasonable request.

Abbreviations

AOR:

Adjusted odds ratio

EPI:

Expanded program on immunizations

FEFO:

First expiry first out

ISCL:

Immunization supply chain and logistics

VVM:

Vaccine vial monitor

WHO:

World Health Organization

References

  1. Organization WH. Global Programme for vaccines and immunization: 1998. 1998.

    Google Scholar 

  2. Yakum MN, Ateudjieu J, Walter EA, Watcho P. Vaccine storage and cold chain monitoring in the north west region of Cameroon: a cross sectional study. BMC Res Notes. 2015;8(1):145.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Organization WH. Global programme for vaccine and immunization: expanded programme on immunization: safe vaccine handling: cold chain and immunizations. Geneva: World Health Organization; 1998. p. 8–21.

    Google Scholar 

  4. Shah J, Agarwal M, Patel J, Trivedi A. Quality assessment of immunization services: a cross sectional study at UHCs of Ahmedabad municipal corporation. Int J Health Sci Res. 2015;5(7):21–5.

    Google Scholar 

  5. Hanjeet K LM, Sinniah M, Schnur A. Evaluation of cold chain monitoring in Kelantan, Malaysia. Bulletin of the World Health Organization. 1996;74(4):391-397

  6. Galazka A, Milstien J, Zaffran M. Thermostability of vaccines: global programme for vaccines and immunization. Geneva: World Health Organization; 1998.

    Google Scholar 

  7. World Health Organization. Department of Immunization, Biologicals. Immunization in practice: A practical guide for health staff. World Health Organization; 2015.

  8. Silva E. Development and strategies of the Colombian vaccination program. Clin Infect Dis. 1989;11(Supplement_3):S505–S6.

    Article  Google Scholar 

  9. Ateudjieu J, Kenfack B, Nkontchou BW, Demanou M. Program on immunization and cold chain monitoring: the status in eight health districts in Cameroon. BMC Res Notes. 2013;6(1):101.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Berhane Y, Demissie M. Cold chain status at immunisation centres in Ethiopia. East Afr Med J. 2000;77(9):476–79.

  11. Weir E, Hatch K. Preventing cold chain failure: vaccine storage and handling. Can Med Assoc J. 2004;171(9):1050.

    Article  Google Scholar 

  12. Organization WH. User’s handbook for vaccine cold rooms and freezer rooms. 2002.

    Google Scholar 

  13. Nelson CM, Wibisono H, Purwanto H, Mansyur I, Moniaga V, Widjaya A. Hepatitis B vaccine freezing in the Indonesian cold chain: evidence and solutions. Bull World Health Organ. 2004;82:99–105.

    PubMed  PubMed Central  Google Scholar 

  14. Creese A, Battersby A. The cost of cold chain equipment. In World Health Forum. 1984;5(2):165–7.

  15. Cheyne J. Strengthening the vaccine cold chain. In World health forum. 1982;3(4):436–40.

  16. Woodyard E, Woodyard L, Alto WA. Vaccine storage in the physician’s office: a community study. J Am Board Fam Pract. 1995;8(2):91–4.

    CAS  PubMed  Google Scholar 

  17. CALL-TO-ACTION A. IMMUNIZATION SUPPLY CHAIN AND LOGISTICS. Geneva: World Health Organization; 2014.

  18. Rogie B, Berhane Y, Bisrat F. Assessment of cold chain status for immunization in Central Ethiopia. Ethiop Med J. 2013;51(Suppl 1):21–9.

    PubMed  Google Scholar 

  19. Wirkas T, Toikilik S, Miller N, Morgan C, Clements CJ. A vaccine cold chain freezing study in PNG highlights technology needs for hot climate countries. Vaccine. 2007;25(4):691–7.

    Article  PubMed  Google Scholar 

  20. Acu F, Adedeji A, Esan J, Odusanya O. Live viral vaccine potency: an index for assessing the cold chain system. Public Health. 1996;110(6):325–30.

    Article  Google Scholar 

  21. Lakew Y, Bekele A, Biadgilign S. Factors influencing full immunization coverage among 12–23 months of age children in Ethiopia: evidence from the national demographic and health survey in 2011. BMC Public Health. 2015;15(1):728.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Ethiopia FDRo. National expanded programme on immunization comprehensive multi-year plan 2011–2015. Addis Ababa: Fedral Ministry of Health; 2010.

    Google Scholar 

  23. Nelson C, Froes P, Van Dyck AM, Chavarría J, Boda E, Coca A, et al. Monitoring temperatures in the vaccine cold chain in Bolivia. Vaccine. 2007;25(3):433–7.

    Article  PubMed  Google Scholar 

  24. Dairo DM, Osizimete OE. Factors affecting vaccine handling and storage practices among immunization service providers in Ibadan, Oyo state, Nigeria. Afr Health Sci. 2016;16(2):576–83.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Mugharbel KM, Al Wakeel SM. Evaluation of the availability of cold chain tools and an assessment of health workers practice in Dammam. J Fam Community Med. 2009;16(3):83.

    Google Scholar 

Download references

Acknowledgments

Authors are grateful to the College of Business and Economics, logistics and supply chain management department of Bahir Dar University for providing us this opportunity to look at the Assessment of Pharmaceutical Logistics System in Health Centers. Lastly, we would like to thank zonal health departments, districts health office and health facility officers for their unreserved cooperation and support for all over data collection process.

Funding

The authors did not receive any funding for this study.

Author information

Authors and Affiliations

Authors

Contributions

HAB: Initiated the idea, wrote the proposal, participated in designing the study, supervising data collection process, analyses the data and writing the manuscript. AFA: contributed to the designing of the methodology, analysis of the data, add important intellectual content and writing manuscript. AAB: Contributed to the designing of the methodology, analysis of the data, add important intellectual content and finally prepared the manuscript. All authors agreed and approved the final manuscript.

Corresponding author

Correspondence to Abebe Feyissa Amhare.

Ethics declarations

Ethics approval and consent to participate

Ethical clearance was obtained from the Research and Ethical Committee of Bahir Dar University. Informed consent was obtained in written form, and all participants agreed to participate in the study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Questionnaire of this study.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bogale, H.A., Amhare, A.F. & Bogale, A.A. Assessment of factors affecting vaccine cold chain management practice in public health institutions in east Gojam zone of Amhara region. BMC Public Health 19, 1433 (2019). https://doi.org/10.1186/s12889-019-7786-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12889-019-7786-x

Keywords