Background The Millennium Development Goals (MDGs) availed opportunities for scaling up service coverage but called for stringent monitoring and evaluation (M&E) focusing mainly on MDG related programs. The Sustainable Development Goals 3 (SDGs) and the universal health coverage (UHC) agenda present a broader scope and require more sophisticated M&E systems. We assessed the readiness of low- and middle-income countries to monitor SDG 3.
Methods Employing mixed methods, we reviewed health sector M&E plans of 6 countries in the World Health Organization (WHO) Africa Region to assess the challenges to M&E, the indicator selection pattern and the extent of multisectoral collaboration. Qualitative data were analysed using content thematic analysis while quantitative data were analysed using Excel.
Results Challenges to monitoring SDG 3 include weak institutional capacity; fragmentation of M&E functions; inadequate domestic financing; inadequate data availability, dissemination and utilization of M&E products. The total number of indictors in the reviewed plans varied from 38 for Zimbabwe to 235 for Zanzibar. Sixty-nine percent of indicators for the Gambia and 89% for Zanzibar were not classified in any domain in the M&E results chain. Countries lay greater M&E emphasis on service delivery, health systems, maternal and child health as well as communicable diseases with a seeming neglect of the non-communicable diseases (NCDs). Inclusion of SDG 3 indicators only ranged from 48% for Zanzibar to 67% for Kenya. Although monitoring SDG 3 calls for multisectoral collaboration, consideration of the role of other sectors in the M&E plans was either absent or limited to the statistical departments.
Conclusion There are common challenges confronting M&E at county-level. Countries have omitted key indicators for monitoring components of the SDG 3 targets especially those on NCDs and injuries. The role of other sectors in monitoring SDG 3 targets is not adequately reflected. These could be bottlenecks to tracking progress towards SDG 3 if not addressed. Beyond providing compendium of indicators to guide countries, we advocate for a more binding minimum set of indicators for all countries to which they may add depending on their context. Ministries of Health (MoHs) should prioritise M&E as an important pillar for health service planning and implementation and not as an add-on activity.
Chan M, Kazatchkine M, Lob-Levyt J, et al. Meeting the demand for results and accountability: a call for action on health data from eight global health agencies. PLoS Med. 2010;7(1):e1000223. doi:10.1371/journal.pmed.1000223
Gerring J, Thacker SC, Enikolopov R, Arevalo J, Maguire M. Assessing health system performance: a model-based approach. Soc Sci Med. 2013;93:21-28. doi:10.1016/j.socscimed.2013.06.002
Gorgens M, Zall Kusek J. Making monitoring and evaluation systems work: a capacity development toolkit. Washington DC: The World Bank; 2010.
Kruk ME, Freedman LP. Assessing health system performance in developing countries: a review of the literature. Health Policy. 2008;85(3):263-276. doi:10.1016/j.healthpol.2007.09.003
Murray CJL, Evans DB, santé O mondiale de la. Health Systems Performance Assessment: Debates, Methods and Empiricism. World Health Organization; 2003.
Mutale W, Chintu N, Amoroso C, et al. Improving health information systems for decision making across five sub-Saharan African countries: Implementation strategies from the African Health Initiative. BMC Health Serv Res. 2013;13 Suppl 2:S9. doi:10.1186/1472-6963-13-s2-s9
Reynolds HW, Sutherland EG. A systematic approach to the planning, implementation, monitoring, and evaluation of integrated health services. BMC Health Serv Res. 2013;13:168. doi:10.1186/1472-6963-13-168
Sun D, Ahn H, Lievens T, Zeng W. Evaluation of the performance of national health systems in 2004-2011: an analysis of 173 countries. PLoS One. 2017;12(3):e0173346. doi:10.1371/journal.pone.0173346
Tashobya CK, da Silveira VC, Ssengooba F, Nabyonga-Orem J, Macq J, Criel B. Health systems performance assessment in low-income countries: learning from international experiences. Global Health. 2014;10:5. doi:10.1186/1744-8603-10-5
World Health Organisation (WHO). The world health report 2000: health systems: improving performance. Geneva: WHO; 2000.
World Health Organisation (WHO), International Health Partnership (IHP+). Monitoring, evaluation and review of national health strategies: a country-led platform for information and accountability. Geneva: WHO; 2011.
World Health Organisation (WHO). World health statistics 2016: monitoring health for the SDGs sustainable development goals. Geneva: WHO; 2016.
Boerma T, Eozenou P, Evans D, Evans T, Kieny MP, Wagstaff A. Monitoring progress towards universal health coverage at country and global levels. PLoS Med. 2014;11(9):e1001731. doi:10.1371/journal.pmed.1001731
Garrib A, Stoops N, McKenzie A, et al. An evaluation of the district health information system in rural South Africa. S Afr Med J. 2008;98(7):549-552.
Mpofu M, Semo BW, Grignon J, et al. Strengthening monitoring and evaluation (M&E) and building sustainable health information systems in resource limited countries: lessons learned from an M&E task-shifting initiative in Botswana. BMC Public Health. 2014;14:1032. doi:10.1186/1471-2458-14-1032
Nabyonga-Orem J. Monitoring Sustainable Development Goal 3: how ready are the health information systems in low-income and middle-income countries? BMJ Glob Health. 2017;2(4):e000433. doi:10.1136/bmjgh-2017-000433
World Health Organisation (WHO). Monitoring progress towards universal health coverage at country and global levels: framework, measures and targets. Geneva: WHO; 2014.
Ministry of Health and Social Welfare, The Gambia. The National Monitoring and Evaluation Plan for the National Health Strategic Plan (NHSP), 2014-2020. The Gambia; 2015.
Ministry of Health Uganda. Monitoring and Evaluation Plan for Implementation of the Health Sector Development Plan 2015/16-2019/20. Kampala, Uganda: Ministry of Health Uganda; 2016.
Ministry of Health and Child Care. Zimbabwe Health Sector Performance Monitoring and Evaluation Policy Guidelines and Strategy 2016 - 2020. Harare, Zimbabwe: Ministry of Health and Child Care; 2015.
Ministry of Health Guinea. Plan national de suivi evaluation du PNDS 2015-2024. Guinea: Ministry of Health Guinea; 2015.
Ministry of Health Kenya. Health sector monitoring and evaluation framework 2014-2018. Nairobi, Kenya: Ministry of Health Kenya; 2014.
Ministry of Health of the Revolutionary, Government of Zanzibar. Monitoring and Evaluation Framework for Health Sector Strategic Plan III 2013/14–2018/19. Zanzibar: Ministry of Health of the Revolutionary; 2014.
Stenberg K, Hanssen O, Edejer TT, et al. Financing transformative health systems towards achievement of the health Sustainable Development Goals: a model for projected resource needs in 67 low-income and middle-income countries. Lancet Glob Health. 2017;5(9):e875-e887. doi:10.1016/s2214-109x(17)30263-2
Amado CA, Santos SP. Challenges for performance assessment and improvement in primary health care: the case of the Portuguese health centres. Health Policy. 2009;91(1):43-56. doi:10.1016/j.healthpol.2008.11.008
Smith PC, Mossialos E, Papanicolas I, Leatherman S. Performance measurement for health system improvement: experiences, challenges and prospects. Cambridge University Press; 2008.
Olafsdottir AE, Reidpath DD, Pokhrel S, Allotey P. Health systems performance in sub-Saharan Africa: governance, outcome and equity. BMC Public Health. 2011;11:237. doi:10.1186/1471-2458-11-237
World Health Organisation (WHO). Monitoring the building blocks of health systems: a handbook of indicators and their measurement strategies. Geneva: WHO; 2010.
Nabukalu, J. B., Asamani, J. A., & Nabyonga-Orem, J. (2020). Monitoring Sustainable Development Goals 3: Assessing the Readiness of Low- and Middle-Income Countries. International Journal of Health Policy and Management, 9(7), 297-308. doi: 10.15171/ijhpm.2019.134
Joy Belinda Nabukalu; James Avoka Asamani; Juliet Nabyonga-Orem. "Monitoring Sustainable Development Goals 3: Assessing the Readiness of Low- and Middle-Income Countries". International Journal of Health Policy and Management, 9, 7, 2020, 297-308. doi: 10.15171/ijhpm.2019.134
Nabukalu, J. B., Asamani, J. A., Nabyonga-Orem, J. (2020). 'Monitoring Sustainable Development Goals 3: Assessing the Readiness of Low- and Middle-Income Countries', International Journal of Health Policy and Management, 9(7), pp. 297-308. doi: 10.15171/ijhpm.2019.134
Nabukalu, J. B., Asamani, J. A., Nabyonga-Orem, J. Monitoring Sustainable Development Goals 3: Assessing the Readiness of Low- and Middle-Income Countries. International Journal of Health Policy and Management, 2020; 9(7): 297-308. doi: 10.15171/ijhpm.2019.134