International Journal of Health Policy and Management

International Journal of Health Policy and Management

Assessing Performance of Botswana’s Public Hospital System: The Use of the World Health Organization Health System Performance Assessment Framework

Document Type : Original Article

Authors
Onalenna Seitio-Kgokgwe 1
Robin Gauld 2
Philip Hill 2
Pauline Barnett 3
1 Ministry of Health, Gaborone, Botswana
2 Department of Preventive and Social Medicine, School of Medicine, University of Otago, Dunedin, New Zealand
3 School of Health Sciences at Canterbury, Christchurch, New Zealand
10.15171/ijhpm.2014.85
Abstract
Background
Very few studies have assessed performance of Botswana public hospitals. We draw from a large research study assessing performance of the Botswana Ministry of Health (MoH) to evaluate the performance of public hospital system using the World Health Organization Health Systems Performance Assessment Framework (WHO HSPAF). We aimed to evaluate performance of Botswana public hospital system; relate findings of the assessment to the potential for improvements in hospital performance; and determine the usefulness of the WHO HSPAF in assessing performance of hospital systems in a developing country.
 
Methods
This article is based on data collected from document analysis, 54 key informants comprising senior managers and staff of the MoH (N= 40) and senior officers from stakeholder organizations (N= 14), and surveys of 42 hospital managers and 389 health workers. Data from documents and transcripts were analyzed using content and thematic analysis while data analysis for surveys was descriptive determining proportions and percentages.
 
Results
The organizational structure of the Botswana’s public hospital system, authority and decision-making are highly centralized. Overall physical access to health services is high. However, challenges in the distribution of facilities and inpatient beds create inequities and inefficiencies. Capacity of the hospitals to deliver services is limited by inadequate resources. There are significant challenges with the quality of care.
 
Conclusion
While Botswana invested considerably in building hospitals around the country resulting in high physical access to services, the organization and governance of the hospital system, and inadequate resources limit service delivery. The ongoing efforts to decentralize management of hospitals to district level entities should be expedited. The WHO HSPAF enabled us to conduct a comprehensive assessment of the public hospital system. Though relatively new, this approach proved useful in this study.
Keywords
Botswana
Public Hospitals
Service Delivery
World Health Organization Health System Performance Assessment Framework (WHO HSPSF)
Subjects
  1. Central Statistics Office (CSO). Health facility by type and number of beds 1998-2006, 2009.
  2. Ministry of Health (MoH). Republic of Botswana National Health Accounts, 2006. Gaborone: Ministry of Health; 2006.
  3. McKee M, Healy J. The significance of hospitals: an introduction, in Hospitals in a changing Europe. In: McKee M, J Healy, editors. European Observatory on Health Care Systems. Philadelphia: Open University Press; 2002.
  4. Mothibi M. Ke sechaba se dire eng gore ditlamelo di se tswele mosala. Gaborone: Radio Botswana; 2009.
  5. Mothibi M. A batho ga ba tshephe bongaka jwa mo gae. Gaborone: Radio Botswana; 2010.
  6. Harding A, Preker A. Understanding organizational reforms The corporatization of public hospitals. Washington DC: The World Bank; 2000.
  7. Osei D, d’Almeida S, George MO, Kirigia JM, Mensah AO, Kainyu LH. Technical efficiency of public district hospitals and health centres in Ghana: a pilot study. Cost Eff Resour Alloc 2005; 3: 9.  doi: 10.1186/1478-7547-3-9
  8. Kirigia JM, Sambo LG, Scheel H. Technical efficiency of public clinics in Kwazulu-Natal province of South Africa. East Afr Med J 2001; 78: S1-13.
  9. Marschall P, Flessa S. Efficiency of primary care in rural Bukina Faso. A two staged DEA analysis. Health Econ Rev 2011; 1: 1-15.  doi: 10.1186/2191-1991-1-5
  10. Ramanathan TV, Chandra KS, Thupeng WM. A comparison of the technical efficiencies of health districts and hospitals in Botswana. Dev South Afr 2003; 20: 307-20. 
  11. Tlotlego N, Nonvignon J, Sambo LG, Asbu EZ , Kirigia JM. Assessment of productivity of hospitals in Botswana: A DEA application.  Int Arch Med 2010; 3: 27.  doi: 10.1186/1755-7682-3-27
  12. Seitio-Kgokgwe O. Organizational Structure of the Botswana Ministry of Health: Impact on Performance. Dunedin: University of Otago; 2012.
  13. World Health Organization (WHO). Working together for health: The World Health Report 2006. Geneva: WHO; 2006.
  14. World Health Organization (WHO). Everybody’s business: Strengthening health systems to improve health outcomes: WHO’s framework for action. Geneva: WHO; 2007.
  15. Murray CJL, Frenk J. A framework for assessing the performance of health systems. Bull World Health Organ 2000; 78: 717-31. 
  16. World Health Organization (WHO). The World Health Report 2000: Health systems: Improving performance. Geneva: WHO; 2000.
  17. Islam M. Health systems assessment approach: A how-to-manual. Submitted to the U.S. Agency for International Development in collaboration with Health Systems 20/20, Partners for Health Reformplus, Quality Assurance Project, and Rational Pharmaceutical Management Plus. Arlington, VA: Management Sciences for Health; 2007.
  18. World Health Organization (WHO). Toolkit on monitoring health systems strengthening: Service delivery (draft). Geneva: WHO; 2008.
  19. Cameron K. Effectiveness as paradox: Consensus and conflict in conceptions of organizational effectiveness. Manage Sci 1986; 32: 539-53. 
  20. Steers RM. Problems in the measurement of organizational effectiveness. Adm Sci Q 1975; 20: 546-58. 
  21. Connolly T, Deutsch SJ. Performance Measures: Some conceptual issues. Eval Program Plann 1980; 3: 35-43. 
  22. Goddard M, Mannion R, Smith PC. Assessing the performance of NHS Hospital Trusts: the role of ‘hard’ and ‘soft’ information. Health Policy 1999; 48: 119-34. doi: 10.1016/S0168-8510(99)00035-4
  23. McCraken M, Jé, McIlwain T, F, Fottler M, D. Measuring oraganizational performance in the hospital industry:an exploratory comparison of objective and subjective methods. Health Serv Manage Res 2001; 14: 211-9. 
  24. Ministry of Finance and Development Planning (MFDP). National Development Plan 8: 1997/98-2002/03. Gaborone: MFDP; 1997.
  25. Yin RK. Case Study Research: Design and Methods. 3rd edition. London: Sage Publications; 2003.
  26. Creswell JW. Research design: Qualitative, quantitative and mixed methods approaches. 2nd edition. London: Sage Publications Inc; 2003.
  27. Teddlie C, Tashakkori A. Foundations of mixed methods research: Integrating quantitative and qualitative approaches in the social and behavioural sciences. Thousand Oaks: Sage; 2009.
  28. Miles MB, Huberman AM. Qualitative data analysis. 2nd ed. Thousands Oaks: Sage Publications; 1994.
  29. Ministry of Health (MoH). Approved structure of the Ministry of Health.  Gaborone: Ministry of Health; 2005.
  30. Central Statistics Office (CSO). Stats brief: Access to health services in Botswana. Gaborone: Central Statistics Office; 2007.
  31. Ministry of Health (MoH). Botswana human resource strategic plan for health 2008-2016. Gaborone: Ministry of Health; n.d.
  32. Lenneiye M, Bloom G, Haddon B, Kraus R, Ndlovu R. Botswana district hospitals’ expansion requirements study, Summary report. Gaborone: Ministry of Health; 1996.
  33. Central Statistics Office (CSO). Health statistics 2000. Gaborone: Central Statistics Office; 2003.
  34. Central Statistics Office (CSO). Health statistics report 2005. Gaborone: Central Statistics Office; 2008.
  35. Statistics Botswana. Health Statistics Report 2009. Gaborone: Statistics Botswana; 2012.
  36. Ministry of Health (MoH). National health service situational analysis report. Gaborone: Ministry of Health; 2009.
  37. Jane S. Shortage of medications in health facilities. Gaborone: Radio Botswana; 2009.
  38. Healthshare Integrated Solutions. Final report: Performance audit and gap analysis of the four district and two referral public hospitals in Botswana. Gaborone: Ministry of Health; 2009.
  39. Ministry of Health (MoH). The provider perspective on the provision of quality care. Gaborone: Ministry of Health; 2004.
  40. Khulumani P, Tau P, Ditirafalo T, Kolberg J, Skjelmerud A, Clark S. Patient satisfaction with health care services in Scottish Livingstone Hospital (SLH), Botswana. Gaborone: Ministry of Health; 1998.
  41. McPake B. Public autonomous hospitals in sub-Saharan Africa: trends and issues. Health Policy 1996; 35: 155-77.  doi: 10.1016/0168-8510(95)00778-4
  42. McPake B, Yepes FJ, Lake S, Sanchez LH. Is the Colombian health system reform improving the performance of public hospitals in Bogotá? Health Policy Plan 2003; 18: 182-94. doi: 10.1093/heapol/czg023
  43. Ssengooba F, Atuyambe L, McPake B, Hanson K, Okuonzi  S. What could be achieved with greater public hospital autonomy? Comparison of public and PNFP hospitals in Uganda. Public Adm Dev 2002; 22: 415-28.  doi: 10.1002/pad.244
  44. Collins D, Njeru G, Meme J, Newbrander W. Hospital autonomy: The experience of Kenyatta National hospital. Int J Health Plann Manage 1999; 14: 129-53. 
  45. Bossert T, Chitah MB, Browser D. Decentralization in Zambia: resource allocation and district performance. Health Policy Plan 2003; 18: 357-69.  doi: 10.1093/heapol/czg044
  46. Tenbensel T. Health targets. Health Policy Monitor. 2007. Survey no: 10.
  47. Taytiwat P, Briggs D, Fraser J, Minichiello V, Cruickshank M. Lessons from understanding the role of community hospital director in Thailand: clinical versus manager. Int J Health Plann Manage 2010; 26. doi: 10.1002/hpm.1040
  48. Pillay R. The skills gap in hospital management: a comparative analysis of hospital managers in the public and private sectors in South Africa. Health Serv Manage Res 2010; 23: 30-6.  doi: 10.1258/hsmr.2009.009015
  49. Blas E, Limbambala M. The challenges of hospitals in health sector reforms: the case of Zambia. Health Policy Plan 2001; 16: 29-43. 
  50. Borg MA. Bed occupancy and overcrowding as determinant factors in the incidence of MRSA infections within general ward settings. J Hosp Infect 2003: 316-8.  doi: 10.1016/S0195-6701(03)00153-1
  51. DeLia D. Annual bed statistics give a misleading picture of hospital surge capacity. Ann Emerg Med 2006; 48: 384-8.  doi: 10.1016/j.annemergmed.2006.01.024
  52. Council for Health Service Accreditation of Southern Africa (COHSASA). Making health care safer and better [internet]. 2009. Available from: http://www.cohsasa.co.za/
  53. Hurst J. Performance measurement and improvement in OECD health systems: Overview of issues and challenges.  In: Measuring up: Improving health system performance in OECD countries. Paris: OECD; 2002.
  54. Papanicolas I, Smith PC, Mossialos E. Principles of performance measurement. Euro Observer 2008; 10: 1-4. 
  55. Connolly T, Conlon E, Deutsch SJ. Organizational effectiveness: A multiple-constituency approach. Acad Manage J 1980; 5: 211-7. 
  56. Murray CJ, Evans D, editors. Health systems performance: Goals, framework and overview. Geneva: World Health Organization; 2003.
  57. Rubin H, Pronovost P, Diette GB. The advantages and disadvantages of process-based measures of health care quality. Int J Qual Health Care 2001; 13: 469-74. 
  58. Girard JF, Minvielle É. In: Measuring up: Lessons and potentials, in Measuring up: Improving health system performance in OECD countries. Paris: OECD; 2002.
  59. Smith PC. Developing composite indicators for assessing health system efficiency. In:  Measuring up: Improving health system performance in OECD countries. Paris: OECD; 2002.

  • Received Date 30 June 2014
  • Revised Date 29 August 2014
  • Accepted Date 09 September 2014
  • First Published Date 09 September 2014
  • Published Date 01 September 2014