Measuring Organizational Culture in Ethiopia’s Primary Care System: Validation of a Practical Survey Tool for Managers

Document Type : Original Article

Authors

1 Global Health Leadership Initiative, Yale University, New Haven, CT, USA

2 Department of Health Policy and Management, Yale School of Public Health, New Haven, CT, USA

3 Department of Chronic Disease Epidemiology, Yale School of Public Health, New Haven, CT, USA

Abstract

Background 
Organizational culture has been widely recognized as predictive of health system performance and improved outcomes across various healthcare settings. Research on organizational culture in healthcare has been largely conducted in high-income settings, and validated scales to measure this concept in primary healthcare systems in lowand middle-income country (LMIC) settings are lacking. Our study aimed to validate a tool to measure organizational culture in the context of the Ethiopian Primary Healthcare Transformation Initiative (PTI), a collaborative of the Federal Ministry of Health (FMoH) and the Yale Global Health Leadership Initiative to strengthen primary healthcare system performance in Ethiopia.

Methods 
Following established survey development and adaptation guidelines, we adapted a 31-item US-based organizational culture scale using (1) cognitive interviewing, (2) testing with 1176 district and zonal health officials from four regions in Ethiopia, and (3) exploratory factor analysis (EFA).

Results 
Based on the results of cognitive interviewing, an adapted 30-item survey was piloted. The factor analyses of 1034 complete surveys (88% complete responses) identified five constructs of the scale which demonstrated strong validity and internal consistency: learning and problem solving, psychological safety, resistance to change, time for improvement, and commitment to the organization. Of the 30 a priori items, 26 items loaded well on the five constructs (loading values 0.40-0.86), and 4 items failed to load. Cronbach alpha coefficients were 0.86 for the scale as a whole and ranged from 0.65 to 0.90 for the subscales. The five-factor solution accounted for 62% of total variance in culture scores across respondents.

Conclusion 
Through validation and factor analyses, we generated a 26-item scale for measuring organizational culture in public primary healthcare systems in LMIC settings. This validated tool can be useful for managers, implementers, policy-makers, and researchers to assess and improve organizational culture in support of improved primary healthcare system performance.
 

Keywords

References

  1. Schein EH. Organizational Culture and Leadership. 4th ed. San Francisco: Jossey-Bass; 2010.
  2. Braithwaite J, Westbrook MT, Iedema R, Mallock NA, Forsyth R, Zhang K. A tale of two hospitals: assessing cultural landscapes and compositions. Soc Sci Med. 2005;60(5):1149-1162. doi:1016/j.socscimed.2004.06.046
  3. Jacobs R, Mannion R, Davies HT, Harrison S, Konteh F, Walshe K. The relationship between organizational culture and performance in acute hospitals. Soc Sci Med. 2013;76(1):115-125. doi:1016/j.socscimed.2012.10.014
  4. O'reilly CA, Chatman JA. Culture as social control: corporations, cults, and commitment. In: Cummings LL, Staw BM, eds. Research in Organizational Behavior: An Annual Series of Analytical Essays and Critical Reviews. Vol 18. Greenwich, CT: JAI Press; 1996:157-200.
  5. Shortell SM, O'Brien JL, Carman JM, et al. Assessing the impact of continuous quality improvement/total quality management: concept versus implementation. Health Serv Res. 1995;30(2):377-401.
  6. Ma C, McHugh MD, Aiken LH. Organization of hospital nursing and 30-day readmissions in Medicare patients undergoing surgery. Med Care. 2015;53(1):65-70. doi:1097/mlr.0000000000000258
  7. McHugh MD, Ma C. Hospital nursing and 30-day readmissions among Medicare patients with heart failure, acute myocardial infarction, and pneumonia. Med Care. 2013;51(1):52-59. doi:1097/MLR.0b013e3182763284
  8. Braithwaite J, Herkes J, Ludlow K, Testa L, Lamprell G. Association between organisational and workplace cultures, and patient outcomes: systematic review. BMJ Open. 2017;7(11):e017708. doi:1136/bmjopen-2017-017708
  9. Curry LA, Brault MA, Linnander EL, et al. Influencing organisational culture to improve hospital performance in care of patients with acute myocardial infarction: a mixed-methods intervention study. BMJ Qual Saf. 2018;27(3):207-217. doi:1136/bmjqs-2017-006989
  10. Al Lawati MH, Dennis S, Short SD, Abdulhadi NN. Patient safety and safety culture in primary health care: a systematic review. BMC Fam Pract. 2018;19(1):104. doi:1186/s12875-018-0793-7
  11. Hsiung KS, Colditz JB, McGuier EA, et al. Measures of organizational culture and climate in primary care: a systematic review. J Gen Intern Med. 2021;36(2):487-499. doi:1007/s11606-020-06262-7
  12. Akologo A, Abuosi AA, Anaba EA. A cross-sectional survey on patient safety culture among healthcare providers in the Upper East region of Ghana. PLoS One. 2019;14(8):e0221208. doi:1371/journal.pone.0221208
  13. Jiang K, Tian L, Yan C, et al. A cross-sectional survey on patient safety culture in secondary hospitals of Northeast China. PLoS One. 2019;14(3):e0213055. doi:1371/journal.pone.0213055
  14. Smiley K, Ofori L, Spangler C, et al. Safety culture and perioperative quality at the Volta river authority hospital in Akosombo, Ghana. World J Surg. 2019;43(1):16-23. doi:1007/s00268-018-4763-y
  15. Sopoh GE, Kouckodila Nzingoula MF, Sossa Jérôme C, et al. [Factors associated with the strength of organizational culture in a Beninese hospital]. Sante Publique. 2018;30(1):105-113. doi:3917/spub.181.0105
  16. Wami SD, Demssie AF, Wassie MM, Ahmed AN. Patient safety culture and associated factors: A quantitative and qualitative study of healthcare workers' view in Jimma zone hospitals, Southwest Ethiopia. BMC Health Serv Res. 2016;16:495. doi:1186/s12913-016-1757-z
  17. Mbau R, Gilson L. Influence of organisational culture on the implementation of health sector reforms in low- and middle-income countries: a qualitative interpretive review. Glob Health Action. 2018;11(1):1462579. doi:1080/16549716.2018.1462579
  18. Agency for Healthcare Research and Quality. Hospital Survey on Patient Safety Culture. https://www.ahrq.gov/sites/default/files/wysiwyg/professionals/quality-patient-safety/patientsafetyculture/hospital/userguide/hospcult.pdf. Accessed May 6, 2021.
  19. Bradley EH, Brewster AL, Fosburgh H, Cherlin EJ, Curry LA. Development and psychometric properties of a scale to measure hospital organizational culture for cardiovascular care. Circ Cardiovasc Qual Outcomes. 2017;10(3):e003422. doi:1161/circoutcomes.116.003422
  20. Quinn RE, Rohrbaugh J. A spatial model of effectiveness criteria: towards a competing values approach to organizational analysis. Manage Sci. 1983;29(3):363-377. doi:1287/mnsc.29.3.363
  21. Sexton JB, Helmreich RL, Neilands TB, et al. The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006;6:44. doi:1186/1472-6963-6-44
  22. Mallouli M, Aouicha W, Tlili MA, et al. [Safety culture in Tunisian primary health care: a multicenter study]. Sante Publique. 2017;29(5):685-691. doi:3917/spub.175.0685
  23. Mesfin D, Woldie M, Adamu A, Bekele F. Perceived organizational culture and its relationship with job satisfaction in primary hospitals of Jimma zone and Jimma town administration, correlational study. BMC Health Serv Res. 2020;20(1):438. doi:1186/s12913-020-05319-x
  24. Van Huy N, Thu NTH, Anh NLT, et al. The validation of organisational culture assessment instrument in healthcare setting: results from a cross-sectional study in Vietnam. BMC Public Health. 2020;20(1):316. doi:1186/s12889-020-8372-y
  25. Liu L, Desai MM, Fetene N, Ayehu T, Nadew K, Linnander E. District-level health management and health system performance: the Ethiopia primary healthcare transformation initiative. Int J Health Policy Manag. 2020. doi:34172/ijhpm.2020.236
  26. World Bank Group. World Bank Data Indicators. https://data.worldbank.org/indicator. Accessed May 5, 2021.
  27. Assefa Y, Damme WV, Williams OD, Hill PS. Successes and challenges of the Millennium Development Goals in Ethiopia: lessons for the sustainable development goals. BMJ Glob Health. 2017;2(2):e000318. doi:1136/bmjgh-2017-000318
  28. National Planning Commission, United Nations in Ethiopia. MDG Report 2014 Ethiopia. 2015. https://www.et.undp.org/content/ethiopia/en/home/library/mdg/EthiopiaMDG2014.html. Accessed May 6, 2021.
  29. Fetene N, Canavan ME, Megentta A, et al. District-level health management and health system performance. PLoS One. 2019;14(2):e0210624. doi:1371/journal.pone.0210624
  30. World Health Organization. Process of Translation and Adaptation of Instruments. https://www.who.int/substance_abuse/research_tools/translation/en/. Accessed May 5, 2021.
  31. Willis GB. Cognitive Interviewing and Questionnaire Design: A Training Manual. Cognitive Methods Staff Working Paper Series, No. 7. 1994. http://www.srl.uic.edu/links/CMS_WP07_Willis_1994_CogIntTraining.pdf. Accessed August 23, 2016.
  32. Nunnaly J. Psychometric Theory. New York: McGraw-Hill; 1978.
  33. Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods. 1999;4(3):272-299. doi:1037/1082-989x.4.3.272
  34. Floyd FJ, Widaman KF. Factor analysis in the development and refinement of clinical assessment instruments. Psychol Assess. 1995;7(3):286-299. doi:1037/1040-3590.7.3.286
  35. Kaiser HF. The application of electronic computers to factor analysis. Educ Psychol Meas. 1960;20(1):141-151. doi:1177/001316446002000116
  36. Kaufman JD, Dunlap WP. Determining the number of factors to retain: a Windows-based FORTRAN-IMSL program for parallel analysis. Behav Res Methods Instrum Comput. 2000;32(3):389-395. doi:3758/bf03200806
  37. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297-334.
  38. Taber KS. The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res Sci Educ. 2018;48(6):1273-1296. doi:1007/s11165-016-9602-2
  39. Brown TA. Confirmatory Factor Analysis for Applied Research. 2nd ed. New York, NY: Guilford Press; 2015.
  40. Cattell RB. The scree test for the number of factors. Multivariate Behav Res. 1966;1(2):245-276. doi:1207/s15327906mbr0102_10
  41. Streiner DL. Figuring out factors: the use and misuse of factor analysis. Can J Psychiatry. 1994;39(3):135-140. doi:1177/070674379403900303
  42. Scott T, Mannion R, Davies H, Marshall M. The quantitative measurement of organizational culture in health care: a review of the available instruments. Health Serv Res. 2003;38(3):923-945. doi:1111/1475-6773.00154
  43. Verbeke W, Volgering M, Hessels M. Exploring the conceptual expansion within the field of organizational behaviour: organizational climate and organizational culture. J Manag Stud. 1998;35(3):303-329. doi:1111/1467-6486.00095
  44. Bunderson JS, Sutcliffe KM. Why some teams emphasize learning more than others: evidence from business unit management teams. In: Sondak H, ed. Toward Phenomenology of Groups and Group Membership. Vol 4. Oxford: Emerald Group Publishing Limited; 2002:49-84. doi:1016/s1534-0856(02)04004-5
  45. Bunderson JS, Sutcliffe KM. Management team learning orientation and business unit performance. J Appl Psychol. 2003;88(3):552-560. doi:1037/0021-9010.88.3.552
  46. Tucker AL, Edmondson AC. Why hospitals don't learn from failures: organizational and psychological dynamics that inhibit system change. Calif Manage Rev. 2003;45(2):55-72. doi:2307/41166165
  47. Edmondson AC, Lei Z. Psychological safety: the history, renaissance, and future of an interpersonal construct. Annu Rev Organ Psychol Organ Behav. 2014;1(1):23-43. doi:1146/annurev-orgpsych-031413-091305
  48. Edmondson A. Psychological safety and learning behavior in work teams. Adm Sci Q. 1999;44(2):350-383. doi:2307/2666999
  49. March JG. Exploration and exploitation in organizational learning. Organ Sci. 1991;2(1):71-87. doi:1287/orsc.2.1.71
  50. Repenning NP, Sterman JD. Capability traps and self-confirming attribution errors in the dynamics of process improvement. Adm Sci Q. 2002;47(2):265-295. doi:2307/3094806
  51. McNatt Z, Linnander E, Endeshaw A, Tatek D, Conteh D, Bradley EH. A national system for monitoring the performance of hospitals in Ethiopia. Bull World Health Organ. 2015;93(10):719-726. doi:2471/blt.14.151399
  52. Linnander E, McNatt Z, Sipsma H, et al. Use of a national collaborative to improve hospital quality in a low-income setting. Int Health. 2016;8(2):148-153. doi:1093/inthealth/ihv074
  53. Meyer JP, Stanley DJ, Herscovitch L, Topolnytsky L. Affective, continuance, and normative commitment to the organization: a meta-analysis of antecedents, correlates, and consequences. J Vocat Behav. 2002;61(1):20-52. doi:1006/jvbe.2001.1842
  54. Berberoglu A. Impact of organizational climate on organizational commitment and perceived organizational performance: empirical evidence from public hospitals. BMC Health Serv Res. 2018;18(1):399. doi:1186/s12913-018-3149-z
  55. Stazyk EC, Pandey SK, Wright BE. Understanding affective organizational commitment: the importance of institutional context. Am Rev Public Adm. 2011;41(6):603-624. doi:1177/0275074011398119
  56. Singer SJ, Moore SC, Meterko M, Williams S. Development of a short-form learning organization survey: the LOS-27. Med Care Res Rev. 2012;69(4):432-459. doi:1177/1077558712448135
  57. Curry LA, Spatz E, Cherlin E, et al. What distinguishes top-performing hospitals in acute myocardial infarction mortality rates? A qualitative study. Ann Intern Med. 2011;154(6):384-390. doi:7326/0003-4819-154-6-201103150-00003
  58. Sudman S, Bradburn NM, Schwarz N. Thinking about Answers: The Application of Cognitive Processes to Survey Methodology. 1st ed. San Francisco: Jossey-Bass; 1996.
International Journal of Health Policy and Management
Volume 11, Issue 12
December 2022
Pages 3071-3078

Files

History

  • Receive Date: 23 July 2021
  • Revise Date: 28 February 2022
  • Accept Date: 18 June 2022
  • First Publish Date: 19 June 2022

Share

How to cite

Statistics