Background Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country.
Methods A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection.
Results Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals.
Conclusion Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.
Dianis NL, Cummings C. An interdisciplinary approach to process performance improvement. J Nurs Care Qual 1998; 12: 49-59. doi: 10.1097/00001786-199804000-00011
Øvretveit J. Evaluating Health Interventions: An Introduction to Evaluation of Health Treatments, Services, Policies, and Organizational Interventions. Buckingham, Philadelphia: Open University Press; 1998.
Robbins SP, Coulter M. Management. 7th edition. New Jersy: Prentice-Hall International, Inc.; 2002.
Moullin M. Performance measurement definitions: Linking performance measurement and organisational excellence. Int J Health Care Qual Assur 2007; 20: 181-3. doi: 10.1108/09526860710743327
de Bruijn JA. Managing Performance in the Public Sector. 2nd edition. Oxon: Routledge; 2007.
Kwak NK, McCarthy KJ, Parker GE. A human resource planning model for hospital/medical technologists: an analytic hierarchy process approach. J Med Syst 1997; 21: 173-87.
Purbey S, Mukherjee K, Bhar C. Performance measurement system for healthcare processes. International Journal of Productivity and Performance Management 2006; 56: 241-51. doi: 10.1108/17410400710731446
Lohman C, Fortuin L, Wouters M. Designing a performance measurement system: a case study. Eur J Oper Res 2004; 156: 267-86. doi: 10.1016/s0377-2217(02)00918-9
Bititcti US, Turner T, Begemann C. Dynamics of performance measurement, systems. International Journal of Operations & Production Management 2000; 20: 692-704. doi: 10.1108/01443570010321676
Lynch R, Cross K. Measure Up! Yardsticks for Continuous Improvement. Oxford: Blackwell; 1991.
Neely A, Adams C, Kennerley M. The performance prism: the scorecard for measuring and managing business success. London: Prentice Hall Financial Times; 2002.
Kaplan RS, Norton DP. The balanced scorecard: measures that drive Performance. Harv Bus Rev 1992; 70: 71-9.
Kanji GK. Measurement of business excellence. Total Quality Management & Business Excellence 1998; 9: 633-43. doi: 10.1080/0954412988325
Kanji GK. Measuring business excellence. London: Routledge; 2002.
Hilarion P, Suñol R, Groene O, Vallejo P, Herrera E, Saura RM. Making performance indicators work: The experience of using consensus indicators for external assessment of health and social services at regional level in Spain. Health Policy 2008; 90: 94-103. doi: 10.1016/j.healthpol.2008.08.002
Joint Commission on Accreditation of Healthcare Organizations (JCAHO). Tools for Performance Measurement in Health Care: Quick Reference Guide. Washington: Joint Commission Resources; 2002.
Ballantine J, Brignall S, Modell S. Performance measurement and management in public health services: a comparison of U.K. and Swedish practice. Management Accounting Research 1998; 9: 71-94. doi: 10.1006/mare.1997.0067
Brignall S, Modell S. An institutional perspective on performance measurement and management in the new public sector. Management Accounting Research 2000; 11: 281-306. doi: 10.1006/mare.2000.0136
Hood C. The “new public management” in the 1980s: variations on a theme. Accounting Organisations and Society 1995; 20: 93-109. doi: 10.1016/0361-3682(93)e0001-w
Veillard J, Champagne F, Klazinga N, Kazandjian V, Arah OA, Guisset AL. A performance assessment framework for hospitals: the WHO regional office for Europe PATH project. Int J Qual Health Care 2005; 17: 487-96.
Scrivens E, Lodge J. Accreditation: protecting the professional or the consumer? Journal of Management Studies 1997; 34: 167-9. doi: 10.1093/intqhc/12.3.243
Donahue KT, Vanostenberg P. Joint Commission International accreditation: relationship to four models of evaluation. Int J Qual Health Care 2000; 12: 243-6.
Heaton C. External peer review in Europe: an overview from the ExPeRT Project. Int J Qual Health Care 2000; 12: 177-82. doi: 10.1093/intqhc/12.3.177
Greenfield D, Hinchcliff R, Pawsey M, Westbrook J, Braithwaite J. The public disclosure of accreditation information in Australia: Stakeholder perceptions of opportunities and challenges. Health Policy 2013. doi: 10.1016/j.healthpol.2013.09.002
Lancaster J, Braithwaite J, Greenfield D. Benefits of participating in accreditation surveying. Int J Health Care Qual Assur 2010; 23: 141-52. doi: 10.1108/09526861011017076
Braithwaite J, Shaw CD, Moldovan M, Greenfield D, Hinchcliff R, Mumford V, et al. Comparison of health service accreditation programs in low-and middle-income countries with those in higher income countries: a cross-sectional study. Int J Qual Health Care 2012; 24: 568-77. doi: 10.1093/intqhc/mzs064
Hinchcliff R, Greenfield D, Westbrook JI, Pawsey M, Mumford V, Braithwaite J. Stakeholder perspectives on implementing accreditation programs: a qualitative study of enabling factors. BMC Health Serv Res 2013; 13: 437. doi: 10.1186/1472-6963-13-437
Tabrizi JS, Gharibi F, Wilson AJ. Advantages and disadvantages of health care accreditation models. Health Promot Perspect 2011; 1: 1-31.
Cerqueira M. A literature review on the benefits, challenges and trends in accreditation as a quality assurance system. British Columbia: Ministry of Children and Family Development; 2006.
Scrivens E. Accreditation: protecting the professional or the consumer? Buckingham: Open University Press; 1995.
Scrivens E. Assessing the value of accreditation systems. Eur J Public Health 1997; 7: 4-8. doi: 10.1093/eurpub/7.1.4
Green J, Thorogood N. Qualitative methods for health research. London: Sage; 2004.
Barbara B. Factors Influencing Costs and Effectiveness of Accreditation. Oakbrook Terrace: JCAHO; 2006.
Jaafaripooyan E, Agrizzi D, Akbari-Haghighi F. Healthcare accreditation systems: further perspectives on performance measures Int J Qual Health Care 2011; 23: 645-56. doi: 10.1093/intqhc/mzr063
Yarmohammadian M, Shokri A, Bahmanziari N, Kordi K. The blind spots on Accreditation program (in Persian). Journal of Health System Research 2013; 9: 1158-66.
Pope C, Mays N. Qualitative research in health care. 3rd edition. Oxford: Blackwell Publishing; 2006.
Ministry of Health and Medical Education (MoHME). [The instruction of standards and principles of evaluation of the general hospitals]. Tehran: Centre for healthcare accreditation and supervision; Healthcare organisations evaluation group; 1997.
Ng GK, Leung GK, Johnston JM, Cowling BJ. Factors affecting implementation of accreditation programmes and the impact of the accreditation process on quality improvement in hospitals: a SWOT analysis. Hong Kong Med J 2013; 19: 434-46. doi: 10.12809/hkmj134063
Øvretveit J, Ham C. Action Evaluation of Health Programmes and Changes: A Handbook for a User-focused Approach. Oxon: Radcliffe Publishing; 2002.
Rooney A, van Ostenberg P. International accreditation: what;s good practice in Sao Paulo is good practice in Istanbul. J AHIMA 2004; 75: 38-9.
El-Jardali F, Jamal D, Dimassi H, Ammar W, Tchaghchaghian V. The impact of hospital accreditation on quality of care: perception of Lebanese nurses. Int J Qual Health Care 2008; 20: 363-71. doi: 10.1093/intqhc/mzn023
Moghimi A. [Familiarity with evaluation concepts and establishing quality measures]. Tehran: Ministry of Health, Centre for accreditation and supervision, Healthcare organisations evaluation group; 2004.
Vallabhaneni D. What’s Your MBA IQ: A Manager\'s Career Development Tool. Hoboken: John Wiley & Sons; 2009.
Batalden P, Leach D, Swing S, Dreyfus H, Dreyfus S. General Competencies And Accreditation In Graduate Medical Education. Health Aff (Millwood) 2002; 21: 103-11. doi: 10.1377/hlthaff.21.5.103
Gauld R. Comparative health policy in the Asia-Pacific. Maidenhead, Berkshire: Open University Press; 2005.
Mannion R, Davies H, Marshall M. Impact of star performance ratings in English acute hospital trusts. J Health Serv Res Policy 2005; 10: 18-24. doi: 10.1258/1355819052801877
Pomey M, Lemieux-Charles L, Champagne F, Angus D, Shabah A, Contandriopoulos A. Does accreditation stimulate change? A study of the impact of the accreditation process on Canadian healthcare organizations. Implement Sci 2010; 5: 1-14. doi: 10.1186/1748-5908-5-31
Kelman S, Friedman JN. Performance improvement and performance dysfunction: an empirical examination of distortionary impacts of the emergency room wait-time target in the English national health service. Journal of Public Administration Research and Theory 2009; 19: 917-46. doi: 10.1093/jopart/mun028
Bevan G, Hood C. Have targets improved performance in the English NHS? BMJ 2006; 332: 419-22. doi: 10.1136/bmj.332.7538.419
Shaw CD. External quality mechanisms for health care: summary of the ExPeRT project on visitatie, accreditation, EFQM and ISO assessment in European Union countries. Int J Qual Health Care 2000; 12: 169-75. doi: 10.1093/intqhc/12.3.169
Greenfield D, Braithwaite J. Health sector accreditation research: a systematic review. Int J Qual Health Care 2008; 20: 172-83. doi: 10.1093/intqhc/mzn005
Sack C, Scherag A, Lütkes P, Günther W, Jöckel K-H, Holtmann G. Is there an association between hospital accreditation and patient satisfaction with hospital care? A survey of 37 000 patients treated by 73 hospitals. Int J Qual Health Care 2011; 23: 278-83. doi: 10.1093/intqhc/mzr011
Ministry of Health and Medical Education (MoHME). [The instruction of standards and principles of evaluation of the general hospitals: Emergency department]. Tehran: Centre for healthcare accreditation and supervision, Healthcare organisations evaluation group; 1997.
Fairbrother G, Gleeson M. EQuIP accreditation: feedback from a Sydney teaching hospital. Aust Health Rev 2000; 23: 200-3. doi: 10.1071/ah000153
Bukonda N, Tavrow P, Abdallah H, Hoffner K, Tembo J. Implementing a national hospital accreditation program: the Zambian experience. Int J Qual Health Care 2003; 14: 7-16. doi: 10.1093/intqhc/14.suppl_1.7
Jaafaripooyan, E. (2014). Potential Benefits and Downsides of External Healthcare Performance Evaluation Systems: Real-Life Perspectives on Iranian Hospital Evaluation and Accreditation Program. International Journal of Health Policy and Management, 3(4), 191-198. doi: 10.15171/ijhpm.2014.84
Ebrahim Jaafaripooyan. "Potential Benefits and Downsides of External Healthcare Performance Evaluation Systems: Real-Life Perspectives on Iranian Hospital Evaluation and Accreditation Program". International Journal of Health Policy and Management, 3, 4, 2014, 191-198. doi: 10.15171/ijhpm.2014.84
Jaafaripooyan, E. (2014). 'Potential Benefits and Downsides of External Healthcare Performance Evaluation Systems: Real-Life Perspectives on Iranian Hospital Evaluation and Accreditation Program', International Journal of Health Policy and Management, 3(4), pp. 191-198. doi: 10.15171/ijhpm.2014.84
Jaafaripooyan, E. Potential Benefits and Downsides of External Healthcare Performance Evaluation Systems: Real-Life Perspectives on Iranian Hospital Evaluation and Accreditation Program. International Journal of Health Policy and Management, 2014; 3(4): 191-198. doi: 10.15171/ijhpm.2014.84