Development and Content Validation of a Transcultural Instrument to Assess Organizational Readiness for Knowledge Translation in Healthcare Organizations: The OR4KT

Document Type: Original Article

Authors

1 Population Health and Optimal Health Practices Research Unit, CHU de Québec-Université Laval Research Centre, Québec, QC, Canada

2 Faculty of Nursing, Université Laval, Québec, QC, Canada

3 CRED Research Centre – École Supérieure des Affaires, Beirut, Lebanon

4 CHEO Research Institute, Centre for Practice Changing Research Building, Ottawa, ON, Canada

5 Better Outcomes Registry & Nerwork (BORN) Ontario, Ottawa, ON, Canada

6 Primary Care Research Unit of Bizkaia – Osakidetza, Basque Health Service, Bilbao, Spain

7 BioCruces Health Research Institute, Baracaldo, Spain

8 Faculty of Nursing and School of Public Health, University of Alberta, Edmonton, AB, Canada

9 Department of Family Medicine, Université Laval, Québec, QC, Canada

10 Department of Nursing Sciences, Université Laval, Québec, QC, Canada

Abstract

Background
Implementing effective interventions in healthcare requires organizations to be ready to support change. This study aimed to develop, adapt transculturally, and assess the content and face validity of the Organizational Readiness for Knowledge Translation (OR4KT) tool. The OR4KT was designed to measure the readiness of healthcare organizations to implement evidence-informed change across a variety of services.

 
Methods
Based on systematic reviews of the literature, a Delphi exercise, and expert consultation, we first generated an initial pool of items. Second, we developed and assessed content validity of the pilot OR4KT questionnaire in English. Third, we created French and Spanish versions using a sequential forward and backward translation approach, and transcultural adaptation by a consensus process. Finally, we conducted pilot studies in three contexts – the Basque country region (Spain), and the provinces of Québec and Ontario (Canada) – where 30 experts assessed the face validity of the three versions of OR4KT.

 
Results
We selected 59 items, grouped in 6 dimensions (organizational climate, context, change content, leadership, organizational support, and motivation) for the final English version of OR4KT. Translation and transcultural adaptation did not identify any content or language problems. Our findings indicate that the English, French and Spanish versions of OR4KT are linguistically equivalents and have high face validity. Only minor revisions to the wording of some items were recommended.

 
Conclusion
The OR4KT holds promise as a measure of readiness for knowledge translation (KT) in healthcare organizations. The validity and reliability of the three versions of the OR4KT will be assessed in real-life contexts of implementation of evidence-based changes in healthcare.

Highlights

Supplementary File 1 (Download)

Supplementary File 2 (Download)

 

Commentaries Published on this Paper

  • Are Healthcare Organizations Ready for Change?; Comment on “Development and Content Validation of a Transcultural Instrument to Assess Organizational Readiness for Knowledge Translation in Healthcare Organizations: The OR4KT”

            Abstract | PDF

  • Assessing Organizational Readiness for Change; Comment on “Development and Content Validation of a Transcultural Instrument to Assess Organizational Readiness for Knowledge Translation in Healthcare Organizations: The OR4KT”

            Abstract | PDF

 

Authors' Response to the Commentaries

  • Future Directions for the Organizational Readiness for Knowledge Translation (OR4KT) Tool: Response to Recent Commentaries

           Abstract | PDF

Keywords

Main Subjects


  1. Attieh R, Gagnon MP, Estabrooks CA, et al. Organizational readiness for knowledge translation in chronic care: a review of theoretical components. Implement Sci. 2013;8:138. doi:10.1186/1748-5908-8-138
  2. Weiner BJ, Amick H, Lee SY. Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields. Med Care Res Rev. 2008;65(4):379-436. doi:10.1177/1077558708317802
  3. Yost J, Ganann R, Thompson D, et al. The effectiveness of knowledge translation interventions for promoting evidence-informed decision-making among nurses in tertiary care: a systematic review and meta-analysis. Implement Sci. 2015;10:98. doi:10.1186/s13012-015-0286-1
  4. Montague TJ, Gogovor A, Krelenbaum M. Time for chronic disease care and management. Can J Cardiol. 2007;23(12):971-975.
  5. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7:50. doi:10.1186/1748-5908-7-50
  6. Brown CE, Wickline MA, Ecoff L, Glaser D. Nursing practice, knowledge, attitudes and perceived barriers to evidence-based practice at an academic medical center. J Adv Nurs. 2009;65(2):371-381. doi:10.1111/j.1365-2648.2008.04878.x
  7. Kotter JP. Leading change.  Boston: Harvard Business Press; 1996.
  8. Armenakis AA, Harris SG, Mossholder KW. Creating Readiness for Organizational Change. Hum Relat. 1993;46(6):681-703. doi:10.1177/001872679304600601
  9. Scott SD, Estabrooks CA, Allen M, Pollock C. A context of uncertainty: how context shapes nurses' research utilization behaviors. Qual Health Res. 2008;18(3):347-357. doi:10.1177/1049732307313354
  10. Cummings GG, Estabrooks CA, Midodzi WK, Wallin L, Hayduk L. Influence of organizational characteristics and context on research utilization. Nurs Res. 2007;56(4 Suppl):S24-39. doi:10.1097/01.nnr.0000280629.63654.95
  11. Graham ID, Logan J, Harrison MB, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13-24. doi:10.1002/chp.47
  12. Attieh R, Gagnon MP, Estabrooks CA, et al. Organizational readiness for knowledge translation in chronic care: a Delphi study. BMC Health Serv Res. 2014;14:534. doi:10.1186/s12913-014-0534-0
  13. Ehrhart MG, Aarons GA, Farahnak LR. Assessing the organizational context for EBP implementation: the development and validity testing of the Implementation Climate Scale (ICS). Implement Sci. 2014;9:157. doi:10.1186/s13012-014-0157-1
  14. Holt DT, Helfrich CD, Hall CG, Weiner BJ. Are you ready? How health professionals can comprehensively conceptualize readiness for change. J Gen Intern Med. 2010;25 Suppl 1:50-55. doi:10.1007/s11606-009-1112-8
  15. Timmings C, Khan S, Moore JE, Marquez C, Pyka K, Straus SE. Ready, Set, Change! Development and usability testing of an online readiness for change decision support tool for healthcare organizations. BMC Med Inform Decis Mak. 2016;16:24. doi:10.1186/s12911-016-0262-y
  16. Shea CM, Jacobs SR, Esserman DA, Bruce K, Weiner BJ. Organizational readiness for implementing change: a psychometric assessment of a new measure. Implement Sci. 2014;9:7. doi:10.1186/1748-5908-9-7
  17. Gagnon MP, Attieh R, Ghandour el K, et al. A systematic review of instruments to assess organizational readiness for knowledge translation in health care. PLoS One. 2014;9(12):e114338. doi:10.1371/journal.pone.0114338
  18. Gagnon MP, Labarthe J, Legare F, et al. Measuring organizational readiness for knowledge translation in chronic care. Implement Sci. 2011;6:72. doi:10.1186/1748-5908-6-72
  19. Higgins R, Murphy B, Worcester M, Daffey A. Supporting chronic disease self-management: translating policies and principles into clinical practice. Aust J Prim Health. 2012;18(1):80-87. doi:10.1071/py11006
  20. Bowditch JL, Buono AF. A primer on Organizational Behavior. 5th ed. New York: John Wiley Sons, Limited; 2002.
  21. Touw-Otten F, Meadows K. Cross-cultural issues in outcome measurements. In: Hutchinson A, McColl E, Christie M, Riccalton CS. Amsterdam: Hardwood Academic Publishers; 1996:199-208.
  22. Maneesriwongul W, Dixon JK. Instrument translation process: a methods review. J Adv Nurs. 2004;48(2):175-186. doi:10.1111/j.1365-2648.2004.03185.x
  23. Grandes G, Bully P, Martinez C, Gagnon MP. Validity and reliability of the Spanish version of the Organizational Readiness for Knowledge Translation (OR4KT) questionnaire. Implement Sci. 2017;12(1):128. doi:10.1186/s13012-017-0664-y
  24. Streiner DL, Norman GR. Health Measurement Scales: A practical guide to their development and use. 4th ed.  Oxford (UK): Oxford University Press; 2008.