Examining and Contextualizing Approaches to Establish Policy Support Organizations – A Critical Interpretive Synthesis

Document Type : Review Article

Authors

1 Health Policy PhD Program, McMaster University, Hamilton, ON, Canada

2 McMaster Health Forum, McMaster University, Hamilton, ON, Canada

3 Department of Health Evidence and Impact, McMaster University, Hamilton, ON, Canada

4 Centre for Health Economics and Policy Analysis, McMaster University, Hamilton, ON, Canada

5 Department of Political Science, McMaster University, Hamilton, ON, Canada

6 Africa Centre for Evidence, University of Johannesburg, Johannesburg, South Africa

7 Knowledge to Policy Center, American University of Beirut, Beirut, Lebanon

8 Universidad de Antioquia, Medellin, Colombia

Abstract

Background
In response to worldwide calls for the need to support evidence-informed policy-making (EIPM), more countries are increasingly interested in enhancing their efforts to use research to inform policy-making. In order to inform the efforts of those asked to lead the support of EIPM, our aim is to develop a conceptual framework to guide the process of establishing a policy support organization (PSO).
 
Methods
We conducted a critical interpretive synthesis (CIS). We conducted a two steps literature review. In the second step, we systematically searched OVID EMBASE, PsychInfo, HealthStar, CINAHL, Web of Science, Social Science Abstract, Health Systems Evidence, and ProQuest Dissertations and Theses Global databases for documents reporting the establishment of PSOs and the contextual factors influencing the process of establishing these organizations. We assessed the eligibility of the retrieved articles and synthesized the findings iteratively.
 
Results
We included 52 documents in the synthesis. Our findings suggest that a PSO establishment process has four interconnected stages: awareness, development, assessment, and maturation. The process of establishing a PSO is iterative and influenced by political, research and health systems contextual factors, which determine the availability of the resources and the trust between researchers and policy-makers. The contextual factors have an impact on each other, and the challenges that arise from one factor can be mitigated by other factors.
 
Conclusion
For those interested in establishing a PSO, our framework provides a road map for identifying the most appropriate starting point and the factors that might influence the establishment process. Leaders of such PSOs can use our findings to expand or refine their scope of work. Given that this framework focuses only on PSOs in the health sector, an important next step for research would be to include other sectors from social systems and identify any additional insight that can enhance our framework.

Keywords


  1. Graham ID, Logan J, Harrison MB, et al. Lost in knowledge translation: time for a map? J Contin Educ Health Prof. 2006;26(1):13-24. doi:10.1002/chp.47
  2. Strydom WF, Funke N, Nienaber S, Nortje K, Steyn M. Evidence-based policymaking: a review. S Afr J Sci. 2010;106(5-6):17-24. doi:10.4102/sajs.v106i5/6.249
  3. Wilson DC, Smith NA, Blakey NC, Shaxson L. Using research-based knowledge to underpin waste and resources policy. Waste Manag Res. 2007;25(3):247-256. doi:10.1177/0734242x07079154
  4. Fierlbeck K. Paradigm freeze: why it is so hard to reform health-care policy in Canada. Can Public Adm. 2014;57(3):478-480. doi:10.1111/capa.12085
  5. Kingdon JW. Agendas, Alternatives, and Public Policies. 2nd ed. New York, USA: HarperCollins College Publishers; 2003.
  6. Fafard P. Evidence and Healthy Public Policy: Insights from Health and Political Sciences. http://www.ncchpp.ca/docs/FafardEvidence08June.PDF.  Accessed March 1, 2019. Published 2008.
  7. Oxman AD, Lavis JN, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 1: what is evidence-informed policymaking? Health Res Policy Syst. 2009;7(Suppl 1):S1. doi:10.1186/1478-4505-7-s1-s1
  8. International Development Research Centre (IDCR). The Knowledge Translation Toolkit: Bridging the Know-Do Gap: A Resource for Researchers. Ottawa: International Development Research Centre; 2011.
  9. Lavis JN, Lomas J, Hamid M, Sewankambo NK. Assessing country-level efforts to link research to action. Bull World Health Organ. 2006;84(8):620-628. doi:10.2471/blt.06.030312
  10. World Health Organization (WHO). World Report on Knowledge for Better Health: Strengthening Health Systems. Geneva: WHO; 2004. https://apps.who.int/iris/bitstream/handle/10665/43058/9241562811.pdf?sequence=1&isAllowed=y.  Accessed March 5, 2019.
  11. Jewell CJ, Bero LA. "Developing good taste in evidence": facilitators of and hindrances to evidence-informed health policymaking in state government. Milbank Q. 2008;86(2):177-208. doi:10.1111/j.1468-0009.2008.00519.x
  12. Stewart R, Langer L, Erasmus Y. An integrated model for increasing the use of evidence by decision-makers for improved development. Dev South Afr. 2019;36(5):616-631. doi:10.1080/0376835X.2018.1543579
  13. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7:50.  doi:10.1186/1748-5908-7-50
  14. Innvaer S, Vist G, Trommald M, Oxman A. Health policy-makers' perceptions of their use of evidence: a systematic review. J Health Serv Res Policy. 2002;7(4):239-244. doi:10.1258/135581902320432778
  15. Oliver K, Cairney P. The dos and don’ts of influencing policy: a systematic review of advice to academics. Palgrave Commun. 2019;5(1):21. doi:10.1057/s41599-019-0232-y
  16. Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14:2. doi:10.1186/1472-6963-14-2
  17. Jakobsen MW, Eklund Karlsson L, Skovgaard T, Aro AR. Organisational factors that facilitate research use in public health policy-making: a scoping review. Health Res Policy Syst. 2019;17(1):90. doi:10.1186/s12961-019-0490-6
  18. Jakobsen MW. Evidence-Informed Policymaking: The Role of Research, Stakeholders and Policy Organizations [thesis]. Odense: Syddansk Universitetsforlag; 2019.
  19. Lavis JN, Moynihan R, Oxman AD, Paulsen EJ. Evidence-informed health policy 4 - case descriptions of organizations that support the use of research evidence. Implement Sci. 2008;3:56. doi:10.1186/1748-5908-3-56
  20. Lavis JN, Oxman AD, Moynihan R, Paulsen EJ. Evidence-informed health policy 3 - interviews with the directors of organizations that support the use of research evidence. Implement Sci. 2008;3:55. doi:10.1186/1748-5908-3-55
  21. Lavis JN, Paulsen EJ, Oxman AD, Moynihan R. Evidence-informed health policy 2 - survey of organizations that support the use of research evidence. Implement Sci. 2008;3:54. doi:10.1186/1748-5908-3-54
  22. Lavis JN, Lomas J, Hamid M, Sewankambo NK. Assessing country-level efforts to link research to action. Bull World Health Organ. 2006;84(8):620-628. doi:10.2471/blt.06.030312
  23. Canadian Institutes of Health Research (CIHR). Knowledge Translation at CIHR. http://www.cihr-irsc.gc.ca/e/29418.html#7.  Accessed September 8, 2017. Published 2017.
  24. Ellen ME, Horowitz E, Vaknin S, Lavis JN. Views of health system policymakers on the role of research in health policymaking in Israel. Isr J Health Policy Res. 2016;5(1):24. doi:10.1186/s13584-016-0088-1
  25. Hamid M, Bustamante-Manaog T, Truong VD, et al. EVIPNet: translating the spirit of Mexico. Lancet. 2005;366(9499):1758-1760. doi:10.1016/s0140-6736(05)67709-4
  26. Kasonde JM, Campbell S. Creating a knowledge translation platform: nine lessons from the Zambia Forum for Health Research. Health Res Policy Syst. 2012;10:31. doi:10.1186/1478-4505-10-31
  27. Contandriopoulos D, Lemire M, Denis JL, Tremblay E. Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature. Milbank Q. 2010;88(4):444-483. doi:10.1111/j.1468-0009.2010.00608.x
  28. Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A. Synthesising qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy. 2005;10(1):45-53. doi:10.1177/135581960501000110
  29. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review--a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10 Suppl 1:21-34. doi:10.1258/1355819054308530
  30. Dixon-Woods M, Cavers D, Agarwal S, et al. Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 2006;6:35. doi:10.1186/1471-2288-6-35
  31. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O, Peacock R. Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci Med. 2005;61(2):417-430. doi:10.1016/j.socscimed.2004.12.001
  32. Dixon-Woods M. Critical Interpretive Synthesis: What it is and Why it is Needed. https://abstracts.cochrane.org/2006-dublin/critical-interpretive-synthesis-what-it-and-why-it-needed.  Accessed March 1, 2019. Published 2006.
  33. Wilson MG, Ellen ME, Lavis JN, et al. Processes, contexts, and rationale for disinvestment: a protocol for a critical interpretive synthesis. Syst Rev. 2014;3:143. doi:10.1186/2046-4053-3-143
  34. Boyko JA, Lavis JN, Abelson J, Dobbins M, Carter N. Deliberative dialogues as a mechanism for knowledge translation and exchange in health systems decision-making. Soc Sci Med. 2012;75(11):1938-1945. doi:10.1016/j.socscimed.2012.06.016
  35. Alderson P, Green S, Higgins JP. Cochrane Reviewers’ Handbook 4.2.2. The Cochrane Library 2004; https://www.iecs.org.ar/cochrane/guias/Handbook_4-2-2.pdf.   Accessed December 23,  2018.
  36. Eakin JM, Mykhalovskiy E. Reframing the evaluation of qualitative health research: reflections on a review of appraisal guidelines in the health sciences. J Eval Clin Pract. 2003;9(2):187-194. doi:10.1046/j.1365-2753.2003.00392.x
  37. Cochrane. Cochrane Knowledge Translation Framework. http://community.cochrane.org/sites/default/files/uploads/Cochrane%20Knowledge%20Translation%20Framework%281%29.pdf.  Accessed July 13, 2018. Published 2017.
  38. Brennan SE, Cumpston M, Misso ML, McDonald S, Murphy MJ, Green SE. Design and formative evaluation of the Policy Liaison Initiative: a long-term knowledge translation strategy to encourage and support the use of Cochrane systematic reviews for informing health policy. Evid Policy. 2016;12(1):25-52. doi:10.1332/174426415x14291899424526
  39. El-Jardali F, Lavis J, Moat K, Pantoja T, Ataya N. Capturing lessons learned from evidence-to-policy initiatives through structured reflection. Health Res Policy Syst. 2014;12:2. doi:10.1186/1478-4505-12-2
  40. World Health Organization Regional Office for Europe. EVIPNet Europe: Situation Analysis Manual. Copenhagen: World Health Organization Regional Office for Europe; 2017. http://www.euro.who.int/__data/assets/pdf_file/0004/335551/EVIPNet-Europe-Situation-Analysis-Manual.pdf?ua=1.  Accessed January 10, 2019.
  41. Hawkes S, B KA, Jadeja N, et al. Strengthening capacity to apply health research evidence in policy making: experience from four countries. Health Policy Plan. 2016;31(2):161-170. doi:10.1093/heapol/czv032
  42. Haynes A, Rowbotham SJ, Redman S, Brennan S, Williamson A, Moore G. What can we learn from interventions that aim to increase policy-makers' capacity to use research? a realist scoping review. Health Res Policy Syst. 2018;16(1):31. doi:10.1186/s12961-018-0277-1
  43. Mihalicza P, Leys M, Borbás I, Szigeti S, Biermann O, Kuchenmüller T. Qualitative assessment of opportunities and challenges to improve evidence-informed health policy-making in Hungary - an EVIPNet situation analysis pilot. Health Res Policy Syst. 2018;16(1):50. doi:10.1186/s12961-018-0331-z
  44. Mijumbi RM, Oxman AD, Panisset U, Sewankambo NK. Feasibility of a rapid response mechanism to meet policymakers' urgent needs for research evidence about health systems in a low income country: a case study. Implement Sci. 2014;9:114. doi:10.1186/s13012-014-0114-z
  45. Sheikh K, Kumar S, Ved R, et al. India's new health systems knowledge platform-making research matter. Lancet. 2016;388(10061):2724-2725. doi:10.1016/s0140-6736(16)32391-1
  46. Sriram V, Bennett S, Raman VR, Sheikh K. Developing the National Knowledge Platform in India: a policy and institutional analysis. Health Res Policy Syst. 2018;16(1):13. doi:10.1186/s12961-018-0283-3
  47. Zida A, Lavis JN, Sewankambo NK, Kouyate B, Ouedraogo S. Evaluating the process and extent of institutionalization: a case study of a rapid response unit for health policy in Burkina Faso. Int J Health Policy Manag. 2018;7(1):15-26. doi:10.15171/ijhpm.2017.39
  48. van Kammen J, de Savigny D, Sewankambo N. Using knowledge brokering to promote evidence-based policy-making: the need for support structures. Bull World Health Organ. 2006;84(8):608-612. doi:10.2471/blt.05.028308
  49. Scarlett J, Köhler K, Reinap M, et al. Evidence-informed Policy Network (EVIPNet) Europe: success stories in knowledge translation. Public Health Panor. 2018;4(2):161-169.
  50. El-Jardali F, Ataya N, Jamal D, Jaafar M. A multi-faceted approach to promote knowledge translation platforms in eastern Mediterranean countries: climate for evidence-informed policy. Health Res Policy Syst. 2012;10:15. doi:10.1186/1478-4505-10-15
  51. Keita N, Lokossou V, Berthe A, Sombie I, Johnson E, Busia K. The West African experience in establishing steering committees for better collaboration between researchers and decision-makers to increase the use of health research findings. Health Res Policy Syst. 2017;15(Suppl 1):50. doi:10.1186/s12961-017-0216-6
  52. Ongolo-Zogo P, Lavis JN, Tomson G, Sewankambo NK. Initiatives supporting evidence informed health system policymaking in Cameroon and Uganda: a comparative historical case study. BMC Health Serv Res. 2014;14:612. doi:10.1186/s12913-014-0612-3
  53. Uneke CJ, Ezeoha AE, Uro-Chukwu HC, Ezeonu CT, Igboji J. Promoting researchers and policy-makers collaboration in evidence-informed policy-making in Nigeria: outcome of a two-way secondment model between university and health ministry. Int J Health Policy Manag. 2018;7(6):522-531. doi:10.15171/ijhpm.2017.123
  54. Mwendera C, de Jager C, Longwe H, Hongoro C, Phiri K, Mutero CM. Development of a framework to improve the utilisation of malaria research for policy development in Malawi. Health Res Policy Syst. 2017;15(1):97. doi:10.1186/s12961-017-0264-y
  55. Ongolo-Zogo P, Lavis JN, Tomson G, Sewankambo NK. Climate for evidence informed health system policymaking in Cameroon and Uganda before and after the introduction of knowledge translation platforms: a structured review of governmental policy documents. Health Res Policy Syst. 2015;13:2. doi:10.1186/1478-4505-13-2
  56. Nabyonga-Orem J, Gebrikidane M, Mwisongo A. Assessing policy dialogues and the role of context: Liberian case study before and during the Ebola outbreak. BMC Health Serv Res. 2016;16 Suppl 4(Suppl 4):219. doi:10.1186/s12913-016-1454-y
  57. Basaza R, Kinegyere A, Mutatina B, Sewankambo N. National framework for the sustainability of health knowledge translation initiatives in Uganda. Int J Technol Assess Health Care. 2018;34(1):120-128. doi:10.1017/s0266462317004482
  58. Langlois EV, Becerril Montekio V, Young T, Song K, Alcalde-Rabanal J, Tran N. Enhancing evidence informed policymaking in complex health systems: lessons from multi-site collaborative approaches. Health Res Policy Syst. 2016;14:20. doi:10.1186/s12961-016-0089-0
  59. Berman J, Mitambo C, Matanje-Mwagomba B, et al. Building a knowledge translation platform in Malawi to support evidence-informed health policy. Health Res Policy Syst. 2015;13:73. doi:10.1186/s12961-015-0061-4
  60. Mansilla C, Herrera CA, Basagoitia A, Pantoja T. The Evidence-Informed Policy Network (EVIPNet) in Chile: lessons learned from a year of coordinated efforts. Rev Panam Salud Publica. 2017;43:e36. doi:10.26633/rpsp.2017.36
  61. Uneke CJ, Aulakh BK, Ezeoha AE, Ndukwe CD, Onwe F. Bridging the divide between research and policy in Nigeria: the role of a health policy advisory committee. J Public Health Policy. 2012;33(4):423-429. doi:10.1057/jphp.2012.30
  62. Uneke CJ, Sombie I, Keita N, Lokossou V, Johnson E, Ongolo-Zogo P. An assessment of policymakers' engagement initiatives to promote evidence informed health policy making in Nigeria. Pan Afr Med J. 2017;27:57. doi:10.11604/pamj.2017.27.57.9844
  63. Bennett S, Corluka A, Doherty J, et al. Influencing policy change: the experience of health think tanks in low- and middle-income countries. Health Policy Plan. 2012;27(3):194-203. doi:10.1093/heapol/czr035
  64. Bennett S, Corluka A. Health Policy Analysis Institutes: Landscaping and Learning from Experience. Geneva: Alliance for Health Policy and Systems Research; 2010. https://www.who.int/alliance-hpsr/evidenceinformed/alliancehpsr_healthpolicyanalysisinstitutesreport.pdf.  Accessed October 12, 2018.
  65. Rispel LC, Doherty J. Research in support of health systems transformation in South Africa: the experience of the Centre for Health Policy. J Public Health Policy. 2011;32 Suppl 1:S10-29. doi:10.1057/jphp.2011.33
  66. Uneke CJ, Ndukwe CD, Ezeoha AA, Uro-Chukwu HC, Ezeonu CT. Implementation of a health policy advisory committee as a knowledge translation platform: the Nigeria experience. Int J Health Policy Manag. 2015;4(3):161-168. doi:10.15171/ijhpm.2015.21
  67. Roby DH, Jacobs K, Kertzner AE, Kominski GF. The California health policy research program - supporting policy making through evidence and responsive research. J Health Polit Policy Law. 2014;39(4):887-900. doi:10.1215/03616878-2743263
  68. Clar C, Campbell S, Davidson L, Graham W. Systematic Review: What are the Effects of Interventions to Improve the Uptake of Evidence from Health Research into Policy in Low and Middle-Income Countries? https://assets.publishing.service.gov.uk/media/57a08ab3ed915d3cfd0008c2/SR_EvidenceIntoPolicy_Graham_May2011_MinorEditsJuly2011.pdf.  Accessed December 5, 2018. Published 2011.
  69. Yehia F, El Jardali F. Applying knowledge translation tools to inform policy: the case of mental health in Lebanon. Health Res Policy Syst. 2015;13:29. doi:10.1186/s12961-015-0018-7
  70. Shroff Z, Aulakh B, Gilson L, Agyepong IA, El-Jardali F, Ghaffar A. Incorporating research evidence into decision-making processes: researcher and decision-maker perceptions from five low- and middle-income countries. Health Res Policy Syst. 2015;13:70. doi:10.1186/s12961-015-0059-y
  71. Shaw SE, Russell J, Parsons W, Greenhalgh T. The view from nowhere? how think tanks work to shape health policy. Crit Policy Stud. 2015;9(1):58-77. doi:10.1080/19460171.2014.964278
  72. Goering P, Butterill D, Jacobson N, Sturtevant D. Linkage and exchange at the organizational level: a model of collaboration between research and policy. J Health Serv Res Policy. 2003;8 Suppl 2:14-19. doi:10.1258/135581903322405126
  73. Uzochukwu B, Mbachu C, Onwujekwe O, et al. Health policy and systems research and analysis in Nigeria: examining health policymakers' and researchers' capacity assets, needs and perspectives in south-east Nigeria. Health Res Policy Syst. 2016;14:13. doi:10.1186/s12961-016-0083-6
  74. El-Jardali F, Saleh S, Khodor R, et al. An institutional approach to support the conduct and use of health policy and systems research: The Nodal Institute in the Eastern Mediterranean Region. Health Res Policy Syst. 2015;13:40. doi:10.1186/s12961-015-0032-9
  75. Mutatina B, Basaza R, Obuku E, Lavis JN, Sewankambo N. Identifying and characterising health policy and system-relevant documents in Uganda: a scoping review to develop a framework for the development of a one-stop shop. Health Res Policy Syst. 2017;15(1):7. doi:10.1186/s12961-017-0170-3
  76. Mijumbi-Deve R, Sewankambo NK. A process evaluation to assess contextual factors associated with the uptake of a rapid response service to support health systems' decision-making in Uganda. Int J Health Policy Manag. 2017;6(10):561-571. doi:10.15171/ijhpm.2017.04
  77. Uzochukwu B, Onwujekwe O, Mbachu C, et al. The challenge of bridging the gap between researchers and policy makers: experiences of a Health Policy Research Group in engaging policy makers to support evidence informed policy making in Nigeria. Global Health. 2016;12(1):67. doi:10.1186/s12992-016-0209-1
  78. Boyko JA. Evidence-informed health policy making in Canada: past, present, and future. J Evid Based Med. 2015;8(4):215-221. doi:10.1111/jebm.12169
  79. Ongolo-Zogo P, Lavis JN, Tomson G, Sewankambo NK. Assessing the influence of knowledge translation platforms on health system policy processes to achieve the health millennium development goals in Cameroon and Uganda: a comparative case study. Health Policy Plan. 2018;33(4):539-554. doi:10.1093/heapol/czx194
  80. Wilson M, Lavis J, Grimshaw J. Supporting the use of research evidence in the Canadian health sector. Healthc Q. 2012;15 Spec No:58-62. doi:10.12927/hcq.2013.23148
  81. Campbell D, Donald B, Moore G, Frew D. Evidence check: knowledge brokering to commission research reviews for policy. Evid Policy. 2011;7(1):97-107. doi:10.1332/174426411x553034
  82. WHO Regional Office for Europe. Conceptual Background and Case Studies - Introduction to EVIPNet Europe. Copenhagen: WHO Regional Office for Europe; 2017. http://www.euro.who.int/__data/assets/pdf_file/0004/368833/Annual-report-2017-for-EVIPNet-Europe.pdf?ua=1.  Accessed February 15, 2019.
  83. Majdzadeh R, Sadighi J, Nejat S, Shahidzade Mahani A, Gholami J. Knowledge translation for research utilization: design of a knowledge translation model at Tehran University of Medical Sciences. J Contin Educ Health Prof. 2008;28(4):270-277. doi:10.1002/chp.193
  84. Moore GM, Redman S, Turner T, Haines M. Rapid reviews in health policy: a study of intended use in the New South Wales' Evidence Check programme. Evid Policy. 2016;12(4):505-519. doi:10.1332/174426415x14446635524057
  85. Ziam S. Knowledge brokers and how to communicate knowledge in 2010. Allergy Asthma Clin Immol. 2010;6(4):A3. doi:10.1186/1710-1492-6-S4-A3
  86. Moat KA, Lavis JN, Abelson J. How contexts and issues influence the use of policy-relevant research syntheses: a critical interpretive synthesis. Milbank Q. 2013;91(3):604-648. doi:10.1111/1468-0009.12026
  87. El-Jardali F, Lavis JN, Ataya N, Jamal D, Ammar W, Raouf S. Use of health systems evidence by policymakers in eastern Mediterranean countries: views, practices, and contextual influences. BMC Health Serv Res. 2012;12:200. doi:10.1186/1472-6963-12-200
  88. Liverani M, Hawkins B, Parkhurst JO. Political and institutional influences on the use of evidence in public health policy. A systematic review. PLoS One. 2013;8(10):e77404. doi:10.1371/journal.pone.0077404
  89. Gagliardi AR, Webster F, Brouwers MC, Baxter NN, Finelli A, Gallinger S. How does context influence collaborative decision-making for health services planning, delivery and evaluation? BMC Health Serv Res. 2014;14:545. doi:10.1186/s12913-014-0545-x

Articles in Press, Accepted Manuscript
Available Online from 30 September 2020