“We’re Not Providing the Best Care If We Are Not on the Cutting Edge of Research”: A Research Impact Evaluation at a Regional Australian Hospital and Health Service

Document Type : Original Article

Authors

1 Townsville Hospital and Health Service, Townsville, QLD, Australia

2 James Cook University, Townsville, QLD, Australia

3 Flinders University, Adelaide, SA, Australia

Abstract

Background 
Research is central to high functioning health services alongside clinical care and health professional training. The impact of embedded research includes delivery of high-quality care and improved patient outcomes. Evaluations of research impact help health service leadership ensure investments lead to the greatest healthcare benefits for patients. This study aimed to retrospectively evaluate the impact of research investment from 2008 to 2018 at Townsville Hospital and Health Service (THHS), a regional Hospital and Health Service in Queensland, Australia. The evaluation also sought to identify contextual conditions that enable or hinder intended impacts.

Methods 
A mixed-methods realist-informed evaluation was conducted using documentation, interviews with 15 staff and available databases to identify and measure research investments, impacts and contextual conditions influencing impact outcomes.

Results 
Between 2008 and 2018, THHS increased resources for research by funding research projects, employing research personnel, building research-enabling facilities, hosting research events, and providing research education and training. Clinical practice, policy and workforce impacts were successful in isolated pockets, championed by individual researchers and facilitated by their policy and community-of-practice networks. However, there was little organisationallevel support for continuity of research and implementation into practice and policy. Availability of research supports varied geographically across THHS, and across disciplines.

Conclusion 
Definitive steps in the development of THHS as a credible and productive research centre and leading hospital research centre in Northern Australia are evident. Continuing investments should address support for the research continuum through to translation and establish ongoing, systematic processes for evaluating research investment and impact.

Highlights

 

Commentaries Published on this Paper

 

  • Retrospective Impact Evaluation Continuing to Prove Challenging Irrespective of Setting: A Study of Research Impact Enablers and Challenges Cloaked as an Impact Evaluation?; Comment on “‘We’re Not Providing the Best Care If We Are Not on the Cutting Edge of Research’: A Research Impact Evaluation at a Regional Australian Hospital and Health Service”

        Abstract | PDF

 

  • Bibliometrics, the “Clinical Diagnostics” of Research Impact; Comment on “‘We’re Not Providing the Best Care If We Are Not on the Cutting Edge of Research’: A Research Impact Evaluation at a Regional Australian Hospital and Health Service”

        Abstract | PDF

 

  • Cutting Edge Research? Realistic Expectations of Priorities, Scope and Engagement; Comment on “‘We’re Not Providing the Best Care If We Are Not on the Cutting Edge of Research’: A Research Impact Evaluation at a Regional Australian Hospital and Health Service”

        Abstract | PDF

 

  • If Providing Best Care Means Being at the Cutting Edge of Research, Should It Be Implemented System-wide?; Comment on “‘We’re Not Providing the Best Care If We Are Not on the Cutting Edge of Research’: A Research Impact Evaluation at a Regional Australian Hospital and Health Service”

        Abstract | PDF

 

  • Embedded Research: Possibilities for Learning Health Systems; Comment on “‘We’re Not Providing the Best Care if We are Not on the Cutting Edge of Research’: A Research Impact Evaluation at a Regional Australian Hospital and Health Service”

        Abstract | PDF

 

Keywords

References

  1. Boaz A, Hanney S, Jones T, Soper B. Does the engagement of clinicians and organisations in research improve healthcare performance: A three-stage review. BMJ Open. 2015;5(12). doi:10.1136/bmjopen-2015-009415
  2. Ozdemir BA, Karthikesalingam A, Sinha S, et al. Research activity and the association with mortality. PLoS ONE. 2015;10(2):1-15. doi:10.1371/journal.pone.0118253
  3. Deeming S, Searles A, Reeves P, Nilsson M. Measuring research impact in Australia’s medical research institutes: A scoping literature review of the objectives for and an assessment of the capabilities of research impact assessment frameworks. Health Research Policy and Systems. 2017;15(1):1-13. doi:10.1186/s12961-017-0180-1
  4. Buykx P, Humphreys J, Wakerman J, et al. “Making evidence count”: A framework to monitor the impact of health services research. Australian Journal of Rural Health. 2012;20(2):51-58. doi:10.1111/j.1440-1584.2012.01256.x
  5. Hanney S, Greenhalgh T, Blatch-Jones A, Glover M, Raftery J. The impact on healthcare, policy and practice from 36 multi-project research programmes: Findings from two reviews. Health Research Policy and Systems. 2017;15(1):1-21. doi:10.1186/s12961-017-0191-y
  6. Australian Government Department of Health. Review to Strengthen Independent Medical Research Institutes.; 2015.
  7. Perkins DA, Barclay L, Browne KM, et al. The Australian Rural Health Research Collaboration: building collaborative population health research in rural and remote NSW. New South Wales public health bulletin. 2011;22(1-2):23-26. doi:10.1071/nb10067
  8. Barclay L, Phillips A, Lyle D. Rural and remote health research: Does the investment match the need? Australian Journal of Rural Health. 2018;26(2):74-79. doi:10.1111/ajr.12429
  9. Greville H, Haynes E, Kagie R, Thompson SC. ‘It Shouldn’t Be This Hard’: Exploring the Challenges of Rural Health Research. International Journal of Environmental Research and Public Health. 2019;16(23). doi:10.3390/ijerph16234643
  10. McKeon S. Strategic Review of Health and Medical Research.; 2013. papers3://publication/uuid/7A2B4688-8C06-46B3-998E-3E8EFEB0007B
  11. Australian Medical Research Advisory Board. Australian Medical Research and Innovation Strategy 2021-2026 Determination.; 2021.
  12.     Edelman A, Topp SM, Taylor J, Ovseiko P v. “‘ Academic ’ is a dirty word ” : Intended impact pathways of an emerging academic health centre in tropical regional Australia. 2018;(September):1-18. doi:10.1002/hpm.2681
  13. Queensland Government. Townsville Hospital and Health Service Annual Report.; 2018. Accessed February 22, 2021. https://www.townsville.health.qld.gov.au/
  14. Edelman A, Brown A, Pain T, Larkins S, Harvey G. Evaluating research investment and impact at a regional Australian Hospital and Health Service : a programme theory and conceptual framework. Health Research Policy and Systems. 2020;18(30):1-15. doi:10.1186/s12961-020-0542-y
  15. Pawson R, Tilley N. Realistic Evaluation. SAGE Publications Ltd; 1997.
  16. Nguyen T, Graham ID, Mrklas KJ, et al. How does integrated knowledge translation (IKT) compare to other collaborative research approaches to generating and translating knowledge ? Learning from experts in the field. 2020;6:1-20.
  17. Williamson A, Tait H, el Jardali F, et al. How are evidence generation partnerships between researchers and policy-makers enacted in practice? A qualitative interview study. Health Research Policy and Systems. 2019;17(1). doi:10.1186/s12961-019-0441-2
  18. Charmaz K. Constructing Grounded Theory: A Practical Guide through Qualitative Analysis. SAGE Publications; 2006.
  19. Harding K, Lynch L, Porter J, Taylor NF. Organisational benefits of a strong research culture in a health service: a systematic review. Aust Health Rev. 2017;41(1):45-53. doi:10.1071/ah15180
  20. Hanney S, Boaz A, Jones T, Soper B. Engagement in research: an innovative three-stage review of the benefits for health-care performance. Health Services and Delivery Research. 2013;1(8):1-152. doi:10.3310/hsdr01080
  21. Pain T, Petersen M, Fernando M. Building allied health research capacity at a regional Australian hospital: a follow-up study. Internet Journal of Allied Health Sciences & Practice. 2018;16(4):Article 8.
  22. Pain T, Plummer D, Pighills A, Harvey D. Comparison of research experience and support needs of rural versus regional allied health professionals. Australian Journal of Rural Health. 2015;23:277-285.
  23. Webster E, Thomas M, Ong N, Cutler L. Rural Research Capacity Building Program: capacity building outcomes. Australian Journal of Primary Health. 2011;17(1):107-113. doi:http://dx.doi.org/10.1071/PY10060
  24. O’Sullivan B, Cairns A, Gurney T. Exploring how to sustain “place-based” rural health academic research for informing rural health systems: A qualitative investigation. Health Research Policy and Systems. 2020;18(1):1-14. doi:10.1186/s12961-020-00608-7
  25. Braithwaite J, Boyling C, Warwick M, Smith KL, Zurynski Y, Hibbert P. Where the Rubber Meets the Road : A Learning Health Care System for Australia A Working Paper Providing a Synthesis of Ideas Drawn from Selected Literature Where the Rubber Meets the Road : A Learning Health Care System for Australia.; 2019.
  26. Morain SR, Kass NE, Grossmann C. What allows a health care system to become a learning health care system: Results from interviews with health system leaders. Learning Health Systems. 2017;1(1):1-8. doi:10.1002/lrh2.10015
  27. Wolfenden L, Yoong SL, Williams CM, et al. Embedding researchers in health service organizations improves research translation and health service performance: the Australian Hunter New England Population Health example. Journal of Clinical Epidemiology. 2017;85:3-11. doi:10.1016/j.jclinepi.2017.03.007
  28. Myall M, May C, Richardson A, et al. Creating pre-conditions for change in clinical practice: the influence of interactions between multiple contexts and human agency. J Health Organ Manag. 2020;ahead-of-p(ahead-of-print). doi:10.1108/jhom-06-2020-0240
  29. Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Services Research. 2014;14. doi:10.1186/1472-6963-14-2
  30. Barratt H, Shaw J, Simpson L, Bhatia S, Fulop N. Health services research: Building capacity to meet the needs of the health care system. Journal of Health Services Research and Policy. 2017;22(4):243-249. doi:10.1177/1355819617714815
  31. Bowen S, Botting I, Graham ID, et al. Experience of Health Leadership in Partnering With University-Based Researchers in Canada - A Call to “Re-imagine” Research. Int J Health Policy Manag. 2019;8(12):684-699. doi:10.15171/ijhpm.2019.66
  32. Michie S, van Stralen MM, West R. The behaviour change wheel: A new method for characterising and designing behaviour change interventions. Implementation Science. 2011;6(1):42. doi:10.1186/1748-5908-6-42
  33. Hinrichs-Krapels S, Grant J. Exploring the effectiveness, efficiency and equity (3e’s) of research and research impact assessment. Palgrave Communications. 2016;2(16090). doi:10.1057/palcomms.2016.90
  34. Rubio DM. Common metrics to assess the efficiency of clinical research. Eval Health Prof. 2013;36(4):432-446. doi:10.1177/0163278713499586
  35. Cooke J. A framework to evaluate research capacity building in health care. BioMed Central. 2005;6(44):1-6.
  36. Greenhalgh T, Raftery J, Hanney S, Glover M. Research impact: A narrative review. BMC Medicine. 2016;14(1). doi:10.1186/s12916-016-0620-8
  37. Panel on Return on Investment in Health Research. Making an Impact: A Preferred Framework and Indicators to Measure Returns on Investment in Health Research.; 2009.
International Journal of Health Policy and Management
Volume 11, Issue 12
December 2022
Pages 3000-3011

Files

History

  • Receive Date: 23 June 2021
  • Revise Date: 18 March 2022
  • Accept Date: 10 May 2022
  • First Publish Date: 11 May 2022

Share

How to cite

Statistics