Process Evaluation of an Effective Multifaceted Quality Improvement Intervention to Improve Acute Stroke Care: Unpacking the Success Factors and Challenges

Document Type : Original Article

Authors

1 Department of Medicine, School of Clinical Sciences at Monash Health, Monash University, Clayton, VIC, Australia

2 College of Nursing and Health Sciences, Flinders University, Adelaide, SA, Australia

3 Stroke and Critical Care Research, The Florey Institute of Neuroscience and Mental Health, University of Melbourne, Heidelberg, VIC, Australia

4 Nursing Research Institute, St Vincent’s Health Network Sydney, St Vincent’s Hospital Melbourne and Australian Catholic University, Sydney, NSW, Australia

5 School of Nursing Midwifery and Paramedicine, Australian Catholic University, Sydney, NSW, Australia

Abstract

Background 
The Shared Team Efforts Leading to Adherence Results (STELAR) program is a multifaceted quality improvement intervention directed at hospital clinicians to improve stroke care. In a stepped-wedge cluster trial (N = 9 hospitals, Australia), STELAR achieved a 17% improvement in adherence to prioritized clinical indicators (composite outcome). We report the critical success factors and challenges that influenced change in care delivery.
 
Methods 
STELAR included two externally facilitated workshops; (i) feedback of national registry data to identify practice gaps and prioritize indicators; (ii) barrier assessment and action plan development (2017-2018). Hospitals appointed a site coordinator, and identified local change champions. Two months of remote-support followed to implement action plans. The process evaluation included workshop observations (N = 18), document review, satisfaction surveys (N = 51), and semi-structured interviews (external facilitator, N = 9 clinician site coordinators). Qualitative data were mapped to an implementation framework before inductive thematic analysis. Quantitative data were analysed descriptively, with all data triangulated.
 
Results 
Critical success factors included delivery by knowledge translation experts, external facilitation support/nudging to maintain staff engagement at hospitals, and the use of evidence to self-select prioritized indicators. Involving multidisciplinary staff in action planning and supporting local change champions to lead the implementation fostered capacity building. Reported challenges related to insufficient time when focusing on several prioritized indicators simultaneously within a limited timeframe and having to address strategies that involved working with different clinicians or hospital departments. Staff workload and availability and lack of medical buy-in and management support during the process were wider organizational challenges reported.
 
Conclusion 
Despite the identified challenges imposed by the limited implementation period, STELAR’s multifaceted attributes underpinned the overall strong positive change in quality of stroke care. Implications for wider adoption include involvement of knowledge translation experts with ongoing support for capacity building, and allowing greater time to work through implementation strategies. 

Keywords

References

  1. Feigin VL, Brainin M, Norrving B, et al. World Stroke Organization (WSO): Global Stroke Fact Sheet 2022. Int J Stroke. 2022;17(1):18-29. doi:1177/17474930211065917
  2. Stroke Foundation. Australian Living Stroke Guidelines. Melbourne: Stroke Foundation; 2025. https://informme.org.au/en/guidelines. Accessed November 10, 2025.
  3. Intercollegiate Stroke Working Party. National Clinical Guideline for Stroke for the UK and Ireland. London: Intercollegiate Stroke Working Party; 2023. https://www.strokeguideline.org. Accessed November 10, 2025.
  4. Powers WJ, Rabinstein AA, Ackerson T, et al. Guidelines for the early management of patients with acute ischemic stroke: 2019 update to the 2018 guidelines for the early management of acute ischemic stroke: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2019;50(12):e344-e418. doi:1161/STR.0000000000000211
  5. Ormseth CH, Sheth KN, Saver JL, Fonarow GC, Schwamm LH. The American Heart Association's Get With the Guidelines (GWTG)-Stroke development and impact on stroke care. Stroke Vasc Neurol. 2017;2(2):94-105. doi:1136/svn-2017-000092
  6. Cadilhac DA, Morrison J, Birhanu M, et al. The Australian Stroke Clinical Registry Annual Report 2023. Melbourne: The Florey Institute of Neuroscience and Mental Health; 2024.
  7. Cadilhac DA, Andrew NE, Lannin NA, et al. Quality of acute care and long-term quality of life and survival: the Australian Stroke Clinical Registry. Stroke. 2017;48(4):1026-1032. doi:1161/STROKEAHA.116.015714
  8. Langhorne P, Ramachandra S, Stroke Unit Trialists' Collaboration. Organized inpatient (stroke unit) care for stroke: network meta-analysis. Cochrane Database Syst Rev. 2020;4(4):CD000197. doi:1002/14651858.CD000197.pub4
  9. Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7:50. doi:1186/1748-5908-7-50
  10. Ivers N, Yogasingam S, Lacroix M, et al. Audit and feedback: effects on professional practice. Cochrane Database Syst Rev. 2025;3(3):CD000259. doi:1002/14651858.CD000259.pub4
  11. Harvey G, Lynch E. Enabling continuous quality improvement in practice: the role and contribution of facilitation. Front Public Health. 2017;5:27. doi:3389/fpubh.2017.00027
  12. Squires JE, Sullivan K, Eccles MP, et al. Are multifaceted interventions more effective than single-component interventions in changing health-care professionals' behaviours? An overview of systematic reviews. Implement Sci. 2014;9:152. doi:1186/s13012-014-0152-6
  13. Colquhoun HL, Squires JE, Kolehmainen N, et al. Methods for designing interventions to change healthcare professionals' behaviour: a systematic review. Implement Sci. 2017;12(1):30. doi:1186/s13012-017-0560-5
  14. Cahill LS, Carey LM, Lannin NA, et al. Implementation interventions to promote the uptake of evidence-based practices in stroke rehabilitation. Cochrane Database Syst Rev. 2020;10(10):CD012575. doi:1002/14651858.CD012575.pub2
  15. Bird ML, Miller T, Connell LA, Eng JJ. Moving stroke rehabilitation evidence into practice: a systematic review of randomized controlled trials. Clin Rehabil. 2019;33(10):1586-1595. doi:1177/0269215519847253
  16. Cadilhac DA, Marion V, Andrew NE, et al. A stepped-wedge cluster-randomized trial to improve adherence to evidence-based practices for acute stroke management. Jt Comm J Qual Patient Saf. 2022;48(12):653-664. doi:1016/j.jcjq.2022.09.003
  17. Cadilhac DA, Lannin NA, Anderson CS, et al. Protocol and pilot data for establishing the Australian Stroke Clinical Registry. Int J Stroke. 2010;5(3):217-226. doi:1111/j.1747-4949.2010.00430.x
  18. Rycroft-Malone J. The PARIHS framework--a framework for guiding the implementation of evidence-based practice. J Nurs Care Qual. 2004;19(4):297-304. doi:1097/00001786-200410000-00002
  19. Baker R, Camosso-Stefinovic J, Gillies C, et al. Tailored interventions to address determinants of practice. Cochrane Database Syst Rev. 2015;2015(4):CD005470. doi:1002/14651858.CD005470.pub3
  20. Oakley A, Strange V, Bonell C, Allen E, Stephenson J; RIPPLE Study Team. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413-416. doi:1136/bmj.332.7538.413
  21. Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2013;14:15. doi:1186/1745-6215-14-15
  22. Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. 2016;11:33. doi:1186/s13012-016-0398-2
  23. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349-357. doi:1093/intqhc/mzm042
  24. Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;5(1):80-92. doi:1177/160940690600500107
  25. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77-101. doi:1191/1478088706qp063oa
  26. Xu W, Zammit K. Applying thematic analysis to education: a hybrid approach to interpreting data in practitioner research. Int J Qual Methods. 2020;19:1-9. doi:1177/1609406920918810
  27. Denzin NK. The Research Act: A Theoretical Introduction to Sociological Methods. Chicago: Aldine Pub & Co.; 1970.
  28. Bladin CF, Bagot KL, Vu M, et al. Real-world, feasibility study to investigate the use of a multidisciplinary app (Pulsara) to improve prehospital communication and timelines for acute stroke/STEMI care. BMJ Open. 2022;12(7):e052332. doi:1136/bmjopen-2021-052332
  29. Bladin CF, Kim J, Bagot KL, et al. Improving acute stroke care in regional hospitals: clinical evaluation of the Victorian Stroke Telemedicine program. Med J Aust. 2020;212(8):371-377. doi:5694/mja2.50570
  30. Nilsen P, Seing I, Ericsson C, Birken SA, Schildmeijer K. Characteristics of successful changes in health care organizations: an interview study with physicians, registered nurses and assistant nurses. BMC Health Serv Res. 2020;20(1):147. doi:1186/s12913-020-4999-8
  31. Williams L, Daggett V, Slaven JE, et al. A cluster-randomised quality improvement study to improve two inpatient stroke quality indicators. BMJ Qual Saf. 2016;25(4):257-264. doi:1136/bmjqs-2015-004302
  32. Machline-Carrion MJ, Santucci EV, Damiani LP, et al. Effect of a quality improvement intervention on adherence to therapies for patients with acute ischemic stroke and transient ischemic attack: a cluster randomized clinical trial. JAMA Neurol. 2019;76(8):932-941. doi:1001/jamaneurol.2019.1012
  33. Wang Y, Li Z, Zhao X, et al. Effect of a multifaceted quality improvement intervention on hospital personnel adherence to performance measures in patients with acute ischemic stroke in china: a randomized clinical trial. JAMA. 2018;320(3):245-254. doi:1001/jama.2018.8802
  34. Miao M, Power E, O'Halloran R. Factors affecting speech pathologists' implementation of stroke management guidelines: a thematic analysis. Disabil Rehabil. 2015;37(8):674-685. doi:3109/09638288.2014.932444
  35. Barwick MA, Boydell KM. A pragmatic review of knowledge translation: moving forward in cardiovascular disease and hypertension. Toronto: Heart and Stroke Foundation of Ontario; 2007.
  36. Andrew NE, Middleton S, Grimley R, et al. Hospital organizational context and delivery of evidence-based stroke care: a cross-sectional study. Implement Sci. 2019;14(1):6. doi:1186/s13012-018-0849-y
  37. Paul CL, Ryan A, Rose S, et al. How can we improve stroke thrombolysis rates? A review of health system factors and approaches associated with thrombolysis administration rates in acute stroke care. Implement Sci. 2016;11:51. doi:1186/s13012-016-0414-6
  38. Yoong SL, Hall A, Stacey F, et al. Nudge strategies to improve healthcare providers' implementation of evidence-based guidelines, policies and practices: a systematic review of trials included within Cochrane systematic reviews. Implement Sci. 2020;15(1):50. doi:1186/s13012-020-01011-0
  39. Rycroft-Malone J, Seers K, Eldh AC, et al. A realist process evaluation within the Facilitating Implementation of Research Evidence (FIRE) cluster randomised controlled international trial: an exemplar. Implement Sci. 2018;13(1):138. doi:1186/s13012-018-0811-0
  40. Fasugba O, Cheng H, Dale S, et al. Finding the right dose: a scoping review examining facilitation as an implementation strategy for evidence-based stroke care. Implement Sci. 2024;19(1):4. doi:1186/s13012-023-01332-w
  41. Liddy C, Hogg W, Singh J, et al. A real-world stepped wedge cluster randomized trial of practice facilitation to improve cardiovascular care. Implement Sci. 2015;10:150. doi:1186/s13012-015-0341-y
  42. Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10(1):63-74. doi:1370/afm.1312
  43. Stetler CB, Legro MW, Rycroft-Malone J, et al. Role of "external facilitation" in implementation of research findings: a qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implement Sci. 2006;1:23. doi:1186/1748-5908-1-23
  44. Kitson AL, Harvey G. Methods to succeed in effective knowledge translation in clinical practice. J Nurs Scholarsh. 2016;48(3):294-302. doi:1111/jnu.12206
  45. Harvey G, Loftus-Hills A, Rycroft-Malone J, et al. Getting evidence into practice: the role and function of facilitation. J Adv Nurs. 2002;37(6):577-588. doi:1046/j.1365-2648.2002.02126.x
  46. Berta W, Cranley L, Dearing JW, Dogherty EJ, Squires JE, Estabrooks CA. Why (we think) facilitation works: insights from organizational learning theory. Implement Sci. 2015;10:141. doi:1186/s13012-015-0323-0
  47. Jolliffe L, Lannin NA, Larcombe S, et al. Training and education provided to local change champions within implementation trials: a rapid systematic review. Implement Sci. 2025;20(1):8. doi:1186/s13012-025-01416-9
  48. McInnes E, Dale S, Craig L, et al. Process evaluation of an implementation trial to improve the triage, treatment and transfer of stroke patients in emergency departments (T3 trial): a qualitative study. Implement Sci. 2020;15(1):99. doi:1186/s13012-020-01057-0
  49. Zamboni K, Baker U, Tyagi M, Schellenberg J, Hill Z, Hanson C. How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review. Implement Sci. 2020;15(1):27. doi:1186/s13012-020-00978-0
  50. Persson LÅ, Nga NT, Målqvist M, et al. Effect of facilitation of local maternal-and-newborn stakeholder groups on neonatal mortality: cluster-randomized controlled trial. PLoS Med. 2013;10(5):e1001445. doi:1371/journal.pmed.1001445
  51. Francis L, Dunt D, Cadilhac DA. How is the sustainability of chronic disease health programmes empirically measured in hospital and related healthcare services? A scoping review. BMJ Open. 2016;6(5):e010944. doi:1136/bmjopen-2015-010944
  52. Wray LO, Ritchie MJ, Oslin DW, Beehler GP. Enhancing implementation of measurement-based mental health care in primary care: a mixed-methods randomized effectiveness evaluation of implementation facilitation. BMC Health Serv Res. 2018;18(1):753. doi:1186/s12913-018-3494-3
  53. Morgan DL. Commentary—After triangulation, what next? J Mixed Methods Res. 2019;13(1):6-11. doi:1177/1558689818802752
  54. Malterud K, Siersma VD, Guassora AD. Sample size in qualitative interview studies: guided by information power. Qual Health Res. 2016;26(13):1753-1760. doi:1177/1049732315617444
International Journal of Health Policy and Management
Volume 15, Issue 1
2026
Pages 1-15

Files

History

  • Received Date: 01 February 2025
  • Revised Date: 11 December 2025
  • Accepted Date: 10 March 2026
  • First Published Date: 10 March 2026
  • Published Date: 01 December 2026

Share

How to cite

Statistics