What, Where, and How to Collect Real-World Data and Generate Real-World Evidence to Support Drug Reimbursement Decision-Making in Asia: A reflection Into the Past and A Way Forward

Document Type : Original Article

Authors

1 Health Intervention and Technology Assessment Program (HITAP), Ministry of Health, Nonthaburi, Thailand

2 Saw Swee Hock School of Public Health, National University of Singapore (NUS), Singapore, Singapore

3 The Oxford Centre for Diabetes, Endocrinology, and Metabolism, University of Oxford, Oxford, UK

4 Ewha Womans University, Seoul, South Korea

5 Sunnybrook Odette Cancer Centre, Toronto, ON, Canada

6 Sunnybrook Research Institute, Toronto, ON, Canada

7 Canadian Centre for Applied Research in Cancer Control, Toronto, ON, Canada

8 Essential Medicine and Technology Division, Department of Medical Services, Ministry of Health, Thimphu, Bhutan

9 Health Technology Assessment Unit, Department of Health, Quezon City, Philippines

10 Faculty of Medicine, University of Adelaide, Adelaide, SA, Australia

11 Health Policy Advisory Committee on Technology, Brisbane, QLD, Australia

12 China Health Technology Assessment Centre, National Health Development Research Centre, Ministry of Health, Beijing, China

13 Hitotsubashi Institute for Advanced Study, Hitotsubashi University, Tokyo, Japan.

14 Agency for Care Effectiveness, Ministry of Health, Singapore, Singapore

15 Department of Community Medicine and School of Public Health, Post Graduate Institute of Medical Education and Research, Chandigarh, India

16 Taiwan National Hepatitis C Program Office, Ministry of Health and Welfare, Taipei, Taiwan

17 Discipline of Social and Administrative Pharmacy, School of Pharmaceutical Sciences, Universiti Sains Malaysia, Penang, Malaysia

18 Department of Pharmacology and Clinical Pharmacy, Faculty of Pharmacy, Universitas Padjadjaran, Sumedang, Indonesia

19 Center for Medical Technology Policy (CMTP), Baltimore, MD, USA

20 Cancer Research Program, School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia

21 Department of Medical Oncology, Alfred Hospital, Melbourne, VIC, Australia

22 Centre for Excellence in Economic Analysis Research, St. Michael’s Hospital, Toronto, ON, Canada

23 Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada

24 Department of Pharmacy, Faculty of Science, National University of Singapore (NUS), Singapore, Singapore

Abstract

Background 
Globally, there is increasing interest in the use of real-world data (RWD) and real-world evidence (RWE) to inform health technology assessment (HTA) and reimbursement decision-making. Using current practices and case studies shared by eleven health systems in Asia, a non-binding guidance that seeks to align practices for generating and using RWD/RWE for decision-making in Asia was developed by the REAL World Data In ASia for HEalth Technology Assessment in Reimbursement (REALISE) Working Group, addressing a current gap and needs among HTA users and generators.

Methods 
The guidance document was developed over two face-to-face workshops, in addition to an online survey, a face-to-face interview and pragmatic search of literature. The specific focus was on what, where and how to collect RWD/RWE.

Results 
All 11 REALISE member jurisdictions participated in the online survey and the first in-person workshop, 10 participated in the second in-person workshop, and 8 participated in the in-depth face-to-face interviews. The guidance document was iteratively reviewed by all working group members and the International Advisory Panel. There was substantial variation in: (a) sources and types of RWD being used in HTA, and (b) the relative importance and prioritization of RWE being used for policy-making. A list of national-level databases and other sources of RWD available in each country was compiled. A list of useful guidance on data collection, quality assurance and study design were also compiled.

Conclusion 
The REALISE guidance document serves to align the collection of better quality RWD and generation of reliable RWE to ultimately inform HTA in Asia.

Keywords

References

  1. Orsini LS, Berger M, Crown W, et al. Improving transparency to build trust in real-world secondary data studies for hypothesis testing-why, what, and how: recommendations and a road map from the real-world evidence transparency initiative. Value Health. 2020;23(9):1128-1136. doi:1016/j.jval.2020.04.002
  2. INAHTA, HTAi. HTA Glossary. http://htaglossary.net/HomePage. Accessed March 17, 2020.
  3. Berger ML, Sox H, Willke RJ, et al. Good practices for real-world data studies of treatment and/or comparative effectiveness: recommendations from the joint ISPOR-ISPE Special Task Force on real-world evidence in health care decision making. Pharmacoepidemiol Drug Saf. 2017;26(9):1033-1039. doi:1002/pds.4297
  4. Hampson G, Towse A, Dreitlein B, Henshall C, Pearson S. Real world evidence for coverage decisions: opportunities and challenges. A report from the 2017 ICER membership policy summit. 2018. https://icer-review.org/wp-content/uploads/2018/03/ICER-Real-World-Evidence-White-Paper-03282018.pdf. Accessed December 22, 2019.
  5. Murphy G. Use of Real-World Evidence in Single Drug Technology Assessment Processes by Health Technology Assessment and Regulatory Organizations. 2018. https://www.cadth.ca/use-real-world-evidence-single-drug-technology-assessment-processes-health-technology-assessment-and. Accessed December 19, 2019.
  6. Downing NS, Shah ND, Neiman JH, Aminawung JA, Krumholz HM, Ross JS. Participation of the elderly, women, and minorities in pivotal trials supporting 2011-2013 U.S. Food and Drug Administration approvals. Trials. 2016;17:199. doi:1186/s13063-016-1322-4
  7. Population by Region. 2021. https://www.worldometers.info/world-population/asia-population/. Accessed February 17, 2020.
  8. Fashoyin-Aje LA, Fernandes LL, Lemery S, et al. Asian representation in clinical trials of new drugs for the treatment of cancer. J Clin Oncol. 2017;35(15 Suppl):6564-6564. doi:1200/JCO.2017.35.15_suppl.6564
  9. Alemayehu C, Mitchell G, Nikles J. Barriers for conducting clinical trials in developing countries- a systematic review. Int J Equity Health. 2018;17(1):37. doi:1186/s12939-018-0748-6
  10. Lee E, Ryan S, Birmingham B, et al. Rosuvastatin pharmacokinetics and pharmacogenetics in white and Asian subjects residing in the same environment. Clin Pharmacol Ther. 2005;78(4):330-341. doi:1016/j.clpt.2005.06.013
  11. Annemans L, Makady A. TRUST4RD: tool for reducing uncertainties in the evidence generation for specialised treatments for rare diseases. Orphanet J Rare Dis. 2020;15(1):127. doi:1186/s13023-020-01370-3
  12. Bloem LT, Vreman RA, Peeters NWL, et al. Associations between uncertainties identified by the European Medicines Agency and national decision making on reimbursement by HTA agencies. Clin Transl Sci. 2021;14(4):1566-1577. doi:1111/cts.13027
  13. Lou J, Kc S, Toh KY, et al. Real-world data for health technology assessment for reimbursement decisions in Asia: current landscape and a way forward. Int J Technol Assess Health Care. 2020;36(5):474-480. doi:1017/s0266462320000628
  14. REALISE Guidance Document. 2021. https://hiper.nus.edu.sg/realise-guidance/. Accessed January 19, 2021.
  15. World Cafe Method. https://theworldcafe.com/key-concepts-resources/world-cafe-method/. Accessed December 22, 2022.
  16. Use of Real-World Data and Real-World Evidence to Support Drug Reimbursement Decision-Making in Asia. Public Feedback. 2020. https://hiper.nus.edu.sg/realise-guidance/. Accessed August, 8, 2022.
  17. Scholte M, van Dulmen SA, Neeleman-Van der Steen CW, van der Wees PJ, Nijhuis-van der Sanden MW, Braspenning J. Data extraction from electronic health records (EHRs) for quality measurement of the physical therapy process: comparison between EHR data and survey data. BMC Med Inform Decis Mak. 2016;16(1):141. doi:1186/s12911-016-0382-4
  18. Ministry of Public Health Ministry of Higher Education. 5 Ministry Joins Forces to Reform Big Rock 1 Public Health System, Driving Pandemic Ending Projects with Innovation. November 2021. https://www.mhesi.go.th/index.php/news/5006-5-big-rock-1.html. Accessed November 8, 2022.
  19. Precision Public Health Asia Society. Responsible Data Sharing in Health and Healthcare. 2022. https://pphasia.com/publications/papers-reports/whitepaper-responsible-data-sharing-in-health-and-healthcare/?fbclid=IwAR3T41L9xAvm3cWnRAmRj3jkOfjNCpogHciZohHgIfQJoROMV5jnfxgod2Y.
  20. Ngusie HS, Shiferaw AM, Bogale AD, Ahmed MH. Health data management practice and associated factors among health professionals working at public health facilities in resource limited settings. Adv Med Educ Pract. 2021;12:855-862. doi:2147/amep.s320769
  21. Nordo AH, Levaux HP, Becnel LB, et al. Use of EHRs data for clinical research: historical progress and current applications. Learn Health Syst. 2019;3(1):e10076. doi:1002/lrh2.10076
  22. Berger M, Daniel G, Frank K, et al. A Framework for Regulatory Use of Real-World Evidence. Duke-Margolis Health Policy Center; 2017. https://healthpolicy.duke.edu/publications/real-world-evidence-white-paper. Accessed December 20, 2019.
  23. Khozin S, Blumenthal GM, Pazdur R. Real-world Data for Clinical Evidence Generation in Oncology. J Natl Cancer Inst. 2017;109(11):djx187. doi:1093/jnci/djx187
  24. Wilkinson T, Sculpher MJ, Claxton K, et al. The international decision support initiative reference case for economic evaluation: an aid to thought. Value Health. 2016;19(8):921-928. doi:1016/j.jval.2016.04.015
  25. Oortwijn W, Sampietro-Colom L, Trowman R. How to deal with the inevitable: generating real-world data and using real-world evidence for HTA purposes - from theory to action. Int J Technol Assess Health Care. 2019;35(4):346-350. doi:1017/s0266462319000400
  26. Chan K, Nam S, Evans B, et al. Developing a framework to incorporate real-world evidence in cancer drug funding decisions: the Canadian Real-world Evidence for Value of Cancer Drugs (CanREValue) collaboration. BMJ Open. 2020;10(1):e032884. doi:1136/bmjopen-2019-032884
  27. Framework for FDA’s Real-World Evidence Program. 2018. https://www.fda.gov/media/120060/download. Accessed March 2, 2021.
  28. McClellan M. Regional approaches to the development and use of real world data and evidence. Paper presented at: CoRE Symposium 2019; Duke-NUS Medical School, Amphitheatre Level 2.
  29. Teerawattananon Y, Kc S, Chi YL, et al. Recalibrating the notion of modelling for policymaking during pandemics. Epidemics. 2022;38:100552. doi:1016/j.epidem.2022.100552
  30. Regulation of the Minister of Health Indonesia: HTA in the National Health Insurance Program. Chapter 3 (HTA process). 2017. http://hukor.kemkes.go.id/uploads/produk_hukum/PMK_No._51_Th_2017_ttg_Pedoman_Penilaian_Teknologi_Kesehatan_Dalam_Program_JKN_.pdf.
  31. Pearson SD, Dreitlein B, Towse A, Hampson G, Henshall C. Understanding the Context, Selecting the Standards: A Framework to Guide the Optimal Development and Use of Real-World Evidence for Coverage and Formulary Decisions. OHE, ICER; 2018.
  32. Qiu Y, Thokala P, Dixon S, Marchand R, Xiao Y. Topic selection process in health technology assessment agencies around the world: a systematic review. Int J Technol Assess Health Care. 2022;38(1):e19. doi:1017/s0266462321001690
  33. Minelli C, Baio G. Value of information: a tool to improve research prioritization and reduce waste. PLoS Med. 2015;12(9):e1001882. doi:1371/journal.pmed.1001882
  34. Garrison LP Jr, Neumann PJ, Erickson P, Marshall D, Mullins CD. Using real-world data for coverage and payment decisions: the ISPOR Real-World Data Task Force report. Value Health. 2007;10(5):326-335. doi:1111/j.1524-4733.2007.00186.x
  35. Jaksa A, Wu J, Jónsson P, Eichler HG, Vititoe S, Gatto NM. Organized structure of real-world evidence best practices: moving from fragmented recommendations to comprehensive guidance. J Comp Eff Res. 2021;10(9):711-731. doi:2217/cer-2020-0228
  36. Karen K. The use of real-world data (RWD) by health technology assessment (HTA) agencies. Eur J Public Health. 2021;31(Suppl 3):ckab164.574. doi:1093/eurpub/ckab164.574
  37. Xoxi E, Rumi F, Kanavos P, et al. A proposal for value-based managed entry agreements in an environment of technological change and economic challenge for publicly funded healthcare systems. Front Med Technol. 2022;4:888404. doi:3389/fmedt.2022.888404
  38. Kale MS, Korenstein D. Overdiagnosis in primary care: framing the problem and finding solutions. BMJ. 2018;362:k2820. doi:1136/bmj.k2820
  39. Bloudek L, Jaksa A, McKenna A, et al. Observational Real-World Evidence Update Prophylaxis of Hereditary Angioedema with Takhzyro and C1 Inhibitors: Effectiveness and Value. ICER; 2021. https://icer.org/wp-content/uploads/2020/10/ICER_Aetion_RWE_HAE_Report_082421.pdf.
  40. Jaksa A, Bloudek L, Carlson JJ, et al. Key learnings from Institute for Clinical and Economic Review's real-world evidence reassessment pilot. Int J Technol Assess Health Care. 2022;38(1):e32. doi:1017/s0266462322000162
  41. Sukmanee J, Butchon R, Sarajan MH, et al. Estimating the potential overdiagnosis and overtreatment of acute appendicitis in Thailand using a secondary data analysis of service utilization before, during and after the COVID-19 lockdown policy. PLoS One. 2022;17(11):e0270241. doi:1371/journal.pone.0270241
  42. Teerawattananon Y, Anothaisintawee T, Pheerapanyawaranun C, et al. A systematic review of methodological approaches for evaluating real-world effectiveness of COVID-19 vaccines: advising resource-constrained settings. PLoS One. 2022;17(1):e0261930. doi:1371/journal.pone.0261930
  43. Janke AT, Mei H, Rothenberg C, Becher RD, Lin Z, Venkatesh AK. Analysis of hospital resource availability and COVID-19 mortality across the United States. J Hosp Med. 2021;16(4):211-214. doi:12788/jhm.3539
  44. Asaria M, Griffin S, Cookson R. Distributional cost-effectiveness analysis: a tutorial. Med Decis Making. 2016;36(1):8-19. doi:1177/0272989x15583266
  45. Herrman H, Patel V, Kieling C, et al. Time for united action on depression: a Lancet-World Psychiatric Association Commission. Lancet. 2022;399(10328):957-1022. doi:1016/s0140-6736(21)02141-3
  46. Ma L, Luo N, Wan T, Hu C, Peng M. An improved healthcare accessibility measure considering the temporal dimension and population demand of different ages. Int J Environ Res Public Health. 2018;15(11):2421. doi:3390/ijerph15112421
  47. Ahmed S, Hasan MZ, MacLennan M, et al. Measuring the efficiency of health systems in Asia: a data envelopment analysis. BMJ Open. 2019;9(3):e022155. doi:1136/bmjopen-2018-022155
  48. Sagiroglu S, Sinanc D. Big data: a review. In: 2013 International Conference on Collaboration Technologies and Systems (CTS). IEEE; 2013.
  49. Jin X, Wah BW, Cheng X, Wang Y. Significance and challenges of big data research. Big Data Res. 2015;2(2):59-64. doi:1016/j.bdr.2015.01.006
  50. Morton SC, Costlow MR, Graff JS, Dubois RW. Standards and guidelines for observational studies: quality is in the eye of the beholder. J Clin Epidemiol. 2016;71:3-10. doi:1016/j.jclinepi.2015.10.014
International Journal of Health Policy and Management

Articles in Press, Corrected Proof
Available Online from 29 January 2023

Files

History

  • Receive Date: 13 October 2021
  • Revise Date: 24 December 2022
  • Accept Date: 28 January 2023
  • First Publish Date: 29 January 2023

Share

How to cite

Statistics