Quality and Utility of European Cardiovascular and Orthopaedic Registries for the Regulatory Evaluation of Medical Device Safety and Performance Across the Implant Lifecycle: A Systematic Review

Document Type : Review Article

Authors

1 Department of Orthopaedics, Leiden University Medical Center, Leiden, The Netherlands

2 Department of Biomedical Data Sciences & Medical Decision Making, Leiden University Medical Center, Leiden, The Netherlands

3 Division of Orthopaedic Surgery and Traumatology, Geneva University Hospitals and University of Geneva, Geneva, Switzerland

4 Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK

5 Department of Cardiology, Uppsala University, Uppsala, Sweden

6 Directorate of Research Policy (Formerly: Walaeus Library), Leiden University Medical Center, Leiden, The Netherlands

7 Scientific Secretariat of the Presidency, Istituto Superiore di Sanità, Rome, Italy

8 Health Technology Unit B6, Directorate General for Health (DG SANTE), European Commission, Brussels, Belgium

9 Department of Clinical Epidemiology, Aarhus University Hospital, Aarhus, Denmark

10 Department of Clinical Medicine, Aarhus University, Aarhus, Denmark

11 Leeds Institute of Cardiovascular and Metabolic Medicine, University of Leeds, Leeds, UK

12 Leeds Institute for Data analytics, University of Leeds, Leeds, UK

13 Department of Cardiology, Leeds Teaching Hospitals NHS Trust, Leeds, UK

14 Botnar Research Centre and Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK

15 National Institute for Health Research Oxford Biomedical Research Centre, John Radcliffe Hospital, Oxford, UK

16 Centro Studi ANMCO, Via Alfonso la Marmora, Florence, Italy

17 Department of Medical Science, Uppsala University, Uppsala, Sweden

18 Clinical Research Center, Uppsala University, Uppsala, Sweden

19 Department of Cardiology, University Hospital of Wales, Cardiff, UK

Abstract

Background 
The European Union Medical Device Regulation (MDR) requires manufacturers to undertake post-market clinical follow-up (PMCF) to assess the safety and performance of their devices following approval and Conformité Européenne (CE) marking. The quality and reliability of device registries for this Regulation have not been reported. As part of the Coordinating Research and Evidence for Medical Devices (CORE-MD) project, we identified and reviewed European cardiovascular and orthopaedic registries to assess their structures, methods, and suitability as data sources for regulatory purposes.

Methods 
Regional, national and multi-country European cardiovascular (coronary stents and valve repair/replacement) and orthopaedic (hip/knee prostheses) registries were identified using a systematic literature search. Annual reports, peer-reviewed publications, and websites were reviewed to extract publicly available information for 33 items related to structure and methodology in six domains and also for reported outcomes.

Results 
Of the 20 cardiovascular and 26 orthopaedic registries fulfilling eligibility criteria, a median of 33% (IQR: 14%-71%) items for cardiovascular and 60% (IQR: 28%-100%) items for orthopaedic registries were reported, with large variation across domains. For instance, no cardiovascular and 16 (62%) orthopaedic registries reported patient/procedure-level completeness. No cardiovascular and 5 (19%) orthopaedic registries reported outlier performances of devices, but each with a different outlier definition. There was large heterogeneity in reporting on items, outcomes, definitions of outcomes, and follow-up durations.

Conclusion 
European cardiovascular and orthopaedic device registries could improve their potential as data sources for regulatory purposes by reaching consensus on standardised reporting of structural and methodological characteristics to judge the quality of the evidence as well as outcomes.

Keywords


  1. International Medical Device Regulators Forum (IMDRF). Principles of International System of Registries Linked to Other Data Sources and Tools. September 30, 2016. https://www.imdrf.org/sites/default/files/docs/imdrf/final/technical/imdrf-tech-160930-principles-system-registries.pdf.
  2. AHRQ Methods for Effective Health Care. In: Gliklich RE, Leavy MB, Dreyer NA, eds. Registries for Evaluating Patient Outcomes: A User’s Guide. Rockville, MD: Agency for Healthcare Research and Quality; 2020.
  3. International Medical Device Regulators Forum (IMDRF). Tools for Assessing the Usability of Registries in Support of Regulatory Decision-Making. March 27, 2018. https://www.imdrf.org/sites/default/files/docs/imdrf/final/technical/imdrf-tech-180327-usability-tools-n46.pdf.
  4. Lübbeke A, Carr AJ, Hoffmeyer P. Registry stakeholders. EFORT Open Rev. 2019;4(6):330-336. doi:1302/2058-5241.4.180077
  5. Medical Device Coordination Group, European Commission. Regulation (EU) 2017/745: Clinical Evidence Needed for Medical Devices Previously CE Marked Under Directives 93/42/EEC or 90/385/EEC. A Guide for Manufacturers and Notified Bodies. 2020. https://ec.europa.eu/health/system/files/2020-09/md_mdcg_2020_6_guidance_sufficient_clinical_evidence_en_0.pdf.
  6. Klonoff DC, Gutierrez A, Fleming A, Kerr D. Real-world evidence should be used in regulatory decisions about new pharmaceutical and medical device products for diabetes. J Diabetes Sci Technol. 2019;13(6):995-1000. doi:1177/1932296819839996
  7. Tarricone R, Boscolo PR, Armeni P. What type of clinical evidence is needed to assess medical devices? Eur Respir Rev. 2016;25(141):259-265. doi:1183/16000617.0016-2016
  8. de Steiger RN, Miller LN, Davidson DC, Ryan P, Graves SE. Joint registry approach for identification of outlier prostheses. Acta Orthop. 2013;84(4):348-352. doi:3109/17453674.2013.831320
  9. Campbell B, Wilkinson J, Marlow M, Sheldon M. Generating evidence for new high-risk medical devices. BMJ Surg Interv Health Technol. 2019;1(1):e000022. doi:1136/bmjsit-2019-000022
  10. Melvin T, Torre M. New medical device regulations: the regulator's view. EFORT Open Rev. 2019;4(6):351-356. doi:1302/2058-5241.4.180061
  11. Pijls BG, Meessen J, Tucker K, et al. MoM total hip replacements in Europe: a NORE report. EFORT Open Rev. 2019;4(6):423-429. doi:1302/2058-5241.4.180078
  12. de Steiger RN, Hang JR, Miller LN, Graves SE, Davidson DC. Five-year results of the ASR XL acetabular system and the ASR hip resurfacing system: an analysis from the Australian Orthopaedic Association National Joint Replacement Registry. J Bone Joint Surg Am. 2011;93(24):2287-2293. doi:2106/jbjs.j.01727
  13. Australian Orthopaedic Association National Joint Replacement Registry (AOANJRR). Annual Report 2007. https://aoanjrr.sahmri.com/documents/10180/42612/Annual+Report+2007.
  14. DePuy Synthes. DePuy Synthes ASR™ Hip Recall Contact Information. https://www.jnjmedicaldevices.com/en-US/depuy-synthes/support-resources/asr-recall. Accessed March 18, 2022.
  15. Lagerqvist B, Carlsson J, Fröbert O, et al. Stent thrombosis in Sweden: a report from the Swedish Coronary Angiography and Angioplasty Registry. Circ Cardiovasc Interv. 2009;2(5):401-408. doi:1161/circinterventions.108.844985
  16. Capodanno D, Gori T, Nef H, et al. Percutaneous coronary intervention with everolimus-eluting bioresorbable vascular scaffolds in routine clinical practice: early and midterm outcomes from the European multicentre GHOST-EU registry. EuroIntervention. 2015;10(10):1144-1153. doi:4244/eijy14m07_11
  17. Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi:1136/bmj.n71
  18. Niederländer C, Wahlster P, Kriza C, Kolominsky-Rabas P. Registries of implantable medical devices in Europe. Health Policy. 2013;113(1-2):20-37. doi:1016/j.healthpol.2013.08.008
  19. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210. doi:1186/s13643-016-0384-4
  20. Niederländer CS, Kriza C, Kolominsky-Rabas P. Quality criteria for medical device registries: best practice approaches for improving patient safety–a systematic review of international experiences. Expert Rev Med Devices. 2017;14(1):49-64. doi:1080/17434440.2017.1268911
  21. British Cardiovascular Intervention Society. https://www.bcis.org.uk/.
  22. East Denmark Heart Registry.
  23. German Society for Thoracic and Cardiovascular Surgery. https://www.dgthg.de/.
  24. Polish National Database of Cardiac Surgery Procedures. https://krok.csioz.gov.pl/krok/.
  25. Portuguese National Registry of Intervention Cardiology. https://www.apic.pt/.
  26. Spanish Cardiac Catheterization and Coronary Intervention Registry.
  27. Western Denmark Heart Registry.
  28. Polish National Percutaneous Coronary Intervention Registry. https://www.orpki.cm-uj.krakow.pl/.
  29. Swedish Coronary Angiography and Angioplasty Registry. https://www.ucr.uu.se/swedeheart/start-scaar/.
  30. Quality Assurance Registry on Aortic Valve Replacement.
  31. Austrian-TAVI Registry. https://www.tavi.at/.
  32. Belgian TAVI Registry.
  33. Czech TAVI Registry.
  34. FinnValve Registry.
  35. FRANCE-TAVI Registry.
  36. German Aortic Valve Registry. https://www.aortenklappenregister.de/.
  37. Polish Registry of Transcatheter Aortic Valve Implantation.
  38. Spanish Registry of Heart Valves Repair.
  39. Swedish Transcatheter Cardiac Intervention Registry. https://www.ucr.uu.se/swedeheart/start-swentry/.
  40. Swiss TAVI Registry. https://www.swisstavi.ch/.
  41. Croatian Register of endoprothesis.
  42. German Arthroplasty Register. https://www.eprd.de/de/.
  43. Finnish Arthroplasty Register. https://www.thl.fi/far/.
  44. Irish National Orthopaedic Register. https://www.noca.ie/audits/irish-national-orthopaedic-register/.
  45. Lithuanian Arthroplasty Register. https://lsed.lt/.
  46. Dutch Arthroplasty Register. https://www.lroi.nl/.
  47. Hungarian Arthroplasty Register. https://www.ortopedtarsasag.hu/.
  48. Norwegian Arthroplasty Register. https://nrlweb.ihelse.net/.
  49. Nordic Arthroplasty Register Association.
  50. National Joint Registry for England W, Northern Ireland, the Isle of Man, and the States of Guernsey. https://www.njrcentre.org.uk/.
  51. Belgian National Arthroplasty Register. https://www.ehealth.fgov.be/nl/egezondheid/beroepsbeoefenaars-in-de-gezondheidszorg/qermidorthopride/.
  52. Catalan Arthroplasty Register.
  53. National Arthroplasty Registry of Slovenia. https://www.ob-valdoltra.si/.
  54. Italian Arthroplasty Registry. https://riap.iss.it/riap/it/.
  55. Emilia-Romagna Region Arthroplasty Register. https://www.ior.it/en/curarsi-al-rizzoli/register-orthopaedic-prosthetic-implants/.
  56. Romanian National Arthroplasty Register. https://www.rne.ro/.
  57. Portuguese National Arthroplasty Register. https://www.rpa.spot.pt/.
  58. Scottish Arthroplasty Project Joint Registry. https://www.arthro.scot.nhs.uk/.
  59. Slovakian National Arthroplasty Register. https://sar.mfn.sk/.
  60. Swiss Arthroplasty Register. https://www.siris-implant.ch/.
  61. Czech Republic Arthroplasty Register. https://www.ksrzis.cz/.
  62. Danish Hip Arthroplasty Register. https://www.dhr.dk/.
  63. Swedish Hip Arthroplasty Register. https://shpr.registercentrum.se/.
  64. Danish Knee Arthroplasty Register. https://www.danishhealthdata.com/find-health-data/Dansk-Knaealloplastik-Register/.
  65. Swedish Knee Arthroplasty Register. https://www.myknee.se/.
  66. French Arthroplasty Register. https://www.sofcot.fr/.
  67. Medical Device Coordination Group, European Commission. Post-Market Clinical Follow-Up (PMCF) Plan Template. A Guide for Manufacturers and Notified Bodies. 2020. https://ec.europa.eu/health/system/files/2020-09/md_mdcg_2020_7_guidance_pmcf_plan_template_en_0.pdf.
  68. Medical Device Coordination Group, European Commission. MDR – Article 83 – Post-Market Surveillance System of the Manufacturer. https://www.medical-device-regulation.eu/tag/mdr-article-83-post-market-surveillance-system-of-the-manufacturer/. Accessed March 28, 2022.
  69. Medical Device Coordination Group, European Commission. MDR – Article 108 – Device Registers and Databanks. https://www.medical-device-regulation.eu/tag/mdr-article-108/. Accessed March 28, 2022.
  70. Orthopedic Data Evaluation Panel (ODEP). Introducing ODEP. https://www.odep.org.uk/ODEPExplained/IntroductiontoODEP.aspx. Accessed March 21, 2022.
  71. Orthopedic Data Evaluation Panel (ODEP). Data Sources and Reliability. https://www.odep.org.uk/methodology/data-sources-and-reliability/. Accessed June 30, 2022.
  72. Wyatt M, Frampton C, Whitehouse M, Deere K, Sayers A, Kieser D. Benchmarking total hip replacement constructs using noninferiority analysis: the New Zealand joint registry study. BMC Musculoskelet Disord. 2021;22(1):719. doi:1186/s12891-021-04602-0
  73. Deere KC, Whitehouse MR, Porter M, Blom AW, Sayers A. Assessing the non-inferiority of prosthesis constructs used in hip replacement using data from the National Joint Registry of England, Wales, Northern Ireland and the Isle of Man: a benchmarking study. BMJ Open. 2019;9(4):e026685. doi:1136/bmjopen-2018-026685
  74. Keurentjes JC, Pijls BG, Van Tol FR, et al. Which implant should we use for primary total hip replacement? A systematic review and meta-analysis. J Bone Joint Surg Am. 2014;96 Suppl 1:79-97. doi:2106/jbjs.n.00397
  75. Deere KC, Whitehouse MR, Porter M, Blom AW, Sayers A. Assessing the non-inferiority of prosthesis constructs used in total and unicondylar knee replacements using data from the National Joint Registry of England, Wales, Northern Ireland and the Isle of Man: a benchmarking study. BMJ Open. 2019;9(4):e026736. doi:1136/bmjopen-2018-026736
  76. Dawson LP, Biswas S, Lefkovits J, et al. Characteristics and quality of national cardiac registries: a systematic review. Circ Cardiovasc Qual Outcomes. 2021;14(9):e007963. doi:1161/circoutcomes.121.007963
  77. Liebs TR, Splietker F, Hassenpflug J. Is a revision a revision? An analysis of national arthroplasty registries' definitions of revision. Clin Orthop Relat Res. 2015;473(11):3421-3430. doi:1007/s11999-015-4255-4
  78. van Schie P, Hasan S, van Bodegom-Vos L, Schoones JW, Nelissen R, Marang-van de Mheen PJ. International comparison of variation in performance between hospitals for THA and TKA: is it even possible? A systematic review including 33 studies and 8 arthroplasty register reports. EFORT Open Rev. 2022;7(4):247-263. doi:1530/eor-21-0084
  79. Lübbeke A, Silman AJ, Barea C, Prieto-Alhambra D, Carr AJ. Mapping existing hip and knee replacement registries in Europe. Health Policy. 2018;122(5):548-557. doi:1016/j.healthpol.2018.03.010
  80. Denissen GAW, van Steenbergen LN, Lollinga WT, Verdonschot NJJ, Schreurs BW, Nelissen R. Generic implant classification enables comparison across implant designs: the Dutch Arthroplasty Register implant library. EFORT Open Rev. 2019;4(6):344-350. doi:1302/2058-5241.4.180063
  81. Batra G, Aktaa S, Wallentin L, et al. Methodology for the development of international clinical data standards for common cardiovascular conditions: European Unified Registries for Heart Care Evaluation and Randomised Trials (EuroHeart). Eur Heart J Qual Care Clin Outcomes. 2023;9(2):161-168. doi:1093/ehjqcco/qcab052
  82. Zannad F, Garcia AA, Anker SD, et al. Clinical outcome endpoints in heart failure trials: a European Society of Cardiology Heart Failure Association consensus document. Eur J Heart Fail. 2013;15(10):1082-1094. doi:1093/eurjhf/hft095
  83. Batra G, Aktaa S, Wallentin L, et al. Data standards for acute coronary syndrome and percutaneous coronary intervention: the European Unified Registries for Heart Care Evaluation and Randomised Trials (EuroHeart). Eur Heart J. 2022;43(24):2269-2285. doi:1093/eurheartj/ehac133
  84. Havelin LI, Fenstad AM, Salomonsson R, et al. The Nordic Arthroplasty Register Association: a unique collaboration between 3 national hip arthroplasty registries with 280,201 THRs. Acta Orthop. 2009;80(4):393-401. doi:3109/17453670903039544
  85. International Society of Arthroplasty Registries (ISAR). International Prosthesis Benchmarking Working Group Guidance Document: Hip and Knee Arthroplasty Devices. 2018. https://www.isarhome.org/publications.
  86. Govatsmark RES, Janszky I, Slørdahl SA, et al. Completeness and correctness of acute myocardial infarction diagnoses in a medical quality register and an administrative health register. Scand J Public Health. 2020;48(1):5-13. doi:1177/1403494818803256
  87. Fraser AG, Nelissen R, Kjærsgaard-Andersen P, Szymański P, Melvin T, Piscoi P. Improved clinical investigation and evaluation of high-risk medical devices: the rationale and objectives of CORE-MD (Coordinating Research and Evidence for Medical Devices). EFORT Open Rev. 2021;6(10):839-849. doi:1302/2058-5241.6.210081
  • Receive Date: 24 August 2022
  • Revise Date: 20 March 2023
  • Accept Date: 27 June 2023
  • First Publish Date: 01 July 2023