The Impact of Drug Trials With Financial Conflict of Interests on the Meta-analyses: A Meta-epidemiological Study

Document Type : Review Article

Authors

1 Evidence Based Social Science Research Center, School of Public Health, Lanzhou University, Lanzhou, China

2 Health Technology Assessment Center of Lanzhou University, School of Public Health, Lanzhou University, Lanzhou, China

3 Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, China

4 Key Laboratory of Evidence Based Medicine and Knowledge Translation of Gansu Province, Lanzhou, China

5 Department of Epidemiology and Health Statistics, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, China

Abstract

Background 
To assess the impact of trials with potential financial conflict of interests (FCOIs) on evidence synthesis in meta-analyses (MAs).

Methods 
A total of 96 MAs from the Cochrane Library about drug trials were investigated. The primary outcomes examined the proportion of conclusions that would change with the exclusion of trials with potential FCOIs. If the proportion of changed conclusions was below the non-inferiority margin of 10%, we considered that it was not inferior to include the trials with potential FCOIs in the MAs.

Results 
Only 54.17% of MAs reported the funding sources of each included trial, and in 21.88% of MAs, the authorindustry- related financial ties of each included trial were reported. When trials with FCOIs were excluded, the changed conclusions of effectiveness and major adverse events were 13.16% and 11.11%, respectively, and the I2 decreased by 13.56% and 10.09%, respectively. For serious adverse events, the exclusion of FCOIs trials did not lead to any change in conclusions; however, the I2 decreased by 24.24%. The impact of trials without reported FCOIs was also examined on evidence synthesis, and the results showed that the changed conclusions of effectiveness and major adverse events were 5.26% and 6.25%, respectively, indicating non-inferiority. However, the I2 increased by 13.60% and 12.37%, respectively.

Conclusion 
In this meta-epidemiological study, we demonstrated that trials with FCOIs may not only influence the final outcome of MAs but may also increase the heterogeneity of results. It is suggested that all MAs fully report the FCOIs involved in evidence-based research and explore the impact of its FCOIs to better provide a more valuable reference for patients, clinicians, and policy-makers.

Keywords

References

  1. Resnik DB. Conflict of interest in medical research, education, and practice. Environ Health Perspect. 2010;118(2):a92. doi:1289/ehp.118-a92
  2. Moses H, 3rd, Matheson DH, Cairns-Smith S, George BP, Palisch C, Dorsey ER. The anatomy of medical research: US and international comparisons. JAMA. 2015;313(2):174-189. doi:1001/jama.2014.15939
  3. Ahn R, Woodbridge A, Abraham A, et al. Financial ties of principal investigators and randomized controlled trial outcomes: cross sectional study. BMJ. 2017;356:i6770. doi:1136/bmj.i6770
  4. Hakoum MB, Jouni N, Abou-Jaoude EA, et al. Authors of clinical trials reported individual and financial conflicts of interest more frequently than institutional and nonfinancial ones: a methodological survey. J Clin Epidemiol. 2017;87:78-86. doi:1016/j.jclinepi.2017.04.002
  5. Hakoum MB, Jouni N, Abou-Jaoude EA, et al. Characteristics of funding of clinical trials: cross-sectional survey and proposed guidance. BMJ Open. 2017;7(10):e015997. doi:1136/bmjopen-2017-015997
  6. Baird P. Getting it right: industry sponsorship and medical research. CMAJ. 2003;168(10):1267-1269.
  7. Lexchin J, Bero LA, Djulbegovic B, Clark O. Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ. 2003;326(7400):1167-1170. doi:1136/bmj.326.7400.1167
  8. Rochon PA, Gurwitz JH, Simms RW, et al. A study of manufacturer-supported trials of nonsteroidal anti-inflammatory drugs in the treatment of arthritis. Arch Intern Med. 1994;154(2):157-163.
  9. Als-Nielsen B, Chen W, Gluud C, Kjaergard LL. Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events? JAMA. 2003;290(7):921-928. doi:1001/jama.290.7.921
  10. Nejstgaard CH, Bero L, Hróbjartsson A, et al. Association between conflicts of interest and favourable recommendations in clinical guidelines, advisory committee reports, opinion pieces, and narrative reviews: systematic review. BMJ. 2020;371:m4234. doi:1136/bmj.m4234
  11. Young D. Policymakers, experts review evidence-based medicine. Am J Health Syst Pharm. 2005;62(4):342-343. doi:1093/ajhp/62.4.0342
  12. Yan P, Yao L, Li H, et al. The methodological quality of robotic surgical meta-analyses needed to be improved: a cross-sectional study. J Clin Epidemiol. 2019;109:20-29. doi:1016/j.jclinepi.2018.12.013
  13. Hakoum MB, Anouti S, Al-Gibbawi M, et al. Reporting of financial and non-financial conflicts of interest by authors of systematic reviews: a methodological survey. BMJ Open. 2016;6(8):e011997. doi:1136/bmjopen-2016-011997
  14. Jørgensen AW, Hilden J, Gøtzsche PC. Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review. BMJ. 2006;333(7572):782. doi:1136/bmj.38973.444699.0B
  15. Tian J, Zhang J, Ge L, Yang K, Song F. The methodological and reporting quality of systematic reviews from China and the USA are similar. J Clin Epidemiol. 2017;85:50-58. doi:1016/j.jclinepi.2016.12.004
  16. Wang X, Chen Y, Yao L, et al. Reporting of declarations and conflicts of interest in WHO guidelines can be further improved. J Clin Epidemiol. 2018;98:1-8. doi:1016/j.jclinepi.2017.12.021
  17. Roseman M, Turner EH, Lexchin J, Coyne JC, Bero LA, Thombs BD. Reporting of conflicts of interest from drug trials in Cochrane reviews: cross sectional study. BMJ. 2012;345:e5155. doi:1136/bmj.e5155
  18. Ting J. Updated 2010 Consolidated Standards of Reporting Trials guidelines and selective reporting of clinical trial outcomes: in response to Babl and Davidson. Emerg Med Australas. 2011;23(1):108. doi:1111/j.1742-6723.2010.01383.x
  19. Knobloch K, Yoon U, Vogt PM. Preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement and publication bias. J Craniomaxillofac Surg. 2011;39(2):91-92. doi:1016/j.jcms.2010.11.001
  20. Yao L, Sun R, Chen YL, et al. The quality of evidence in Chinese meta-analyses needs to be improved. J Clin Epidemiol. 2016;74:73-79. doi:1016/j.jclinepi.2016.01.003
  21. Bero L. More journals should have conflict of interest policies as strict as Cochrane. BMJ Opinion. 12 November 2018. https://blogs.bmj.com/bmj/2018/11/12/lisa-bero-more-journals-should-have-conflict-of-interest-policies-as-strict-as-cochrane/. Accessed October 1, 2021.
  22. Xiu-xia L, Ya Z, Yao-long C, Ke-hu Y, Zong-jiu Z. The reporting characteristics and methodological quality of Cochrane reviews about health policy research. Health Policy. 2015;119(4):503-510. doi:1016/j.healthpol.2014.09.002
  23. Wen J, Ren Y, Wang L, et al. The reporting quality of meta-analyses improves: a random sampling study. J Clin Epidemiol. 2008;61(8):770-775. doi:1016/j.jclinepi.2007.10.008
  24. Sterne JA. Why the Cochrane risk of bias tool should not include funding source as a standard item. Cochrane Database Syst Rev. 2013(12):ED000076. doi:1002/14651858.ed000076
  25. Collaboration TC. Standards for the reporting of new Cochrane Intervention Reviews Version 1.1. https://wounds.Cochrane.org/sites/wounds.cochrane.org/files/public/uploads/MECIR%2. Accessed October 1, 2021.
  26. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006-1012. doi:1016/j.jclinepi.2009.06.005
  27. Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. doi:1136/bmj.n71
  28. Drazen JM, Van Der Weyden MB, Sahni P, et al. Uniform format for disclosure of competing interests in ICMJE journals. J Am Dent Assoc. 2010;141(2):131-132. doi:14219/jada.archive.2010.0119
  29. Benea C, Turner KA, Roseman M, et al. Reporting of financial conflicts of interest in meta-analyses of drug trials published in high-impact medical journals: comparison of results from 2017 to 2018 and 2009. Syst Rev. 2020;9(1):77. doi:1186/s13643-020-01318-5
  30. Drazen JM, De Leeuw PW, Laine C, et al. Toward more uniform conflict disclosures: the updated ICMJE conflict of interest reporting form. Natl Med J India. 2010;23(4):196-197.
  31. Higgins JP, Thomas J, Chandler J eae. Cochrane Handbook for Systematic Reviews of Interventions version 6.1 (updated September 2021). The Cochrane Collaboration, 2021. https://training.cochrane.org/handbook. Accessed October 1, 2021.
  32. Mauri L, D'Agostino RB Sr. Challenges in the design and interpretation of noninferiority trials. N Engl J Med. 2017;377(14):1357-1367. doi:1056/NEJMra1510063
  33. Wagner G, Nussbaumer-Streit B, Greimel J, Ciapponi A, Gartlehner G. Trading certainty for speed - how much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: an international survey. BMC Med Res Methodol. 2017;17(1):121. doi:1186/s12874-017-0406-5
  34. Awad Z, Huins C, Pothier DD. Antivirals for idiopathic sudden sensorineural hearing loss. Cochrane Database Syst Rev. 2012(8):CD006987. doi:1002/14651858.CD006987.pub2
  35. Schoot RA, van Dalen EC, van Ommen CH, van de Wetering MD. Antibiotic and other lock treatments for tunnelled central venous catheter-related infections in children with cancer. Cochrane Database Syst Rev. 2013(6):CD008975. doi:1002/14651858.CD008975.pub2
  36. Murphy A, O'Sullivan R, Wakai A, et al. Intranasal fentanyl for the management of acute pain in children. Cochrane Database Syst Rev. 2014;2014(10):CD009942. doi:1002/14651858.CD009942.pub2
  37. Maruani A, Samimi M, Stembridge N, et al. Non-antistreptococcal interventions for acute guttate psoriasis or an acute guttate flare of chronic psoriasis. Cochrane Database Syst Rev. 2019;4(4):CD011541. doi:1002/14651858.CD011541.pub2
  38. Chauhan BF, Ducharme FM. Anti-leukotriene agents compared to inhaled corticosteroids in the management of recurrent and/or chronic asthma in adults and children. Cochrane Database Syst Rev. 2012;2012(5):CD002314. doi:1002/14651858.CD002314.pub3
  39. Turner K, Carboni-Jiménez A, Benea C, et al. Reporting of drug trial funding sources and author financial conflicts of interest in Cochrane and non-Cochrane meta-analyses: a cross-sectional study. BMJ Open. 2020;10(5):e035633. doi:1136/bmjopen-2019-035633
  40. Tau N, Shochat T, Gafter-Gvili A, Amir E, Shepshelovich D. Undisclosed financial conflicts of interest of authors of clinical drug trials published in influential medical journals: a cohort study. Mayo Clin Proc. 2019;94(11):2272-2276. doi:1016/j.mayocp.2019.08.025
  41. Viswanathan M, Carey TS, Belinson SE, et al. A proposed approach may help systematic reviews retain needed expertise while minimizing bias from nonfinancial conflicts of interest. J Clin Epidemiol. 2014;67(11):1229-1238. doi:1016/j.jclinepi.2014.02.023
International Journal of Health Policy and Management
Volume 11, Issue 10
October 2022
Pages 2038-2045

Files

History

  • Receive Date: 23 April 2021
  • Revise Date: 26 October 2021
  • Accept Date: 17 November 2021
  • First Publish Date: 20 November 2021

Share

How to cite

Statistics