An Implementation Research Approach to Evaluating Health Insurance Programs: Insights from India

Document Type: Short Communication


1 Department of International Health, Johns Hopkins University, Baltimore, MD, USA

2 Aarogyasri Health Care Trust, Hyderabad, India

3 Public Health Foundation of India, New Delhi, India

4 The Graduate Institute of International and Development Studies, Geneva, Switzerland

5 International Development Research Centre, Ottawa, ON, Canada


One of the distinguishing features of implementation research is the importance given to involve implementers in all aspects of research, and as users of research. We report on a recent implementation research effort in India, in which researchers worked together with program implementers from one of the longest serving government funded insurance schemes in India, the Rajiv Aarogyasri Scheme (RAS) in the state of undivided Andhra Pradesh, that covers around 70 million people. This paper aims to both inform on the process of the collaborative research, as well as, how the nature of questions that emerged out of the collaborative exercise differed in scope from those typically asked of insurance program evaluations. Starting in 2012, and over the course of a year, staff from the Aarogyasri Health Care Trust (AHCT), and researchers held a series of meetings to identify research questions that could serve as a guide for an evaluation of the RAS. The research questions were derived from the application of a Logical Framework Approach (“log frame”) to the RAS. The types of questions that emerged from this collaborative effort were compared with those seen in the published literature on evaluations of insurance programs in low- and middle-income countries (LMICs). In the published literature, 60% of the questions pertained to output/outcome of the program and the remaining 40%, relate to processes and inputs. In contrast, questions generated from the RAS participatory research process between implementers and researchers had a remarkably different distribution – 81% of questions looked at program input/processes, and 19% on outputs and outcomes. An implementation research approach can lead to a substantively different emphasis of research questions. While there are several challenges in collaborative research between implementers and researchers, an implementation research approach can lead to incorporating tacit knowledge of program implementers into the research process, research questions that are more relevant to the research needs of policy-makers, and greater knowledge translation of the research findings.


Main Subjects

  1. Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ. 2013;347:f6753. doi:10.1136/bmj.f6753
  2. Remme JH, Adam T, Becerra-Posada F, et al. Defining research to improve health systems. PLoS Med. 2010;7(11):e1001000. doi:10.1371/journal.pmed.1001000
  3. Cornwall A, Jewkes R. What is participatory research? Soc Sci Med. 1995;41(12):1667-1676.
  4. LaForgia G, Nagpal S. Government Sponsored Health Insurance in India: Are You Covered? Washington DC: The World Bank; 2012.
  5. Aarogyasri Health Care Trust (AHCT). Annual Report: 2011-12. Government of Andhra Pradesh, Hyderabad; 2012.
  6. Gasper, D. Evaluating the ‘logical framework approach’ towards learning-oriented development evaluation. Public Adm Dev. 2000;20(1):17-28.
  7. Acharya A, Vellakkal S, Kalita S, et al. The impact of health insurance schemes for the informal sector in low- and middle-income countries: a systematic review. The World Bank Research Observer. 2012;28(2). Accessed on August 21, 2013.
  8. Lagomarsino G, Garabrant A, Adyas A, Muga R, Otoo N. Moving towards universal health coverage: health insurance reforms in nine developing countries in Africa and Asia. Lancet. 2012;380(9845):933-943. doi:10.1016/S0140-6736(12)61147-7
  9. Spaan E, Mathijssen J, Tromp N, McBain F, ten Have A, Baltussen R. The impact of health insurance in Africa and Asia: a systematic review. Bull World Health Organ. 2012;90(9):633-712.
  10. Faden L, Vialle-Valentin C, Ross-Degnan D, Wagner A. Active pharmaceutical management strategies of health insurance systems to improve cost-effective use of medicines in low- and middle-income countries: a systematic review of current evidence. Health Policy. 2011;100(2-3):134-143. doi:10.1016/j.healthpol.2010