The lack of public health research output from India

Background

Systematic assessment of recent health research output from India, and its relation with the estimated disease burden, is not available. This information would help understand the areas in health research that need improvement in India to enhance the health of India's population.

Methods

The health research output from India during 2002, which was accessible in the public domain, was assessed by searching PubMed and other internet health literature databases, and was related to the disease burden suggested by the Global Burden of Disease Study. The main outcome measures were number of health papers with abstracts in basic, clinical and public health sciences; quality-adjusted research output based on the impact factors of journals in which the papers were published; classification of papers in disease/condition categories and comparison of research output with the estimated disease burden in each category. Comparison of the health papers from India during 2002 included in PubMed was done with those from Australia during one quarter of 2002.

Results

Of the 4876 health papers from India in 2002 in PubMed, 48.4%, 47.1% and 4.4% were in basic, clinical and public health sciences, respectively. Of the 4495 papers based on original research, only 3.3% were in public health. Quality-adjusted original research output was highest for non-communicable diseases (62% of total). Of the total quality-adjusted original research output, the proportions in injuries (0.7%), cardiovascular diseases (3.6%), respiratory infections (0.2%), diarrhoeal diseases (1.9%), perinatal conditions (0.4%), childhood cluster diseases (0.5%), unipolar major depression (0%), and HIV/AIDS (1.5%) were substantially lower than their proportional contribution to the disease burden in India. Human resources, health policy, health economics, and impact assessment of interventions were particularly poorly represented in public health research. The Australia-India ratio for quality-adjusted health research output per unit gross domestic product was 20 and for public health research output was 31.

Conclusions

Good-quality public health research output from India is grossly inadequate, and strategic planning to improve it is necessary if substantial enhancement of population health were to be made possible. There is inordinately low relative research output in several diseases/conditions that cause major disease burden in India.

India suffers a large proportion of the disease burden of the world, which has been estimated to be more than its 16.8% share of the world's population [1, 2]. One of the vital elements in improving this situation is the need for a comprehensive and relevant evidence base that would equip India to take informed actions. A systematic assessment of recent health research output from India is not available. Without objective information about the current deficiencies and strengths in the health research output from India, it is difficult to plan substantial improvements in health research output that could enhance India's health status. We analysed the health research output from India in 2002 and related it with the estimated disease burden to identify areas that require particular attention to facilitate effective action to reduce disease burden in this world's second most populous country.

Health research output was defined as tangible research information related to human health that was readily accessible in the public domain. PubMed [3, 4] (which includes MEDLINE) of the US National Library of Medicine, the most widely used online health literature search database in the world, and websites of major academic institutions in India, international agencies, and publishing houses, were searched to ascertain the health research output from India in the year 2002.

PubMed was searched for papers published from India in 2002 using "India" in the author affiliation option in PubMed for all journals, and also by searching the Indian journals in PubMed as several papers in these journals mention only city and state but not India in the author affiliation. Only papers with abstracts were included, as the aim was to review all abstracts and classify the papers in various categories, including type of research, type of paper, disease/condition covered, allopathic or traditional system of medicine, and type and location of first author's institution. PubMed gives institutional affiliation and its location only for the first author. Papers that showed the first author affiliation with an Indian institution were considered as research output from India.

Definitions were used to classify the Indian papers located in PubMed. Health research was defined as research that could be related to health. Basic research was considered either pure or applied, pure being experimental or theoretical work to advance health knowledge without a defined specific application and applied having such an application. Clinical research was categorised as patient series/management if the paper was about clinical cases or issues in management of patients, laboratory if it dealt mainly with laboratory analysis of patient specimens, clinical trial if it was a trial in the clinical setting, and clinical epidemiology if it was about distribution and determinants of disease assessed in the clinical setting. Public health research was categorised into epidemiology, environment/ social, and health systems/policy. Epidemiology included population epidemiology that dealt with study of distribution and determinants of disease and health in the population, and biostatistics/methods that dealt with methodological issues in epidemiology. Environment/social included environmental sciences that dealt with environmental influences on health, and social aspects that dealt with social dimensions of health. Health system/policy included health services that dealt with aspects of health service provision, and health policy that dealt with concepts and frameworks related to the health system. A paper was classified as original research if it had original data collection and its analysis, and review/viewpoint if it was not based on original data. An attempt was made to classify each paper under the disease/condition that it covered, according to the listing used in the Global Burden of Disease Study [2]. If a paper covered generic issue(s) which could not be classified under a particular disease/condition, it was considered unclassifiable for disease/condition.

The 2002 impact factor of the journal, in which each paper was published, was used as a measure of the quality of each paper [5, 6]. The proportion of papers and the quality-adjusted output for the diseases/conditions were related to the proportion of burden caused by each disease/condition in India as estimated for 2000 by the Global Burden of Disease Study [2]. The publications of 2002 were related to the disease burden of 2000, as research initiation to publication may take on an average a couple of years.

Percent quality-adjusted research output was calculated for papers in the categories of several classifications as follows:

IndMED [7], an online database of the Indian Medlars Centre, which covers several Indian biomedical journals was also searched. However, this database could not be included in the study, as the abstracts/papers for all the months of 2002 were not included in this database with substantial portions missing.

As reports on commissioned research in public health may be available on the websites of agencies/organisations, the websites of several international agencies (DFID, European Commission, UNAIDS, USAID, WHO, World Bank), twelve academic institutions of India involved with public health, and sixteen publishing houses, were searched to locate research on public health reported in the public domain from India in 2002.

For comparison of the Indian health research output with a developed country, a PubMed search was also done for papers published from Australia during the April–June 2002 quarter, using "Australia" OR "names/abbreviations of the states and territories of Australia [8]" in the author affiliation option in PubMed for all journals as several papers in Australian journals mentioned only city and state but not Australia in the author affiliation.

Data were entered in an MS Access database and analysed using SPSS software.

Of the 5718 papers with abstracts located on PubMed that were published from India in 2002, 842 (14.7%) papers were considered as non-health papers as they were on pure botany, chemistry, physics or zoology that could not be related to human health, and the other 4876 were health papers. The distribution of the types of research and the types of papers for the health papers is shown in Table 1. The basic and clinical science papers predominated, with public health papers comprising a very small fraction (4.4% of the total). The proportion of papers based on original research was substantially lower for public health (68.5%) than for basic sciences (94.4%) and clinical sciences (92.3%); of the total 4495 original research papers, public health made up only 3.3%. 4700 (96.4%) of the total health papers were on the allopathic system of medicine and 176 (3.6%) on the traditional systems of medicine in which the majority were on ayurveda (144 [81.8%]).

Table 2 shows the distribution of the diseases/conditions covered by the original research papers from India as compared with the estimated disease burden. A large proportion of the basic science papers (49%) were not classifiable into specific disease/condition categories, as they were generic in nature, as compared with 2.9% papers in clinical science and 13% in public health. Overall, the relative proportion of quality-adjusted original research output for non-communicable diseases was higher than their relative contribution to the disease burden, and this was most marked for clinical sciences. However, some major categories/sub-categories within non-communicable diseases were not covered adequately, as a fairly large proportion of research output was on conditions or issues that were not contributing as much to the disease burden. For example, cardiovascular diseases with a disease burden of 11.4% of the total in 2000 had a relatively low quality-adjusted research output of 3.6% of the total. The estimated disease burden due to neuro-psychiatric conditions was 9.6% of the total and the quality adjusted original research output in this category was relatively fair at 8.8%, but the two major sub-categories of unipolar major depression and biopolar disorder that made up 5.2% of the total disease burden had only 0.2% of the total quality-adjusted original research output. A similar mismatch was seen for infectious & parasitic diseases and respiratory infections that had 33.3% of the total quality-adjusted original research output for 33.9% of the total disease burden, but the six major sub-categories under this group contributing 30.1% of the total disease burden had only 11.8% of the total quality-adjusted original research output (Table 2).

Overall, the diseases/conditions that were substantially underrepresented in the relative proportion of quality-adjusted original research output as compared with their contribution to the disease burden were injuries, cardiovascular disease, respiratory infections, diarrhoeal diseases, perinatal conditions, childhood cluster diseases (including measles and tetanus), unipolar major depression, and HIV/AIDS (Table 2).

As the research output was least in public health, a brief description follows to understand this deficiency better. Figure 1 shows the diseases/conditions that were estimated to contribute more than 4% of the total disease burden in 2000 or 2010, and for which the original research output in public health was less than one-third of their proportional contribution to the disease burden estimated for 2010, suggesting that these diseases/conditions needed particular attention. Table 3 shows the distribution of original research in the various areas of public health, which suggests that original research in human resources, health policy, and health economics is relatively more deficient within the already low public health research output. Only six of the original public health research papers were on assessing interventions across the various areas, suggesting that the existing public health research in India has not yet evolved to the stage of methodically assessing the impact of public health interventions, which is a necessary step in the evolution of effective public health action.

Diseases/conditions poorly represented in original public health research relative to their contribution to the disease burden in India.

Full size image

Of the total 4876 health papers from India in PubMed for 2002, 1300 (26.7%) were published in Indian journals, but these papers accounted for only 1.5% of the total impact factor of all health papers from India due to the very low impact factors of Indian journals. Among the public health papers 44.4% were published in Indian journals, for clinical sciences papers this was 39.7%, whereas this proportion was much smaller for basic sciences (12.4%).

The highest proportion of quality-adjusted basic research output was by university departments, institutions affiliated with the Council of Scientific and Industrial Research, and technical institutions; the predominant proportion of clinical research was by medical colleges / hospitals; and public health research by medical colleges / hospitals, government departments (due to one paper in a very high impact factor journal), and institutions affiliated with the Indian Council of Medical Research (Table 4). The National Capital Territory of Delhi accounted for the highest health research output among all states / union territories or cities (Table 5). The top ten research producing cities, with 6% of the population of India, produced 75.6% of the quality-adjusted research output, suggesting a concentration of quality research activity in parts of the country.

Search of websites of major academic institutions in India, international agencies, and publishing houses revealed that substantial original public health research output that was accessible in the public domain was not readily available from these sources. Among the major academic institutions in India involved with public health research, only one was found to have a few reports on health research accessible on its website [9] and another had some health research abstracts on its website [10]. The international agencies had some reports on their websites on India-related health research that were mostly authored by non-Indian authors.

In the April-June quarter of 2002, 1905 health papers published from Australia were located on PubMed, of which 722 (37.9%) were in basic sciences, 954 (50.1%) in clinical sciences, and 229 (12%) in public health. Taking into account the population and total gross domestic product (GDP) adjusted for purchasing power parity (PPP) of Australia and India [1], the quality-adjusted health research output and public health research output were 19.6 and 31 times higher from Australia than India, respectively, per unit GDP adjusted for PPP (Table 6).

The data presented in this paper suggest that the health research output from India is not commensurate with the magnitude and distribution of disease burden. The research output in public health is particularly meagre, which is a major concern as public health sciences are a necessary tool to facilitate improvement in population health. Within this low research output, several diseases/conditions contributing substantially to the disease burden and several major areas of public health importance have relatively less representation. Without dynamic, relevant, good quality and adequate original research in the various aspects of public health it is difficult to imagine how the sub-optimal health status of the Indian population would improve on rhetoric or theoretical concepts alone [14, 15].

In this paper we used impact factors for journals as a measure of the quality of papers published in those journals. Although impact factors are not without their limitations, they still offer a tangible, and perhaps the best available, option to compare the quality of publications in journals [6].

We explored several sources where information about health research output from India could be available in the public domain, as the utilisation of research findings is facilitated most if they are readily accessible in the public domain. However, we did not find any source that would add substantially to the information available in the PubMed database. Indeed, there are more Indian health journals than are included in PubMed, but their quality in general is not as high as those included in PubMed with none of them having an impact factor above zero. Non-inclusion in our analysis of the papers published in these journals, therefore, did not bias our assessment of quality-adjusted research output based on impact factors. The relative low quality and impact factor of a large proportion of Indian journals has been discussed previously [16, 17]. PubMed lists affiliation of the first author only, and therefore, the analysis presented in this paper includes only those publications in which the first author had Indian affiliation. There would be other publications with non-Indians as first author and Indians as co-author(s), which we estimate to be a very small fraction of those with Indians as first author. In the general context, the PubMed/MEDLINE database has been used previously to assess the health research output from several countries [18–25].

We used the disease burden in India as estimated by the Global Burden of Disease Study [2]. Although the limitations of this Study have been debated previously in the literature, we could not find a better alternative for use for our study, as these were the most comprehensive estimates available for India. In any case, these estimates can be taken only as indicative, and therefore, we highlight only gross deviations of health research output from these trends.

There has been a previous attempt to assess the health research output from India using the Science Citation Index of 1981–85 and relating the number of papers published in journals of various medical/health specialities with the perceived areas of major disease burden [26]. However, review of all published abstracts to classify each paper in various categories, the approach used by us, has not been used previously to assess health research output from India to our knowledge. Systematic tracking of health research output, and its relation to the estimated trends in disease burden, are necessary for guiding further appropriate development of health research in India. In addition to the overview of research needs identified in this paper, more in-depth assessment of research needs for major diseases/conditions would also be necessary, as was reported recently for the evidence base needed to control HIV/AIDS in India [27].

Since public health sciences seem to be the weakest link in improving health in India currently, it is imperative that a strategic framework for developing original public health research in India be evolved. To do so, the demand, supply and environment issues would have to be addressed:

Demand. Among the multitude of factors that influence the demand for relevant public health research, the role of policy makers and senior health academics is of particular importance. This is seriously sub-optimal in India at present. Political compulsions push many policy makers into short-term gains instead of investments in comprehensive research for long-term benefits. Although there has recently been an increasing trend in India towards commissioned research by government and international agencies in some aspects of public health, this by itself is not enough to boost comprehensive public health research in India, and the reports of such studies are many times not available in the public domain which reduces the chance of their widespread utilisation. Many senior health academics in India continue to disregard public health research as a less-respectful cousin of basic and clinical research. Systematic efforts are needed to demonstrate to these groups the linkages between all aspects of health research (basic, clinical and public health), and the linkages between public health research and improvements in population health, in order to boost the demand for relevant and good-quality public health research in India.

Supply. Enhancing the output of public health research will require effort on various fronts. Establishing schools of public health and other institutions to train quality scientists in public health is a priority, as India has a surprisingly few number of institutions that can provide proper training in public health research. Another area that needs quick attention is to make public health exposure in medical and paramedical colleges more practical to encourage hands-on investigative thinking, as currently it is so theoretical that it rarely inspires enthusiasm in young professionals towards public health research. Setting higher standards for the research dissertations currently required for post-graduate degrees in preventive and social medicine would also encourage better quality and practically relevant public health research. It is also necessary to systematically develop performance-based opportunities to public health research scholars for career enhancement. Another element that would help develop public health research capacity in India is evolving mechanisms to encourage contribution to this effort by the many Indian public health researchers living abroad.

Environment. A conducive environment is necessary for the demand and supply of public health research to function optimally. Efforts are needed to develop this by attempting to develop broad-based coalitions, that include health care providers, civil society and non-governmental sector, for-profit private sector and industry, and national and international agencies providing financial support, which would understand and support the need for vibrant public health research as a vital element of societal development. This is a necessary element that has so far received scant attention, which must be addressed if sustainable development of public health research to improve population health is to become possible in India. An environment of good-quality and comprehensive public health research in India would also infuse the much-needed originality in teaching public health sciences and their practical application to the local context.

Evolving such frameworks would require building up a critical momentum for this effort through perseverance and wisdom. One such opportunity is provided by the recent initiative of the Indian Ministry of Health and Family Welfare to develop more effective institutes of public health in India, with relevant public health research and its utilisation an important key to improving population health [28].

The recent attention towards revitalising the academic aspects of health care / medicine through evidence [29] and evidence-based global health [30] is particularly relevant for developing nations. Evolving a strong, dynamic and locally-relevant evidence base is even more important for developing nations as this is likely to yield relatively higher returns by contributing to improvements in the health, lives and economy of a larger proportion of the world's population. For this to happen, theoretical concepts alone would obviously be not enough. The practical solutions for this effort would have to be developed wisely. The data and its interpretation presented in this paper are, we hope, an example of how the deficiencies in the evidence-base needed for adequate health care in developing nations can be understood objectively in order to plan its strengthening.

Publications from India in PubMed were 11 times less in public health than those in basic sciences and in clinical sciences in 2002.

Injuries, cardiovascular diseases, respiratory infections, diarrhoeal diseases, perinatal conditions, childhood cluster diseases, unipolar major depression, and HIV/AIDS had substantially less proportion of quality-adjusted original research output in India as compared with their contribution to the disease burden.

India produced 20 times less quality-adjusted health research output than Australia per unit gross domestic product adjusted for purchasing power parity, and this ratio for public health research output was even higher at 31 times.

Good-quality public health research output from India is grossly inadequate, and strategic planning to improve it is necessary if substantial enhancement of population health were to be made possible.

Affiliations

1. Centre for Public Health Research, Administrative Staff College of India, Raj Bhavan Road, Hyderabad, 500 082, India

   • Lalit Dandona
   • , Yegnanarayana S Sivan
   • , Mukkamala N Jyothi
   • , VS Udaya Bhaskar
   •  & Rakhi Dandona

Corresponding author

Correspondence to Lalit Dandona.

Competing interests

The author(s) declare that they have no competing interests.

Authors' contributions

LD conceived the idea of this study, guided the design, data collection and analysis, and wrote the initial draft of this paper. YSS contributed to the design, data collection and analysis. MNJ contributed to data collection and analysis. VSUB contributed to data management and analysis. RD contributed to the idea of this study, design and data analysis. All authors read and approved the final manuscript.

Reprints and Permissions