bang for the buck? government funding and research ... · bang for the buck? government funding and...

30
BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH PRODUCTIVITY AT TOP SCIENCE AND TECHNOLOGY UNIVERSITIES IN INDIA Akshay Jain Master of Arts Paper International Education Policy Analysis Graduate School of Education Stanford University August 2018

Upload: others

Post on 24-Jun-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

BANG FOR THE BUCK? GOVERNMENT FUNDING AND

RESEARCH PRODUCTIVITY AT TOP SCIENCE AND

TECHNOLOGY UNIVERSITIES IN INDIA

Akshay Jain

Master of Arts Paper

International Education Policy Analysis

Graduate School of Education

Stanford University

August 2018

Page 2: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

1

Graduate School of Education

Stanford University

INTERNATIONAL EDUCATION POLICY ANALYSIS

Bang for The Buck? Government Funding and Research Productivity

at Top Science and Technology Universities in India

Akshay Jain

August 2018

A Master of Arts Paper in partial fulfillment

of the requirements for the degree of Master of Arts

Approvals:

ICE/IEPA Master’s Program Director: ____________________________________

Christine Min Wotipka, Ph.D., date

Advisor: ____________________________________

Prashant Loyalka, Ph.D., date

Page 3: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

2

Acknowledgements

As I submit this, I am filled with deep gratitude for all the wonderful people who made this

milestone possible for me. First and foremost, I would like to thank Prof. Prashant Loyalka, my

advisor who has been generous throughout the year in providing critical and constructive feedback

on my paper. Right from brainstorming for thesis ideas to collecting my data and now submitting

my final MA paper, Prashant has provided constant guidance. Similarly, I can’t express enough

gratitude for our program director, Prof. Christine Min Wotipka, who has done a marvelous job of

creating a robust scaffolding for students to climb and achieve mastery over the research process

every year. I benefitted immensely from all the drafts, feedback and workshops that were

incorporated in our thesis seminars throughout the year.

I would also like to thank Filipe Recch and Nadine Skinner, doctoral students who have

been extremely generous with their time and support. I thank them for our countless office hour

meetings and discussions. I am sure I have imbibed the researcher attitude and spirit through our

rich conversations. I wish both of you the best for your doctoral theses and hope to learn from your

research down the road.

I thank all my fellow classmates who have inspired me through their own research. They

have also been a source for many ideas and solutions whenever I have hit a roadblock with my

paper. Besides, informal conversations, I thank my classmates for all our seminar workshops

where they have provided critical peer feedback to push my paper to greater heights.

My time at Stanford would not have been possible without generous scholarships from

several donors. I was fortunate to receive the Ellen A. and Robert F. Sawyer Fellowship provided

through the support of Robert F. Sawyer, Wende Sawyer Hutton, and G. Thompson (Tom) Hutton.

I thank them from the bottom of my heart for providing this much needed financial support. I

Page 4: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

3

would not have been able to spend a year at Stanford without your support. Similarly, I would like

to thank Mr. Ratan Tata who was gracious enough to respond to my email and provide a generous

scholarship to me through the Tata Education and Development Trust. Thank you, Sir, for your

generous gesture. I am also grateful for the generous funding I received through the ICE MA funds

to attend CIES 2018 in Mexico City.

I would also like to thank all my professors, professional colleagues, and friends who

have nudged and pushed me to pursue this research and think about creating a dent in the higher

education landscape in India. I hope to continue striving in this direction and use all the skills

that I have learnt over the past year to bring a change.

Finally, I thank my parents, for believing in me and investing so much love and affection

in raising me to where I am today. My educational journey would have been unthinkable without

you. Both of you are my inspiration and I hope to continue making you proud!

Page 5: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

4

Abstract

Global expenditure on research and development has been increasing steadily over the last few

decades. Several studies in developed countries have shown that increased research funding to

individual researchers leads to increased research output, while having mixed effects on research

quality. However, very few studies have analyzed the relationship between research funding and

research productivity (comprising research output and quality) in the context of developing

countries. In this paper, I examine the relationship between government research funding and

research productivity at science and technology (S&T) universities in India. I find a positive

relationship between government research funding and research output, however the relationship

between government research funding and research quality is surprisingly negative. My results

imply that Indian policymakers should substantially increase the research funding for Indian

institutions to compete with their international peers in terms of research output. However,

improving research quality might require supplementary measures such as attracting world-class

faculty members and nurturing the next generation of researchers at Indian universities.

Keywords: Government research funding, research productivity, research quality, science and

technology, higher education, India

Page 6: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

1

1. Introduction

Global expenditure on research and development (R&D) reached a peak of $1.7 trillion in 2015

(UNESCO, 2017). While the United States (US) is still the world leader with annual research

spending of $473 billion,1 several developing countries such as India have significantly increased

their research funding in the last few decades (Varghese & Malik, 2015). Researchers have

demonstrated that higher R&D expenditure leads to greater economic development, mediated by

knowledge creation, human capital accumulation, and innovation (Inglesi-Lotz et al., 2015; Kumar

et al., 2016; Romer, 1986; Solarin and Yen, 2016; Solow, 1956).

Alongside industry, universities are an important center for R&D and play a critical role in

economic development (Arbo and Benneworth, 2007). In view of this, government funding for

university-led R&D is substantial in many countries. The Indian government in recent years has

indicated that it aims to increase India’s R&D expenditure to 2% of the GDP in a bid to boost

economic development, innovation, and prestige of Indian universities (Press Information Bureau,

2015). The government has also announced a policy to select 20 ‘Institutions of Eminence’ which

shall receive increased autonomy and government research funding in order to perform high

quality research and climb to the top 200 universities in the world (Indo Asian News Service,

2017). However, there is little evidence documenting the effectiveness of government’s

expenditure in increasing R&D performance at Indian universities.

Previous studies have focused on assessing the impact of research funding on research

productivity in developed countries (Jacob & Lefgren, 2011; Payne and Siow, 2003). For this

paper, I refer to research productivity as comprising both research output and research quality.

1 The figures above constitute the cumulative R&D expenditure by businesses, government and higher education

institutions in a country.

Page 7: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

2

Research output is measured by the total count of journal articles, books, conference proceedings,

and patents produced by an institution in a given year, whereas research quality is measured

through the total count of citations for all academic publications of an institution in a given year.

Since the research funding model in developed countries awards grants to individual researchers,

most studies assess the relationship between research funding and research productivity at the level

of individual researchers. These studies find that research funding has a positive impact on research

output, while the impact of research funding on research quality is mixed. Very few studies have

analyzed the relationship between research funding and research productivity in developing

countries, and none in India. The research funding model in India awards research funding to

universities, instead of individual researchers. Hence, there is a need to assess the relationship

between government research funding and research productivity at the institutional level.

In this paper, I examine the relationship between government research funding and research

productivity at science and technology (S&T) universities in India. I define research productivity

to include both research output and research quality. Thus, my central research question is whether

increased research funding at Indian S&T universities is associated with increased research output,

research quality, or both. I focus on S&T universities as they have seen the largest expansion, both

in terms of number of institutions and enrollment, in India over the last two decades (Ernst &

Young, 2014). Also, focusing on S&T institutions allows meaningful comparisons in research

productivity across institutions.

The results of my study are of interest to Indian higher education policymakers as they allow

policymakers to understand the quantitative relationship between each additional dollar allocated

to universities and the research productivity of the institution. This knowledge can be applied to

benchmark Indian institutions with their global peers, increase research funding to boost their

Page 8: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

3

research productivity, improve their international rankings and prestige, while spurring innovation

and economic growth.

2. Background: Higher Education in India

India has one of the largest higher education systems in the world with 665 universities and

33,000 colleges (Tilak, 2013). While the number of universities in India was 185 in 1990, it more

than tripled to 665 in 2013. Enrollment has grown rapidly from 4.9 million in 1990 to 29.6 million

students in 2013, propelling India’s higher education gross enrollment ratio to 25.2 percent

(Varghese & Malik, 2015). As mentioned earlier, most of the expansion in universities and

enrolment has focused on S&T. As of 2012, about 40% of the students enrolled in Indian higher

education were pursuing degrees in S&T (Ernst & Young, 2014).

Despite the massive growth in the number of higher education institutions and student

enrolments, growth in research productivity has been slow. Research by Gupta and Dhawan

(2009), Bhattacharya et al. (2015), and Prathap (2017) documents the steady rise of India’s

scientific research output that took off in the mid-1990s. India’s S&T research output, defined as

the number of academic publications, grew annually at an average rate of 7% between 1996 and

2006. More recently, this output grew even more rapidly, growing at 13.9% between 2009 and

2013. Physical sciences, followed by life sciences and engineering sciences, have been the most

productive research areas for India. By 2013, India accounted for 4.4% of the world’s science and

technology (S&T) academic output (Elsevier’s Analytical Services, 2016).

Figure 1 shows India’s government R&D expenditure in absolute and percentage of GDP

terms from 1990 to 2017. While the nominal expenditure on R&D has increased significantly, the

government research expenditure as a percentage of GDP peaked in 2008 at 0.85% of the GDP

and then fell to 0.69% of the GDP by 2017. Even though the fluctuation in the percentage of GDP

Page 9: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

4

is not very large, this trend suggests that the government research expenditure has not kept up with

the overall economic development in India and that there remains room for the government to

increase and better target its research funding.

[Figure 1 about here]

Given this backdrop, the Indian government has proposed to select and promote 20

research universities in the country as “Indian Institutes of Eminence” by increasing their

autonomy and research funding. The government’s vision for these institutions is for them to be

ranked among the top 200 universities in the world (Indo Asian News Service, 2017). Currently,

only three Indian universities are placed among top 200 universities in the world (Nanda, 2017).

Since research output and quality are the most important factors in university ranking systems (QS

World University Rankings, 2017; Times Higher Education, 2017), Indian policymakers aim to

boost research output and quality, subsequently increasing the international rankings of Indian

institutions. In addition, Indian policymakers are keen on tapping university R&D to spur

innovation and economic growth. Hence, this paper is timely in that it provides policy

recommendations for targeted research funding in the Indian context.

3. Prior Literature

3.1. Research productivity and economic development

Two major economic growth models namely, the neo-classical growth model and

endogenous growth model, link knowledge to economic development. While knowledge affects

economic growth indirectly through improved labor in the neo-classical model (Romer, 1986;

Solow, 1956), knowledge affects economic growth directly through human capital accumulation

in the endogenous growth model (Romer, 1986). An important way through which new knowledge

is created is academic research. Thus, it is widely believed that research productivity plays an

Page 10: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

5

important role in economic growth. In testing this hypothesis empirically, many researchers have

found a causal link between research productivity and economic development. In examining panel

data on research output and GDP from countries across the world, Solarin and Yen (2016) and Lee

et al. (2011) find that research output has a positive impact on economic development, especially

in Asia. Similarly, Roula Inglesi-Lotz et al. (2013, 2015) and Kumar et al. (2016) find a positive

effect of research output on economic development for developing countries like India, China, and

South Africa. These research outcomes have policy implications for developing countries such as

India, as they suggest that higher levels of research productivity can boost countries’ economic

development.

3.2. Factors affecting research productivity

Bland et al. (2005) present a comprehensive model of factors affecting research

productivity. The model consists of individual and institutional characteristics that are related to

productivity of researchers at a university in the U.S. Using faculty surveys and publication data,

they show that individual characteristics such as socialization in academic settings, motivation,

content-knowledge, and work-habits are important predictors of research productivity. They also

find that institutional factors such as selective recruitment, research emphasis and culture,

mentorship, time available for research, and resources including funding and human-resource

support are important predictors of productivity. The authors treat research funding as only one

factor among various other individual and institutional characteristics that affect research

productivity.

Other studies have found that institutional factors better predict research productivity

compared to individual factors. Creswell (1985) found that institutional factors such as time

allocated for research and peer networks explain research productivity more precisely than

Page 11: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

6

individual-level factors such as intelligence and content knowledge. Teodorescu (2000) conducted

an empirical study with data from ten countries including Australia, Brazil, Chile, Hong Kong,

Israel, Japan, Korea, Mexico, the United Kingdom, and the US, and observed that individual

characteristics such as age and gender are non-significant predictors of productivity while

institutional characteristics such as affiliation with professional societies, attendance at

international conferences, and high research funding are significant predictors of productivity.

Dundar & Lewis (1998) observe faculty size and percentage of faculty publishing in peer-reviewed

journals to be important predictors of research productivity in examining more than 3,600 doctoral

programs in the United States. Researchers have also found international research collaborations

to have a strong positive impact on both research output and quality (Glanzel and Schubert, 2001;

Ordóñez-Matamoros et al., 2010). Thus, the literature suggests that institutional characteristics,

which I measure in my study as faculty size, faculty qualifications, and international research

collaborations, are important factors related to research productivity.

3.3. Impact of government research funding on research productivity

Government research funding can improve research productivity at universities in the

context of both developed and developing countries. Jacob & Lefgren (2011) utilize a regression

discontinuity (RD) approach to show that receipt of National Institute of Health (NIH) grants in

the US leads to a seven percent increase in research output for individual researchers but find that

NIH grants do not have a statistically significant effect on citations (a measure of quality). They

suggest that the small effect of the national grant on research productivity highlights a competitive

funding market where researchers just shift to another source of funding (mainly other government

agencies such as National Science Foundation or private foundations) in case they are not awarded

the research grant. However, this model might not be applicable for developing country contexts

Page 12: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

7

where researchers depend heavily on purely government funding. At an institutional level, Payne

and Siow (2003) show that increasing the federal funding of a U.S. university by one million

dollars (1996 dollars) leads to 10 more research articles and 0.2 more patents. However, they find

that the effect on citations i.e., research quality is negatively related to federal funding.

In the context of developing countries, Benavente et al. (2012) use the RD approach to find

positive and significant impact of a national research fund on research output of individual

researchers in Chile. They suggest that the low amount of research funding per project was

sufficient to increase the quantity of research output via inexpensive activities such as networking

and promotion at conferences. However, they find that the funding was insufficient to raise the

quality of research, which requires greater investment in laboratories, data-collection, or field-

work. Similarly, Chudnovsky et al. (2008) and Fedderke and Goldschmidt (2015) find positive

effects of research funding on research productivity in Argentina and South Africa, respectively.

However, this research identifies the effect of national grants on the research productivity of

individual researchers.

3.4. Addressing the gaps in the literature

There are various gaps in the current literature examining the impact of government

research funding on research productivity. Firstly, most of the studies focus on the effect of

government research funding on research productivity of individual researchers, not universities.

Secondly, most studies do not analyze the heterogeneous impact of research funding given

institutional characteristics that significantly affect research productivity. Finally, despite India’s

rising status as a knowledge producer and its intent to increase research funding, there are no

studies analyzing the effect of research funding on research productivity at Indian universities.

Page 13: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

8

4. Methodology

Many researchers have attempted to measure the impact of government research funding on

research productivity, either at the individual researcher or the university level. In both cases, an

important concern in measuring impact, however, is the problem of endogeneity. For the purposes

of this study, if government research funding were allocated randomly to the S&T universities in

India, making causal inference regarding the impact of funding on research productivity would be

straightforward. However, government research funding is not allocated randomly. In fact, the

government research funding received by a university is likely to be correlated with various

observable or unobservable characteristics of the university such as its prior publication and

funding record as well as its reputation. Therefore, simple OLS regression analysis will produce

biased estimates.

In most studies mentioned in the literature review, researchers rely on quasi-experimental

methods to arrive at non-biased causal estimates linking research funding to research productivity.

The most common method adopted by researchers is a regression discontinuity design. Benavente

et al. (2012) use this design to compare researchers just above and below the cutoff score for a

national research grant in Chile. Assuming researchers on either side of the cutoff are very similar,

the difference in their research outcomes can be attributed to the difference in their funding status.

Payne and Siow (2003) employ instrumental variable regression to assess the impact of federal

research funding on the research performance of U.S. universities. A suitable instrumental variable

is correlated with the government research funding, but uncorrelated with other factors that affect

a university’s research performance. In this paper, authors use alumni representation on

congressional appropriation committees for research funding as such an instrument.

Page 14: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

9

I rely on a longitudinal dataset with data on 100 institutions for a period of four years from

2013-2017. This allows me to adopt a fixed-effect regression model that controls for institution-

level variation in observable and unobservable factors that contribute to research productivity such

as a university’s prior publications, funding, reputation etc. While a fixed-effects regression model

assumes that these unobservable factors remain constant over time, it is better than a simple OLS

model in tackling the problem of endogeneity.

I specify three fixed-effects regression models with research output as the dependent variable

in the first and research quality as the dependent variable in the latter two models. The three

specifications are as follows:

Outputit +2 = β1 fundingit + αi + uit+2

Qualityit +2 = β2 fundingit + αi + uit+2

Qualityit +3 = β3 fundingit + αi + uit+3

where Outputit +2 is a measure of research output of institution i in period t+2, fundingit is the

government research funding for institution i in period t, αi is the unknown intercept for each

institution for fixed-effects, Qualityit +2 and Qualityit +3 are measures for research quality of

institution i in period t+2 and t=3 respectively, and uit+2 and uit+3 are error terms. Since the effect

of research funding takes time to manifest in terms of publications and citations, the specifications

include lagged variables for research funding. Crespi and Geuna (2005) suggest that a minimum

of two years of time lag on funding is essential to detect changes in scientific publications and

citations at the country level. They also mention that the total cumulative effects of funding on

publications and citations reach a maximum only after five to six years. I follow their suggestion

and include a two-year time lag while analyzing the relationship between research funding and

research output. To accommodate the longer time taken by citations, I include both two-year and

Page 15: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

10

three-year time lags on research funding while analyzing the relationship between research funding

and research quality. Ideally, the time lag on the research funding variable should be longer while

analyzing its relationship with both research output and research quality. However, since my panel

data is only across four years, I cannot introduce lags on research funding any longer than three

years.

5. Data

I compile a longitudinal dataset from two online sources namely Scopus and Government of

India websites. The dataset contains data on several quantitative variables for 100 S&T universities

in India from years 2013 to 2017. The dependent variables of interest are research output and

research quality at S&T universities in India. Research output is measured by the total count of

journal articles, books, conference proceedings and patents produced by an institution in a given

year. Quality of research output is measured through the total count of citations for all academic

publications of an institution in a given year. Benavente et al. (2012) state that the typical way of

measuring quality has been to use the impact factor of the journal in which the research output is

published. However, they argue that the impact factor depends on the field of study and size of the

journal; and it fluctuates widely over time, thus not providing a suitable measure of the quality of

a research output. Hence, they suggest the use of citations as a more robust measure for quality.

World university ranking systems such as Times Higher Education (THE) and Quacquarelli

Symonds (QS) have also adopted the use citation count as an indicator of quality of research (QS

World University Rankings, 2017; Times Higher Education, 2017). Hence, my measure of

research quality is in alignment with international ranking standards, making my results directly

relevant for policymakers looking to propel Indian universities among the top 200 universities of

the world.

Page 16: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

11

The data on the dependent variables, namely, the institutional research output and quality

comes from the online Scopus database. The database contains institution-wise count of peer-

reviewed academic publications and their cumulative citations each year appearing in all Scopus-

indexed journals. It also contains the breakdown of the academic publications in terms of the

number of journal articles, books, conference proceedings etc. and their corresponding citation-

count. It is important to note that the Scopus database does not capture all the academic

publications and citations for Indian institutions. In fact, many Indian journals may not be indexed

in Scopus due to a lack of quality. This prevents me from capturing all the research output and

citations produced by the institutions which might negatively bias my estimates for the relationship

between research funding and research output and quality. Nonetheless, Scopus is one of the most

exhaustive databases for S&T research used by world university ranking organizations like THE

and QS. Hence, as mentioned above, using Scopus data allows me to study the relationship

between research funding and research output and quality at international standards.

The main independent variable of interest is research funding obtained by a university from

years 2013 to 2017. This independent variable enables me to answer the primary research question

of my study, i.e., whether increased research funding at Indian S&T universities is related to

increased quantity of research output, increased quality of research output or both. Other control

variables include faculty size, faculty qualifications, and institutional budget. The data regarding

the independent and control variables comes from the National Institutional Ranking Framework

(NIRF) website of the Ministry of Human Resource Development, Government of India. The

website provides institution-wise details of the faculty size, faculty qualifications (in terms of the

number of faculty members holding a PhD degree), and yearly institutional budgets (in terms of

annual capital and operational expenditure).

Page 17: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

12

Table 1 highlights the summary statistics for my data. The table shows that the average

amount of research funding received by a university in a given year is $1,749,000. The average

number of publications by a university between years 2013 and 2017 is 492, while the average

number of citations is 1649. In terms of control variables, the average number of faculty members

at an institution is 332, with just around half of faculty members holding PhDs and less than a third

of faculty members being women. The fact that almost half of the faculty members do not have a

PhD implies that at least half of the faculty members are devoted largely to teaching. The average

number of undergraduate, postgraduate and PhD students at an institution is 3724, 683 and 296,

respectively. This highlights that majority of the institutions are highly focused on undergraduate

education with an overwhelming majority of undergraduate students on campus, and just a tiny

fraction of PhD students. The dearth of PhD students also implies that research is not the priority

at an average institution in this sample, and that the research culture and ecosystem there is likely

underdeveloped.

[Table 1 about here]

6. Results

6.1. Research Funding and Research Output

To assess the relationship between research funding and research output, I first ran a fixed-

effect regression model that controls for all university-level time invariable factors. Column 1 of

Table 2 highlights the results from this regression specification. I find that the coefficient on

research funding is positive, albeit small, and statistically significant. The value of the coefficient

is 0.007 which means that a one-thousand dollar increase in research funding at an institution is

related to an increase in the number of academic publications at that institution by 0.007 units,

given a two-year time lag between research funding and academic publication. In other words, an

increase in funding by 142,000 US dollars is associated with an increase in one Scopus-indexed

Page 18: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

13

research publication at an Indian institution. Payne and Siow (2003) showed that increasing the

federal funding of a U.S. university by one million dollars (1996 dollars) leads to 10 additional

research publications. Based on this, an additional academic publication at a US university today

would require about 156,000 US dollars (adjusted for inflation from 1996 dollars). This number is

very close to the 142,000 US dollar estimate for Indian universities found in my results.

[Table 2 about here]

6.2. Research Funding and Research Quality

To understand the relationship between research funding and research quality, I first ran

two fixed-effect regression models, as highlighted in Columns 2 and 3 of Table 2, with two and

three-year time lags on research funding, respectively. I find that the coefficient on research

funding is negative and highly statistically significant in both models. The values of the

coefficients are -0.181 and -0.191, respectively. This result is surprising, as most of the previous

literature does not find a statistically significant negative relationship between research funding

and research quality. Most of the literature finds that there is no statistically significant relationship

between research funding and research quality. A negative relationship is particularly difficult to

explain as it suggests that an increase in government research funding is associated with a decrease

in the number of citations for an institution. These results will be explained in the next section.

It is important to note for one of these regression specifications, I have kept the time lag

on research funding to be two years, the same as while analyzing its relationship with research

publications. Since it might take longer for citations to be generated once the research is published,

it is important to allow for at least a three-year time lag between research funding and research

citations. However, even the coefficient in column 3 that has a three-year time lag on research

funding is negative and highly statistically significant.

Page 19: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

14

6.3. Limitations

There are several limitations to my analysis above. Firstly, while I find a positive and

significant relationship between research funding and research publications, the coefficient was

small. This coefficient might be biased downwards as it only captures the relationship between

research funding and research publications at Indian universities as captured by the Scopus

database. Since the Scopus database captures publications appearing only in international, peer-

reviewed journals, it misses the publications from local or non-peer-reviewed journals. However,

as mentioned above, I focus on the publications in the Scopus database as it is used by major

international ranking agencies such as THE and QS, and the policy objective of the Indian

government is to increase the international rankings for Indian universities.

Secondly, due to my dataset limitations, I can only create two and three-year time lags

between research funding and research publications. However, the average lag between research

funding and scientific publication might even be longer than three years. As mentioned above,

Crespi and Geuna (2005) show that the time lag between research funding and publications might

extend to five-to-six years. This restriction constrains my analysis of the relationship between

research funding and research publications.

7. Discussion

One of the aims of Indian government’s higher education policy is to improve international

rankings of Indian institutions and create twenty ‘Institutions of Eminence’ that are ranked among

the top 200 global universities. In this context, the findings of my paper are directly relevant for

Indian policymakers. My data is restricted to academic publications indexed by Scopus, the

databased used by international university ranking agencies like THE and QS to verify the research

output and quality of universities ranked by them. I find a positive relationship between

Page 20: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

15

government research funding and research productivity, with a coefficient of 0.007. With this

estimate, I benchmark Indian institutions with their international peers.

According to the 2018 THE rankings, the highest ranked university in world is Oxford

University which published 13,406 Scopus-indexed items in 2017. Among US universities,

Stanford University is the 3rd ranked university in the world and it published 10,266 items in the

year 2017. Similarly, the highest ranked university in China – Peking University – is ranked 27th

in the world and it published 14,468 items in 2017. Comparatively, the top three-ranked Indian

universities namely, Indian Institute of Science (IISc), Indian Institute of Technology Bombay

(IIT-B), and Indian Institute of Technology Delhi (IIT-D) are ranked in the brackets 251-300, 351-

400, and 501-600, respectively. These three institutions published 2,762; 2,570, and 2,549 items

in 2017, respectively.

To compete with their top-ranked international peers, these institutes need to quadruple

their academic publications every year. Such an increase in research productivity requires a

staggering 994 million-dollar increase in the research budget of each institution. The research

budgets of IISc, IIT-B, and IIT-D were 58 million, 51 million, and 14 million US dollars,

respectively in 2017. Thus, an increase in the budget close to a billion dollars, as required to

compete with the top universities in the world, seems infeasible. However, IISc, IIT-B, and IIT-D

might still be able to compete with universities ranked near the 200th spot. The three universities

tied at the 198th spot in the THE university rankings are University of California Riverside,

University of Gothenburg, and National Taiwan University. They published 2,521; 3,728, and

5,363 academic publications captured by Scopus in 2017. To produce comparable research, IISc,

IIT-B, and IIT-D might aim to publish, on average, an additional 1,000 research publications in

Scopus-indexed journals per year. To accomplish this, each institution will require an additional

Page 21: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

16

budget of 142 million USD per institution, as per my findings. This is close to a 300 percent

increase in research funding for IISc and IIT-B and close to a 1000 percent increase in research

funding for IIT-D. Overall, if Indian policymakers are serious about competing with the top 200

universities in the world, they must rethink the existing research funding paradigm for the top

Indian universities. They must look to increase the existing research funding at Indian S&T

universities substantially in the coming years, possibly to quadruple it or more, just to compete

with the institutions ranked around the 200th spot in international university rankings.

My findings also show a negative relationship between government research funding and

the number of citations generated by an Indian S&T university in a given year. Previous

researchers have found either a null or a positive relationship between research funding and

research quality. In the case of my findings, it is hard to explain why the relationship between

research funding and the number of citations is negative. However, one likely explanation is that

the lag used for citations is just two and three years, the same or just one year more compared to

the lag used for publications. It is only natural that it takes longer for citations to be generated once

an article, book, or conference proceeding gets published. Hence, a longer lag while analyzing the

relationship between research funding and citations might have been more meaningful. However,

this was not possible due to the limitations with my dataset.

However, from a policy perspective, the negative relationship between government

research funding and research quality suggests that while the government might be able to increase

the number of publications by increasing funding, increasing the quality of the publications might

be harder. One possible reason for this might be that government research funding is usually tied

to research outputs such as journal articles, books, or conferences, rather than research quality.

The funding agencies usually provide no clear expectation in terms of the quality of publication,

Page 22: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

17

especially as measured by the number of citations. Thus, one approach that policymakers can adopt

is to tie research funding not only to research outputs but also the long-term research quality of an

institution, as measured by its cumulative citations. However, increasing the quality of research

will likely require an approach that goes beyond merely increasing research funding. For instance,

policymakers could encourage Indian universities to attract world-class faculty members to build

a strong research culture at these institutions. China has been attracting a large number of

international professors and researchers amidst funding cuts in the West to become the next

knowledge hub of the world (Gooch, 2012). India can surely take a leaf out of China’s playbook

to build a world-class faculty base that not only improves research productivity at Indian

institutions but also provides collaborative opportunities for local faculty and nurtures the next

generation of researchers – leading to a world-class research culture and ecosystem at Indian

universities.

8. Conclusion

Indian policymakers aim to boost the research productivity of Indian S&T universities to

galvanize innovation and economic growth. They also aim to propel Indian universities among the

global elite by helping them break into the top 200 ranked universities in the world. However,

there is little empirical evidence to suggest that increasing government research funding will have

any impact on the research output and quality of an institution in India. In this paper, I attempt to

provide basic empirical evidence to test this hypothesis. I find that while there is a positive

relationship between research funding and research output, there is a negative relationship between

research funding and research quality. Also, I find that Indian policymakers should aim to at least

quadruple the research funding of India’s top institutions such as IISc, IIT-B and IIT-D such that

they can compete with their peers ranked close to the 200th spot in international university

Page 23: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

18

rankings. Finally, Indian policymakers must go beyond research funding and explore other policy

options such as increasing the number of faculty members with PhDs, increasing the intake of PhD

students, and encouraging institutions to attract world-class faculty to nurture and build long-

lasting research quality at these institutions.

However, more broadly, Indian policymakers should also reflect on possible downsides of

increasing focus on research at S&T universities. Indian S&T universities still largely play the

function of providing technical education to the next generation of Indian engineers and

professionals. However, despite a heavy focus on undergraduate instruction, many S&T

universities still perform poorly in terms of providing employment-readiness to their students. As

many as 550,000 Indian students venture abroad to get a higher quality higher education. Thus,

Indian S&T universities need resources for the improvement of both teaching and research to retain

top Indian students and reverse brain drain. Indian policymakers should allocate resources in line

with these competing priorities in the context of India, instead of shifting attention solely towards

research. Since ranking agencies do not weigh teaching and employability as highly as research,

Indian policymakers should not ignore these functions of modern Indian S&T universities in the

pursuit of high international rankings.

There are several areas for future research. My findings in this paper are limited by the

restrictions of my dataset. Since I only have data spanning four years, I am unable to add enough

time lag on research funding, while assessing its relationship with research output or research

quality. However, the data regarding research funding and research productivity will continue

being added to the public domain as the Indian government collects more rounds of data for the

NIRF rankings in the coming years. Hence, future researchers can tap on a longer panel dataset to

better assess the relationship between research funding and research productivity at Indian S&T

Page 24: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

19

institutions. Future researchers may look at universities specializing in other disciplines such as

law, medicine, business, arts, humanities, and social sciences. It will be interesting to note whether

the relationship between research funding and research productivity is dependent on the nature of

the academic discipline. Finally, Indian researchers and policymakers should continue

collaborating to explore the discipline and practice of building quality higher education institutions

in India, for India to contribute to the growing knowledge economy of the globe.

Page 25: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

20

References

Arbo, P., Benneworth, P., 2007. Understanding the regional contribution of higher education

institutions: A literature review, OECD, Directorate for Education, Working Paper N. 9.

Paris. https://doi.org/10.1787/161208155312

Benavente, J.M., Crespi, G., Figal Garone, L., Maffioli, A., 2012. The impact of national

research funds: A regression discontinuity approach to the Chilean FONDECYT. Res.

Policy 41, 1461–1475. https://doi.org/10.1016/j.respol.2012.04.007

Bhattacharya, S., Kaul, A., 2015. Emerging countries assertion in the global publication

landscape of science: a case study of India. Scientometrics 103, 387–411.

https://doi.org/10.1007/s11192-015-1551-4

Bland, C.J., Center, B.A., Finstad, D.A., Risbey, K.R., Staples, J.G., 2005. A theoretical,

practical, predictive model of faculty and department research productivity. Acad. Med. 80,

225–237. https://doi.org/Doi 10.1097/00001888-200503000-00006

Chudnovsky, D., López, A., Rossi, M.A., Ubfal, D., 2008. Money for Science? The Impact of

Research Grants in Argentina. Fisc. Stud. 29, 75–87.

Crespi, G., Geuna, A., 2005. Modelling and Measuring Scientific Production : Results for a

Panel of OECD Countries. Sussex.

Creswell, J.W., 1985. Faculty Research Performance Lessons from the Sciences and the Social

Sciences. Washington DC.

Dundar, H., Lewis, D.R., 1998. Determinants of research productivity in Higher Edcuation. Res.

High. Educ. 43, 309–329. https://doi.org/10.1007/BF02457402

Elsevier’s Analytical Services, 2016. International Comparative Performance of India’s Research

Base (2009-2013): A Bibliometric Analysis. New Delhi.

Ernst & Young, 2014. Higher education in India: Moving towards global relevance and

competitiveness. New Delhi.

Fedderke, J.W., Goldschmidt, M., 2015. Does massive funding support of researchers work?:

Evaluating the impact of the South African research chair funding initiative. Res. Policy 44,

467–482. https://doi.org/10.1016/j.respol.2014.09.009

Glanzel, W., Schubert, A., 2001. Double effort = Double impact? A critical view at international

co-authorship in chemistry. Scientometrics 50, 199–214.

https://doi.org/10.1023/A:1010561321723

Gooch, L., 2012. Chinese Universities Send Big Signals to Foreigners. New York Times.

Gupta, B.M., Dhawan, S.M., 2009. Status of India in science and technology as reflected in its

publication output in the Scopus international database, 1996–2006. Budapest Sci. 80, 475–

492. https://doi.org/10.1007/s11192-008-2083-y

Indo Asian News Service, 2017. 20 world class research varsities to be called “Indian institutes

of eminence,” will come up soon: Javadekar. Hindustan Times.

Page 26: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

21

Inglesi-Lotz, R., Chang, T., Gupta, R., 2015. Causality between research output and economic

growth in BRICS. Qual. Quant. 49, 167–176. https://doi.org/10.1007/s11135-013-9980-8

Inglesi-Lotz, R., Pouris, A., 2013. The influence of scientific research output of academics on

economic growth in South Africa: An autoregressive distributed lag (ARDL) application.

Scientometrics 95, 129–139. https://doi.org/10.1007/s11192-012-0817-3

Jacob, B.A., Lefgren, L., 2011. The impact of research grant funding on scientific productivity. J.

Public Econ. 95, 1168–1177. https://doi.org/10.1016/j.jpubeco.2011.05.005

Kumar, R.R., Peter, J.S., Patel, A., 2016. Exploring the link between research and economic

growth: an empirical study of China and USA. Qual. Quant. 50, 1073–1091.

https://doi.org/10.1007/s11135-015-0191-3

Lee, L.C., Lin, P.H., Chuang, Y.W., Lee, Y.Y., 2011. Research output and economic

productivity: A Granger causality test. Scientometrics 89, 465–478.

https://doi.org/10.1007/s11192-011-0476-9

Nanda, P.K., 2017. IIT Delhi among three Indian institutes on global top 200 list. Livemint.

Ordóñez-Matamoros, H.G., Cozzens, S.E., Garcia, M., 2010. International Co-Authorship and

Research Team Performance in Colombia. Rev. Policy Res. 27, 415–431.

https://doi.org/10.1111/j.1541-1338.2010.00449.x

Payne, A.A., Siow, A., 2003. Does Federal Research Funding Increase University Research

Output? Adv. Econ. Anal. Policy 3.

Prathap, G., 2017. A three-dimensional bibliometric evaluation of recent research in India.

Scientometrics 110, 1085–1097. https://doi.org/10.1007/s11192-016-2181-1

Press Information Bureau, 2015. Move to increase R&D Expenditure to two percent of GDP.

QS World University Rankings, 2017. QS World University Rankings – Methodology | Top

Universities. QS. URL https://www.topuniversities.com/qs-world-university-

rankings/methodology (accessed 11.28.17).

Romer, P.M., 1986. Increasing Returns and Long-Run Growth. J. Polit. Econ. 94, 1002–1037.

https://doi.org/10.1086/261420

Solarin, S.A., Yen, Y.Y., 2016. A global analysis of the impact of research output on economic

growth. Scientometrics 108, 855–874. https://doi.org/10.1007/s11192-016-2002-6

Solow, R., 1956. A Contribution to the Theory of Economic Growth. Q. J. Econ. 70, 65–94.

Teodorescu, D., 2000. Correlates of faculty publication productivity: A analysis. High. Educ. 39,

201–222.

Tilak, J., 2013. Higher Education in India. In Search of Equality, Quality and Quantity. Orient

Blackswan Private Limited, New Delhi.

Times Higher Education, 2017. World University Rankings 2018 methodology | THE Rankings.

Times High. Educ. URL https://www.timeshighereducation.com/world-university-

rankings/methodology-world-university-rankings-2018 (accessed 11.28.17).

Page 27: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

22

UNESCO, 2017. How much does your country invest in R&D?. UNESCO. URL

http://uis.unesco.org/apps/visualisations/research-and-development-spending/ (accessed

3.16.18).

Varghese, N. V., Malik, G., 2015. India Higher Education Report 2015. Routledge, New Delhi.

Page 28: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

23

Fig. 1. National R&D Expenditure in India in nominal and % of GDP terms

(Source: Department of Science and Technology, Government of India, 2017)

Page 29: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

24

Table 1

Summary statistics.

Observation Mean Standard

Deviation

Min Max

Research Funding

Publications

Citations

No. of Faculty

Faculty with PhD

UG Students

PG Students

PhD Students

400

396

396

400

400

400

400

400

1749.31

492.14

1648.69

332.39

181.03

3724.40

683.31

295.98

5053.48

579.47

2630.30

249.37

155.31

3076.23

642.67

468.37

0

4

4

57

11

0

18

0

38338.18

2956

16078

1596

979

19386

3086

2471

Notes: UG stands for undergraduate, PG stands for postgraduate

Page 30: BANG FOR THE BUCK? GOVERNMENT FUNDING AND RESEARCH ... · Bang for The Buck? Government Funding and Research Productivity at Top Science and Technology Universities in India Akshay

25

Table 2

Relationship between research funding and research publications and citations.

(Fixed effects model)

(1) (2) (3)

Publications

(2 year lag)

Citations

(2 year lag)

Citations

(3 year lag)

Research Funding 0.007* -0.181*** -0.195***

(0.003) (0.042) (0.058)

Constant 480 1968 1671

Number of obs

(8.72)

396

(113)

396

(132)

297

Notes: **=indicates statistical significance at the 5% level; *=indicates significance at the 10%

level.