Next Article in Journal
On the Vulnerability of Citation Metrics in the Era of Generative Artificial Intelligence
Previous Article in Journal
When AI Writes the Letters: Recognizing Synthetic Authorship Patterns in Medical Publishing
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Quantitative Assessment of Scholarly Output and ROI in ARC-Funded Australian Research

1
School of Computer and Information Sciences, The University of Newcastle, Callaghan 2308, Australia
2
School of Information Technology, King’s Own Institute, Sydney 2000, Australia
3
School of Information Technology, Kent Institute of Higher Education, Sydney 2000, Australia
*
Author to whom correspondence should be addressed.
Publications 2026, 14(2), 22; https://doi.org/10.3390/publications14020022
Submission received: 21 March 2025 / Revised: 6 March 2026 / Accepted: 12 March 2026 / Published: 1 April 2026

Abstract

Government funding programs administered by the Australian Research Council (ARC) aim to advance national research priorities while generating scholarly and socio-economic impact. This study employs a descriptive bibliometric benchmarking approach to examine the relationship between funding levels and scholarly output for publications explicitly acknowledging ARC support. Using project-level funding data linked with journal articles published between 2009 and 2016, we analyze 10,565 ARC-funded projects receiving a total of AUD 4.6 billion and producing 54,639 journal publications. On average, each project received approximately AUD 437,720 and generated five publications, corresponding to a cost of about AUD 84,700 per article. We compare research productivity, citation impact, and return on investment across ARC Discovery and Linkage programs, as well as between STEM and HASS disciplines. The results reveal no strong correlation between funding amount and either publication volume or citation impact across ARC programs. STEM projects generally exhibit higher returns on investment and citation impact; however, a subset of HASS projects achieves exceptionally high efficiency relative to funding received. Notably, projects funded below AUD 100,000 demonstrate the highest return on investment in terms of both publication productivity and normalized citation impact. These findings suggest that smaller grants can yield disproportionately high scholarly returns, offering important implications for research funding allocation, efficiency evaluation, and performance assessment in public research systems.

1. Introduction

In Australia, like most other countries, the government supports research by providing funds each year to research projects after an extensive competitive grant round and associated peer review process. The Australian Research Council (ARC) supports basic and applied research in numerous fields to enable engagement with national and international challenges. Increasing focus is placed on the impact of funded research, with return on government investment for all funded projects central to the accountability of public funds. While the measurement of impact continues to evolve, scholarly publications play a fundamental role in the grant cycle. The publication history of grant applicants is an important criterion in the assessment process, as well as being a measure of a project’s impact. Thus, the journal publication outputs of research projects create a self-referencing system.
Government-funded research is commonly held in the highest esteem by academic and research communities. Researchers allocate significant time and effort to preparing grant applications (Harper et al., 2020). In the Australian context, the ARC has fixed total research funding each year, making obtaining ARC research funding a highly competitive process. In 2021, the percentage of successful applicants for the national priority Discover program was 20%, compared to 29.9% (averaged over Rounds 1 and 2) for the industry collaboration Linkage program (Australian Research Council, 2021c). Although the funding application is a very well-defined process with clear guidelines, there is no simple method to comparably measure the output and impact of funded projects. The impact principles from the ARC provide a “Research Impact Pathway” table that describes the progression from the inputs needed to conduct research, through the activities carried out and outputs generated, to the outcomes and broader societal benefits that result (Australian Research Council, 2012). Publications, patents, policy, and media briefings have been identified as high-level examples of output that result in outcomes in the form of commercial products, start-ups, policy implementations, and citations to provide socio-economic benefits and risk reductions in decision making. In terms of outcomes, impact considers scholarly publication as one of the primary output factors and citations as one of the main impact measures of funded projects (Australian Research Council, 2021b).
From this perspective, the research presented in this paper only focuses on investigating how research funding is associated with research impact, as measured through the quantity and impact of scholarly publications, for ARC funded Discovery (national priority) and Linkage (industry collaboration) projects. The ARC Discovery scheme primarily supports investigator-driven fundamental research, whereas the Linkage scheme is designed to encourage collaboration between universities and industry, government, and community organisations. To achieve this, we consider the funding acknowledgement in research papers, with these references showing the association of publications to the ARC project(s) supporting that research. The objective of this study is not to estimate the causal effect of research funding on scholarly performance but rather to provide a descriptive benchmarking of publication productivity and citation impact across ARC-funded projects at different funding levels. We report on the impact and quantity of research outputs for projects in receipt of differing levels of funding. Lastly, return on investment (ROI) in terms of productivity and scholarly impact is calculated for all funded projects to evaluate the relationship between funding amount and ROI. We begin with a review of the literature on work that considers the relationship between research funding and research impact, and we discuss the different metrics used for quantifying research impact. From this review, we draw upon the metrics discussed to undertake a quantitative analysis of research output and the scholarly impact of ARC funding schemes in alignment with the research questions posed. The research methodology adopted is introduced in the following section, providing details of the data sources used and the data pre-processing procedure. The analysis, results, and discussion of results are included in a consolidated Section 4, with a consolidated conclusion provided in Section 5.
Despite a growing body of international research examining the relationship between research funding and scholarly output, several important gaps remain. First, existing studies often focus on aggregate publication or citation outcomes without explicitly assessing funding efficiency or return on investment at the project level. Second, relatively little empirical evidence is available for the Australian research funding context, particularly for ARC-funded projects analyzed across both Discovery and Linkage schemes. Third, prior analyses rarely compare research efficiency systematically across disciplinary groupings such as STEM and HASS using normalized impact indicators. As a result, it remains unclear how funding levels translate into scholarly productivity and impact efficiency within Australia’s primary public research funding system.

2. Review of the Literature

The analysis of the correlation between research funding and subsequent scholarly output has garnered considerable attention, forming the foundation for policy-making concerning the allocation of research grants. Prior studies, with the background details shown in Table 1, have incorporated both qualitative and quantitative methodologies to probe the influence of various factors on this relationship.
However, the past decade of research has yielded inconclusive results due to a huge variety in scope and methods of studies, as shown in Table 2. Hence, complicating the task of articulating a coherent rationale for research fund distribution. In the following section, we review recent investigations in this domain and contrast the factors considered to represent research output.
The success of funded research projects has been considered along multiple dimensions of impact including the degree to which they achieve their stated aims or outcomes and the quantity and impact of research outputs produced. The goal achievement of funded projects has been studied for several large-scale projects (Spanos & Vonortas, 2012), with the goals identified as scientific, technical, and commercial objectives. The results of this research showed that the scale of projects, in terms of team members, has a positive effect to a certain extent on goal achievement, and after that, the positive effect starts diminishing; hence, an inverse U-shaped effect is observed. Similarly, scale in terms of the budget of the project has an inverse U-shaped effect on goal achievement.
The relationship between project size and output was further corroborated by Bloch et al. (2016), who analysed the performance of 57 Centres of Excellence (CoE) funded by the Danish National Research Foundation, and the results indicate that the performance of these CoEs increased linearly in terms of number of publications with the duration of the grant, with a peak around grant year 9. The effect of grant size on performance was calculated by dividing the grants into four quartiles based on the average annual grant size. CoEs belonging to different quartiles showed varying performance in terms of Mean Normalized Citation Score (MNCS) throughout the grant period. Overall performance of CoEs was observed to be very high both in terms of MNCS and the share of top 10% most cited publications in the respective fields.
The relationship between citations and the research funding acknowledged in any paper is explored by Gök et al. (2016). The purpose of the study was to explore how the acknowledgement of different funding in a paper affects first citation, total citations and also the possibility of the paper becoming highly cited. The authors found that the mentioning of funding for any project in the paper positively relates to the number of total citations for that paper and also to the top percentile citation impact. In a related study, Jowkar et al. (2011) analysed the citation impact of funded and unfunded publications by Iranian authors. The results indicated that funded publications have a higher citation impact, implying that funded projects generate higher-impact publications.
The impact of funding size on research outcomes was further studied by the teams from Danthi et al. (2015) and Lauer et al. (2017). in the context of funding provided by the National Institute of Health, USA. Danthi et al. (2015) compared the impact of projects funded through regular grants and those receiving special grants. The regular grant projects resulted in more publications with higher normalised citation impact as compared to the special grant projects. However, there was no difference when the effects based per million dollars spent were considered and the mechanism of funding had no effect on normalised citation impact per million dollars spent. The authors also observed that the factor that contributed most to the prediction of the normalised citation impact per million dollars spent is the total funded amount. Lauer et al. (2017) then studied the effect of the Grant Support Index (GSI) on the research output of the National Institute of Health, USA, funded projects. The results showed that research output increased initially with the increase of GSI, but the positive trend started diminishing to the extent that with the increase of GSI, the research output slightly decreased after a certain GSI values.
The potential factors influencing the research output of funded projects were investigated by Győrffy et al. (2020). Their analysis indicates that international collaborations and funding amounts have positively impacted the publication output of the funded projects. However, the largest positive influence relates to the scientometric characteristics of the applying principal investigator including H-index, independent citations, and the average number of articles in highly ranked journals.
The relationship between funding amount and research outcomes is made more complex by imperfect measures of impact. Aagaard et al. (2020) reviewed existing literature on the relation between funding size and research performance for funded projects. The review showed that there has been research favouring concentration of funding as well as dispersion when it comes to funded research projects, hence, no clear position can be established on the topic of funding dispersion or concentration. Jung et al. (2017) also considered these conflicting results when the impact of funding is observed on research output. The authors argued that the results may be due to the way research output is being calculated and mentioned some additional factors like journal impact factor, journal ranking and discipline-specific measures that must be considered while calculating research performance.
One of very few research articles considering the Australian research funding environment, through the ARC research grants schemes, was conducted by Bromham et al. (2016). The authors studied the impact of the multidisciplinary research focus of proposed projects on its acceptance for funding. The project proposals submitted to the ARC’s Discovery Program indicated multidisciplinary projects have a much lower probability of receiving funds as compared to projects with a more disciplined focus. This may have a subsequent effect on impact, given the propensity for bibliometric impact measures to favour discipline-focused outputs (Rafols et al., 2012), introducing a self-referencing effect. Since 2020, no empirical studies have specifically examined the relationship between academic output and Australian research funding.
A requirement of a suitable method and/or tool to assess research impact across different research areas is an open issue, investigated in multiple studies. The two distinct research areas of Humanities, Arts and Social Sciences (HASS) and Science, Technology, Engineering and Mathematics (STEM) require multiple indicators to be considered when it comes to research evaluation in both domains using one bibliometric tool (Melchiorsen, 2019). The role of different disciplines is studied in multidisciplinary research projects across STEM and non-STEM areas funded by ARC Discovery scheme. Among the STEM disciplines, Engineering, Biological Sciences and Technology appeared most common disciplines. On the other hand, non-STEM interdisciplinary research had Studies in Human Societies, Language, Communication and Culture, and History and Archaeology as the most commonly appearing disciplines. By introducing a new combined discipline of STEMM that contains disciplines of Astrophysics, Computer Science, Engineering, Environmental Studies, Mathematics, Medicine, and Nanotechnology, the authors studied the association of funding amount with the research impact in terms of citations of the publications of those funded projects (Yan et al., 2018). The number of authors and institutions positively influenced the citation impact in addition to the funding amount.
The body of literature on government-funded research paints a complex picture of the relationship between funding and subsequent academic output. While there is no shortage of effort by researchers to secure these funds, given their prestige and significance in academia, understanding the effects of such funding on research output presents a challenge. In the Australian context, where ARC funding is highly competitive, the difficulty is further compounded. Measuring research impact remains a complex task, with approaches generally highlighting scholarly publication and citation counts as key academic indicators. Taking into account the diverse landscape of research on government-funded projects, our study moves forward to examine the relationship between research funding and the resultant academic output. Specifically, in the competitive setting of ARC funding in Australia, we seek to understand how varying funding levels influence research impact and output.
More recent studies published after 2020 have increasingly emphasised the complexity of evaluating research funding effectiveness, particularly in the context of evolving bibliometric practices and the disruptions associated with the COVID-19 pandemic. This body of work highlights the importance of field-normalised indicators, the limitations of funding acknowledgement data, and the challenges of attributing causality in non-random funding environments.
From this previous work, it is evident that a variety of approaches have been posited for considering relationships between scholarly output and funding amount. The primary purpose of our research is to employ a descriptive benchmarking approach to investigate the relationship between scholarly output and funding amount in the Australian context, using data for ARC-funded projects. By delving specifically into funded projects, we aim to discover nuanced insights into how funding influences scholarly output.
Scholarly output can be measured from two perspectives: the quantity of scholarly output (number of papers produced) and impact of scholarly output (citation counts and journal ranks). To provide focus for our analysis of the data, we seek the answers to the following specific questions:
RQ1: What is the relationship between the quantity of scholarly output and funding amount?
RQ2: What is the relationship between impact of scholarly output and funding amount?
For this study, the impact of scholarly output can be measured via the sum of category-normalized citation impact (CNCI), and the number of highly cited papers generated by the funded project. CNCI is calculated as the number of citations received divided by the expected citations for papers of a similar type, year, and research area. This index is used to eliminate the discipline-specific differences and serves the same purpose as GSI defined by the previous study (Lauer et al., 2017). Highly cited papers are defined as publications in the top 1% by citations for their research area and publication year. The values of the CNCI, and the highly cited status are provided by InCites. By normalising citations by both publication year and research field, CNCI mitigates temporal bias associated with differential citation windows across publication cohorts. While journal-level indicators (e.g., impact factor quartiles) capture outlet prestige, this study relies on CNCI as an outcome-based measure of research impact, reflecting how publications perform relative to global citation norms within their respective fields and years.
The data sources, data collection and cleansing process, data consolidation, and analysis procedure adopted in this research are explained in the following Section 3. It is also worth noting that the dataset used in this study predates the COVID-19 pandemic, which significantly disrupted research productivity and publication patterns globally. The global COVID-19 pandemic disrupted academic activity across the world, with noted impacts such as an increase in pandemic-focused publications (Harper et al., 2020), a decrease in non-medical research output and the impact of those outputs (Riccaboni & Verginer, 2022), disproportionate impacts on underrepresented minority research (Carr et al., 2021), and changes in grant applications (Esquivel et al., 2023). As such, we focus on the period prior to the most acute pandemic-related disruptions (i.e., projects completed before March 2021) to minimise the influence of pandemic-related distortions in research activity and citation dynamics.

3. Methodology

In this study, analytical strategy is intentionally descriptive. Summary statistics, distributional analyses, and comparative visualizations are employed to benchmark research output and impact across funding categories. No inferential modeling is applied, as the purpose of the analysis is to document observed patterns rather than to test causal hypotheses.

3.1. Data Sources

Two major data sources, ARC (Australian Research Council, 2021a), and Web of Science (Clarivate, 2021b) (WoS) together with InCites Clarivate (2021a), have been used to obtain insights on the quantitative relationships between research project funding amounts and scholarly outputs for this research. The ARC’s official website (Australian Research Council, 2021a) provides various datasets on different aspects of the available funding schemes, and a data portal for detailed grants searching (Australian Research Council, 2021b). Broader funding-related information can also be captured through the ARC website.
Initially, WoS (Clarivate, 2021b) and Scopus (Scopus, 2021) were taken into consideration, as both are major bibliographic databases that provide detailed information relating to scholarly publications. Both also provide detailed records for publications that identify the ARC as a funding sponsor. As of 1 March 2021, 131,492 journal articles from WoS and 100,590 journal articles from Scopus dated from the year 2002 were located that identify the ARC as the funding sponsor. In addition to having a larger dataset, WoS is supported by a robust citation analysis tool, InCites, that enables the analysis of journal impact metrics. Thus, in this research, we use WoS and InCites to assist in answering our scholarly output-related questions. We also limit scholarly impact to peer-reviewed journal articles only to ensure valid and consistent impact measures are used given the variability in measures associated with other sources such as conferences and book chapters.

3.2. Data Collection and Consolidation

3.2.1. ARC Datasets

The data collection on ARC funding has been conducted from two data repositories: the National Competitive Grants Program (NCGP) dataset for project details, and the results from ARC Grants search data portal for grants/team details.
The NCGP dataset (Australian Research Council, 2021a) lists ARC funding for all projects by funding commencement year including University Group, Administering Organisation, State/Territory, Program, Scheme, STEM/HASS Allocation, Primary Field of Research Division (FoR 2D), and Primary Field of Research Group (FoR 4D). In this NCGP dataset, “University Group” enumerates six groupings of universities and educational institutions in Australia: Australian Technology Network of Universities, Group of Eight Universities, Innovative Research Universities, Non-university Organizations, Not Aligned Universities, and Regional Universities Network. “Administering Organization” details the specified university or research institution. The “Program" data field comprises two types of entries, “Discovery” and “Linkage”, and the “Scheme” data field specifies the subcategories of “Program” to allow differentiation of these. “STEM/HASS Allocation” identifies the category of the research fields: Science, Technology, Engineering or Maths (STEM); Humanities, Arts, or Social Science (HASS); Not Specified; or Unknown. The fields “FoR 2D” and “FoR4D” identify the research area of the projects. This NCGP dataset covers the period from 2002 to 2020.
The additional dataset from the ARC Grants search data portal (Australian Research Council, 2021b) was downloaded with no search criteria and for all data for the calendar years from 2002 to 2020, matching the time frame for the NCGP dataset. The search results do not contain any details of the research output; specifically, the dataset does not include details of publications produced from the funded research projects. However, the results provide the time frame of the projects, including funding commencement year and end year, chief investigators, and team members.
Joining of the NCGP and the ARC Grants data provided a comprehensive list of ARC-funded projects, producing a dataset of 28,033 records for the analysis of publications and referred to in the remaining sections as “ARC dataset”.

3.2.2. Publication Datasets

To locate relevant journal publications for this study, searches have been conducted over the Web of Science (WoS) bibliometric database. From the WoS web interface, searches were specified for “Australian Research Council” under Funding Sponsor, and from Year 2002 to 2020. The results were restricted to “Article” under the Document Type criteria.
In this first step, a total of 131,492 article records were downloaded from WoS. In the next step, ARC reference numbers from the Funding Organization data field were extracted. All duplicate publication entries using the WoS built-in unique identifier UID were also removed to ensure unique data, resulting in a total of 129,187 article publication records.
In the second step, the scholarly impact data for these publications was downloaded from InCites from the WoS website. Through this step, a total of 139,346 records with scholarly impact details were collected.
In the third step, article records from WoS, and scholarly impact details from InCites, were merged on UID. Often, one article could be funded by multiple ARC projects. The most important data processing in this step was to generate the list of unique article records by just one ARC number. That means, in this dataset, ARC numbers combined with UID for all records are always unique. At the end of this step, a total of 141,092 article records with scholarly impact details were consolidated.
In the fourth step and last step in this sub-process, 18,747 unique ARC numbers were extracted from the 141,092 article records. Based on the unique ARC number, a summary dataset with publication details and scholarly impact details was generated and is referred to as the “publication dataset” in the following sections.

3.3. Consolidated ARC-Funded Publication Dataset

To merge with the funding details, the 18,747 unique ARC numbers with publication details were matched to 28,033 ARC records based on ARC number in this final consolidation step. There are ARC numbers in the publication dataset that are absent from the ARC dataset, and conversely, there are ARC numbers in the ARC dataset that are absent from the publication dataset. Between these two datasets, a collection of 14,153 distinct records and a distinct set of 13,880 shared records, by matching ARC number, were obtained. This signifies that a total of 14,153 ARC projects were not able to be associated with any publications in WoS. Consequently, a total of 13,880 ARC project records were generated with ARC number and funding details, publications details, as well as associated scholarly impact details which are included in the analysis for this study. Although only 49.5% of the ARC project from the original NCGP dataset was selected for the analysis, it is worth mentioning that the number of research grants considered for our study is significantly larger than most other such research impact studies for a single funding agency.
Approximately half of the ARC projects in the original dataset could not be linked to publications via funding acknowledgements. This incomplete linkage primarily arises from the reliance on funding acknowledgement information in bibliographic databases, which is a known limitation in bibliometric studies of funded research. Publications resulting from funded projects may omit funding information, record funding sponsors inconsistently, or fail to include specific ARC grant identifiers. Additionally, some ARC-funded projects may generate outputs other than journal articles (e.g., reports, patents, and policy outputs), which are not captured in Web of Science.
In summary, the workflow of the data collection and consolidation process is shown in Figure 1.

3.4. Scope of the Study

This study was only about the academic output funded by ARC. The academic publications not funded by ARC were excluded. In this analysis, the comparison was conducted by the projects funded by the Australian Research Council (ARC) under the Discovery and Linkage schemes.

4. Results and Discussion

The analysis and results relating to the two research sub-questions presented in Section 1 are provided and discussed in sequence order in this section. However, prior to the analysis of the research questions, the dataset of 13,880 records has been further investigated for the purpose of better understanding the relationship between funding and scholarly output.
In the ARC dataset, the Program data field identifies the funding program of the project. As previously noted, the ARC has two main funding programs: Discovery and Linkage (Brooks & Byrne, 2006). The Discovery program focuses on fundamental research to create research areas, opportunities, and impact. These programs support competitive and collaborative research while providing training and career opportunities in research priority areas. The Linkage program focuses on the development of partnerships to transfer knowledge and ideas to industry and businesses for commercial benefit. This program supports industry research collaboration to promote the use of research outcomes. Due to the differences in the focus of these programs, the research output of the projects may be influenced. The projects funded by the Discovery programs aim to publish more high-impact articles on fundamental research. For example, it is assumed that projects supported by the Linkage program focus on applications of the research for industry partners and on generating patents. We therefore expect to see some differences in the publication patterns across these two schemes. Specifically, basic research has been associated with lower levels of funding (Bentley et al., 2015), which has not been considered through the generated scholarly productivity of these two schemes.
The important aspects of comparison between the Discovery and Linkage programs are funding amount; quantity and impact of publication; and subsequently, a calculation of funding investment return based on this data. T-tests have been conducted between these two programs to consider statistical significance using a 95% confidence interval. For the comparisons including quantity of publication and impact of publication, the test results show p < 0.0001, which means significant differences between Discovery and Linkage programs. For the comparisons including funding investment return including the number of publications per dollar and impact per dollar, the t-test results show p < 0.05, which means there are some differences between Discovery and Linkage programs. Based on these findings, it is necessary to separate the analysis by programs.
Several methodological limitations should be acknowledged. Although citation impact is assessed using normalized indicators to improve comparability, variations in citation practices across disciplines and publication years may still influence observed impact patterns. In particular, differences between STEM and HASS fields and the cumulative nature of citations over time cannot be fully eliminated through normalization. In addition, this study relies on publications that explicitly acknowledge ARC funding, which may lead to an underrepresentation of outputs where funding acknowledgements are incomplete.
  • Number of Projects
The final consolidated dataset of 13,880 records included grants with Active and Closed status. To appropriately investigate funding investment return, only Closed projects have been included for this analysis, assuming grants with an active status may have unrealised outputs. For these projects, the number of all projects (with or without publications) and the number of projects with identified publications from 2002 to 2020 are plotted on a bar chart (Figure 2). In Figure 2, the numbers above the pink bars represent the total number of projects, while those above the green bars show the number of projects with publications. The percentage of projects with publications versus the number of all projects dramatically increased from 2002 to 2014. This indicates that an increasing number of projects submitted funding sponsorship details to the publisher over time as they publish. The plot also shows that the number of all projects decreased from 2013 to 2019, which matches the time frame of the ARC projects defined in this dataset from 0 to 8 years for the project duration, aligning with a previous study noting the 9-year peak (Bloch et al., 2016). From Figure 2, more than 60% projects between 2009 to 2016 are associated with published articles, while less than 50% of projects from 2002 to 2008 and from 2018 to 2019 have successfully published scholarly articles, with the latter likely attributed to publishing lag.
For meaningful analysis, grant years with more than 60% funded projects having publications were selected for this study to counter issues with publication lag, resulting in the time frame being restricted from 2009 to 2016 (an 8-year period).
Research outputs often take several years to materialise following the receipt of funding. The process typically involves project execution, manuscript preparation, peer review, and eventual publication, followed by the accumulation of citations. Previous bibliometric studies therefore commonly apply extended observation windows to capture the longer-term academic impact of funded research.
Consequently, using this time restriction, a total of 10,565 ARC projects are included in this study.
These ARC projects are categorized based on the funding amounts into six distinct groups: below 1 million, 1–2 million, 2–3 million, 3–4 million, and over 5 million. Furthermore, these projects are further segmented into subcategories within the ARC funding program, as well as research areas defined by Primary FoR4D types. The count of projects within each of these breakdown categories is detailed in Table 3.
Due to the considerable quantity of projects funded below the 1 million mark, these projects are further subdivided into funding amounts specifically at the 100K level (Table 4).
To understand the insights of the ROI pertaining to the funding, the analysis in this study is conducted on the basis of 100K (0.1 million).
  • Correlation
Prior to answering the research questions, the associations among all the data fields including the funding amount, the quantity of scholarly output, and the impact of scholarly output are explored. A correlation heatmap is employed to explain the complex relationships between funding amount and all other attributes, presented in Figure 3.
Funding Amount: There is a moderate positive correlation (0.327) with the Number of Publications and a weak positive correlation (0.197) with CNCI Score. Weak positive correlations are also observed with Collaborating Universities (0.254) and Collaborating with Top 10 (0.152).
Primary FoR4D: There are weak negative correlations with most variables, indicating very little linear relationships.
Collaborating Universities: Strong positive correlations are seen with Number of Publications (0.667) and CNCI Score (0.567), indicating that as the number of collaborating universities increases, the number of publications and CNCI score also tend to increase.
Collaborating with Top 10: Similar to Collaborating Universities, there are positive correlations with Number of Publications (0.420) and CNCI Score (0.295), but slightly weaker.
Number of Publications: Strong positive correlations are seen with Collaborating Universities (0.667) and Collaborating with Top 10 (0.420), indicating that more collaborations lead to more publications.
CNCI Score: Strong positive correlations are seen with Collaborating Universities (0.567) and Number of Publications (0.775), suggesting that higher CNCI scores are associated with more collaborations and publications.
Number of Authors and Highly Cited Score: Both have weak correlations with other variables in the table, indicating minimal linear relationships.
From Figure 3, this analysis suggests that collaborations with universities, especially top-ranked ones, and higher numbers of publications are associated with increased funding amounts and CNCI scores. However, causality cannot be inferred from correlation alone, and further analysis is needed to understand the underlying relationships.
This section presents a descriptive benchmarking analysis of publication productivity and citation impact across ARC-funded projects at different funding levels. To avoid misinterpretation, it should be noted that related metrics reported in this section serve different benchmarking purposes and are not intended as alternative formulations of the same result.
  • RQ1: What is the relationship between the quantity of scholarly output and funding amount?
To inspect the big picture, scatter plots are generated to demonstrate the relationship between the quantity of scholarly output and the funding amount. The three scatter plots in Figure 4 show all funding levels, funding less than and equal to 5 million, and funding less than and equal to 1 million. The scatter plots are generated based on two categories, Discovery and Linkage. Throughout all funding levels, most of the projects received funding less than five millions dollars. More specifically, funding less than or equal to 1 million dollar is the most common funding levels for both Linkage projects and Discovery projects. These projects generated the highest number of publications. However, Discovery projects have a higher number of publications than Linkage projects.
To better understand the relationship between the quantity of scholarly output and funding amount, the analysis was conducted from the following three sections:
Total Number of Publications vs. Funding Amount
Funding Return on Productivity (Publication per Million Dollar) vs. Funding Amount
Funding Return on Productivity (Million Dollars per Publication) vs. Funding Amount

4.1. Total Number of Publications vs. Funding Amount

To measure the quantity of scholarly output, the total number of publications generated by a funded project is used for the analysis. The mathematical equation is presented as follows.
[ F u n d i n g R e t u r n p e r M i l l i o n D o l l a r ] = [ N u m b e r o f P u b l i c a t i o n s ] / [ F u n d i n g A m o u n t ( i n m i l l i o n ) ]
On average, five publications were generated for each closed project, with projects receiving an average of $437,720 AUD funding from 2009 to 2016. Using $100,000 increments, the number of publications from closed projects from 2009 to 2016 inclusive are plotted on a bar chart in Figure 5 to show the distribution of associated publications. From this graph, clear divisions emerge, allowing the funding amount to be grouped into three clusters. The first cluster ranges from 0.0 to 1.9 million dollars, the second cluster from 2.0 to 3.2 million dollars, and the remaining cluster groups funding over 3.2 million dollars. From Figure 5, it is evident that the second cluster funding levels from 2.0 to 3.2 million dollars generated the majority of publications, while the third cluster funding (levels above 3.2 million dollars) generated the least number of publications. This pattern matches with the inverse U-shaped effect from an earlier study (Spanos & Vonortas, 2012).
From Figure 5, there is no strong relationship between the number of publications and the funding amount as the number of publications varies with the growing funding amount. However, among the projects up to 1 million dollars in funding, the higher the funding goes, the more publications the project generates; however, there are exceptions to this rule.
To understand the difference between outputs for funded projects for the Discovery program and Linkage program, the number of publications based on different levels of funding amount is categorized and distributed on bar plots. From Figure 6, it is evident that funded projects over 3.2 million dollars are associated almost exclusively with Linkage projects, although the higher funded Linkage projects do not produce more publications than lower funded Linkage projects. Both the Discovery and Linkage projects with funding between 1 and 3.2 million dollars have dramatic changes in the number of publications in each level of funding amount, demonstrating that projects with similar funding amounts produce varying numbers of publications. For funded projects with less than 1 million, both Discovery projects and Linkage projects have an increasing number of publications.
From Figure 6, it is also evident that, for projects funded with less than 1 million dollars, Discovery projects result in more publications than Linkage projects, simply based on the total number of publications. The measure using the number of publications simply shows the total number of publications for different funding levels, but it does not show the productivity of each funding level. To compare the productivity of all fund levels, the funding return on productivity is analysed. The number of publications produced per million dollars is adopted to measure funding return productivity. The number of publications per million dollars is calculated using the number of publications produced per project and dividing this by the funding amount in million dollars for each project. On average, 12 publications were generated by each ARC-funded million dollars from 2009 to 2016.
To understand the disparities between research outputs for funded projects based on the research area by the FoR4D program, the number of publications categorized by either STEM or HASS is presented on bar plots according to different funding levels.
The analysis of Figure 7 reveals the number of HASS publications and STEM publications. Notably, as funding amounts increase, the difference in publication counts between these two project types tends to widen progressively. However, this trend is not applicable for the rest of the funding levels. A few HASS projects within the funding range of 1.5 to 3.2 million demonstrate visible prolific publication outputs, exceeding the productivity of STEM projects within a similar funding range. This could be caused by the number of funded HASS projects being higher than the number of STEM projects at the same funding level.

4.2. Funding Return on Productivity (Publication per Million Dollar) vs. Funding Amount

To visualize the calculated results across all funding levels, funding return by publication per million dollars based on funding amount per 100K are plotted for the two funding programs (Figure 8).
The most noticeable return is for funding amounts less than 100K (0.0–0.1 million) from Discovery projects, which is more than 5 fold higher than the other funding levels (within 1 million). As such, the results suggest that Discovery projects with funding less than 100K are the most successful projects in terms of producing outcomes through peer-reviewed journal publications. Additionally, projects with less than 200K funding from both Discovery and Linkage programs generated (on average) more than 25 publications per million dollars, resulting in higher productivity than any other funding level. In general, funding returns for projects of less than 2 million dollars are higher than projects with more than 2 million dollars. It can be concluded that the lower the funding level, the higher the productivity in terms of publications the project generates. This result contradicts the earlier research (Danthi et al., 2015) on general funding and special funding grants provided by the National Institute of Health in 2009, which may be attributed to discipline-specific issues and differences in selection criteria for the grants.
To visualize the calculated results for STEM/HASS projects across all funding levels, funding return by publication per million dollars based on funding amount per 100K are plotted for the two funding programs (Figure 9).
As demonstrated in prior research (Kulczycki et al., 2018), STEM projects generally produce a greater number of publications compared to HASS projects. Our study aligns with this pattern on the whole. However, notable exceptions are observed. Specifically, HASS projects receiving funding under 100K dollars, as well as a few HASS projects with substantial funding, stand out from the trend. Within the subset of projects funded under 100,000 dollars, the return on investment, measured by the number of publications per million dollars, is significantly higher for HASS projects than for STEM projects.

4.3. Funding Return on Productivity (Million Dollars per Publication) vs. Funding Amount

In the previous analysis, the funding return per million dollar is hardly observable for the projects exceeding 5 millions. To overcome this particular challenge, a second funding return algorithm—million dollars required to produce one publication—is used to demonstrate the relationship between funding return and funding amount. Million dollars per publication is calculated based on the funding amount in units of million dollars divided by the number of publications by each project. The mathematical equation is presented as follows.
[ F u n d i n g R e t u r n p e r P u b l i c a t i o n ] = [ F u n d i n g A m o u n t ( i n m i l l i o n ) ] / [ N u m b e r o f P u b l i c a t i o n s ]
The results of funding return (million dollars per publication) and funding amount categorized by funding categories are plotted in Figure 10.
In opposition to the data shown in Figure 8, projects with high funding and low publication yields become obvious in Figure 10. The projects with 50 million dollars in funding require the highest funding amount to produce one publication, indicating that those highly funded projects produce the lowest yields. To consider funding return by million dollars required to produce one publication further, only funding amounts less than and equal to 5 million dollars are plotted (Figure 11).
For funding levels less than 1 million dollars, there is steady growth in funding return, meaning the more funding a project gets, the higher the amount of funding that is required to produce one publication. However, in general, there is no relationship between funding amount and funding return in terms of number of publications. Two types of funding return analysis, including Publication per Million Dollar and Million Dollar per Publication, confirmed these results.
To understand the disparities in funding required per publication by research area, the results of funding return (million dollars per publication) and funding amount categorized by STEM/HASS are plotted in Figure 12.
Similarly to the analysis in the funding category analysis, in opposition to the data shown in Figure 9, projects with high funding and low publication yields become obvious in Figure 12. It can be concluded that highly funded projects produce the lowest yields, especially in a few STEM projects. To consider funding return by million dollars required to produce one publication further, only funding amounts less and equal to 5 million dollars are plotted (Figure 13).
Figure 13 allows us to visually observe the funding return per publication for the STEM/HASS projects with less than or equal to 5 million funding. For the low funded projects with less than 1 million dollars, there is steady growth in required funding for each publication for both STEM and HASS. Generally speaking, through this visual chart, STEM projects have higher productivity than the HASS projects in terms of required funding to produce one publication. However, there is no strong relationship between funding amount and funding return in terms of number of publications.
  • RQ2: What is the relationship between impact of scholarly output and funding amount?
To inspect the big picture, scatter plots are generated to demonstrate the relationship between the impact of scholarly output and the funding amount. The three scatter plots in Figure 14 show all funding levels, funding less than and equal to 5 million, and funding less than and equal to 1 million. The scatter plots are generated based on two categories, Discovery and Linkage. Throughout the entire funding levels, most of the impact are generated from the projects received funding around 3 millions dollars or less. More specifically, most of the impact is generated from the projects less than or equal to 1 million dollar. Although Discovery and Linkage projects within 1 million dollar funding generated high impact, Discovery projects in this funding level generated higher impact than Linkage projects.
To better understand the relationship between the impact of scholarly output and funding amount, the analysis was conducted from the following two sections:
  • CNCI vs. Funding Amount;
  • Highly Cited Status vs. Funding Amount.

4.4. CNCI vs. Funding Amount

The first measure of impact of scholarly output is CNCI. On average, each project with 437,720 AUD funding generated 88 CNCI from 2009 to 2016.
Based on the different levels of funding (using 100K increments), the CNCI values of publications from closed projects from 2009 to 2016 inclusive are shown in Figure 15 to demonstrate the distribution of publication impact. Based on the results of the impact on this graph, the funding amount can be grouped into three clusters. The first cluster ranges from 0.0 to 1.9 million dollars, the second cluster from 2.0 to 3.2 million dollars, and anything above 3.2 million dollars is assigned to the third cluster. From Figure 15, it is evident that the second cluster funding levels from 2.0 to 3.2 million dollars generated the highest impact, and the third cluster funding (levels above 3.2 million dollars) generated the lowest impact. These results align with those for publication productivity (Figure 5) and also match the inverse U-shaped effect noted in an earlier study (Spanos & Vonortas, 2012).
From Figure 15, there is no obvious pattern between CNCI of publications and funding amount. However, among the projects with less than 1 million funding, the higher funding, the higher the impact those publications generated.
To understand the difference between ARC Discovery and Linkage programs, the CNCI values based on different levels of funding amount were categorized by program type (Figure 16).
Figure 16 demonstrates that funding over 3.2 million dollars from Linkage projects produces substantially less impact than that for projects with lower funding. This result aligns with the quantity of scholarly output in Figure 5. Both findings can conclude that higher funded projects do not always generate a higher number of publications or higher impact.
Both Discovery and Linkage projects with funding between 1 and 3.2 million dollars have dramatic changes in CNCI in each level of funding amount. This indicates that projects with similar funding amounts produce various impacts, irrespective of research area. For funded projects with less than 1 million, both Discovery and Linkage projects show an increasing number of publications. It can be concluded that there is no strong relationship between CNCI and funding amount. However, for projects with less than 1 million dollars funding, the higher the funding amount, the more CNCI generated.
To understand the difference between STEM and HASS projects, the CNCI values based on different levels of funding amount were categorized by research area (Figure 17).
Based on the visualized chart (Figure 17), it can be observed from the big picture that the majority of impacts are oriented from STEM projects. Nevertheless, despite being in the minority, a few HASS projects have the potential to yield significant impacts in the academic realm.

4.5. Highly Cited Status vs. Funding Amount

The second measure of impact of scholarly output is the number of highly cited papers. To observe the distribution of highly cited papers, the highly cited papers from closed projects from 2009 to 2016 inclusive along different levels of funding amount (using 100K increments) are plotted (Figure 18).
From this graph, it can be concluded that there is no relationship between highly cited status and funding amount, with no trends evident in this data.
The analysis results from two measures using CNCI and Highly Cited Status indicate that there is no relationship between scholarly impact and funding amount. To further analyse the relationship between scholarly impact and funding amount, the funding return on impact is included in this study. The results of CNCI produced per million dollars are adopted to measure funding return on impact. Funding Return on impact per million dollar is calculated using the sum of CNCI of all publications and dividing by the funding amount in million dollars for each project. On average, 202 CNCI scores were generated from each million dollar from 2009 to 2016.
To observe the distribution of highly cited papers for STEM/HASS, the highly cited papers from closed projects from 2009 to 2016 inclusive are plotted (Figure 19). From this graph, it can be detected that there is no relationship between highly cited status and funding amount for STEM/HASS, with no trends evident in this data. Therefore, it can be concluded that highly cited papers are not correlated with the amount of funding received.

4.6. Funding Return on Impact (CNCI per Million Dollar) vs. Funding Amount

To observe the return on impact across all funding levels, funding return on impact per million dollars based on funding amount by 100K is considered, categorized by funding program, in Figure 20. The most noticeable return is from funding amount less than 100K (0.0–0.1 million), with more than double that for any other funding levels, and for other funding levels within 1 million, return on productivity is more than 5 fold higher (Figure 20).
Thus, it can be concluded that funding less than 100K is the most successful in terms of producing publications and generating impact than any other funding levels. This result contradicts the research conclusion from Győrffy et al. (2020), who indicated that large funding levels leads to higher impact. Despite this, funded projects between 100K and 1 million demonstrated high variability such that it can be concluded that there is no strong relationship between funding returns on impact and funding amount. For funded projects between 1 and 3.2 million, the number of publications produced per million dollars is low compared to funded projects less than 1 million, and for funding levels over 3.2 million, it is hard to visually detect any pattern from Figure 20 due to the low number of publications.
In summary, the two measures, namely CNCI and High Cited Status, considered in terms of analysis of funding return on impact (CNCI per Million Dollar) show that there is no strong relationship between the scholarly impact and funding amount.
To observe the return on impact categorized by STEM/HASS, funding returns on impact per million dollars categorized by research area are plotted in Figure 21.
Through this analysis, the most noticeable return in Figure 21 is also from funding amount less than 100K (0.0–0.1 million), with more than double that of any other funding levels, for both research areas in STEM and HASS. For both STEM and HASS projects, there is a trend where the impact per mission dollar decreases as the funding increases, limited within the range of 1.0 million dollar funding. Furthermore, it is noteworthy that a few highly funded HASS projects have yielded impacts higher than the average.

5. Conclusions

This study provides a comprehensive project-level bibliometric assessment of scholarly output and return on investment (ROI) associated with Australian Research Council (ARC) funding between 2009 and 2016. Across both Discovery and Linkage programs, the results show no strong or systematic relationship between funding amount and either publication volume or citation impact. Instead, research productivity and impact vary substantially among projects with similar funding levels. Notably, projects receiving less than AUD 100,000 consistently demonstrate the highest returns on investment in terms of both publication productivity and normalized citation impact. While STEM projects exhibit higher average productivity and impact overall, a subset of HASS projects achieves exceptionally high efficiency relative to funding received.
This study focuses exclusively on ARC-funded projects that can be linked to journal publications through funding acknowledgements. Projects whose outputs are not captured in bibliographic databases or whose publications do not consistently report funding information are not included in the analysis. This limitation should be considered when generalising the findings beyond journal-based scholarly outputs.
Through our analysis and comparisons, some interesting phenomena are identified that may or may not be limited within ARC-funded projects. Over the time frame from 2009 to 2016, there were on average five publications produced from each closed project within the Discovery and Linkage projects. In most cases, funded Discovery projects resulted in more articles than Linkage projects. Categorizing all projects into three clusters by the funding amount, 0.0–1.9 million, 2.0–3.2 million, and 3.2+ million, it was observed that, in general, projects awarded 2.0–3.2 million dollars in grant funding generated the highest number of publications. An inverse U-shaped pattern in the number of publications was noted, matching results from a previous study (Spanos & Vonortas, 2012). However, no strong relationship between publication productivity and funding amount for projects with smaller funding amounts awarded was observed.
We identified no evident connection between publication productivity and funding level; however, the analysis presented in this paper does produce some other interesting results. For funding amounts less than 1 million dollars, as project funding increases, the more publications the project produces. Analysing return on investment for the projects at this funding level, there is a consistent and gradually increasing pattern in funding returns. This also implies that as the project receives greater funding, the corresponding amount of funding associated with generating a single publication increases. This trend applies to both Discovery projects and Linkage projects and to both STEM and HASS projects and suggests a negative return on investment mechanism is at play. Across all funding levels considered in this study, the maximum return on investment projects were associated with the Discovery research funding program and grants with less than 100K of awarded funding, which produces the highest yields in terms of publication productivity per million dollars. Specifically, this funding scheme and level produces approximately 150 publications per million dollar investment. STEM projects typically produce a greater number of publications than HASS projects. Our study generally fits this pattern. However, notable exceptions have been observed. Specifically, HASS projects that received funding under 100K and a handful of HASS projects that received substantial funding stood out from this trend. In the subset of projects funded under 100K, HASS projects had significantly higher ROIs (measured as publications per million dollars) than STEM projects. Another interesting result occurs with Linkage projects and project funding exceeding 5 million dollars, which produce substantially fewer publications compared to projects with lower funding. This may be attributed to the industry-linked nature of the funding scheme, and the propensity for funded projects to generate outputs other than scholarly work, such as patents, industry and/or government reports, and applied innovations. This result does however signal a need for more nuanced approaches to measuring research funding return on investment and impact, noting though that to be effective, this also needs to extend to how the productivity of academics and researchers is measured and accounted for from a career enhancement perspective. It is important to interpret the differences between STEM and HASS disciplines with caution. Bibliometric data derived from Web of Science may underrepresent certain forms of scholarly output common in HASS fields, such as monographs and regional journals. Consequently, citation-based metrics may not fully reflect the broader scholarly and societal contributions of HASS research.
From the perspective of measures, in this study, two types of citation metrics, CNCI and highly cited status, are taken into account during the analysis to measure scholarly impact. From our analysis, there is no obvious connection between the funding amount and the scholarly impact across all funding levels. Much of the impact comes from STEM programs. Nonetheless, while a handful of HASS projects have the potential to have a significant impact in the academic space. Upon closer examination of the particulars, an intriguing phenomena emerged within projects with funding totalling less than one million dollars. In the scope of this investment bracket, the higher funding is, the higher impact the publications generated in terms of citation-metrics-based scholarly impact.
While useful insights have emerged from this study, the methodology employed in this work is not without limitations. Firstly, the publications used to measure the scholarly output are extracted from only WoS, potentially missing some outputs. Additionally, while it is expected that publications produced as a result of an ARC-funded project will reference the funding scheme, omissions or errors in recording ARC funding numbers cannot be ruled out. In these cases, publications are identified as having received funding from ARC; however, these publications do not include the corresponding ARC funding reference number and thus could not be included in this study.
This study focuses on ARC-funded projects between 2009 and 2016 in order to mitigate issues associated with publication lag and citation accumulation. A considerable time window is required to ensure that research outputs resulting from funded projects have sufficient opportunity to be published and cited. However, it is important to acknowledge that the Australian research policy landscape has evolved in recent years, particularly with the introduction of the ARC Engagement and Impact Assessment Pilot in 2018. This initiative expanded the evaluation of research performance beyond traditional scholarly metrics to include broader societal, policy, and industry impacts. As a result, contemporary research outputs increasingly include policy reports, industry collaborations, and other non-academic contributions that may not be captured by citation-based metrics. Therefore, while this study provides insights into the scholarly publication outcomes of ARC-funded research, it does not capture the broader spectrum of research impact that has become increasingly important in recent years.
Furthermore, citation metrics are not the only mechanism for measuring scholarly and research impact, and thus, broader measures of impact such as policy contributions or patents are not captured. Despite these limitations, through our literature review, the dataset we utilized for our study comprising 13,880 funded projects represents one of the most extensive collections of research output and research impact studies within a single funding agency available. Moreover, it is important to note that the analysis in this study is exclusively limited to the publications funded by ARC. The publications not funded by ARC were not taken into consideration in this study.
From the results, it can be concluded that the most successful ARC projects, in terms of the quantity and impact of scholarly output, are Discovery projects with less than 1 million dollars in investment. This indicates that comparatively modestly funded projects yield substantial scholarly output and have a noteworthy scholarly impact and thus may be leveraged for optimal research impact of government funding schemes such as the ARC in Australia. While the work presented here provides an extensive analysis of the correlations between scholarly productivity and research funding amounts, there are opportunities for further exploration. These include but are not limited to, attributes such as the correlation between team size, professorial involvement, and institutional collaborations as a function of funding amount. Lastly, the work provided here provides an approach for a more holistic consideration of impact and return on investment for research grant scheme administrators.
This study focuses exclusively on academic outputs arising from ARC-funded projects. Comparative analyses involving projects supported by alternative funding sources remain a promising direction for future research. Moreover, consistent with the descriptive benchmarking orientation of this study, future work could build on these findings by employing multivariate or quasi-experimental approaches to further examine robustness and potential causal mechanisms underlying the observed patterns.

Author Contributions

Conceptualization, K.B.; Introduction, S.S.; Literature Review, X.G.; Methodology, X.G.; Data Analysis, X.G.; Visualization, X.G.; Results, X.G.; Conclusion, K.B.; Supervision, K.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

ARC funding datasets are publicly available from the Australian Research Council website. Derived bibliometric datasets generated during this study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors have no relevant financial or non-financial interests to disclose. The authors have no competing interests to declare that are relevant to the content of this article. All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript. The authors have no financial or proprietary interests in any material discussed in this article.

References

  1. Aagaard, K., Kladakis, A., & Nielsen, M. W. (2020). Concentration or dispersal of research funding? Quantitative Science Studies, 1(1), 117–149. [Google Scholar] [CrossRef]
  2. Australian Research Council. (2012). Research impact principles and framework. Available online: https://www.arc.gov.au/policies-strategies/strategy/research-impact-principles-framework (accessed on 1 March 2021).
  3. Australian Research Council. (2021a). ARC funding outcome—grants dataset. Available online: https://www.arc.gov.au/funding-research/funding-outcome/grants-dataset (accessed on 1 March 2021).
  4. Australian Research Council. (2021b). ARC grants search. Available online: https://dataportal.arc.gov.au/NCGP/Web/Grant/Grants (accessed on 1 March 2021).
  5. Australian Research Council. (2021c). Selection output report. Available online: https://www.arc.gov.au/funding-research/funding-outcomes/selection-outcome-reports (accessed on 1 March 2021).
  6. Bentley, P. J., Gulbrandsen, M., & Kyvik, S. (2015). The relationship between basic and applied research in universities. Higher Education, 70, 689–709. [Google Scholar] [CrossRef]
  7. Bloch, C., Schneider, J. W., & Sinkjær, T. (2016). Size, accumulation and performance for research grants: Examining the role of size for centres of excellence. PLoS ONE, 11(2), e0147726. [Google Scholar] [CrossRef] [PubMed]
  8. Bromham, L., Dinnage, R., & Hua, X. (2016). Interdisciplinary research has consistently lower funding success. Nature, 534(7609), 684–687. [Google Scholar] [CrossRef] [PubMed]
  9. Brooks, R. D., & Byrne, J. (2006). A citation analysis of ARC discovery and linkage grant investigators in economics and finance. Applied Economics Letters, 13(3), 141–146. [Google Scholar] [CrossRef]
  10. Carr, R. M., Lane-Fall, M. B., South, E., Brady, D., Momplaisir, F., Guerra, C. E., Montoya-Williams, D., Dalembert, G., Lavizzo-Mourey, R., & Hamilton, R. (2021). Academic careers and the COVID-19 pandemic: Reversing the tide. Science Translational Medicine, 13(584), eabe7189. [Google Scholar] [CrossRef] [PubMed]
  11. Clarivate. (2021a). InCites. Available online: https://access.clarivate.com/login?app=incites (accessed on 1 March 2021).
  12. Clarivate. (2021b). Web of science. Available online: http://www.webofscience.com/ (accessed on 1 March 2021).
  13. Danthi, N. S., Wu, C. O., DiMichele, D. M., Hoots, W. K., & Lauer, M. S. (2015). Citation impact of NHLBI R01 grants funded through the American Recovery and Reinvestment Act as compared to R01 grants funded through a standard payline. Circulation Research, 116(5), 784–788. [Google Scholar] [CrossRef] [PubMed]
  14. Esquivel, A., Marincean, S., & Benore, M. (2023). The effect of the COVID-19 pandemic on STEM faculty: Productivity and work-life balance. PLoS ONE, 18(1), e0280581. [Google Scholar] [CrossRef] [PubMed]
  15. Gök, A., Rigby, J., & Shapira, P. (2016). The impact of research funding on scientific outputs: Evidence from six smaller European countries. Journal of the Association for Information Science and Technology, 67(3), 715–730. [Google Scholar] [CrossRef]
  16. Győrffy, B., Herman, P., & Szabó, I. (2020). Research funding: Past performance is a stronger predictor of future scientific output than reviewer scores. Journal of Informetrics, 14(3), 101050. [Google Scholar] [CrossRef]
  17. Harper, L., Kalfa, N., Beckers, G., Kaefer, M., Nieuwhof-Leppink, A. J., Fossum, M., Herbst, K. W., Bagli, D., & ESPU Research Committee. (2020). The impact of COVID-19 on research. Journal of Pediatric Urology, 16(5), 715. [Google Scholar] [CrossRef] [PubMed]
  18. Jowkar, A., Didegah, F., & Gazni, A. (2011). The effect of funding on academic research impact: A case study of Iranian publications. In Aslib proceedings (Vol. 63, pp. 593–602). Emerald Group Publishing Limited. [Google Scholar]
  19. Jung, H., Seo, I., Kim, J., & Kim, B.-K. (2017). Factors affecting government-funded research quality. Asian Journal of Technology Innovation, 25(3), 447–469. [Google Scholar] [CrossRef]
  20. Kulczycki, E., Engels, T. C., Pölönen, J., Bruun, K., Dušková, M., Guns, R., Nowotniak, R., Petr, M., Sivertsen, G., Istenič Starčič, A., & Zuccala, A. (2018). Publication patterns in the social sciences and humanities: Evidence from eight European countries. Scientometrics, 116, 463–486. [Google Scholar] [CrossRef]
  21. Lauer, M., Roychowdhury, D., Patel, K., Walsh, R., & Pearson, K. (2017). Marginal returns and levels of research grant support among scientists supported by the national institutes of health. BioRxiv. [Google Scholar] [CrossRef]
  22. Melchiorsen, P. M. (2019). Bibliometric differences—A case study in bibliometric evaluation across SSH and STEM. Journal of Documentation, 75(2), 366–378. [Google Scholar] [CrossRef]
  23. Rafols, I., Leydesdorff, L., O’Hare, A., Nightingale, P., & Stirling, A. (2012). How journal rankings can suppress interdisciplinary research: A comparison between innovation studies and business & management. Research Policy, 41(7), 1262–1282. [Google Scholar] [CrossRef]
  24. Riccaboni, M., & Verginer, L. (2022). The impact of the COVID-19 pandemic on scientific research in the life sciences. PLoS ONE, 17(2), e0263001. [Google Scholar] [CrossRef] [PubMed]
  25. Scopus. (2021). Scopus. Available online: https://www.scopus.com/ (accessed on 1 March 2021).
  26. Spanos, Y. E., & Vonortas, N. S. (2012). Scale and performance in publicly funded collaborative research and development. R&D Management, 42(5), 494–513. [Google Scholar] [CrossRef]
  27. Yan, E., Wu, C., & Song, M. (2018). The funding factor: A cross-disciplinary examination of the association between research funding and citation impact. Scientometrics, 115, 369–384. [Google Scholar] [CrossRef]
Figure 1. Data collection and consolidation process.
Figure 1. Data collection and consolidation process.
Publications 14 00022 g001
Figure 2. Annual number of funded projects from 2002 to 2019. Pink bars denote the total number of projects, whereas green bars represent the subset of projects that generated publications.
Figure 2. Annual number of funded projects from 2002 to 2019. Pink bars denote the total number of projects, whereas green bars represent the subset of projects that generated publications.
Publications 14 00022 g002
Figure 3. Correlation heatmap.
Figure 3. Correlation heatmap.
Publications 14 00022 g003
Figure 4. Scatter plot of number of publications vs. funding amount.
Figure 4. Scatter plot of number of publications vs. funding amount.
Publications 14 00022 g004
Figure 5. Number of publications vs. funding amount from 2009 to 2016.
Figure 5. Number of publications vs. funding amount from 2009 to 2016.
Publications 14 00022 g005
Figure 6. Number of publications vs. funding amount categorized by funding program from 2009 to 2016.
Figure 6. Number of publications vs. funding amount categorized by funding program from 2009 to 2016.
Publications 14 00022 g006
Figure 7. Number of publications vs. funding amount categorized by STEM/HASS from 2009 to 2016.
Figure 7. Number of publications vs. funding amount categorized by STEM/HASS from 2009 to 2016.
Publications 14 00022 g007
Figure 8. Funding return (publication per million dollars) vs. funding amount categorized by funding program from 2009 to 2016.
Figure 8. Funding return (publication per million dollars) vs. funding amount categorized by funding program from 2009 to 2016.
Publications 14 00022 g008
Figure 9. Funding return (publication per million dollars) vs. funding amount categorized by STEM/HASS from 2009 to 2016.
Figure 9. Funding return (publication per million dollars) vs. funding amount categorized by STEM/HASS from 2009 to 2016.
Publications 14 00022 g009
Figure 10. Funding return (million dollars per publication) vs. funding amount categorized by funding program from 2009 to 2016.
Figure 10. Funding return (million dollars per publication) vs. funding amount categorized by funding program from 2009 to 2016.
Publications 14 00022 g010
Figure 11. Funding return (million dollars per publication) vs. funding amount <= 5 million categorized by funding categories from 2009 to 2016.
Figure 11. Funding return (million dollars per publication) vs. funding amount <= 5 million categorized by funding categories from 2009 to 2016.
Publications 14 00022 g011
Figure 12. Funding return (million dollars per publication) vs. funding amount categorized by STEM/HASS from 2009 to 2016.
Figure 12. Funding return (million dollars per publication) vs. funding amount categorized by STEM/HASS from 2009 to 2016.
Publications 14 00022 g012
Figure 13. Funding return (million dollars per publication) vs. funding amount <= 5 million categorized by STEM/HASS from 2009 to 2016.
Figure 13. Funding return (million dollars per publication) vs. funding amount <= 5 million categorized by STEM/HASS from 2009 to 2016.
Publications 14 00022 g013
Figure 14. Scatter plot of number of publications vs. funding amount.
Figure 14. Scatter plot of number of publications vs. funding amount.
Publications 14 00022 g014
Figure 15. CNCI vs. funding amount from 2009 to 2016.
Figure 15. CNCI vs. funding amount from 2009 to 2016.
Publications 14 00022 g015
Figure 16. CNCI vs. funding amount categorized by funding program from 2009 to 2016.
Figure 16. CNCI vs. funding amount categorized by funding program from 2009 to 2016.
Publications 14 00022 g016
Figure 17. CNCI vs. funding amount categorized by STEM/HASS from 2009 to 2016.
Figure 17. CNCI vs. funding amount categorized by STEM/HASS from 2009 to 2016.
Publications 14 00022 g017
Figure 18. Number of highly cited papers vs. funding amount categorized by funding program from 2009 to 2016.
Figure 18. Number of highly cited papers vs. funding amount categorized by funding program from 2009 to 2016.
Publications 14 00022 g018
Figure 19. Number of highly cited papers vs. funding amount categorized by SETM/HASS 2009 to 2016.
Figure 19. Number of highly cited papers vs. funding amount categorized by SETM/HASS 2009 to 2016.
Publications 14 00022 g019
Figure 20. Funding return (CNCI per million dollar) vs. funding amount categorized by funding programs from 2009 to 2016.
Figure 20. Funding return (CNCI per million dollar) vs. funding amount categorized by funding programs from 2009 to 2016.
Publications 14 00022 g020
Figure 21. Funding return (CNCI per million dollar) vs. funding amount categorized by STEM/HASS from 2009 to 2016.
Figure 21. Funding return (CNCI per million dollar) vs. funding amount categorized by STEM/HASS from 2009 to 2016.
Publications 14 00022 g021
Table 1. Prior studies.
Table 1. Prior studies.
Prior StudyCountry StudiedTime PeriodFunding Context
Spanos and Vonortas (2012)Multi countries across Europe2000s to early 2010sEuropean Union publicly funded collaborative R&D programmes
Bloch et al. (2016)Denmark1993–2007Danish National Research Foundation
Gök et al. (2016)Belgium, Denmark, Netherlands, Norway, Switzerland, Sweden2008–mid 2010sNational research councils, European funding sources, and others within six countries
Jowkar et al. (2011)Iran2000–2009Funded vs. non-funded Iranian research outputs
Danthi et al. (2015)United States2009–2014.05Two funding mechanisms for NIH R01 grants
Lauer et al. (2017)United States1996 to 2014National Institutes of Health Funds
Győrffy et al. (2020)Hungary2006–2015Hungarian Scientific Research Funds
Aagaard et al. (2020)Many nations1980s–2010sResearch funding allocation patterns
Jung et al. (2017)South KoreaMid 2010sGovernment-funded research in Korea
Bromham et al. (2016)Australia2010–2014Australian Research Council Discovery Programme
Rafols et al. (2012)United Kingdomlate 2000s early 2010sEvaluation environment and assessment incentives under the UK research system
Yan et al. (2018)Spain2010–2014Research funding acknowledgements in seven STEMM fields
Table 2. Prior studies on correlation between research funding and scholarly output.
Table 2. Prior studies on correlation between research funding and scholarly output.
Prior StudyFocus of the StudyResults
Spanos and Vonortas (2012)Role of project scale (team, budget) on performance dimensionsInverse U-shaped effect of team size on networking impacts and U-shaped effect of budget on goal achievement
Bloch et al. (2016)Relation between grant size of COEs and the research performanceResearch performance increases with grant size over time
Gök et al. (2016)Role of research funding on citation impact of publicationsFunding relates to number of citations and top percentile citation impact
Jowkar et al. (2011)Citation impact of funded and unfunded publications in 22 subject fieldsCitation impact of funded publications is higher in all fields
Danthi et al. (2015)Comparison of citation impacts of two types of funded grantsThe normalised citation impacts per $1 million spent for both grants are similar irrespective of project budgets
Lauer et al. (2017)Association of grant support with research output of researchersDecreasing marginal research returns with increase in funding support
Győrffy et al. (2020)Relationship between proposal review score and research outputInstead of proposal review score, scientometric characteristics of applying PI effects on research output
Aagaard et al. (2020)Benefits and drawbacks of concentrating research fundsStrong support for smaller research funding resulting in increased dispersal of funds
Jung et al. (2017)Impact of funding on research qualityMethod to measure research quality influences the results
Bromham et al. (2016)Success rate of research proposals spanning multiple disciplinesThe degree of interdisciplinarity negatively impacts the probability of being funded
Rafols et al. (2012)Research evaluation method for mono and multidisciplinary researchJournal ranking-based research evaluation favors mono-disciplinary research only
Yan et al. (2018)Association among funding and citation impactFunding amount, number of authors, and number of institutions positively influenced citation impact
Table 3. Projects in funding amount categories (millions) from 2009 to 2016.
Table 3. Projects in funding amount categories (millions) from 2009 to 2016.
Funding AmountDiscoveryLinkageSTEMHASSNot SpecifiedCount
Below 1 million279810,3587831251897560
1–2 million461068814460
2–3 million14563915242
3–4 million325232022
4–5 million000000
Over 5 million202015230
Table 4. Projects in funding amount categories (100K) from 2009 to 2016.
Table 4. Projects in funding amount categories (100K) from 2009 to 2016.
Funding AmountDiscoveryLinkageSTEMHASSNot SpecifiedCount
0 + K4454293874483874
100 + K968730101916781698
200 + K2140698232145132838
300 + K1985394197504042379
400 + K4852536330105738
500 + K4121514520111563
600 + K575785280125653
700 + K39047364073437
800 + K16018152026178
900 + K000000
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Blackmore, K.; Gu, X.; Sohail, S. Quantitative Assessment of Scholarly Output and ROI in ARC-Funded Australian Research. Publications 2026, 14, 22. https://doi.org/10.3390/publications14020022

AMA Style

Blackmore K, Gu X, Sohail S. Quantitative Assessment of Scholarly Output and ROI in ARC-Funded Australian Research. Publications. 2026; 14(2):22. https://doi.org/10.3390/publications14020022

Chicago/Turabian Style

Blackmore, Karen, Xin Gu, and Shaleeza Sohail. 2026. "Quantitative Assessment of Scholarly Output and ROI in ARC-Funded Australian Research" Publications 14, no. 2: 22. https://doi.org/10.3390/publications14020022

APA Style

Blackmore, K., Gu, X., & Sohail, S. (2026). Quantitative Assessment of Scholarly Output and ROI in ARC-Funded Australian Research. Publications, 14(2), 22. https://doi.org/10.3390/publications14020022

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop