Responsible Research and Innovation in Enterprises: Benefits, Barriers and the Problem of Assessment

Abstract

In the paper, the author takes stock of the conceptual reflection and empirical studies described in the current scientific literature on responsible innovation in the context of the emergence of the Responsible Research and Innovation (RRI) concept. RRI has been promoted in the European Union as a part of the Europe 2020 strategy with the objective of making research and innovation more sustainable and inclusive. As more than half of the EU’s firms declare they are conducting innovation activities, RRI problems are more relevant than ever. There remain many open questions, unresolved dilemmas and empirical white spots that call for more research in this field. This paper’s focus is the problem of RRI acceptance as a global framework for responsible innovation and the scarcity of suitable instruments that may help industries understand and adopt this concept. The main contributions of this paper include critical analysis of the RRI concept and its implications for industry, proposing a concept of an RRI index for innovating enterprises.

1. Introduction

Responsible Research and Innovation (RRI) is an emerging framework for governing the R&D activity and innovation in both the public and private sectors. It is considered to be “the ongoing process of aligning research and innovation to societal values, needs and expectations” [1]. It has been promoted in the European Union as a part of the Europe 2020 strategy with the objective of making research and innovation more sustainable and inclusive. Von Schomberg’s seminal definition states that:

Responsible Research and Innovation is a transparent, interactive process by which societal actors and innovators become mutually responsive to each other with a view to the (ethical) acceptability, sustainability and societal desirability of the innovation process and its marketable products (in order to allow a proper embedding of scientific and technological advances in our society) [2].

In recent years, a significant number of research projects and industry-oriented initiatives have attempted to address RRI from different angles, in different geographical areas and with different methods.

There remain many open questions, unresolved dilemmas and empirical white spots that call for more research in this field [3]. As more than half of the EU’s firms declare they are conducting innovation activities [4], RRI problems have become more relevant than ever. This paper’s main focus is the problem of RRI acceptance as a global framework for responsible innovation and the scarcity of suitable instruments that may help industries understand and adopt this concept.

In the first part of this work, the author analyses the current scientific discourse on RRI. Bibliometric analysis is carried out together with a critical analysis of most common RRI-related subjects, lines of thought, and methodologies. The critical analysis approach is also used in the second part in which the issue of RRI costs and benefits are synthesized and discussed. Next, the problematic of RRI assessment is presented and deconstructed. Various approaches to measuring RRI in public and private entities are discussed. The paper concludes with a discussion of the results, identification of the limitations of the study, and suggestions for the possible future research directions.

2. Responsible Research and Innovation—Overview of Current Discourse

Scientific production on the topic of RRI has been steadily increasing since 2009—the year of publication of Robinson’s important work that used the term “responsible research and innovation” for the first time [5]. The same may be said about the diffusion of the concept in non-academic sources. Media intelligence tools that analyze public news items online suggest a steady societal uptake of RRI from 2010 to 2017; however, the absolute numbers of news items with the term “responsible research and innovation” are not impressive (356 news items globally in 2017) [6].

Query in the Scopus database on the documents that contain phrases “responsible research and innovation” or “responsible innovation” in their title, abstract or keywords, returned 841 documents (mostly articles, conference papers and book chapters; including 127 papers from the Journal of Responsible Innovation) published between 2009 and 2019. A clear growing tendency in the number of published documents may be observed; however, the tendency seems to slow down, as shown in Figure 1.

The slowdown is a new observation compared to previous analyses of this kind by Cuppen, van de Grift and Pesch [7] Timmermans [8] and Nazarko [9]. It remains to be seen if the slowdown constitutes a definite break in the sharp upward trend registered so far or if it is only temporary. Some of Timmermans’ conclusion in his mapping study [8] provide an argument for the former hypothesis. He observes that most of the RRI related activities took place in Western Europe and were funded by the European Union or public institutions in Western European member states. More than 100 million EUR from the Horizon 2020 Framework Program (2014–2020) was spent on more than 40 projects that dealt explicitly with RRI [9]. It should be noted, however, that customizing and contextualizing of RRI has been taking place in many (if not all) H2020 program lines, without necessarily mentioning the term RRI (terms such as broader impacts criterion, value-sensitive design, technology acceptance, social-technological alignment, ethical impact assessment, human readiness level, social implications of technology, stage-gate system, upstream engagement, etc., were used instead). The living lab and comparative evaluation approach developed in the framework of the NewHoRRIzon project sought to recognize and invent RRI relevance in many different sections of H2020 to provide a systematic approach for addressing complex social challenges related to RRI [10].

Since the RRI-related activity may not be motivated by a market demand of Research and Innovation (R&I) milieu, but rather has been pushed by policy-makers [8], the future extent of RRI-related scientific production is heavily dependent on the available public funding for RRI activities. As the EU funding cycle within its Framework Program for Research and Technological Development (Horizon 2020) is coming to an end, the number of RRI-related documents generated as the results of the H2020 projects is going down. For the time being, the EU planning documents for the next Framework Program (Horizon Europe, 2021–2027) do not mention RRI explicitly and do not foresee a separate funding stream similar to the current “Science with and for Society” (SwafS) program. There seems to be more emphasis on excellence rather than on responsibility [11]. Strategic implementation of RRI in future R&I policy at the EU level remains uncertain [1]. Such developments may herald stagnation in the research work on RRI unless the industry significantly increases its interest and involvement, which has not happened so far (only 12.5% of consortia members in RRI-related projects were for-profit organizations [9]). Owen and Pansera [12] also admit that RRI faces an uncertain future as an EU policy agenda. They take into account the possible shift in the framing of RRI toward relating it to the ’3 Os’: Open Innovation [13,14], Open Science and Openness to the world [15]. Indeed, a more explicit connection to the Open Innovation paradigm that envisages the creative interaction of business [16], industry, government and civil society in a quadruple helix [17], and offers some practical tools [18], may be a remedy for a low uptake of the RRI concept in industries.

Moving from the quantitative to the qualitative dimension, several categories of topics may be distinguished by analyzing the keywords of the RRI-related documents indexed by Scopus. Visualization with VOSviewer has resulted in the identification of eight clusters of terms that co-occur most frequently (Figure 2). The clusters (labelled with different colors in Figure 2), however, are neither internally coherent nor qualitatively distinctive. It is, therefore, necessary to decompose the set of the most frequent keywords and make an attempt to form distinctive thematic categories based on substance and not on the co-occurrence.

Thematic analysis of keywords in RRI related literature resulted in the identification of 9 categories of topics. The categories are named in

Table 1. Thematic categories of RRI-related literature.

	Category	Keywords
1	Epistemological foundations of RRI	values, Grand Challenges, ethics, human rights
2	Concepts and frameworks related to RRI	Corporate Social Responsibility, sustainability, sustainable development, social responsibility, value-sensitive design
3	Discussion on RRI principles	responsiveness, anticipation, participation, engagement
4	Analysis of RRI as a policy framework	research policy, anticipatory governance, participation and science governance, governance, innovation policy, science policy
5	Conceptualizing entrepreneurship and innovation in line with RRI principles	entrepreneurship, social entrepreneurship, social innovation, open innovation
6	Sectoral approach to RRI	industry, emerging technologies, nanotechnology, artificial intelligence, big data, human brain project, ICT, synthetic biology, technology
7	Educational and participatory aspect of RRI	science communication, public engagement, science education, stakeholder engagement, citizen science, science and society, stakeholders
8	Tools and methods for RRI	foresight, technology assessment, risk assessment
9	Institutional origin and source of funding	Horizon 2020

. Relevant terms are assigned to categories (including terms that have been omitted in Figure 1 for the sake of clarity).

The obtained categories reveal the dominance of theoretical and conceptual themes in the RRI literature. A bulk of papers and book chapters concern the epistemological foundations of RRI together with many dilemmas, ambiguities and contradictions. Much attention is also devoted to localizing RRI among more established concepts, such as Corporate Social Responsibility or sustainability. RRI principles [19] and RRI policy agendas are discussed against that epistemological and conceptual background. Moreover, RRI evokes new voices with regards to the (re)conceptualization of entrepreneurship and innovation. A considerable section of the works deals with RRI agendas for particular technologies and innovation spheres. Public engagement and science education topics are also prominent. Finally, the European Union (more specifically, Horizon 2020 Framework Program) is mentioned frequently, which is an indication of the policy-push evident in the current discourse. Generally, the works are conceptual rather than practical and process-oriented rather than outcome-oriented, which corresponds with the findings of Cuppen, van de Grift and Pesch [7] and Timmermans [8].

3. Promised Benefits and Criticism of RRI

RRI remains a concept and a policy framework connected to the selected funding streams in the European Union. As such, it has not been translated into new regulatory measures at the level of particular countries. A unified, comprehensive international regulatory framework related to RRI does not seem viable in the foreseeable future. Thus, the uptake of the RRI is dependent on the effective communication of the advantages that may accompany its broad adoption. Such is the approach adopted in the US in the framework of the Socio-Technical Integration Research (STIR) project that aimed at encouraging and equipping innovators with tools to reflect more deeply and creatively on societal aspects of their work [20].

In

Table 2. RRI principles and promised benefits.

	RRI Principle	Promised Benefits
1	Anticipation	Awareness of possible future legislation Increased foresight competences and better risk management “First mover” advantage
2	Reflexivity	Higher quality of innovation outcomes due to third-party critical appraisal Higher probability of innovation success
3	Transparency	Better ability to interpret available information thanks to the culture of sharing knowledge Higher effectiveness and efficiency of collaboration initiatives Better ability to match social expectations
4	Responsiveness	Increased trust from customers Improved corporate image and increased public trust in offered goods Better insight into needs and preferences of customers

Source: own elaboration on the basis of [21,22,23,24,25,26,27,28].

and

Table 3. RRI criticism and identified barriers to its implementation.

	Problematic Issue	Implications for Innovating Organizations
1	RRI concept under constant development; different views and understandings of RRI framework in the literature	Indifference towards the RRI idea Little comprehension of the notion of RRI
2	Western Eurocentrism of the RRI concept	Little chance of buy-in at the global level Regulatory and cultural differences between countries even within EU
3	No clear “division of labor” in the sphere of responsibility in the innovation activity as a consequence of the “shared responsibility” [29] or “meta-responsibility” [30] concepts	No clear indication of what is actually expected and at what stage from innovating businesses
4	Tension between “excellence” and “responsibility” both in science and business	Treating all activities related to RRI as an additional burden that makes innovation more costly and time consuming
5	Insistence on transparency and open access	Corporate strategies of intellectual property management not aligned with the open access paradigm
6	Shortage of understandable and easy-to-use tools to measure responsible innovation in business	Little interest in filling out long surveys and exhausting self-reflection forms

Source: own elaboration on the basis of [21,31,32].

, a synthesis of the current discussion on both benefits and problems related to the implementation of RRI in enterprises are presented.

4. Towards an RRI index for Innovating Organizations

4.1. One RRI Index Does Not Fit All

When attempting to compile metrics and indicators or to design indices that allow the comparison of different units from the perspective of RRI, the following facts become apparent.

Firstly, separation of “research” and “innovation” within the RRI concept seems appropriate since these two terms may be ascribed to different phenomena/processes with different actors involved [22,33]. “Research”, as it is normally described in RRI literature, belongs to universities, laboratories, research institutes and research funding agencies. Research, in this sense, is associated with the production of new knowledge, often on the basis of public funding. “Innovation”, in turn, is a process of turning existing or new knowledge into a marketable good, improved process, or organizational arrangement. It is mostly associated with market context and the for-profit activity. In consequence, it is more suitable to speak about Responsible Research in the context of public institutions and Responsible Innovation (RI) in the corporate/industrial context. This is not to say that research entities do not innovate or that the private sector does not conduct research; however, the above distinction is helpful in making sense of differences between R&I in the non-profit/public and for-profit contexts. Such delineation may also be observed in the recent work by von Schomberg [34] in which he drafts two separate models of step-up processes for ’good’ open research and ’good’ open innovation (three steps: credible—responsive—responsible).

Secondly, as a consequence of the above observation, different ways of assessing RRI are proposed for public entities (research conducting and research funding bodies) and for innovating enterprises. In

Table 4. Examples of RRI assessment criteria for public entities.

	RRI Policy Agenda	Names of Indicators
1	Gender equality	share of organizations with gender equality plans, share of female researchers, share of female authors and inventors, gender wage gap
2	Science literacy and science education	importance of societal aspects of science in science curricula, availability of RRI-related training at higher education institutions, number of citizen science publications in Scopus, organizational membership in European Citizen Science Association
3	Public engagement	models of public involvement in science and technology (S&T) decision-making, Active information search about controversial technologies innovation democratization
4	Open Access	share of Open Access publications, citation scores for Open Access publications, incentives and barriers for data sharing
5	Ethics	presence and performance of research ethics structures at research performing and research funding organizations
6	Governance	use of science in policy making, RRI-related governance mechanisms within research-funding and performing organizations

Source: own elaboration on the basis of [6,37,38].

and

Table 5. Examples of RRI assessment criteria for enterprises.

	RRI Policy Agenda	Names of Metric/Indicator
1	Gender equality	Implementation of a gender equality plan and practices regarding team composition, management positions, work spaces, salary levels, contract conditions Systematic evaluation of the state of gender equality in the organization Provision of gender equality training Identification of gender stereotypes present in R&I activity
2	Science literacy and science education	Supporting citizens in making informed decisions Increasing stakeholder awareness that R&I can create solutions that have impact on their lives Using different outreach channels and adapting contents according to the target group
3	Public engagement	Engagement of relevant stakeholders in the innovation process (civil society organizations, local government, education community, customers, patients, families, etc.) Conducting outreach activities and reflecting on them Addressing conflicts of interests
4	Open Access	Ensuring transparency and open access throughout the innovation process Clear traceability of ownership and authorship
5	Ethics	Anticipation of the benefits and risks of innovation project (including long-term side effects) Ensuring project outcomes are used responsibly even after the project Alignment with the Code of Conduct for Research Integrity Encouragement of critical peer review and internal discussion on ethical issues throughout the process Consultation with external ethics experts or committees
6	Governance	Openness to emerging societal needs Readiness to change the research plan or innovation project in response to unforeseen results or as a result of a dialogues with the stakeholders Providing time for reflection during the innovation processes Appointment of a staff RRI expert Providing RRI training to employees

Source: own elaboration on the basis of [40,41,42].

, an overview of RRI assessment criteria proposed in the literature is presented.

Thirdly, it requires much scientific effort both theoretically and empirically to evaluate the appropriateness of the RRI assessment criteria presented below. As in the case of Corporate Social Responsibility (CSR), despite higher maturity of the concept, there is still much doubt as to whether the available CSR metrics and indicators are suitable, optimal and transparent [35], and what is the relationship between CSR and firm performance [36].

Metrics and indicators presented in Table 4 are of a very diverse nature. Some are quantitative and objective, others are qualitative and more arbitrary. Some are based on data already available, others require new surveys. It is quite obvious that performance in some RRI dimensions (like gender, open access) is easier to capture with the use of indicators than in others (ethics, governance). Many of the indicators offer information about formal settings and structures established at research performing or research funding institutions. However, it requires a much deeper look to see how those formal settings influence researchers, innovators and wider society [6]. Categorizing the assessment criteria according to the defined RRI policy agendas also has its implications. Much emphasis is put on the process but less on the outcome of R&I. The presented metrics seem to miss the Grand Challenges and sustainability dimension of the RRI discourse [39]. Moreover, some indicators relate to the democratization of science and technology decision-making, which could be a serious barrier in the adoption of RRI in non-democratic political systems.

Assessment criteria for enterprises presented in Table 5 are clearly different from the ones presented in Table 4. This confirms the argument for a separate approach to RRI in for-profit, market-driven entities and in public research performing and research funding bodies. The indicators suitable for enterprises are predominantly based on subjective judgement and self-assessment. Moreover, it should be noted that not all criteria are relevant to the activity of each innovating organization. Additionally, certain criteria may have more importance in a particular sector/technological domain than in others. All these conclusions have implications for the design of an assessment framework in the form of a RRI index presented below.

4.2. Proposal of RRI Index for Innovating Organizations

There is a clear tension between the need to measure and quantify the responsibility aspect of the innovation activity (“you can only manage what you can measure”) and the broad, heuristic and often ambiguous nature of the RRI concept. “Monitoring RRI by utilizing closed response surveys, questionnaires, and other highly quantified methodologies risks serving to reify narrow interpretations of its application and constitution” writes van de Klippe [43]. Nevertheless, if RRI were ever to become a widely accepted paradigm of corporate responsibility and governance, the industry would expect academia to provide concrete solutions and to propose concrete metrics against which RRI could be measured. The conceptual work presented below has been inspired by existing approaches to sustainability evaluation [44].

The proposed RRI index for innovating organizations has the following features:

• It is based on respondent’s subjective/arbitrary judgement (semi-quantitative nature);
• Its ingredients may be customized according the needs of a particular sector or a group of enterprises;
• Components of the index are weighted. Weights are also arbitrarily determined by the users of the index.

The first stage of the development of the RRI index for enterprises consists of conducting a survey among innovating companies. Companies judge their own performance in the RRI relevant fields with the use of a simple 5-point scale. They make their judgement on the basis of what they think is the best practice/performance in that area. As a result, each company obtains its score in RRI-relevant fields compared to the highest score in the group. Examples of RRI fields that may be assessed are presented in Figure 3.

The second stage consists of determining the weights of the index components (E1, E2, G1, G2, Gov1, Gov2, O1, O2, P1, S1, S2). Weights could be determined arbitrarily by a researcher or policy maker or they may be determined collectively by the enterprises participating in the survey. The sum of weights should be equal to 1.

$${\displaystyle \sum }_{n=1}^N{w}_n=1$$

(1)

where:

w_n, - weight of the nth component

N - total number of components

The third stage is carried out separately for each enterprise. The distance between the enterprise’s score (E1) and the leader’s score (E1_max) should be calculated for each component; the difference will have a negative value. In components where the studied company is actually the leader, the distance between its score (E2) and the score of the second-best enterprise (E2_max) is calculated; the difference will have a positive value (Figure 4).

The fourth stage consists of summing up the distances calculated in the third stage, taking into account the weights determined in the second stage. The enterprises may be ranked according to the obtained result. The higher the number, the better the RRI performance. Normalization procedures may be applied if needed.

$$RRI Index={\displaystyle \sum }_{n=1}^N{w}_n(C_n-C_{n max})$$

(2)

where:

w_n, - weight of the nth component

N - total number of components

C_n - enterprise’s score for n-th component

C_{n max} - leader’s score for n-th component (alternatively, second best score if the studied company is the leader)

The advantage of the proposed RRI index is its flexibility and simplicity, which makes it understandable, usable and easy to interpret. Organizations do not need to sacrifice much time and many resources to fill in the score sheet. The time needed to fill in the sheet decreases even further if the exercise is performed on a regular basis (to monitor changes). It should be noted that the optimal use of the index consists in benchmarking, i.e., in calculating the index with the same components and the same weights for a number of similar organizations. Such exercises may help identify leaders and followers in RRI, thus spreading best RRI practices. If used by only one organization, the RRI index may help with tracking changes over time.

5. Discussion and Conclusions

The complexity and dynamism of innovation ecosystems is growing on regional, national and global levels. The impact of new technologies, products and services on society, economic activity, natural environment, the evolution of culture and values is increasingly difficult to predict as the world is increasingly characterized by volatility, uncertainty, complexity and ambiguity (VUCA). In this context, classical perspectives on responsibility that focus on its individual dimension are insufficient to reflect the complexity and multifaceted reality of modern socio-technical systems [24]. That calls for a new, relational and networked understanding of responsibility which transits from “responsibility in and to society” towards “responsibility for and with society” [29].

Gianni’s position that RRI is essentially a “performative framework that can never be accomplished” [46] carries both risks and opportunities. On one hand, its unfinished nature allows for a big deal of flexibility and adaptability to different contexts. On the other, a lack of one common understanding of the concept poses serious difficulties in its operationalization and buy-in from the industry [47].

The distinctive feature of RRI approach consists in the aspiration to take stakeholders’ needs, concerns and values before a product, service or technology enters the market; to go beyond “not doing wrong” (for example by introducing environmental management systems [48]) towards “doing good”. Thus, anticipation, in addition to regulation, becomes a new critical element of innovation governance [49]. Even more than before, innovators are encouraged to practice reflexivity in the form of foresight [50], Future-Oriented Technology Analysis [51,52] or innovative forms of Technology Assessment [53,54]. This is easier said than done, as anticipation of future impacts of innovation (often unintended and ambiguous) falls into the Collingridge dilemma: “When change is easy, the need for it cannot be foreseen; when the need for change is apparent, change has become expensive, difficult, and time-consuming” [55].

The main limitation of the presented study comes from the lack of a representative empirical component. It is therefore the author’s ambition to continue studies in that direction. Two avenues seem especially enticing: investigating RRI adoption and testing RRI assessment tools in selected sectors (for example food industry [56] or machinery building industry [57]) and exploring the territorial aspect of RRI in less-studied European regions (namely, Eastern and Central Europe [58]).

In the author’s opinion, further research may be directed towards two goals. First, attempts should be made to overcome the Eurocentrism of the RRI and to increase its global reception. After all, RRI should foster innovation that tackles major societal challenges that are global by nature: i) tightening supplies of energy, water and food; ii) pandemics and public health issues; iii) ageing societies [59]; iv) security; and v) climate change [60]. Analyzing innovation systems of countries such as South Africa and China with a view of verifying the adaptability of RRI concept in those contexts is a step in the right direction [61]. It should not be impossible to establish a certain set of social desirability criteria necessary for RRI to go global [62].

Secondly, context-sensitive, business-relevant and user-friendly tools for RRI evaluation should be further developed and continuously improved to increase industry acceptance of the framework. Development of valid measures of the responsibility of innovation processes and outcomes are perhaps the most important challenge for researchers and innovation stakeholders alike. Innovation responsibility ratings of enterprises could be strong tools capable of influencing ethically-sensitive investors and mobilizing consumers, potential employees and social movements. As awkward as it sounds, there is a big deal of responsibility attached to responsibility assessment.

A universally-accepted set of social desirability criteria would be a very good starting point for global responsibility benchmarking surveys [63] and analyses. The application of more sophisticated analytical instruments would be desirable. For example, Data Envelopment Analysis (DEA) could be used to evaluate how efficiently innovating organizations transform their resources and time (input) into socially desirable “outputs” [64,65]. Such “RRI productivity” approach could also be used at the strategic planning stage to choose between competing technology roadmaps [66,67,68] with different anticipated inputs and outputs.