Standardizing Innovation Management: An Opportunity for SMEs in the Aerospace Industry

: In a globalized marketplace, the competition in the aerospace industry has increased signiﬁcantly. Producers can choose between many suppliers. These suppliers have to comply with more requirements and technical speciﬁcations, as well as take on greater responsibilities that originally fell on producers. In this context, business opportunities for small and medium-sized enterprises (SMEs) are limited, but still suppliers must try to leverage the maximum strategic advantage of the few that present. Adopting research, development and innovation (R + D + i) practices has proven to bring great beneﬁts to companies and allows them to gain signiﬁcant competitive advantages. However, the process of designing, implementing and testing R + D + i-related processes is not straightforward, nor it has been addressed in the recent research on SMEs. In this paper, a case study of a Spanish innovative small company providing industrial metrology and quality services is analyzed. Thanks to an internal decision-making process, an R + D + i management system based on the UNE 166.002:2014 standard is eventually adopted. A pilot project is closely followed up to test the robustness of the system implementation. The R + D + i management system has allowed the company to streamline its innovation activities, establish objectives to better allocate essential resources, organize high performing innovation units within the organization structure, increase the clients’ conﬁdence, improve the company’s competitiveness, carry out technological surveillance, and get more patented technology, among many others. Adoption steps taken by this SME are generalizable to other SMEs from other industries and show how an R + D + i management system can be chosen, designed, implemented and tested in the context of Industry 4.0 (I4.0).


Introduction
In a globalized economy, companies need to be adaptable to maintain their presence in the market [1]. The whole value chain is also changing and companies need to be proactive in this change [2]. Where and how much these companies invest can decide whether they will acquire a significant competitive advantage or fail and go under [3,4].
In companies, particularly in the case of Small and Medium Enterprises (SMEs), research has found a strong positive relationship between innovation and growth [5], and between innovation and performance [6]. Unfortunately, SMEs frequently lack the resources to fully invest in recent technologies [7]. They need to prioritize their investments and be very careful when allocating their

Research Objectives
Aerospace companies participate in a complex supply chain where both the companies they provide to and the final users have become much more demanding. This has forced them to cope with increasingly higher manufacturing standards. In order to survive, SMEs from the aerospace sector can develop new technologies to improve their products, services and systems (even for their clients). An obvious way to achieve this is to make informed decisions regarding in which areas more research is needed, as well as how research tasks can be better managed, in other words: To develop an R+D+i management system.
Through a paradigmatic example of a Spanish SME dedicated to providing metrology services in the aerospace sector, this research analyzes how an R+D+i management system can help SMEs to survive and prosper in the I4.0 context. Spain is one of the countries where the innovation-related framework and standards are more advanced. Spain also encompasses a significant number of SMEs working in the aerospace industry, as well as one of the two major aircraft builders (Airbus). This makes of this case study a good example depicting how an SME can remain competitive within an increasingly complex supply chain environment.
Thus, the first objective of this study will be to carry out a holistic analysis of the design, development and implementation of an R+D+i management system. The second objective will be to document how the decision-making process takes place regarding how an SME can approach and manage R+D+i. In the case of Spain, a company is considered an 'innovative SME', if a seal is awarded to that company as official recognition. Besides demonstrating its innovation capacity, it is possible for that company to access special subsidies, tenders, tax incentives and other advantages.
From the case study analyzed, it will become clear that the company develops intensive R+D+i activities on a daily basis. Still, this company will be faced with a set of voluntary alternatives that can provide it with a greater strategic and competitive value. However, these alternatives must be carefully selected so that they are compatible with the management systems already in place.

R+D+i management
R+D+i management involves planning, directing, controlling and coordinating the development and implementation of R+D+i capabilities in order to shape and accomplish the strategic and operational objectives of organizations [27]. According to the Frascati manual [28], R+D+i management includes the management of basic research, applied research, and experimental development; Cetindamar, Phaal and Probert [29] also describe the challenges on the rise in the fields of technology management and innovation.
Particularly, in the case of innovation management, many interpretations can be found for the concept of innovation depending on the purpose and context. The Oslo Manual [30], for example, considers four general innovation types: Product, process, marketing and organizational; Schiederig, Tietze and Herstatt [31] talk about green and ecological innovation; Zeschky, Winterhalter and Gassmann [32] refer to frugal and reverse innovation; Horwitch and Stohr [33] describe social innovation; whereas Tidd and Bessant [34] propose design-driven innovation, to cite just a few.
R+D+i, in any of its conceptions though, has a positive effect on the performance of organizations [35]. In fact, innovation is one of the key factors for companies long-term success [36]. The development of technological innovations [37] facilitates the introduction of improvements in the organizational management context, as well as quicker knowledge and learning and exchange [30]. In this setting then, companies with the ability to innovate face and resolve challenges and conflicts quicker than non-innovative ones [38]. A quick inspection of Table 1 reveals that Spain has been at the forefront of innovation regulation well before other European countries. Particularly, the Spanish UNE 166.002 standard [51] provides a guide for those companies that intend to develop more effective organizational and technological innovations [48]. Furthermore, the European Committee for Standardization (CEN) is developing the Processes 2019, 7, 282 6 of 42 16555 family of standards at a European level (largely based on the Spanish standards). More recently, the International Organization for Standardization (ISO) has also published the 50501 standard at an international level [52] which largely based on the European standards and, in turn, in the Spanish ones too. A simplified timeline of the most relevant Spanish and International is shown in Figure 1.
Processes 2019, 7 FOR PEER REVIEW 6 recently, the International Organization for Standardization (ISO) has also published the 50501 183 standard at an international level [52] which largely based on the European standards and, in turn, 184 in the Spanish ones too. A simplified timeline of the most relevant Spanish and International is shown 185 in Figure 1. 186 187 Figure 1. Evolution of the Spanish, European and international of R+D+i standards.

188
As a result, despite the apparently extensive R+D+I regulatory framework, current literature has 189 not currently tried to identify which are the best practices/actions to take (drivers) throughout the 190 stages of managerial innovation [53], nor provided practical information about how to manage 191 business for optimizing the R+D+i outcomes [54]. There is also a lack of research within companies, 192 when teams are not prepared to implement R+D+I systems either because resources are insufficient, 193 not complementary, and/or cannot work collaboratively [55]. In the case of SMEs, this deficit extends 194 to the management of R+D+i by their staff in order to exploit innovative ideas [56]. This is especially 195 relevant because of the difficulties in finding, selecting and retaining specialized, entrepreneurial and 196 managerial workers [57]. The case study developed in this paper will address some of these research 197 gaps. 198

R+D+i management in the Industry 4.0 199
I4.0 is expected to significantly transform industrial value creation, encompassing high-grade 200 digitization of business processes, smart manufacturing and intercompany connectivity [13]. Its 201 principles can also be applied to transforming the nature of products and services provided by 202 organizations [58]. 203 I4.0 faces the challenge of transforming (even reinventing) the business culture of organizations, 204 influencing the competence and talent of their personnel, and orienting themselves towards new 205 sustainable, competitive and ever-changing business models [59]. This paradigm shift in design, 206 production and methods of operation is also changing the way people and businesses interact with 207 each other [60]. I4.0 mostly involves a quantum leap on three principles: Digitization of production, 208 automation, and linking manufacturing sites in a comprehensive supply chain [61]. Maturity models 209 help organizations to embed these three principles into their culture [62]. New business opportunities 210 that promote the transformation of production processes usually find, mainly in SMEs, some 211 resistance to change [48]. Moreover, many SMEs just do not even know where to begin with when 212 trying to visualize how they want to manage innovation [62]. 213 Nevertheless, SMEs are major contributors to the industry of most countries [63].  As a result, despite the apparently extensive R+D+I regulatory framework, current literature has not currently tried to identify which are the best practices/actions to take (drivers) throughout the stages of managerial innovation [53], nor provided practical information about how to manage business for optimizing the R+D+i outcomes [54]. There is also a lack of research within companies, when teams are not prepared to implement R+D+I systems either because resources are insufficient, not complementary, and/or cannot work collaboratively [55]. In the case of SMEs, this deficit extends to the management of R+D+i by their staff in order to exploit innovative ideas [56]. This is especially relevant because of the difficulties in finding, selecting and retaining specialized, entrepreneurial and managerial workers [57]. The case study developed in this paper will address some of these research gaps.

R+D+i management in the Industry 4.0
I4.0 is expected to significantly transform industrial value creation, encompassing high-grade digitization of business processes, smart manufacturing and intercompany connectivity [13]. Its principles can also be applied to transforming the nature of products and services provided by organizations [58].
I4.0 faces the challenge of transforming (even reinventing) the business culture of organizations, influencing the competence and talent of their personnel, and orienting themselves towards new sustainable, competitive and ever-changing business models [59]. This paradigm shift in design, production and methods of operation is also changing the way people and businesses interact with each other [60]. I4.0 mostly involves a quantum leap on three principles: Digitization of production, automation, and linking manufacturing sites in a comprehensive supply chain [61]. Maturity models help organizations to embed these three principles into their culture [62]. New business opportunities that promote the transformation of production processes usually find, mainly in SMEs, some resistance to change [48]. Moreover, many SMEs just do not even know where to begin with when trying to visualize how they want to manage innovation [62].
Nevertheless, SMEs are major contributors to the industry of most countries [63]. In the case of the Spanish economy, SMEs represent 99.9% of companies, 65.9% of employees and provide 60.4% in terms of added value [64,65]. In other countries like Germany, we can find similar figures (99.6, 59.4 and 54.8, respectively [66]. Similarly, most SME faces similar challenges: Lack of financial resources; low productivity; low level of standardization; and lack of understanding of integration [18].
Thanks to I4.0, though, SMEs can improve their competitive position and individualize their products and services to suit clients' demands [14]. Even if the majority of SME still lack the expertise for implementing I4.0 [67], new doors for cooperation and value creation can be opened to innovate with partnering companies and institutions [68]. However, with generally lower automation levels than large companies [15], SMEs tend to rely heavily on some key manufacturing employees, working together to generate value creation innovations [69]. In this context, SMEs need a higher amount of employee training [13], including those skills required for fixing machines in the case of failures [70]. This paper will also discuss these aspects through the case study.

Supply Chain Management and the Aerospace Sector
The Supply chain is currently the center of operational activities of manufacturing companies [71] and a decisive factor when a company is trying to gain some competitive advantage [72,73]. Bär, Herbert-Hansen and Khalid [2] reviewed the benefits of I4.0 in the supply chain, finding that the most important were: Stakeholders integration, product customization, process transparency, production flexibility, resource efficiency, real-time data, automation, customer data retrieval, and increasing client satisfaction. In order to fully benefit from I4.0 then, companies need to learn and share production-related data with suppliers and clients within the supply chain [74].
On the other hand, the aerospace sector is a highly competitive industry, where the priority is to ensure safety and airworthiness. Due to their operating conditions, their results are restricted to very high-quality and reliable standards [75]. However, despite being a highly regulated sector, it is still possible to adopt innovative business models that allow operating in lean, agile, resilient manufacturing supply chains [76,77]. In this context, the development of aerospace technologies is very fast, and has stood out at the vanguard of many other industrial sectors. A common thread among the majority of these technologies is that they have boasted higher levels of automation, as well as greater production speed and accuracy [78]. Still, the intensive use of automation, data exchange and advanced manufacturing technologies are requiring better coordination of operations, especially when dealing with new measuring technologies supporting digital manufacturing. Consequently, new opportunities based on innovative measuring technologies and procedures for metrological quality assurance and control are also emerging [79]. In this sense, the case study analyzed later will describe the case of an SME developing metrological solutions to other aerospace industry clients.
Furthermore, original equipment manufacturers (OEMs) are working these days collaboratively with many smaller suppliers [80], exchanging knowledge, technological innovations and benefiting reciprocally [81]. Historically, OEMs had acted as focal points of supply chains, carrying out the majority of manufacturing and assembly processes themselves. These days, a great proportion and variety of work are being carried out by specialist organizations, dispersing the supply chain. In this context, OEMs are transferring risks to their suppliers, but also losing some degree of operational control [82].
Hence, the maturity of the aerospace supply chain management has always been a paradigm of efficiency, accuracy, responsiveness and agility [83,84]. This has allowed OEMs and their suppliers to face together complex challenges, fostering interdependence. However, I4.0 challenges need industrial companies capable of operating in the whole value-chain in an agile and responsive manner [85]. These companies also need (technical and managerial) structures that allow them to cooperate with each other and adapt rapidly across whole lifecycle processes, from innovation to production [86]. The case study in this paper will describe these challenges and interactions.

Research Method
As discussed earlier, although there is significant research on I4.0 in the context of SMEs, most of it has focused on business flexibility and productivity, as well as on delivery time and cost reduction [87]. Very few studies have covered other essential issues for SMEs, like quality improvement [88] or R+D+i management [56]. Therefore, qualitative research seems especially suited for the first exploratory research on how SMEs can design, implement and benefit from R+D+i management systems.
This study has opted for a case study as there is hardly any previous research on the topic and insufficient empirical observations to turn it into a quantitative study. This is probably to be expected as, due to confidentiality and competitive reasons, companies do not tend to share the information that would be required for a more extensive analysis. Indeed, when only limited theoretical knowledge exists, an inductive research strategy leading to emerging theory from a case study can constitute a good starting point [89].
Building theory from a case study is a research strategy that involves using the case to create theoretical constructs, propositions and/or midrange theory empirical evidence [90]. The theoretical sampling of single cases is straightforward. Cases are chosen because they are unusually revelatory, extremely exemplary, or because they represent unique opportunities for gaining research insights [91]. If the case study is rich, with empirical descriptions of a particular instance that is based on a variety of data sources [91], then an accurate, interesting, and testable theory can also be developed [89]. Additionally, while experiments isolate the phenomena from their context, case studies emphasize the rich and real-world context in which they occur [92], sometimes, including the points of view of all people and entities involved [93]. For the interested reader, Eisenhardt and Graebner [94] provided the keys to build a solid case study. In the context of our study, we will strive to answer the following research questions: • Do R+D+i activities help SMEs to work along the value chain? • Does the systematic management of R+D+i activities optimize the resources of SMEs? • What standards can be followed to design an R+D+i management system in an SME? • What criteria must be considered to develop an R+D+i management system in an SME? • How can an SME implement a successful R+D+i management system? • How can an R+D+i management system be tested after its implementation in an SME?

Case Study
InnoMet (the real company name has been changed to keep it anonymous) was a company created in 2006 within a university context as a technology-based company (TBC). InnoMet provides services related to metrology and its initial aim was to transfer research results from a university metrology laboratory to the industry. The forté of InnoMet is providing calibration support and management to companies within the aerospace and naval sectors. Nowadays, InnoMet has become a leading company in Spain providing advanced metrology services, but also industrial quality engineering and IT solutions. With a current staff of 35 employees to date, the company has worked with more than 100 clients, calibrated more than 30,000 instruments and handled over 50,000 calibrations. The  Aerospace and naval OEMs homologation for industrial and IT verifications. Most services offered by InnoMet are carried out through routine, essentially repetitive operations. However, this company detected new business opportunities that increasingly involved carrying out more and more singular activities. Although these new business areas did not seem critical initially, they have brought substantial changes regarding the way InnoMet operates and makes money. InnoMet can offer nowadays state-of-the-art metrological processes through transferring the latest developments on research metrology. They have also consolidated their metrology innovations in emerging industrial processes, which has involved strengthening and broadening InnoMet's links with current and new clients.

SWOT Analysis
As a first step, InnoMet analyzed itself and its competitors in order to better understand its clients' needs and expectations, especially those in the aerospace and naval sectors. These clients constitute InnoMet's major work source. Thus, InnoMet resorted to a SWOT (Strengths, Weaknesses, Opportunities and Threats) analysis, which is a well-known instrument from operations research to develop organizational strategies [95] that has been applied in many fields (e.g., [96][97][98][99]).
From a thorough scientific literature review and several focus group workshops involving central stakeholders, the SWOT analysis was built. Among the central stakeholders, InnoMet's OEM's supplier was included, as well as the company's experts committee. This committee is made up of the company directors, managers and advisory board, who are mostly a group of researchers from academia. The SWOT analysis captured key aspects of the company's environment and strategic capabilities, and identified internal and external critical success factors, which are summarized in Table 2. Once the SWOT analysis was carried out, the Experts Committee realized that the company's best path to follow was to become a TBC company that intensively developed R+D+i-based metrology services. For this, the company needed to obtain a seal that serves as an official recognition of innovative SMEs. The analysis of alternative solutions that InnoMet considered to obtain this official recognition by the Spanish accreditation bodies is discussed in the next section.

Alternatives Analysis
InnoMet concluded that the innovative SME seal was a strategic requirement because it would help them differentiate from its rivals and gain some competitive advantages. In addition, it would allow them to explore new national markets, while enjoying tax deductions and pension bonuses.
To obtain the 'Innovative SME Seal' regulated by the Spanish order ECC/1087/2015 [100], a company is required to carry out intensive R+D+i activities. Besides establishing the seal awarding criteria, this order attempts to promote proposals that foster business growth of Spanish SMEs. However, just doing research or apply new ways of doing things in production processes or services is not enough to be considered an innovative SME. A series of additional, but an alternative, formal requirements set out in the Royal Decree 475/2014 [101] must also be met. As a result, a Spanish SME may be considered as innovative or R+D+i intensive if it has carried out activities in the field of research, technological development or technological innovation in recent years. However, the SME will only be considered to be officially innovative if it either: Demonstrates the company's innovative character by submitting a (positive): 1.
Binding reasoned report (BRR) by the Corporate Income Tax Law 27/2014 [102], or proves the company's innovation capacity by being awarded one of these official certifications recognized by the MINECO: 2.
Hence, if the SME meets one of these criteria, the company will eventually be awarded the 'innovative seal' by the Spanish Ministry of Economy and Business (MINECO). Companies that receive this seal have the following advantages [104]: Compatibility between tax deductions and bonuses in the company pension contributions for the staff dedicated exclusively to R+D+i tasks.
Access to specific soft financing lines from the Spanish Official Credit Institute (ICO). Access to public procurement of innovation (CPI), an administrative action to promote innovation, aimed at boosting the development of new innovative markets from the demand side, through the instrument of public procurement.
Abbreviated tendering procedures with the public administration. Direct aid channeled through the European Union Framework Programmes' agents. It is evident, that all these preferential conditions could be harnessed by InnoMet to gain significant competitive advantages. As a result, InnoMet considered that being awarded this innovative SME seal was the most advisable step to take. What remained was deciding which of alternatives (BRR, AENOR EA0047, or AENOR UNE 166002 R+D+i) was the most suitable for them.

Binding Reasoned Report (BRR)
The Spanish Royal Decree 1432/2003 [105] requires that applicants submit a technical report to the MINECO. This report classifies the SME's research activities and identifies their expenses and investments in R+D+i. The facts contained in this report have to be checked and certified by an external entity accredited by the Spanish National Accreditation Body (ENAC) [106,107].
The process basically consists of three stages. In the first stage, companies prepare a report of their R+D+i projects once they are completed. All relevant technical and economic documentation must be compiled following a clear structure based on some ENAC requirements. In a second stage, a certification is requested from an R+D+i projects certification body. Then, in a third and final stage, companies must present their certified reports to the MINECO in order to get their BRR.
For the interested reader, Appendix A includes two figures that show the schematic process for applying for and issuing a BRR ( Figure A1) and the evolution of issued BRRs vs. the number of applicants in Spain from 2005 to 2017 ( Figure A2).

AENOR EA0047 Specification
The EA0047 specification by AENOR [103] describes the set of objective criteria and assessments that define when a consolidated SME can be considered 'innovative'. The European Innovation Scoreboard (EIS) [108] was originally used as a reference for the preparation of the EA0047.
The EA0047 specification consists of 27 indicators that allow companies to identify their strengths and weaknesses, and improve their management performance by means of a self-assessment instrument. In order to obtain the certificate of conformity, an SME needs to achieve a minimum score of 400 points. Besides comparing its relative performance, the SME applying can receive immediate feedback by observing in which assessment items the company is not performing adequately. A top-performing company might reach (theoretically) a score of up to 1,000 points.
The 27 indicators of the EA0047 are grouped in three blocks: Human and economic financial resources; innovation processes; and results, including generation of employment in R+D+i. The first block (resources) is focused on understanding the organizations' commitment to innovation. It measures the number of personnel dedicated to R+D+i, the percentage of expenditures in R+D+i and the sources of public and private financing. The second block (processes) focuses on technological vigilance and collaboration with third parties. The third block (results) focuses on providing a clear vision of the benefits that organizations obtain from their R+D+i activities (e.g., enable protection models, job creation, and other positive economic outcomes).
The structure of the EA0047 specification systematizes: The relationship of the SME with its suppliers; the monitoring of market developments; customer feedback; the relationship with training organizations or technological services; the analytical accounting of different innovation activities; and the SME's innovative capacities communication policy.
For the interested reader, Figure A3 in Appendix A reproduces the latest EA0047 ranking for Spanish innovative SMEs. Table A5 in Appendix B summarizes InnoMet's self-assessment results. Our company got 500 points, then it could have been certified by this standard and consolidated among the 12% most innovative companies in Spain.

AENOR UNE 166002 R+D+i Management System Standard
The UNE 166002 standard by AENOR [51] includes the organizational structure, activity planning, responsibilities, practices, procedures, processes and resources to develop, implement, carry out, review and keep the organization's R+D+i policy up to date. This certification of an R+D+i management system allows companies to: Therefore, the UNE 166002 standard could potentially contribute to the optimization of the organizations' research, the development of technological innovation processes, facilitate the recognition of emerging/new technologies, and provide the basis for strengthening R+D+i activities. Requirements from this standard are complementary to the requirements of other business management systems too, such as quality management, environmental management, safety management and ethical and social management.
Taking into account the particularities of innovation activities within organizations, the UNE 166002 standard proposes a methodology for the continuous improvement of any SME's innovation process. This methodology resembles Deming's classical Plan-Do-Check-Act (PDCA) cycle as represented in Figure 2.
Processes 2019, 7 FOR PEER REVIEW 12 Taking into account the particularities of innovation activities within organizations, the UNE 444 166002 standard proposes a methodology for the continuous improvement of any SME's innovation 445 process. This methodology resembles Deming's classical Plan-Do-Check-Act (PDCA) cycle as 446 represented in Figure 2.

449
For the interested reader, Figure A4 in Appendix A represents a flowchart of the certification 450 process for a Spanish SME. Figures A5 and A6 show a comparison of companies certified in Spain by 451 the major management standards (ISO 9001, 14001, 22000, 27001 and 50001 versus UNE 166002). 452

Alternatives Selection with the AHP Method 453
Having presented the three possible alternatives to obtain an innovative seal awarded by the 454 MINECO, it only remained to analyze which was the most suitable option for InnoMet. To make an 455 informed decision, our SME decided to resort to a multi-criteria decision tool, in this case, AHP. The 456 Analytical Hierarchy Process (AHP) method is a very popular discrete multi-criteria decision tool 457 [109,110]. In AHP, the problem to be solved is modelled from a set of alternatives and a series of 458 decision criteria that can sometimes be conflicting. 459 AHP is applied through the construction of hierarchical structures, in which the first hierarchical 460 level consists of the problem goal, the next hierarchical levels encompass the decision criteria and 461 sub-criteria and, finally, the last level contains the alternatives. For allocating weights to the decision 462 criteria and sub-criteria, paired comparisons are made (criterion vs. criterion) by knowledgeable 463 members of a panel. These numerical comparisons are generally expressed in a 1-to-9 scale and lead 464 to dominance matrices. The steps for applying AHP are summarized in Figure 3. 465 For the interested reader, Figure A4 in Appendix A represents a flowchart of the certification process for a Spanish SME. Figures A5 and A6 show a comparison of companies certified in Spain by the major management standards (ISO 9001, 14001, 22000, 27001 and 50001 versus UNE 166002).

Alternatives Selection with the AHP Method
Having presented the three possible alternatives to obtain an innovative seal awarded by the MINECO, it only remained to analyze which was the most suitable option for InnoMet. To make an informed decision, our SME decided to resort to a multi-criteria decision tool, in this case, AHP. The Analytical Hierarchy Process (AHP) method is a very popular discrete multi-criteria decision tool [109,110]. In AHP, the problem to be solved is modelled from a set of alternatives and a series of decision criteria that can sometimes be conflicting.
AHP is applied through the construction of hierarchical structures, in which the first hierarchical level consists of the problem goal, the next hierarchical levels encompass the decision criteria and sub-criteria and, finally, the last level contains the alternatives. For allocating weights to the decision criteria and sub-criteria, paired comparisons are made (criterion vs. criterion) by knowledgeable members of a panel. These numerical comparisons are generally expressed in a 1-to-9 scale and lead to dominance matrices. The steps for applying AHP are summarized in Figure 3.   Table 3: 473 The AHP model of the decision problem is identified in Figure 4.  Thus, the decision problem components in this case were:

1.
Goal: Innovative SME seal regulated by the MINECO.

3.
Decision criteria: InnoMet came up with the criteria shown in Table 3: The AHP model of the decision problem is identified in Figure 4. The first step was to weight the decision criteria. Then, decision criteria binary comparisons and paired assessment matrices were completed by the Experts Committee of InnoMet. More precisely, a specific questionnaire was designed to capture the judgements of all experts. The criteria weights were voted after a debate and a relative consensus had been reached. In this case, the experts resorted to ratio scales that derived verbal statements (comparisons) which were eventually converted into priorities through integers from 1 to 9 (being: 8-9 extremely important, 6-7 very strongly more important, 4-5 strongly more important, 2-3 moderately more important, 1 equally important).

485
The multi-criteria decision-making software SuperDecisions [111] was used for the weighting of 486 both the first and second level criteria, and also for the final ranking of alternatives. A summary of 487 the weight results from all the pairwise decision criteria, sub-criteria and alternatives are represented 488 in Table 4. Details of the pairwise comparison can be found in Tables B1 to B3 in Appendix B.  489 According to the results of the first level criteria weights compiled in Table 4  The multi-criteria decision-making software SuperDecisions [111] was used for the weighting of both the first and second level criteria, and also for the final ranking of alternatives. A summary of the weight results from all the pairwise decision criteria, sub-criteria and alternatives are represented in Table 4. Details of the pairwise comparison can be found in Tables A1-A3 in Appendix B. According to the results of the first level criteria weights compiled in Table 4, the organizational strategy (C1) was considered the most important factor (with just over 60% of the total criteria weight). The second most important criterion was the technical (C3) group (slightly over 25%). Within the organizational strategy group (C1), the most important sub-criteria were the Alignment with strategy (C1.1) and the Promotion of R+D+i capacity (C1.4). Just these two sub-criteria represented nearly 50% of the total problem decision weight (as 0.60206 × (0.45310+0.34500) = 0.4805).
As a result, as shown in Table 4, the best alternative for InnoMet's R+D+i management system was deemed to be obtaining the certification by the UNE 166002 standard (with a preference ratio of 69%). The second-best ranked option was to obtain the conformity certificate based on the EA0047 specification (22%); and the third (worst) alternative was the BRR (9%).
However, once judgments had been entered, it was also necessary to check whether they were consistent. The admissible inconsistency coefficient was calculated and resulted in a value below 10% (which is considered quite low in AHP). The SuperDecisions software also calculated the weights for every pairwise comparison in order to minimize local inconsistencies of the model. Table A4 in Appendix B shows the details of these calculations.
Finally, a sensitivity analysis was performed. This analysis consists of a study of how changes in the decision criteria weights could have affected the decision outcome. Results of this analysis are summarized in Table 5. Nevertheless, being the alternative C so overwhelmingly superior, only if criterion C2 had weighted more than 70%, alternative C would have no longer been the top ranked. As this scenario seemed to largely misrepresent the expert panel's priorities, it was finally concluded that alternative C really seemed the most suitable option for InnoMet.

Document Management System
Thanks to the previous multi-criteria decision-making stage, a specific R+D+i management system was eventually chosen by InnoMet. Next, it was necessary to create and/or modify the structures of the organization. To do so, it was necessary to update the company's document management system.
InnoMet then established, documented, implemented and prepared to maintain an R+D+i management system based on the UNE 166002 standard by AENOR seeking to continuously improve its research effectiveness. To this end, the organization chart, the company processes and other information were reviewed and updated.

Organization Chart
InnoMet had to ensure that the resources and necessary information would always be available to support the operation and monitoring of R+D+i activities. In the updated organization chart (that can be found in Figure A7 in Appendix B) there was evidence of this commitment from InnoMet's senior management team. In addition, InnoMet created two new roles in the organization chart: • R+D+i Management Unit: For the general management of the R+D+i.

•
R+D+i Unit(s): For specific R+D+i projects.
As can be seen in Figure A7, a new division was created, whose director was at the same level than other division directors like operations, quality and administration. Within this new division, three functional areas were created for the undertaking: R+D+i projects, calibration of CNC machine tools, and verification of industrial processes. The staff (division director, department manager and area coordinators) were full-time employees fully dedicated to R+D+i activities.

Processes Map
Based on the certification demands, requirements and recommendations included in the R+D+i management system, InnoMet adopted and optimized a series of Management, Operational and Support processes. Greater detail of these can be found in Figure A8 in Appendix B. Namely, Management processes: To the existing processes related to Change management (incidences and corrective actions), Risk management (risks, opportunities and preventive actions) and System management (audits and improvement actions), InnoMet added: Results management (protection and exploitation): These processes established the guidelines that ensured the mechanisms of protection, technology transfer and exploitation of results, starting with the definition of a valuation system for the company's intangible assets.
Operational processes: To the existing processes of Stakeholder management (offers, contracts and clients), Supply chain management (subcontracting and suppliers), Integrated metrology management, Software design and development, and Equipment CNC Machine tools calibration, InnoMet added: Ideas management: It covered the stages of generation, collection, evaluation and selection of ideas. More precisely, these processes included how to capture the purposes sought by those ideas, the sources from which they can be generated, the expected frequency of generation, the methods and criteria for their analysis and prioritization, and eventually the means for their protection (intellectual property). R+D+i projects development: These processes described how to document a new metrology methodology consisting of start-up, planning, development, control, closure and operation phases, without requiring an exhaustive project portfolio for prioritization or compatibility.

Support processes:
To the existing processes of Documented Information (documents and records), Competence management (industrial safety, procedural qualification) and Configuration management (facilities, equipment and systems), InnoMet added: Technology surveillance and competitive intelligence These processes allowed anticipating (proposing changes for expectations), taking advantage of opportunities (exploiting identified advantages), reducing risks (reducing threats or overcoming barriers to access new technologies and/or markets), as well as opening new lines of improvement (overcoming gaps and minimizing identified weaknesses), accessing innovation (proposing new ideas and/or R+D+i projects), and foster cooperation (identifying potential collaborators).

Other Documented Information
In addition to the organizational chart and the revised and extended processes map, InnoMet also modified its mission, vision and values. New R+D+i policy and objectives were included in the company strategy, and a comprehensive manual for the R+D+i management system was created. Besides, a series of new performance indicators (see Table A6 in Appendix B) was created. These indicators will be reviewed annually.

Pilot R+D+i Project
Once the R+D+I management system was up and running, an R+D+i pilot project was chosen to evaluate the successful implementation of the whole management system. The pilot project was, of course, handled with InnoMet's new management system and represented a project for its main client in the aerospace sector. Project details are included in Appendix C.
For this project, a set of objectives were proposed, experimental procedures described, and its results released. This and other later R+D+i projects have allowed InnoMet to take the lead against its competitors, and be positioned at the forefront in the evaluation of aeronautical process qualifications. Particularly, the major traits and contributions of this pilot project were:

•
It supplied a technological solution to a specific need of a major client (OEM).

•
It replaced (or complemented) older, less reliable and generally more expensive verification methods. • It mitigated process risk and variability.

•
It developed alternative drilling and riveting processes that could be used in future aeronautical applications. • It decreased the time for automatic drilling and riveting processes verification.

•
It allows implementing non-destructive inspection procedures.

•
It reduced measurement uncertainty.
Once the system was successfully tested, other successful projects followed. Among them, the more relevant were: • Volumetric positioning errors of flushed systems for ultrasonic inspection of carbon fiber parts.

•
In-situ calibration of three-dimensional laser tracker measurement systems.

•
Verification of gaps and steps in aeronautical assembly panels.

•
Geolocation of in-situ measurement instruments for metrological management.

•
Web applications for the metrological management of instruments for OEMs.

•
Evaluation of wear effects on the machining of aluminum alloys.

•
Metrological model for the characterization of microgeometric errors in additive manufacturing processes.

Discussion
In this research, a case study of a Spanish innovative SME (InnoMet) providing metrology and industrial quality services in the aerospace sector has been analyzed. For the SME, obtaining an innovative seal was a priority objective. This accreditation is official recognition for Spanish SMEs after an intensive research focus. It also brings a series of tax and funding benefits that give these companies some additional competitive advantages that partially compensate their smaller size.
From an external point of view, holding an innovative SME seal has allowed InnoMet to carry out technological surveillance and be able to anticipate its clients' needs (for example by proposing new metrological methods to them that enhance the quality of their processes). These positive outcomes were partially anticipated by Erkut [41], Zott, Amit and Massa [112], and Taran, Boer and Lindgren [113], who suggested that organizations must design and conduct their own activities while trying to provide value and confidence to their clients. In this vein, InnoMet's new R+D+I management system standardizes and generates the necessary intermediate processes from generating ideas to materializing protectable and usable results. Developing these intermediate is essential, but it is frequently neglected by SMEs, as George and Bock's [114] and DaSilva and Trkman's [115] found.
Furthermore, to achieve all these positive outcomes, InnoMet has streamlined a way of compiling its clients' needs and expectations while also involving its own suppliers and partners in the thinking process. According to Ng, Ding and Yip [116] and Bouncken and Fredrich [117], both aspects constitute essential elements to drive innovation. Besides, contrary to many other companies, InnoMet has demonstrated total transparent approach towards all its operations (a proof of this is the current case study). Indeed, this was considered an important barrier by Mittal, et al. [20], who reviewed aspects that prevented the successful adoption of SMEs' smart manufacturing techniques in the I4.0 context. However, InnoMet is confident they can share how they operate as, "by the time the competition reaches them, they expect to be already ahead". They also apply a strict code of ethics with which its shareholders are greatly satisfied. This totally transparent approach has also brought the attention, not just of new clients, but new potential company investors.
From an internal point of view, and as anticipated by Moeuf et al. [87] and Dassisti, et al. [21], InnoMet's R+D+i management system has enabled the company to systematize and channel all the company's R+D+i activities. But thanks to the UNE 166002 high level structure (HLS), this new management system has also allowed perfect integration with other management systems already in place in InnoMet (the ISO 9001, EN 9100, and the ISO 170025). This way, innovation units can grow, be better planned and organized, constantly redefine their processes, and keep key human resources updated (trained) with the latest metrology techniques. Benefits of this high level integration were also partially envisaged by Oesterreich and Teuteberg [118], and Müller, Buliga and Voigt [13].
In summary, InnoMet's new R+D+i management system has empowered the company and they are being compensated by their clients. These outcomes were found in Chesbrough's [119] and Massa, Tucci and Afuah's [120] studies, however, they are rarely found in the context of SMEs.

Conclusions
The aerospace sector involves very demanding regulations and high-quality sustainability requirements. However, I4.0 is bringing increasing digitization and automation of the manufacturing processes, as well as the empowerment of the supply chain actors [20]. Nowadays, OEMs offer great opportunities for supplying companies to get involved in the processes of the companies they supply to. This involvement gives access to first-hand knowledge about the clients' needs and indirectly, their competitors' (absence of) capacities. Companies in this sector can harness these opportunities and improve the way they operate. For this reason, they must also establish mechanisms that allow them to generate new knowledge and transfer it to their clients, as well as to optimize previous products and services.
With the intention of expanding the knowledge on research management on SMEs (not just research, development and innovation, R+D+i, but technology and strategy management as well), a case study has been analyzed. The case study has described an SME providing metrology services in the aerospace sector. This SME decides to obtain an innovative seal awarded by the Spanish Ministry of Economy and Business. Being awarded this seal, besides allowing the company to better manage all its R+D+i activities, gives it access to a series of preferential advantages (tax deductions, special tenders, additional lines of funding, etc.). All these outcomes can significantly improve the company's competitiveness and allow that company to keep improving over time.
The major contribution of this study is depicting how a real SME operationalized the implementation of an R+D+i management system, from detecting the need, to implement it, even test it. Almost all the steps and decisions taken by the company can be exported to other industrial contexts. In short, this company took the following steps. After a SWOT analysis was performed by InnoMet's experts' committee, and thanks to an internal decision-making process based on AHP, an R+D+i management system based on the UNE 166002 standard was selected. This standard will drive InnoMet's innovation activities from now on. Particularly, InnoMet's new R+D+i management system will guide the company in: Identifying new opportunities for diversification facilitating different types of innovation, highlighting resource needs, involving the senior management and promote an innovative culture, strengthening cooperation and, eventually, favoring the creation of new knowledge. It is also expected that this new management system will increase the company's competitiveness (e.g., by reducing cost, shortening response times and increasing quality). Finally, in order to check the adequacy of the R+D+i management system once it was implemented, a pilot project was closely followed-up. This pilot project involved the design and development of non-destructive metrological methodologies for the assessment of automatic drilling and riveting machines processes. Because of the results of this pilot project, previous measurement methods were indeed simplified; costs, risks and variability were reduced, and new mechanization methods emerged.
This paper contributes to the scientific understanding of how R+D+i work and can be adopted in SMEs. However, the qualitative nature of the paper and its reliance on a single case study may raise some issues regarding the generalizability of results. Hopefully, this limitation is attenuated by the representativeness of the case study analyzed. Still, the present study should encourage future analyses expanding the implementation steps of R+D+i management systems in industrial SMEs. This area has been clearly lacking in recent research, but it is absolutely worth revisiting in the I4.0 context. Further recommendations for future research include the application of quantitative research methods to verify and quantify the qualitative results and outcomes found in this preliminary analysis. A comparison of SMEs with larger companies would also be of interest to understand which differences and similarities can be found between both types of companies. Furthermore, further analysis of the necessary actions of companies oriented to develop their own supply chain may be of interest. Finally, analyses on the risks of integrating a company's multiple management systems will also be greatly beneficial to both SMEs and bigger companies operating in the increasingly demanding I4.0 context.  Figure A3 simulates the grade of the fulfillment of the criteria included in the EA 0047 specification by those enterprises registered in 2017 into the PITEC. It must be noted that only 25% of the registered companies reached the minimum value (400 points or more) to pass the certification process.
includes more than 460 variables of the technological innovation activities of around 12,000 Spanish 721 companies. 722 Figure A3 simulates the grade of the fulfillment of the criteria included in the EA 0047 723 specification by those enterprises registered in 2017 into the PITEC. It must be noted that only 25% of 724 the registered companies reached the minimum value (400 points or more) to pass the certification 725 process. 726 The process of certifying the R+D+i management system according to the standard UNE 166002 731 requirements is based on the process of external audits based on compliance with the provision of 732 evidence, similar to other certification schemes, as can be tested in Figure A4. 733 734 Figure A4. Flowchart of the certification process.

735
Quality and environment are the areas with more companies certified, as shown in Figure A5.

Appendix A.3. AENOR UNE 166002 R+D+i Management
The process of certifying the R+D+i management system according to the standard UNE 166002 requirements is based on the process of external audits based on compliance with the provision of evidence, similar to other certification schemes, as can be tested in Figure A4.
includes more than 460 variables of the technological innovation activities of around 12,000 Spanish 721 companies. 722 Figure A3 simulates the grade of the fulfillment of the criteria included in the EA 0047 723 specification by those enterprises registered in 2017 into the PITEC. It must be noted that only 25% of 724 the registered companies reached the minimum value (400 points or more) to pass the certification 725 process. 726 727

A.3. AENOR UNE 166002 R+D+i Management 730
The process of certifying the R+D+i management system according to the standard UNE 166002 731 requirements is based on the process of external audits based on compliance with the provision of 732 evidence, similar to other certification schemes, as can be tested in Figure A4. 733 734 Figure A4. Flowchart of the certification process.

735
Quality and environment are the areas with more companies certified, as shown in Figure A5. Points (0-1000) Positive EA0047 Certification >400 points > Figure A4. Flowchart of the certification process.
Quality and environment are the areas with more companies certified, as shown in Figure A5. It can be noted that the most generalist one (ISO 9001) has been halved since the Spanish real estate bubble crisis. The second one (ISO 14001) has remained stable. On the contrary, the number of companies certified by UNE 166002 standard, as well as other specific standards, like ISO 27001 (information security management), ISO 22000 (food safety management) and ISO 50001 (energy management), has increased steadily over the same period of time, as shown in Figure A6. (information security management), ISO 22000 (food safety management) and ISO 50001 (energy 740 management), has increased steadily over the same period of time, as shown in Figure A6.  (information security management), ISO 22000 (food safety management) and ISO 50001 (energy 740 management), has increased steadily over the same period of time, as shown in Figure A6.   Human resources 135 120 Staff dedicated to R+D+i activities 60 65 Graduate staff dedicated to R+D+i activities 65 10 Compensation for voluntary dedication to R+D+i activities 10 205 Economic-financial Resources 100 20 International public funding of R+D+i 0 15 National public funding of R+D+i 15 5 Public research grants 0 15 Private funding 15 100 Investment in R+D+i expenses 20 50 R+D related to R+D+i expenses 50

200
Innovation process 150 120 Ways to innovate 100 60 R+D+i projects with Research Organizations 40 60 Collaborative R+D+i execution 60 80 Innovation Organization 50 10 Relationship with suppliers to increase innovative capacity 0 10 Knowledge of novelties to increase innovative capacity 10 10 Client feedback to increase innovative capacity 10 30 Analytical accounting to identify R+D+i activities 30 10 Training institutions to increase innovative capacity 0 10 Communication policy to disseminate R+D+i results 0

400
Results and valorization 115 60 Records 0 20 International patents and utility models 0 20 National patents and utility models 0 10 International and/or national industrial designs 0 10 International and/or national trademarks 0 80 Process results 50 Introduction of innovative products and services on market 40 Introduction of innovative marketing techniques on market 0 Advertising of innovation 10 50 R+D+i employment 20 50 Social Security contribution by R+D+i staff 20 210 Economic return 45 30 Incomes from patent licenses 0 120 Sales of new products or services 30 60 Exports of new products or services 15 1000 Total EA0047 500  Figure A7. Modifications to the InnoMet organization chart. Processes 2019, 7 FOR PEER REVIEW 28 763 Figure B2.  Regardless of materials that conform to aeronautical structures, the mechanical jointing method (riveting) is still the most used to assemble aircraft sections. The assembly panels that configure these sections are composed of several plates of equal or different materials, such as aluminum alloys, titanium or carbon fiber, which are connected through joints using rivets in their drilled holes.
The proper functioning of aeronautical structures in terms of stresses, vibrations and fatigue depends fundamentally on the good fit between rivets and holes. A poor fit between them significantly reduces the service life of pieces, increasing the chances of catastrophic structural failure. Any aeronautical structure involves hundreds of thousands of rivets. In this context, it is necessary to verify both the hole parameters and the rivet ones, with very strict tolerances. From this repetitive and technically demanding process comes the automation of drilling and automatic riveting operations in mechanical joining processes.
Drilling and riveting process, from the point of view of the aeronautical sector, is considered a special process, which needs to be technically validated and qualified in a phase prior to its acceptance and implementation to ensure its capacity. A special process may be defined as one whose results cannot be fully verified by product inspection and testing or when deficiencies can only be revealed after the product is used. The autonomous technical qualification of an automatic drilling and riveting process is determined by the materials, facilities and equipment, personnel, tools life, assembly and verification of test plates. Traditionally, the evaluation of the parameters that characterize the quality of riveted joints (holes and rivets installed) is conditioned by, among other factors: • The complexity of measurement by traditional and direct methods. • Measurement elements that do not comply with the tolerance/uncertainty relationship. • Impossibility of evaluation, due to the size of the elements that integrate the union. • High investment in time and resources for the evaluation.

•
Lack of flexibility in procedures.

•
Use of destructive methods.
The objective of this research and development (R+D) project is the development of a non-destructive metrological model for the technical qualification of special processes in machines dedicated to the automatic drilling and riveting of strategic materials in the aerospace industry. The purpose is to give technical validity for the design of a methodology to characterize complex dimensional and macro/microgeometric parameters, evaluated using polymer replications. The development of this project arises from the observation of a need detected in an internal procedure of an external client (aerospace OEM).
As mentioned above, part of the technical qualification process is the elaboration of test plates that represent common working conditions, using procedures, cutting tools, rivets and staff technical qualification. Generally, the design and execution of drilling and riveting test plates are based on the establishment, among others, of the following variables:

•
Cutting parameters (speed, feed and depth of cut).

•
Stack types and thicknesses.

•
Cutter materials and geometries. • Lubrication and cooling systems. • Clamping systems.
In Figure A9, several examples of automatic drilling test plates (with and without rivets installed in different materials) are shown. Processes 2019, 7 FOR PEER REVIEW 31 819 Figure C1. Test plates for drilling and riveting process qualification.

820
In Table C1, the parameters usually required for an aeronautical drilling and riveting process 821 are gathered, starting from the execution of test plates according to indicated technological variables 822 and distinguishing between drills (without installed rivets) and riveted joints (with them). 823 The main property sought in the product that allows the reproduction of dimensions, geometries 828 and surfaces that compose a drilled hole, is the possibility to faithfully reproduce it, in order to be 829 evaluated. This fact implies a very low reproducibility error, with a final rigid consistency that makes 830 it possible to measure with and without contact measurement systems, high hardness, with the slight 831 percentage of elasticity and elongation break, that favour the operations of demoulding and that 832 allows to be sectioned or cut without difficulties. 833 Figure A9. Test plates for drilling and riveting process qualification.
In Table A7, the parameters usually required for an aeronautical drilling and riveting process are gathered, starting from the execution of test plates according to indicated technological variables and distinguishing between drills (without installed rivets) and riveted joints (with them). After an evaluation of commercial alternatives available that satisfy the requirements aforementioned, the material selected for impressions or replicas is a polymer composed by silicon using high-technology by vulcanizing addition, containing, vinyl, acid sylicic, aggregate material and colouring agent. With the aim to demonstrate the main capacities for reproducing geometry and surfaces, different replicas of pieces and elements are shown in Figure A10.
Processes 2019, 7 FOR PEER REVIEW 32 After an evaluation of commercial alternatives available that satisfy the requirements 834 aforementioned, the material selected for impressions or replicas is a polymer composed by silicon 835 using high-technology by vulcanizing addition, containing, vinyl, acid sylicic, aggregate material and 836 colouring agent. With the aim to demonstrate the main capacities for reproducing geometry and 837 surfaces, different replicas of pieces and elements are shown in Figure C2. 838 839 Figure C2. Representative capabilities of impressions obtained by the polymer.

840
Main technical and quality control information are collected below: 841 • Final consistency: Semi-rigid 842 • Hardness: 80 Shore A 843 • Curing time (at 20 ºC): 6 min 844 • Elongation to failure: 8% 845 • Vertical and horizontal impression 846 • No heat and smell polymerization 847 • Shape-retention memory 848 • Reaction without oxygen or heat 849 • Dimensional stability 850 • No shrinkage during polymerization 851 • No residues on the surfaces 852 • Use on every kind of material 853 • Non-toxic and non-polluting 854 • High resistance to inorganic chemical agents 855 • Biocompatible and clean 856 • Impression unaffected by acids or bases 857 C. The technical validation scope is defined by: 868 Figure A10. Representative capabilities of impressions obtained by the polymer.
Main technical and quality control information are collected below: The objective of the technical validation is to determine the suitability in the use of polymer replicas for the measurement of dimensional and geometric parameters. A set of parameters selected simulate the parameters used in the evaluation of drilled test plates to qualify automatic drilling and riveting processes. A comparative methodology has been designed based in quantifying the dimensions by direct measurement of gauges and test pieces ( Figure A11 left), and the indirect measurement obtained from the negatives (replicas or impressions) of the same gauges ( Figure A11 right). From this comparative method it is possible to quantify the reproducibility errors caused by the use of this kind of replicas.
The technical validation scope is defined by: • Hole diameters (d) from 4 mm to 15 mm and lengths (l) up to 15 mm. • Angles (α) from 0º to 180º.

•
Burr height (b) less than 1 mm • Surface finish (s) in terms of roughness average (Ra) from 0.4 µm to 12.7 µm.

874
In order to isolate the component, due to the reproducibility of replicas, the same conditions 875 have been maintained during the measurement of dimensional gauges/test pieces and replicas. To 876 ensure the measurement process is repeatable and reproducible, these factors have been taken into 877 account: 878 • The measurement process has been performed in a dimensional laboratory accredited 879 under the standard ISO 17025:2017. 880 • The same measurement process has been used both gauges and replicas. 881 • Environmental conditions have been controlled and monitored. 882 • The same measurement system has been used. 883 Materials used to perform replicas of gauges and test pieces have been: 884 • Cleaning products. 885 • Polymer product, dispensing gun, injectors and nozzle tip. 886 • Auxiliary metal bushes retainers. 887 • Non-greasy plasticine. 888

C.2.3. Evaluation of Diameters 889
For the simulation of drilled holes diameter measurements, a set of five ring gauges with 890 different nominal diameters ranging from 4 mm to 15 mm are used. Figure C4 shows every ring 891 gauge and their replicas impressions. The values of diameters certified according to their calibration 892 certificates were: 4,00076 ± 0,00059 mm, 5,50141 ± 0,00064 mm, 7,00055 ± 0,00067 mm, 9,99995 ±0,00064 893 mm, 15,00138 ± 0,00066 mm. 894 In order to isolate the component, due to the reproducibility of replicas, the same conditions have been maintained during the measurement of dimensional gauges/test pieces and replicas. To ensure the measurement process is repeatable and reproducible, these factors have been taken into account:

•
The measurement process has been performed in a dimensional laboratory accredited under the standard ISO 17025:2017.

•
The same measurement process has been used both gauges and replicas. • Environmental conditions have been controlled and monitored. • The same measurement system has been used.
Materials used to perform replicas of gauges and test pieces have been: • Cleaning products.

•
Polymer product, dispensing gun, injectors and nozzle tip.

Appendix C.2.3. Evaluation of Diameters
For the simulation of drilled holes diameter measurements, a set of five ring gauges with different nominal diameters ranging from 4 mm to 15 mm are used. Figure A12 shows every ring gauge and their replicas impressions. The values of diameters certified according to their calibration certificates were: 4,00076 ± 0,00059 mm, 5,50141 ± 0,00064 mm, 7,00055 ± 0,00067 mm, 9,99995 ±0,00064 mm, 15,00138 ± 0,00066 mm.  Perthometer Concept PGK120 with stylus MF250 with 90º angle and 2 µm radius tip ( Figure C6). 918 From height values obtained and compared with its replica, the maximum reproducibility error of 919 0.22 µm. is obtained. 920 Measurements of ring gauges and replicas, have been carried out through a coordinate measurement machine (CMM) model Tesa Visio 300 manual, with optical vision system assisted by CAD-based measurement software, as shown in Figure A12. This measurement system is based in a non-contact measurement system by a high-resolution colour CCD camera and episcope coaxial illumination. From diameter values obtained and compared between different ring gauges and their replicas, the maximum reproducibility error of 0.005 mm is obtained.

Appendix C.2.4. Evaluation of Angles
In order to evaluate the reproducibility error in angular magnitude, a 90º angle gauge block and a thread gauge M25x1-Sh7 with 60º nominal flank angle are used. Angles measurement are conducted through a coordinate measurement machine (CMM) model Tesa Visio 300 manual with episcope coaxial illumination. Figure A13 shows the angle gauge block and their replica impressions, as well as a measurement setup. From the angle values obtained and compared with their replicas, the maximum reproducibility error of 0.227º is obtained.  Perthometer Concept PGK120 with stylus MF250 with 90º angle and 2 µm radius tip ( Figure C6). 918 From height values obtained and compared with its replica, the maximum reproducibility error of 919 0.22 µm. is obtained. 920  to prevent any kind of impurity, contamination or chip that could be transferred to the replicas. 946 For the evaluation of microgeometry, C2 type roughness standard has been employed, which are characterization by periodical profiles patterns in the form of isosceles triangles repeated along its surface. Four roughness standards are used with certificate values in terms of roughness average (Ra): 1.48 ± 0.06 µm, 3.08 ± 0.11 µm, 6.42 ± 0.22 µm, and 12.73 ± 0.44 µm. In Figure A15, details of roughness standards and their replicas impressions obtained by polymer are shown. Furthermore, is shown the measurement process carried out by a contact roughness device Mahr Perthometer Concept PGK120 with stylus MF250 with 90º angle and 2 µm radius tip. All measures have been undertaken in accordance with roughness internationally standards and procedures. From the values obtained and compared between among different roughness standards and their replicas, the maximum reproducibility error of 0.07 µm is obtained. From the results obtained in the experimental procedure (and with reproducibility errors 939 according to specifications defined by the exigencies of automatic drilling and riveting aerospace 940 processes), a methodology for evaluating drilled test plate involved in qualify procedures is designed 941 and developed. The different stages of the process are briefly collected below, as summarizes Figure  942 C8. 943 Stage 1. Test plate cleaning after drilling: It is desirable to carry out cleaning soaking a little 944 some fabric in a solution of ether and alcohol, passing it through the inner surface of drills, in order 945 to prevent any kind of impurity, contamination or chip that could be transferred to the replicas. 946

Stage 1. Test plate cleaning after drilling:
It is desirable to carry out cleaning soaking a little some fabric in a solution of ether and alcohol, passing it through the inner surface of drills, in order to prevent any kind of impurity, contamination or chip that could be transferred to the replicas. Stage 2. Rear face test plate sealing. It consists in placing an adhesive sealing tape on the opposite surface of the reference of the test plate (drill outlet), so that the material can be contained inside the hole and there is no excessive loss of it.
Stage 3. Set up of auxiliary retainers. It is important that metal bushes used as retainers are well fixed to the surface and they are positioned concentrically to holes, in order to avoid eccentricity problems that may cause measurement difficulties. For this purpose, non-greasy plasticine is used. Stage 4. Replica performance. A nozzle tip and mixing injector are placed in the cartridge into the dispensing gun. The injection of the mixture into the hole must be done slowly, making small circular movements with the aim to fit the whole surface and filling metal bushes approximately 5-6 mm above the test plate surface. It is important to perform this step correctly, due to the probably of the formation of defects, such as a lack of product, bubbles or internal cavities induced by the bad deposition of the polymer. Once the hole filling has been completed, the curing and solidification process takes place depending on the size of the hole and ambient temperature, approximately 6-7 min.
Stage 5. Replica demoulding. Once the replica is curing and solidified, the adhesive tape, non-greasy plasticine and auxiliary metal bushes retainers are removed. The extraction of the replica is done by exerting a slight side-to-side movement while exerting a traction force in the axial direction (hole direction). After that, the replicas are identified and stored for further evaluations. the dispensing gun. The injection of the mixture into the hole must be done slowly, making small 954 circular movements with the aim to fit the whole surface and filling metal bushes approximately 5−6 955 mm above the test plate surface. It is important to perform this step correctly, due to the probably of 956 the formation of defects, such as a lack of product, bubbles or internal cavities induced by the bad 957 deposition of the polymer. Once the hole filling has been completed, the curing and solidification 958 process takes place depending on the size of the hole and ambient temperature, approximately 6−7 959 min. 960 Stage 5. Replica demoulding. Once the replica is curing and solidified, the adhesive tape, non-961 greasy plasticine and auxiliary metal bushes retainers are removed. The extraction of the replica is 962 done by exerting a slight side-to-side movement while exerting a traction force in the axial direction 963 (hole direction). After that, the replicas are identified and stored for further evaluations. 964  The development of this project implies a significant advance in the characterization, 968 measurement and evaluation of riveted joints and is conceptually delimited as R+D, according to the 969 definitions and delimitations (positive and negative) in Law 27/2014 [102]. This project is considered 970 an entirely R+D activity because of the novelty, previous studies carried out, which has led to a 971 unique and singular methodology in the sector. Besides, it has incorporated substantial 972 improvements in these industrial processes if compared to previous situations. More in detail: 973 • Polymer research: 974 Activities carried out in this milestone are considered Research, because they are 975 Figure A16. Methodology for obtaining the replicas.

Appendix C.4. Project Results
The development of this project implies a significant advance in the characterization, measurement and evaluation of riveted joints and is conceptually delimited as R+D, according to the definitions and delimitations (positive and negative) in Law 27/2014 [102]. This project is considered an entirely R+D activity because of the novelty, previous studies carried out, which has led to a unique and singular methodology in the sector. Besides, it has incorporated substantial improvements in these industrial processes if compared to previous situations. More in detail:

•
Polymer research: Activities carried out in this milestone are considered Research, because they are original studies to acquire new knowledge about the different market polymers and their characteristics for their choice in order to suit the need to obtain the pattern.

•
Polymer test/error: Activities carried out in this milestone are considered Development, because they are tests undertaken with the polymers previously studied to verify they meet the necessary characteristics for the execution of the replica, which will later be validated in the parameters that need to be measured in holes of riveted joints.

•
Monitoring, control and validation of the metrological method: Activities carried out in this milestone are considered Development, because they are the necessary works of measuring on the drill replica, comparing them with the corresponding calibrated standard for each one of the parameters to measure and verifying admitted tolerance ranges are fulfilled.

•
Qualification and certification of the metrological method: Activities carried out in this milestone are considered Development, because they are the necessary works of certifying the metrological method evolved.