Innovation serves as a cornerstone of business strategy, enabling organizations to thrive in competitive markets by fostering differentiation, creating value, and ensuring long-term sustainability.
Business strategy focuses on setting goals, charting actionable plans, and allocating resources to achieve objectives while adapting to technological advancements, economic changes, and competitive pressures [
1]. Integrating innovation into these strategies allows organizations to meet customer needs, improve efficiency, and build resilience, ultimately creating competitive advantages. These advantages extend beyond immediate gains to include long-term capabilities, such as employee expertise, robust infrastructure, and strong brand equity [
2]. In today’s globalized and technology-driven markets, where competitors can rapidly replicate or surpass innovations, continuous innovation is vital for sustaining this edge [
3]. Explicit management structures dedicated to fostering innovation are essential for aligning organizational capabilities with dynamic market demands, ensuring long-term growth and leadership.
Beyond organizational success, innovation serves as a critical driver of economic growth and societal well-being [
4,
5,
6]. It enhances living standards through advancements in healthcare, transportation, and education, while addressing global challenges like climate change, resource scarcity, and public health crises through sustainable practices and green technologies [
7]. By aligning economic growth with social and ecological objectives, innovation contributes to achieving the Sustainable Development Goals. Empirical evidence shows that countries with higher innovation rates experience greater economic performance, as technological advancements drive productivity and competitiveness [
8]. Governments play a key role in fostering innovation by designing policies that strengthen National Innovation Systems, encouraging private enterprises to build competitive advantage through innovative solutions rather than relying on low wages or subsidies that may hinder development [
9]. Moreover, sustainable innovation, such as environmental technologies, not only addresses social and ecological objectives but can also enhance competitiveness by improving efficiency and reducing costs throughout product life cycles [
7]. Thus, innovation is a cornerstone for nations to achieve balanced economic, social, and environmental progress.
The challenges faced by Ecuadorian organizations in fostering innovation highlight the urgent need for targeted strategies to drive economic growth and enhance competitiveness. Within this context, the ICT industry stands out as a sector with significant potential to address these gaps. As highlighted in the Global Innovation Index report, Ecuador demonstrates an openness to integrating high-tech solutions, as reflected in its ranking for high-tech imports [
12]. Globally, the ICT industry is recognized as a cornerstone of modern development, driving transformative advancements through technologies such as artificial intelligence, cloud computing, big data analytics, and the Internet of Things. These innovations are reshaping social, economic, and political landscapes, fueling digital transformation across sectors ranging from medicine to robotics [
13,
14,
15].
ICT’s unique attributes, including rapid product cycles, global market access, and cost-efficient digital product development, have positioned it as one of the most competitive and influential industries [
16,
17]. In Ecuador, particularly in Quito, the ICT industry represents a promising opportunity for innovation and economic growth. With over 2000 companies generating annual sales of
$2.2 billion and providing nearly 23,000 jobs, the sector accounts for more than half of the national ICT market share [
18]. Although its contribution to the national Gross Domestic Product (GDP) is relatively modest at 2%, the ICT industry holds strategic potential to transition Ecuador toward an innovation-driven economy. This research focuses on the ICT sector as a case study, analyzing specific strategies to unlock its innovation potential, given its pivotal role in global development and its untapped capacity to drive sustainable growth and competitiveness in Ecuador.
Addressing innovation challenges within organizations requires explicit management of innovation, with the measurement of innovation serving as a critical component. Effective measurement enables the identification of key gaps, the setting of strategic objectives, and the allocation of resources to foster competitiveness and national development. However, many existing innovation assessment methodologies, designed primarily for advanced economies, fail to capture the unique socioeconomic conditions of developing countries like Ecuador [
19,
20]. To address these issues, measurement criteria must be systematized, and standardized procedures established to enable international comparisons while accounting for regional and national specificities, such as market structures, organizational size, and cultural factors [
4]. For example, differences between manufacturing and service-based organizations must be considered to ensure that measurement tools accurately reflect the realities of target organizations. By incorporating additional indicators that capture local nuances, these tools can more effectively evaluate the impact of innovation on national development and advance progress tailored to Ecuador’s unique context.
The development of measurement tools has traditionally relied on Classical Test Theory (CTT), valued for its simplicity and minimal technical requirements [
21]. CTT operates on a linear scoring model, where the observed score is considered a sum of the true construct value and measurement error, assuming the mean of these errors is zero. Consequently, the average item score is treated as a representation of the true construct value [
22]. Despite these advantages, CTT has critical limitations that undermine its broader applicability. One key weakness lies in its dependency on sample characteristics during the item discrimination process. For instance, in samples with high ability levels, selected items tend to exhibit higher difficulty (higher
p-values), leading to what is termed the “group heterogeneity effect on correlation coefficients”. This issue restricts the utility of CTT-based tools to populations closely resembling the validation sample, limiting their generalizability. Additionally, CTT assumes uniform precision across all levels of the latent trait, making tests optimal for individuals with moderate trait levels but less accurate for those with extreme (low or high) levels. These inconsistencies in precision, coupled with challenges in measuring diverse populations effectively, highlight significant shortcomings in CTT-based scales [
22].
This study seeks to address two key challenges in assessing innovation potential within Ecuadorian technology companies. First, it introduces the use of the CRI model questionnaire as a measurement tool specifically contextualized to the region, ensuring that the unique organizational and environmental factors of the local context are accurately represented. Second, it adopts Item Response Theory (IRT) as the analytical framework, which provides a more precise and adaptive alternative to CTT. Unlike CTT, IRT resolves critical limitations such as the dependency on sample-specific characteristics and the assumption of uniform measurement precision across all levels of the latent trait. By employing IRT, this study enhances the reliability and applicability of innovation measurement tools, fostering a deeper understanding of innovation potential. This integrated approach not only addresses the methodological gaps but also contributes to Ecuador’s broader developmental goals by enabling the design of innovation-driven policies. Furthermore, it equips organizations with actionable insights to align their strategies with innovation objectives, thereby strengthening their competitiveness and fostering sustainable industrial growth.
The paper is structured as follows:
Section 1 presents the theoretical framework, discussing the strategic importance of innovation, its measurement, and the features of IRT.
Section 2 outlines the methodology used to construct the proposed assessment tool, detailing the application of IRT to derive multidimensional indices of innovation potential.
Section 3 presents the results of applying this tool to ICT companies in Quito and offers recommendations for the sector. Finally,
Section 4 concludes with key findings, implications for innovation management, and suggestions for future research.
Literature Review
The literature on innovation measurement is extensive, with significant contributions focusing on tools and frameworks tailored for developed economies. However, there is a notable gap in methodologies designed for developing countries, where contextual factors such as resource constraints and socio-economic challenges significantly impact innovation outcomes. Additionally, the use of IRT in this context remains largely unexplored.
Edison et al. (2013) [
23] conducted a comprehensive review of innovation measurement methodologies across seven major academic databases (Inspec, Compendex, Scopus, IEEEXplore, ACM Digital Library, ScienceDirect, and Business Source Premiere), analyzing 13,401 articles published between 1949 and 2010. Their study identified 232 unique metrics, with the majority (88%) focused on organizational-level innovation, while fewer metrics addressed regional or national contexts (11%), and even fewer targeted the industry level (1%). These findings emphasize the dominant focus on organizational innovation in existing methodologies, revealing significant gaps in metrics designed for broader systemic or sectoral evaluations—gaps that are crucial to address for aligning innovation strategies with national and industrial objectives.
Most of the tools created are designed for developed OECD countries, with only a limited number tailored to the needs of developing nations [
19]. One of the most well-known tools globally is the Global Innovation Index, developed and maintained by Cornell University, INSEAD, and the World Intellectual Property Organization since 2007. Its most recent report, published in 2024, provides detailed parameters from 80 indicators regarding innovation drivers and outcomes for 131 countries (covering 93.5% of the global population) from several perspectives, such as political environment, infrastructure, education, and business development [
24,
25]. The objective of this index is to present a set of indicators that reflect national strengths and weaknesses, helping policymakers better understand innovation and develop policies to foster it.
Another well-known tool is the OECD’s STI Scoreboard, which provides data on 1000 indicators related to science, technology, and innovation for around 60 countries across various regions. This tool does not provide a general index but presents individual information on each indicator within six main areas: research and development, science, business innovation, intellectual property, economy, and labor force [
4,
26].
The European Innovation Scoreboard (EIS) is an analytical tool developed by the European Commission to provide a comparative assessment of the research and innovation performance of EU Member States and selected non-EU countries. It examines a wide array of indicators grouped into categories like framework conditions (e.g., human resources, innovation-friendly environment), investments (e.g., finance, support, and firm investments), and innovation activities (e.g., linkages, firm activities, and intellectual assets). The primary aim of the EIS is to help policymakers understand the strengths and weaknesses in their national innovation systems and craft targeted policies to enhance innovation performance [
27].
The Bloomberg Innovation Index evaluates countries’ innovation capacities through a composite score derived from various metrics such as R&D intensity, manufacturing capability, productivity, patent activity, and the concentration of high-tech public companies. This index emphasizes economic and business aspects of innovation, focusing on how innovation translates into tangible outcomes like productivity and technological advancements [
28].
The Oslo Manual provides guidelines for research and experimentation on innovation measurement, primarily for the private sector but also including information for all sectors of society: private, public, nonprofit, and households. The Oslo Manual analyzes various elements of innovation, such as innovation activities (research, intangible acquisition, marketing, engineering, design, training), innovation capabilities (organization size, assets, time in market, human resources, intellectual property), external factors (market collaboration, intermediaries, regulations, government programs, public infrastructure, macroeconomic environment), innovation objectives, and outcomes [
4]. The manual aims to promote standardization and facilitate international comparability. First published in 1992, four editions have been released to date, the most recent in 2018.
In Latin America and the Caribbean, the Bogotá Manual [
29] is a regional attempt to systematize innovation measurement, aimed at capturing the specific characteristics of these regions that are not covered by the Oslo Manual. It analyzes the elements that should be included in Latin American innovation indices, such as technological capabilities, information sources for innovation, funding, government policies, social processes, quality management, and environmental management, integrating them into a unified set of indicators.
In Ecuador, the National Innovation Activities Survey was an attempt to develop a local innovation measurement methodology and tool under international parameters, based on the need to understand the state of innovation in the country, identify its strengths and weaknesses, and develop action plans and strategies for knowledge-based development leading to social, economic, and environmental growth. Its methodology follows guidelines from OECD-developed manuals, including the Oslo and Frascati Manuals [
30,
31]. This survey uses a set of indicators to evaluate organizations in areas such as innovation expenditure levels, use of support programs, human resource qualifications, funding, export intensity, information sources, and intellectual property. Similar local initiatives have been developed in Colombia, Argentina, Brazil, and other Latin American countries by government entities [
30]. While this government initiative provides a macro view of Ecuador’s national innovation system, it does not effectively capture the innovation context of Ecuadorian organizations [
20].
In the Ecuadorian context, other recent initiatives for innovation quantification have also emerged from non-governmental entities. One such initiative is the Innómetro, developed by the Alliance for Entrepreneurship and Innovation (AEI), a network of public, private, and academic actors, which aims to diagnose the level of innovation within organizations, identify strengths and opportunities, and create a roadmap for achieving objectives [
32]. Another initiative is Deloitte’s surveys of business leaders to understand the culture of innovation in Ecuadorian organizations, using indicators such as innovation budgets, reasons for innovation, priorities, customer influence, organizational growth, and idea-generation processes [
33]. Both initiatives rely on methodologies that are not publicly available and are exclusive to the entities developing the tools. Another study, conducted by Robalino-López et al. (2017) [
34], builds on the guidelines of the Oslo Manual, the Bogotá Manual, and the analytical framework of Camio et al. (2015) [
35], this academic initiative aims to provide Ecuadorian organizations with an innovation assessment model, known as CRI, which aligns with standardized international methodologies while accounting for the socio-economic structures of the local context. The CRI model questionnaire is employed in this research as a data collection method.
IRT has been continuously developed and refined since the 1930s, but its practical application had to wait until recent computational advances due to its high processing demands [
21,
36]. Despite these advances, the literature on the application of IRT in organizational studies remains limited, with most work concentrating on psychometrics, such as aptitude and personality assessments. Approaches of IRT applied in organizational and innovation contexts include measuring open innovation in Italian organizations [
37], constructing the Berkeley Innovation Index for measuring individual innovation capabilities [
38], assessing innovation capabilities of students [
39], and measuring individual employee creativity, workplace atmosphere, and workplace innovative activity [
40].