Next Article in Journal
Towards a Holistic Framework of Knowledge Worker Productivity
Previous Article in Journal
Distance-Dependent Migration Intention of Villagers: Comparative Study of Peri-Urban and Remote Villages in Indonesia
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluation of Product Development Success: A Student Perspective

by
László Berényi
1,* and
László Soltész
2
1
Institute of Management Science, University of Miskolc, H3515 Miskolc, Hungary
2
Institute of Machine and Product Design, University of Miskolc, H3515 Miskolc, Hungary
*
Author to whom correspondence should be addressed.
Adm. Sci. 2022, 12(2), 49; https://doi.org/10.3390/admsci12020049
Submission received: 18 March 2022 / Revised: 10 April 2022 / Accepted: 12 April 2022 / Published: 13 April 2022

Abstract

:
The time pressure on new product development under unpredictable conditions requires the renewal of the project management approach that suggests the prominent role of project managerial competencies in achieving project success. Project management education must be adjusted to understand students’ opinions in the field. The study uses a survey among Hungarian engineering, business, and IT higher education students. The analysis aims to explore opinions about the main barriers to successful product development projects, and the expected ways of regulating the project by ANOVA and principal component analysis. The responses of 126 students confirm the appreciation of management competencies. Gaps in team composition, inadequate communication, common changes in the plans, and the lack of experience in similar development tasks are considered to be the main contributors to product development project failures. Collaboration and competition with external partners were found to be less essential factors. Students believe that regulation of the work is necessary, but the project team should be trusted to establish it. Beyond developing the curricula, the experience of this study can promote the successful execution of collaborative projects between companies and higher education institutions. It can establish expected student competencies to quickly become effective project team members.

1. Introduction

The traditional methods in project management are increasingly outdated. The market needs new products faster than ever before, and competition between companies is intensified. The accelerated changes lead to unpredictable product requirements and lead times. Reducing the lead time of a new product can be complicated as much by keeping the quality of deliverables and cost constraints as by the iron triangle of project management (Pollack et al. 2018). Companies with industrial products aim to support their customers to increase their performance (Kärkkäinen et al. 2001), but the time urgency causes uncertainty and difficulties. The new conditions affect the related project management approaches and methods. Integrated product development (Vajna 2020) offers the coordination of the related activities from market analysis to sales. Agile tools allow a better focus on customer orientation. Agility in project management becomes general, going beyond software development in line with embedding lean principles in operation. Product development models have long shifted from the traditional predictive to an iterative or incremental project approach, however, the development is ongoing.
Although project management methods are widely available and industry-specific procedures, application success significantly depends on the approach and skills. Successful product development projects are available through carefully selected and applied project management methods accepted by all affected stakeholders. The increasing complexity of the products is perceptible, and that, together with the characteristics above, raises the need for the collaboration of several professions. Knowledge integration capability (Todorović et al. 2015) and managing the interdisciplinary composition of the project team (Henson et al. 2020) are key factors of sustainable project success. Armenia et al. (2019) offer a framework of sustainable project management based on five key dimensions, including corporate policies and practices, resource management, life cycle orientation, stakeholders’ engagement, and organizational learning. The concept of connected leadership (Hayward 2016) can be applied to the project management challenges:
  • purpose and direction: a common understanding of the project goals is worthwhile,
  • authenticity: a trusting relationship among the project team members and the stakeholders allows for integrity;
  • devolved decision-making: authorization of the team members can speed up problem solutions;
  • collaborative achievements: project outcome is the result of shared efforts, and effective performance requires collaboration;
  • agility: adaptation to the changing requirements is required in line with the purposes.
The duty of a university can be marked as developing human capital; in particular, its purpose is to prepare the students for their future managerial and employee roles (Bejinaru et al. 2018). An exceptional opportunity is opened if higher education students work on real projects. Pilot projects that involve engineering and management students are excellent instruments for testing new solutions and finding the development gaps.
Improving the collaboration of universities and corporations in product development has several benefits (Soh and Subramanian 2014; Un and Asakawa 2015; Apa et al. 2021). Additional knowledge, laboratory capacity, management skills, and tools can be complemented temporarily or permanently. Flexibility can be achieved by long-term cooperation. Beyond the direct benefits according to the actual deliverables of the projects, the experience can be used to develop the students’ skills through a more practice-oriented curriculum in project management. These students will enter the labor market with ready-to-use knowledge.
The research can contribute to preparing the engineering and management students for project tasks. Exploring the students’ approach to project management is an essential part of this learning process. The goal of the study is to explore the students’ opinions about new product development success factors through a voluntary online survey.
The next sections are organized as follows. Section 2 presents the literature review of the topic, focusing on the key issues related to the survey development. Section 3 shows the research questions and the methodology. Section 4 deals with the discussion of the results, and Section 5 summarizes the conclusions. An appendix includes the main results of the analysis.

2. Literature Review

2.1. Approach to New Product Development

New product development has been in focus for a long time (Karakaya and Kobu 1994; Jones and Stevens 1999; Lewis 2001; Derbyshire and Giovannetti 2017; Iqbal and Suzianti 2021). Based on literature reviews and analysis of product development case studies, the success factors and the process approaches are traceable. Regardless of the technical characteristics of the given era, studies agree that new product development bears a higher risk than other projects. The main characteristics of new product development are high uncertainty and high complexity that can have a negative impact on the product development performance (Ahmad et al. 2013).
There is a significant agreement that a predictive approach to product development is no longer appropriate; adaptive solutions are required. The PMBOK standards (PMI 2017, 2021) distinguish predictive, iterative, incremental, adaptive, or hybrid development approaches. A predictive (also called traditional) approach with a waterfall planning of the tasks is feasible when the project and product requirements can be defined, collected, and analyzed at the start of the project (PMI 2021). Iterative and incremental (also called adaptive) approaches fit the uncertain conditions better. Iterative work organizing can be preferred if deliverables are not required before finishing the project, while incremental life cycles deliver more often than a single final product. Hybrid approaches aim to change the behavior with the current requirements. Customized models of new product development reflect well the basic approaches above. Integrated Product Development models (Table 1) can give an industry-independent comprehensive framework (Gerwin and Barrowman 2002; Vajna 2020).
A synthesis of the achievements of product development models is to be found in Autogenetic Design Theory (Vajna 2020), by integrating the benefits:
  • Marketing, product, and production task integration with management focus according to Olsson (1985) and Andreasen and Hein (1987);
  • Simultaneous optimization of the product and its production processes, according to Ehrlenspiel (1991);
  • Collaboration of human, organization, technology, and methodology, according to Meerkamm (1995);
  • Dynamic product development of Ottosson (1996) for reacting quickly to changing conditions.
The enhancement of product development process approaches in recent decades shows that the scope of project management responsibility moved from the narrower engineering issues to considering the changing requirements and environment. However, the essence of product development remained the output of the project; the understanding of success needs a more comprehensive approach.

2.2. Project Success

Project success can be described by the iron triangle model that gives the triple bottom line of success as scope, time, and cost constraints in a simple way, but there has long been a consensus that the contribution to corporate strategy and stakeholders’ satisfaction must be considered (Görög 2019; Verzuh 2021). Moreover, intensity, extension, and predictability of the environment force a change in strategy and strategic management (Deutsch et al. 2017), leading to the need for a continuous rethinking of project success. Exploring the project and project management success factors is the focus of interest in general and at the industry level. The success factors can be grouped into three categories by Radujkovića and Sjekavica (2017):
  • The elements of project management competency, including behavioral, technical, and contextual competencies of project manager and project team members;
  • Organizational culture, structure, competence, atmosphere;
  • Project management methodologies, software, tools, techniques, risk assessment tools, and communication support tools.
According to new product development, Cooper (2019) identified 20 drivers of success into three categories:
  • Product: the characteristics of the new product project or the product itself;
  • Business: Drivers of success for the business, including organizational and strategic factors such as the business’s innovation strategy and how it makes its R&D investment decisions; climate and culture; leadership; and how the firm organizes for NPD;
  • Methods: the systems and methods applied for managing new product development.
Organizational factors influencing new products include visionary leadership, structure, key individuals, teamwork, extensive communications, high involvement, customer focus, the creative and innovatory climate, and the learning organization (Jones and Stevens 1999). A learning organization represents the capability of achieving sustainable competitive advantage due to generative learning processes (Bratianu et al. 2020), where projects play a dominant role. Shenhar et al. (1997) defined four success dimensions by the impact areas as the fulfillment of the triple bottom line of the project: impact on customers, corporate success, and preparing for the future. According to the recent pandemic, Hallstedt et al. (2020) emphasize that adequate responses to digitalization, sustainability, and servitization influence the success of new product development. A new product development project usually showcases state-of-the-art technology and focuses on the future (Table 2). This confirms the need for managing uncertainty (Szabó and Cserháti 2013).
However, literature on product development success (González and Palacios 2002; Cooper 2019) reflect the even more agile approach and highlights the strategic focus, communication, team skills, knowledge management, and other soft factors, and a survey among product development experts (Soltész and Berényi 2021) confirmed that beyond that adherence to stability, setting clear project goals is given a high weight. A clearly written set of project goals, as a specification or scope, was evaluated as the most important success factor, followed by the collaboration of the project team.

2.3. Project Failures

Failures in achieving the project goals cannot be excluded. Understanding the nature and influencing factors of project failures allows for appropriate strategies for managing the related risks. Non-compliance with the requirements derived from the iron triangle, shortcomings in meeting stakeholder expectations, and strategic contribution may come from the task complexity or environmental uncertainty. Pinto and Mantel (1990) emphasize three aspects of evaluating the project’s success or failure:
  • the implementation process itself, internal efficiency;
  • the perceived value, quality of the project deliverables;
  • client satisfaction with the delivered project, external efficiency.
Project success can describe the areas in which the project manager must perform well, but understanding failures provides the opportunity to learn. Project risk management (Fekete and Szontágh 2020) is for mitigating concerns; lessons learned are essential inputs of the related actions. Exploring the reasons for these failures can suggest prevention and other precautionary measures (Gupta et al. 2019). Several blogs and learning materials deal with the reasons for the project failures, including general and industry-specific focus. Common literature items are in line with the categorization of success and failure factors. Emam and Koru (2008) identified top project cancellation reasons among IT projects:
  • Senior management is not sufficiently involved;
  • Too many requirements and scope changes;
  • Lack of necessary management skills;
  • Over budget;
  • Lack of necessary technical skills;
  • No more need for the system to be developed;
  • Over schedule;
  • Technology is too new; it does not work as expected;
  • Insufficient staff;
  • Critical quality problems with software;
  • End users are not sufficiently involved.
Antony and Gupta (2018) focused on process development in designating the main failure factors:
  • Lack of commitment and support from top management;
  • Poor communication practices;
  • Incompetent team;
  • Inadequate training and learning;
  • Faulty selection of process improvement methodology and its associated tools/techniques;
  • Inappropriate rewards and recognition system/culture;
  • Scope creep;
  • Sub-optimal team size and composition;
  • Inconsistent monitoring and control (lack of expert supervision);
  • Resistance to change (partial cooperation by employees).
Although achieving project goals is a multi-faceted problem, literature agrees that it can be supported by appropriate project management. ‘Soft’ factors such as project management competencies, communication, and team-level collaboration are appreciated. Networking also came into view (Li and Yu 2022). It cannot mean that all ‘hard’ factors, such as plans or regulations, would expire; it suggests that more is needed. Since new product development has a passing-through impact on production technology, organizational challenges, and, in parallel, customer habits and satisfaction, a particular emphasis should be paid to success and failure factors already during the education period.

3. Research Design

3.1. Research Goal

The study deals with the assessment of product development success factors among higher education students. A negative question was formulated, and a set of factors was asked to be rated about the contribution to the failure of a product development project. The goal was to explore the opinions of the students in the field. Regardless of the students’ experience in project management, and especially in product development, the responses can help them understand their attitudes toward the projects. The results can be used for curricula development by highlighting the misunderstood factors. Beyond improving education, the information is significant for the companies when hiring new staff.
There were four research questions formulated to cover the investigations:
  • RQ1: What level of regulation is considered appropriate by the students?
  • RQ2: What are the main barriers to product development projects’ success based on the students’ judgment?
  • RQ3: Can patterns be explored in the students’ judgment?

3.2. Research Instrument and Analysis Methods

A voluntary online questionnaire was designed for data collection in Microsoft Forms. The questionnaire included twelve factors for assessment, as shown in Table 3. The factors included planning and regulation of the project, competencies of project management and team members, company issues, and external issues. Short names added to Table 3 describe the factors in the results for a simple review of the figures and tables of the paper.
The respondents were asked to evaluate the contribution of the statements to project failures. The questionnaire used a 5-point scale with the endpoints ‘does not contribute at all’ and ‘typical reason’. The questionnaire also included four statements to be ranked about the most effective way for achieving success:
  • Keeping the written regulations and plans is the most expedient (Keeping written regulation);
  • The project team must define the rules for a given project (Rules defined by the project team);
  • The team must consciously adapt to changing situations (Adapting to the changing situations);
  • There is no need for overregulation since everyone performs to the best of their ability that leads to the fastest competition in the project (No need for detailed regulations).
The analysis was performed with IBM SPSS 25 software, following the guideline of Pallant (2020) and Babbie (2020). The survey items were described with mean value, standard deviation, skewness, and kurtosis. Beyond the descriptive statistics, the assessment of the students was presented by rank orders calculated based on the mean values and proportion of the high agreement (four or five) answers. The relationship between the survey items was checked by Spearman’s correlation method. The impact of grouping factors (profession, gender, study level, and work experience) was tested by the non-parametric Kruskal–Wallis analysis of variance, adjusted to the level of measurement. Based on this, results were considered as significant differences by the grouping factor if the significance level is lower than 0.05.
Since the items of the survey were categorized preliminary according to a researcher’s vision, structure validation was a critical issue at this point in the research. Principal component analysis was selected as a dimension reduction method with Varimax rotation to maximize the variance of the components. The applicability of the analysis was tested by the Kaiser–Meyer–Olkin criteria, Bartlett’s test of sphericity, and the anti-image correlation matrix method.

3.3. Research Sample

The research sample consisted of 126 responses, including 39 business and 47 engineering students at the University of Miskolc and 40 students from the IT field at the University of Miskolc and the Ludovika University of Public Service. The data collection period was the fall semester of the 2020/2021 academic year.
Beyond the profession, the gender, study level (bachelor or master), and work experience (no, internship, yes) were identified as grouping factors for the analysis. Sample characteristics are summarized in Table 4. The reliability analysis showed acceptable results (Cronbach’s Alpha = 0.711).

4. Results and Discussion

4.1. Approach to the Regulation of Product Development Projects

Although the predictability of product development is low, and changes are common, the students considered the rules and regulations as necessary. Based on the ranking of the related questions, only a fifth of them ranked in first place that the project will be completed the fastest, and there is no need to complicate it since everyone performs the tasks to the best of their knowledge. At the same time, the students believed that the rules must have been defined by the project team taking the specificities of the given project into account. Opinions on keeping the written regulations were divided. The mean values of the rank orders are presented in Figure 1, and the distributions of the rankings are detailed in Table 5.

4.2. Factors of Product Development Project Failures

Improper communication solutions between team members were the most important contributors to product development project failure based on the mean values of the students’ evaluations (Figure 2). It is followed by selecting the team members, changes in the project plan, and the lack of experience in similar development challenges. According to the grouping of the factors investigated, external issues and the lack of regulation were at the end of the list. The descriptive statistics of the results and the correlations are placed in Appendix A.
The low scattering of the mean values and negative skew of the distributions is a characteristic of the sample. Kurtosis of the evaluations suggested the highest agreement on the opinions about the lack of corporate-level cooperation (K = 0.494) and the lack of experience in similar development tasks (K = 0.405). Based on the distributions of the responses, the proportion of respondents with a four or five (typical reason for the failure) rating is highlighted. The factors by this indicator show a different order in the top five positions (Figure 3). Improper selection of the team members was marked as the most common or typical reason for the failure (76.2% of the respondents). Lack of experience in the development task (75.4% of the respondents) was considered more relevant than based on the mean values, while improper communication (74.6% of the respondents) was only in the third place. Too common changes in project plans were considered the typical reason for failure by 69.9% of the respondents (fifth position), while it was the third by the mean values (Table 6).

4.3. Alternative Factor Structure

The evaluation orders show a scattered picture by grouping the failure factors, except the external issues. Therefore, a principal component analysis was performed with Varimax rotation to check the factor structure assumed in Table 7. Kaiser–Meyer–Olkin test (KMO = 0.709), Bartlett’s test of sphericity (Chi-square = 243.251, df = 66, p = 0.000), and anti-image correlation matrix method (minimum value in the main diagonal is 0.562) confirmed the applicability of the analysis. The results offer an alternative factor structure.
The alternative factor structure suggests a different approach to the project success or failure of product development (Table 8). The first factor includes the question of team-level cooperation by proper selection of them and the communication. The second factor consists of external issues and regulation; these can be considered enablers of a project. While the items of team-level cooperation were the most decisive success factors, enablers were considered at the end of the list.
The third factor collects the items of project and corporate management competencies in framing and controlling the product development project. The fourth factor consists of professional issues, including project planning success, former experience in product development, and the ability to react to competitors’ actions.

4.4. Analysis of Variance

Since different professionals contribute to projects, and the emphasis on product development and project management may be different in study programs, it was expected during the compilation of the research sample that the sub-samples would show distinct opinions on product development failures. Figure 4 shows the mean values by profession.
IT students rate the ‘too common changes in plans’ as being more harmful to the project than other professions, and engineers are the least worried about it. The evaluation of the external factors, including the relationship with external partners and access to market information, show a similar picture. Engineering students’ evaluations stand out from the others according to team composition, and especially the cooperation between company management and the project team. However, Figure 4 presents remarkable patterns by professions; the analysis of variance could confirm significant differences in only a few cases. Beyond the profession as a grouping factor, the Kruskal–Wallis H test was performed for gender, study level, work experience, and former participation in product development projects. Based on the study level, work experience, and experience in product development projects, the sample is considered homogeneous for each question. The significant results (p < 0.05) are highlighted in Table 9; the analysis results are placed in Appendix A.

4.5. Evaluation of the Results

Project management learning materials give a high emphasis to establishing the framework of the project including the work breakdown structure, timing plan, cost, and deliverables. The planning covers personal responsibilities as well. Recent experience questions the possibility of this predictive approach. Software development projects put agile project management in the foreground, and an ever-widening range of sources deals with its applicability in other areas. New product development projects usually must face a less dynamic environment than software engineering, but the technological uncertainty may be higher when delivering before the end of the project is not expected; iterative and incremental approaches fit better to product development, but agile tools and approaches are to be considered. A consequence of the predictability and technological uncertainty is the need for rethinking the way of regulations. RQ1 asked the students about the expected way of regulation. The results confirm that regulated work is important; 46% of the respondents ranked last the option in the questionnaire that project success will be assured by personal skills and competencies while detailed regulation is redundant. Rules defined by the team are the most popular way, followed by a continuous adaption to the changing requirements.
Related to the second research question about the success factors of product development projects, the survey confirmed appreciation of the ‘soft’ factors. When interpreting the results, it should be taken into account that the respondents are higher education students with limited experience in projects. However, it is encouraging that their opinions and attitudes mirror the challenges of the uncertain environment of the project. All listed factors represent high mean values, but the rankings signal that communication and cooperation are the most relevant success factors. At the same time, there seems to be a sense of trust in the ‘hard’ factors and external issues of the project.
The third research question investigated the clustering opportunities of the sample. Based on the statistical analysis, only a few significant results were found. The sample seems to be homogenous by the grouping factors even by the work experience of the students. Patterns of the opinions could not be determined.

5. Conclusions

The increasing complexity of the projects required adaptive project management approaches. New product development is a special area of projects since it must deliver under high technical uncertainty. The increased pressure on introducing a new product to the market faster than before, while costs and quality are controlled asks for new methods and approaches in project management. Changing the culture and refining the new procedures is time-consuming and risky. Investigating the opinions of higher education students has remarkable benefits. First, the experience of the study supports developing the learning materials in the field. The result can be a more comprehensive understanding of product development challenges, leading to more effective integration of the new workforce. Second, corporations can gain relevant information about the preparedness of the students and to find appropriate work for them. In addition, communication and problem-solving can be supported if the values are known. Third, higher education students are more often involved in real-life projects (Berényi and Vadász-Bognár 2019; Bihari and Tóbis 2019). In these cases, effective project management support is not a future aim but a present task.
The results show that the students’ opinions reflect the key success factors of product development projects in the literature. ‘Soft’ factors of projects such as communication and collaboration are appreciated. A former study among product development experts (Soltész and Berényi 2021) found the importance of teamwork, project manager’s control, and other factors of success that allow flexibility and responses to the uncertainty of the project. However, a well-defined project goal is among the most important success factors next to these. Both the experts’ and students’ surveys give a lower emphasis to the ‘hard’ factors of project management, but it cannot mean that these are not relevant anymore. Experience shows that time and cost planning or assuring the resources of the projects are considered as enablers. In other words, these remained important, but not enough for success. The survey results are encouraging in this sense. The few statistically significant differences by the grouping factors could suggest the homogeneity of the sample and common thinking of the respondents, but this must be questioned.
Despite the thorough planning of the survey, the study has some limitations. The survey included general questions; however, each project is a unique endeavor. The sample composition used a convenient method, and the universities involved were limited. Engineering, business, and IT students were separated, but they cannot cover all responsibilities and positions of product development. Another limitation comes from the fact that the results were based on the responses of higher education students. Although a large proportion of them has work experience and some were involved in product development, a general conclusion from the results is not available. The study can be considered as a pilot investigation.
Further work in the research is expanding data collection and involving new grouping factors. Another task is preparing the practical application of the experience. Projects performed in collaboration between corporations and universities offer experience in new management methods. A survey is also planned that measures the opinions of the students before, during, and after the project work. It will let us make more comprehensive conclusions on the topic and develop a framework for targeted education for future product development experts.

Author Contributions

Conceptualization, L.B. and L.S.; methodology, L.B.; validation, L.S.; formal analysis, L.B.; investigation, L.B. and L.S.; writing—original draft preparation, L.B.; writing—review and editing, L.S.; visualization, L.B.; supervision, L.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are available from the corresponding author by request.

Acknowledgments

The study was conducted as part of the OTKA T139225 project entitled “Management readiness level towards Strategic Technology Management Excellence”.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

The appendix presents detailed descriptive statistics, Spearman’s correlation coefficients, and Kruskal–Wallis H test results for the survey items.
Table A1. Descriptive statistics of the evaluations.
Table A1. Descriptive statistics of the evaluations.
ItemMeanSDSkewnessKurtosis
StatisticStatisticStatisticStd. Err.StatisticStd. Err.
Communication in the team4.051.019−0.9270.2160.1630.428
Team member selection4.030.876−0.6430.216−0.2460.428
Changing plans4.020.971−0.7240.2160.0080.428
Professional experience4.020.815−0.5860.2160.4050.428
Company and team cooperation3.980.907−0.7360.2160.4940.428
Time or cost estimate3.940.97−0.6740.2160.0040.428
Management support3.870.889−0.4950.216−0.070.428
Actions of competitors3.61.021−0.3540.216−0.2610.428
Market research3.581.068−0.330.216−0.5350.428
Project management knowledge3.560.899−0.0680.216−0.4260.428
Regulation gaps3.41.067−0.2290.216−0.7240.428
External partners3.341.037−0.070.216−0.7590.428
Table A2. Spearman’s correlation analysis results.
Table A2. Spearman’s correlation analysis results.
Survey Item (1)(2)(3)(4)(5)(6)
Changes in plans are too commonCoeff −0.091−0.0310.0870.230 **0.154
Sig. 0.310.7330.3330.010.084
Competitors move faster in development (2)Coeff 0.1340.1370.1130.118
Sig. 0.1350.1260.210.187
Lack of experience in similar development tasks (3)Coeff 0.268 **0.0740.088
Sig. 0.0020.4130.327
Bad estimate of costs or deadlines (4)Coeff 0.230 **0.187 *
Sig. 0.010.037
Lack of corporate management support (5)Coeff 0.262 **
Sig. 0.003
Project management knowledge of project managers (6)Coeff 1
Sig. 0.000
(7)(8)(9)(10)(11)(12)
Changes in plans are too commonCoeff0.0940.293 **0.339 **0.245 **0.1010.068
Sig.0.2940.00100.0060.2620.447
Competitors move faster in development (2)Coeff0.065−0.1150.0140.214 *0.0770.289 **
Sig.0.4710.1980.8760.0160.3920.001
Lack of experience in similar development tasks (3)Coeff0.0530.189 *0.120.1140.190 *0.149
Sig.0.5570.0340.1810.2040.0330.096
Bad estimate of costs or deadlines (4)Coeff0.179 *0.1630.262 **0.258 **0.196 *0.220 *
Sig.0.0450.0690.0030.0040.0280.013
Lack of corporate management support (5)Coeff0.0060.1430.0660.311 **0.1090.083
Sig.0.9470.110.46400.2260.357
Project management knowledge of project managers (6)Coeff0.179 *0.285 **0.283 **0.310 **0.247 **0.176 *
Sig.0.0450.0010.00100.0050.048
(7)(8)(9)(10)(11)(12)
Gaps in regulations (7)Coeff 0.254 **0.185 *0.188 *0.240 **0.271 **
Sig. 0.0040.0380.0350.0070.002
Improper selection of team members (8)Coeff 0.514 **0.351 **0.1340.023
Sig. 000.1340.8
Improper choice of communication solutions between team members (9)Coeff 0.401 **0.0910.188 *
Sig. 00.3110.035
Lack of cooperation between company management and the project team (10)Coeff 0.270 **0.302 **
Sig. 0.0020.001
Improper relationship with external partners (11)Coeff 0.282 **
Sig. 0.001
Insufficient market research (12)Coeff 1
Sig. 0
* Correlation is significant at the 0.05 level (2-tailed), ** Correlation is significant at the 0.01 level (2-tailed).
Table A3. Kruskal–Wallis H test results by the groping factors.
Table A3. Kruskal–Wallis H test results by the groping factors.
Gender (df = 1)Profession (df = 2)Study Level (df = 1)Work Experience (df = 2)
HSig.HSig.HSig.HSig.
Keeping written regulation0.3990.5280.5050.7770.0420.8371.3590.507
Rules defined by the project team1.0080.3150.2650.8760.0260.8730.6540.721
Adapt to the changing situations0.4260.5140.5140.7740.9510.3290.640.726
No need for detailed regulations1.4540.2281.3610.5060.5230.472.4270.297
Changes in plans are too common0.4090.5226.2350.0441.0440.3074.0090.135
Competitors move faster in development7.120.0083.8580.1451.390.2380.0970.953
Lack of experience in similar development tasks0.0340.8543.5970.1663.6850.0550.6540.721
Bad estimate of costs or deadlines0.450.5031.6280.4430.0850.770.4250.809
Lack of corporate management support0.890.3460.2490.8830.4310.5120.490.783
Project management knowledge of project managers1.2920.2560.3530.8382.1540.1423.9250.141
Gaps in regulations7.5260.0060.0290.98600.9851.6690.434
Improper selection of team members0.0460.8311.1620.5590.5060.4771.9470.378
Improper choice of communication solutions between team members0.970.3251.2790.5271.1440.2851.3190.517
Lack of cooperation between company management and the project team1.0150.3147.0170.030.9130.3393.8230.148
Improper relationship with external partners0.6190.4323.5550.1690.20.6550.1590.923
Insufficient market research2.3480.1253.260.1960.0670.7963.8220.148

References

  1. Ahmad, Sohel, Debasish N. Mallick, and Roger G. Schroeder. 2013. New product development: Impact of project characteristics and development practices on performance. Product Innovation Management 30: 331–48. [Google Scholar] [CrossRef]
  2. Andreasen, Mogens M., and Lars Hein. 1987. Integrated Product Development. Berlin/Heidelberg: Springer. [Google Scholar]
  3. Antony, Jiju, and Sandeep Gupta. 2018. Top ten reasons for process improvement project failures. International Journal of Lean Six Sigma 10: 367–74. [Google Scholar] [CrossRef]
  4. Apa, Roberta, Valentina De Marchi, Roberto Grandinetti, and Silvia R. Sedita. 2021. University-SME collaboration and innovation performance: The role of informal relationships and absorptive capacity. Journal of Technology Transfer 46: 961–88. [Google Scholar] [CrossRef]
  5. Armenia, Stefano, Rosa Maria Dangelico, Fabio Nonino, and Alessandro Pompe. 2019. Sustainable project management: A conceptualization-oriented review and a framework proposal for future studies. Sustainability 11: 2664. [Google Scholar] [CrossRef] [Green Version]
  6. Babbie, Earl. 2020. The Practice of Social Research, 15th ed. Boston: Cengage. [Google Scholar]
  7. Bejinaru, Ruxandra, Cristian Valentin Hapenciuc, Iulian Condratov, and Pavel Stanciu. 2018. The university role in developing the human capital for a sustainable bioeconomy. Amfiteatru Economic 20: 583–98. [Google Scholar] [CrossRef]
  8. Berényi, László, and Gabriella Vadász-Bognár. 2019. HEIBus: Az ipar és a felsőoktatás nemzetközi együttműködése a Miskolci Egyetemen. Magyar Minőség 28: 14–99. [Google Scholar]
  9. Bihari, János, and Zsolt Tóbis. 2019. Pneumobilok fejlesztése és építése a Miskolci Egyetem Gép- és Terméktervezési Intézetében. Multidiszciplináris Tudományok: A Miskolci Egyetem Közleménye 9: 305–16. [Google Scholar] [CrossRef]
  10. Bratianu, Constantin, Gabriela Prelipcean, and Ruxandra Bejinaru. 2020. Exploring the latent variables which support SMEs to become learning organizations. Management & Marketing. Challenges for the Knowledge Society 15: 154–71. [Google Scholar] [CrossRef]
  11. Burchardt, Carsten. 2001. Ein erweitertes Konzept für die Integrierte Produktentwicklung. In Integrierte Produktentwicklung. Edited by Sándor Vajna. Band 3. Magdeburg: Lehrstuhl für Maschinenbauinformatik, p. 208. [Google Scholar]
  12. Cooper, Robert G. 2019. The drivers of success in new-product development. Industrial Marketing Management 76: 36–47. [Google Scholar] [CrossRef]
  13. Derbyshire, James, and Emanuele Giovannetti. 2017. Understanding the failure to understand new product development failures: Mitigating the uncertainty associated with innovating new products by combining scenario planning and forecasting. Technological Forecasting and Social Change 125: 334–44. [Google Scholar] [CrossRef]
  14. Deutsch, Nikolett, Tamás Mészáros, and Lajos Szabó. 2017. Modelling the development of strategic management. In Proceedings 31st European Conference on Modelling and Simulation: ECMS 2017. Edited by Zita Zoltay-Paprika, Péter Horák, Kata Váradi, Péter T. Zwierczyk, Ágnesd Vidovics-Dancs and Péter Rádics. Regensburg: European Council for Modelling and Simulation, pp. 67–73. [Google Scholar]
  15. Ehrlenspiel, Kalus. 1991. Integrierte Produkterstellung Organisation—Methoden—Hilfsmittel. In Wettbewerbsfaktor Zeit in Produktionsunternehmen. Edited by Joachim Milberg. Berlin/Heidelberg: Springer, pp. 113–31. [Google Scholar] [CrossRef]
  16. Emam, Khaled E., and Günes A. Koru. 2008. A Replicated Survey of IT Software Project Failures. IEEE Software 25: 84–90. [Google Scholar] [CrossRef]
  17. Fekete, István, and Péter Szontágh. 2020. Projektek programszintű kockázatmenedzsmentje. Vezetéstudomány 51: 46–59. [Google Scholar] [CrossRef] [Green Version]
  18. Gerwin, Donald, and Nicholaj J. Barrowman. 2002. An evaluation of research on integrated product development. Management Science 48: 938–53. [Google Scholar] [CrossRef]
  19. González, Francisco J. M., and Tomás M. B. Palacios. 2002. The effect of new product development techniques on new product success in Spanish firms. Industrial Marketing Management 31: 261–71. [Google Scholar] [CrossRef]
  20. Görög, Mihály. 2019. Projektvezetés a Szervezetekben. Budapest: Panem. [Google Scholar]
  21. Gupta, Sandeep K., Angappa Gunasekaran, Jiju Antony, Shivam Gupta, Surajit Bag, and David Roubaud. 2019. Systematic literature review of project failures: Current trends and scope for future research. Computers & Industrial Engineering 127: 274–85. [Google Scholar] [CrossRef]
  22. Hallstedt, Sophie I., Ola Isaksson, and Anna Öhrwall Rönnbäck. 2020. The need for new product development capabilities from digitalization, sustainability, and servitization trends. Sustainability 12: 10222. [Google Scholar] [CrossRef]
  23. Hayward, Simon. 2016. Connected Leadership: How to Build a More Agile, Customer-Driven Business. Harlow: Pearson Education. [Google Scholar]
  24. Henson, Reilly V., Kelly M. Cobourn, Kathleen C. Weathers, Cayelan C. Carey, Kaitlin J. Farrell, Jennifer L. Klug, Michael G. Sorice, Nicole K. Ward, and Weizhe Weng. 2020. A practical guide for managing interdisciplinary teams: Lessons learned from coupled natural and human systems research. Social Sciences 9: 119. [Google Scholar] [CrossRef]
  25. Iqbal, Muhammad, and Amalia Suzianti. 2021. New product development process design for small and medium enterprises: A systematic literature review from the perspective of open innovation. Journal of Open Innovation: Technology, Market, and Complexity 7: 153. [Google Scholar] [CrossRef]
  26. Jones, Oswald, and Gary Stevens. 1999. Evaluating failure in the innovation process: The micropolitics of new product development. R&D Management 29: 167–78. [Google Scholar]
  27. Karakaya, Fahri, and Bulent Kobu. 1994. New product development process: An investigation of success and failure in high-technology and non-high-technology firms. Journal of Business Venturing 9: 49–66. [Google Scholar] [CrossRef]
  28. Kärkkäinen, Hannu, Petteri Piippo, and Markku Tuomine. 2001. Ten tools for customer-driven product development in industrial companies. International Journal of Production Economics 69: 161–76. [Google Scholar] [CrossRef]
  29. Lewis, Michael A. 2001. Success, failure and organisational competence: A case study of the new product development process. Journal of Engineering and Technology Management 18: 185–206. [Google Scholar] [CrossRef]
  30. Li, Jian, and Yue Yu. 2022. From collaborative research to new product development: Why a central or brokered network position is not enough. Journal of Knowledge Management 26: 615–41. [Google Scholar] [CrossRef]
  31. Meerkamm, Harald. 1995. Integrierte Produktentwicklung im Spannungsfeld von Kosten-, Zeit-und Qualitätsmanagement. VDI-Jahrbuch 95. Düsseldorf: VDI-Verlag. [Google Scholar]
  32. Olsson, Fredrick. 1985. Integrerad Produktutveckling—Arbetsmodel. Series 21 Produktutveckling; Stockholm: Sveriges Mekanförbundet. [Google Scholar]
  33. Ottosson, Stig. 1996. Dynamic product development: Findings from participating action research in a fast new product development process. Journal of Engineering Design 7: 151–69. [Google Scholar] [CrossRef]
  34. Pallant, Julie. 2020. SPSS Survival Manual: A Step by Step Guide to Data Analysis Using IBM SPSS, 7th ed. London: Open University Press. [Google Scholar]
  35. Pinto, Jeffery K., and Samuel J. Mantel. 1990. The Causes of project failure. IEEE Transactions on Engineering Management 37: 269–76. [Google Scholar] [CrossRef] [Green Version]
  36. PMI. 2017. A Guide to the Project Management Body of Knowledge (PMBOK Guide), 6th ed. Newtown Square: Project Management Institute. [Google Scholar]
  37. PMI. 2021. A Guide to the Project Management Body of Knowledge (PMBOK® Guide)—Seventh Edition and the Standard for Project Management. Newtown Square: Project Management Institute. [Google Scholar]
  38. Pollack, Julien, Jane Helm, and Daniel Adler. 2018. What is the iron triangle, and how has it changed? International Journal of Managing Projects in Business 11: 527–47. [Google Scholar] [CrossRef]
  39. Radujkovića, Mladen, and Mariela Sjekavica. 2017. Project management success factors. Procedia Engineering 196: 607–15. [Google Scholar] [CrossRef]
  40. Shenhar, Aaron J., Dov Dvir, Ofer Levy, and Alan C. Maltz. 2001. Project success: A multidimensional strategic concept. Long Range Planning 34: 699–725. [Google Scholar] [CrossRef]
  41. Shenhar, Aaron J., Ofer Levy, and Dov Dvir. 1997. Mapping the dimensions of project success. Project Management Journal 28: 5–13. [Google Scholar]
  42. Soh, Pek-Hooi, and Annapoornima M. Subramanian. 2014. When do firms benefit from university–industry R&D collaborations? The implications of firm R&D focus on scientific research and technological recombination. Journal of Business Venturing 29: 807–21. [Google Scholar] [CrossRef]
  43. Soltész, László, and László Berényi. 2021. Success factors in product development projects: Expert opinions. Journal Of Physics—Conference Series 1935: 012003. [Google Scholar] [CrossRef]
  44. Szabó, Lajos, and Gabriella Cserháti. 2013. Stratégiai projektek irányítása—A projektvezetés kihívásai. Vezetéstudomány 44: 6–13. [Google Scholar]
  45. Todorović, Maria L., Dejan Č. Petrović, Marko M. Mihić, Vladimir L. Obradović, and Sergey D. Bushuyev. 2015. Project success analysis framework: A knowledge-based approach in project management. International Journal of Project Management 33: 772–83. [Google Scholar] [CrossRef]
  46. Un, Annique C., and Kazuhiro Asakawa. 2015. Types of R&D collaborations and process innovation: The benefit of collaborating upstream in the knowledge chain. Journal of Product Innovation Management 32: 138–53. [Google Scholar] [CrossRef]
  47. Vajna, Sándor, ed. 2020. Integrated Design Engineering: Interdisciplinary and Holistic Product Development. Cham: Springer. [Google Scholar] [CrossRef]
  48. Verzuh, Erik. 2021. The Fast Forward MBA in Project Management: The Comprehensive, Easy-to-Read Handbook for Beginners and Pros, 6th ed. Hoboken: Wiley. [Google Scholar]
Figure 1. Mean value of the rankings on the approach to regulating a product development project.
Figure 1. Mean value of the rankings on the approach to regulating a product development project.
Admsci 12 00049 g001
Figure 2. Mean values of the evaluation of the failure factors.
Figure 2. Mean values of the evaluation of the failure factors.
Admsci 12 00049 g002
Figure 3. Evaluation of the failure factors, the proportion of high (four or five) ratings.
Figure 3. Evaluation of the failure factors, the proportion of high (four or five) ratings.
Admsci 12 00049 g003
Figure 4. Comparison of the evaluations by the profession of the students.
Figure 4. Comparison of the evaluations by the profession of the students.
Admsci 12 00049 g004
Table 1. Integrated Product Development models.
Table 1. Integrated Product Development models.
ModelMain FocusConditionsUtilization
Olsson (1985)Project management
Review of the economics of all
activities
Parallel processing of equivalent tasks
Integration of tasks
Pioneer of the integrated product development processIntegrative approach
Project orientation
Teamwork
Andreasen and Hein (1987)The parallel design of product versions
Using CAD solution
A stable market environment is neededTime-saving through parallel tasks
Ehrlenspiel (1991)Integration of personal, informational, and organizational levelsFlat organizational structure and management are neededExploiting human resources
Improving motivation
Meerkamm (1995)Integration through ITFlexible organization
Design for product life cycle
IT integrated performance of project tasks
Ottosson (1996)Reduced development time
Focus on product specification
Changing conditions during the project realizationFlexibility through framework thinking
Magdeburg model by Burchardt (2001)Holistic approach
Human-centered development
Process parallelization available
Available communication
Benefits of human-centered thinking
Network as a dynamic organizational form
Table 2. Description of success dimensions for low-tech and high-tech project types, based on Shenhar et al. (2001, p. 719).
Table 2. Description of success dimensions for low-tech and high-tech project types, based on Shenhar et al. (2001, p. 719).
Success DimensionProject Type: Level of Technological Uncertainty
Low-TechHigh-Tech
Project efficiencyCriticalOverruns acceptable
Impact on customerStandard productSignificantly improved capabilities
Business successReasonable profitHigh profits, market share
Preparing for the futureAlmost noneNew product line, new markets
Table 3. Survey items.
Table 3. Survey items.
GroupQuestionShort Name
Project planningChanges in plans are too commonChanging plans
Bad estimate of costs or deadlinesTime or cost estimate
Gaps in regulationsRegulation gaps
Project managementProject management knowledge of project managersProject management knowledge
Improper choice of communication solutions between team membersCommunication in the team
Lack of cooperation between company management and the project teamCompany and team cooperation
Company issuesImproper selection of team membersTeam member selection
Lack of corporate management supportManagement support
Lack of experience in similar development tasksProfessional experience
External issuesInsufficient market researchMarket research
Competitors move faster in developmentActions of competitors
Improper relationship with external partnersExternal partners
Table 4. Sample characteristics.
Table 4. Sample characteristics.
CharacteristicsItemFrequencyPercentage
GenderFemale6047.6%
Male6652.4%
Study levelBachelor8164.3%
Master4535.7%
ProfessionBusiness3931.0%
Engineering4737.3%
IT4031.7%
Work experienceNo work experience2923.0%
Internship2419.0%
Work experience7357.9%
Table 5. Distribution of the rankings on the approach to regulating a product development project.
Table 5. Distribution of the rankings on the approach to regulating a product development project.
RankKeeping Written RegulationsRules Defined by the Project TeamAdapting to the Changing SituationsNo Need for Detailed Regulations
1.22.2%38.1%17.5%22.2%
2.29.4%20.6%34.9%15.1%
3.23.0%29.4%31.0%16.7%
4.25.4%11.9%16.7%46.0%
Table 6. Rank orders of the survey item and distribution of the ratings.
Table 6. Rank orders of the survey item and distribution of the ratings.
ItemRank Order by Mean ValuesRank Order by 4 or 5 Ratings1. (%)2. (%)3. (%)4. (%)5. (%)
Team member selection2.1.0.06.317.542.933.3
Professional experience4.2.0.81.622.245.230.2
Communication in the team1.3.1.67.915.933.341.3
Company and team cooperation5.4.1.63.22340.531.7
Changing plans3.5.1.6424.63138.9
Time or cost estimate6.6.1.65.623.835.733.3
Management support7.7.0.85.625.442.925.4
Market research9.8.3.211.931.730.223
Actions of competitors8.9.3.28.734.931.721.4
Project management knowledge10.10.0.89.538.934.915.9
Regulation gaps11.11.3.21927.834.115.9
External partners12.12.2.420.631.73114.3
Table 7. Rotated component matrix of principal component analysis.
Table 7. Rotated component matrix of principal component analysis.
Item1.2.3.4.
Team member selection0.8220.0590.0910.132
Communication in the team0.7350.1750.20.192
Regulation gaps0.2150.725−0.101−0.072
External partners0.0870.5840.0240.105
Market research−0.1380.7330.1880.15
Changing plans0.4670.0670.492−0.267
Management support0.043−0.0860.7910.044
Project management knowledge0.2970.3420.3430.134
Company and team cooperation0.3230.3350.5420.207
Actions of competitors−0.4260.2440.3360.511
Professional experience0.159−0.005−0.1560.796
Time or cost estimate0.1810.1790.2630.568
Notes: In this table, the bold highlight helps to highlight the factor items.
Table 8. Alternative factor structure.
Table 8. Alternative factor structure.
ItemOriginal GroupingAlternative Structure
Communication in the teamProject managementTeam-level cooperation
Team member selectionCompany issues
Regulation gapsProject planningEnablers
Market researchExternal issues
External partnersExternal issues
Changing plansProject planningManagement competencies
Project management knowledgeProject management
Company and team cooperationProject management
Management supportCompany issues
Time or cost estimateProject planningProfessional competencies
Professional experienceCompany issues
Actions of competitorsExternal issues
Table 9. Significant results of the analysis of variance.
Table 9. Significant results of the analysis of variance.
Grouping FactorItemMean ValuesHdfSig.
ProfessionChanging plansMengineering = 3.77
Mbusiness = 4.05
MIT = 4.27
6.23520.044
ProfessionCompany and team cooperationMengineering = 3.85
Mbusiness = 3.82
MIT = 3.93
7.01720.030
GenderActions of competitorsMfemale = 3.83
Mmale = 3.38
7.12010.008
GenderRegulation gapsMfemale = 3.68
Mmale = 3.15
7.52610.006
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Berényi, L.; Soltész, L. Evaluation of Product Development Success: A Student Perspective. Adm. Sci. 2022, 12, 49. https://doi.org/10.3390/admsci12020049

AMA Style

Berényi L, Soltész L. Evaluation of Product Development Success: A Student Perspective. Administrative Sciences. 2022; 12(2):49. https://doi.org/10.3390/admsci12020049

Chicago/Turabian Style

Berényi, László, and László Soltész. 2022. "Evaluation of Product Development Success: A Student Perspective" Administrative Sciences 12, no. 2: 49. https://doi.org/10.3390/admsci12020049

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop