Next Article in Journal
Syrian SMEs in Times of COVID-19 Pandemic: Challenges, Adaptation, and Policy Measures
Previous Article in Journal
Forecasting Methods of Key Ratios and Their Impact in Company’s Value
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Factors Influencing the Success of Online Education during COVID-19: A Case Analysis of Odisha

by
Barada Prasanna Mohapatra
1,
Sudhansu Sekhar Nanda
2,*,
Chetan V. Hiremath
3,
Mahantesh Halagatti
4,
Suresh Chandra Das
5 and
Anindita Das
6
1
School of Business, ASBM University, Chandaka, Bhubaneswar 754012, Odisha, India
2
Department of Finance, Kirloskar Institute of Management, Harihar 577601, Karnataka, India
3
Department of Operations and Analytics, Kirloskar Institute of Management, Harihar 577601, Karnataka, India
4
School of Management Studies and Research, KLE Technological University, Hubballi 580031, Karnataka, India
5
Department of Commerce & Management Studies, Kendrapara Autonomous College, Kendrapara 754211, Odisha, India
6
Department of Management, Srusti Academy of Management, Bhubaneswar 751024, Odisha, India
*
Author to whom correspondence should be addressed.
J. Risk Financial Manag. 2023, 16(3), 141; https://doi.org/10.3390/jrfm16030141
Submission received: 15 December 2022 / Revised: 14 February 2023 / Accepted: 14 February 2023 / Published: 21 February 2023

Abstract

:
The COVID-19 pandemic caused by the coronavirus has dramatically changed the lives of students all around the world, with the virus’s effects profoundly impacting students’ physical and emotional well-being. Due to a series of shutdowns and lockdowns, social distancing, and further closure of schools, colleges, and institutions to ameliorate the pandemic crisis, the teaching and learning process shifted to an online form. As a result, students all over the world have been forced to deal with the problem as a last resort to accepting online education. This study looked at the efficiency of online education in the current situation and the student’s reactions. To enhance the online method of education for students, we examined the success characteristics of online education in the Indian state of Odisha. The study’s samples were collected from the faculty members of various graduate and post-graduate educational institutions in Odisha, who were recruited by questionnaire to get an expert opinion.
JEL Classification:
A20; A23; A29

1. Introduction

The recent COVID-19 pandemic outbreak in Wuhan city in December 2019 not only disrupted the course of history but also altered the way we live today (Stratton et al. 2020). Over 170 nations have been impacted by it, including the US, the UK, Italy, Pakistan, and many others. Given the interconnected and linked nature of the modern world, the COVID-19 pandemic has impacted several vital sectors, with the education sector being one of the worst affected (McKibbin and Fernando 2020). Since the spread of this pandemic, its economic effects have significantly altered both professional routines and the operational working patterns of numerous sectors, causing great concern worldwide (Wang et al. 2020). COVID-19 has caused disruptions in practically all facets of existence. Both developed and developing countries are currently looking for novel approaches to manage the core business operations of each impacted industry. Further, estimation of the end of COVID-19 appears to be unachievable, which has thus caused colleges and secondary school institutions around the world to become concerned (Crawford et al. 2020).
The COVID-19 pandemic has created stress among students regarding their academic continuity. Thus, educational institutes have been compelled to adopt emergency remote teaching (ERT), a temporary and quick instructional response to the pandemic to allow students to continue their studies. However, educational institutions have opted for online teaching processes while considering the duration and frequency of the pandemic. Online teaching pedagogy is not a quick solution as it requires time, money, training, and infrastructure for the design and implementation. Hodges et al. (2020) highlighted the difference between “Emergency Remote Teaching’ and ‘Online Learning’ and suggestions to help institutions implement temporary solutions, such as emergency remote teaching or permanent online learning based on the strengths and weaknesses of their organizations. This has sparked a wave of creative solutions, most notably in the educational field, to mitigate or lessen the impact of this pandemic on students and their academic pursuits. The industrialized nations have evolved with numerous effective techniques to manage their educational setup, particularly when we speak about the effects of the COVID-19 pandemic on the education industry (Ukpokodu 2021). Whereas underdeveloped nations lag far behind in managing their education sectors effectively due to a lack of money, experience, and inadequate infrastructure (Liguori and Winkler 2020). Although many private universities now use technology to deliver education and management internet services, they are now aware of several problems with e-learning. In contrast, many public educational institutions around the world are still establishing their digital platforms and working to remove the obvious drawbacks of the online educational system. Technology adoption in the education sector is not a novel idea because it has previously been practised in numerous ways. Examples of modern computer educational technologies include web-based learning and other applications. Nonetheless, with the current global catastrophe, there is a significant rise in the demand for technology and digital networks for education. Technology not only thrives on new teaching methods but it also improves the caliber of educational experiences.
Today’s global educational climate is extremely competitive. The growth of Internet-based computerized learning, specifically online learning, is the primary emphasis of all educators in this period of widespread digitalization (Goodman et al. 2018). Only when virtual education is supported and tailored can it be optimized (Gell-Mann 1996). According to the definition, online learning is a combination of several technologies (Wu et al. 2010), with computers serving as the system’s most crucial and potentially life-saving component. Computers are excellent at keeping track of our steady development and alerting us to any errors in reasoning so that we can remedy them (Hayashi et al. 2004). Therefore, while adopting virtual or digital education, the accessibility of computer systems is essential.
Additionally, online education is a thorough approach to learning that gives students the freedom to choose their preferred learning style (Hasnat 2009) and can support the growth of both personal and social knowledge in any nation. Good education and active learning through online courses appear to be crucial success criteria in our digital age (Siddiqui et al. 2019; Vohra 2013). A learner can build all these abilities in a virtual setting. As digital training involves the transmission of both internal and external content via information systems to improve the quality of education and the cognitive ability of students, consequently, it can directly alter students’ work habits.
The education system, the backbone of our country, has been impacted by war, riots, natural disasters, weather conditions, terrorist operations, and now COVID-19, which has already spread over to 100 nations worldwide, making it a pandemic. COVID-19 is rapidly claiming lives, and one of the preventative measures to avoid the virus is social distancing, for which the government has declared lockdowns and shutdowns to prevent the virus from spreading. To avoid social gatherings on the educational platform, all schools and colleges have been forced to close remain for indefinite periods. All courses, tests, and academic activities have been halted, and the epidemic has also affected the students. The effects of the coronavirus pandemic can be seen all across the world, with 98.5 percent of the world’s student population affected by the disrupted educational system. As the circumstances demanded and to preserve continuity in education, online education has sprung forward in full force to help students advance their careers while also keeping up with the educational industry’s competitiveness. From the month of July or August, all educational establishments in India have begun providing online education to their respective students.

2. Literature Review

Volery and Lord (2000) conducted a survey of students enrolled in an online management course at an Australian university and identified three success factors for online education: technology, the instructor, and the previous use of technology from the perspective of students, with an emphasis on the instructor as the central role for online education success. Puri (2012) outlined the essential success elements for online distance learning in higher education institutions, highlighting five variables for improving online education efficiency: learning environment, institutional administration, course assessment, services sector, and instructional design. Rohayani (2015) discussed the idea of e-learning-ready elements, as well as the e-learning variables identified by earlier researchers in higher education. He concluded that the most significant elements influencing e-learning readiness are skills and attitudes. The influencing variables and their impact on interactive e-learning were emphasized by Wan (2016). In his research article “Impact of online education in India”, Zahoor (2017) discussed the fledgling state of digital education in India, as well as how the combination of learning services and technology will deliver high value in the Indian context. Ch and Popuri (2013) emphasized the introduction of a variety of new portals for student usage, particularly the advent of edX as a worldwide learning platform for free online education. Pham et al. (2019) conducted a study on the e-learning service quality by polling 1232 college students on three factors: e-learning system quality, e-learning administration and support service quality, and e-learning teacher and course materials quality. He emphasized that the quality of the e-learning system is the most significant aspect of student happiness.
Fazil and Kesavan (2014) and Rajesh et al. (2013), identified the elements that are causing the issue, establishing a contextual connection between the variables. The structural self-interaction matrix is being developed (SSIM), which is used to create the initial reachability matrix. The finalization of the reachability matrix is the calculation of the driving forces and its dependency is divided into several tiers: the formation of a digraph, or driving power-dependence diagram, as well as a multileveled hierarchy model based on the interpretive structural model (ISM). The three dimensions of the interpretive structural model (ISM) are described by Jacob and Pramod (2013) as “I” for interpretive, “S” for structural, and “M” for modeling. Interpretive is the judgement of specialists in the same area, structural is the creation of links between the factors, and modeling is the presentation of the structure based on the significance of factors. According to Gorvett and Liu (2007), the interpretive structural model (ISM) is a computer-based technique for users dealing with complicated circumstances to determine the link between the elements. The current use of ISM in research articles, such as supply chain management, risk control decision, and mobile banking, was discussed by Jayant et al. (2015). Sreejith (2012) used the ISM methodology to provide a solid foundation for implementing green supply chain management in the construction industry. After evaluating the inter-relationships between the elements, Ambika et al. (2013) presented the interpretive structural model (ISM) to determine the factors that impact cloud computing.
Gamage et al. (2020) emphasized academic integrity in terms of delivery practices and assessment practices in universities as a challenge for the primary education sector because students are overly reliant on teachers and secondary and higher secondary students face the challenge of completing curricula and preparing for final examinations in a short period. Many colleges have advanced their students to the following semesters without using an appropriate assessment method for student evaluation. Cassibba et al. (2021) emphasized the difficulties faced by university professors while teaching mathematics through distant or online modes as this style of instruction necessitates face-to-face contact in which the instructor must provide symbols and formulae to illustrate the issues. Osman (2020) emphasized COVID-19’s global influence on education systems, as well as its impact on Sultan Qaboos University. He discussed how the university used e-learning ‘Emergency Remote Teaching’ (ERT) to meet the problems of giving equitable access to all students in remote regions where the Internet connection may be a barrier to the implementation of Emergency Remote Teaching. As a consequence of the COVID-19 pandemic, Tarkar (2020) emphasized the issues encountered by students, instructors, and parents as a result of the shift in teaching style from the offline mode to online mode. According to Partlow and Gibbs (2003), online programs should be innovative, interactive, relevant, student-centered, and focused on group-based education, with teachers making continual efforts to enhance the program. The influence of the COVID-19 epidemic on entrepreneurial education has been emphasized by Liguori and Winkler (2020), leading to the development of new resources for the online method of teaching and learning. Martin (2020) offered five essential issues for educators to consider while teaching in an online manner. The first is ‘instruction’, which may refer to load reduction instruction in clear, well-structured and manageable deliveries to give an opportunity to both students and teachers; the second is ‘content’, which should be appropriate for the level of knowledge and competence of the students. The third is’ motivation’, which refers to the motivation of a learner’s energy and effort to engage positively in the learning process. The fourth is ‘connection’, in which the interpersonal interaction between instructor and student in a peer group is extremely important to the online mode learning process. The fifth issue is ‘mental health’, as it is difficult to give aid to students suffering from mental health issues over the internet; however, this may be solved by maintaining closer contact with students to ensure ongoing moral support. Singh and Thurman (2019) conducted a systematic assessment of the literature from 1988 to 2018 to look at the definitions of online learning and the content analysis of these concepts. “Learning experiences in synchronous or asynchronous contexts using various devices such as mobile phones and computers with internet access to engage with instructors to learn” is how online learning is described. Song et al. (2004) identified the problems of online learning from the perspective of the student, including how course design, learner motivation, time management, and user-friendly technology influence the learning experience. Students believe that technology issues and a lack of knowledge of instructional goals are stumbling blocks in the online learning process. Pitambar Paudel (2021) highlighted the benefits and challenges faced by the students of higher educational institutes in Nepal by comparing online education with traditional education. The author also discussed the strategies during and after COVID-19 and suggested that the blended mode of education would be more effective, as opposed to going only for online education or only education in the traditional approach.
COVID-19 taught us that the use of the Internet for the online classes should be the final option employed to maintain continuity in the education industry. Technology development and the Internet increased the easy access to the online session, though there are disadvantages to it. It also increased the likelihood of students’ being academically dishonest. Students have often been involved in unethical practices and witnessed academic fraudulence in this online era of teaching-learning pedagogy. Serkan et al. (2012) highlighted such e-dishonesty at Midwestern University, where they developed a relationship between the involvement of e-dishonesty and the rationale for e-dishonesty. Seife and Stockton (2020) suggested that academic dishonesty can be mitigated using the proctoring system as online academic dishonesty decreased after the implementation of the proctoring system as per their research analysis. Yazici et al. (2023) compared face-to-face cheating and online cheating among Turkish university students during the pandemic time concerning the pre-pandemic period.

3. Research Gap

Based on the research paper, idea, and subsequent analysis done on the basis of reviewing the related research papers on online education during the COVID-19 pandemic, it has been found that the issues like benefits, challenges, impact on students, student satisfaction and dissatisfaction, comparison between the online education with the traditional teaching pedagogy, and many more issues highlighted by a number of authors over the time. The research work, which is still ongoing, aims to find out the solutions to the problems in the teaching–learning process. In the State of Odisha in particular, it was found that the research work on the online education system during the pandemic in educational institutes was much less. Also, few research studies have aimed to identify the success factors for online education using interpretive structural modeling (ISM) in Odisha State. This analysis will help the researchers to further explore this area of concern to acquire the solutions and suggestive measures to improve the online teaching pedagogy.

4. Methodology

Based on the research gap identified from the literature review, the following objectives were decided.
  • To identify the variables affecting online education.
  • To develop the contextual relationship between the variables.
  • To identify and rank the driving power and dependence power of the variables.
  • To develop the multilevel hierarchy model of the variables based on their driving power and dependence power.
Based on the objectives, we have applied the interpretive structural model (ISM). In this approach, we need at least eight expert opinions as an essential part of this technique (Warfield 1974). The ISM approach developed the contextual relationship between the variables using management techniques including brain-storming and nominal group techniques (Kannan et al. 2010). To collect expert opinions to understand the success factors of online education and its importance, we designed one questionnaire (Appendix A), which was circulated to 150 faculty members of different higher educational institutes (7 universities and 13 standalone colleges). Out of these, 96 questionnaires were returned by the respondents and 45 questionnaires were found complete. We selected 12 responses (7 senior professors and 5 professors with additional administrative responsibilities) based on their knowledge and duration in the academic field. We analyzed all the 12 responses collected and a convergence in the kind of relationships between the variables were identified. Finally, the results were discussed with these 12 experts to draw the final judgment. The data was collected in the month of July 2020, when the educational institutes implemented online education as the last resort.

5. Interpretive Structural Modeling (ISM)

We used the interpretive structural model (ISM) for the identification of the factors influencing the success of online education as it is a powerful mathematical-based qualitative tool, introduced by John Warfield in 1973. ISM model can be used by both individuals and groups to solve problems in complex situations (Lin and Yeh 2013). ISM is used to show the inter-relationship between the factors and develop a hierarchy model and graph (Ravi and Shankar 2005). ISM is used to develop the specific relationship between the factors of interest and to develop the graphical model or diagraph (Sage 1997). ISM provides a direction, realistic decisions, and an ordered framework to the complex situation faced by the researchers by involving the variables in analysis (Rajesh et al. 2013). Authors have used the ISM model to analyze different complex problems; for example, Mandal and Deshmukh (1994) used this model to select the vendors based on some criteria and explained the inter-relationships between these criteria. Singh et al. (2003) have used the ISM in the engineering industry for the successful implementation of knowledge management. Ravi et al. (2005) used this ISM model in the reverse logistic supply chain management in the computer hardware section to improve their performance. Sharma et al. (1995) used the ISM model in waste management and the action plan was designed to develop the hierarchy to solve issues regarding the future of the waste management in India. Thakkar et al. (2008) used the ISM in supply chain and compared the relationships in small and medium-scale enterprise (SME) sectors. Meghraj and Sridhar (2016) used ISM to analyze the factors involved in the successful implementation of total productive maintenance in a machine shop.
In this analysis, we aim to identify the relevant factors of online education and will prepare the structural self-interaction matrix (SSIM), the initial reachability matrix, the final reachability matrix, the driving power and dependence power matrix, the level of partition, the driving power and dependence power diagraph and multilevel hierarchy model. These are the steps for this ISM approach.

6. Case Analysis

In our study, we focused on ten elements that influence the success of online learning in the educational institutions. The study is based on the educational establishments in Odisha and the criteria were considered after consulting with the professionals and the academics from the state. Some of these factors are listed as follows:
Effective team work (ETW): Effective teamwork in the workplace, with both teaching and non-teaching employees working together to enable online education, can provide positive results. There will be no coordination between the staffs if they do not work together, which will result in a futile attempt.
Infrastructure and technology (IT): The necessary infrastructure and up-to-date technology will aid in the seamless and effective delivery of online programs.
Cost of project (COP): The success of the program will be determined by the project’s cost, as providing these services to the students requires the necessary infrastructure, technology, and trained staff.
Internet connectivity (IC): For students to participate in online classes, they must have access to the internet. It is difficult to hold online lessons without any access to the internet.
Power supply (PS): To operate the online classes efficiently, power is necessary to support the process and technology. The internet connections and other electrical devices needed for online classes will be made more accessible with a reliable and consistent power supply.
Trained manpower (TM): A trained workforce will boost the organization’s production by delivering results that are based on their abilities and knowledge. The success of online education will be aided by well-trained personnel who will make the process and operations run smoothly.
Student participation (SP): Students will be encouraged to participate by providing all of the necessary amenities. Students will be interested in enrolling in the online programs if the authority and skilled personnel of the organization provide support in all the areas.
Method of teaching (MOT): Offline classes and online classes have distinct teaching methods. The teaching method in online classrooms should be developed to encourage students to participate, and this is dependent on the availability of skilled people and physical facilities, as well as the organization’s support.
Organization support (OS): It is a critical component for executing any type of program in the organization since we cannot achieve the success that we expected and planned without the support of the organization, which includes the support of the authority and top-level management. As a result, government funding can facilitate other variables such as project cost, skilled labour recruitment, internet services, and other physical infrastructure.
Effective study environment (ESE): To ensure the success of any program, we must establish a conducive learning atmosphere in which everyone is eager to share and receive the information. With the aid of modern technology, the authorities and experienced personnel, this atmosphere can be established.
Structural Self-Interaction Matrix (SSIM). We utilized statistical tools to rank the elements in order of relevance in our research. We utilized the interpretive structural model (ISM) approach to conduct our research, considering the ten criteria listed above. The structural self-interaction matrix (SSIM), shown in Table 1, is used to determine the contextual connection between the variables. To establish a link between the variables, the ISM model employs management approaches such as brainstorming and nominal group methodology. The direction of the relationship between the variables i and ‘j’ is represented by four symbols (Sudarshan and Ravi 2013). A structural self-interaction matrix (SSIM) is prepared to measure the contextual relationship among the variables/factors by comparing the variables by assigning one possible relationship (i.e, ‘V’, ‘A’, ‘X’ or ‘O’).
The symbols are as follows:
  • V—Factor ‘i’ influences factor ‘j’ but factor ‘j’ does not influence factor ‘i’.
  • A—Factor ‘i’ does not influence factor ‘j’ but factor ‘j’ influences factor ‘i’.
  • X—Factor ‘i’ influences factor ‘j’ and factor ‘j’ influences factor ‘i’.
  • O—There is no relation between ‘I’ and ‘j’.

7. Initial Reachability Matrix

The structural self-interaction matrix (SSIM) is transformed in the format of the reachability matrix by transforming the information in each entry of SSIM into ‘1s’ and ‘0s’ in the reachability. The initial reachability matrix is designed by using some rules, which can be obtained from the SSIM (Table 1), regarding the pair-wise comparison of different factors. The initial reachability matrix is shown in binary form i.e., 1 and 0 (Table 2). The rules can be:
If (i, j) entry in SSIM is V, then the (i, j) will be ‘1′ and (j, i) will be ‘0′ in the initial reachability matrix. (eij = 1 & eji = 0)
If (i, j) entry in SSIM is A, then the (i, j) will be ‘0′ and (j, i) will be ‘1′ in the initial reachability matrix. (eij = 0 & eji = 1)
If (i, j) entry in SSIM is X, then both (i, j) and (j, i) will be ‘1′ in the initial reachability matrix. (eij = 1 & eji = 1)
If (i, j) entry in SSIM is o, then both (i, j) and (j, i) will be ‘0′ in the initial reachability matrix. (eij = 0 & eji = 0)

8. Final Reachability Matrix

We may use the transitivity check to construct a consistent model from the variables when generating the Final reachability matrix. The transitivity check in ISM is based on the premise that if “A” is linked to “B”, and “B” is related to “C”, “A” is related to “C”. If the factor “I” is linked to “k”, and “k” is related to “j”, then “I” is related to “j”.
Here, the link between “i” to “k” is the direct link and is denoted as “1”, and the link between “i” and “j” is the transitive or indirect link, which will be denoted as “1 *”.
In our analysis, e.g., ‘IT’ influence ‘COP’ and ‘COP’ influence ‘PS’, so based on the transitivity relation, ‘IT’ will influence ‘PS’ and this relation is denoted as “1 *”. Final reachability matrix will be prepared based on all transitivity checks (Table 3 shows the results).

9. Driving Power and Dependence Power Matrix

We can now determine the driving power and dependence power of each component after obtaining the final reachability matrix. The results show that each variable drives x number of variables and is dependent on x amount of variables. As a result, we may add the matrix horizontally and vertically to determine the driving power and factor dependencies (Table 4).
Calculate the sum of rows and columns of matrix ‘S’. The sum of rows is denoted as ‘R’ and the sum of columns is denoted as ‘C’.
  • S = [ t ij ] n × n , i , j = { 1 , 2 , 3 , n } ,
  • R = j = 1 n t ij n × 1 = [ t ij ] n × 1 ,
  • C = i = 1 n t ij 1 × n = [ t ij ] 1 × n ,

10. Level of Partition

The final reachability matrix for each factor may be used to calculate the partition level. Reachability set (R), antecedent set (C), and interaction set (I) are examples of levels (RC). The reachability set (R) includes the factor and any other factors that it may influence, whereas the antecedent set (C) includes the factor and any other elements that may affect it. The interaction set (RC) is derived from all of the elements in order to identify the levels that will be used to construct the ISM hierarchical structural model. Table 5 shows the partitioning level (includes Level-1, 2, 3, 4, 5, 6, and 7).

11. MICMAC Analysis

Matriced‘Impactscroises-multiplication appliqu’e an classment (cross-impact matrix multiplication applied to classification), i.e., MICMAC analysis is used to analyze the driving power and dependence power of the variables (Attri et al. 2015). MICMAC analysis is based on the multiplication properties of matrices (Sharma et al. 1995). Based on the driving power and dependence power, the variables are classified into four quadrants (Faisal 2010). Also prepared the driving power and dependence power diagraph (Figure 1).
All the variables are displayed in four quadrants, i.e.,
Quadrant I (autonomous factors)—Those factors with weak driving power and weak dependence power will come under this quadrant. There is no factor preserved in this region.
Quadrant II (dependent Factors)—Those factors with weak driving power and a strong dependence power will come under this quadrant. The factors TM (6), ETW (1), MOT (8), ESE (10) and SP (7) are preserved in this quadrant.
Quadrant III (Linked Factors)—Those factors with strong driving power and strong dependence power will come under this quadrant. There is no factor preserved in this region.
Quadrant IV (Independent factors)—Those factors with strong driving power and weak dependence power will come under this quadrant. The factors OS (9), IT (2), COP (3), IC (4), and PS (5) are preserved in this quadrant.

12. Multilevel Hierarchy Model

We can now design the interpretive structural model (ISM) hierarchy model (Figure 2) using the level partition table (Table 5), in which all of the levels of the hierarchy model will be occupied by those components that have the same reachability and interaction sets. The variables in our study are divided into five tiers, i.e., L1 = (7), L2 = (10), L3 = (8), L4 = (1), L5 = (6), L6 = (2, 3, 4, 5), L7 = (9).
Factor OS (9) is dependent on 1 factor, i.e., itself (OS) and driving 10 factors, including itself (IT, COP, IC, PS, TM, ETW, MOT, ESE, SP, OS). Factor IT (2) is dependent on 5 factors including itself (IT, COP, IC, PS, OS) and driving 9 factors, including itself (IT, COP, IC, PS, TM, ETW, MOT, ESE, SP).
Factor COP (3) is dependent on 5 factors, including itself (IT, COP, IC, PS, OS) and driving 9 factors, including itself (IT, COP, IC, PS, TM, ETW, MOT, ESE, SP).
Factor IC (4) is dependent on 5 factors, including itself (IT, COP, IC, PS, OS) and driving 9 factors, including itself (IT, COP, IC, PS, TM, ETW, MOT, ESE, SP).
Factor PS (5) is dependent on 5 factors, including itself (IT, COP, IC, PS, OS) and driving 9 factors, including itself (IT, COP, IC, PS, TM, ETW, MOT, ESE, SP).
Factor TM (6) is dependent on 6 factors, including itself (TM, IT, COP, IC, PS, OS) and driving 5 factors, including itself (TM, ETW, MOT, ESE, SP).
Factor ETW (1) is dependent on 7 factors, including itself (ETW, TM, IT, COP, IC, PS, OS) and driving 4 factors, including itself (ETW, MOT, ESE, PS).
Factor MOT (8) is dependent on 8 factors, including itself (MOT, ETW, TM, IT, COP, IC, PS, OS) and driving 3 factors, including itself (MOT, ESE, SP).
Factor ESE (10) is dependent on 9 factors, including itself (ESE, MOT, ETW, TM, IT, COP, IC, PS, OS) and driving 2 factors, including itself (ESE, SP).
Factor SP (7) is dependent on 10 factors, including itself (SP, ESE, MOT, ETW, TM, IT, COP, IC, PS, OS) and driving 1 factors, i.e., itself (PS).

13. Discussion and Conclusions

During COVID-19, it is critical to analyze the variables impacting the success of online education in Odisha. We created a link between the elements in our study to assign emphasis on a priority basis for the proper implementation of online education. Data collected from the experts were interpreted using the interpretive structural model (ISM) and MICMAC analysis.
The factors ‘Organization support” is at the bottom level (Figure 1) of the hierarchy and has the highest driving power, which means the factor is the most important factor for the success of online education as it drives all other nine factors. The authority should provide all the support in terms of resources and a conducive environment for the successful implementation of online education. This factor comes under Quadrant-IV (Figure 1), which is for the independent factors.
Factors such as “Infrastructure & Technology”, “Cost of Project”, “Internet connectivity”, and “Power supply” are in level-6. Each of these variables has a driving power of 9 and dependence power 5, including themselves. The factor “Organization support” is driving these factors, and subsequently, these factors will drive the factor “Trained manpower”, which is in level-5. The factor “Trained manpower” drives the factor “Effective team work”, and it will drive another factor, “Method of Teaching”. The management should understand that the four factors in level-6 ultimately create the “trained manpower”, and this will facilitate “Effective team work” as, if the manpower is well trained, then the better the teamwork will be in the workplace. “Effective team work” will facilitate the factor “Method of teaching” as the better team can arrange all the facilities required to run the online sessions. The authority should understand that, if the method of teaching will be improved, then the study environment will be created and students will be eager to participate in the online classes organized by the institution. For any online education, the organization’s or authority’s support will be critical. Without support, we will not be able to spend money on the project in order to acquire the necessary infrastructure and internet access, which will create a conducive environment and encourage everyone to contribute effectively to the program’s success. To improve the use of such systems, educational institutes should think about providing instructors and other support personnel with training in troubleshooting and emergency preparation. No matter a person’s gender or level of prior educational attainment, our conceptual approach and findings can be adapted to online learning tools and are effective for everyone.

14. Limitations and Scope for Future Research

The study has certain limitations. First, the research is confined only to the state of Odisha and covers its higher educational institutes. Second, the analysis is based on the expert opinion, and may thus have some sort of bias as 12 expert opinion were taken for the analysis. The researchers may include more expert opinions to reduce this bias. Third, we have identified 10 variables for our analysis, and furthermore, such variables may be identified in future research to make the analysis on online education a robust one. In order to analyze the variables, other statistical tools can be used to find solutions concerned to the education sector.

Author Contributions

Conceptualization: B.P.M.; Methodology: B.P.M.; Formal analysis: B.P.M.; Writing—Original Draft: S.S.N., C.V.H. and S.C.D.; Writing—Review and editing: S.S.N. and A.D.; Investigation: M.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research has received no external funding.

Data Availability Statement

This analysis did not report any data.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Appendix A

Questionnaire for experts
Name of the Respondent………………………………………………………………………..
Designation………………………………………………………………………………………
Organization……………………………………………………………………………………
Gender…………………………. Age……………………
Years of Experience…………………………………………..
Job Profile…………………………………………………………………………………………
The table is designed to register the perception of the academic professionals regarding the factors for the success of online education in the higher educational institutes. This will help to create a contextual relationship between the factors to decide their driving power and dependence power.
Please fill in the white boxes of the Table using one of the following symbols:
V—Factor ‘i’ influences factor ‘j’ but factor ‘j’ does not influence factor ‘i’
A—Factor ‘i’ does not influence factor ‘j’ but factor ‘j’ influences factor ‘i’
X—Factor ‘i’ influences factor ‘j’and factor ‘j’ influences factor ‘i’
O—There is no relation between ‘I’ and ‘j’
Jrfm 16 00141 i001
Thank you very much for your support.

References

  1. Ambika, Devi Amma T., V. R. Pramod, and N. Radhika. 2013. Modeling the interrelationship between the enablers of cloud computing. International Journal of Computers and Applications 67: 38–43. [Google Scholar]
  2. Attri, Rajesh, Sandeep Grover, Nikhil Dev, and Deepak Kumar. 2015. An ISM approach for modelling the enablers in the implementation of Total Productive Maintenance (TPM). International Journal of System Assurance Engineering & Management 4: 313–26. [Google Scholar]
  3. Cassibba, Rosalinda, Daniela Ferrarello, Maria Flavia Mammana, Pasquale Musso, Mario Pennisi, and Eugenia Taranto. 2021. Teaching Mathematics at Distance: A Challenge for Universities. Education Sciences 11: 1. [Google Scholar] [CrossRef]
  4. Ch, Sai Kiran, and Sushmitha Popuri. 2013. Impact of online education: A study on online learning platforms and edX. Paper presented at the IEEE International Conference in MOOC, Innovation and Technology in Education (MITE), Jaipur, India, December 20–22; pp. 366–70. [Google Scholar]
  5. Crawford, Joseph, Kerryn Butler-Henderson, Jürgen Rudolph, Bashar Malkawi, Matt Glowatz, Rob Burton, Paola Magni, and Sophia Lam. 2020. COVID-19: 20 countries’ higher education intra-period digital pedagogy responses. Journal of Applied Learning & Teaching 3: 1–20. [Google Scholar]
  6. Faisal, Mohd Nishat. 2010. Analysing the barriers to corporate social responsibility in supply chains: An interpretive structural modelling approach. International Journal of Logistics: Research and Applications 13: 179–95. [Google Scholar] [CrossRef]
  7. Fazil, B. Mohmed, and R. Kesavan. 2014. Vendor slection in Supply chain management using ISM and ANP. IOSR Journal of Mechanical and Civil Engineering 3: 81–89. [Google Scholar]
  8. Gamage, Kelum A. A., Erandika K. De Silva, and Nanda Gunawardhana. 2020. Online Delivery and Assessment during COVID-19: Safeguarding Academic Integrity. Education Sciences 10: 301. [Google Scholar] [CrossRef]
  9. Gell-Mann, Murray. 1996. A commentary to R Schank. In The Third Culture: Beyond the Scientific Revolution. Edited by John Brockman. New York: Simon & Schuster. [Google Scholar]
  10. Goodman, Joshua, Julia Melkers, and Amanda Pallais. 2018. Can Online Delivery Increase Access to Education? Journal of Labor Economics 37: 1–34. [Google Scholar] [CrossRef] [Green Version]
  11. Gorvett, Rick, and Ningwei Liu. 2007. Using Interpretive Structural Modeling to Identify and Quantify Interactive Risks. ASTIN Colloquium Call For Papers 24: 56–84. [Google Scholar]
  12. Hasnat, Farhana. 2009. Developing an Online Learning Environment for CSE-110 at BRAC University. Bachelor’s thesis, Department of Computer Science and Engineering, BRAC University, Dhaka, Bangladesh. [Google Scholar]
  13. Hayashi, Albert, Charlie Chen, and Terry Ryan. 2004. The Role of Social Presence and Moderating Role of Computer Self Efficacy in Predicting the Continuance Usage of E-Learning Systems. Journal of Information Systems Education 15: 139–55. [Google Scholar]
  14. Hodges, Charles, Stephanie Moore, Barbara Lockee, Torrey Trust, and Mark A. Bond. 2020. The Difference between Emergency Remote Teaching and Online Learning. EDUCAUSE Review. Available online: http://hdl.handle.net/10919/104648 (accessed on 21 July 2021).
  15. Jacob, George P., and V. R. Pramod. 2013. ISM for analyzing the safety of SRRMs. International Journal of Scientific and Research Publications 3: 1–9. [Google Scholar]
  16. Jayant, A., Mohammed Azhar, and Priya Singh. 2015. Interpretive Structural Modeling (ISM) Approach: A State of the Art Literature Review. International Journal of Research in Mechanical Engineering and Technology 5: 15–21. [Google Scholar]
  17. Kannan, Govindan, Devika Kannan, and A. Noorul Haq. 2010. Analyzing supplier development criteria for an automobile industry. Industrial Management Data Systems 110: 43–62. [Google Scholar]
  18. Liguori, Eric W., and Christoph Winkler. 2020. From offline to online: Challenges and Opportunities for entrepreneurial education following the COVOD-19 pandemic. Entrepreneurship Education and Pedagogy 3: 346–51. [Google Scholar] [CrossRef] [Green Version]
  19. Lin, Ling-Zhong, and Huery-Ren Yeh. 2013. Analysis of tour values to develop enablers using an interpretive hierarchy-based model in Taiwan. Tourism Management 34: 133–44. [Google Scholar] [CrossRef]
  20. Mandal, Anukul, and S. G. Deshmukh. 1994. Vendor selection using interpretive structural modeling (ISM). International Journal of Operations and Production Management 14: 52–59. [Google Scholar] [CrossRef]
  21. Martin, Andrew J. 2020. How to Optimize Online Learning in the Age of Coronavirus (COVID-19): A 5-Point Guide for Educators. Sydney: UNSW Newsroom. [Google Scholar]
  22. Meghraj, and Sridhar. 2016. An ISM-Based Analysis for Modelling Factors in Machine Shop for the Implementation of Total Productive Maintenance (TPM). International Research Journal of Engineering and Technology (IRJET) 3: 1821–30. [Google Scholar]
  23. McKibbin, Warwick, and Roshen Fernando. 2020. The Global Macroeconomic Impacts of COVID-19: Seven Scenario. CAMA Working Paper No. 19/2020. Available online: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3547729 (accessed on 21 July 2021).
  24. Osman, Mohamed E. 2020. Global impact of COVID-19 on education systems: The emergency remote teaching at Sultan Qaboos University. Journal of Education for Teaching, International Research and Pedagogy 46: 463–71. [Google Scholar]
  25. Partlow, Karen M., and William Gibbs. 2003. Indicators of Constructivist principles in internet-based courses. Journal of Computing in Higher Education 14: 68–97. [Google Scholar] [CrossRef] [Green Version]
  26. Paudel, Pitambar. 2021. Online Education: Benefits, challenges and strategies during and after COVID-19 in higher education. International Journal on Studies in Education 3: 70–85. [Google Scholar] [CrossRef]
  27. Pham, Long, Yam B. Limbu, Trung K. Bui, Hien T. Nguyen, and Huong T. Pham. 2019. Does e-learning service quality influence e-learning student satisfaction and loyalty? Evidence from Vietnam. International Journal of Educational Technology in Higher Education 16: 7. [Google Scholar] [CrossRef] [Green Version]
  28. Puri, Goldi. 2012. Critical success factors in e-learning—An empirical study. International Journal of Multidisciplinary Research 2: 149–61. [Google Scholar]
  29. Rajesh, Attri, Dev Nikhil, and Sharma Vivek. 2013. Interpretive structural modeling (ISM) approach: An overview. Research Journal of Management Sciences 2: 3–8. [Google Scholar]
  30. Ravi, V., and Ravi Shankar. 2005. Analysis of interactions among the barriers of reverse logistics. Technological Forecasting and Social Change 72: 1011–29. [Google Scholar] [CrossRef]
  31. Ravi, V., Ravi Shankar, and M. K. Tiwari. 2005. Productivity improvement of a computer hardware supply chain. International Journal of Production and Performance Measurement 54: 239–55. [Google Scholar] [CrossRef] [Green Version]
  32. Rohayani, A. Hetty. 2015. A Literature Review: Readiness factors to Measuring e-Learning Readiness in Higher Education. Procedia Computer Science 59: 230–34. [Google Scholar] [CrossRef] [Green Version]
  33. Sage, A. 1997. Interpretive Structural Modeling: Methodology for Large-Scale Systems. New York: McGraw-Hill, pp. 91–164. [Google Scholar]
  34. Seife, Dendir, and Maxwell Stockton. 2020. Cheating in online courses: Evidence from online proctoring. Computers in Human Behavior Report 2: 1–10. [Google Scholar]
  35. Serkan, Sendag, Duran Mesut, and Fraser Robert. 2012. Surveying the extent of involvement in online academic dishonesty (e-dishonesty) related practices among university students and the rationale students provide: One university’s experience. Computers in Human Behavior 28: 849–60. [Google Scholar]
  36. Sharma, Hemendra D., Anand D. Gupta, and Sushil. 1995. The objectives of waste management in India: A future inquiry. Technol Forecast Soc Change 48: 285–309. [Google Scholar] [CrossRef]
  37. Siddiqui, Moiz Uddin Ahmed, Hina Saeed, and Shahid Farid. 2019. Online Support Services in Online learning: A Technology Acceptance Model. Sukkur IBA Journal of Computing and Mathematical Sciences 2: 22–29. [Google Scholar]
  38. Singh, Vandana, and Alexander Thurman. 2019. How many ways can we define online learning? A systematic literature review of definitions of online learning (1998–2018). American Journal of Distance Education 33: 289–306. [Google Scholar] [CrossRef]
  39. Singh, M. D., Ravi Shankar, Rakesh Narain, and Ashish Agarwal. 2003. An interpretive structural modeling of knowledge management in engineering industries. Journal of Advances in Management Research 1: 28–40. [Google Scholar] [CrossRef]
  40. Song, Liyan, Ernise S. Singleton, Janette R. Hill, and Myung Hwa Koh. 2004. Improving online learning: Student perceptions of useful and challenging characteristics. The Internet and Higher Education 7: 59–70. [Google Scholar] [CrossRef]
  41. Sreejith, Balasubramanian. 2012. A Hierarchy framework of barriers to Green supply chain management in the construction sector. Journal of Sustainable Development 5: 15–27. [Google Scholar]
  42. Stratton, Charles, Hongzhou Lu, and Yi-Wei Tang. 2020. The Wuhan SARS-CoV-2—What’s Next for China. Journal of Medical Virology 92: 546–47. [Google Scholar] [CrossRef] [Green Version]
  43. Sudarshan, Kumar, and Kant Ravi. 2013. Supplier selection process enablers: An interpretive structural modeling approach. International Journal of Mechanical and Industrial Engineering 3: 89–95. [Google Scholar]
  44. Tarkar, Preeti. 2020. Impact of COVID-19 Pandemic On Education System. International Journal of Advanced Science and Technology 29: 3812–14. [Google Scholar]
  45. Thakkar, Jitesh, Arun Kanda, and S. G. Deshmukh. 2008. Evaluation of buyersupplier relationships using an integrated mathematical approach of interpretive structural modeling (ISM) and graph theoretic approach. Journal of Manufacturing Technology Management 19: 92–124. [Google Scholar] [CrossRef]
  46. Ukpokodu, Omiunota N. 2021. Marginalization of Social Studies Teacher Preparation for Global Competence and Global Perspectives Pedagogy: A Call for Change. Journal of International Social Studies 10: 3–34. [Google Scholar]
  47. Volery, Thierry, and Deborah Lord. 2000. Critical success factors in online education. The International Journal of Educational Management 14: 216–23. [Google Scholar] [CrossRef] [Green Version]
  48. Vohra, M. Haseeb. 2013. Online Learning in Pakistan. Available online: http://www.hamariweb.com/articles/article.aspx?id=32766 (accessed on 21 July 2021).
  49. Wan, Au Thien. 2016. Influencing Factors in Using Interactive E-Learning Tool. Open Journal of Social Sciences 4: 211–16. [Google Scholar] [CrossRef] [Green Version]
  50. Warfield, John N. 1974. Developing subsystem matrices in structural modeling. IEEE Transactions on Systems, Man and Cybernetics 1: 74–80. [Google Scholar] [CrossRef]
  51. Wang, Chen, Peter W. Horby, Frederick G. Hayden, and George F. Gao. 2020. A novel coronavirus outbreak of global health concern. The Lancet 395: 470–73. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  52. Wu, Jen-Her, Robert D. Tennyson, and Tzyh-Lih Hsia. 2010. A study of staff satisfaction in a blended e-learning system environment. Computers & Education 55: 155–64. [Google Scholar]
  53. Yazici, Sedat, Hatice Yildiz Durak, Beyza Aksu Dünya, and Burcu Şentürk. 2023. Online versus face-to-face cheating: The prevalence of cheating behaviours during the pandemic compared to the pre-pandemic among Turkish University students. Journal of Computer Assisted Learning 39: 231–54. [Google Scholar] [CrossRef]
  54. Zahoor, Ahmed Lone. 2017. Impact of Online Education in Indian. International Journal of Engineering Science and Computing 7: 13950–52. [Google Scholar]
Figure 1. Driving power and dependence power diagraph. (Source: Survey data and author’s calculation).
Figure 1. Driving power and dependence power diagraph. (Source: Survey data and author’s calculation).
Jrfm 16 00141 g001
Figure 2. ISM multilevel hierarchy model. (Source: Survey data and author’s calculation).
Figure 2. ISM multilevel hierarchy model. (Source: Survey data and author’s calculation).
Jrfm 16 00141 g002
Table 1. Structural self-interaction matrix (SSIM).
Table 1. Structural self-interaction matrix (SSIM).
1-ETW2-IT3-COP4-IC5-PS6-TM7-SP8-MOT9-OS10-ESE
1-ETWXAOAAAVVAV
2-IT XXVAVVVAV
3-COP XXXVOVAO
4-IC XAOVVAV
5-PS XOVVAV
6-TM XVVAV
7-SP XOAA
8-MOT XAV
9-OS XV
10-ESE X
(Source: Survey data and author’s calculation). The above matrix is a symmetrical matrix.
Table 2. Initial reachability matrix of SSIM.
Table 2. Initial reachability matrix of SSIM.
1-ETW2-IT3-COP4-IC5-PS6-TM7-SP8-MOT9-OS10-ESE
1-ETW1000001101
2-IT1111011101
3-COP0111110100
4-IC1011001101
5-PS1011101101
6-TM1000011101
7-SP0000001000
8-MOT0000000101
9-OS1111111111
10-ESE0000001001
(Source: Survey data and author’s calculation).
Table 3. The final reachability matrix of SSIM.
Table 3. The final reachability matrix of SSIM.
1-ETW2-IT3-COP4-IC5-PS6-TM7-SP8-MOT9-OS10-ESE
1-ETW1000001101
2-IT11111 *11101
3-COP1 *111111 *101 *
4-IC11 *111 *1 *1101
5-PS11 *1111 *1101
6-TM1000011101
7-SP0000001000
8-MOT0000001 *101
9-OS1111111111
10-ESE0000001001
(Source: Survey data and author’s calculation). *: It shows the relationship based on transitivity check.
Table 4. Calculation of driving power and dependence power of SSIM.
Table 4. Calculation of driving power and dependence power of SSIM.
1-ETW2-IT3-COP4-IC5-PS6-TM7-SP8-MOT9-OS10-ESEDriving Power
1-ETW10000011014
2-IT11111 *111019
3-COP1 *111111 *101 *9
4-IC11 *111 *1 *11019
5-PS11 *1111 *11019
6-TM10000111015
7-SP00000010001
8-MOT0000001 *1013
9-OS111111111110
10-ESE00000010012
Dependence75555610819
(Source: Survey data and author’s calculation). *: It shows the relationship based on transitivity check.
Table 5. Level of partition using ISM Analysis.
Table 5. Level of partition using ISM Analysis.
LEVEL-1
FactorsReachability Set (R)Antecedent Set (C)Intersection Set (RC)
11,7,8,101,2,3,4,5,6,91
21,2,3,4,5,6,7,8,102,3,4,5,92,3,4,5
31,2,3,4,5,6,7,8,102,3,4,5,92,3,4,5
41,2,3,4,5,6,7,8,102,3,4,5,92,3,4,5
51,2,3,4,5,6,7,8,102,3,4,5,92,3,4,5
61,6,7,8,102,3,4,5,6,96
771,2,3,4,5,6,7,8,9,107
87,8,101,2,3,4,5,6,8,98
91,2,3,4,5,6,7,8,9,1099
107,101,2,3,4,5,6,8,9,1010
LEVEL-2
FactorsReachability Set (R)Antecedent Set (C)Intersection Set (RC)
11,8,101,2,3,4,5,6,91
21,2,3,4,5,6,8,102,3,4,5,92,3,4,5
31,2,3,4,5,6,8,102,3,4,5,92,3,4,5
41,2,3,4,5,6,8,102,3,4,5,92,3,4,5
51,2,3,4,5,6,8,102,3,4,5,92,3,4,5
61,6,8,102,3,4,5,6,96
88,101,2,3,4,5,6,8,98
91,2,3,4,5,6,8,9,1099
10101,2,3,4,5,6,8,9,1010
LEVEL-3
FactorsReachability Set (R)Antecedent Set (C)Intersection Set (RC)
11,81,2,3,4,5,6,91
21,2,3,4,5,6,82,3,4,5,92,3,4,5
31,2,3,4,5,6,82,3,4,5,92,3,4,5
41,2,3,4,5,6,82,3,4,5,92,3,4,5
51,2,3,4,5,6,82,3,4,5,92,3,4,5
61,6,82,3,4,5,6,96
881,2,3,4,5,6,8,98
91,2,3,4,5,6,8,999
LEVEL-4
FactorsReachability Set (R)Antecedent Set (C)Intersection Set (RC)
111,2,3,4,5,6,91
21,2,3,4,5,62,3,4,5,92,3,4,5
31,2,3,4,5,62,3,4,5,92,3,4,5
41,2,3,4,5,62,3,4,5,92,3,4,5
51,2,3,4,5,62,3,4,5,92,3,4,5
61,62,3,4,5,6,96
91,2,3,4,5,6,999
LEVEL-5
FactorsReachability Set (R)Antecedent Set (C)Intersection Set (RC)
22,3,4,5,62,3,4,5,92,3,4,5
32,3,4,5,62,3,4,5,92,3,4,5
42,3,4,5,62,3,4,5,92,3,4,5
52,3,4,5,62,3,4,5,92,3,4,5
662,3,4,5,6,96
92,3,4,5,6,999
LEVEL-6
FactorsReachability Set (R)Antecedent Set (C)Intersection Set (RC)
22,3,4,52,3,4,5,92,3,4,5
32,3,4,52,3,4,5,92,3,4,5
42,3,4,52,3,4,5,92,3,4,5
52,3,4,52,3,4,5,92,3,4,5
92,3,4,5,999
LEVEL-7
FactorsReachability Set (R)Antecedent Set (C)Intersection Set (RC)
9999
The discovered factors are partitioned into seven levels, as shown in Table 5: L1 = (7), L2 = (10), L3 = (8), L4 = (1), L5 = (6), L6 = (2,3,4,5), L7 = (9).
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Mohapatra, B.P.; Nanda, S.S.; Hiremath, C.V.; Halagatti, M.; Das, S.C.; Das, A. Factors Influencing the Success of Online Education during COVID-19: A Case Analysis of Odisha. J. Risk Financial Manag. 2023, 16, 141. https://doi.org/10.3390/jrfm16030141

AMA Style

Mohapatra BP, Nanda SS, Hiremath CV, Halagatti M, Das SC, Das A. Factors Influencing the Success of Online Education during COVID-19: A Case Analysis of Odisha. Journal of Risk and Financial Management. 2023; 16(3):141. https://doi.org/10.3390/jrfm16030141

Chicago/Turabian Style

Mohapatra, Barada Prasanna, Sudhansu Sekhar Nanda, Chetan V. Hiremath, Mahantesh Halagatti, Suresh Chandra Das, and Anindita Das. 2023. "Factors Influencing the Success of Online Education during COVID-19: A Case Analysis of Odisha" Journal of Risk and Financial Management 16, no. 3: 141. https://doi.org/10.3390/jrfm16030141

Article Metrics

Back to TopTop