1. Introduction
With the continuous improvement in the integration of network information technology and higher education, online teaching, a new business type in the Internet era, is constantly embedded into the school system in the process of market-oriented operation. In order to hedge the influence of COVID-19 and ensure that colleges and universities are “closed without suspension”, online teaching is quickly implanted in colleges and universities due to its time-space flexibility, synchronicity and repeatability. However, in this way, teachers cannot readily perceive the learning condition of their student, and have aroused doubts about the quality of online teaching. To relieve this situation, Qu et al. [
1] presented a method for forecasting students’ representation and grasp of learning contents in MOOCs according to online operation data related to assignments. Meanwhile, Qiu et al. [
2] discovered that the method proposed by [
1] neglected the intrinsic relationship among online operation behaviors and creatively put forward a novel behavior prediction approach, which mainly fused the behavior category characteristics and behavior data to obtain the category eigenvalues of each kind of behavior, and finally constructed a learning representation predictor. To carry out the online classroom smoothly, Toan et al. [
3] proposed an integration model to choose an online platform with most effective performance and minimized the influence of the platform factor on the quality of online teaching. Utilizing performance evaluation matrix, Lee et al. [
4] proposed the framework for assessment and analysis to strengthen learning satisfaction and teaching effectiveness.
In order to ensure the homogeneity and equivalence of online and offline teaching quality, online teaching quality evaluation is crucial. Most of the current research on online education quality evaluation focuses on student performance, including student engagement [
1,
2,
5] and student achievement [
5,
6,
7], to measure the effectiveness of online teaching. The reality is that the quality of online teaching is often affected by multi-dimensional factors, such as students’ participation, teachers’ adaptability, network environment collocation and so on. Therefore, the problem of the online teaching quality evaluation can be regarded as a multi-attribute decision making (MADM) problem, which requires the exploitation and adherence of a methodology for quality evaluation.
There are two essential questions in handling MADM problem: 1. How do decision makers deliver their assessment preference using an appropriate expression? 2. How is the alternative with the best performance determined? There exist lots of different sorts of effective tools to denote decision makers’ preference information, where fuzzy set is one of the most concerned [
8,
9,
10,
11,
12,
13,
14,
15,
16,
17]. The Fermatean fuzzy set (FFS) proposed by Senapati and Yager [
18] is one of the most well-known and practical tools among them, which mainly restricts the summation of the cubes of the membership degree and the non-membership degree shall not exceed one. Due to this feature, FFS possesses a wider scope of application than intuitionistic fuzzy set (IFS) [
19] and Pythagorean fuzzy set (PFS) [
20]. Numerous research in relation to FFS for the MADM problem, such as Fermatean fuzzy (FF) function [
21,
22], aggregation operators of FFS [
23,
24], distance measure for FFS [
25] and similarity measure for FFS [
26], are becoming increasingly significant and popular in academia.
As the most effective and practical MADM method, the aggregation operator is applied by many scholars, allowing them to obtain the compressed information from disparate data headstreams to facilitate in profiting significant reasoning in the process of making the decision. Arithmetic mean (AM) and geometric mean (GM) operators [
27] are the simplest aggregation operators, not taking into account the interrelationship among data parameters and failing to capture the main decision-making focus. The comprehensive values obtained through these operators are not affected by the combination of individual opinions. In the realistic decision-making environment, human opinion is irregular and unfathomable, and aggregation operators are supposed to possess the function to seize the correlation between data parameters. Many aggregation operators blending the interrelationship among arguments have been explored, such as the Choquet integral [
28], the Bonferroni mean (BM) operator [
29], the Maclaurin symmetric mean (MSM) operator [
30] and the Muirhead mean (
MM) [
31] operator. Considering that the Dombi operation [
32] has the preponderance in good flexibility with a general parameter, Liu et al. [
33] extended the BM operator and presented a series of aggregation operators combining Dombi operation and BM operator in intuitionistic fuzzy (IF) environment. References [
34,
35] combined the BM operator with Dombi operation under a two-tuple linguistic neutrosophic and a probabilistic linguistic q-rung orthopair fuzzy environment, respectively. In addition, the MSM operator has been extended frequently in a hesitant fuzzy environment [
36], a Pythagorean fuzzy (PF) environment [
37] and a complex q-rung orthopair fuzzy environment [
38]. Xu et al. [
39] proposed a novel aggregation method under interval-valued q-rung dual hesitant fuzzy environment merging the
MM operator. Du and Liu [
40] combined
MM operator with VlseKriterijuska Optimizacija I Komoromisno Resenje (VIKOR) method and introduced a novel approach to handle the MADM problem.
However, in a practical situation, the interrelationship between all attributes may not always hold but may only appear in some attributes [
41,
42,
43,
44]. Taking excellent manager selection as an instance, we find the following four attributes:
: Interpersonal relationship;
: Management ability;
: Working skill;
: Awards. Obviously, the four attributes can be divided into two partitions:
and
. Easy to observe,
and
belong to the partition
, having no correlation with
and
, independent of this partition
. Hence, it is necessary to divide attributes into multiple partitions when the inter-relationships between whole attributes do not exist, but some attributes do share inter-relationships. Based on the above considerations, Yin et al. [
45] made an analysis about partition BM (PBM) operator and then proposed the trapezoidal fuzzy two-dimensional linguistic PBM and trapezoidal fuzzy two-dimensional linguistic weighted PBM aggregation operators. Liu et al. [
44] introduced a novel MADM approach fusing the weighted partitioned MSM (PMSM) operators for IF numbers (IFNs). Qin et al. [
46] put forward a novel framework based on (weighted) Archimedean power partitioned
MM (
PMM) operator of q-rung orthopair fuzzy numbers. In the existing research of the aggregation operator, many scholars have paid attention to the intercorrelation between parameters, but most of the research contents fail to solve the problem of the segmentation structure between parameters based on association pattern. In addition, there is not yet an operator simultaneously meeting the following requirements:
- (1)
Utilize the Dombi operation and present satisfactory flexibility in the aggregation of FFS;
- (2)
Manage the condition in which the whole attributes are partitioned into several segments and a correlation exists between attributes in every segment and attributes in different segment have no inter-relationship with each other;
- (3)
Flexibly handle various situations related to attributes: where there is no correlation between attributes, where there is correlation between two attributes and where there is correlation between three or more attributes.
When evaluating the quality of online teaching, it often needs to assess standing in multiple dimensions, such as the teacher dimension, the student dimension, the curriculum dimension and the technical dimension, each of which is often affected by multiple factors. Therefore, it is a very typical evaluation attribute group that needs to be divided into several partitions, and the assessment information is given by the decision makers’ subjective opinions, so the flexibility of the integrated method is highly required in the evaluation process. Hence, a qualified aggregation operator is supposed to be highly flexible, not only in form but also in dealing with the complex correlation between attributes. Based on the above-mentioned viewpoints, the intentions of this manuscript are stated in the following:
- (1)
To develop an ideal aggregation operator of FFS which can precisely seize the complicated correlation between attributes, an
MM operator and partitioned average (PA) operator are employed. As a general form of AM, GM, BM and MSM operators, the
MM operator is a typical versatile aggregation operator possessing the ability to capture the complex correlation among attributes. Only by adjusting the value of the corresponding parameter can the
MM operator address different situations, where the whole attributes fail to be related, where inter-relations exist between any two attributes and where there exists a relationship among any three or more attributes [
47,
48,
49,
50,
51]. The PA operator possesses the capability to integrate the attribute evaluation value from diverse segments by the identical aggregation method and to aggregate the diverse segments’ integration results by the arithmetic average operator [
52,
53,
54];
- (2)
Referring the superiority of Dombi operation in great flexibility with a general parameter, the operational laws of FFS combined the Dombi operation are implemented to form the operations. The Dombi operation possess the superiority in two points: in applications, a special logic can be constructed just by adjusting an argument; the proper parameter and the proper operator can be discovered just by an algorithm [
55,
56];
- (3)
According to the influence factors of the offline teaching and the characteristics of online teaching, an evaluation index system is innovatively established to objectively evaluate the quality of online teaching.
From the above considerations, the purpose of this study is to construct a reasonable evaluation index system for the online teaching quality evaluation and to propose a novel comprehensive evaluation model based on analytical hierarchy process approach for online teaching quality of business statistics course, wherein the FF Dombi weighted
PMM operator is proposed by unifying the advantages of the Dombi operation, PA operator and
MM operator. The structure of this manuscript is described as follows. In
Section 2, a fundamental introduction of some basic knowledge is reviewed.
Section 3 introduces the details about the proposed aggregation operator. An integral evaluation index system about online teaching is constructed in
Section 4.
Section 5 introduces a novel MADM model based on Fermatean fuzzy analytical hierarchy process (FF-AHP) and FF Dombi weighted
PMM operator. A practical online teaching quality evaluation case of business statistics course is introduced to further verify the feasibility and applicability of the proposed approach in
Section 6. The sensitivity analysis and comparative analysis are described in
Section 7 to illustrate the superiority and effectiveness of the proposed method.
Section 8 ends this manuscript with the conclusion.
3. Fermatean Fuzzy Dombi (Weighted) Partitioned Muirhead Mean Operators
3.1. Fermatean Fuzzy Dombi Operation
Definition 8 ([23]) . Assume that there exist three FFNs, namely, , and , and is a positive value. Then, the elementary operations of FFNs with respect to Dombi operation are shown in the following forms:
- (1)
- (2)
- (3)
- (4)
3.2. PMM Operator
The MM operator expresses the interrelationships among several polymerized parameters in the internal structure. However, in some practical conditions, the attributes will be divided into several subregions, where the attributes express the interrelationships between diverse arguments in the homogeneous subfield but stand alone in distinct subfields. The PBM operator can capture the association of any two attributes in the homogeneous subfield, while the PMSM operator can describe the relationship among multiple attributes in the homogeneous subfield. Motivated by this situation, this manuscript utilizes partitioned Muirhead Mean (PMM) operator, a general form of the above two operators, to describe the practical correlation among criteria. The mathematical definition is denoted below.
Definition 9 ([46]) . Let be a group of non-negative numbers, is the set of , is N subregions of S, in accord with the condition , and . Then, the PMM operator is given the following definition:where means the number of arguments in the partition , denotes any permutation of and is the convergence of all permutations of .
indicates a collection of n real numbers, satisfying the condition but not concurrently .
In the same light, the PMM operator can be transformed into some distinctive operators with respect to the diverse values of argument vector :
- (1)
When
, the
PMM operator is turned into partitioned GM (PGM) operator:
- (2)
When
, the
PMM operator is degenerated into partitioned AM (PAM) operator:
- (3)
When
, the
PMM operator is degenerated into PBM operator [
45]:
- (4)
When
, the
PMM operator is changed into PMSM operator [
44]:
Consequently, it is easy to conclude that the proposed PMM operator possesses mathematical properties such as Idempotency, Monotonicity and Boundedness. The detailed proof process is omitted here.
3.3. Fermatean Fuzzy Dombi (Weighted) Partitioned Muirhead Mean Operators
On the basis of above theoretical analysis, we can easily infer the mathematical definition of Fermatean fuzzy Dombi partitioned Muirhead mean (FFDPMM) operator, which accomplishes the effective fusion of the advantage information of the Dombi method with the PMM operator, not only realizing the generality and flexibility both in form and in the process of aggregation but handling various related situations within attributes flexibly, including the independence of all attributes or multiple attributes are interrelated.
Definition 10. Let be a class of FFNs, abbreviated as, and indicates a collection of n real numbers, satisfying the condition but not concurrently . Then, the FFDPMM operator is described in the following:where is the set of , is N subregions of S, satisfying the condition and .
denotes the number of arguments in the partition , denotes any permutation of and is the convergence of all permutations of .
Theorem 1. Suppose is a collection of FFNs, the final aggregation consequences by utilizing FFDPMM operator is a FFN and is equal to the full expansion formula:where: The following Theorems discuss three mathematical properties of the FFDPMM operator:
Theorem 2. (Idempotency) Assume is a group of FFNs, abbreviated as. If all IFFNS are equal, that is, , then: Theorem 3. (Monotonicity) Assume and are two groups of FFNs such that for, then: Theorem 4. (Boundedness) Assume is a class of FFNs, , and then: It is easy to verify the above properties, so the proof process is omitted here. Obviously, if argument vector takes distinct special values, the FFDPMM would be degenerated into different operators:
- (1)
When
, the
FFDPMM operator is turned into the FFDPGM operator:
- (2)
When
, the
FFDPMM operator is degenerated into the FFDPAM operator:
- (3)
When
, the
FFDPMM operator is degenerated into the FFDPBM operator:
- (4)
When
, the
FFDPMM operator is changed into the FFDPMSM operator:
Next, we mainly introduce the FFDPMM operator of the weighted form.
Definition 11. Let be a class of FFNs, abbreviated as, and indicates a collection of n real numbers, satisfying the condition but not concurrently .
is the weight vector relative to, in accord with and . Then, the Fermatean fuzzy Dombi weighted partitioned Muirhead mean (FFDWPMM) operator is described in the following:where is the set of , is N subregions of S, satisfying the condition , and .
denotes the number of arguments in the partition , denotes any permutation of , and is the convergence of all permutations of .
Theorem 5. Assume that is a family of FFNs, the final aggregated consequences by utilizing FFDWPMM operator is a FFN and is equal to the following mathematical form:where: Similar to the FFDPMM operator, the FFDWPMM operator possesses three mathematical characteristics: Idempotency, Monotonicity and Boundedness. In order to save space, it will not be described in detail here.
Apparently, if argument vector takes distinct special values, the FFDWPMM would be changed into several operators.
- (1)
When
, the
FFDWPMM operator is turned into FFDWPGM operator:
- (2)
When
, the
FFDWPMM operator is degenerated into FFDWPAM operator:
- (3)
When
, the
FFDWPMM operator is degenerated into the FFDWPBM operator:
- (4)
When
, the
FFDWPMM operator is changed into FFDWPMSM operator:
4. Construction of the Online Teaching Quality Evaluation Index System
The online teaching model is increasingly applied for college classrooms due to the dominant positions it creates, such as geographical location, unrestricted time and access, synchronization of involvement and creative teaching patterns [
59,
60,
61]. Online teaching and offline teaching are two kinds of teaching activities with the same nature but different categories. Online teaching, a new teaching form based on modern communication technology, has many idiographic characteristics, such as environment networking, media data and resource sharing. Under the influence of COVID-19, online teaching has been integrated into college teaching, so the quality of online teaching will closely affect the process of students’ quality training. Therefore, the quality evaluation of online teaching in colleges and universities can not only supervise the professional construction of colleges and universities in the special period but can also provide references and suggestions for the development of online teaching pattern. On the basis of combing the literature related to classroom teaching [
62,
63,
64] and teaching satisfaction [
6,
65,
66], combined with the features of online teaching, 4 criteria levels and 14 attribute levels that affect the quality of online teaching, such as teacher factors, student factors, classroom factors and technical factors, are extracted to form an online teaching quality evaluation index system. The details are shown in the following
Table 1.
The teacher dimension () consists of four aspects: teachers’ teaching attitude (), teaching method (), teaching literacy () and teaching plan (). Among them, teaching attitude () refers to the acquired psychological tendency of teachers to show their working attitude and react to it in online teaching. The positive work attitude is mainly manifested as taking the initiative to prepare lessons before class, teaching vividly in class and assessing and revising homework fairly after class.
Teaching method () refers to a series of teaching methods adopted by teachers to teach professional knowledge and learning experience to students, so that students can master subject knowledge and subject education ideas.
Teaching literacy () mainly includes three aspects: teachers’ own quality, knowledge level and professional skills. Teachers’ own knowledge reserve is the premise of excellent teaching literacy, teachers’ own quality determines the level of imparting knowledge and teachers’ professional skills are the external embodiment of excellent teaching literacy.
Teaching plan () is the overall planning of the teaching process. According to the teaching tasks and the total class hours, teachers design and arrange the proportion of different chapters in terms of time organization, assessment form and learning requirements.
The Student dimension () is embodied in four levels of students’ learning attitude (), learning capacity (), learning consciousness () and academic performance (). Students’ learning attitude () means that students possess a positive or negative behavior tendency towards their long-term learning tasks. It can be judged from the emotional state of learning, the degree of seriousness of learning and so on. Learning attitude is one of the most important non-cognitive factors that affect students’ learning efficiency. Cultivating students’ positive learning attitude is an effective way to improve teachers’ teaching quality. In addition, the quality of learning attitude can reflect students’ satisfaction with online learning.
Learning capacity () is the inherent embodiment of students’ learning efficiency of curriculum content. Learning capacity will not only affect students’ interest and motivation, but also imply the attribution of their learning quality. Learning capacity determines students’ acceptance and acquisition of fresh knowledge, which is closely related to the quality of teaching.
Learning consciousness () refers to the subjective consciousness action produced by students in completing their schoolwork. It is reflected in that students preview knowledge before class, listen carefully in class, review actively after class and so on. Equipped with a good learning consciousness will enable students to actively make learning plans and goals, and then complete learning tasks in an efficient and planned manner.
Academic performance () measures the extent to which learners can master and apply knowledge and improve their skills and abilities through online teaching. Academic performance not only reflects the results of online teaching, but also related to the level of online education quality, which is the comprehensive level of teachers’ teaching output, learners’ learning input and online classroom implementation.
The curriculum dimension () includes curriculum acceptance (), curriculum property () and curriculum assessment method (). Among them, curriculum acceptance () refers to the psychological acceptance of the courses taught by teachers and students, including the judgment of the difficulty of the course content and the familiarity of the curriculum knowledge. Possessing a good acceptance degree of the courses will exert a certain promotion effect on the students’ mastery of knowledge and understanding of the content, which will make the teaching process smoother and will ensure the quality of teaching.
Curriculum property () refers to whether the category of the course subordinates to a compulsory course or an elective course, which mainly embodies its judgment on the importance of curriculum content and the measurement of the practical application of the course. The curriculum property will affect learners’ attention to the curriculum. Learners usually have a higher interest and motivation in learning compulsory courses with high credits and strong practicability.
Curriculum assessment method () refers to the method by which teachers test the learning situation of learners, including process assessment and horizontal assessment. Process assessment indicates the performance of learners in class, such as actively answering questions, high completion of homework and high enthusiasm for class. Horizontal assessment is to give the scores according to the degree of completion of the final paper handed in by the learners, embodying the familiarity with the knowledge and its application.
The technical dimension () includes network environment (), software equipment () and hardware equipment (). The network environment (), related to space and scope, which not only refers to the place where network resources and network tools act but also includes learning atmosphere, learning experience and other states, is a combination of the macro- and micro-scales. Different from offline classroom teaching, online teaching runs in the network environment. Network stutter leads to poor knowledge teaching and learners’ lack of knowledge acquisition that will exert a negative impact on the overall teaching quality.
Software equipment () refers to all kinds of software facilities, which belong to internal factors, including online platform, school teaching organization ability, the teaching atmosphere and so on. In the process of online teaching, this software equipment is easily ignored. Teaching management ideas and teaching techniques adapted to the online teaching should be adopted to ensure the subjective experience of teachers and learners, so as to promote the high-quality development of online teaching.
Hardware equipment (), belonging to external factors, mainly includes solid-state facilities for auxiliary teaching tasks such as computer equipment, seat equipment, mobile phones and other facilities. The hardware equipment is the basis of online teaching, and the quality of the basic equipment will affect the online teaching process to a great extent. In addition, mobile phones are widely used as an online learning tool because of its strong portability. However, mobile phones and other smart devices also have drawbacks such as unsmooth network connections, unstable networks and temporary failure, which have poor effects on the comprehensive teaching quality.
5. A Novel MADM Model Based on FF-AHP and FFDWPMM Operator
Analytical hierarchy process (AHP) is a quantitative decision analysis method for qualitative problems, which was first put forward by Satty [
67], belonging to the research category of multi-objective decision optimization problems in operational research. This method decomposes the research objective into the component attributes of the problem from a systematic point of view. By comparing the influence of each attribute on the entire research objective, the influence of each attribute at each level on the final judgment result can be clearly and accurately quantified. The attributes of the online teaching quality evaluation index system are relatively complex and cannot be carried out standard quantitative processing, causing the evaluation of various attributes depends on decision maker’s subjective consciousness. Based on the above considerations, this manuscript utilizes the AHP to calculate the weight of attribute under FF situation, thus forming the FF-AHP method.
Considering a MADM case, which is made up of m alternatives, and n criteria . Meanwhile, the n criteria are divided into N subregions, , satisfying the conditions: and . indicates the number of arguments in the partition . The FF-AHP method’s main steps are listed as follows:
- Step 1.
Build a hierarchical structure model. According to the influencing factors and internal logical relationships of the evaluation object, the corresponding hierarchical structure model is constructed.
- Step 2.
Construct the pairwise comparison matrix
, where
denotes the relative importance scale of criteria
to criteria
, utilizing practiced experts’ judgement information based on linguistic terms shown in
Table 2.
- Step 3.
Compute the maximum eigenvalue of judgment
referring to the mathematical formulas:
where
is obtained by multiplying the element
in the comparison matrix
P by row, and
represents the normalized weight vector.
- Step 4.
Examine the consistency of each pairwise comparison matrix. The smaller the value of the consistency index (
CI), the greater the consistency level. Considering that the consistency deviation may also be caused by random causes, it is necessary to compare
CI with the random consistency index (
RI) to obtain the consistency ratio (
CR) to test whether the judgment matrix meets the requirement:
where the value of
CR is delimited by the order of the comparison matrix (
n) as given in
Table 3.
If
, then the consistency of the comparison matrix is satisfactory and meets the requirements; if
, then the comparison matrix cannot be qualified for further computation. Thus, decision makers are required to modify the initial values in the comparison matrix for subsequent calculation process [
68].
- Step 5.
Construct the FF evaluation matrix referring to the experts’ scoring value, where means FFNs on the evaluation information of alternative with regard to criteria .
- Step 6.
Normalize the FF evaluation matrix . In general, two types of criteria may be contained in MADM case, namely, benefit criteria and cost criteria, exerting positive and negative impact on evaluation results. To eliminate the adverse effects, FF evaluation matrix is normalized in this way: If belongs to benefit criteria, then ; if belongs to cost criteria, then .
- Step 7.
Compute the comprehensive assessment value of each alternative. Utilizing the criteria weight vector obtained by Step 3, and matrix , calculating the comprehensive assessment value of alternative by utilizing the FFDWPMM operator defined in Equation (28).
- Step 8.
Sort the alternatives by score value of comprehensive assessment value and choose one with optimal performance.
8. Conclusions
There exist differences in teaching media among online teaching models and traditional offline teaching models, so online teaching quality evaluation is supposed to explore new index evaluation systems and evaluation methods. The first purpose of the research is to construct a novel online teaching quality evaluation index system for the quality evaluation of business statistics course from the four dimensions of teacher, student, curriculum and technology. Another main purpose is to put forward a scientific and effective comprehensive evaluation model for online teaching quality of business statistics course, which utilizes the AHP method to determine the importance of index, as well proposes the FFDWPMM operator to aggregate the comprehensive score of all schemes.
The empirical research and comparative analysis through a practical case verify the superiority and effectiveness of this presented method. From the theoretical point of view, it not only enriches the theories and methods of online teaching quality evaluation of business statistics in colleges and universities, providing a reference for online teaching quality evaluation and construction, but also plays a foreshadowing role in ensuring the stable development of higher education quality.
In addition, through the comparative analysis of cases, it can be seen that students’ learning attitude, learning ability, learning consciousness and learning achievement all have an important impact on the quality of online teaching. Therefore, colleges and universities should pay attention to cultivating students’ habit of active learning and continuous learning from the perspective of practical significance. On the other hand, teachers should timely update their teaching concepts, reform teaching methods and teaching models and ensure the homogeneous development of online and offline teaching ability. The competent authorities should also strengthen technological innovation, improve the convenience of “teaching” and “learning” and stimulate the enthusiasm of teachers and students to use online teaching.
However, there exist room for improvement in this research. The setting of the correlation coefficient of the attributes in the FFDPMM and FFDWPMM operators, like most studies, either refers to the number of attributes or is convenient to calculate. In addition, there is a lack of the standardized theory for fitting the correlation coefficient of attributes, that is, how to reasonably set the correlation coefficient in different partitions according to the degree of correlation among attributes. Thus, the future work can start from the setting method of the correlation coefficient among attributes and put forward a more practical partitioned aggregation theory.