Next Article in Journal
3D Flow of Hybrid Nanomaterial through a Circular Cylinder: Saddle and Nodal Point Aspects
Next Article in Special Issue
Modeling Immigration in Spain: Causes, Size and Consequences
Previous Article in Journal
Mathematical Model and Optimization Methods of Wide-Scale Pooled Sample Testing for COVID-19
Previous Article in Special Issue
Border Irrigation Modeling with the Barré de Saint-Venant and Green and Ampt Equations
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Optimization of the Cognitive Processes in a Virtual Classroom: A Multi-objective Integer Linear Programming Approach

by
María Luisa Nolé
1,
David Soler
2,*,
Juan Luis Higuera-Trujillo
1,3 and
Carmen Llinares
1
1
Institute for Research and Innovation in Bioengineering (i3B), Universitat Politècnica de València, Camí de Vera s/n, 46022 València, Spain
2
Institut Universitari de Matemàtica Multidisciplinar, Universitat Politècnica de València, Camí de Vera s/n, 46022 València, Spain
3
Tecnológico de Monterrey, Escuela de Arquitectura, Arte y Diseño (EAAD), Monterrey 64849, Mexico
*
Author to whom correspondence should be addressed.
Mathematics 2022, 10(7), 1184; https://doi.org/10.3390/math10071184
Submission received: 25 February 2022 / Revised: 2 April 2022 / Accepted: 3 April 2022 / Published: 5 April 2022
(This article belongs to the Special Issue Mathematical Models and Methods in Engineering and Social Sciences)

Abstract

:
A fundamental problem in the design of a classroom is to identify what characteristics it should have in order to optimize learning. This is a complex problem because learning is a construct related to several cognitive processes. The aim of this study is to maximize learning, represented by the processes of attention, memory, and preference, depending on six classroom parameters: height, width, color hue, color saturation, color temperature, and illuminance. Multi-objective integer linear programming with three objective functions and 56 binary variables was used to solve this optimization problem. Virtual reality tools were used to gather the data; novel software was used to create variations of virtual classrooms for a sample of 112 students. Using an interactive method, more than 4700 integer linear programming problems were optimally solved to obtain 13 efficient solutions to the multi-objective problem, which allowed the decision maker to analyze all the information and make a final choice. The results showed that achieving the best cognitive processing performance involves using different classroom configurations. The use of a multi-objective interactive approach is interesting because in human behavioral studies, it is important to consider the judgement of an expert in order to make decisions.

1. Introduction

Multi-objective linear programming (MOLP) is a mathematical model in which two or more conflicting linear objective functions, which dependent on variables subject to certain linear constraints, are optimized simultaneously [1,2,3,4]. MOLP has several variations; in particular, if all variables must be integers, the model is known as the multi-objective integer linear programming (MOILP), which will be the fundamental tool for the development of the study presented here.
Given the MOILP problem M a x i m i z e { C x : A x b , x 0   a n d   i n t e g e r } , a feasible solution x’ is efficient if there is no other feasible solution x such that C x C x with at least one strict inequality. In this case, the objective vector C x is called non-dominated. It is highly unlikely that a MOILP problem will have an optimal solution, and therefore, solving a MOILP problem generally entails identifying the set of its efficient solutions.
There are several algorithms to solve a MOILP problem. The very recent survey by Halffmann et al. [5] presents all the exact algorithms known up to that date but also gives references on approximate algorithms. To solve a MOILP problem, scalarization methods, which, as their name indicates, turn such a problem into solving single-objective integer linear programming problems, play a crucial role in finding all or a subset of the non-dominated objective vectors. Note that a single-objective integer linear programming problem is known in the literature as an integer linear programming (ILP) problem [6,7,8,9,10].
In this work, the scalarization known as the weighted sum is used [11]. This basically consists of solving ILP problems where the objective functions are convex combinations of the objective functions in the original MOILP problem, with the same restrictions ( A x b , x 0   a n d   i n t e g e r ) plus C x g , where g is a row vector of objective bounds. Each optimal solution to an ILP problem with the above conditions is an efficient solution to the MOILP problem.
Therefore, a method that generates the whole set, or a large subset, of non-dominated objective vectors may require an excessive amount of computational resources, which may make it inappropriate for dealing with large problems. Another approach is to use the so-called interactive methods [3], which basically consist of phases of human intervention alternated with phases of computation. Human intervention is carried out by a decision maker (DM), which is a domain expert who can provide preferences toward solutions and select the most preferred one for implementation. It is essential that, on interactive methods, the computational effort is not too high in the computation phase and that the questions asked to the DM are simple and understandable. In these procedures, the DM makes the final choices.
In this work, an interactive method based on a MOILP weighted-sum scalarization is used to examine how classroom design affects cognitive processes. The objective of the study is to maximize learning (represented by memory, attention, and preference) from six classroom parameters (height, width, color hue, color saturation, color temperature, and illuminance).
MOLP has already been used to model problems in the field of human behavior, for instance, in psychology, for item calibration/selection in psychometrics [12]. Additionally,, very recently, González-Gallardo et al. [13] used a variant of MOLP known as interval multi-objective linear programming (e.g., see Oliveira and Antunes [14]) to analyze the well-being of students in Spain and Finland. Specifically, the main purpose was to study how four indicators (positive feelings, motivation, sense of belonging, and bullying) could be simultaneously improved while taking into account the particularities of both countries. This variation of the MOLP has also been used in order to simultaneously achieve a balanced performance in four measures of academic achievement from their use of the internet [15].
To solve the problem presented here, the help of virtual reality (VR) will be essential because VR allows researchers to overcome the difficulties, including cost, of using real spaces to study any one contextual key (keeping the others unchanged) in a controlled manner. VR can simulate different configurations of classroom characteristics. In recent years, VR has gained particular importance, with 2020 being the turning point at the international level due to the health situation. An increasing body of literature has validated the use of VR [16,17] for perception studies [18] and, specifically, environmental psychology studies [19,20]. Some authors [21,22,23] have concluded that VR is an efficient tool for measuring attention performance.
To collect the data, the subjects were presented with variations of a VR-based replica of a representative classroom at the Polytechnic University of Valencia. Six classroom parameters were varied: wall height and width, color hue, saturation and temperature, and lighting. Three objective functions were analyzed: memory, attention, and environmental preference. The solutions produced different cognitively efficient design configurations (in terms of memory and attention performance and environmental preference) that allowed the DM to analyze all the information and make a final choice. This is the fundamental contribution of this analytical methodology to the area of human behavioral studies, where statistical approaches have traditionally been applied. MOILP allows researchers to identify combinations of classroom design parameters that can simultaneously optimize cognitive processes taking into account the judgement of an expert.
The remainder of this work is organized as follows: Section 2 exhaustively reviews the existing literature about the influence of the environment on cognitive processes, including an analysis of how previous studies relate to this work. Section 3 explains the data collection process (procedure, conditions, software used for the VR, etc.). Section 4 presents the mathematical model, that is, the MOILP approach used to optimize the three functions cited above. Section 5 presents the results, which are discussed in Section 6, and finally, some conclusions and possible future research directions are provided in Section 7.

2. Related Cognitive Processing and Environment Works

Over the last decades, increasing attention has been paid to the influence of the environment on human beings at the cognitive–emotional level. Several studies have analyzed the effects of environmental characteristics on mental states and cognitive processes [24,25,26,27]. Ulrich’s [27] pioneering study found that patients suffered less stress and enjoyed improved recovery in post-surgical scenarios when the windows of their rooms looked out onto natural vistas. Over the years, studies such as these have examined clinical populations and real environments and expanded into other contexts, such as education.
The study of the effects of classroom environments on experimental subjects must address two fundamental questions: first, how to assess improvements in learning, which can be understood as an active mental process of acquisition, retrieval, and use of information [28,29], and second, which classroom characteristics influence this process?
Taking the first question, learning is a complex psychological construct. There is no consensus in the scientific community on its measurement: some studies focus on completing general tasks and others on specific tests of fundamental learning-related processes, such as attention and memory. Attention is a cognitive process that captures information from the environment [30], and memory stores it [31]. The study of attention and memory involves performing specific tasks in specific environments. The nature of the tasks is important because it has been shown that the neuronal load involved in concentration prevents individuals becoming distracted [32,33]. Thus, easier tasks that require less concentration make people pay more attention to their environments. Another line of work, however, has examined subjects’ preferences for environments. Perceptions of one’s environment are important for two reasons: (1) There is a strong positive correlation between subjects’ preferences and improvements in their mood [34]; and (2) a brief, positive mood improvement enhances performance in short- and medium-term learning tasks [35]. That is, one’s environment influences one’s mood [36], which, in turn, acts as a cognitive mediator, which results in positive perceptions, which strongly improve student performance [37].
As to the second question, on classroom characteristics, it has been shown that when plants are present in the environment, student performance improves [38,39,40] and that the arrangement of furniture in classrooms influences teachers’ behaviors [41], in-class teaching methodologies [42,43], and how students interact [43,44,45]. However, the central theme has been the influence of the built space on student learning. Thus, Marchand et al. [46] recently discovered that in a space classified as uncomfortable (temperature of 26.67 °C, lighting of 2500 lx, and ambient sound of 60–65 dBA), university students scored lower in a reading comprehension test than students in a comfortable space (22 °C, 500 lx, 35 dBA); and it has been shown that a green-colored wall simulating vegetation did not improve subjects’ performance in a specific test of sustained and selective attention in contrast to the effects of real vegetation found in a school classroom-based longitudinal study [47]. However, most studies have analyzed the visual characteristics of classrooms.
The scientific literature highlights, among others, the visual characteristics of classroom color, lighting, and dimensions. These coincide with three of the seven characteristics of the built environment that have been shown to most influence the progress of primary school students [48]. As for color, it has been shown that in chromatic spaces, fewer errors are made in text correction tasks [49] and that tasks are performed quicker [50]. It has also been shown that cold tones improve the performance of complex tasks [51,52] and enhance the cognitive processes, such as attention and memory, of university students [53]. In addition, it has been shown that the contextual key of lighting influences student learning and performance [54]. For example, it has been observed that greater illuminance is associated with greater attention [55,56]. In another line of work, Huiberts [57] observed that very bright, direct light improved the retrieval of numerical information in easy memory tasks, while more muted lighting was better when retrieving similar information in more difficult memory tasks. It has also been observed that higher color-temperature lighting (the light spectrum emitted by a black body heated to a certain temperature) produces faster cognitive processing speed and higher concentration [58] and better attention and memory task performance [56]. As for dimensions, it has been observed that lower ceilings promote cooperation in school classrooms [59] and that smaller classrooms are associated with better performance and higher arousal [60]. In any case, while classroom dimensions have featured in many studies [61,62,63], they have not been their central focus; thus, there are few relevant conclusive results.
Although many studies have been undertaken in this area, they have all examined the individual characteristics of the classroom and cognitive processes in isolation, ignoring the impact they may have on each other. Classrooms have numerous characteristics, and it is possible that the results obtained from isolated analyses will differ from results obtained from combinations of characteristics. Thus, a good result in terms of lighting may be poorer when it is combined with a certain color or ceiling height, which might make subjects perceive the environment as a whole differently. The existing literature has not examined the effects of different combinations of classroom characteristics. In addition, researchers should simultaneously examine the different cognitive processes underlying learning, as some classroom characteristics might generate positive effects in one cognitive process and negative in others. Thus, for example, a study conducted with university students showed that low illuminance levels (100 lx–200 lx) improved memory but reduced attention [56,64]. An investigation into color showed that the subjects preferred blue and yellow tones, but these were associated with the poorest results in reading comprehension tasks [65]. Thus, classroom designs must optimize the set of these cognitive processes. Table 1 summarizes studies carried out into classrooms, detailing some relevant aspects.
The present study analyzes the simultaneous effects of different classroom characteristics on different cognitive processes. That is, an assessment is made of which design configurations of a university classroom (combining the characteristics lighting, color, and size) enhance the set of significant cognitive processes in learning, memory, attention, and preference). To do so, MOILP is used as an analytical tool and VR as an environmental-simulation tool.

3. Materials and Methods

3.1. Participants

The model used data collected from the Polytechnic University of Valencia student population. A total of 112 students participated (50.9% men, 49.1% women, mean age 23.24 years, standard deviation 3.79). To avoid the physical problems associated with VR glasses and to control cultural influences, the subjects were required to: (1) have good vision without glasses (they could wear contact lenses) and (2) be Spanish nationals. The procedure, including its non-invasive techniques, was explained to the participants, and they signed the appropriate informed consent form.

3.2. Procedure

The study procedure is shown in Figure 1. In the first phase, a VR replica of a classroom at the Polytechnic University of Valencia was used as the base. Each participant viewed 5 randomly physically modified base classrooms. Each view was modified in the parameters of only one of the classroom characteristics: (a) wall color (hue and saturation); (b) interior lighting (illuminance and color temperature); and (c) dimensions (width and height of the walls). The levels of three psychological metrics and the students’ sense of presence were assessed in this phase. Sense of presence is a crucial element of virtual environments. Presence can be understood as the user’s illusion of “being there”, in a virtual environment [66], where (s) he has lost the sense of being in an environment simulated by a technological medium, and therefore, (s) he responds as if (s) he was in the real world [67]. It has been found that sense of presence is directly related to the validity of the virtual experience [68], understood as the similarity of the simulated experience to one generated by the physical environment represented. For this reason, sense of presence is sometimes used to validate virtual experiences. A detailed description of how the data were obtained is provided in the following two subsections.

3.3. Experimental Design

The same experimental procedure was followed for all conditions, with only one difference, namely the type of classroom each subject viewed in the VR scenario: the base classroom was modified in color, lighting, and dimension. The criteria and processes associated with manipulating these three characteristics are described below.

3.3.1. Conditions

The original characteristics of the real classroom were maintained in each virtual reality scenario, modifications being made on an individual basis only to the parameters of the classroom characteristics. A set of specific values was selected from among the possible values of the different parameters. The criteria for choosing the color, illumination, and dimensions’ values were based on the equitable distribution of colors in the Itten chromatic circle [69], on the information provided by the light bulb suppliers, and on the standard measurements used in the construction of removable ceilings.
A total of 29 values for the classroom parameters were obtained: 10 for color hue, 2 for color saturation, 3 for lighting, 4 for color temperature, 4 for height, and 6 for width. These were used to assess which combination optimizes memory, attention, and preference. It was not feasible for the experimental procedure to examine the 5760 (10 × 2 × 3 × 4 × 4 × 6) possible combinations individually. It should be taken into account that each visualization and corresponding data collection took at least 30 min, and each had to be viewed by at least 5 subjects so that the data were statistically validated. Therefore, a comprehensive analysis would take more than 14,400 working hours.
Therefore, the study was simplified by using 56 variables. The variables examined were those resulting from combinations of the two parameters that made up each contextual key. Each variable corresponds to a modification of the base classroom. Thus, each modification involved changing the values of the two parameters that made up the classroom characteristics color, lighting, and dimensions. The changes were applied separately to the two parameters of the classroom characteristics, while the remaining parameters maintained their original values.

3.3.2. Materials Set-Up

The VR classrooms were recreated using Rhinoceros Software v.5.0 and the Corona Renderer Software v.2.0 These provided high-quality modeling and rendering, respectively. ColorMunki TM software was used to translate the 10 colors studied in Munsell notation into RGB notation.
The subjects viewed the classroom simulation, which allowed them to make changes to their visual fields through head movements through a head-mounted device (HTC Vive) connected to the researcher’s computer. Unity3D was used to generate the software, which allowed the researcher to show the subjects the different scenarios through the HTC Vive.
The entire experiment was carried out in the same laboratory. The participants undertook the experiment in the same time slots, and the temperature (22.5–23 °C) and sound insulation (34 dbA) were kept constant. The researcher’s table and the participant’s table faced each other in the center of the room.

3.4. Metrics

Data on memory, attention, and preference were collected for each visualization. All were statistically normalized. The data collection is now described.

3.4.1. Memory Task

The memory task was based on the auditory presentation of three out of a total of 16 randomized word lists. The lists were composed of 15 words in the same semantic field. Before the tests, the researcher said: “…then, you will hear a list of words. Try to remember them. Then, you will be asked to repeat them regardless of their order in a time of 30 s. This will be repeated 3 times.” Thus, immediately after listening to the words, the subjects were asked to repeat those they could remember. Memory was measured by adding the number of words the subjects repeated from the 45 presented; thus, the more words remembered, the better the result. This is similar to the DRM experimental paradigm [70]. The information was collected through audio recordings, which the researcher played back to calculate the number of correct words recalled by the participants.

3.4.2. Attention Task

The attention task was based on the presentation of 3 lists of 40 sounds of 4 different types; 3 were distracting, and only 1 was objective. The subjects had 750 ms after the presentation of each sound during which to make a mouse click only to the target stimuli. Before the tests the researcher said: “…then, you will hear a series of sounds. You should react as soon as possible to this stimulus (target) by making a single mouse click and avoid clicking when you hear other sounds” (the 3 distractors). Attention was measured by calculating the average of the reaction times to the objective stimuli; thus, shorter times represented better results. This is similar to Seidman’s [71] continuous auditory performance test. The information on reaction times was collected through software developed specifically for this research.

3.4.3. Preference Task

The subjects’ subjective perceptions of the environments were assessed through the degree of “I like” that they reported about their experiences of the classroom in a post-experiment written survey. This was rated through a Likert scale, from −4 to 4, addressed by the subjects at the end of their visualizations. The precise question was “Please rate your degree of agreement/disagreement with the following sentence (−4 being a high degree of disagreement, and +4 a high degree of agreement): In general, how much do you like this place?” To avoid any bias, the subjects were first told that there were no correct or incorrect answers. The question is based on that used by Galindo and Corraliza [72] to assess general preference judgements in the Spanish population. The participants gave oral answers to the survey to the interviewers, who incorporated them into a database.

3.4.4. Sense of Presence

The SUS questionnaire [73] was used to quantify sense of presence. This is a six-item self-report, rated from 1 to 7 on a Likert-type scale. The participants completed the questionnaire at the end of each classroom-simulation experience. The scenarios all achieved reasonably high mean values (mean = 29.38, standard deviation = 8.48). Based on the evidence provided by previous studies into presence [74], it can be concluded that the classroom simulations were satisfactory and that the results obtained are similar to those that might have been obtained by modifying actual classrooms.

3.5. Data Collection Results

The objective of the problem is to maximize learning from classroom design features. Learning was represented by attention ( a ) and memory ( m ), cognitive processes directly related to learning, and preference ( p ), which has an indirect effect. The design features were illumination ( x ), dimension ( y ), and color ( z ), each of which is represented by two design parameters ( i j ): illuminance and color temperature for x, height and width for y, and hue color and saturation color for z. In the experimental process, these design features ( x i j ,   y i j , and z i j ) were viewed by 10 participants, from whom a, m, and p were collected. These data were normalized, subsequently obtaining the mean values by SPSS v. 26 software. These mean values represent the levels of a ,   m , and p for the study population in each of the design situations. The points below provide a good understanding of the data and the formulae used in this work:
  • Let a i j x , a i j y ,   and a i j z be the means of the levels of attention obtained in the lighting, dimension, and color conditions of the base classroom, respectively, for each combination. These values are shown in column 5 in Table 2, Table 3 and Table 4, which shows the sets where i and j vary in each case.
  • Let m i j x , m i j y , and m i j z be the means of the levels of memory obtained in the lighting, dimensions, and color conditions of the base classroom, respectively, for each combination. These values are shown in column 4 in Table 2, Table 3 and Table 4, with the same sets for i and j cited above.
  • Let p i j x , p i j y , and p i j z be the means of the levels of preference obtained for the lighting, dimensions, and color conditions of the base classroom, respectively, for each combination. These values are shown in column 6 in Table 2, Table 3 and Table 4, with the same sets for i and j cited above.
  • Let a ¯ x , a ¯ y ,   a ¯ z ,   m ¯ x ,   m ¯ y ,   m ¯ z , p ¯ x , p ¯ y , and p ¯ z be the means of the values a i j x , a i j y , a i j z , m i j x , m i j y , m i j z , p i j x , p i j y , and p i j z , respectively, with their respective variations being i and j. These values are shown at the end of the respective columns in Table 2, Table 3 and Table 4;
  • Let x i j ,   y i j , and z i j be the 0–1 variables whose values of 1 indicate that the classroom has lighting with illuminance of type i, color temperature of type j, dimensions with height type i, and width type j, and walls colored with hue type i, and with saturation type j, respectively. Conversely, a 0 value indicates that the classroom does not have type i lighting and j-type color temperature, dimensions of height type i and width type j, and walls colored with tone type i and saturation of type j, respectively. These variables are shown in column 3 of Table 1, Table 2 and Table 3, respectively.
Table 2, Table 3 and Table 4 provide the data obtained on illumination, dimensions, and color, respectively.

4. Mathematical Model

The problem of identifying the combinations of the six classroom parameters (height, width, color hue, color saturation, color temperature, and lighting) that provide the best results for memory and attention performance and preference was addressed by modeling a MOILP problem designed to optimize these functions. It should be noted that the aim is to maximize the memory and preference values and minimize the attention values. Therefore, equality M a x i m i z e   f ( x ) = M i n i m i z e   ( f ( x ) ) is used for the attention function. With this equation, all the functions can be maximized.
Taking into account the information given in Section 3.3.1, the ideal MOILP problem should consider 5760 binary variables, each one corresponding to a different combination of color hue, color saturation, lighting, color temperature, height, and width. Its aim should be maximizing the three-dimensional vector corresponding to the average (normalized) results of memory, attention, and preference obtained for each one of the 5760 combinations. However, to pose and solve this problem is practically impossible due to the data collection time (more than 14,400 h) and to the number of variables. Instead, a more realistic situation is to consider the 56 variables introduced in Section 3.3.1 and detailed in Section 3.5 so that the three-dimensional vector to maximize has as components the sum of the means of the results of memory, the sum of the means of the results of attention, and the sum of the means of the results of preference (always normalized values) for each one of the 12 combinations of lighting and color temperature, 24 combinations of height and width, and 20 combinations of color hue and color saturation (a total of 56 combinations).
Therefore, using the notation given in Section 3.5, the following MOILP problem was formulated:
Maximize ( i = 1 3 j = 1 4 m i , j x · x i , j + i = 1 4 j = 1 6 m i , j y · y i , j + i = 1 10 j = 1 2 m i , j z · z i , j , i = 1 3 j = 1 4 a i , j x · x i , j i = 1 4 j = 1 6 a i , j y · y i , j i = 1 10 j = 1 2 a i , j z · z i , j , i = 1 3 j = 1 4 p i , j x · x i , j + i = 1 4 j = 1 6 p i , j y y i , j + i = 1 10 j = 1 2 p i , j z · z i , j )
s.t:
i = 1 3 j = 1 4 x i , j = 1  
i = 1 4 j = 1 6 y i , j = 1  
i = 1 10 j = 1 2 z i , j = 1  
i = 1 3 j = 1 4 m i , j x · x i , j + i = 1 4 j = 1 6 m i , j y · y i , j + i = 1 10 j = 1 2 m i , j z · z i , j   m ¯ x + m ¯ y + m ¯ z
i = 1 3 j = 1 4 a i , j x · x i , j i = 1 4 j = 1 6 a i , j y · y i , j i = 1 10 j = 1 2 a i , j z · z i , j a ¯ x a ¯ y a ¯ z
i = 1   3 j = 1 4 p i , j x · x i , j + i = 1 4 j = 1 6 p i , j y · y i , j + i = 1 10 j = 1 2 p i , j z · z i , j p ¯ x + p y + p ¯ z  
  x i , j   , y i , j , z i , j { 0 , 1 }     i , j  
where:
Equation (1) represents the multi-objective function, that is, the vector with components students’ memory, attention, and preference.
Equations (2)–(4) guarantee that each classroom is composed of a single parameter of illuminance and temperature in terms of lighting, height, and width (in terms of size) and a single parameter of hue and saturation (in terms of wall color), respectively.
Equations (5)–(7) ensure that the total memory value is higher than the sum of the memory means, the total attention value is higher than the sum of the attention means, and the total preference value is higher than the sum of the preference means, respectively. Note that these three inequations represent the logical lower bounds for the functions, and they can be changed for other more (or less) demanding inequations [11]. The reason why these three restrictions were included in the formulation will be discussed later.
Equation (8) defines the problem variables as binaries.
Other linear restrictions could be added to the formulation if considered opportune. Moreover, it is obvious that this formulation can be extended to a more general formulation, with general bounds for i and j in each case, to more objective functions and to more variable types.
As stated in Section 1, there are several ways to obtain the set of efficient solutions to a MOILP problem. In this case, the following scalarization of the MOILP problem was used: Given λ 1 , λ 2 , λ 3 + with λ 1 + λ 2 + λ 3 = 100 and b a , b m , b p with b a a ¯ x a ¯ y a ¯ z ,   b m m ¯ x + m ¯ y + m ¯ z and b p p ¯ x + p y + p ¯ z ,   the optimal solutions corresponding to each ILP problem formulated as follows are efficient solutions to the MOILP problem [11], with objective function given by Equation (9) and restrictions given by Equations (2)–(4), (8) and (10)–(12).
Maximize   λ 1 ( i = 1 3 j = 1 4 m i , j x · x i , j + i = 1 4 j = 1 6 m i , j y · y i , j + i = 1 10 j = 1 2 m i , j z · z i , j ) +   λ 2 ( i = 1 3 j = 1 4 a i , j x · x i , j i = 1 4 j = 1 6 a i , j y · y i , j i = 1 10 j = 1 2 a i , j z · z i , j ) +   λ 3 ( i = 1 3 j = 1 4 p i , j x · x i , j + i = 1 4 j = 1 6 p i , j y y i , j + i = 1 10 j = 1 2 p i , j z · z i , j )
i = 1 3 j = 1 4 m i , j x · x i , j + i = 1 4 j = 1 6 m i , j y · y i , j + i = 1 10 j = 1 2 m i , j z · z i , j b m
i = 1 3 j = 1 4 a i , j x · x i , j i = 1 4 j = 1 6 a i , j y · y i , j i = 1 10 j = 1 2 a i , j z · z i , j b a
i = 1   3 j = 1 4 p i , j x · x i , j + i = 1 4 j = 1 6 p i , j y · y i , j + i = 1 10 j = 1 2 p i , j z · z i , j   b l
Note that Equations (5)–(7) are particular cases of Equations (10)–(12), respectively. This is the fact by which they have been considered in the formulation of the problem. Therefore, from a theoretical point of view, solving a MOILP problem involves solving infinite ILP problems, as shown above (one for each combination of λ 1 , λ 2 , λ 3 , b a , b m   a n d   b p ). However, it is likely that the vast majority of these ILP problems will have the same optimal solutions, and the total number of different efficient solutions will not be very high because the variables are integers and particularly in this case, where they are binary.
An interactive procedure based on the scalarization described above is used here to obtain good (according to the DM), efficient solutions to the MOILP problem. As usual with this method, a subset of efficient solutions is generated, and from this subset, the DM draws conclusions and proposes, for instance, new bounds for the objective functions to generate a new subset of efficient solutions, which are in turn analyzed by the DM and so on, until the DM decides which are the most efficient solutions to the MOILP.
The proposed heuristic is shown below. This procedure does not guarantee identification of the complete set of efficient solutions, but based on the problem’s characteristics, it is expected that it will obtain a representative set of solutions.
Heuristic:
Step 1. For each combination of even numbers λ 1 , λ 2 , λ 3 + with λ 1 + λ 2 + λ 3 = 100 (1176 ILP combinations), solve (with Mathematica v12.1) the ILP problem with Equation (9) as the objective function, using the restrictions of Equations (2)–(8). Solve the same problem but with λ 1 = λ 2 = λ 3 = 100 / 3 (the same weight for all three objective functions). The DM assesses the set of optimal solutions obtained (all of them are efficient solutions to the MOILP problem) and makes decisions, such as removing from the list of solutions those not considered adequate, and establishes (increases or decreases) the percentile to be used in Step 2.
Step 2. Repeat Step 1, changing the right-hand side of Equations (5)–(7) by the percentile i provided by the DM of the list of 1177 non-dominated objective vectors corresponding to each objective function (in the first execution of Step 1). The new solutions obtained are saved (although sometimes no solution is obtained). This step is repeated until no further solutions emerge, and all the percentiles j with j < i have been considered along the heuristic or until the DM decides that even if more solutions may exist, it is not important to identify them.
Step 3. The DM draws conclusions about those efficient solutions obtained in the process that remain in the list.
The criteria to be used by the DM to remove or maintain efficient solutions in the list in Step 2 and to decide which are the best solutions in Step 3 depend on the situation. Thus, in general, the classroom will be designed to take account of all three cognitive processes (memory, attention, and preference), but it is possible that, in circumstances in which a high cognitive load is required, such as taking an exam, the DM will choose a criterion prioritizing memory and attention over preference.
To give a general idea of how the heuristic works, in Step 2, the lower bounds for the values of the objective functions vary; these variations are the percentiles of the 1177 initial solutions. The higher the percentile, the greater the requirement for the objective functions. If, for instance, the DM introduces a high percentile, and none of the 1177 ILP problems has a feasible solution, during the next Step 2 run, the DM might lower the percentile to try to obtain new solutions or even to terminate the process. The number of iterations will be finite, as it is obvious that from a certain percentile (unknown a priori), no new solutions will be found.
Note that, in each iteration, the proposed heuristic must optimally solve 1177 ILP problems, each of which theoretically has exponential complexity. Therefore, from a computational viewpoint, this is a complex heuristic; but the Mathematica V.12 tool has been shown to be very effective in this regard. This fact, together with the simplicity of the alternation and connection between the computation phases and the intervention phases of the DM, has prompted the authors of the present study to opt for this heuristic although, obviously, other procedures could have been applied to obtain a reasonable set of “good”, efficient solutions to the MOILP problem here formulated.

5. Results

The results obtained by the heuristic are shown in Table 5. On the 1st run of Step 1, only 10 efficient solutions were obtained from the 1177 ILP problems. This caused the DM to adopt a conservative stance and advance from percentile to percentile. The DM decided not to discard any of the 10 solutions and to apply the 1st percentile in the 1st run of Step 2. On the 2nd run of Step 1, seven efficient solutions to the MOILP problem were obtained from the new 1177 ILP problems, only two of which were new. The DM decided not to discard any of the 12 solutions and applied the 2nd percentile in the 2nd run of Step 2. Only two efficient solutions were obtained during the 3rd run of Step 1 from the new 1177 ILP problems, only one of which differed from those previously obtained. The DM decided not to discard any of the 13 solutions and applied the 3rd percentile in the 3rd run of Step 2. None of the 1177 ILP problems assessed in the 4th run of Step 1 had a feasible solution; therefore, the heuristic procedure was terminated after the DM provided conclusions on the 13 efficient solutions obtained (provided below).
The Mathematica software was run on a PC Intel®CoreTM I5-7500 with 3.40 GHz and 16GB RAM. The average CPU time to obtain the optimal solution on all ILP problems was 0.0035 s, with a maximum value of 0.0156 s and a minimum value of 0 s, which, according to Mathematica’s assumptions, means that the calculation took no measurable CPU time.
Figure 2 represents the position in three-dimensional space of the points corresponding to the 13 non-dominated objective vectors obtained by the heuristic. Note that the Mathematica software automatically scales the points. Figure 3 shows the points of the vectors of the three objective functions on the same scale. It is worth remembering that the values entered in Equation (1) are normalized.
In Step 3, the DM identified the four best solutions based on the different selection criteria. The first criterion is to ensure that the three objective functions are broadly in balance, that is, that one is not more salient than the others. Based on this decision, the DM chose solutions 9 and 10. It is worth mentioning that solution 10 attached equal importance to the three metrics ( λ 1 = λ 2 = λ 3 = 100 / 3 ) and was the most frequently cited solution to the 1770 problems. Another possible criterion would be to prioritize memory and attention over preference, particularly relevant in the design of classrooms where important cognitive effort is required, such as for exams. In this case, the DM would select solutions 1 and 3. Table 6 lists the design configurations of these four solutions.
As shown in Table 6, the best solutions have the same illumination color temperature (6500 K) and the same wall color saturation (low). The difference between the solutions, according to the decision criteria, is in illuminance. A higher illuminance level (300 lx) enhances attention and memory processes although it is regarded as less pleasant, decreasing preference level. The solutions with the best results in attention, memory, and preference levels (9 and 10) have the same characteristics in terms of lighting, color saturation, and dimension but feature different hues. On the other hand, the solutions that enhance attention and memory feature the same configurations except in dimensions.

6. Discussion

The present study aims to identify the combination of classroom design parameters that optimize students’ internal psychological processes by applying MOLP as an analysis method and using VR as an environmental-simulation tool. The study makes three fundamental contributions: one methodological, one at the results level, and one at the application level.
As for the methodological contribution, a mathematical analysis was undertaken to complement the traditional statistical approach of the behavioral study. In this sense, this methodology is novel and ideal for: (1) identifying the design configurations that take into account the combination of parameters that make up spaces, as in real scenarios; (2) optimizing several objective psychological metrics, which is of special interest for multi-functional spaces; and (3) considering the judgement of an expert, which is important in human behavior studies.
The results of the present study provided a small set of efficient solutions to be evaluated by the DM. As shown in Table 5, there are two possible selection criteria. On the one hand, taking into account the three cognitive processes, the DM would select solutions 10 and 9, which combine dimensions of 4.4 m height and 8.4 m width, interior artificial lighting of 6500 K and 100 lx, and low-saturation blue or purple wall color. These solutions are suitable, as they maintain a high level of preference and the best combination of attention and memory levels. Moreover, solution 10 gives all three psychological metrics equal importance ( λ 1 = λ 2 = λ 3 = 100 / 3 ). Another possible criterion would be to prioritize memory and attention over preference given their importance in learning [28,29]. Both are important for class sessions with activities that require different levels of cognitive load, such as taking exams [75], undertaking projects [76], and teaching through alternative educational methodologies, such as the flipped classroom [77]. In this case, the DM would choose solutions 1 and 3, which combine interior artificial lighting of 6500 K and 300 lx, low-saturation purple wall color, and dimensions of 3.2 m height and 6 m width or 4.4 m height and 8.4 m width. These solutions, while subject to the constraints of the model, are efficient for this set of cognitive processes; while they present the lowest preference values, they achieved the highest values in the combination of attention and memory. The preference–performance relationship has been examined in many studies, but no conclusive results have been achieved. Some authors have negatively correlated the two [65], and others have done so positively [78].
In any case, this research provides concrete design results to consider. The benefit of using a color temperature of 6500 K was clear for attention, memory, and preference. In addition, some authors have observed that blue-enriched white light has a positive effect on performance [58,79]. The combination of high lighting color temperature (6500 K) and low illuminance (100 lx and 300 lx) was common to all 13 solutions. Several authors have shown that lower illuminance improves cognitive performance [80,81]. This lighting effect is repeated with color. Virtually all the solutions featured low-saturation colors. Similarly, Kwallek et al. [49] observed that fewer errors were made in performance tasks in environments with colors of saturations similar to or lower than those used in the present study. The solutions included both cold and warm hues. On this issue, the literature is conflicting. Some authors, for example, Mahnke [82], have argued that better academic performance is achieved with blue colors in high/secondary school classrooms, while Barret [83] observed that warm-hue colors are more appropriate for senior grades and that cold-hue colors are more appropriate for junior grades. As to the dimensions contextual key, in no case did lower ceilings (2.4 m) or narrow classrooms (3.6 m) improve student performance. Specifically, heights between 3.2 m and 4.4 m and widths between 6 m and 8.4 m provided efficient solutions. This outcome may be consistent with the results obtained by Vartanian et al. [84], in which high ceilings were evaluated as more beautiful than low ceilings because they expanded the viewers’ fields of view.
Regarding the application contribution, this article connects two different fields of study: architecture and psychology. In general, from the architectural perspective, studies have analyzed human responses to built spaces taking preference as the main decision-making criterion [85,86] and used psychological metrics other than task performance, that is, through self-reports [62,87]; this may be a limited approach. The present study proposes using environmental preferences (typical in architectural studies) and the results of tests analyzing cognitive processes (typical in psychology studies) to bridge the gap between the two disciplines.

7. Conclusions and Future Research

This study addresses the complexity of the analysis of the effects of classroom environments on subjects. This complexity drives the need to analyze the various environmental characteristics of classrooms and the cognitive processes involved in learning. This process requires the application of techniques that can simultaneously analyze a large number of variables. In the present study, the MOLP analysis technique was applied to optimize this set of variables. The advantages of this method for this work are: (1) it takes into account the interdependencies between classroom characteristics; (2) it maximizes the levels of the cognitive processes attention, memory, and preference; and (3) it provides several efficient solutions to allow the DM to select the most appropriate depending on the situation. In this case, the best solutions share interior artificial lighting of 6500 K and low-saturation wall colors. If the DM wants to achieve high levels in the three psychological metrics (memory, attention, and preference), the classroom should also be 4.4 m high and 8.4 m wide and have 100 lx of lighting and blue or purple wall color. If, on the other hand, the requirement is to enhance only the cognitive functions of attention and memory, the DM will choose a classroom combining 300 lx and low-saturation purple wall color, with dimensions of 3.2 m height and 6 m width or 4.4 m height and 8.4 m width. These results may be of interest to researchers and professionals involved in the design of educational centers.
Finally, as for future research lines, three aspects should be considered. First, the present study used auditory tasks to examine the processing of classroom characteristics. In future works, it would be interesting to include other types of tasks, as information processing through other sensory pathways requires different neural bases [88,89,90]. Second, regarding the stimuli presented, it would be interesting to address the influence of multisensory contextual cues [91]. Synergies between interior design parameters may involve senses other than sight, such as auditory and tactile temperature receptors [46]. Third, regarding the sample, it would be interesting to analyze whether differences exist between men and women [92,93]. In all these lines, MOILP analyses with appropriate interactive methods can help researchers to obtain good results.

Author Contributions

Conceptualization, M.L.N. and D.S.; methodology, J.L.H.-T. and M.L.N.; software, J.L.H.-T., M.L.N. and D.S.; validation, C.L., J.L.H.-T., M.L.N. and D.S.; formal analysis, M.L.N. and D.S.; investigation, C.L., J.L.H.-T. and M.L.N.; resources, J.L.H.-T.; data curation, M.L.N. and D.S.; writing—original draft preparation, C.L., J.L.H.-T., M.L.N. and D.S; writing—review and editing, C.L., J.L.H.-T., M.L.N. and D.S.; visualization, J.L.H.-T. and M.L.N.; supervision, C.L. and D.S.; project administration, C.L. and D.S.; funding acquisition, C.L. and D.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Grant BIA2017-86157-R, funded by MCIN/AEI/10.13039/501100011033, and by ERDF—“A way of making Europe” and also derived from R&D project RTI2018-096384-B-I00, funded by MCIN/AEI/10.13039/501100011033 and “ERDF A way of making Europe”.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of the Universitat Politècnica de València (P1_25_07_18; 25 July 2018).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

The first author is supported by the Spanish Ministry of Universities (FPU19/03531). The third author (postdoctoral fellow “Margarita Salas”) is supported by funding from the Spanish Ministry of Universities and by the European Union NextGenerationEU.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study, in the collection, analysis or interpretation of the data, in the writing of the manuscript or in the decision to publish the results.

References

  1. Luptacik, M. Multiobjetive linear programming. In Mathematical Optimization and Economic Analysis, 1st ed.; Pardalos, P.M., Du, D.Z., Eds.; Springer: New York, NY, USA, 2010; Volume 36, pp. 243–269. [Google Scholar]
  2. Sakawa, M.; Yano, H.; Nishizaki, I. Multiobjective linear programming. In Linear and Multiobjective Programming with Fuzzy Stochastic Extensions, 1st ed.; Hillier., F.S., Ed.; Springer: Boston, MA, USA, 2013; Volume 203, pp. 73–102. [Google Scholar]
  3. Antunes, C.H.; Alves, M.J.; Clímaco, J. Multiobjective integer and mixed-integer linear programming. In Multiobjective Linear and Integer Programming, 1st ed.; Antunes, C.H., Alves, M.J., Clímaco, J., Eds.; Springer: Cham, Switzerland, 2016; pp. 161–203. [Google Scholar]
  4. Herzel, A.; Ruzika, S.; Thielen, C. Approximation methods for multiobjective optimization problems: A survey. INFORMS J. Comput. 2020, 33, 1284–1299. [Google Scholar] [CrossRef]
  5. Halffmann, P.; Schäfer, L.E.; Dächert, K.; Klamroth, K.; Ruzika, S. Exact algorithms for multiobjective linear optimization problems with integer variables: A state of the art survey. J. Multi-Criteria Decis. Anal. 2022, 1–23. [Google Scholar] [CrossRef]
  6. Sherali, H.D.; Driscoll, P.J. Evolution and state-of-the-art in integer programming. J. Comput. Appl. Math. 2000, 124, 319–340. [Google Scholar] [CrossRef]
  7. Chan, D.Y.; Ku, C.Y.; Li, M.C. A method to improve integer linear programming problem with branch-and-bound procedure. Appl. Math. Comput. 2006, 179, 484–493. [Google Scholar] [CrossRef]
  8. Fallah, M.K.; Fazlali, M.; Daneshtalab, M. A symbiosis between population based incremental learning and LP-relaxation based parallel genetic algorithm for solving integer linear programming models. Computing 2021, 1–19. [Google Scholar] [CrossRef]
  9. Tantawy, S.F. A new procedure for solving integer linear programming problems. Arab. J. Sci. Eng. 2014, 39, 5265–5269. [Google Scholar] [CrossRef]
  10. Tengan, T.; Yoshida, T.; Nakamura, M. A monte carlo iterative optimization algorithm for integer linear programming problems. Int. J. Comput. Sci. Netw. Secur. 2018, 18, 60–67. [Google Scholar]
  11. Alves, M.J.; Clímaco, J. A review of interactive methods for multiobjective integer and mixed-integer programming. Eur. J. Oper. Res. 2007, 180, 99–115. [Google Scholar] [CrossRef] [Green Version]
  12. Köhn, H.F. A review of multiobjective programming and its application in quantitative psychology. J. Math. Psychol. 2011, 55, 386–396. [Google Scholar] [CrossRef]
  13. González-Gallardo, S.; Ruiz, A.B.; Luque, M. Analysis of the well-being levels of students in spain and finland through interval multiobjective linear programming. Mathematics 2021, 9, 1628. [Google Scholar] [CrossRef]
  14. Oliveira, C.; Antunes., C.H. Multiple objective linear programming models with interval coefficients—An illustrated overview. Eur. J. Oper. Res. 2007, 181, 1434–1463. [Google Scholar] [CrossRef]
  15. Prieto-Latorre, C.; Lopez-Agudo, L.A.; Luque, M.; Marcenaro-Gutierrez, O.D. The ideal use of the internet and academic success: Finding a balance between competences and knowledge using interval multiobjective programming. Socio-Econ. Plan. Sci. 2021, 101208. [Google Scholar] [CrossRef]
  16. Karakas, T.; Yildiz, D. Exploring the influence of the built environment on human experience through a neuroscience approach: A systematic review. Front. Archit. Res. 2020, 9, 236–247. [Google Scholar] [CrossRef]
  17. Marín-Morales, J.; Higuera-Trujillo, J.L.; Guixeres, J.; Llinares, C.; Alcañiz, M.; Valenza, G. Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios. PLoS ONE 2021, 16, e0254098. [Google Scholar] [CrossRef] [PubMed]
  18. Ammann, J.; Stucki, M.; Siegrist, M. True colours: Advantages and challenges of virtual reality in a sensory science experiment on the influence of colour on flavour identification. Food Qual. Prefer. 2020, 86, 103998. [Google Scholar] [CrossRef]
  19. Latini, A.; Di Giuseppe, E.; D’Orazio, M.; Di Perna, C. Exploring the use of immersive virtual reality to assess occupants’ productivity and comfort in workplaces: An experimental study on the role of walls colour. Energy Build. 2021, 253, 111508. [Google Scholar] [CrossRef]
  20. Armougum, A.; Orriols, E.; Gaston-Bellegarde, A.; Joie-La Marle, C.; Piolino, P. Virtual reality: A new method to investigate cognitive load during navigation. J. Environ. Psychol. 2019, 65, 101338. [Google Scholar] [CrossRef]
  21. Rizzo, A.A.; Bowerly, T.; Buckwalter, J.G.; Klimchuk, D.; Mitura, R.; Parsons, T.D. A virtual reality scenario for all seasons: The virtual classroom. Cns Spectr. 2006, 11, 35–44. [Google Scholar] [CrossRef] [Green Version]
  22. Iriarte, Y.; Diaz-Orueta, U.; Cueto, E.; Irazustabarrena, P.; Banterla, F.; Climent, G. AULA—Advanced virtual reality tool for the assessment of attention: Normative study in Spain. J. Atten. Disord. 2016, 20, 542–568. [Google Scholar] [CrossRef]
  23. Diaz-Orueta, U.; Garcia-López, C.; Crespo-Eguilaz, N.; Sánchez-Carpintero, R.; Climent, G.; Narbona, J. AULA virtual reality test as an attention measure: Convergent validity with Conners’ Continuous Performance Test. Child Neuropsychol. 2013, 20, 328–342. [Google Scholar] [CrossRef]
  24. Hoffman, A.J. Going “green” from gray: Providing opportunities of community development and sustainability within a correctional facilities program. J. Prev. Interv. Community 2020, 48, 272–280. [Google Scholar] [CrossRef]
  25. Kim, D.; Hyun, H.; Park, J. The effect of interior color on customers’ aesthetic perception, emotion, and behavior in the luxury service. J. Retail. Consum. Serv. 2020, 57, 102252. [Google Scholar] [CrossRef]
  26. Toews, B.; Wagenfeld, A.; Stevens, J.; Shoemaker, C. Feeling at home in nature: A mixed method study of the impact of visitor activities and preferences in a prison visiting room garden. J. Offender Rehabil. 2020, 59, 223–246. [Google Scholar] [CrossRef]
  27. Ulrich, R.S. View through a window may influence recovery from surgery. Science 1984, 224, 420–421. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Pritchard, A. Ways of Learning: Learning Theories for the Classroom, 4th ed.; Routledge: London, UK, 2017. [Google Scholar]
  29. Schunk, D.H. Learning Theories an Educational Perspective, 6th ed.; Pearson: Boston, MA, USA, 2012. [Google Scholar]
  30. Brosowsky, N.P.; Murray, S.; Schooler, J.W.; Seli, P. Attention need not always apply: Mind wandering impedes explicit but not implicit sequence learning. Cognition 2021, 209, 104530. [Google Scholar] [CrossRef] [PubMed]
  31. Jongbloed-Pereboom, M.; Nijhuis-Van der Sanden, M.W.G.; Steenbergen, B. Implicit and explicit motor learning in typically developing children: Effects of task, age and working memory. Physiotherapy 2015, 101, e693–e694. [Google Scholar] [CrossRef] [Green Version]
  32. Sörqvist, P.; Marsh, J.E. How concentration shields against distraction. Curr. Dir. Psychol. Sci. 2015, 24, 267–272. [Google Scholar] [CrossRef]
  33. Sörqvist, P.; Dahlström, Ö.; Karlsson, T.; Rönnberg, J. Concentration: The neural underpinnings of how cognitive load shields against distraction. Front. Hum. Neurosci. 2016, 10, 221. [Google Scholar] [CrossRef] [Green Version]
  34. Gao, T.; Zhang, T.; Zhu, L.; Gao, Y.; Qiu, L. Exploring psychophysiological restoration and individual preference in the different environments based on virtual reality. Int. J. Environ. Res. Public Health 2019, 16, 3102. [Google Scholar] [CrossRef] [Green Version]
  35. Bryan, T.; Mathur, S.; Sullivan, K. The impact of positive mood on learning. Learn. Disabil. Q. 1996, 19, 153–162. [Google Scholar] [CrossRef]
  36. Loewen, L.J.; Suedfeld, P. Cognitive and arousal effects of masking office noise. Environ. Behav. 1992, 24, 381–395. [Google Scholar] [CrossRef]
  37. Aldridge, S.; Rowley, J. Measuring customer satisfaction in higher education. Qual. Assur. Educ. 1998, 6, 197–204. [Google Scholar] [CrossRef]
  38. Van den Berg, A.E.; Wesselius, J.E.; Maas, J.; Tanja-Dijkstra, K. Green walls for a restorative classroom environment: A controlled evaluation study. Environ. Behav. 2017, 49, 791–813. [Google Scholar] [CrossRef]
  39. Doxey, J.S.; Waliczek, T.M.; Zajicek, J.M. The impact of interior plants in university classrooms on student course performance and on student perceptions of the course and instructor. HortScience 2009, 44, 384–391. [Google Scholar] [CrossRef]
  40. Daly, J.; Burchett, M.; Torpy, F.; National Interior Plantscape Association. Plants in the classroom can improve student performance. 2010. Available online: https://www.wolvertonenvironmental.com/Plants-Classroom.pdf (accessed on 13 February 2022).
  41. Wheldall, K.; Lam, Y.Y. Rows versus Tables. II. The Effects of Two Classroom Seating Arrangements on Classroom Disruption Rate, On-task Behaviour and Teacher Behaviour in Three Special School Classes. Educ. Psychol. 1987, 7, 303–312. [Google Scholar] [CrossRef]
  42. Baum, E.J. Learning space design and classroom behavior. Int. J. Learn. Teach. Educ. Res. 2018, 17, 34–54. [Google Scholar] [CrossRef] [Green Version]
  43. Wannarka, R.; Ruhl, K. Seating arrangements that promote positive academic and behavioural outcomes: A review of empirical research. Support Learn. 2008, 23, 89–93. [Google Scholar] [CrossRef]
  44. Shernoff, D.; Sannella, A.; Schorr, R.; Sanchez-Wall, L.; Ruzek, E.; Sinha, S.; Bressler, D. Separate worlds: The influence of seating location on student engagement, classroom experience, and performance in the large university lecture hall. J. Environ. Psychol. 2017, 49, 55–64. [Google Scholar] [CrossRef]
  45. Park, E.L.; Choi, B.K. Transformation of classroom spaces: Traditional versus active learning classroom in colleges. High. Educ. 2014, 68, 749–771. [Google Scholar] [CrossRef]
  46. Marchand, G.; Nardi, N.M.; Reynolds, D.; Pamoukov, S. The impact of the classroom built environment on student perceptions and learning. J. Environ. Psychol. 2014, 40, 187–197. [Google Scholar] [CrossRef]
  47. Bernardo, F.; Loupa-Ramos, I.; Matos, C.; Manso, M. The restorative effect of the presence of greenery on the classroom in children’s cognitive performance. Sustainability 2021, 13, 3488. [Google Scholar] [CrossRef]
  48. Barrett, P.; Davies, F.; Zhang, Y.; Barrett, L. The impact of classroom design on pupils’ learning: Final results of a holistic, multi-level analysis. Build. Environ. 2015, 89, 118–133. [Google Scholar] [CrossRef] [Green Version]
  49. Kwallek, N.; Lewis, C.M.; Lin-Hsiao, J.W.D.; Woodson, H. Effects of nine monochromatic office interior colors on clerical tasks and worker mood. Color Res. Appl. 1996, 21, 448–458. [Google Scholar] [CrossRef]
  50. Cockerill, I.M.; Miller, B.P. Children’s Colour Preferences and Motor Skill Performance with Variation in Environmental Colour. Percept. Mot. Ski. 1983, 56, 845–846. [Google Scholar] [CrossRef]
  51. Stone, N.J. Environmental view and color for a simulated telemarketing task. J. Environ. Psychol. 2003, 23, 63–78. [Google Scholar] [CrossRef]
  52. Xia, T.; Song, L.; Wang, T.T.; Tan, L.; Mo, L. Exploring the Effect of Red and Blue on Cognitive Task Performances. Front. Psychol. 2016, 7, 784. [Google Scholar] [CrossRef] [Green Version]
  53. Llinares, C.; Higuera-Trujillo, J.L.; Serra, J. Cold and warm coloured classrooms. Effects on students’ attention and memory measured through psychological and neurophysiological responses. Build. Environ. 2021, 196, 107726. [Google Scholar] [CrossRef]
  54. Jago, E.; Tanner, K. Influence of the School Facility on Studies Achievement: Lighting; Color, Athens, Ga; Department of Educational Leadership, University of Georgia: Athens, GA, USA, 1999. [Google Scholar]
  55. Smolders, K.C.; de Kort, Y.A. Bright light and mental fatigue: Effects on alertness, vitality, performance and physiological arousal. J. Environ. Psychol. 2014, 39, 77–91. [Google Scholar] [CrossRef]
  56. Llinares, C.; Castilla, N.; Higuera-Trujillo, J.L. Do attention and memory tasks require the same lighting? A study in university classrooms. Sustainability 2021, 13, 8374. [Google Scholar] [CrossRef]
  57. Huiberts, L.M.; Smolders, K.C.H.J.; de Kort, Y.A.W. Shining light on memory: Effects of bright light on working memory performance. Behav. Brain Res. 2015, 294, 234–245. [Google Scholar] [CrossRef]
  58. Keis, O.; Helbig, H.; Streb, J.; Hille, K. Influence of blue-enriched classroom lighting on students cognitive performance. Trends Neurosci. Educ. 2014, 3, 86–92. [Google Scholar] [CrossRef]
  59. Read, M.A.; Sugawara, A.I.; Brandt, J.A. Impact of space and color in the physical environment on preschool children’s cooperative behavior. Environ. Behav. 1999, 31, 413–428. [Google Scholar] [CrossRef]
  60. Llinares, C.; Higuera-Trujillo, J.L.; Montañana i Aviñó, A.; Torres, J.; Sentieri, C. The influence of classroom width on attention and memory: Virtual-reality-based task performance and neurophysiological effects. Build. Res. Inf. 2021, 49, 813–826. [Google Scholar] [CrossRef]
  61. Roskos, K.; Neuman, S.B. The classroom environment: First, last, and always. Read. Teach. 2021, 65, 110–114. [Google Scholar] [CrossRef]
  62. Yang, Z.; Becerik-Gerber, B.; Mino, L. A study on student perceptions of higher education classrooms: Impact of classroom attributes on student satisfaction and performance. Build. Environ. 2013, 70, 171–188. [Google Scholar] [CrossRef]
  63. Ahrentzen, S.; Evans, G.W. Distraction, privacy, and classroom design. Environ. Behav. 1984, 16, 437–454. [Google Scholar] [CrossRef]
  64. Smolders, K.C.; De Kort, Y.A.; Cluitmans, P.J.M. A higher illuminance induces alertness even during office hours: Findings on subjective measures, task performance and heart rate measures. Physiol. Behav. 2012, 107, 7–16. [Google Scholar] [CrossRef]
  65. Al-Ayash, A.; Kane, R.T.; Smith, D.; Green-Armytage, P. The influence of color on student emotion, heart rate, and performance in learning environments. Color Res. Appl. 2016, 41, 196–205. [Google Scholar] [CrossRef]
  66. Steuer, J. Defining virtual reality: Dimensions determining telepresence. J. Commun. 1992, 42, 73–93. [Google Scholar] [CrossRef]
  67. Lombard, M.; Ditton, T. At the heart of it all: The concept of presence. J. Comput.-Mediat. Commun. 1997, 3, JCMC321. [Google Scholar] [CrossRef]
  68. Higuera-Trujillo, J.L.; Maldonado, J.L.T.; Millán, C.L. Psychological and physiological human responses to simulated and real environments: A comparison between photographs, 360 panoramas, and virtual reality. Appl. Ergon. 2017, 65, 398–409. [Google Scholar] [CrossRef] [PubMed]
  69. Itten, J. Design and Form: The Basic Course at the Bauhaus, 1st ed.; Thames & Hudson: London, UK, 1987. [Google Scholar]
  70. Beato, M.S.; Díez, E. False recognition production indexes in Spanish for 60 DRM lists with three critical words. Behav. Res. Methods 2001, 43, 499–507. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  71. Seidman, L.J.; Breiter, H.C.; Goodman, J.M.; Goldstein, J.M.; Woodruff, P.W.R.; O’Craven, K.; Savoy, R.; Tsuang, M.T.; Rosen, B.R. A functional magnetic resonance imaging study of auditory vigilance with low and high information processing demands. Neuropsychology 1998, 12, 505. [Google Scholar] [CrossRef] [PubMed]
  72. Galindo-Galindo, M.P.; Corraliza Rodríguez, J.A. Estética ambiental y bienestar psicológico: Algunas relaciones existentes entre los juicios de preferencia por paisajes urbanos y otras respuestas afectivas relevantes. Apunt. Psicol. 2012, 30, 289–303. [Google Scholar]
  73. Slater, M.; Usoh, M.; Steed, A. Depth of presence in virtual environments. Presence Teleoperators Virtual Environ. 1994, 3, 130–144. [Google Scholar] [CrossRef]
  74. Slater, M.; Steed, A. A virtual presence counter. Presence Teleoperators Virtual Environ. 2000, 9, 413–434. [Google Scholar] [CrossRef] [Green Version]
  75. Vogel, S.; Schwabe, L. Learning and memory under stress: Implications for the classroom. Npj Sci. Learn. 2016, 1, 16011. [Google Scholar] [CrossRef] [Green Version]
  76. Sart, G. The effects of the development of metacognition on project-based learning. Procedia-Soc. Behav. Sci. 2014, 152, 131–136. [Google Scholar] [CrossRef] [Green Version]
  77. Mattis, K.V. Flipped classroom versus traditional textbook instruction: Assessing accuracy and mental effort at different levels of mathematical complexity. Technol. Knowl. Learn. 2015, 20, 231–248. [Google Scholar] [CrossRef]
  78. Burke, K.; Burke-Samide, B. Required changes in the classroom environment it’s a matter of design. Clear. House A J. Educ. Strateg. Issues Ideas 2004, 77, 236–240. [Google Scholar] [CrossRef]
  79. Ferlazzo, F.; Piccardi, L.; Burattini, C.; Barbalace, M.; Giannini, A.M.; Bisegna, F. Effects of new light sources on task switching and mental rotation performance. J. Environ. Psychol. 2014, 39, 92–100. [Google Scholar] [CrossRef]
  80. Leccese, F.; Salvadori, G.; Öner, M.; Kazanasmaz, T. Exploring the impact of external shading system on cognitive task performance, alertness and visual comfort in a daylit workplace environment. Indoor Built Environ. 2020, 29, 942–955. [Google Scholar] [CrossRef]
  81. Leichtfried, V.; Mair-Raggautz, M.; Schaeffer, V.; Hammerer-Lercher, A.; Mair, G.; Bartenbach, C.; Canazei, M.; Schobersberger, W. Intense illumination in the morning hours improved mood and alertness but not mental performance. Appl. Ergon. 2015, 46, 54–59. [Google Scholar] [CrossRef] [PubMed]
  82. Mahnke, F.H. Color, Environment, and Human Response: An Interdisciplinary Understanding of Color and Its Use as a Beneficial Element in the Design of the Architectural Environment; John Wiley & Sons: Hoboken, NJ, USA, 1996. [Google Scholar]
  83. Barrett, P.; Zhang, Y.; Moffat, J.; Kobbacy, K. A holistic, multilevel analysis identifying the impact of classroom design on pupils’ learning. Build. Environ. 2013, 59, 678–689. [Google Scholar] [CrossRef]
  84. Vartanian, O.; Navarrete, G.; Chatterjee, A.; Fich, L.B.; Gonzalez-Mora, J.L.; Leder, H.; Skov, M. Architectural design and the brain: Effects of ceiling height and perceived enclosure on beauty judgments and approach-avoidance decisions. J. Environ. Psychol. 2015, 41, 10–18. [Google Scholar] [CrossRef]
  85. Herzog, T.R. A cognitive analysis of preference for urban spaces. J. Environ. Psychol. 1992, 12, 237–248. [Google Scholar] [CrossRef]
  86. Stamps, A.E. Simulation effects on environmental preference. J. Environ. Manag. 1993, 38, 115–132. [Google Scholar] [CrossRef]
  87. Lipczynska, A.; Schiavon, S.; Graham, L.T. Thermal comfort and self-reported productivity in an office with ceiling fans in the tropics. Build. Environ. 2018, 135, 202–212. [Google Scholar] [CrossRef] [Green Version]
  88. Bear, M.F.; Connors, B.W.; Paradiso, M.A. Neurociencia: La Exploración del Cerebro; Wolters Kluwer: Alphen aan den Rijn, The Netherlands, 2016. [Google Scholar]
  89. Carlson, N.R.; Platón, M.J.R.; Carson, N.R.; Urbano, B.C. Fundamentos de Fisiología de la Conducta; Pearson Educación: London, UK, 2010. [Google Scholar]
  90. Ganong, W.F.; Barrett, K.E.; Barman, S.M.; Boitano, S.; Brooks, H.L. Ganong. In Sección III: Neurofesiología Central y Periferica; McGraw-Hill Interamericana Editores: Ciudad de México, Mexico, 2010; pp. 167–299. [Google Scholar]
  91. Yang, W.; Moon, H.J. Combined effects of acoustic, thermal, and illumination conditions on the comfort of discrete senses and overall indoor environment. Build. Environ. 2019, 148, 623–633. [Google Scholar] [CrossRef]
  92. Picucci, L.; Caffò, A.O.; Bosco, A. Besides navigation accuracy: Gender differences in strategy selection and level of spatial confidence. J. Environ. Psychol. 2011, 31, 430–438. [Google Scholar] [CrossRef]
  93. Miola, L.; Meneghetti, C.; Toffalini, E.; Pazzaglia, F. Environmental learning in a virtual environment: Do gender, spatial self-efficacy, and visuospatial abilities matter? J. Environ. Psychol. 2021, 78, 101704. [Google Scholar] [CrossRef]
Figure 1. Schema of the study procedure.
Figure 1. Schema of the study procedure.
Mathematics 10 01184 g001
Figure 2. Three-dimensional graph of the efficient solution set.
Figure 2. Three-dimensional graph of the efficient solution set.
Mathematics 10 01184 g002
Figure 3. Levels of psychological metrics of each efficient solution.
Figure 3. Levels of psychological metrics of each efficient solution.
Mathematics 10 01184 g003
Table 1. Summary of studies of human behavior in classrooms.
Table 1. Summary of studies of human behavior in classrooms.
ReferenceClassroom Design Parameters Experience Register BehavioralExperience Methods
Ahrentzen and Evans, 1984Interior Spaciousness; Degree of Open Perimeter and AmenitiesDistraction; PrivacyRC 3
Wheldall and Lam, 1987Seating ArrangementsClassroom Disruption Rate; Task Behavior; Teacher BehaviorRC 3
Jago and Tanner, 1999Lighting; ColorAcademic ProgressRC 3
Read, Sugawara, and Brandt, 1999Ceiling Height; Wall ColorCooperative BehaviorRC 3
Wannarka Ruhl, 2008Seating ArrangementsAttention; Instructional TimeRC 3
Doxey, Waliczek, and Zajicek, 2009PlantsCognitive Performance; PerceptionRC 3
Daly, Burchett, and Torpy, 2010PlantsClassroom PerformanceRC 3
Yang, Becerik-Gerber, and Mino, 2013Temperature; Air quality; Artificial and Natural Lighting; Acoustics; Visibility; Room Layout; Furniture; Hardware and Software.Satisfaction; PerformanceRC 3
Park and Choi, 2014Seating ArrangementsMotivation; ParticipationRC 3
Marchand, Nardi, Reynolds, et al., 2014Lighting; Sound; TemperatureStudent Learning; Mood; Environmental PerceptionRC 3
Smolders and de Kort, 2014Lighting (Bright Light)Alertness; Vitality; Performance and Physiological Arousal (HRV 1 and Electrodermal Activity)ER 4
Keis, Helbig, Streb, et al., 2014Lighting (Blue-enriched White Light vs. Standard Lighting)Speed of Cognitive Processing; Concentration Performance; Visuospatial and Verbal MemoryRC 3
Barrett, Davies, Zhang, et al., 2015Lighting; Temperature; Air quality; Ownership; Flexibility; Complexity; ColorAcademic ProgressRC 3
Huiberts, Smolders, and de Kort, 2015Lighting (Illuminance Level and Bright Light)Working MemoryER 4
Xia, Song, Wang, et al., 2016ColorCognitive Task PerformanceRC 3
Al-Ayash, Kane, Smith, et al., 2016Wall ColorReading Task Performance; Emotional Responses; Neurophysiological (HRV 1)ER 4
Van den Berg, Wesselius, Maas, et al., 2017Green Walls vs. PlantsCognitive Performance; Well-beingRC 3
Shernoff, Sannella, Schorr, et al., 2017Seating LocationStudent Engagement; AttentionRC 3
Baum, 2018Node Classroom vs. Spoke Classroom (Seating Arrangement; Lighting; Audio-visual and Computing equipment)Classroom Activity; Student AttitudeRC 3
Bernardo, Loupa-Ramos, Matos, et al., 2021PlantsSustained and Selective Attention; Working MemoryRC 3
Llinares, Higuera-Trujillo, and Serra, 2021Wall colorAttention; Memory; Neurophy-siological (HRV 1 and EEG 2)VR
Llinares, Castilla, and Higuera-Trujillo, 2021Lighting (Illuminance; CCT)Attention; MemoryVR
Llinares, Higuera-Trujillo, Montañana i Aviñó, et al., 2021Classroom WidthAttention; Memory; Neurophy-siological (HRV 1 and EEG 2)VR
1 Heart rate variability. 2 Electroencephalogram. 3 Real classroom. 4 Experimental room.
Table 2. Grouping of variables for each parameter of the classroom lighting characteristic.
Table 2. Grouping of variables for each parameter of the classroom lighting characteristic.
IlluminanceColor TemperatureVariable m i j x a i j x p i j x
500 lx10,500 K x 11 −0.35730.46470.7778
6500 K x 12 0.1104−0.23730.6154
4000 K x 13 −0.08570.2080.6429
3000 K x 14 −0.11740.0887−0.3571
300 lx10,500 K x 21 −0.5019−0.15310.3333
6500 K x 22 0.4349−0.77340.0714
4000 K x 23 −0.05250.02250.011
3000 K x 24 0.2053−0.24050.4615
100 lx10,500 K x 31 −0.11680.02980.5714
6500 K x 32 0.5459−0.25421.3846
4000 K x 33 0.45980.12831
3000 K x 34 −0.11880.27140.7059
m ¯ x = 0.0338 a ¯ x = −0.0371 p ¯ x = 0.5182
Table 3. Grouping of variables for each parameter of the classroom characteristic dimensions.
Table 3. Grouping of variables for each parameter of the classroom characteristic dimensions.
HeightWidthVariable m i j y a i j y p i j y
3.2 m8.4 m y 11 0.2123−0.42791
6.2 m y 12 0.9640.05560.1333
6 m y 13 0.3807−0.18041.1429
4.8 m y 14 −0.39990.2504−0.625
3.6 m y 15 −0.17480.4341−2
2.4 m y 16 −0.69950.62770
3.8 m8.4 m y 21 −0.08280.1032−0.0814
6.2 m y 22 0.1614−0.01160.1333
6 m y 23 −0.39450.56790.3333
4.8 m y 24 0.00070.5091−0.375
3.6 m y 24 −0.4977−0.58240
2.4 m y 26 −0.0565−0.1736−2.1667
4.4 m8.4 m y 31 0.1639−0.62031.1429
6.2 m y 32 0.0575−0.27−0.1
6 m y 33 −0.52990.0587−1
4.8 m y 34 0.05370.1453−0.1429
3.6 m y 35 −0.1942−0.2556−1.3333
2.4 m y 36 −0.59250.916−0.8333
2.6 m8.4 m y 41 −032256−0.4320.5455
6.2 m y 42 −0.1003−0.27140.3077
6 m y 43 −0.16682.2663−1.2857
4.8 m y 44 −0.26150.1171
3.6 m y 45 0.1623−0.0309−2.625
2.4 m y 46 0.04210.7354−1.7143
m ¯ y = −0.1269 a ¯ y = 0.1471 p ¯ y = −0.3417
Table 4. Grouping of variables for each parameter of the classroom characteristic color.
Table 4. Grouping of variables for each parameter of the classroom characteristic color.
HueSaturationVariable m i j z a i j z p i j z
5BHigh z 11 0.92110.0702−0.3333
Low z 12 −0.00390.2269−0.1667
5GHigh z 21 −0.41550.2138−0.2
Low z 22 −0.29390.4916−2.1429
5GYHigh z 31 −0.0421−0.0328−0.8333
Low z 32 −0.07580.33971.4286
5YHigh z 41 −0.6764−0.37181.1429
Low z 42 −0.1845−0.65781.8571
5YRHigh z 51 0.0605−0.14960.5
Low z 52 0.0816−0.3638−0.3333
5RHigh z 61 −0.19290.3043−2.125
Low z 62 −0.3090.26621.5
5RPHigh z 71 −0.22570.6897−0.625
Low z 72 −0.544−0.3037−2.1429
5PHigh z 81 0.33140.0233−1.1667
Low z 82 0.9799−0.127−0.8333
5PBHigh z 91 −0.1766−0.30660.2222
Low z 92 0.249−0.0731.5714
5GBHigh z 101 −0.1321−0.02610.6667
Low z 102 0.07340.0751−0.1429
m ¯ z = −0.0288 a ¯ z = 0.0144 p ¯ z = −0.1078
Table 5. Set of efficient solutions obtained with the heuristic.
Table 5. Set of efficient solutions obtained with the heuristic.
Solutionsn1MemoryAttentionPreferenceR-h Side 2Step 1
1 :   x 22 = 1 , y 13 = 1 ,   z 82 = 1 91.79551.08080.381 b m = 0.1218 ;
b a = 0.1244 ;
b p = 0.0686
1st run
2 :   x 22 = 1 ,   y 31 = 1 ,   z 42 = 1 2000.41432.05153.0714
3 :   x 22 = 1 ,   y 31 = 1 ,   z 82 = 1 551.57871.52070.381
4 :   x 32 = 1 ,   y 13 = 1 ,   z 11 = 1 501.84770.36442.1942
5 :   x 32 = 1 ,   y 13 = 1 ,   z 42 = 1 1080.74211.09244.3846
6 :   x 32 = 1 ,   y 13 = 1 ,   z 82 = 1 861.90650.56161.6942
7 :   x 32 = 1 ,   y 13 = 1 ,   z 92 = 1 1211.17560.50764.0989
8 :   x 32 = 1 ,   y 31 = 1 ,   z 42 = 1 5270.52531.53234.3846
9 :   x 32 = 1 ,   y 31 = 1 ,   z 82 = 1 181.68971.00151.6942
10 :   x 32 = 1 ,   y 31 = 1 ,   z 92 = 1 30.95880.94754.0989
11 :   x 22 = 1 ,   y 31 = 1 ,   z 51 = 1 160.65931.54331.7143 b m = 0.4143;
b a = 0.5076;
b p = 1.6942
2nd run
12 :   x 22 = 1 ,   y 31 = 1 ,   z 92 = 1 1310.84781.46672.7857
5 :   x 32 = 1 ,   y 13 = 1 ,   z 42 = 1 6720.74211.09244.3846
6 :   x 32 = 1 ,   y 13 = 1 ,   z 82 = 1 1401.90650.56161.6942
7 :   x 32 = 1 ,   y 13 = 1 ,   z 92 = 1 1271.17560.50764.0989
9 :   x 32 = 1 ,   y 31 = 1 ,   z 82 = 1 831.68971.00151.6942
10 :   x 32 = 1 ,   y 31 = 1 ,   z 92 = 1 80.95880.94754.0989
10 :   x 32 = 1 ,   y 31 = 1 ,   z 92 = 1 11240.95880.94754.0989 b m = 0.5253;
b a = 0.5616;
b p = 3.0714
3rd run
13 :   x 32 = 1 ,   y 11 = 1 ,   z 92 = 1 531.00720.75513.956
1 n represents the frequency with which the solution was repeated among the 1177 possible. 2 r-h side column shows the right-hand side values of Equations (5)–(7).
Table 6. Design configurations for the best solutions.
Table 6. Design configurations for the best solutions.
Design ParametersDecision Criterion
Better (Memory, Attention, Preference)Better (Memory, Attention)
10913
LightingColor Temperature6500 K6500 K6500 K6500 K
Illuminance100 lx100 lx300 lx300 lx
ColorHue5PB5P5P5P
Saturationlowlowlowlow
DimensionHeight4.4 m4.4 m3.2 m4.4 m
Width8.4 m8.4 m6 m8.4 m
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Nolé, M.L.; Soler, D.; Higuera-Trujillo, J.L.; Llinares, C. Optimization of the Cognitive Processes in a Virtual Classroom: A Multi-objective Integer Linear Programming Approach. Mathematics 2022, 10, 1184. https://doi.org/10.3390/math10071184

AMA Style

Nolé ML, Soler D, Higuera-Trujillo JL, Llinares C. Optimization of the Cognitive Processes in a Virtual Classroom: A Multi-objective Integer Linear Programming Approach. Mathematics. 2022; 10(7):1184. https://doi.org/10.3390/math10071184

Chicago/Turabian Style

Nolé, María Luisa, David Soler, Juan Luis Higuera-Trujillo, and Carmen Llinares. 2022. "Optimization of the Cognitive Processes in a Virtual Classroom: A Multi-objective Integer Linear Programming Approach" Mathematics 10, no. 7: 1184. https://doi.org/10.3390/math10071184

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop