You are currently viewing a new version of our website. To view the old version click .
Mathematics
  • Article
  • Open Access

5 April 2022

Optimization of the Cognitive Processes in a Virtual Classroom: A Multi-objective Integer Linear Programming Approach

,
,
and
1
Institute for Research and Innovation in Bioengineering (i3B), Universitat Politècnica de València, Camí de Vera s/n, 46022 València, Spain
2
Institut Universitari de Matemàtica Multidisciplinar, Universitat Politècnica de València, Camí de Vera s/n, 46022 València, Spain
3
Tecnológico de Monterrey, Escuela de Arquitectura, Arte y Diseño (EAAD), Monterrey 64849, Mexico
*
Author to whom correspondence should be addressed.
This article belongs to the Special Issue Mathematical Models and Methods in Engineering and Social Sciences

Abstract

A fundamental problem in the design of a classroom is to identify what characteristics it should have in order to optimize learning. This is a complex problem because learning is a construct related to several cognitive processes. The aim of this study is to maximize learning, represented by the processes of attention, memory, and preference, depending on six classroom parameters: height, width, color hue, color saturation, color temperature, and illuminance. Multi-objective integer linear programming with three objective functions and 56 binary variables was used to solve this optimization problem. Virtual reality tools were used to gather the data; novel software was used to create variations of virtual classrooms for a sample of 112 students. Using an interactive method, more than 4700 integer linear programming problems were optimally solved to obtain 13 efficient solutions to the multi-objective problem, which allowed the decision maker to analyze all the information and make a final choice. The results showed that achieving the best cognitive processing performance involves using different classroom configurations. The use of a multi-objective interactive approach is interesting because in human behavioral studies, it is important to consider the judgement of an expert in order to make decisions.

1. Introduction

Multi-objective linear programming (MOLP) is a mathematical model in which two or more conflicting linear objective functions, which dependent on variables subject to certain linear constraints, are optimized simultaneously [,,,]. MOLP has several variations; in particular, if all variables must be integers, the model is known as the multi-objective integer linear programming (MOILP), which will be the fundamental tool for the development of the study presented here.
Given the MOILP problem M a x i m i z e { C x : A x b , x 0   a n d   i n t e g e r } , a feasible solution x’ is efficient if there is no other feasible solution x such that C x C x with at least one strict inequality. In this case, the objective vector C x is called non-dominated. It is highly unlikely that a MOILP problem will have an optimal solution, and therefore, solving a MOILP problem generally entails identifying the set of its efficient solutions.
There are several algorithms to solve a MOILP problem. The very recent survey by Halffmann et al. [] presents all the exact algorithms known up to that date but also gives references on approximate algorithms. To solve a MOILP problem, scalarization methods, which, as their name indicates, turn such a problem into solving single-objective integer linear programming problems, play a crucial role in finding all or a subset of the non-dominated objective vectors. Note that a single-objective integer linear programming problem is known in the literature as an integer linear programming (ILP) problem [,,,,].
In this work, the scalarization known as the weighted sum is used []. This basically consists of solving ILP problems where the objective functions are convex combinations of the objective functions in the original MOILP problem, with the same restrictions ( A x b , x 0   a n d   i n t e g e r ) plus C x g , where g is a row vector of objective bounds. Each optimal solution to an ILP problem with the above conditions is an efficient solution to the MOILP problem.
Therefore, a method that generates the whole set, or a large subset, of non-dominated objective vectors may require an excessive amount of computational resources, which may make it inappropriate for dealing with large problems. Another approach is to use the so-called interactive methods [], which basically consist of phases of human intervention alternated with phases of computation. Human intervention is carried out by a decision maker (DM), which is a domain expert who can provide preferences toward solutions and select the most preferred one for implementation. It is essential that, on interactive methods, the computational effort is not too high in the computation phase and that the questions asked to the DM are simple and understandable. In these procedures, the DM makes the final choices.
In this work, an interactive method based on a MOILP weighted-sum scalarization is used to examine how classroom design affects cognitive processes. The objective of the study is to maximize learning (represented by memory, attention, and preference) from six classroom parameters (height, width, color hue, color saturation, color temperature, and illuminance).
MOLP has already been used to model problems in the field of human behavior, for instance, in psychology, for item calibration/selection in psychometrics []. Additionally,, very recently, González-Gallardo et al. [] used a variant of MOLP known as interval multi-objective linear programming (e.g., see Oliveira and Antunes []) to analyze the well-being of students in Spain and Finland. Specifically, the main purpose was to study how four indicators (positive feelings, motivation, sense of belonging, and bullying) could be simultaneously improved while taking into account the particularities of both countries. This variation of the MOLP has also been used in order to simultaneously achieve a balanced performance in four measures of academic achievement from their use of the internet [].
To solve the problem presented here, the help of virtual reality (VR) will be essential because VR allows researchers to overcome the difficulties, including cost, of using real spaces to study any one contextual key (keeping the others unchanged) in a controlled manner. VR can simulate different configurations of classroom characteristics. In recent years, VR has gained particular importance, with 2020 being the turning point at the international level due to the health situation. An increasing body of literature has validated the use of VR [,] for perception studies [] and, specifically, environmental psychology studies [,]. Some authors [,,] have concluded that VR is an efficient tool for measuring attention performance.
To collect the data, the subjects were presented with variations of a VR-based replica of a representative classroom at the Polytechnic University of Valencia. Six classroom parameters were varied: wall height and width, color hue, saturation and temperature, and lighting. Three objective functions were analyzed: memory, attention, and environmental preference. The solutions produced different cognitively efficient design configurations (in terms of memory and attention performance and environmental preference) that allowed the DM to analyze all the information and make a final choice. This is the fundamental contribution of this analytical methodology to the area of human behavioral studies, where statistical approaches have traditionally been applied. MOILP allows researchers to identify combinations of classroom design parameters that can simultaneously optimize cognitive processes taking into account the judgement of an expert.
The remainder of this work is organized as follows: Section 2 exhaustively reviews the existing literature about the influence of the environment on cognitive processes, including an analysis of how previous studies relate to this work. Section 3 explains the data collection process (procedure, conditions, software used for the VR, etc.). Section 4 presents the mathematical model, that is, the MOILP approach used to optimize the three functions cited above. Section 5 presents the results, which are discussed in Section 6, and finally, some conclusions and possible future research directions are provided in Section 7.

3. Materials and Methods

3.1. Participants

The model used data collected from the Polytechnic University of Valencia student population. A total of 112 students participated (50.9% men, 49.1% women, mean age 23.24 years, standard deviation 3.79). To avoid the physical problems associated with VR glasses and to control cultural influences, the subjects were required to: (1) have good vision without glasses (they could wear contact lenses) and (2) be Spanish nationals. The procedure, including its non-invasive techniques, was explained to the participants, and they signed the appropriate informed consent form.

3.2. Procedure

The study procedure is shown in Figure 1. In the first phase, a VR replica of a classroom at the Polytechnic University of Valencia was used as the base. Each participant viewed 5 randomly physically modified base classrooms. Each view was modified in the parameters of only one of the classroom characteristics: (a) wall color (hue and saturation); (b) interior lighting (illuminance and color temperature); and (c) dimensions (width and height of the walls). The levels of three psychological metrics and the students’ sense of presence were assessed in this phase. Sense of presence is a crucial element of virtual environments. Presence can be understood as the user’s illusion of “being there”, in a virtual environment [], where (s) he has lost the sense of being in an environment simulated by a technological medium, and therefore, (s) he responds as if (s) he was in the real world []. It has been found that sense of presence is directly related to the validity of the virtual experience [], understood as the similarity of the simulated experience to one generated by the physical environment represented. For this reason, sense of presence is sometimes used to validate virtual experiences. A detailed description of how the data were obtained is provided in the following two subsections.
Figure 1. Schema of the study procedure.

3.3. Experimental Design

The same experimental procedure was followed for all conditions, with only one difference, namely the type of classroom each subject viewed in the VR scenario: the base classroom was modified in color, lighting, and dimension. The criteria and processes associated with manipulating these three characteristics are described below.

3.3.1. Conditions

The original characteristics of the real classroom were maintained in each virtual reality scenario, modifications being made on an individual basis only to the parameters of the classroom characteristics. A set of specific values was selected from among the possible values of the different parameters. The criteria for choosing the color, illumination, and dimensions’ values were based on the equitable distribution of colors in the Itten chromatic circle [], on the information provided by the light bulb suppliers, and on the standard measurements used in the construction of removable ceilings.
A total of 29 values for the classroom parameters were obtained: 10 for color hue, 2 for color saturation, 3 for lighting, 4 for color temperature, 4 for height, and 6 for width. These were used to assess which combination optimizes memory, attention, and preference. It was not feasible for the experimental procedure to examine the 5760 (10 × 2 × 3 × 4 × 4 × 6) possible combinations individually. It should be taken into account that each visualization and corresponding data collection took at least 30 min, and each had to be viewed by at least 5 subjects so that the data were statistically validated. Therefore, a comprehensive analysis would take more than 14,400 working hours.
Therefore, the study was simplified by using 56 variables. The variables examined were those resulting from combinations of the two parameters that made up each contextual key. Each variable corresponds to a modification of the base classroom. Thus, each modification involved changing the values of the two parameters that made up the classroom characteristics color, lighting, and dimensions. The changes were applied separately to the two parameters of the classroom characteristics, while the remaining parameters maintained their original values.

3.3.2. Materials Set-Up

The VR classrooms were recreated using Rhinoceros Software v.5.0 and the Corona Renderer Software v.2.0 These provided high-quality modeling and rendering, respectively. ColorMunki TM software was used to translate the 10 colors studied in Munsell notation into RGB notation.
The subjects viewed the classroom simulation, which allowed them to make changes to their visual fields through head movements through a head-mounted device (HTC Vive) connected to the researcher’s computer. Unity3D was used to generate the software, which allowed the researcher to show the subjects the different scenarios through the HTC Vive.
The entire experiment was carried out in the same laboratory. The participants undertook the experiment in the same time slots, and the temperature (22.5–23 °C) and sound insulation (34 dbA) were kept constant. The researcher’s table and the participant’s table faced each other in the center of the room.

3.4. Metrics

Data on memory, attention, and preference were collected for each visualization. All were statistically normalized. The data collection is now described.

3.4.1. Memory Task

The memory task was based on the auditory presentation of three out of a total of 16 randomized word lists. The lists were composed of 15 words in the same semantic field. Before the tests, the researcher said: “…then, you will hear a list of words. Try to remember them. Then, you will be asked to repeat them regardless of their order in a time of 30 s. This will be repeated 3 times.” Thus, immediately after listening to the words, the subjects were asked to repeat those they could remember. Memory was measured by adding the number of words the subjects repeated from the 45 presented; thus, the more words remembered, the better the result. This is similar to the DRM experimental paradigm []. The information was collected through audio recordings, which the researcher played back to calculate the number of correct words recalled by the participants.

3.4.2. Attention Task

The attention task was based on the presentation of 3 lists of 40 sounds of 4 different types; 3 were distracting, and only 1 was objective. The subjects had 750 ms after the presentation of each sound during which to make a mouse click only to the target stimuli. Before the tests the researcher said: “…then, you will hear a series of sounds. You should react as soon as possible to this stimulus (target) by making a single mouse click and avoid clicking when you hear other sounds” (the 3 distractors). Attention was measured by calculating the average of the reaction times to the objective stimuli; thus, shorter times represented better results. This is similar to Seidman’s [] continuous auditory performance test. The information on reaction times was collected through software developed specifically for this research.

3.4.3. Preference Task

The subjects’ subjective perceptions of the environments were assessed through the degree of “I like” that they reported about their experiences of the classroom in a post-experiment written survey. This was rated through a Likert scale, from −4 to 4, addressed by the subjects at the end of their visualizations. The precise question was “Please rate your degree of agreement/disagreement with the following sentence (−4 being a high degree of disagreement, and +4 a high degree of agreement): In general, how much do you like this place?” To avoid any bias, the subjects were first told that there were no correct or incorrect answers. The question is based on that used by Galindo and Corraliza [] to assess general preference judgements in the Spanish population. The participants gave oral answers to the survey to the interviewers, who incorporated them into a database.

3.4.4. Sense of Presence

The SUS questionnaire [] was used to quantify sense of presence. This is a six-item self-report, rated from 1 to 7 on a Likert-type scale. The participants completed the questionnaire at the end of each classroom-simulation experience. The scenarios all achieved reasonably high mean values (mean = 29.38, standard deviation = 8.48). Based on the evidence provided by previous studies into presence [], it can be concluded that the classroom simulations were satisfactory and that the results obtained are similar to those that might have been obtained by modifying actual classrooms.

3.5. Data Collection Results

The objective of the problem is to maximize learning from classroom design features. Learning was represented by attention ( a ) and memory ( m ), cognitive processes directly related to learning, and preference ( p ), which has an indirect effect. The design features were illumination ( x ), dimension ( y ), and color ( z ), each of which is represented by two design parameters ( i j ): illuminance and color temperature for x, height and width for y, and hue color and saturation color for z. In the experimental process, these design features ( x i j ,   y i j , and z i j ) were viewed by 10 participants, from whom a, m, and p were collected. These data were normalized, subsequently obtaining the mean values by SPSS v. 26 software. These mean values represent the levels of a ,   m , and p for the study population in each of the design situations. The points below provide a good understanding of the data and the formulae used in this work:
  • Let a i j x , a i j y ,   and a i j z be the means of the levels of attention obtained in the lighting, dimension, and color conditions of the base classroom, respectively, for each combination. These values are shown in column 5 in Table 2, Table 3 and Table 4, which shows the sets where i and j vary in each case.
    Table 2. Grouping of variables for each parameter of the classroom lighting characteristic.
    Table 3. Grouping of variables for each parameter of the classroom characteristic dimensions.
    Table 4. Grouping of variables for each parameter of the classroom characteristic color.
  • Let m i j x , m i j y , and m i j z be the means of the levels of memory obtained in the lighting, dimensions, and color conditions of the base classroom, respectively, for each combination. These values are shown in column 4 in Table 2, Table 3 and Table 4, with the same sets for i and j cited above.
  • Let p i j x , p i j y , and p i j z be the means of the levels of preference obtained for the lighting, dimensions, and color conditions of the base classroom, respectively, for each combination. These values are shown in column 6 in Table 2, Table 3 and Table 4, with the same sets for i and j cited above.
  • Let a ¯ x , a ¯ y ,   a ¯ z ,   m ¯ x ,   m ¯ y ,   m ¯ z , p ¯ x , p ¯ y , and p ¯ z be the means of the values a i j x , a i j y , a i j z , m i j x , m i j y , m i j z , p i j x , p i j y , and p i j z , respectively, with their respective variations being i and j. These values are shown at the end of the respective columns in Table 2, Table 3 and Table 4;
  • Let x i j ,   y i j , and z i j be the 0–1 variables whose values of 1 indicate that the classroom has lighting with illuminance of type i, color temperature of type j, dimensions with height type i, and width type j, and walls colored with hue type i, and with saturation type j, respectively. Conversely, a 0 value indicates that the classroom does not have type i lighting and j-type color temperature, dimensions of height type i and width type j, and walls colored with tone type i and saturation of type j, respectively. These variables are shown in column 3 of Table 1, Table 2 and Table 3, respectively.
Table 2, Table 3 and Table 4 provide the data obtained on illumination, dimensions, and color, respectively.

4. Mathematical Model

The problem of identifying the combinations of the six classroom parameters (height, width, color hue, color saturation, color temperature, and lighting) that provide the best results for memory and attention performance and preference was addressed by modeling a MOILP problem designed to optimize these functions. It should be noted that the aim is to maximize the memory and preference values and minimize the attention values. Therefore, equality M a x i m i z e   f ( x ) = M i n i m i z e   ( f ( x ) ) is used for the attention function. With this equation, all the functions can be maximized.
Taking into account the information given in Section 3.3.1, the ideal MOILP problem should consider 5760 binary variables, each one corresponding to a different combination of color hue, color saturation, lighting, color temperature, height, and width. Its aim should be maximizing the three-dimensional vector corresponding to the average (normalized) results of memory, attention, and preference obtained for each one of the 5760 combinations. However, to pose and solve this problem is practically impossible due to the data collection time (more than 14,400 h) and to the number of variables. Instead, a more realistic situation is to consider the 56 variables introduced in Section 3.3.1 and detailed in Section 3.5 so that the three-dimensional vector to maximize has as components the sum of the means of the results of memory, the sum of the means of the results of attention, and the sum of the means of the results of preference (always normalized values) for each one of the 12 combinations of lighting and color temperature, 24 combinations of height and width, and 20 combinations of color hue and color saturation (a total of 56 combinations).
Therefore, using the notation given in Section 3.5, the following MOILP problem was formulated:
Maximize ( i = 1 3 j = 1 4 m i , j x · x i , j + i = 1 4 j = 1 6 m i , j y · y i , j + i = 1 10 j = 1 2 m i , j z · z i , j , i = 1 3 j = 1 4 a i , j x · x i , j i = 1 4 j = 1 6 a i , j y · y i , j i = 1 10 j = 1 2 a i , j z · z i , j , i = 1 3 j = 1 4 p i , j x · x i , j + i = 1 4 j = 1 6 p i , j y y i , j + i = 1 10 j = 1 2 p i , j z · z i , j )
s.t:
i = 1 3 j = 1 4 x i , j = 1  
i = 1 4 j = 1 6 y i , j = 1  
i = 1 10 j = 1 2 z i , j = 1  
i = 1 3 j = 1 4 m i , j x · x i , j + i = 1 4 j = 1 6 m i , j y · y i , j + i = 1 10 j = 1 2 m i , j z · z i , j   m ¯ x + m ¯ y + m ¯ z
i = 1 3 j = 1 4 a i , j x · x i , j i = 1 4 j = 1 6 a i , j y · y i , j i = 1 10 j = 1 2 a i , j z · z i , j a ¯ x a ¯ y a ¯ z
i = 1   3 j = 1 4 p i , j x · x i , j + i = 1 4 j = 1 6 p i , j y · y i , j + i = 1 10 j = 1 2 p i , j z · z i , j p ¯ x + p y + p ¯ z  
  x i , j   , y i , j , z i , j { 0 , 1 }     i , j  
where:
Equation (1) represents the multi-objective function, that is, the vector with components students’ memory, attention, and preference.
Equations (2)–(4) guarantee that each classroom is composed of a single parameter of illuminance and temperature in terms of lighting, height, and width (in terms of size) and a single parameter of hue and saturation (in terms of wall color), respectively.
Equations (5)–(7) ensure that the total memory value is higher than the sum of the memory means, the total attention value is higher than the sum of the attention means, and the total preference value is higher than the sum of the preference means, respectively. Note that these three inequations represent the logical lower bounds for the functions, and they can be changed for other more (or less) demanding inequations []. The reason why these three restrictions were included in the formulation will be discussed later.
Equation (8) defines the problem variables as binaries.
Other linear restrictions could be added to the formulation if considered opportune. Moreover, it is obvious that this formulation can be extended to a more general formulation, with general bounds for i and j in each case, to more objective functions and to more variable types.
As stated in Section 1, there are several ways to obtain the set of efficient solutions to a MOILP problem. In this case, the following scalarization of the MOILP problem was used: Given λ 1 , λ 2 , λ 3 + with λ 1 + λ 2 + λ 3 = 100 and b a , b m , b p with b a a ¯ x a ¯ y a ¯ z ,   b m m ¯ x + m ¯ y + m ¯ z and b p p ¯ x + p y + p ¯ z ,   the optimal solutions corresponding to each ILP problem formulated as follows are efficient solutions to the MOILP problem [], with objective function given by Equation (9) and restrictions given by Equations (2)–(4), (8) and (10)–(12).
Maximize   λ 1 ( i = 1 3 j = 1 4 m i , j x · x i , j + i = 1 4 j = 1 6 m i , j y · y i , j + i = 1 10 j = 1 2 m i , j z · z i , j ) +   λ 2 ( i = 1 3 j = 1 4 a i , j x · x i , j i = 1 4 j = 1 6 a i , j y · y i , j i = 1 10 j = 1 2 a i , j z · z i , j ) +   λ 3 ( i = 1 3 j = 1 4 p i , j x · x i , j + i = 1 4 j = 1 6 p i , j y y i , j + i = 1 10 j = 1 2 p i , j z · z i , j )
i = 1 3 j = 1 4 m i , j x · x i , j + i = 1 4 j = 1 6 m i , j y · y i , j + i = 1 10 j = 1 2 m i , j z · z i , j b m
i = 1 3 j = 1 4 a i , j x · x i , j i = 1 4 j = 1 6 a i , j y · y i , j i = 1 10 j = 1 2 a i , j z · z i , j b a
i = 1   3 j = 1 4 p i , j x · x i , j + i = 1 4 j = 1 6 p i , j y · y i , j + i = 1 10 j = 1 2 p i , j z · z i , j   b l
Note that Equations (5)–(7) are particular cases of Equations (10)–(12), respectively. This is the fact by which they have been considered in the formulation of the problem. Therefore, from a theoretical point of view, solving a MOILP problem involves solving infinite ILP problems, as shown above (one for each combination of λ 1 , λ 2 , λ 3 , b a , b m   a n d   b p ). However, it is likely that the vast majority of these ILP problems will have the same optimal solutions, and the total number of different efficient solutions will not be very high because the variables are integers and particularly in this case, where they are binary.
An interactive procedure based on the scalarization described above is used here to obtain good (according to the DM), efficient solutions to the MOILP problem. As usual with this method, a subset of efficient solutions is generated, and from this subset, the DM draws conclusions and proposes, for instance, new bounds for the objective functions to generate a new subset of efficient solutions, which are in turn analyzed by the DM and so on, until the DM decides which are the most efficient solutions to the MOILP.
The proposed heuristic is shown below. This procedure does not guarantee identification of the complete set of efficient solutions, but based on the problem’s characteristics, it is expected that it will obtain a representative set of solutions.
Heuristic:
Step 1. For each combination of even numbers λ 1 , λ 2 , λ 3 + with λ 1 + λ 2 + λ 3 = 100 (1176 ILP combinations), solve (with Mathematica v12.1) the ILP problem with Equation (9) as the objective function, using the restrictions of Equations (2)–(8). Solve the same problem but with λ 1 = λ 2 = λ 3 = 100 / 3 (the same weight for all three objective functions). The DM assesses the set of optimal solutions obtained (all of them are efficient solutions to the MOILP problem) and makes decisions, such as removing from the list of solutions those not considered adequate, and establishes (increases or decreases) the percentile to be used in Step 2.
Step 2. Repeat Step 1, changing the right-hand side of Equations (5)–(7) by the percentile i provided by the DM of the list of 1177 non-dominated objective vectors corresponding to each objective function (in the first execution of Step 1). The new solutions obtained are saved (although sometimes no solution is obtained). This step is repeated until no further solutions emerge, and all the percentiles j with j < i have been considered along the heuristic or until the DM decides that even if more solutions may exist, it is not important to identify them.
Step 3. The DM draws conclusions about those efficient solutions obtained in the process that remain in the list.
The criteria to be used by the DM to remove or maintain efficient solutions in the list in Step 2 and to decide which are the best solutions in Step 3 depend on the situation. Thus, in general, the classroom will be designed to take account of all three cognitive processes (memory, attention, and preference), but it is possible that, in circumstances in which a high cognitive load is required, such as taking an exam, the DM will choose a criterion prioritizing memory and attention over preference.
To give a general idea of how the heuristic works, in Step 2, the lower bounds for the values of the objective functions vary; these variations are the percentiles of the 1177 initial solutions. The higher the percentile, the greater the requirement for the objective functions. If, for instance, the DM introduces a high percentile, and none of the 1177 ILP problems has a feasible solution, during the next Step 2 run, the DM might lower the percentile to try to obtain new solutions or even to terminate the process. The number of iterations will be finite, as it is obvious that from a certain percentile (unknown a priori), no new solutions will be found.
Note that, in each iteration, the proposed heuristic must optimally solve 1177 ILP problems, each of which theoretically has exponential complexity. Therefore, from a computational viewpoint, this is a complex heuristic; but the Mathematica V.12 tool has been shown to be very effective in this regard. This fact, together with the simplicity of the alternation and connection between the computation phases and the intervention phases of the DM, has prompted the authors of the present study to opt for this heuristic although, obviously, other procedures could have been applied to obtain a reasonable set of “good”, efficient solutions to the MOILP problem here formulated.

5. Results

The results obtained by the heuristic are shown in Table 5. On the 1st run of Step 1, only 10 efficient solutions were obtained from the 1177 ILP problems. This caused the DM to adopt a conservative stance and advance from percentile to percentile. The DM decided not to discard any of the 10 solutions and to apply the 1st percentile in the 1st run of Step 2. On the 2nd run of Step 1, seven efficient solutions to the MOILP problem were obtained from the new 1177 ILP problems, only two of which were new. The DM decided not to discard any of the 12 solutions and applied the 2nd percentile in the 2nd run of Step 2. Only two efficient solutions were obtained during the 3rd run of Step 1 from the new 1177 ILP problems, only one of which differed from those previously obtained. The DM decided not to discard any of the 13 solutions and applied the 3rd percentile in the 3rd run of Step 2. None of the 1177 ILP problems assessed in the 4th run of Step 1 had a feasible solution; therefore, the heuristic procedure was terminated after the DM provided conclusions on the 13 efficient solutions obtained (provided below).
Table 5. Set of efficient solutions obtained with the heuristic.
The Mathematica software was run on a PC Intel®CoreTM I5-7500 with 3.40 GHz and 16GB RAM. The average CPU time to obtain the optimal solution on all ILP problems was 0.0035 s, with a maximum value of 0.0156 s and a minimum value of 0 s, which, according to Mathematica’s assumptions, means that the calculation took no measurable CPU time.
Figure 2 represents the position in three-dimensional space of the points corresponding to the 13 non-dominated objective vectors obtained by the heuristic. Note that the Mathematica software automatically scales the points. Figure 3 shows the points of the vectors of the three objective functions on the same scale. It is worth remembering that the values entered in Equation (1) are normalized.
Figure 2. Three-dimensional graph of the efficient solution set.
Figure 3. Levels of psychological metrics of each efficient solution.
In Step 3, the DM identified the four best solutions based on the different selection criteria. The first criterion is to ensure that the three objective functions are broadly in balance, that is, that one is not more salient than the others. Based on this decision, the DM chose solutions 9 and 10. It is worth mentioning that solution 10 attached equal importance to the three metrics ( λ 1 = λ 2 = λ 3 = 100 / 3 ) and was the most frequently cited solution to the 1770 problems. Another possible criterion would be to prioritize memory and attention over preference, particularly relevant in the design of classrooms where important cognitive effort is required, such as for exams. In this case, the DM would select solutions 1 and 3. Table 6 lists the design configurations of these four solutions.
Table 6. Design configurations for the best solutions.
As shown in Table 6, the best solutions have the same illumination color temperature (6500 K) and the same wall color saturation (low). The difference between the solutions, according to the decision criteria, is in illuminance. A higher illuminance level (300 lx) enhances attention and memory processes although it is regarded as less pleasant, decreasing preference level. The solutions with the best results in attention, memory, and preference levels (9 and 10) have the same characteristics in terms of lighting, color saturation, and dimension but feature different hues. On the other hand, the solutions that enhance attention and memory feature the same configurations except in dimensions.

6. Discussion

The present study aims to identify the combination of classroom design parameters that optimize students’ internal psychological processes by applying MOLP as an analysis method and using VR as an environmental-simulation tool. The study makes three fundamental contributions: one methodological, one at the results level, and one at the application level.
As for the methodological contribution, a mathematical analysis was undertaken to complement the traditional statistical approach of the behavioral study. In this sense, this methodology is novel and ideal for: (1) identifying the design configurations that take into account the combination of parameters that make up spaces, as in real scenarios; (2) optimizing several objective psychological metrics, which is of special interest for multi-functional spaces; and (3) considering the judgement of an expert, which is important in human behavior studies.
The results of the present study provided a small set of efficient solutions to be evaluated by the DM. As shown in Table 5, there are two possible selection criteria. On the one hand, taking into account the three cognitive processes, the DM would select solutions 10 and 9, which combine dimensions of 4.4 m height and 8.4 m width, interior artificial lighting of 6500 K and 100 lx, and low-saturation blue or purple wall color. These solutions are suitable, as they maintain a high level of preference and the best combination of attention and memory levels. Moreover, solution 10 gives all three psychological metrics equal importance ( λ 1 = λ 2 = λ 3 = 100 / 3 ). Another possible criterion would be to prioritize memory and attention over preference given their importance in learning [,]. Both are important for class sessions with activities that require different levels of cognitive load, such as taking exams [], undertaking projects [], and teaching through alternative educational methodologies, such as the flipped classroom []. In this case, the DM would choose solutions 1 and 3, which combine interior artificial lighting of 6500 K and 300 lx, low-saturation purple wall color, and dimensions of 3.2 m height and 6 m width or 4.4 m height and 8.4 m width. These solutions, while subject to the constraints of the model, are efficient for this set of cognitive processes; while they present the lowest preference values, they achieved the highest values in the combination of attention and memory. The preference–performance relationship has been examined in many studies, but no conclusive results have been achieved. Some authors have negatively correlated the two [], and others have done so positively [].
In any case, this research provides concrete design results to consider. The benefit of using a color temperature of 6500 K was clear for attention, memory, and preference. In addition, some authors have observed that blue-enriched white light has a positive effect on performance [,]. The combination of high lighting color temperature (6500 K) and low illuminance (100 lx and 300 lx) was common to all 13 solutions. Several authors have shown that lower illuminance improves cognitive performance [,]. This lighting effect is repeated with color. Virtually all the solutions featured low-saturation colors. Similarly, Kwallek et al. [] observed that fewer errors were made in performance tasks in environments with colors of saturations similar to or lower than those used in the present study. The solutions included both cold and warm hues. On this issue, the literature is conflicting. Some authors, for example, Mahnke [], have argued that better academic performance is achieved with blue colors in high/secondary school classrooms, while Barret [] observed that warm-hue colors are more appropriate for senior grades and that cold-hue colors are more appropriate for junior grades. As to the dimensions contextual key, in no case did lower ceilings (2.4 m) or narrow classrooms (3.6 m) improve student performance. Specifically, heights between 3.2 m and 4.4 m and widths between 6 m and 8.4 m provided efficient solutions. This outcome may be consistent with the results obtained by Vartanian et al. [], in which high ceilings were evaluated as more beautiful than low ceilings because they expanded the viewers’ fields of view.
Regarding the application contribution, this article connects two different fields of study: architecture and psychology. In general, from the architectural perspective, studies have analyzed human responses to built spaces taking preference as the main decision-making criterion [,] and used psychological metrics other than task performance, that is, through self-reports [,]; this may be a limited approach. The present study proposes using environmental preferences (typical in architectural studies) and the results of tests analyzing cognitive processes (typical in psychology studies) to bridge the gap between the two disciplines.

7. Conclusions and Future Research

This study addresses the complexity of the analysis of the effects of classroom environments on subjects. This complexity drives the need to analyze the various environmental characteristics of classrooms and the cognitive processes involved in learning. This process requires the application of techniques that can simultaneously analyze a large number of variables. In the present study, the MOLP analysis technique was applied to optimize this set of variables. The advantages of this method for this work are: (1) it takes into account the interdependencies between classroom characteristics; (2) it maximizes the levels of the cognitive processes attention, memory, and preference; and (3) it provides several efficient solutions to allow the DM to select the most appropriate depending on the situation. In this case, the best solutions share interior artificial lighting of 6500 K and low-saturation wall colors. If the DM wants to achieve high levels in the three psychological metrics (memory, attention, and preference), the classroom should also be 4.4 m high and 8.4 m wide and have 100 lx of lighting and blue or purple wall color. If, on the other hand, the requirement is to enhance only the cognitive functions of attention and memory, the DM will choose a classroom combining 300 lx and low-saturation purple wall color, with dimensions of 3.2 m height and 6 m width or 4.4 m height and 8.4 m width. These results may be of interest to researchers and professionals involved in the design of educational centers.
Finally, as for future research lines, three aspects should be considered. First, the present study used auditory tasks to examine the processing of classroom characteristics. In future works, it would be interesting to include other types of tasks, as information processing through other sensory pathways requires different neural bases [,,]. Second, regarding the stimuli presented, it would be interesting to address the influence of multisensory contextual cues []. Synergies between interior design parameters may involve senses other than sight, such as auditory and tactile temperature receptors []. Third, regarding the sample, it would be interesting to analyze whether differences exist between men and women [,]. In all these lines, MOILP analyses with appropriate interactive methods can help researchers to obtain good results.

Author Contributions

Conceptualization, M.L.N. and D.S.; methodology, J.L.H.-T. and M.L.N.; software, J.L.H.-T., M.L.N. and D.S.; validation, C.L., J.L.H.-T., M.L.N. and D.S.; formal analysis, M.L.N. and D.S.; investigation, C.L., J.L.H.-T. and M.L.N.; resources, J.L.H.-T.; data curation, M.L.N. and D.S.; writing—original draft preparation, C.L., J.L.H.-T., M.L.N. and D.S; writing—review and editing, C.L., J.L.H.-T., M.L.N. and D.S.; visualization, J.L.H.-T. and M.L.N.; supervision, C.L. and D.S.; project administration, C.L. and D.S.; funding acquisition, C.L. and D.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Grant BIA2017-86157-R, funded by MCIN/AEI/10.13039/501100011033, and by ERDF—“A way of making Europe” and also derived from R&D project RTI2018-096384-B-I00, funded by MCIN/AEI/10.13039/501100011033 and “ERDF A way of making Europe”.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of the Universitat Politècnica de València (P1_25_07_18; 25 July 2018).

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

The first author is supported by the Spanish Ministry of Universities (FPU19/03531). The third author (postdoctoral fellow “Margarita Salas”) is supported by funding from the Spanish Ministry of Universities and by the European Union NextGenerationEU.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study, in the collection, analysis or interpretation of the data, in the writing of the manuscript or in the decision to publish the results.

References

  1. Luptacik, M. Multiobjetive linear programming. In Mathematical Optimization and Economic Analysis, 1st ed.; Pardalos, P.M., Du, D.Z., Eds.; Springer: New York, NY, USA, 2010; Volume 36, pp. 243–269. [Google Scholar]
  2. Sakawa, M.; Yano, H.; Nishizaki, I. Multiobjective linear programming. In Linear and Multiobjective Programming with Fuzzy Stochastic Extensions, 1st ed.; Hillier., F.S., Ed.; Springer: Boston, MA, USA, 2013; Volume 203, pp. 73–102. [Google Scholar]
  3. Antunes, C.H.; Alves, M.J.; Clímaco, J. Multiobjective integer and mixed-integer linear programming. In Multiobjective Linear and Integer Programming, 1st ed.; Antunes, C.H., Alves, M.J., Clímaco, J., Eds.; Springer: Cham, Switzerland, 2016; pp. 161–203. [Google Scholar]
  4. Herzel, A.; Ruzika, S.; Thielen, C. Approximation methods for multiobjective optimization problems: A survey. INFORMS J. Comput. 2020, 33, 1284–1299. [Google Scholar] [CrossRef]
  5. Halffmann, P.; Schäfer, L.E.; Dächert, K.; Klamroth, K.; Ruzika, S. Exact algorithms for multiobjective linear optimization problems with integer variables: A state of the art survey. J. Multi-Criteria Decis. Anal. 2022, 1–23. [Google Scholar] [CrossRef]
  6. Sherali, H.D.; Driscoll, P.J. Evolution and state-of-the-art in integer programming. J. Comput. Appl. Math. 2000, 124, 319–340. [Google Scholar] [CrossRef]
  7. Chan, D.Y.; Ku, C.Y.; Li, M.C. A method to improve integer linear programming problem with branch-and-bound procedure. Appl. Math. Comput. 2006, 179, 484–493. [Google Scholar] [CrossRef]
  8. Fallah, M.K.; Fazlali, M.; Daneshtalab, M. A symbiosis between population based incremental learning and LP-relaxation based parallel genetic algorithm for solving integer linear programming models. Computing 2021, 1–19. [Google Scholar] [CrossRef]
  9. Tantawy, S.F. A new procedure for solving integer linear programming problems. Arab. J. Sci. Eng. 2014, 39, 5265–5269. [Google Scholar] [CrossRef]
  10. Tengan, T.; Yoshida, T.; Nakamura, M. A monte carlo iterative optimization algorithm for integer linear programming problems. Int. J. Comput. Sci. Netw. Secur. 2018, 18, 60–67. [Google Scholar]
  11. Alves, M.J.; Clímaco, J. A review of interactive methods for multiobjective integer and mixed-integer programming. Eur. J. Oper. Res. 2007, 180, 99–115. [Google Scholar] [CrossRef]
  12. Köhn, H.F. A review of multiobjective programming and its application in quantitative psychology. J. Math. Psychol. 2011, 55, 386–396. [Google Scholar] [CrossRef]
  13. González-Gallardo, S.; Ruiz, A.B.; Luque, M. Analysis of the well-being levels of students in spain and finland through interval multiobjective linear programming. Mathematics 2021, 9, 1628. [Google Scholar] [CrossRef]
  14. Oliveira, C.; Antunes., C.H. Multiple objective linear programming models with interval coefficients—An illustrated overview. Eur. J. Oper. Res. 2007, 181, 1434–1463. [Google Scholar] [CrossRef]
  15. Prieto-Latorre, C.; Lopez-Agudo, L.A.; Luque, M.; Marcenaro-Gutierrez, O.D. The ideal use of the internet and academic success: Finding a balance between competences and knowledge using interval multiobjective programming. Socio-Econ. Plan. Sci. 2021, 101208. [Google Scholar] [CrossRef]
  16. Karakas, T.; Yildiz, D. Exploring the influence of the built environment on human experience through a neuroscience approach: A systematic review. Front. Archit. Res. 2020, 9, 236–247. [Google Scholar] [CrossRef]
  17. Marín-Morales, J.; Higuera-Trujillo, J.L.; Guixeres, J.; Llinares, C.; Alcañiz, M.; Valenza, G. Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios. PLoS ONE 2021, 16, e0254098. [Google Scholar] [CrossRef] [PubMed]
  18. Ammann, J.; Stucki, M.; Siegrist, M. True colours: Advantages and challenges of virtual reality in a sensory science experiment on the influence of colour on flavour identification. Food Qual. Prefer. 2020, 86, 103998. [Google Scholar] [CrossRef]
  19. Latini, A.; Di Giuseppe, E.; D’Orazio, M.; Di Perna, C. Exploring the use of immersive virtual reality to assess occupants’ productivity and comfort in workplaces: An experimental study on the role of walls colour. Energy Build. 2021, 253, 111508. [Google Scholar] [CrossRef]
  20. Armougum, A.; Orriols, E.; Gaston-Bellegarde, A.; Joie-La Marle, C.; Piolino, P. Virtual reality: A new method to investigate cognitive load during navigation. J. Environ. Psychol. 2019, 65, 101338. [Google Scholar] [CrossRef]
  21. Rizzo, A.A.; Bowerly, T.; Buckwalter, J.G.; Klimchuk, D.; Mitura, R.; Parsons, T.D. A virtual reality scenario for all seasons: The virtual classroom. Cns Spectr. 2006, 11, 35–44. [Google Scholar] [CrossRef]
  22. Iriarte, Y.; Diaz-Orueta, U.; Cueto, E.; Irazustabarrena, P.; Banterla, F.; Climent, G. AULA—Advanced virtual reality tool for the assessment of attention: Normative study in Spain. J. Atten. Disord. 2016, 20, 542–568. [Google Scholar] [CrossRef]
  23. Diaz-Orueta, U.; Garcia-López, C.; Crespo-Eguilaz, N.; Sánchez-Carpintero, R.; Climent, G.; Narbona, J. AULA virtual reality test as an attention measure: Convergent validity with Conners’ Continuous Performance Test. Child Neuropsychol. 2013, 20, 328–342. [Google Scholar] [CrossRef]
  24. Hoffman, A.J. Going “green” from gray: Providing opportunities of community development and sustainability within a correctional facilities program. J. Prev. Interv. Community 2020, 48, 272–280. [Google Scholar] [CrossRef]
  25. Kim, D.; Hyun, H.; Park, J. The effect of interior color on customers’ aesthetic perception, emotion, and behavior in the luxury service. J. Retail. Consum. Serv. 2020, 57, 102252. [Google Scholar] [CrossRef]
  26. Toews, B.; Wagenfeld, A.; Stevens, J.; Shoemaker, C. Feeling at home in nature: A mixed method study of the impact of visitor activities and preferences in a prison visiting room garden. J. Offender Rehabil. 2020, 59, 223–246. [Google Scholar] [CrossRef]
  27. Ulrich, R.S. View through a window may influence recovery from surgery. Science 1984, 224, 420–421. [Google Scholar] [CrossRef] [PubMed]
  28. Pritchard, A. Ways of Learning: Learning Theories for the Classroom, 4th ed.; Routledge: London, UK, 2017. [Google Scholar]
  29. Schunk, D.H. Learning Theories an Educational Perspective, 6th ed.; Pearson: Boston, MA, USA, 2012. [Google Scholar]
  30. Brosowsky, N.P.; Murray, S.; Schooler, J.W.; Seli, P. Attention need not always apply: Mind wandering impedes explicit but not implicit sequence learning. Cognition 2021, 209, 104530. [Google Scholar] [CrossRef] [PubMed]
  31. Jongbloed-Pereboom, M.; Nijhuis-Van der Sanden, M.W.G.; Steenbergen, B. Implicit and explicit motor learning in typically developing children: Effects of task, age and working memory. Physiotherapy 2015, 101, e693–e694. [Google Scholar] [CrossRef][Green Version]
  32. Sörqvist, P.; Marsh, J.E. How concentration shields against distraction. Curr. Dir. Psychol. Sci. 2015, 24, 267–272. [Google Scholar] [CrossRef]
  33. Sörqvist, P.; Dahlström, Ö.; Karlsson, T.; Rönnberg, J. Concentration: The neural underpinnings of how cognitive load shields against distraction. Front. Hum. Neurosci. 2016, 10, 221. [Google Scholar] [CrossRef]
  34. Gao, T.; Zhang, T.; Zhu, L.; Gao, Y.; Qiu, L. Exploring psychophysiological restoration and individual preference in the different environments based on virtual reality. Int. J. Environ. Res. Public Health 2019, 16, 3102. [Google Scholar] [CrossRef]
  35. Bryan, T.; Mathur, S.; Sullivan, K. The impact of positive mood on learning. Learn. Disabil. Q. 1996, 19, 153–162. [Google Scholar] [CrossRef]
  36. Loewen, L.J.; Suedfeld, P. Cognitive and arousal effects of masking office noise. Environ. Behav. 1992, 24, 381–395. [Google Scholar] [CrossRef]
  37. Aldridge, S.; Rowley, J. Measuring customer satisfaction in higher education. Qual. Assur. Educ. 1998, 6, 197–204. [Google Scholar] [CrossRef]
  38. Van den Berg, A.E.; Wesselius, J.E.; Maas, J.; Tanja-Dijkstra, K. Green walls for a restorative classroom environment: A controlled evaluation study. Environ. Behav. 2017, 49, 791–813. [Google Scholar] [CrossRef]
  39. Doxey, J.S.; Waliczek, T.M.; Zajicek, J.M. The impact of interior plants in university classrooms on student course performance and on student perceptions of the course and instructor. HortScience 2009, 44, 384–391. [Google Scholar] [CrossRef]
  40. Daly, J.; Burchett, M.; Torpy, F.; National Interior Plantscape Association. Plants in the classroom can improve student performance. 2010. Available online: https://www.wolvertonenvironmental.com/Plants-Classroom.pdf (accessed on 13 February 2022).
  41. Wheldall, K.; Lam, Y.Y. Rows versus Tables. II. The Effects of Two Classroom Seating Arrangements on Classroom Disruption Rate, On-task Behaviour and Teacher Behaviour in Three Special School Classes. Educ. Psychol. 1987, 7, 303–312. [Google Scholar] [CrossRef]
  42. Baum, E.J. Learning space design and classroom behavior. Int. J. Learn. Teach. Educ. Res. 2018, 17, 34–54. [Google Scholar] [CrossRef][Green Version]
  43. Wannarka, R.; Ruhl, K. Seating arrangements that promote positive academic and behavioural outcomes: A review of empirical research. Support Learn. 2008, 23, 89–93. [Google Scholar] [CrossRef]
  44. Shernoff, D.; Sannella, A.; Schorr, R.; Sanchez-Wall, L.; Ruzek, E.; Sinha, S.; Bressler, D. Separate worlds: The influence of seating location on student engagement, classroom experience, and performance in the large university lecture hall. J. Environ. Psychol. 2017, 49, 55–64. [Google Scholar] [CrossRef]
  45. Park, E.L.; Choi, B.K. Transformation of classroom spaces: Traditional versus active learning classroom in colleges. High. Educ. 2014, 68, 749–771. [Google Scholar] [CrossRef]
  46. Marchand, G.; Nardi, N.M.; Reynolds, D.; Pamoukov, S. The impact of the classroom built environment on student perceptions and learning. J. Environ. Psychol. 2014, 40, 187–197. [Google Scholar] [CrossRef]
  47. Bernardo, F.; Loupa-Ramos, I.; Matos, C.; Manso, M. The restorative effect of the presence of greenery on the classroom in children’s cognitive performance. Sustainability 2021, 13, 3488. [Google Scholar] [CrossRef]
  48. Barrett, P.; Davies, F.; Zhang, Y.; Barrett, L. The impact of classroom design on pupils’ learning: Final results of a holistic, multi-level analysis. Build. Environ. 2015, 89, 118–133. [Google Scholar] [CrossRef]
  49. Kwallek, N.; Lewis, C.M.; Lin-Hsiao, J.W.D.; Woodson, H. Effects of nine monochromatic office interior colors on clerical tasks and worker mood. Color Res. Appl. 1996, 21, 448–458. [Google Scholar] [CrossRef]
  50. Cockerill, I.M.; Miller, B.P. Children’s Colour Preferences and Motor Skill Performance with Variation in Environmental Colour. Percept. Mot. Ski. 1983, 56, 845–846. [Google Scholar] [CrossRef]
  51. Stone, N.J. Environmental view and color for a simulated telemarketing task. J. Environ. Psychol. 2003, 23, 63–78. [Google Scholar] [CrossRef]
  52. Xia, T.; Song, L.; Wang, T.T.; Tan, L.; Mo, L. Exploring the Effect of Red and Blue on Cognitive Task Performances. Front. Psychol. 2016, 7, 784. [Google Scholar] [CrossRef]
  53. Llinares, C.; Higuera-Trujillo, J.L.; Serra, J. Cold and warm coloured classrooms. Effects on students’ attention and memory measured through psychological and neurophysiological responses. Build. Environ. 2021, 196, 107726. [Google Scholar] [CrossRef]
  54. Jago, E.; Tanner, K. Influence of the School Facility on Studies Achievement: Lighting; Color, Athens, Ga; Department of Educational Leadership, University of Georgia: Athens, GA, USA, 1999. [Google Scholar]
  55. Smolders, K.C.; de Kort, Y.A. Bright light and mental fatigue: Effects on alertness, vitality, performance and physiological arousal. J. Environ. Psychol. 2014, 39, 77–91. [Google Scholar] [CrossRef]
  56. Llinares, C.; Castilla, N.; Higuera-Trujillo, J.L. Do attention and memory tasks require the same lighting? A study in university classrooms. Sustainability 2021, 13, 8374. [Google Scholar] [CrossRef]
  57. Huiberts, L.M.; Smolders, K.C.H.J.; de Kort, Y.A.W. Shining light on memory: Effects of bright light on working memory performance. Behav. Brain Res. 2015, 294, 234–245. [Google Scholar] [CrossRef]
  58. Keis, O.; Helbig, H.; Streb, J.; Hille, K. Influence of blue-enriched classroom lighting on students cognitive performance. Trends Neurosci. Educ. 2014, 3, 86–92. [Google Scholar] [CrossRef]
  59. Read, M.A.; Sugawara, A.I.; Brandt, J.A. Impact of space and color in the physical environment on preschool children’s cooperative behavior. Environ. Behav. 1999, 31, 413–428. [Google Scholar] [CrossRef]
  60. Llinares, C.; Higuera-Trujillo, J.L.; Montañana i Aviñó, A.; Torres, J.; Sentieri, C. The influence of classroom width on attention and memory: Virtual-reality-based task performance and neurophysiological effects. Build. Res. Inf. 2021, 49, 813–826. [Google Scholar] [CrossRef]
  61. Roskos, K.; Neuman, S.B. The classroom environment: First, last, and always. Read. Teach. 2021, 65, 110–114. [Google Scholar] [CrossRef]
  62. Yang, Z.; Becerik-Gerber, B.; Mino, L. A study on student perceptions of higher education classrooms: Impact of classroom attributes on student satisfaction and performance. Build. Environ. 2013, 70, 171–188. [Google Scholar] [CrossRef]
  63. Ahrentzen, S.; Evans, G.W. Distraction, privacy, and classroom design. Environ. Behav. 1984, 16, 437–454. [Google Scholar] [CrossRef]
  64. Smolders, K.C.; De Kort, Y.A.; Cluitmans, P.J.M. A higher illuminance induces alertness even during office hours: Findings on subjective measures, task performance and heart rate measures. Physiol. Behav. 2012, 107, 7–16. [Google Scholar] [CrossRef]
  65. Al-Ayash, A.; Kane, R.T.; Smith, D.; Green-Armytage, P. The influence of color on student emotion, heart rate, and performance in learning environments. Color Res. Appl. 2016, 41, 196–205. [Google Scholar] [CrossRef]
  66. Steuer, J. Defining virtual reality: Dimensions determining telepresence. J. Commun. 1992, 42, 73–93. [Google Scholar] [CrossRef]
  67. Lombard, M.; Ditton, T. At the heart of it all: The concept of presence. J. Comput.-Mediat. Commun. 1997, 3, JCMC321. [Google Scholar] [CrossRef]
  68. Higuera-Trujillo, J.L.; Maldonado, J.L.T.; Millán, C.L. Psychological and physiological human responses to simulated and real environments: A comparison between photographs, 360 panoramas, and virtual reality. Appl. Ergon. 2017, 65, 398–409. [Google Scholar] [CrossRef] [PubMed]
  69. Itten, J. Design and Form: The Basic Course at the Bauhaus, 1st ed.; Thames & Hudson: London, UK, 1987. [Google Scholar]
  70. Beato, M.S.; Díez, E. False recognition production indexes in Spanish for 60 DRM lists with three critical words. Behav. Res. Methods 2001, 43, 499–507. [Google Scholar] [CrossRef] [PubMed][Green Version]
  71. Seidman, L.J.; Breiter, H.C.; Goodman, J.M.; Goldstein, J.M.; Woodruff, P.W.R.; O’Craven, K.; Savoy, R.; Tsuang, M.T.; Rosen, B.R. A functional magnetic resonance imaging study of auditory vigilance with low and high information processing demands. Neuropsychology 1998, 12, 505. [Google Scholar] [CrossRef] [PubMed]
  72. Galindo-Galindo, M.P.; Corraliza Rodríguez, J.A. Estética ambiental y bienestar psicológico: Algunas relaciones existentes entre los juicios de preferencia por paisajes urbanos y otras respuestas afectivas relevantes. Apunt. Psicol. 2012, 30, 289–303. [Google Scholar]
  73. Slater, M.; Usoh, M.; Steed, A. Depth of presence in virtual environments. Presence Teleoperators Virtual Environ. 1994, 3, 130–144. [Google Scholar] [CrossRef]
  74. Slater, M.; Steed, A. A virtual presence counter. Presence Teleoperators Virtual Environ. 2000, 9, 413–434. [Google Scholar] [CrossRef]
  75. Vogel, S.; Schwabe, L. Learning and memory under stress: Implications for the classroom. Npj Sci. Learn. 2016, 1, 16011. [Google Scholar] [CrossRef]
  76. Sart, G. The effects of the development of metacognition on project-based learning. Procedia-Soc. Behav. Sci. 2014, 152, 131–136. [Google Scholar] [CrossRef]
  77. Mattis, K.V. Flipped classroom versus traditional textbook instruction: Assessing accuracy and mental effort at different levels of mathematical complexity. Technol. Knowl. Learn. 2015, 20, 231–248. [Google Scholar] [CrossRef]
  78. Burke, K.; Burke-Samide, B. Required changes in the classroom environment it’s a matter of design. Clear. House A J. Educ. Strateg. Issues Ideas 2004, 77, 236–240. [Google Scholar] [CrossRef]
  79. Ferlazzo, F.; Piccardi, L.; Burattini, C.; Barbalace, M.; Giannini, A.M.; Bisegna, F. Effects of new light sources on task switching and mental rotation performance. J. Environ. Psychol. 2014, 39, 92–100. [Google Scholar] [CrossRef]
  80. Leccese, F.; Salvadori, G.; Öner, M.; Kazanasmaz, T. Exploring the impact of external shading system on cognitive task performance, alertness and visual comfort in a daylit workplace environment. Indoor Built Environ. 2020, 29, 942–955. [Google Scholar] [CrossRef]
  81. Leichtfried, V.; Mair-Raggautz, M.; Schaeffer, V.; Hammerer-Lercher, A.; Mair, G.; Bartenbach, C.; Canazei, M.; Schobersberger, W. Intense illumination in the morning hours improved mood and alertness but not mental performance. Appl. Ergon. 2015, 46, 54–59. [Google Scholar] [CrossRef] [PubMed]
  82. Mahnke, F.H. Color, Environment, and Human Response: An Interdisciplinary Understanding of Color and Its Use as a Beneficial Element in the Design of the Architectural Environment; John Wiley & Sons: Hoboken, NJ, USA, 1996. [Google Scholar]
  83. Barrett, P.; Zhang, Y.; Moffat, J.; Kobbacy, K. A holistic, multilevel analysis identifying the impact of classroom design on pupils’ learning. Build. Environ. 2013, 59, 678–689. [Google Scholar] [CrossRef]
  84. Vartanian, O.; Navarrete, G.; Chatterjee, A.; Fich, L.B.; Gonzalez-Mora, J.L.; Leder, H.; Skov, M. Architectural design and the brain: Effects of ceiling height and perceived enclosure on beauty judgments and approach-avoidance decisions. J. Environ. Psychol. 2015, 41, 10–18. [Google Scholar] [CrossRef]
  85. Herzog, T.R. A cognitive analysis of preference for urban spaces. J. Environ. Psychol. 1992, 12, 237–248. [Google Scholar] [CrossRef]
  86. Stamps, A.E. Simulation effects on environmental preference. J. Environ. Manag. 1993, 38, 115–132. [Google Scholar] [CrossRef]
  87. Lipczynska, A.; Schiavon, S.; Graham, L.T. Thermal comfort and self-reported productivity in an office with ceiling fans in the tropics. Build. Environ. 2018, 135, 202–212. [Google Scholar] [CrossRef]
  88. Bear, M.F.; Connors, B.W.; Paradiso, M.A. Neurociencia: La Exploración del Cerebro; Wolters Kluwer: Alphen aan den Rijn, The Netherlands, 2016. [Google Scholar]
  89. Carlson, N.R.; Platón, M.J.R.; Carson, N.R.; Urbano, B.C. Fundamentos de Fisiología de la Conducta; Pearson Educación: London, UK, 2010. [Google Scholar]
  90. Ganong, W.F.; Barrett, K.E.; Barman, S.M.; Boitano, S.; Brooks, H.L. Ganong. In Sección III: Neurofesiología Central y Periferica; McGraw-Hill Interamericana Editores: Ciudad de México, Mexico, 2010; pp. 167–299. [Google Scholar]
  91. Yang, W.; Moon, H.J. Combined effects of acoustic, thermal, and illumination conditions on the comfort of discrete senses and overall indoor environment. Build. Environ. 2019, 148, 623–633. [Google Scholar] [CrossRef]
  92. Picucci, L.; Caffò, A.O.; Bosco, A. Besides navigation accuracy: Gender differences in strategy selection and level of spatial confidence. J. Environ. Psychol. 2011, 31, 430–438. [Google Scholar] [CrossRef]
  93. Miola, L.; Meneghetti, C.; Toffalini, E.; Pazzaglia, F. Environmental learning in a virtual environment: Do gender, spatial self-efficacy, and visuospatial abilities matter? J. Environ. Psychol. 2021, 78, 101704. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.