1. Introduction
Improving the user experience is crucial to human–computer interaction (HCI). It is imperative to comprehend and enhance the diversity of individual experiences [
1]. Given that most individuals spend a substantial portion of their time within indoor environments—more than 90%—the quality of these spaces considerably affects various aspects of well-being, including health, productivity, and comfort [
2]. Consequently, several initiatives have been undertaken to enhance building occupants’ comfort and well-being while increasing efficiency [
3,
4]. Assessing and optimizing human comfort in the built environment presents a complex challenge, given the extensive range of variables involved [
5]. Research has demonstrated that perceptions of comfort are subjective and influenced by many factors, including thermal, visual, air quality, and acoustics [
6].
These factors have been shown to affect health and productivity significantly [
7,
8,
9]. Quantifying environmental factors in physical spaces is relatively straightforward, but accurately assessing comfort levels remains challenging [
6]. Recent research has found a notable increase in interest in technologies capable of automatically recognizing emotional states. Emotions are essential in human physiological and mental states [
10]. Electroencephalography (EEG) is a tool that can identify brain activity associated with different states over time [
11]. Its potential applications have been recognized in various fields, including marketing, fatigue monitoring, e-learning, and healthcare [
10,
12,
13,
14,
15,
16].
Contemporary advancements in sensing and communication technologies have rendered the collection and processing of substantial data in real time a viable proposition [
17]. This technology has demonstrated the capacity to detect human activity in smart homes via wearable devices and sensors distributed throughout the environment [
18]. These developments have facilitated the integration of wireless sensor networks in the construction industry [
19]. Regardless, existing research has concentrated on developing autonomous building systems for various applications, including health monitoring and fire detection [
20,
21]. These general applications do not reflect the diverse physiological conditions of individuals, which constrains their capacity to fulfill individual environmental preferences and needs [
22,
23,
24].
This study aims to develop a real-time EEG-driven personal comfort model to create emotionally responsive architectural spaces, enabling enhanced built environments tailored to individual emotions and preferences. Specifically, it employs real-time deep learning methodologies to predict the preferences of space users effectively by utilizing EEG. The analysis methodology is appropriate for time series data and examines users’ EEG measurements in varying spatial contexts and circumstances. The research questions were derived by decomposing the expected outcomes regarding their psychological relationships with illumination as the primary environmental factor. The study’s hypotheses were:
Specific illumination levels in indoor environments can reduce users’ stress, improve attention and engagement, and maximize comfort.
Deep learning models utilizing EEG and illumination data can predict individual comfort in real time and recommend optimal lighting conditions.
After the introduction, we review the relevant literature to examine the need for personalized spatial environment design and real-time personal comfort models according to emotional cognition, laying the groundwork for the proposed research. Next, we provide a detailed account of the experimental setup, model structure, and implementation process. We present a comprehensive account of the methodology employed in constructing the real-time model and a detailed exposition of the experimental findings. In conclusion, we examine the implications, contributions, limitations, and potential avenues for future research presented in this paper.
2. Literature Review
2.1. Personalized Environmental Spaces for Occupants
The comfort level of a spatial environment significantly affects a user’s learning ability and productivity [
25,
26,
27]. Many factors, including physiological, psychological, and physical elements, determine human comfort [
28]. In this context, several studies have examined the relationship between physical measurements and subjective responses, thereby contributing to the development of indoor environmental control solutions that optimize user comfort [
29,
30]. The indoor environment exerts various health, well-being, and performance effects.
Likewise, subjective responses can vary significantly from one individual to another, even when the conditions remain identical [
28]. In particular, light significantly influences various cognitive processes, including attention [
31,
32,
33], working memory [
34,
35,
36,
37], and overall cognitive performance [
38,
39]. Bright light has been shown to enhance attention and working memory performance [
31,
34]. Lighting can influence emotional states, interacting with subjective mood and modulating emotional processing [
40]. Occupants’ productivity is contingent on providing suitable indoor lighting conditions. Creating a pleasant and secure indoor environment can potentially enhance users’ comfort and well-being [
41].
Incorporating personalized space design is crucial in optimizing spaces’ efficiency and user satisfaction by reflecting individuals’ specific needs and preferences [
42]. A recent study indicates that implementing personalized design methodologies and utilizing computer graphics and machine learning techniques, can enhance users’ psychological comfort and task satisfaction [
43]. Personalization of workspaces that automatically adjust lighting, temperature, desk height, and other factors has been shown to affect psychological comfort and job satisfaction positively [
44]. Personalizing intelligent buildings is crucial for achieving an equilibrium between energy consumption and user well-being [
45]. It enables developing novel systems that provide tailored feedback and environmental conditioning to diverse users [
46]. Implementing personalized environmental conditions has been demonstrated to promote health, comfort, and productivity [
47,
48,
49,
50], underscoring the significance of customized environmental systems in sustainable buildings. It has been demonstrated that the ability to control indoor environmental conditions is closely associated with users’ perceived comfort and environmental satisfaction [
51,
52,
53]. For example, Baird and Lechat [
47] noted the significance of lighting control, and Ilvitskaya et al. [
49] highlighted the pivotal role of natural elements for visual comfort. In their analysis of the sustainability of innovative interior design, Barbosa et al. [
50] considered the effect of learning spaces on building comfort. Similarly, López-Chao et al. [
51] explored the sustainability of learning spaces.
Accordingly, personalizing built environments necessitates a comprehensive approach to optimizing user experience. Custom design has emerged as a pivotal strategy to address the diverse needs of users [
54]. However, existing personalized systems primarily prioritize system efficiency, which does not fully leverage the elements of the built environment. This can be enhanced by integrating architectural design with HCI to create novel interfaces [
55]. Recent studies have exemplified this integration through practical frameworks. For example, Economidou et al. [
56] proposed an HBI framework that emphasizes lived experience in human–building interaction and provides guidance for incorporating occupants’ subjective perspectives into design. Hamdani and Chihi [
57] introduced an Adaptive HCI model for Industry 5.0 that dynamically adapts to user behavior, cognitive load, and environmental changes, demonstrating improved efficiency and reduced cognitive strain. Lin et al. [
58] presented a framework that leverages multimodal data and neural correlates of spatial experience to inform AI-supported, user-centered design tools. These approaches demonstrate the potential of integrating architectural design with HCI to advance personalized environmental systems that more effectively address users’ cognitive requirements.
2.2. Emotional Cognition and Real-Time Personal Comfort Model
Emotions are a significant aspect of daily human life, and with the advancement of HCI applications, automated emotion recognition is becoming increasingly necessary. Recently, there has been a surge of interest in emotion recognition using EEG, with promising results in real-time emotional state determination [
59,
60,
61,
62]. EEG-driven technologies have historically been employed in the medical domain. However, with the advent of wireless headsets, which have enhanced wearability, cost-effectiveness, portability, and ease of use, their applications are expanding to diverse fields [
63]. EEG can detect immediate responses to emotional stimuli with exceptional temporal resolution, thereby providing a comprehensive means of emotion recognition. Further, it is an effective method for determining concentration and stress levels [
64,
65]. EEG signals are significant in emotion recognition because they can monitor many physiological responses in real time. For example, an EEG fatigue detection system can monitor a driver’s fatigue status in real time [
66,
67]. Moreover, EEG is less susceptible to deception than behavioral responses, as it captures involuntary neurophysiological activity that is difficult to consciously manipulate [
68]. It can also achieve higher classification accuracy than other physiological signals, such as electrocardiogram, skin temperature, and galvanic skin response, particularly in detecting cognitive or affective states where brain activity offers more direct markers [
69]. The extant real-time emotion recognition systems employ stimuli such as pictures and sounds to induce emotions and are constrained to identifying emotions from the arousal-value matrix in isolation. In light of these considerations, the proposal of a real-time system for recognizing an individual’s emotional state according to EEG represents a potential avenue for overcoming the above-stated limitations, reducing the inaccuracy of subjective reports, and accurately assessing emotional states in real time [
70].
EEG-driven systems for real-time monitoring and control of individual comfort in indoor environments underscore the significance of real-time application [
71]. Such systems facilitate an enhanced user experience by processing data expeditiously and providing immediate feedback. Previous studies have employed EEG signals to track users’ cognitive state but have been constrained by limitations in real-time response speed and accuracy [
72]. Recent studies have employed deep learning techniques, resulting in notable advancements in the real-time processing of EEG data [
73]. Deep learning techniques enable the development of real-time systems according to EEG signals [
74] and facilitate the automation of data preprocessing and feature extraction, thereby enhancing the real-time response speed [
75]. Real-time EEG systems monitor user health and provide immediate feedback in the event of any abnormalities [
76]. They also control various devices through brain–computer interface [
77]. These systems necessitate the capacity for high-speed data processing, precise signal classification, and real-time responsiveness [
78,
79,
80,
81] to maintain individual comfort and facilitate immediate response in a multitude of indoor settings. Recurrent neural networks (RNNs) are frequently employed to address the time series data characteristics of EEG signals [
82] because they effectively capture the temporal features of EEG signals [
83]. As Chen et al. [
84] demonstrated, a real-time emotion recognition system employing gated recurrent units (GRUs) can monitor stress levels by analyzing the user’s emotional state in real time from EEG data. This enables the system to recommend suitable rest periods or stress relief techniques to the user. Integrating EEG and deep learning is a highly effective real-time approach to monitoring and analyzing an individual’s emotional state, enhancing emotion recognition, and creating a personalized and comfortable environment [
85,
86]. Despite recent advances, most EEG-based systems have focused on general emotion or fatigue under controlled laboratory stimuli, limiting their applicability to built environment research.
While some recent studies have begun applying EEG directly to architectural contexts, their emphases have differed from cognitive performance. For instance, the concept of sustainable neuro-responsive habitats integrates brain–computer interfaces with building information modeling to create adaptive residential spaces, highlighting the role of neurophysiological data in shaping sustainable housing design [
87]. Another study demonstrated the feasibility of real-time thermal regulation by using EEG-based assessments of individual thermal sensation, thereby linking neurophysiological responses to heating, ventilation, and air conditioning (HVAC) control strategies [
88]. More recently, EEG-based emotion analysis combined with CNN–LSTM deep learning techniques has been employed to predict occupants’ architectural space preferences, suggesting the potential of EEG for data-driven spatial design decisions [
89]. While these approaches highlight the increasing significance of EEG in the architectural field, their focus has mainly been on thermal comfort and overall spatial preferences, with limited consideration of illumination’s impact on cognitive performance. Although illumination is well established as a determinant of comfort and cognitive performance, its incorporation into EEG-driven personal comfort models has been limited. This study addresses this limitation by developing a real-time model centered on illumination, extending EEG applications toward adaptive and cognitively supportive architectural environments.
3. Materials and Methods
3.1. Experiment Setup
3.1.1. Subjects
The single-subject research design is a methodology well suited to the detailed observation and analysis of behavioral changes in specific individuals. It has been used effectively in a variety of fields. Given the complexity and variability of human behavior, encompassing both individual and contextual variations, a methodology that applies to diverse settings and individuals is essential for user-centered research [
90,
91,
92,
93]. Using single-subject studies enhances data consistency and accuracy because it accurately captures users’ needs and preferences. This approach is fundamental in implementing customized comfort environments, offering the advantage of detailed analysis of individual users’ needs and reactions. In this study, the single-subject design was adopted as an exploratory study to examine the feasibility of real-time EEG-based comfort modeling in the context of illumination. The findings are presented as illustrative, and future research should focus on accumulating data from diverse individuals to refine and extend personalized comfort models. The detailed insights derived from repeated and controlled measurements on a single individual nevertheless provide a valuable foundation for advancing user-specific environmental models.
Accordingly, a single subject (Participant A) was selected to conduct repeated experiments to control personalized spatial environments. The participant was a 28-year-old female architectural researcher with corrected vision and normal hearing, and no history of neurological or psychiatric disorders. She maintained a regular sleep schedule and refrained from consuming alcohol, tea, or coffee for at least 24 h before each session to minimize physiological variability. The selection was also based on her familiarity with EEG equipment and ability to remain still for extended periods, which helped ensure high-quality data acquisition with minimal artifacts. This study followed the ethical guidelines set forth by the Ethics Committee of Hanyang University (HYU-2023-280) and received the committee’s approval. The participant was required to sign an informed consent form confirming full understanding of the experiment.
3.1.2. EEG Equipment
In this study, data were collected using the Emotiv EPOC X EEG headset (Emotiv Inc., San Francisco, CA, USA), with the prominent EEG bands (δ, θ, α, β, γ) as the primary focus. The electrodes for EEG measurements were positioned by the 10 to 20 international standard system, comprising 14 channels and two reference channels. The data may be monitored, processed, and analyzed in real time via the EmotivPRO v.3.7.0 software [
94].
Preprocessing the EEG data entails removing power noise and high frequencies within the EPOC X headset. The data are sampled at 2048 Hz and then passed through a high-pass filter of 0.16 Hz and a low-pass filter of 43 Hz. A dual-notch filter removes noise at 50 Hz and 60 Hz. Subsequently, the data are downsampled to 256 Hz or 128 Hz. Emotiv employs machine learning algorithms to categorize various emotional states and conditions, offering three distinct detection algorithms (Performance Metrics, Mental Commands, and Facial Expressions). The performance metrics include six emotion metrics, quantified on a scale of zero to 100, representing the user’s psychological and physiological response to the emotions depicted in
Table 1 [
95].
3.1.3. Experiment Procedure and Environment
All windows were kept closed to eliminate external natural light, and the existing lecture hall lights were switched off. Illumination was provided solely by a single ceiling light temporarily installed in the experimental room, ensuring that only controlled lighting conditions were maintained throughout the study. Additionally, the participant was provided with earplugs to mitigate the potential effect of external noise. To collect a broad range of data under varying lighting conditions, the experiment spanned three days, with five daily sessions commencing at 9 am, 12 pm, 3 pm, 6 pm, and 9 pm. The primary focus of this study was on the effects of lighting conditions, rather than on variations across different times of day. Previous research supports this approach, showing that light can modulate cognitive and neural responses [
39]. Each session comprised five trials, contingent on the prevailing light conditions, and lasted approximately 55 min (see
Figure 1) [
96].
The experiment was conducted in a lecture hall with experimental equipment and a simple room. For EEG measurements, an experimental room measuring 800 × 1200 × 2000 mm was placed in the center of the lecture hall. The space was covered with aluminum-plated film to provide a constant and uniform lighting environment and block external interference, thereby improving the accuracy of EEG measurements (see
Figure 2).
The experimental procedure was as follows. At the commencement of the experimental session, a baseline was established utilizing the EmotivPRO appliance to eliminate any extraneous electrical noise from the participant’s EEG. Environmental sensor data were collected in conjunction with the EEG data from Participant A for 5 min [
97,
98]. The temperature and humidity were continuously monitored and maintained within a consistent range throughout the experiment to ensure environmental stability. Following data collection, the illuminance value was maintained for five minutes to stabilize the lighting device and ensure uniformity of the experimental environment. The experimenter provided no instructions beyond those necessary to operate the lighting device, and the participant was not permitted to look directly at the light.
Area A is the site of EEG experimentation and is equipped with standing desks. Illuminance sensors were installed in Area B to measure the lighting conditions continuously. These sensors are labeled by the Korean Industrial Standards (KS) C 7612:1987 (illuminance measurement for lighting installations) [
99], and one is installed at each end of the upper surface (virtual surface within 5 cm) of the desk work surface. Intelligent temperature and humidity sensors are positioned in Area C to record environmental data. The ceiling luminaire in Area D is equipped with five levels of illuminance control, according to the KS A 3011:1998 (recommended levels of illumination) [
100], offering 150, 300, 450, 600, and 750 Lx.
3.2. Data Acquisition and Preprocessing
The collection and preprocessing of various sensor data were divided into two principal stages for model training. In the initial phase, diverse sensor data, encompassing EEG-derived performance metrics and spatial environmental data, were gathered. The EEG dataset included metrics related to stress (St), engagement (En), and attention (At). These metrics serve as critical indicators of the user’s psychological and physiological state, collectively representing personal comfort by capturing negative and positive cognitive and emotional dimensions. Specifically, stress reflects the degree of tension experienced, while engagement and attention indicate the level of immersion and focus, respectively.
Prior studies support the rationale for this selection. Lang et al. [
101] demonstrated that the relative power of alpha (α), theta (θ), and beta (β) EEG frequency bands is significantly and positively correlated with both thermal comfort and cognitive task performance, with α-band power in particular serving as a robust indicator of subjective comfort. Pino et al. [
102] showed that increased EEG-derived engagement elevates cognitive function and is closely linked to a flow state—an optimal, low-stress condition of immersive, productive focus. Conversely, Veranic et al. [
103] found that the suppression of α-band activity, particularly during the intrusion of personal space, reflects heightened attentional engagement associated with anxiety and vigilance rather than comfort per se. Their findings emphasize that increased attention is not inherently indicative of well-being; rather, it may reflect a defensive state elicited by environmental stressors.
Building on these findings, our model conceptualizes personal comfort as a positive state characterized by low stress and high levels of engagement and attention. That is, while both engagement and attention reflect increased cognitive focus on tasks or the environment, only engagement under low stress reliably corresponds to optimal comfort and performance. This distinction allows our model to capture the nuanced interplay between these neurophysiological states, thereby providing a comprehensive measure of individual well-being in dynamic environments. In summary, our approach defines optimal personal comfort as a state of high engagement and attention under minimal stress, ensuring that defensive or vigilance-driven attention is not conflated with comfort.
Thus, these three metrics provide a comprehensive real-time assessment of personal comfort. To operationalize this, the Personal comfort (PC) index can be conceptually modeled as a weighted combination of these EEG metrics as follows:
where α, β, γ are weighting coefficients reflecting the relative influence of each metric (assigned as α = 0.5, β = 0.25, γ = 0.25 to emphasize negative effects (stress reduction) while equally accounting for positive effects (engagement and attention)), serving as the conceptual foundation. Building upon this, actual prediction is performed using a gated recurrent unit (GRU) deep learning architecture that integrates EEG metrics with environmental factors such as illumination, temperature, and humidity, allowing the model to capture complex nonlinear and temporal relationships for adaptive and individualized environmental optimization. The model is constructed to establish an optimal environment by identifying interrelationships between various environmental factors influencing illuminance and formulating corresponding recommendations. Temperature and humidity are additionally monitored to ensure their stability, minimizing interference from other environmental variables.
EEG data were collected using EmotivPRO v.3.7.0 software, while spatial environmental data were gathered in real time via the Home Assistant system. The collected data were integrated at 10 s intervals using Node-RED (OpenJS Foundation, San Francisco, CA, USA) v.3.1, resulting in a dataset of five-minute segments saved as comma-separated values (CSV) files. In the second phase, the data were transformed into formats conducive to model training. This preprocessing included the incorporation of emotional metrics (stress, engagement, and attention) alongside physical environmental factors (illumination, temperature, and humidity). After removing incomplete or corrupted data segments caused by sensor artifacts or communication failures via automated filtering procedures, the dataset was organized to facilitate analysis.
The preprocessed dataset was split into training and testing sets, with 80% of the data allocated for training and the remaining 20% reserved for testing. Due to the limited size of the dataset (7500 data points), a separate validation set was not used; model training and evaluation were conducted solely on the training and test subsets. To normalize the collected sensor data with varying characteristics, we employed the MinMaxScaler (see Equation (2)) to transform all values into numbers between zero and one. This approach reduces the discrepancy between EEG data and spatial environmental data, thereby facilitating comparative analysis and enhancing the stability and efficiency of the model training process.
3.3. Model Construction
3.3.1. Model Selection
RNNs effectively process data continuity over time, particularly when analyzing time series data such as EEG. Among these, the GRU regulates data flow through update and reset gates, providing a faster learning speed and greater computational efficiency with a more straightforward structure and fewer parameters than long short-term memory networks (LSTMs). The GRU unifies the traditional input and forgetting gates into a single update gate, streamlining the model structure and facilitating rapid learning and prediction [
82] (see
Figure 3). The ability to process data rapidly and efficiently is crucial for sensors to operate in real time. GRUs are particularly suited to fulfilling this need. GRUs demonstrate comparable performance to LSTMs while utilizing fewer parameters [
104]. While other recurrent models such as LSTM were considered, GRUs were chosen based on a balance of predictive performance and computational efficiency. The choice was also aligned with the real-time operational requirements of the system, where minimizing latency and model complexity was essential.
The structural properties of GRUs are well suited to efficiently processing real-time data streams. The need for rapid response and adaptation in real-time data processing is a significant challenge. The compact structure of GRUs allows them to incorporate new input information and identify time-varying data patterns with remarkable efficiency [
105,
106]. Further, GRUs can effectively learn time series data by addressing the long-term dependence issue, a limitation of RNN models. These characteristics are particularly advantageous for EEG data analysis, enabling rapid data integration and training and real-time model updates to maximize the efficiency and accuracy of the training process [
107,
108].
3.3.2. Hyperparameter Optimization
A feature selection process is employed to ensure the optimal time series data classification to ascertain that only pertinent features are applied in the model’s training. This approach has the dual benefit of reducing computation time and enhancing the model’s performance. Hyperparameters are variables in machine learning models that the user must define. Therefore, these parameters must be correctly set to optimize the model’s performance. The objective of this study is to construct a GRU-grounded neural network model that is optimized for time series data through the process of hyperparameter tuning.
The GRU model comprises two layers, with dropout applied to each layer to prevent overfitting and enhance generalization performance [
109]. We employed the rectified linear unit (ReLU) activation function in the output layer to introduce nonlinearity and permit the model to discern more intricate patterns [
110,
111,
112]. The Adam optimizer was employed for the optimization function to automatically adjust the learning rate and momentum, facilitating rapid and efficient learning [
113,
114].
The efficacy of a learning model is contingent on the specific combination of hyperparameters employed. Consequently, it is imperative to identify the optimal hyperparameter settings. This study employed the Optuna framework, which utilizes the tree-structured parzen estimator algorithm to efficiently explore and evaluate optimal hyperparameter combinations during the GRU model training process [
115,
116]. The principal hyperparameters are the dropout rate, which determines the percentage of neurons to be randomly deactivated to prevent overfitting; the learning rate, which determines the rate at which the model learns and the size of the weight updates; the number of epochs, which is the number of times the network is shown data during the entire training process; and the batch size, which is the number of data patterns shown before updating the weights (see
Table 2).
3.3.3. Model Evaluation
To assess the efficacy of the constructed GRU-grounded time series data prediction model, we undertook a process of hyperparameter optimization. The model’s performance was evaluated by measuring the loss function to identify the optimal combination of parameters. The results were obtained through 30 iterations of training (see
Figure 4).
In the data regression analysis, the statistical performance of the model was evaluated using the performance metrics of mean square error (MSE), root mean square error (RMSE), and mean absolute error (MAE), as defined in Equation (3). The MSE is a statistical measure that quantifies the discrepancy between the predicted and actual values. The RMSE is a variant of the MSE that normalizes the error by the standard deviation, providing a measure of the average squared deviation. The MAE is a further variant of the MSE calculated as the average of the absolute deviations [
117,
118]. The overall performance evaluation of the model indicates that the MSE is approximately 0.0012, the RMSE is 0.0348, and the MAE is 0.0214. These results suggest the model can make accurate predictions on the dataset (see
Table 3)
A graphical representation of the changes in MSE and MAE throughout the training process (see
Figure 5) demonstrates a gradual reduction in the error rate as training progresses and the discrepancy between training and test metrics diminishes. This suggests that the model avoids overfitting and improves its prediction accuracy through generalization. The constructed GRU model receives real-time EEG and assorted environmental sensor data to forecast the user’s psychological and physiological state. The system can predict several variables according to EEG and environmental data, including stress index and concentration level, which can then be correlated with performance metrics. The GRU model considers the temporal continuity of input data, identifies the effect of data from previous times on the current prediction, and incorporates this information into its predictions.
By examining the interrelationship between patterns identified in EEG data and environmental data, the model can anticipate how a user’s psychological state may evolve when subjected to specific environmental conditions. By identifying patterns indicating an increase in stress levels under specific light or temperature conditions, the model can predict stress levels and alert when these conditions are present. This predictive capability enables rapid and precise responses to real-time data streams, facilitating immediate user feedback. In conclusion, the GRU model demonstrates effective real-time EEG and environmental sensor data processing, clearly identifying time-varying patterns and high prediction accuracy. This enables the model to provide personalized solutions across various applications.
4. Results
4.1. EEG-Driven Personal Comfort Model
In this study, we constructed the comfort model to predict and recommend the illuminance level of personal comfort in real time. As illustrated in
Figure 6, the comfort model is operated in real time and implemented in two main frameworks. Initially, the pretrained GRU model is updated. This is a method of retraining whereby data collected in real time is added to the existing model. As the amount of data increases, the accuracy of the model improves. Subsequently, a prediction and ranking are conducted. The model suggests customized environmental conditions and calculates relative scores to provide the optimal environment, recommending the light level to reach the desired emotional metrics.
The model’s training process is integrated through the Google Cloud Platform (GCP), which provides the technical foundation for storing and processing the collected data and continuous training and updating of the GRU model. Additionally, pretrained GRU models and scalers are located and utilized on GCP. After accumulating data collected in real time for five minutes, comprising 60 data points, a mechanism integrated into the cloud storage system is triggered, initiating the preprocessing and conversion of the data into a format suitable for training the GRU model. During the transformation process, any missing values are removed from the dataset, ensuring only the necessary information is extracted. The system operates according to data measured in real time, offering an automated and efficient method of processing and predicting real-time data.
4.2. Updating Model
The adaptability and accuracy of the GRU model can be enhanced by continuously updating its conditions through interaction with real-time data (see
Figure 7).
Following data preprocessing, the GRU model is updated continuously through the application of the continuous learning process. Continuous learning is defined as “learning over time by accepting new knowledge while retaining previously learned experience.” It is also known as “incremental learning” or “lifelong learning.” This learning method ensures the continuous incorporation of new data collected in real time into the model, enabling effective adaptation to evolving data patterns. The model is updated by learning from new data, which is particularly beneficial in contexts that continuously generate data streams [
119,
120,
121].
Traditional machine learning models are trained on large datasets, and generalized patterns are learned from those datasets. However, models of personal comfort, which consider the interaction between users’ emotional responses and their spatial environments, require the learning process to use personal experience. This involves gradually collecting and fine-tuning data over an extended period to predict comfort metrics in a given space. In particular, incorporating spatial environment reactions can enhance the model’s predictive capabilities by updating only the user’s specific experiences in previous environments.
4.3. Prediction and Ranking
The GRU model is employed to make predictions from real-time data. The model artificially extends the dataset by duplicating the last 30 data points, creating the requisite space for the prediction process to generate 30 consecutive predictions (see
Figure 8).
In the prediction process, each sequence of 60 data points—which is data collected in real time—is fed into the model. The model makes predictions regarding the occurrence of a subvalue according to the most recent data point in the sequence. Predictions are then made sequentially for each subsequent data point, commencing with the sixty-first data point. This prediction method considers the continuity of the time series data, enabling the formulation of predictions at various points shortly.
A relative score is calculated for the predicted temperature, humidity, and illumination values to rank them according to the user’s preferred conditions. This allows the user to receive suggestions regarding optimal environmental conditions. The score is determined by weighting the independent variables stress (
St), attention (
At), and engagement (
En) with EEG emotion indicators. The relative scores for the concentration indicators (
At,
En) are set at a higher level for more positive emotional states. Further, as each indicator approaches the maximum value of that variable, the calculated score increases. In contrast, the stress indicator (
St) is calculated using the formula 1 − (maximum value), whereby a lower stress value corresponds to a higher score (see
Table 4).
The final score is calculated by summing the concentration metric (At, En = 0.25 each) and the stress metric (St = 0.5), which determines the weight of the final score. The output dataset is then sorted in descending order according to the final score, with each data point assigned a rank. The relative score for each performance metric is calculated, and the previously set weights are applied to derive a composite score. Subsequently, the highest-ranked data are extracted, and the output is transmitted to the Google Cloud Pub/Sub service. It is then conveyed to Node-RED, which can be employed as input to control and operate spatial environment devices.
5. Discussion
This study developed and tested a real-time EEG-driven personal comfort model focusing on illumination. The results demonstrated the feasibility of combining EEG signals with environmental sensor data and deep learning techniques to predict and recommend individualized lighting conditions that enhance cognitive efficiency and comfort. However, the relationship between diverse spatial environmental variables and emotional responses must be more thoroughly considered to enhance the model’s precision. In addition, the relatively short experimental period limited the ability to observe long-term changes and patterns. Further research could be conducted to develop more sophisticated personal comfort models by incorporating additional environmental variables and psychological metrics. This approach will ultimately make a significant contribution to the fields of intelligent architecture and human-centered environmental design.
Nevertheless, the study is significant because it demonstrates the potential of combining EEG and deep learning techniques to enable objective and precise comfort assessment and immediate environmental adjustment, thereby establishing the feasibility of a real-time personalized environment system.
Based on these findings, several implications and contributions can be highlighted. First, unlike previous studies that used subjective surveys, self-assessments, and other similar techniques to assess psychological states, this study integrates EEG and data from multiple sensors to measure an individual’s psychological comfort more accurately. This indicates that designers and researchers may utilize integrated systems comprising diverse sensors to develop tailored user experiences, particularly in classrooms, offices, and other task-oriented environments where concentration and productivity are critical. Second, this study’s findings demonstrate that integrating wearable EEG headsets and environmental sensors enables the real-time monitoring of an individual’s psychological state, facilitating the provision of environmental conditions that enhance comfort. These findings have practical implications for the real-time management of user comfort. Third, this study’s insights can be employed in developing a framework capable of monitoring and adjusting environmental conditions regularly to maintain users’ psychological stability and comfort, thereby directly supporting cognitive functions such as attention that are essential in learning and work settings. Moreover, the study’s framework can be applied to other psychological indicators, such as stress, attention, and engagement, or other environmental variables, which can contribute to more effective environmental management.
To further illustrate the applicability of this approach, a potential application scenario is presented in
Figure 9. In this example, light levels are adjusted regularly to enhance concentration (
En,
At) and reduce stress (
St). These adjustments are made every five minutes to meet the corresponding targets and continue to be adjusted afterwards by re-collecting data. This enables the implementation of customized comfort management strategies in many settings, which may ultimately lead to enhanced productivity and other beneficial outcomes.
The system operates through four sequential steps. In the initial phase of “Real-time Monitoring”, EEG signals are recorded using a headset. During the subsequent “Data Analysis” phase, the program processes key metrics such as stress, engagement, and attention. In the “Illumination Adjustment” phase, the program dynamically regulates the light level based on the analysis to enhance attention and engagement while simultaneously reducing stress. Finally, in the “Feedback Loop” phase, illumination is continuously adjusted in real time according to changes in EEG signals to maintain optimal conditions for personalized comfort and performance.
The “Getting Started” panel in the center of the screen provides guidance on system initialization. In this process, the user wears the EEG headset and establishes a connection with the program, which then begins monitoring EEG signals. The interface also informs the user that the surrounding environment can be adjusted according to the recommended light values displayed. The left graph depicts the attention, engagement, and stress levels, which are measured at 10 s intervals in real-time. The dotted line from the present moment to the right illustrates the projected levels after modifying the light to align with the recommended parameters. The graph on the right displays the changes in illumination over a five-minute interval, along with the recommended illumination five minutes hence. Additionally, it shows the current cognitive score and the predicted score, which would be altered by adjusting the recommended illumination.
The images on the right depict the illumination situation five minutes ago (A), the current illumination situation (B), and the change according to the recommended illumination (C). These configurations clearly illustrate how the system uses real-time data to provide an optimal light environment that aligns with the user’s psychological and physiological state. This enhances user concentration and stress reduction, enabling customized comfort management in various indoor environments.
6. Conclusions
This study presents an EEG-driven personal comfort model designed to predict and optimize the indoor environment’s effect on an individual’s psychological state and productivity in real time. The data were collected using three environmental variables: illuminance, temperature, and humidity. A real-time prediction and recommendation system was constructed using the GRU model. This illustrates the value of personal comfort models. The personalized comfort model provides optimal environmental conditions that reflect each individual’s preferences and psychological state, integrating various sensor data to construct a comprehensive comfort model.
The results of this study address two key hypotheses. First, while the model does not claim to demonstrate direct causal effects, it was designed to identify illumination conditions correlating with EEG-indicated reductions in stress and improvements in attention and engagement, thus supporting psychological comfort. Second, the GRU-based model effectively integrated EEG and illumination conditions to enable real-time prediction of comfort states and provide personalized environmental recommendations.
The study’s findings yield the following significant implications:
A real-time system that integrates EEG and environmental sensor data can accurately monitor and optimize the psychological comfort of users. This provides more accurate and objective data than traditional subjective assessment methods, which can contribute to realizing personalized environments.
A quantitative approach can be employed to assess the influence of environmental factors, such as indoor illumination, on an individual’s stress, attention, and engagement levels.
The model can adapt effectively to changing data patterns by incorporating new data collected in real time. The findings indicate that real-time personal comfort models have the potential for practical application in various indoor settings.
These findings highlight the study’s methodological and applied contributions. Methodologically, the research advances comfort modeling by integrating EEG with multi-sensor environmental data in a GRU-based framework, enabling objective and real-time assessment of psychological states. Practically, the model demonstrates value by providing personalized recommendations for indoor environmental conditions, offering direct implications for human-centered environmental design. Overall, the study establishes the feasibility of real-time EEG-driven personalized environmental control, laying the groundwork for future intelligent and user-centered built environments.
Author Contributions
Conceptualization, S.Y.K.; methodology, S.Y.K.; investigation, S.Y.K. and J.E.C.; analysis, S.Y.K. and J.E.C.; visualization, S.Y.K. and J.E.C.; software, S.Y.K. and J.E.C.; validation, S.Y.K. and J.E.C.; writing—original draft preparation, S.Y.K.; writing—editing, S.Y.K. and J.E.C.; writing—review, H.J.J.; supervision, H.J.J.; project administration, H.J.J.; funding acquisition, H.J.J. All authors have read and agreed to the published version of the manuscript.
Funding
This research was funded by the National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIT) (No. NRF 2022R1A2C3011796). This work was supported by the research fund of Hanyang University (HY- 202500000000860).
Institutional Review Board Statement
The study was conducted in accordance with the Declaration of Helsinki, and approved by the Ethics Committee of Hanyang University (protocol code HYUIRB-202311-033, time 29 November 2023).
Informed Consent Statement
Written informed consent has been obtained from the participant to publish this paper.
Data Availability Statement
The raw EEG datasets generated during the current study are not publicly available due to privacy and ethical restrictions, but derived data supporting the findings of this study are available from the corresponding author upon reasonable request.
Conflicts of Interest
The authors declare no conflicts of interest.
References
- Mccarthy, J.; Wright, P.; Wallace, J.; Dearden, A. The experience of enchantment in human–computer interaction. Pers. Ubiquitous Comput. 2006, 10, 369–378. [Google Scholar] [CrossRef]
- Lan, L.; Wargocki, P.; Wyon, D.P.; Lian, Z. Effects of thermal discomfort in an office on perceived air quality, SBS symptoms, physiological responses, and human performance. Indoor Air 2011, 21, 376–390. [Google Scholar] [CrossRef]
- Choi, J.; Aziz, A.; Loftness, V. Investigation on the impacts of different genders and ages on satisfaction with thermal environments in office buildings. Build. Environ. 2010, 45, 1529–1535. [Google Scholar] [CrossRef]
- Choi, J.-H.; Moon, J. Impacts of human and spatial factors on user satisfaction in office environments. Build. Environ. 2017, 114, 23–35. [Google Scholar] [CrossRef]
- Jayathissa, P.; Quintana, M.; Abdelrahman, M.; Miller, C.; Jayathissa, P.; Quintana, M.; Abdelrahman, M.; Miller, C. Humans-as-a-Sensor for Buildings—Intensive Longitudinal Indoor Comfort Models. Buildings 2020, 10, 174. [Google Scholar] [CrossRef]
- Rawi, M.I.M.; Al-Anbuky, A.; Rawi, M.I.M.; Al-Anbuky, A. Wireless sensor networks and human comfort index. Pers. Ubiquitous Comput. 2012, 17, 999–1011. [Google Scholar] [CrossRef]
- Kosonen, R.; Ahola, M.; Villberg, K.; Takki, T. Perceived IEQ Conditions: Why the Actual Percentage of Dissatisfied Persons is Higher than Standards Indicate? In Sick Building Syndrome; Springer: Berlin/Heidelberg, Germany, 2011; pp. 75–88. [Google Scholar] [CrossRef]
- Wagner, A.; Gossauer, E.; Moosmann, C.; Gropp, T.; Leonhart, R. Thermal comfort and workplace occupant satisfaction-Results of field studies in German low energy office buildings. Energy Build. 2007, 39, 758–769. [Google Scholar] [CrossRef]
- Abbaszadeh, S.; Zagreus, L.; Lehrer, D.; Huizenga, C. Occupant satisfaction with indoor environmental quality in green buildings. In Proceedings of the Healthy Buildings, Lisboa, Portugal, 4–8 June 2006. [Google Scholar]
- Kołakowska, A.; Szwoch, W.; Szwoch, M.; Kołakowska, A.; Szwoch, W.; Szwoch, M. A Review of Emotion Recognition Methods Based on Data Acquired via Smartphone Sensors. Sensors 2020, 20, 6367. [Google Scholar] [CrossRef]
- Santamaria, J.; Chiappa, K.H. The EEG of drowsiness in normal adults. J. Clin. Neurophysiol. 1987, 4, 327–382. [Google Scholar] [CrossRef]
- Szwoch, M. Evaluation of affective intervention process in development of affect-aware educational video games. In Proceedings of the 2016 Federated Conference on Computer Science and Information Systems (FedCSIS), Gdansk, Poland, 11–14 September 2016; pp. 1675–1679. [Google Scholar]
- Szwoch, M.; Szwoch, W. Using Different Information Channels for Affect-Aware Video Games—A Case Study. In Image Processing and Communications Challenges 10; Springer: Cham, Switzerland, 2019. [Google Scholar] [CrossRef]
- Landowska, A.; Szwoch, M.; Szwoch, W. Methodology of Affective Intervention Design for Intelligent Systems. Interact. Comput. 2016, 28, 737–759. [Google Scholar] [CrossRef]
- Kołakowska, A.; Landowska, A.; Szwoch, M.; Szwoch, W.; Wróbel, M.R. Emotion recognition and its application in software engineering. In Proceedings of the 2013 6th International Conference on Human System Interactions (HSI), Sopot, Poland, 6–8 June 2013. [Google Scholar] [CrossRef]
- Kołakowska, A. Towards detecting programmers’ stress on the basis of keystroke dynamics. In Proceedings of the 2016 Federated Conference on Computer Science and Information Systems (FedCSIS), Gdansk, Poland, 11–14 September 2016; pp. 1621–1626. [Google Scholar]
- Choi, J.-H. Advancements in Thermal Comfort Modeling Using Modern Sensing and Computational Technologies. In Research Methods in Building Science and Technology; Springer: Cham, Switzerland, 2021. [Google Scholar] [CrossRef]
- Ding, D.; Cooper, R.A.; Pasquina, P.F.; Fici-Pasquina, L. Sensor technology for smart homes. Maturitas 2011, 69, 131–136. [Google Scholar] [CrossRef]
- Kim, J.H.; Jo, B.W.; Jo, J.H.; Kim, D.K.; Kim, J.H.; Jo, B.W.; Jo, J.H.; Kim, D.K. Development of an IoT-Based Construction Worker Physiological Data Monitoring Platform at High Temperatures. Sensors 2020, 20, 5682. [Google Scholar] [CrossRef] [PubMed]
- Singh, A.P.; Luhach, A.K.; Gao, X.-Z.; Kumar, S.; Roy, D.S. Evolution of wireless sensor network design from technology centric to user centric: An architectural perspective. Int. J. Distrib. Sens. Netw. 2020, 16, 1550147720949138. [Google Scholar] [CrossRef]
- Rawi, M.I.M.; Al-Anbuky, A. Passive House sensor networks: Human centric thermal comfort concept. In Proceedings of the 2009 International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), Melbourne, Australia, 7–10 December 2009. [Google Scholar] [CrossRef]
- Choi, J.-H.; Yeom, D. Study of data-driven thermal sensation prediction model as a function of local body skin temperatures in a built environment. Build. Environ. 2017, 121, 130–147. [Google Scholar] [CrossRef]
- Choi, J.-H.; Loftness, V. Investigation of human body skin temperatures as a bio-signal to indicate overall thermal sensations. Build. Environ. 2012, 58, 258–269. [Google Scholar] [CrossRef]
- Choi, J.H. CoBi: Bio-Sensing Building Mechanical System Controls for Sustainably Enhancing Individual Thermal Comfort; Carnegie Mellon University: Pittsburgh, PA, USA, 2010. [Google Scholar]
- Haverinen-Shaughnessy, U.; Shaughnessy, R.J.; Cole, E.C.; Toyinbo, O.; Moschandreas, D.J. An assessment of indoor environmental quality in schools and its association with health and performance. Build. Environ. 2015, 93, 35–40. [Google Scholar] [CrossRef]
- Lee, M.C.; Mui, K.W.; Wong, L.T.; Chan, W.Y.; Lee, E.W.M.; Cheung, C.T. Student learning performance and indoor environmental quality (IEQ) in air-conditioned university teaching rooms. Build. Environ. 2012, 49, 238–244. [Google Scholar] [CrossRef]
- Toyinbo, O.; Shaughnessy, R.; Turunen, M.; Putus, T.; Metsämuuronen, J.; Kurnitski, J.; Haverinen-Shaughnessy, U. Building characteristics, indoor environmental quality, and mathematics achievement in Finnish elementary schools. Build. Environ. 2016, 104, 114–121. [Google Scholar] [CrossRef]
- Frontczak, M.; Wargocki, P. Literature survey on how different factors influence human comfort in indoor environments. Build. Environ. 2011, 46, 922–937. [Google Scholar] [CrossRef]
- Ricciardi, P.; Buratti, C. Environmental quality of university classrooms: Subjective and objective evaluation of the thermal, acoustic, and lighting comfort conditions. Build. Environ. 2018, 127, 23–36. [Google Scholar] [CrossRef]
- Wu, H.; Sun, X.; Wu, Y. A new quantitative measure of occupants’ overall satisfaction for indoor physical environmental quality. Indoor Air 2021, 31, 1583–1600. [Google Scholar] [CrossRef]
- Smolders, K.C.H.J.; Kort, Y.A.W.d. Bright light and mental fatigue: Effects on alertness, vitality, performance and physiological arousal. J. Environ. Psychol. 2014, 39, 77–91. [Google Scholar] [CrossRef]
- Tonetti, L.; Fabbri, M.; Erbacci, A.; Filardi, M.; Martoni, M.; Natale, V. Effects of dawn simulation on attentional performance in adolescents. Eur. J. Appl. Physiol. 2015, 115, 579–587. [Google Scholar] [CrossRef]
- Phipps-Nelson, J.; Redman, J.R.; Dijk, D.-J.; Rajaratnam, S.M.W. Daytime Exposure to Bright Light, as Compared to Dim Light, Decreases Sleepiness and Improves Psychomotor Vigilance Performance. Sleep 2003, 26, 695–700. [Google Scholar] [CrossRef]
- Huiberts, L.M.; Smolders, K.C.H.J.; Kortc, Y.A.W.d. Shining light on memory: Effects of bright light on working memory performance. Behav. Brain Res. 2015, 294, 234–245. [Google Scholar] [CrossRef] [PubMed]
- Huiberts, L.M.; Smolders, K.C.H.J.; Kort, Y.A.W.d. Non-image forming effects of illuminance level: Exploring parallel effects on physiological arousal and task performance. Physiol. Behav. 2016, 164, 129–139. [Google Scholar] [CrossRef] [PubMed]
- Park, J.Y.; Min, B.-K.; Jung, Y.-C.; Pak, H.; Jeong, Y.-H.; Kim, E. Illumination influences working memory: An EEG study. Neuroscience 2013, 247, 386–394. [Google Scholar] [CrossRef] [PubMed]
- Vandewalle, G.; Gais, S.; Schabus, M.; Balteau, E.; Carrier, J.; Darsaud, A.; Sterpenich, V.; Albouy, G.; Dijk, D.J.; Maquet, P. Wavelength-Dependent Modulation of Brain Responses to a Working Memory Task by Daytime Light Exposure. Cereb. Cortex 2007, 17, 2788–2795. [Google Scholar] [CrossRef]
- Smolders, K.C.H.J.; Kort, Y.A.W.d. Investigating daytime effects of correlated colour temperature on experiences, performance, and arousal. J. Environ. Psychol. 2017, 50, 80–93. [Google Scholar] [CrossRef]
- Vandewalle, G.; Maquet, P.; Dijk, D.-J. Light as a modulator of cognitive brain function. Trends Cogn. Sci. 2009, 13, 429–438. [Google Scholar] [CrossRef]
- Li, Y.; Ru, T.; Chen, Q.; Qian, L.; Luo, X.; Zhou, G.; Li, Y.; Ru, T.; Chen, Q.; Qian, L.; et al. Effects of illuminance and correlated color temperature of indoor light on emotion perception. Sci. Rep. 2021, 11, 14351. [Google Scholar] [CrossRef]
- Deng, M.; Wang, X.; Menassa, C.C. Measurement and prediction of work engagement under different indoor lighting conditions using physiological sensing. Build. Environ. 2021, 203, 108098. [Google Scholar] [CrossRef]
- Vartanian, O.; Navarrete, G.; Palumbo, L.; Chatterjee, A. Individual differences in preference for architectural interiors. J. Environ. Psychol. 2021, 77, 101668. [Google Scholar] [CrossRef]
- Wang, Y.T.; Liang, C.; Huai, N.; Chen, J.; Zhang, C.J. A Survey of Personalized Interior Design. Comput. Graph. Forum 2023, 42, e14844. [Google Scholar] [CrossRef]
- Newsham, G.; Veitch, J.; GR Newsham, J.V. Lighting quality recommendations for VDT offices: A new method of derivation. Light. Res. Technol. 2001, 33, 97–113. [Google Scholar] [CrossRef]
- Noy, P.; Liu, K.; Clements-Croome, D.; Qiao, B. Design issues in personalizing intelligent buildings. In Proceedings of the 2nd IET International Conference on Intelligent Environments-IE 06, Athens, Greece, 5–6 July 2006. [Google Scholar] [CrossRef]
- Huang, Y.-C.; Huang, S.C.-C. A Personalized Smart Living Room. In Distributed, Ambient, and Pervasive Interactions; Springer: Cham, Switzerland, 2014. [Google Scholar] [CrossRef]
- Baird, G.; Lechat, S. Users’ Perceptions of Personal Control of Environmental Conditions in Sustainable Buildings. Archit. Sci. Rev. 2009, 52, 108–116. [Google Scholar] [CrossRef]
- Aramburu, F. Environmental Awareness: An Improvement Strategy in the Education of Architects. In Health and Well-Being Considerations in the Design of Indoor Environments; IGI Global: Hershey, PA, USA, 2021. [Google Scholar] [CrossRef]
- Ilvitskaya, S.V.; Lobkov, V.A.; Lobkova, T.V.; Ilvitskaya, S.V.; Lobkov, V.A.; Lobkova, T.V. The natural aspect in the visual comfort of the architectural space of an individual house. IOP Conf. Ser. Mater. Sci. Eng. 2020, 962, 032085. [Google Scholar] [CrossRef]
- Barbosa, J.A.; Araújo, C.; Mateus, R.; Bragança, L. Smart interior design of buildings and its relationship to land use. Archit. Eng. Des. Manag. 2016, 12, 97–106. [Google Scholar] [CrossRef][Green Version]
- López-Chao, V.; Lorenzo, A.A.; Saorín, J.L.; Torre-Cantero, J.D.L.; Melián-Díaz, D.; López-Chao, V.; Amado Lorenzo, A.; Saorín, J.L.; De La Torre-Cantero, J.; Melián-Díaz, D. Classroom Indoor Environment Assessment through Architectural Analysis for the Design of Efficient Schools. Sustainability 2020, 12, 2020. [Google Scholar] [CrossRef]
- Rodionovskaja, I.S.; Dorozhkina, E.A.; Rodionovskaja, I.S.; Dorozhkina, E.A. Arkology Approach to Building Multi-Story “Green” Buildings Suburbanities Environment. IOP Conf. Ser. Mater. Sci. Eng. 2018, 463, 042006. [Google Scholar] [CrossRef]
- Lai, J.H.K.; Yik, F.W.H. Perception of importance and performance of the indoor environmental quality of high-rise residential buildings. Build. Environ. 2009, 44, 352–360. [Google Scholar] [CrossRef]
- Kaneko, K.; Kishita, Y.; Umeda, Y. In Pursuit of Personalization Design. Procedia CIRP 2017, 61, 93–97. [Google Scholar] [CrossRef]
- Turpeinen, M.; Saari, T. System architecture for psychological customization of communication technology. In Proceedings of the 37th Annual Hawaii International Conference on System Sciences, Big Island, Hawaii, 5–8 January 2004. [Google Scholar] [CrossRef]
- Economidou, E.; Itzlinger, A.; Frauenberger, C. Lived experience in human-building interaction (HBI): An initial framework. Front. Comput. Sci. 2024, 5, 1233904. [Google Scholar] [CrossRef]
- Hamdani, R.; Chihi, I. Adaptive human-computer interaction for industry 5.0: A novel concept, with comprehensive review and empirical validation. Comput. Ind. 2025, 168, 104268. [Google Scholar] [CrossRef]
- Lin, Y.C.; Chung, W.-Y.; Chien, C.-Y.; Su, C.-H.; Kuo, P.-C. Shaping the Future of Architectural Design Tools Through the HCI Paradigm and Collective Human-Machine Intelligence. In Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, 26 April–1 May 2025; pp. 1–8. [Google Scholar]
- Bos, D.O. EEG-Based Emotion Recognition: The Influence of Visual and Auditory Stimuli. In Capita Selecta Report, MSc Course; University of Twente: Enschede, The Netherlands, 2006. [Google Scholar]
- Li, M.; Chai, Q.; Kaixiang, T.; Wahab, A.; Abut, H. EEG Emotion Recognition System. In In-Vehicle Corpus and Signal Processing for Driver Behavior; Springer: Greer, SC, USA, 2009. [Google Scholar] [CrossRef]
- Lin, Y.-P.; Wang, C.-H.; Wu, T.-L.; Jeng, S.-K.; Chen, J.-H. EEG-based emotion recognition in music listening: A comparison of schemes for multiclass support vector machine. In Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, Taiwan, 19–24 April 2009. [Google Scholar] [CrossRef]
- Murugappan, M.; Rizon, M.; Nagarajan, R.; Yaacob, S.; Zunaidi, I.; Hazry, D. Lifting scheme for human emotion recognition using EEG. In Proceedings of the 2008 International Symposium on Information Technology, Washington, DC, USA, 21–22 December 2008. [Google Scholar] [CrossRef]
- Liu, Y.; Sourina, O.; Nguyen, M.K. Real-Time EEG-Based Human Emotion Recognition and Visualization. In Proceedings of the 2010 International Conference on Cyberworlds, Singapore, 20–22 October 2010. [Google Scholar] [CrossRef]
- Mauss, I.B.; Robinson, M.D. Measures of emotion: A review. Cogn. Emot. 2009, 23, 209–237. [Google Scholar] [CrossRef]
- Calvo, R.A.; D’Mello, S. Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications. IEEE Trans. Affect. Comput. 2010, 1, 18–37. [Google Scholar] [CrossRef]
- Shashidhar, R.; Hariprasad, S.; Shruthi, B.; Kavita, R.S. Real-Time Fatigue Detection using a Low Cost Wireless EEG Device. i-Manag. J. Embed. Syst. 2020, 8, 8–13. [Google Scholar] [CrossRef]
- Chai, R.; Naik, G.R.; Nguyen, T.N.; Ling, S.H.; Tran, Y.; Craig, A.; Nguyen, H.T. Driver Fatigue Classification With Independent Component by Entropy Rate Bound Minimization Analysis in an EEG-Based System. IEEE J. Biomed. Health Inform. 2017, 21, 715–724. [Google Scholar] [CrossRef]
- Liu, Y.; Sourina, O.; Nguyen, M.K. Real-Time EEG-Based Emotion Recognition and Its Applications. In Transactions on Computational Science XII; Springer: Berlin/Heidelberg, Germany, 2011. [Google Scholar] [CrossRef]
- Nie, D.; Wang, X.-W.; Shi, L.-C.; Lu, B.-L. EEG-based emotion recognition during watching movies. In Proceedings of the International IEEE/EMBS Conference on Neural Engineering, CNE, Cancun, Mexico, 27 April–1 May 2011. [Google Scholar] [CrossRef]
- Liu, Y.-J.; Yu, M.; Zhao, G.; Song, J.; Ge, Y.; Shi, Y. Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals. IEEE Trans. Affect. Comput. 2018, 9, 550–562. [Google Scholar] [CrossRef]
- Gurbuz, S.Z.; Amin, M.G. Radar-Based Human-Motion Recognition with Deep Learning: Promising Applications for Indoor Monitoring. IEEE Signal Process. Mag. 2019, 36, 16–28. [Google Scholar] [CrossRef]
- Park, Y.; Han, S.-H.; Byun, W.; Kim, J.-H.; Lee, H.-C.; Kim, S.-J. A Real-Time Depth of Anesthesia Monitoring System Based on Deep Neural Network With Large EDO Tolerant EEG Analog Front-End. IEEE Trans. Biomed. Circuits Syst. 2020, 14, 825–837. [Google Scholar] [CrossRef] [PubMed]
- Sarkar, S.; Reddy, K.; Dorgan, A.; Fidopiastis, C.; Giering, M. Wearable EEG-based Activity Recognition in PHM-related Service Environment via Deep Learning. Int. J. Progn. Health Manag. 2016, 7, 1–10. [Google Scholar] [CrossRef]
- Chen, Z.; AlHajri, M.I.; Wu, M.; Ali, N.T.; Shubair, R.M. A Novel Real-Time Deep Learning Approach for Indoor Localization Based on RF Environment Identification. IEEE Sens. Lett. 2020, 4, 7002504. [Google Scholar] [CrossRef]
- Reddy, T.K.; Behera, L. Online Eye state recognition from EEG data using Deep architectures. In Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary, 9–12 October 2016. [Google Scholar] [CrossRef]
- Golmohammadi, M.; Harati Nejad Torbati, A.H.; Lopez de Diego, S.; Obeid, I.; Picone, J. Frontiers | Automatic Analysis of EEGs Using Big Data and Hybrid Deep Learning Architectures. Front. Hum. Neurosci. 2019, 13, 76. [Google Scholar] [CrossRef] [PubMed]
- Craik, A.; He, Y.; Contreras-Vidal, J.L.; Craik, A.; He, Y.; Contreras-Vidal, J.L. Deep learning for electroencephalogram (EEG) classification tasks: A review. J. Neural Eng. 2019, 16, 031001. [Google Scholar] [CrossRef]
- Bahador, N.; Erikson, K.; Laurila, J.; Koskenkari, J.; Ala-Kokko, T.; Kortelainen, J.; Bahador, N.; Erikson, K.; Laurila, J.; Koskenkari, J.; et al. A Correlation-Driven Mapping For Deep Learning application in detecting artifacts within the EEG. J. Neural Eng. 2020, 17, 056018. [Google Scholar] [CrossRef]
- Mao, Z.; Yao, W.X.; Huang, Y. EEG-based biometric identification with deep learning. In Proceedings of the 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER), Shanghai, China, 25–28 May 2017. [Google Scholar] [CrossRef]
- Tayeb, Z.; Fedjaev, J.; Ghaboosi, N.; Richter, C.; Everding, L.; Qu, X.; Wu, Y.; Cheng, G.; Conradt, J.; Tayeb, Z.; et al. Validating Deep Neural Networks for Online Decoding of Motor Imagery Movements from EEG Signals. Sensors 2019, 19, 210. [Google Scholar] [CrossRef]
- Luo, T.-j.; Fan, Y.-c.; Lv, J.-t.; Zhou, C.-l. Deep reinforcement learning from error-related potentials via an EEG-based brain-computer interface. In Proceedings of the 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Madrid, Spain, 3–6 December 2018. [Google Scholar] [CrossRef]
- Xu, G.; Guo, W.; Wang, Y. Subject-independent EEG emotion recognition with hybrid spatio-temporal GRU-Conv architecture. Med. Biol. Eng. Comput. 2022, 61, 61–73. [Google Scholar] [CrossRef]
- Xing, X.; Li, Z.; Xu, T.; Shu, L.; Hu, B.; Xu, X. SAE+LSTM: A New Framework for Emotion Recognition from Multi-Channel EEG. Front. Neurorobotics 2019, 13, 37. [Google Scholar] [CrossRef]
- Chen, J.X.; Jiang, D.M.; Zhang, Y.N. A Hierarchical Bidirectional GRU Model with Attention for EEG-Based Emotion Classification. IEEE Access 2019, 7, 118530–118540. [Google Scholar] [CrossRef]
- Aggarwal, S.; Chugh, N.; Aggarwal, S.; Chugh, N. Review of Machine Learning Techniques for EEG Based Brain Computer Interface. Arch. Comput. Methods Eng. 2022, 29, 3001–3020. [Google Scholar] [CrossRef]
- Zheng, W.-L.; Lu, B.-L. Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks. IEEE Trans. Auton. Ment. Dev. 2015, 7, 162–175. [Google Scholar] [CrossRef]
- Almusaed, A.; Yitmen, I.; Almssad, A.; Myhren, J.A. Construction 5.0 and sustainable neuro-responsive habitats: Integrating the brain–computer interface and building information modeling in smart residential spaces. Sustainability 2024, 16, 9393. [Google Scholar] [CrossRef]
- He, X.; Wu, M.; Li, H.; Liu, S.; Liu, B.; Qi, H. Real-time regulation of room temperature based on individual thermal sensation using an online brain–computer interface. Indoor Air 2022, 32, e13106. [Google Scholar] [CrossRef] [PubMed]
- Cho, J.E.; Kang, S.Y.; Hong, Y.Y.; Jun, H.J. Predicting Architectural Space Preferences Using EEG-Based Emotion Analysis: A CNN-LSTM Approach. Appl. Sci. 2025, 15, 4217. [Google Scholar] [CrossRef]
- Hermann, E. Memory: A Contribution to Experimental Psychology. Ann. Neurosci. 2013, 20, 155. [Google Scholar] [CrossRef]
- Nickels, L.; Howard, D.; Best, W. On the use of different methodologies in cognitive neuropsychology: Drink deep and from several sources. Cogn. Neuropsychol. 2011, 28, 475–485. [Google Scholar] [CrossRef]
- Allport, G.W. Pattern and Growth in Personality; Holt, Rinehart and Winston: New York, NY, USA, 1961. [Google Scholar]
- Kazdin, A.E. Single-case experimental designs: Characteristics, changes, and challenges. J. Exp. Anal. Behav. 2021, 115, 56–85. [Google Scholar] [CrossRef]
- Emotiv. EPOC X - 14 Channel Wireless EEG Headset. Available online: https://www.emotiv.com/products/epoc-x (accessed on 28 July 2025).
- Emotiv. Does EmotivPRO Automatically Remove Artifacts from the EEG Data Collected? Available online: https://www.emotiv.com/tools/knowledge-base/emotivpro/does-emotivpro-automatically-remove-artifacts-from-the-eeg-data-collected (accessed on 28 July 2025).
- Hertzog, M.A. Considerations in determining sample size for pilot studies. Res. Nurs. Health 2008, 31, 180–191. [Google Scholar] [CrossRef]
- Joyce, D.S.; Feigl, B.; Zele, A.J. The effects of short-term light adaptation on the human post-illumination pupil response. Investig. Ophthalmol. Vis. Sci. 2016, 57, 5672–5680. [Google Scholar] [CrossRef]
- Mostafavi, A.; Xu, T.B.; Kalantari, S. Effects of illuminance and correlated color temperature on emotional responses and lighting adjustment behaviors. J. Build. Eng. 2024, 86, 108833. [Google Scholar] [CrossRef]
- KS C 7612:1987; Method of Measurement for Illuminance of Lighting Installations. Korean Standards Association: Seoul, Republic of Korea, 1987. Available online: https://www.standard.go.kr/streamdocs/view/sd;streamdocsId=72622301858700771 (accessed on 28 July 2025).
- KS A 3011:1998; Recommended Levels of Illumination. Korean Standards Association: Seoul, Republic of Korea, 1998. Available online: https://www.standard.go.kr/streamdocs/view/sd;streamdocsId=72059351841844752 (accessed on 28 July 2025).
- Lang, X.; Wargocki, P.; Liu, W. Investigating the relation between electroencephalogram, thermal comfort, and cognitive performance in neutral to hot indoor environment. Indoor Air 2022, 32, e12941. [Google Scholar] [CrossRef] [PubMed]
- Pino, O.; Romano, G. Engagement and arousal effects in predicting the increase of cognitive functioning following a neuromodulation program. Acta Bio Medica Atenei Parm. 2022, 93, e2022248. [Google Scholar]
- Veranic, K.; Ewing, L.; Sambrook, T.; Watson, E.A.G.; Zhao, M.; Bayliss, A.P. Changes in interpersonal distance modulate social attention engagement: Evidence from EEG alpha band suppression. Soc. Cogn. Affect. Neurosci. 2025, 20, nsaf008. [Google Scholar] [CrossRef] [PubMed]
- Shashidhar, R.; Tippannavar, S.S.; Bhat, K.B.; Sharma, N.; Rashid, M.; Rana, A. EEG-based Brain Wave Recognition using GRU and LSTM. In Proceedings of the 2022 5th International Conference on Contemporary Computing and Informatics (IC3I), Greater Noida, India, 14–16 December 2022. [Google Scholar] [CrossRef]
- Cho, K.; Van Merriënboer, B.; Gulcehre, C.; Bahdanau, D.; Bougares, F.; Schwenk, H.; Bengio, Y. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv 2014, arXiv:1406.1078. [Google Scholar] [CrossRef]
- Che, Z.; Purushotham, S.; Cho, K.; Sontag, D.; Liu, Y.; Che, Z.; Purushotham, S.; Cho, K.; Sontag, D.; Liu, Y. Recurrent Neural Networks for Multivariate Time Series with Missing Values. Sci. Rep. 2018, 8, 6085. [Google Scholar] [CrossRef]
- Chowdary, M.K.; Anitha, J.; Hemanth, D.J.; Chowdary, M.K.; Anitha, J.; Hemanth, D.J. Emotion Recognition from EEG Signals Using Recurrent Neural Networks. Electronics 2022, 11, 2387. [Google Scholar] [CrossRef]
- Walther, D.; Viehweg, J.; Haueisen, J.; Mäder, P. A systematic comparison of deep learning methods for EEG time series analysis. Front. Neuroinform. 2023, 17, 1067095. [Google Scholar] [CrossRef]
- Srivastava, N.; Hinton, G.; Krizhevsky, A.; Sutskever, I.; Salakhutdinov, R. Dropout: A simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 2014, 15, 1929–1958. [Google Scholar]
- LeCun, Y.; Bengio, Y.; Hinton, G. Deep learning. Nature 2015, 521, 436–444. [Google Scholar] [CrossRef]
- Glorot, X.; Bordes, A.; Bengio, Y. Deep sparse rectifier neural networks. In Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA, 11–13 April 2011; pp. 315–323. [Google Scholar]
- Mohsen, S. Recognition of human activity using GRU deep learning algorithm. Multimed. Tools Appl. 2023, 82, 47733–47749. [Google Scholar] [CrossRef]
- Kingma, D.P.; Ba, J. Adam: A method for stochastic optimization. arXiv 2014, arXiv:1412.6980. [Google Scholar]
- Ruder, S. An overview of gradient descent optimization algorithms. arXiv 2016, arXiv:1609.04747. [Google Scholar]
- Hanifi, S.; Cammarono, A.; Zare-Behtash, H. Advanced hyperparameter optimization of deep learning models for wind power prediction. Renew. Energy 2024, 221, 119700. [Google Scholar] [CrossRef]
- Akiba, T.; Sano, S.; Yanase, T.; Ohta, T.; Koyama, M. Optuna: A next-generation hyperparameter optimization framework. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA, 4–8 August 2019; pp. 2623–2631. [Google Scholar]
- Abumohsen, M.; Owda, A.Y.; Owda, M. Electrical load forecasting using LSTM, GRU, and RNN algorithms. Energies 2023, 16, 2283. [Google Scholar] [CrossRef]
- Plevris, V.; Solorzano, G.; Bakas, N.P.; Ben Seghier, M.E.A. Investigation of performance metrics in regression analysis and machine learning-based prediction models. In Proceedings of the 8th European Congress on Computational Methods in Applied Sciences and Engineering (ECCOMAS Congress 2022), Oslo, Norway, 5–9 June 2022. [Google Scholar]
- Cossu, A.; Carta, A.; Lomonaco, V.; Bacciu, D. Continual learning for recurrent neural networks: An empirical evaluation. Neural Netw. 2021, 143, 607–627. [Google Scholar] [CrossRef]
- Ehret, B.; Henning, C.; Cervera, M.R.; Meulemans, A.; Von Oswald, J.; Grewe, B.F. Continual learning in recurrent neural networks. arXiv 2020, arXiv:2006.12109. [Google Scholar]
- Parisi, G.I.; Kemker, R.; Part, J.L.; Kanan, C.; Wermter, S. Continual lifelong learning with neural networks: A review. Neural Netw. 2019, 113, 54–71. [Google Scholar] [CrossRef]
| Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).