Model-Based Monitoring of Occupant’s Thermal State for Adaptive HVAC Predictive Controlling

Conventional indoor climate design and control approaches are based on static thermal comfort/sensation models that view the building occupants as passive recipients of their thermal environment. Recent advances in wearable sensing technologies and their generated streaming data are providing a unique opportunity to understand the user’s behaviour and to predict future needs. Estimation of thermal comfort is a challenging task given the subjectivity of human perception; this subjectivity is reflected in the statistical nature of comfort models, as well as the plethora of comfort models available. Additionally, such models are using not-easily or invasively measured variables (e.g., core temperatures and metabolic rate), which are often not practical and undesirable measurements. The main goal of this paper was to develop dynamic model-based monitoring system of the occupant’s thermal state and their thermoregulation responses under two different activity levels. In total, 25 participants were subjected to three different environmental temperatures at two different activity levels. The results have shown that a reduced-ordered (second-order) multi-inputs-single-output discrete-time transfer function (MISO-DTF), including three input variables (wearables), namely, aural temperature, heart rate, and average skin heat-flux, is best to estimate the individual’s metabolic rate (non-wearable) with a mean absolute percentage error of 8.7%. A general classification model based on a least squares support vector machine (LS-SVM) technique is developed to predict the individual’s thermal sensation. For a seven-class classification problem, the results have shown that the overall model accuracy of the developed classifier is 76% with an F1-score value of 84%. The developed LS-SVM classification model for prediction of occupant’s thermal sensation can be integrated in the heating, ventilation and air conditioning (HVAC) system to provide an occupant thermal state-based climate controller. In this paper, we introduced an adaptive occupant-based HVAC predictive controller using the developed LS-SVM predictive classification model.


Introduction
Thermal comfort (TC) is an ergonomic aspect determining the satisfaction about the surrounding environment and is defined as "that condition of mind which expresses satisfaction with the thermal environment and is assessed by subjective evaluation" [1]. The effect of thermal environments on occupants might also be assessed in terms of thermal sensation (T S ), which can be defined as "a conscious feeling commonly graded into the categories cold, cool, slightly cool, neutral, slightly warm, warm, and hot" [1]. Thermal sensation and thermal comfort are both subjective judgments, however, thermal sensation is related to the perception of one's thermal state, and thermal comfort to the evaluation of this perception [2]. The assessment of thermal sensation has been regarded as more reliable and. as such. is often used to estimate thermal comfort [3]. Table 1. The different temperature and relative humidity ranges that can be provided by the different Body and Mind rooms (A, B and C).

Experimental Protocol
The experimental protocol used in the present study is designed in such way to investigate the subjects' thermal and physiological responses to predefined three different temperature (low, normal and high) that under two levels of physical activities (seated = low and cycling = high). The three predefined temperatures (low = 5 • C, normal = 24 • C and high = 37 • C) are chosen based on the thermal comfort chart from [15] and the effects on health according to the Wind Chill Chart for cold exposure (National Weather Service of the US) and for hot temperatures exposure according to [16]. The conducted experiments consist of two phases (Figure 1, upper graph), namely, low activity and high activity phases. During the first experimental phase, low activity phase, the test subjects (while being seated = low activity) are exposed, for 55 min, to three levels of temperatures in the following order: normal, low, high and normal again (Figure 1). During the high activity phase, the test subjects is exposed to a 15 min of light physical stress (80 W of cycling on a fastened racing bicycle). During the course (75 min) of the active phase, each test subject is exposed to the predefined three temperature levels ( Figure 1, lower graph). During each temperature level, starting from the normal level (24 • C), the test subjects are performed 15 min of cycling (with 80 W power) and followed 4 min of resting (seated). During the course of conducted experiments, the clothing insulation factor (Col) is kept constant at Col = 0.34, which accounts for a cotton short and t-shirt as standard clothing for all test subjects. The experimental protocol is approved by the SMEC (Sociaal-Maatschappelijke Ethische Comissie) on 16 January 2019 with number G-2018-12-1464.

Test Subjects
In total, 25 healthy participants (six females and 19 males were asked before the experiments if they had been diagnosed with any cardiac problems, diabetic or any other health problems), between the age of 25 and 35 (average age 26 ± 4.2) years, with average weight and height of 70.90 (±12.70) kg and 1.74 (±0.10) m, respectively, volunteered to perform the aforementioned experimental protocol.

Measurements and Gold Standards
During the course of the experiments, participants' heart rate, metabolic rate, average skin temperature, heat flux between the skin and the ambient air and core body temperature represented by the aural temperature are measured continuously. Heart rate monitoring is performed using a Polar H7 ECG (Polar, Kempele, Finland) strap that is placed under the chest, with a sampling frequency of 128 Hz. The metabolic rate, as metabolic equivalent tasks (METs) of each test subject, is calculated based on indirect calorimetry using a MetaMAX 3B (CORTEX-Medical, Leipzig, Germany) spiroergometer sensor. The average skin temperature is calculated based on measurements from three body-placed sensors, namely, scapula, chest and arm ( Figure 2). The skin temperature measurements are performed using one Shimmer (Shimmer-Sensing, Dublin, Ireland) temperature sensor and two gSKIN ® bodyTEMP patches (greenTEG, Zurich, Switzerland). Two heat flux gSKIN ® patches are placed on both the chest and the left arm ( Figure 2). The skin temperatures and heat flux measurements are acquired at a sampling frequency of 1 Hz. All the measured from the wearable sensors were received and saved on a smart phone. Core body temperature is estimated based on aural temperature measure measurements, which is performed using in-ear wireless (Bluetooth) temperature sensor (Cosinuss One, Düsseldorf, Germany) with a sampling rate if 1 Hz. At the end of each applied temperature level during the course of both experimental phases, a thermal sensation questionnaire, based on ASHRAE seven-point thermal scale, is performed for each test subject. comfort chart from [15] and the effects on health according to the Wind Chill Chart for cold exposure (National Weather Service of the US) and for hot temperatures exposure according to [16]. The conducted experiments consist of two phases (Figure 1., upper graph), namely, low activity and high activity phases. During the first experimental phase, low activity phase, the test subjects (while being seated = low activity) are exposed, for 55 min, to three levels of temperatures in the following order: normal, low, high and normal again (Figure 1.). During the high activity phase, the test subjects is exposed to a 15 min of light physical stress (80 W of cycling on a fastened racing bicycle). During the course (75 min) of the active phase, each test subject is exposed to the predefined three temperature levels (Figure 1., lower graph). During each temperature level, starting from the normal level (24 °C), the test subjects are performed 15 min of cycling (with 80 W power) and followed 4 min of resting (seated). During the course of conducted experiments, the clothing insulation factor ( ) is kept constant at = 0.34, which accounts for a cotton short and t-shirt as standard clothing for all test subjects. The experimental protocol is approved by the SMEC (Sociaal-Maatschappelijke Ethische Comissie) on 16 January 2019 with number G-2018-12-1464.

Test subjects
In total, 25 healthy participants (six females and 19 males were asked before the experiments if they had been diagnosed with any cardiac problems, diabetic or any other health problems), between the age of 25 and 35 (average age 26 ± 4.2) years, with average weight and height of 70.90 (±12.70) kg and 1.74 (±0.10) m, respectively, volunteered to perform the aforementioned experimental protocol.

Measurements and gold standards
During the course of the experiments, participants' heart rate, metabolic rate, average skin temperature, heat flux between the skin and the ambient air and core body temperature represented by the aural temperature are measured continuously. Heart rate monitoring is performed using a Polar H7 ECG (Polar, Kempele, Finland) strap that is placed under the chest, with a sampling frequency of 128 Hz. The metabolic rate, as metabolic equivalent tasks (METs) of each test subject, is calculated based on indirect calorimetry using a MetaMAX 3B (CORTEX-Medical, Leipzig, Germany) spiroergometer sensor. The average skin temperature is calculated based on measurements from three body-placed sensors, namely, scapula, chest and arm (Figure 2.). The skin temperature measurements are performed using one Shimmer (Shimmer-Sensing, Dublin, Ireland) temperature sensor and two gSKIN  bodyTEMP patches (greenTEG, Zurich, Switzerland). Two heat flux gSKIN  patches are placed on both the chest and the left arm (Figure 2.). The skin temperatures and heat flux measurements are acquired at a sampling frequency of 1 Hz. All the measured from the wearable sensors were received and saved on a smart phone. Core body temperature is estimated based on aural temperature measure measurements, which is performed using in-ear wireless (Bluetooth) temperature sensor (Cosinuss One, Düsseldorf, Germany) with a sampling rate if 1 Hz. At the end of each applied temperature level during the course of both experimental phases, a thermal sensation questionnaire, based on ASHRAE seven-point thermal scale, is performed for each test subject.

Modelling and Classification
For the sake of present study, the measured variables are divided into wearables, which are easily measured variables using wearable sensors and gold standards (reference) variables, which are not suitable for wearable technologies. The wearables include heart rate , aural temperature , average skin temperature , skin heat flux and ambient air temperature . On the other

Modelling and Classification
For the sake of present study, the measured variables are divided into wearables, which are easily measured variables using wearable sensors and gold standards (reference) variables, which are not suitable for wearable technologies. The wearables include heart rate H R , aural temperature T er , average skin temperature T sk , skin heat flux q sk and ambient air temperature T ∞ . On the other hand, the gold standards consist of the core temperature T c , which is driven from the aural temperature [T c = f (T er )], metabolic rate M r and personal thermal sensation votes TS. The ultimate goal of this work is to develop an adaptive classification model to predict the individual thermal sensation depending, solely, on the wearables or estimated variables. Hence, both of the metabolic rate and core body temperature are estimated using an online dynamic modelling approach (Figure 3). Then, the individual thermal sensation is predicted using a classification model (classifier) whose inputs are the wearables and estimated the metabolic rate and core body temperature ( Figure 3).
where denotes the value of the associated variable at the th sampling instant; ( ) is the output variable; ( ) , = 1,2, … , are input variables, while ( ) and ( ) are appropriately defined polynomials in the backshift operator , i.e., ( ) = ( − ) and ( ) is additive noise, a serially uncorrelated sequence of random variables with variance that accounts for measurement noise. The simplified refined instrumental variable (SRIV) algorithm was utilised in the identification and estimation of the models (model parameters and model structure) [20]. Two main statistical measures were employed to determine the most appropriate model structure. Namely, the coefficient of determination , based on the response error; and (Young's information criterion), which provides a combined measure of model fit and parametric efficiency, with large negative values indicating a model which explains the output data well and yet avoids over-parameterisation [21]. Additionally, the estimation performance of the selected models is evaluated used the mean absolute error (MAE) value.

Classification model
To predict the individual thermal sensation, a classification model (classifier) is developed and trained based on the wearables and estimated variables (metabolic rate and core body temperature), together with the thermal sensation votes (gold standard). A modified support vector machine (SVM) technique, namely, the least squares support vector machine (LS-SVM), is used to develop and train the thermal sensation classifier [22,23]. SVMs are originally presented as binary classifiers [22] that assign each data instance ∈ ℝ to one of two classes described by a class label ∈ −1,1 based on the decision boundary that maximises the margin 2/‖ ‖ between the two classes. Generally, a feature map : ℝ ⇒ ℝ is used to transform the geometric boundary between the two classes to a

Dynamic Modelling
Although the system under study (occupant's thermoregulation) is inherently a non-linear system, the essential perturbation behaviour can often be approximated well by simple linearized transfer function (TF) models [17][18][19]. For the purposes of the present paper, therefore, the following linear, multi-input, single-output (MISO) discrete time systems are considered to estimate metabolic rate and core body temperature [18]: where k denotes the value of the associated variable at the kth sampling instant; y(k) is the output variable; u r (k), r = 1, 2, . . . , R are input variables, while A z −1 and B z −1 are appropriately defined polynomials in the backshift operator z −1 , i.e., z −i y(k) = y(k − i) and ξ(k) is additive noise, a serially uncorrelated sequence of random variables with variance σ 2 that accounts for measurement noise. The simplified refined instrumental variable (SRIV) algorithm was utilised in the identification and estimation of the models (model parameters and model structure) [20]. Two main statistical measures were employed to determine the most appropriate model structure. Namely, the coefficient of determination R T 2 , based on the response error; and YIC (Young's information criterion), which provides a combined measure of model fit and parametric efficiency, with large negative values indicating a model which explains the output data well and yet avoids over-parameterisation [21]. Additionally, the estimation performance of the selected models is evaluated used the mean absolute error (MAE) value.

Classification Model
To predict the individual thermal sensation, a classification model (classifier) is developed and trained based on the wearables and estimated variables (metabolic rate and core body temperature), together with the thermal sensation votes (gold standard). A modified support vector machine (SVM) technique, namely, the least squares support vector machine (LS-SVM), is used to develop and train the thermal sensation classifier [22,23]. SVMs are originally presented as binary classifiers [22] that assign each data instance X ∈ R d to one of two classes described by a class label y ∈ {−1, 1} based on Processes 2019, 7, 720 6 of 15 the decision boundary that maximises the margin 2/ w 2 between the two classes. Generally, a feature map ϕ : R d ⇒ R p is used to transform the geometric boundary between the two classes to a linear boundary L : w T ϕ(x) + b = 0 in feature space, for some weight vector w ∈ R p×1 and b ∈ R. The class of each instance can then be found by y = sign w T ϕ(x) + b , where sign refers to the sign function. Due to some computational complexities of standard SVM because of the quadratic programming problem, the least squares support vector machine (LS-SVM) is presented to overcome such problem. LS-SVM, in contrast with standard SVM, relies on a least squares cost function as follows: such that where e i errors such that 1 − e i is proportional to the signed distance of x i from the decision boundary, and γ represents the regularisation constant. In LS-SVM, instead of solving the quadratic programming problem, a set of linear equations to be solved is sufficient to find the optimal solution of the classifier. The LS-SVMlab (Least Squares Support Vector Machine lab) Matlab-based toolbox is used to implement the LS-SVM classification algorithm [22]. The performance of the classification model is determined based on accuracy, sensitivity, precision and F1-score as follows: where TP, TN, FP and FN are the true positive, true negative, false positive and false negative, respectively.

Dynamic Modelling and Estimation of an Individual's Metabolic Rate
The average metabolic rate obtained from the 25 participants at the temperature levels (24, 5 and 37 • C) during low and high activity phases are presented in Table 2. Table 2. Average (±standard deviation) of the measured metabolic rate obtained from the 25 test subjects during low and high activity phases.

Temperature
Low Activity Phase High Activity Phase Different combinations of input variables (wearables) are tested for the best estimation of an individual's metabolic rate. The SRIV algorithm, combined with YIC and R T 2 selection criteria, suggested that a second-order MISO discrete-time TF with heart rate (H R ), average skin heat flux (q sk ) and aural temperature (T er ) as input variables is the best (with average R T 2 = 0.89 ± 0.04 and YIC = −13.62 ± 2.33) to describe and estimate the dynamic behaviour of the individual's metabolic rate. More specifically, the SRIV algorithm identified the following general MISO discrete-time TF model structure: whereM r (k) is the estimated metabolic rate and the numerator polynomials B 1 , B 2 and B 3 are of the following orders (number of zeros) 2, 3 and 2, respectively. The system delays δ 1 , δ 2 and δ 3 are varied from person to another (inter-personal) with average values of 1.4, 0.20 and 0.21 min, respectively (Table 3). A simulation example of the developed estimation model (Equation (3)) for one test subject during the low activity experimental phase at normal temperature (24 • C) is depicted in Figure 4.  (Table 3). A simulation example of the developed estimation model (Equation (3)) for one test subject during the low activity experimental phase at normal temperature (24 °C) is depicted in Figure 4.. The estimation performance of the selected general MISO-DTF (Equation (3)) is evaluated based on the mean absolute percentage error ( The results have shown that the developed general model (Table 3), for all test subjects, a higher average MAPE value (10 ± 2.2%) during the low activity phases than the average MAPE value (7.6 ± 2.6%) resulted during the high activity phases. The METs (metabolic equivalent tasks) are a measure which accounts for a normalized form of energy expenditure per kilogram of mass. There is a consensus that the measurement of the metabolic rate might vary among individuals (interpersonal) up to 75% [24], even within the same day from morning to afternoon for the same subject (intrapersonal) up to 6%, though measurements on different days might be comparable on fasted subjects [25]. Hence, a general estimation model of individual metabolic rate will not be efficient in this case. However, the general estimation performance of the suggested general MISO model can be enhanced by using the online adaptive form of the SRIV algorithm [26]. The online adaptive (closedloop) SRIV algorithm provides the possibility to personalise the developed general model by retuning the model parameters and model delays based on the streaming data acquired from the wearable sensors.
) value. The results have shown that the developed general model (Table 3), for all test subjects, a higher average MAPE value (10 ± 2.2%) during the low activity phases than the average MAPE value (7.6 ± 2.6%) resulted during the high activity phases. The METs (metabolic equivalent tasks) are a measure which accounts for a normalized form of energy expenditure per kilogram of mass. There is a consensus that the measurement of the metabolic rate might vary among individuals (interpersonal) up to 75% [24], even within the same day from morning to afternoon for the same subject (intrapersonal) up to 6%, though measurements on different days might be comparable on fasted subjects [25]. Hence, a general estimation model of individual metabolic rate will not be efficient in this case. However, the general estimation performance of the suggested general MISO model can be enhanced by using the online adaptive form of the SRIV algorithm [26]. The online adaptive (closed-loop) SRIV algorithm provides the possibility to personalise the developed general model by retuning the model parameters and model delays based on the streaming data acquired from the wearable sensors.

Classification Model and Prediction of Individual's Thermal Sensation
In order to give an idea about the interaction relationship between considered variables, the correlation between all measured variables are calculated and represented in a colour-map Pearson correlation coefficient (r) matrix, as shown in Figure 5. High positive or negative correlation coefficient values, such as that between heat flux and skin temperature, are reflected as a strong interaction between these variables, which can affect the feature selection of the classification model.
In order to give an idea about the interaction relationship between considered variables, the correlation between all measured variables are calculated and represented in a colour-map Pearson correlation coefficient ( ) matrix, as shown in Figure 5.. High positive or negative correlation coefficient values, such as that between heat flux and skin temperature, are reflected as a strong interaction between these variables, which can affect the feature selection of the classification model.
The classification model for predicting the individual's thermal sensation is developed, based on the LS-SVM approach, by training the classifier on 80% of the data points, while the rest of the data (20%) is used for testing. The model accuracy, sensitivity F1-score and overall confusion matrix are computed to evaluate the performance of the developed classifier. The feature space includes all the measured and estimated input variables, namely, , , , , ∆ = − and . Additionally, other features are extracted by computing the variance, min, max, root mean squares (RMS) and first derivative ( , where is the variable) of the aforementioned measured and estimated variables. The age and gender of the test subjects are also included in the feature spaces. Figure 5. Colour-map of the correlation matrix representing the correlation levels ( ∈ −1,1 ) between the mean values of all measured variables, namely, heart rate (HR), aural (core) temperature, arm temperature, chest temperature, scapula temperature, heat flux from the arm skin (Arm HF), heat flux from the chest skin (Chest HF) and metabolic rate (METs). Figure 6. is showing the distribution of the participants' thermal sensation votes at the three environment temperatures (24, 5 and 37 °C). The aforementioned figure shows the 'confusion space', or the area in which the reported thermal sensation votes at the three environmental temperatures are overlapping. Such observation shows that the thermal perception may overlap even with large differences in the surrounding environmental temperatures. Such a confusion space is a great challenge for any predictive model of thermal sensation, especially for static models such as PMV.
For the sake of the main objective of the present work, the computational cost of the developed algorithm should be low enough to be compatible with wearable technology and online modelling. Hence, a feature selection procedure is employed to obtain the most reduced-dimension model yet with the best error performance. Feature selection here is based on evaluating all possible feature combinations and selecting the combination with best error performance. The feature selection step results in a feature space including 25 features, as shown in Table 4.. Table 4. An overview of the selected feature space including the measured and estimated variables (six variables) and some operations on these variables (× = selected). The classification model for predicting the individual's thermal sensation is developed, based on the LS-SVM approach, by training the classifier on 80% of the data points, while the rest of the data (20%) is used for testing. The model accuracy, sensitivity F1-score and overall confusion matrix are computed to evaluate the performance of the developed classifier. The feature space includes all the measured and estimated input variables, namely, T er , H R , q sk , T sk , ∆T = T er − T sk andM r . Additionally, other features are extracted by computing the variance, min, max, root mean squares (RMS) and first derivative ( dx dt , where x is the variable) of the aforementioned measured and estimated variables. The age and gender of the test subjects are also included in the feature spaces. Figure 6 is showing the distribution of the participants' thermal sensation votes at the three environment temperatures (24, 5 and 37 • C). The aforementioned figure shows the 'confusion space', or the area in which the reported thermal sensation votes at the three environmental temperatures are overlapping. Such observation shows that the thermal perception may overlap even with large differences in the surrounding environmental temperatures. Such a confusion space is a great challenge for any predictive model of thermal sensation, especially for static models such as PMV.
For the sake of the main objective of the present work, the computational cost of the developed algorithm should be low enough to be compatible with wearable technology and online modelling. Hence, a feature selection procedure is employed to obtain the most reduced-dimension model yet with the best error performance. Feature selection here is based on evaluating all possible feature combinations and selecting the combination with best error performance. The feature selection step results in a feature space including 25 features, as shown in Table 4.   Table 4. An overview of the selected feature space including the measured and estimated variables (six variables) and some operations on these variables (× = selected).

Variance
Min A classification model is developed based on the selected 25 input features and trained using the LS-SVM approach. The resulting confusion matrix from the developed classification model based on the selected feature space is shown in Figure 7.
The overall error performance results of the developed classification model are presented in Table 5. For a seven-class classification problem, the developed classifier have shown an overall accuracy of 76% to predict the individual's thermal sensation. The developed classifier has shown a high (84%) F1-score, which reflects low false-positives and -negatives.  The overall error performance results of the developed classification model are presented in Error! Reference source not found.. For a seven-class classification problem, the developed classifier have shown an overall accuracy of 76% to predict the individual's thermal sensation. The developed classifier has shown a high (84%) F1-score, which reflects low false-positives and -negatives. The error performance results of the developed general classification for each class separately are shown in Table 6.. The results showed that the error performances of classes 1, 2, 6 and 7 are very low (see Table 6.), which can be attributed to the low number (0, 2, 4 and 2, respectively) of obtained votes for these classes, or, in other words, due to the uneven class distribution. Therefore, the overall F1-score is a more reliable and efficient measure of performance than the accuracy in this case. SVM is used in recent studies to assess the occupant's thermal demands [12] and to predict thermal comfort/sensation [11]. In these studies, the results have shown that SVM is able to predict thermal comfort/sensation with accuracy and F1 scores of 76.7% and 84%, respectively. However, these results is only obtained by reducing the seven-class classification problem to a three-class problem. Hence, we believe that reducing the number of classes will improve our suggested general model performance. Moreover, based on streaming data obtained from wearable sensor technologies, a personalised adaptive classification model, based on the same extracted features, will enhance the The error performance results of the developed general classification for each class separately are shown in Table 6. The results showed that the error performances of classes 1, 2, 6 and 7 are very low (see Table 6), which can be attributed to the low number (0, 2, 4 and 2, respectively) of obtained votes for these classes, or, in other words, due to the uneven class distribution. Therefore, the overall F1-score is a more reliable and efficient measure of performance than the accuracy in this case. Table 6. The error performance (precision, sensitivity and F1-score) of the developed general LS-SVM model for the seven-class classification problem. SVM is used in recent studies to assess the occupant's thermal demands [12] and to predict thermal comfort/sensation [11]. In these studies, the results have shown that SVM is able to predict thermal comfort/sensation with accuracy and F1 scores of 76.7% and 84%, respectively. However, these results is only obtained by reducing the seven-class classification problem to a three-class problem. Hence, we believe that reducing the number of classes will improve our suggested general model performance. Moreover, based on streaming data obtained from wearable sensor technologies, a personalised adaptive classification model, based on the same extracted features, will enhance the model performance to predict the individual's thermal sensation. Different related works investigated the problem of thermal sensation and comfort prediction via machine learning algorithms. Ghahramani et al. [27] applied the hidden Markov model (HMM) technique to the thermal comfort prediction problem with three levels of thermal comfort. The main issue in the used dataset in this study is the class imbalance, which is not tackled by the proposed methodology. A recent study by Lu et al. [7] proposed a personalised model, however, the study strictly investigated two subjects and developed a dedicated model for each subject.

Sensitivty
Testing of the trained model for each test subject was implemented using the Matlab platform on a computer with Intel ® 8 Core i7 (2.7 GHz) processor and 16 GB of RAM. The average computational time for one test run on this computer was 100 ms. The developed model should be trained using data from different populations (e.g., different ages, ethnicities and physical conditions) and different environmental conditions (e.g., broader ranges of temperature and humidity). In future research, the mental status of the participants should be taken into the account to investigate the capability of the developed model to comply with different mental conditions (e.g., stresses). Moreover, a sensitivity analysis should be performed considering different accuracy and sensitivity levels of the wearable sensors. On the other hand, the LS-SVM approach used in this paper is suitable for online adaptation with a flexibility to receive new data (streaming data) variables. Hence, the developed model can be used for adaptive real-time mode-based monitoring of individual thermal sensation. Additionally, as such, the developed mode is suitable for different applications such as the simulation of the human thermal state under different environmental conditions and for building design and control. In this paper, we present the possibility of using this model for adaptive HVAC control systems.

Adaptive Occupant-Based HVAC Predictive Controller
In modern buildings, it is very common that HVAC control systems are designed in such way to ensure parsimonious energy use and cost-effective building operation. This often happens by tuning HVAC control parameters (e.g., set points) to exploit the inherent trade-off between energy consumption and thermal comfort, with the latter acting as a constraint defining a theoretical and practical upper bound on potential energy savings [28][29][30]. In this paper, we suggested a model-predictive control (MPC) strategy, which is based on continuous feedback of occupant's thermal state (sensation/comfort) with main control objective to achieve occupant's thermal comfort. Then the energy use can be employed in the controller's cost-function as constraints.
In this section, we introduced to an adaptive occupant-based HVAC predictive controller using the developed LS-SVM predictive classification model. The general framework of the proposed HVAC predictive controller approach is depicted in Figure 8. In this paper, we only describe the main methodology to use the LS-SVM predictive classification model for the occupant's thermal state in the generalized predictive control (GPC) scheme, which will be studied and investigated further in future work. The GPC is one of the most popular model predictive controlling (MPC) methods in broad number of fields. The basic principle of GPC is to calculate a sequence (control horizon, N c ) of future control signals that minimizes a cost function defined over a prediction horizon (N p ) [31]. In general, the GPC algorithm consists of two main subsystems, namely, a prediction model and an optimizer. As shown in Figure 8, two main components, namely, the adaptive algorithm for LS-SVM predictive model and the GPC algorithm, are suggested. learning, which is based on developing a local model for each test point or subset of the test set [33]. The streaming data includes: i. Wearable sensor data, which consists of the continuously (easily) measured variables, namely, occupant's heart rate, skin heat flux, skin temperature, ambient temperature and aural temperature. ii.
Data obtained from the interactive mobile application, which consists of the occupant's data, namely, age and gender. Additionally, the occupant's thermal sensation vote ( ) is to be obtained via mobile application-based questioner (interactive application).

The GPC algorithm
In general, the goal of any controller is to calculate the input (control signal) to the controlled system (plant) such that the output follows the desired reference. However, in case of the predictive controller, the GPC algorithm aims to find the best-predicted output sequence (using the prediction model) that is the closest to a predefined reference trajectory (desired thermal state in our case). The prediction model in our case is the adaptive LS-SVM classification model that predicts the occupant's thermal sensation ( ). The algorithm simulates multiple future scenarios (predicted output sequence) in a systematic way using the optimizer, then the predicted output ( + | ) is used to calculate the optimal future input (ambient temperature, ( + | )). The optimizer solves an online optimization problem based on a defined cost function (Figure 8.), which minimizes the predicted error ( + | ) between the reference ( ) and the predicted output ( + | ).
The cost-function is given as follows [34]: where ∆ ( ) is the change in the control signal (ambient temperature), ( + | ) is the predicted output (thermal sensation) sequence, ( ) is the reference (desired level of thermal sensation), is the minimum of the prediction horizon and and are the weighting factors. The suggested control signal ( ) can be incorporated into the HVAC system by feeding it as a setpoint to the HVAC controller. The sequence of predicted thermal sensation is crucial in the optimisation (cost function) of the control (manipulated) variables [35,36]. In the presented approach, we have considered the air temperature as the only manipulated variable; however, more HVACrelated variables can be added to the optimisation step (e.g., ventilation rate and energy consumption).  The availability of the real-time sensors data, from the wearable technologies, has given the possibility of streaming data, which are processed via the proposed online streaming algorithm to adapt the classifier model. This adaptive algorithm is needed to handle the newly arrived data (streaming data) in the training set. Different approaches are available in the literature to handle these challenges, such as incremental learning methods [32], which work on adapting and retuning the parameters of the general model based on the newly collected data. Another approach is the localized learning, which is based on developing a local model for each test point or subset of the test set [33]. The streaming data includes: i.
Wearable sensor data, which consists of the continuously (easily) measured variables, namely, occupant's heart rate, skin heat flux, skin temperature, ambient temperature and aural temperature. ii.
Data obtained from the interactive mobile application, which consists of the occupant's data, namely, age and gender. Additionally, the occupant's thermal sensation vote (T S ) is to be obtained via mobile application-based questioner (interactive application).

The GPC Algorithm
In general, the goal of any controller is to calculate the input (control signal) to the controlled system (plant) such that the output follows the desired reference. However, in case of the predictive controller, the GPC algorithm aims to find the best-predicted output sequence (using the prediction model) that is the closest to a predefined reference trajectory (desired thermal state in our case). The prediction model in our case is the adaptive LS-SVM classification model that predicts the occupant's thermal sensation (T S ). The algorithm simulates multiple future scenarios (predicted output sequence) in a systematic way using the optimizer, then the predicted outputT S (k + N p |k) is used to calculate the optimal future input (ambient temperature,T a (k + N c |k)). The optimizer solves an online optimization problem based on a defined cost function (Figure 8), which minimizes the predicted errorê(k + N p |k) between the reference R S (k) and the predicted outputT S (k + N p |k). The cost-function is given as follows [34]: where ∆T a (k) is the change in the control signal (ambient temperature),T S (k + j | k) is the predicted output (thermal sensation) sequence, R S (k) is the reference (desired level of thermal sensation), N 1 is the minimum of the prediction horizon and α and λ are the weighting factors. The suggested control signal (T a ) can be incorporated into the HVAC system by feeding it as a set-point to the HVAC controller. The sequence of predicted thermal sensation is crucial in the optimisation (cost function) of the control (manipulated) variables [35,36]. In the presented approach, we have considered the air temperature as the only manipulated variable; however, more HVAC-related variables can be added to the optimisation step (e.g., ventilation rate and energy consumption). The proposed approach (Figure 8) depends on the extracted features from easily measured variables (T er , H R , q sk and T sk ,) that can be collected from already available (off-the-shelf) wearable sensors (e.g., smart watches and on-body smart tags). As such, this proposed approach has the advantage over other models (e.g., [37]), which depend on difficult and/or invasive measurements (core body temperature and metabolic rate) and, consequently, not convenient for long-term monitoring. Moreover, the used LS-SVM used in this approach is suitable for online prediction of an individual's thermal state with minimum computational cost (100 ms for the prediction of the thermal sensation of each individual).

Conclusions
In this present paper, 25 participants are subjected to three different environmental temperatures, namely 5 • C (cold), 20 • C (moderate) and 37 • C (hot), at two different activity levels, namely, at low level (rest) and high level (cycling at 80 W power). Metabolic rate, heart rate, average skin temperature (from three different body locations), heat flux and aural temperature are measured continuously during the course of the experiments. The thermal sensation votes are collected from each test subject based on the ASHRAE seven-point questionnaire. The results have shown that a reduced-ordered (second-order) MISO-DTF including three input variables (wearables), namely, aural temperature, heart rate and average heat flux, is best to estimate the individual's metabolic rate (non-wearable) with an average MAPE of 8.7%. A general classification model based on the LS-SVM technique is developed to predict the individual's thermal sensation. For a seven-class classification problem, the results have shown that the overall model accuracy and F1-score of the developed classifier are 76% and 84%, respectively. It is suggested in this paper that the overall performance of the model can be enhanced by using a personalised adaptive classification algorithm based on streaming data from wearable sensors. The developed LS-SVM classification model for the prediction of the occupant's thermal sensation can be integrated in the HVAC system to provide an occupant thermal state-based climate controller. In this paper, we introduced an adaptive occupant-based HVAC predictive controller using the developed LS-SVM predictive classification model.