Occupant Comfort Management Based on Energy Optimization Using an Environment Prediction Model in Smart Homes

: Occupant comfort management is an important feature of a smart home, which requires achieving a high occupant comfort level as well as minimum energy consumption. Based on a large amount of data, learning models enable us to predict factors of a mathematical model for deriving the optimal result without expensive experiments. Comfort management supports high-level comfort to the occupant in the individual indoor environment, using the optimal power consumption to run home appliances. In this paper, we propose occupant comfort management based on energy optimization, using an environment prediction model. The proposed energy optimization model provides optimal power consumption based on the proposed objective function, which requires temperature and comfort index data as the input parameters. For the input requirement, temperature prediction model and humidity prediction model are presented based on a recurrent neural network with a pre-collected dataset, including indoor and outdoor temperature and humidity sensing data. Using the predicted temperature and humidity data, the comfort index model derives the predicted mean vote value to be used in the energy optimization model with the predicted temperature data. The experimental results present an 8.43% reduction of the optimized power consumption compared to the actual power consumption using mean absolute percentage error to calculate. Moreover, the emulation of an indoor environment using optimal energy consumption presents as approximately similar to the actual data.


Introduction
In modern life, various electronic appliances provide convenience and improve people's living quality in a way that is based on the consumption of electronic energy.These electronic appliances are one of the biggest consumers of electricity in many cities, where people live urban lives with many electronic products day and night [1].Especially in buildings, a huge amount of electricity in the form of final electronic energy is consumed, which is a larger proportion than both industry and transportation in many developed countries [2].As shown through the survey, people spend more than 80% of their days in the indoor environment, using electronic products for living, working, and entertainment [3].With the development of internet infrastructures, much work will be done through the remote access by employees in the indoor environment, such as their home, office, and wherever people feel comfor working.Furthermore, according to the United Nations, the population of urban centers will increase from today's 55% to 68% in 2050, including most people in developing countries [4].This growth is leading to increasing energy consumption by the operation of electronic appliances in the buildings.Nevertheless, providing a comfortable environment to occupants is an important function of the indoor environment because of the occupant's living quality, including the health and productivity [5][6][7][8].Therefore, in any building, an intelligent approach is required for maintaining the user's environmental comfort while consuming minimal energy through electronic appliances.
The intelligent control system of buildings is comprised of a computer, data storage, sensor, and actuator, to support the occupant's expected comfort while reducing energy consumption during the operation of building [9].For supporting a comfortable environment, the intelligent control system requires parameters, including various indoor and outdoor environmental sensing data with user preferences, to build the model.The parameters are difficult to collect for the mathematical solution, which may require the parameters in specific cases for previous studies [10][11][12].The limitations of deploying various sensors to satisfy the condition of the formula for calculating the comfort index with minimal energy consumption is a challenge [13].The comfort index can be predicted through a historical dataset for the individual environment [14].Predicting various parameters is important to get the factors for making a comfortable environment for users without human intervention, where the electronic appliances work by consuming the power.Through prediction, outputs can be used to change the environment through the actuators.The environmental parameters are the inputs of the prediction model to affect the factors of a control system for heating, cooling, ventilation, and lighting [15].In order to minimize power consumption with the comfortable environment, the control system of smart buildings is required to include the functionalities for supporting high-level comfort, high power efficiency, and user-friendliness.
However, the tradeoff between the energy consumption and indoor comfort level is difficult to achieve, because energy consumption depends on the total operational cost of electronic appliances, and the comfort experience is affected by various dynamic factors, including the occupant's state in the conditioned environment [16].Furthermore, for supporting comfort, various electronic appliances collaborate, such as heating, ventilation, and air conditioning (HVAC), gas, and lighting [17,18].Therefore, supporting the comfortable environment continuously without human intervention shall consume unnecessary energy for satisfying the conditions of user preference.A simple rule-based control system can adjust these actuators based on the collected sensing data from the sensors for each environmental parameter [19,20].Therefore, frequent controlling is required for changing the desired temperature, humidity, and other environmental parameters through the actuators.However, the frequent operation of actuators results in consumption of more energy.
In this paper, we propose a scheme of imposed energy optimization for supporting the high-level comfort to the user in the individual indoor environment using optimal power consumption.The indoor environment is comprised of sensors, actuators, indoor environmental parameters, and the user.For the awareness of the environment, various environmental data is required to be collected.The data on outdoor environmental parameters can be collected from the weather station, and the data of indoor environmental parameters can be collected from indoor sensors.Using the collected data of environmental parameters, the environment can be predicted based on prediction models.The recurrent neural network (RNN) is a machine learning (ML) algorithm that is used for forecasting parameters in the time sequence based on involving the initial states and the past states of the neurons in the series of processing [21].For predicting the indoor environment, an RNN-based prediction model is used occupant comfort management.The prediction model forecasts the indoor environment for the user using the individual historical dataset, including indoor and outdoor data, which is collected by the Oak Ridge National Laboratory (ORNL) to be published online [22].The predicted indoor environment in the future is used for calculating the comfort index and supporting parameters of the objective function in the optimizer.The comfort index is derived by the predicted mean vote (PMV) formula, which provides physical phenomenon and an outcome of human thermal sensation for the heat transfer between a human body and its surrounding environment [23].The objective function is implemented using a complex formula from an optimal control strategy used for a multi-zone air conditioning system [24].The control factor is inferred by the objective function of the optimizer, based on the future comfort index and other environmental parameters.Through comfort management, including a prediction model and optimizer, the optimal power consumption is applied to change the indoor environment for achieving maximum user comfort with minimum energy consumption.
The rest of the paper is structured as follows.Section 2 introduces related works regarding occupants' building environment control systems, based on advanced approaches of fuzzy logic, optimization, and ML.Section 3 illustrates the proposed occupant comfort management, including models of environment parameter prediction, the comfort index, and energy consumption optimization.Section 4 presents prediction and optimization results regarding indoor environmental parameters and energy consumption.Section 5 presents our conclusions regarding the proposed occupant comfort management model.

Related Works
Energy consumption is of paramount importance in residual buildings, due to the fact that most of the buildings consume energy to ensure a certain degree of comfortable environment for occupants.Controlling temperature in an individual space for residents is one of the fundamental functions in occupant buildings.In literature, numerous comfort indices have been considered, including primarily thermal comfort, visual comfort, and air quality.These indices are the function of environmental parameters, such as temperature, humidity, illumination, and air quality [25].Numerous comfort management strategies have been devised to exploit the indoor and outdoor environmental parameters and ensure a certain degree of comfort for occupants in these buildings.In [26][27][28], an optimal model is proposed to provide a solution for energy saving, and to predict the factors of heating, ventilating, and air conditioning systems.Many recent studies leverage fuzzy logic controllers to control the environmental parameters through actuators [29,30].These methods primarily deal with single object optimization, and thus have addressed a single-factor controlling mechanism in the comfort management system.However, in reality such systems require multiple factors to ensure a comfortable environment.Model predictive control (MPC) scheme is another approach, in which the optimal control can be reached through modeling the future environment based on the operation strategy for saving energy and making a comfortable environment [31].A variation of this approach has been proposed, which introduces feedback MPC and allows automatic control in a building in order to maintain energy efficiency and the self-operation of building actuators [32].Weighted parameters in the objective function have been employed to get the optimal control factor, in order to solve multiple parameters for the complex environment [33][34][35].
For achieving optimal values of various parameters in the objective function, an optimization algorithm is required to be selected.Many optimization algorithms have been proposed that are inspired from the behavior of nature.These optimization algorithms are modelled to get optimal results based on reaching the optimal value in each parameter of the objective function.For instance, colony optimization uses stochastic nature to reach its optimal value [36].Similarly, the genetic algorithm (GA) and particle swarm optimization (PSO) are evolutionary algorithms, which can be used for non-linear optimization problems to achieve optimization [37].GA and PSO are used in many different cases to optimize power consumption while controlling electronic appliances [38][39][40].Certain instances from the literature have also been found where GA is utilized in the building control system, in order to optimize the control factor of HVAC to reach the optimal performance [41].PSO, on the other hand, is used in the recommendation system of buildings to minimize the annual energy consumption for the building energy performance optimization [42].These optimization solutions provide a real-time solution for complex multi-objective optimization problems, which most linear mathematical models cannot realistically solve.Based on these algorithms, objective functions are proposed to give the optimal values in the comfort management system.However, these objective functions require multiple parameters in the complex environment [43,44].In the proposed comfort management scheme, the parameters are inferred through the prediction model and calculated by the PMV formula.Heater power consumption is the only value to be required for achieving optimal comfort from the objective function.Therefore, optimization algorithms are not required to optimize the objective function in the proposed scheme.
Energy consumption has become increasingly important to control the stress on today's electrical grid infrastructure [45].Therefore, predicting energy consumption is crucial to find energy demand in the future, for the reliability of power supply system.Through the prediction model, the parameters can be based on the inputs of the model.For forecasting of time series, historical data are required as the inputs of the model, to predict future data in the time sequence.A variety of ML algorithms have been proposed for forecasting, such as the artificial neural network (ANN), hidden Markov model (HMM), support vector machine (SVM), and many other ML algorithms [46].The ANNs have been used for solving nonlinear methods, which can be trained to learn the relationship for recognizing patterns from given data, through the functions of self-organizing, data-driven, self-study, self-adaptive, and associated memory [47].For the training algorithms to predict the parameter in a time sequence, various neural network architectures have been proposed, such as generalized regression, wavelet, dynamic, and backpropagation [48].Recently, most of the neural networks have been based on multiple layers for enabling the complex mapping between inputs and outputs, in order to learn the approximate nonlinear relationship [49].Multi-layer neural networks are based on two basic architectures: convolutional neural network (CNN) and RNN [50].The CNN is handy in cases like image recognition, where the image data is independent from the time series [51,52].
In contrast, RNN contains a memory component, to pass the selected information to the outputs of the model for capturing the time-related dependencies [53].Using an RNN based prediction model, the long short-term memory (LSTM) can be used for learning time series with long time spans [54].Therefore, for forecasting the data continued in the time series, the model of an RNN is trained by the continuous data to pass the features on to the next time in the timeline.For forecasting wind speed, Cheng et al. present an RNN-based architecture to maintain diversities of sub-models and take advantages of learning [55].For estimating the charging state of an Li-ion battery without using battery models, filters, and inference systems like Kalman filters, Chemali et al. introduce an RNN with an LSTM model to predict the charging state, based on continuous battery life [56].Microsoft engineers Tam et al. proposed an RNN-based, spoken-language understanding model to generate valid unseen labeled data, through capturing the structure of a word sequence for evaluating live logs of Cortana [57].For a short-term traffic data forecast in the transportation system, Zhao et al. introduce an RNN-based data prediction approach using LSTM cells [58].Therefore, most of the forecasting problems are implemented by an RNN that can deliver the information from data to the next data that are continuous in the time sequence.
For user comfort, the PMV is the most widely used model, and was developed through costly laboratory experiments by Fanger in 1970s [59].The PMV model is the basis of the International Organization for Standardization (ISO) 7730 standard, which has 1994 and 2005 versions [60,61].A personal comfort model results in individual thermal comfort, which presents the comfort level based on the person's surrounding environment.The PMV-based comfort model takes an individual person as the unit instead of the average of a group, and uses direct feedback from individuals, including thermal sensation, preference, acceptability and pleasure.A personal comfort model is used for better understanding regarding specific comfort needs and the desired thermal comfort of an occupant in an individual environment.For intelligent comfort management, the comfort data can be used for the intelligent controlling model, to manage the building or other environments and to achieve optimal conditioning with energy efficiency [62][63][64].In the proposed comfort management, the PMV results from the predicted environment for the future comfort of the individual occupant environment, to be used for optimizing power consumption within the comfortable environment.

Proposed Occupant Comfort Management Methodology
For occupant comfort management in smart spaces, where the sensors and actuators are deployed to support a comfortable environment to the user, the intelligent system needs to collect environmental information and make the smart decision for controlling the actuators to change the environment, using appropriate power consumption.Figure 1 presents the power consumption optimization process, which is based on environment prediction.
The comfort index is used for evaluating the indoor environment, where the user stays.Through the comfort index, the system can make a strategy to control the actuators for updating the indoor environmental parameters to support the comfortable environment.The comfort index calculator is a generator for the comfort index, which outputs the data for evaluating the indoor environment.
The optimizer includes the objective function for optimizing the power parameter for the environment using environment parameters, including historical data, predicted data, and comfort index.The output of the optimizer is a power consumption value that is used for operating the actuator to change the indoor environment for the user comfort.The value results from the objective function for the minimum power consumption of the comfortable environment.Therefore, the actuators shall make the environment comfortable for the user using optimal power consumption.

Environmental Parameter Prediction Model
For predicting the environmental parameters, prediction models are proposed for temperature data and humidity data in the indoor space.The predicted data is used for calculating the PMV value that is the comfort index, to present user comfort in the future indoor environment.The proposed optimizer also requires the predicted indoor environmental data with the future comfort index to infer the optimal power.Figure 2 shows the prediction models to predict the temperature data and humidity data, using historical data for indoor and outdoor environmental parameters.The prediction model requires a set of data that is used for predicting the next time.In order to develop the prediction model, the dataset is used for training the model.The prediction model is used for predicting the indoor environment, which is comprised of various environmental parameters.The parameters change over time.Therefore, the data must be continuous for training the model, as well as predicting the next time.The input data that is used for predicting the next time, which can be a data moment or a data sequence from a point in time in the past to the current point.The outputs of the prediction model are a dataset for the predicted indoor environmental parameters in the future.This forecasting is continued from the past, which is affected by all the data from the past.
Using the outputs of the prediction model, the comfort index can be calculated for the future.The comfort index is used for evaluating the indoor environment, where the user stays.Through the comfort index, the system can make a strategy to control the actuators for updating the indoor environmental parameters to support the comfortable environment.The comfort index calculator is a generator for the comfort index, which outputs the data for evaluating the indoor environment.
The optimizer includes the objective function for optimizing the power parameter for the environment using environment parameters, including historical data, predicted data, and comfort index.The output of the optimizer is a power consumption value that is used for operating the actuator to change the indoor environment for the user comfort.The value results from the objective function for the minimum power consumption of the comfortable environment.Therefore, the actuators shall make the environment comfortable for the user using optimal power consumption.

Environmental Parameter Prediction Model
For predicting the environmental parameters, prediction models are proposed for temperature data and humidity data in the indoor space.The predicted data is used for calculating the PMV value that is the comfort index, to present user comfort in the future indoor environment.The proposed optimizer also requires the predicted indoor environmental data with the future comfort index to infer the optimal power.Figure 2 shows the prediction models to predict the temperature data and humidity data, using historical data for indoor and outdoor environmental parameters.
Sustainability 2019, 11, x FOR PEER REVIEW 6 of 18 The proposed prediction models require input parameters, such as time sequence (TS), outdoor temperature (To), user-desired indoor temperature (Ti), outdoor humidity (Ho), and user-desired indoor humidity (Hi).The temperature prediction model (TPM) requires historical data for the environmental parameters To and Ti.For each environmental parameter, the TPM requires 96 sequential data.Each row of the input dataset is comprised of a TS, To, and Ti.The 96 sequential data are the historical data from t-96 to t.Each t represents the number of TSs that present 15 minutes.The t means the number for the current time in the TS.Therefore, 96 of TS presents 1 hour.Through the TPM, the Ti of t + 1 can be predicted.Similarly, the humidity prediction model (HPM) requires the historical data of Ho and Hi.The output of the HPM is the Hi of t + 1.The prediction models are built by the RNN-based ML, which is good in scenarios where there are temporal or order dependencies through containing a memory component, to pass the selective knowledge down the time sequence.Figure 3 shows the sequential architecture of an RNN-based environmental prediction model for predicting the indoor temperature and humidity.
In the RNN-based indoor environment prediction model, the input parameters are continuous in the time axis, and the output parameter is also continued from the inputs.An RNN model enables efficient learning, to handle sequential data with temporal correlation based on connecting hidden layers with the former ones circularly.In the proposed RNN-based model, eight hidden layers are connected with the LSTM cells, which are the recurrent units, to save the historical information from the sequence.In an RNN model, there are numerous connections between current and previously hidden layers.However, training such a network becomes difficult because of the vanishing gradient problem [65].The LSTM cells were proposed to build recurrent units for the hidden layers in the network of RNN model.The LSTM cells are used for remembering the short-term memory that delivers information to the result.The input parameters are presented as x(n), which are continuous data.Each x has three dimensions: TS, To, and Ti for TPM; and TS, Ho, and Hi for HPM.In the model, the last outputs are taken to the fully-connected layer that outputs the power consumption value.The proposed prediction models require input parameters, such as time sequence (TS), outdoor temperature (To), user-desired indoor temperature (Ti), outdoor humidity (Ho), and user-desired indoor humidity (Hi).The temperature prediction model (TPM) requires historical data for the environmental parameters To and Ti.For each environmental parameter, the TPM requires 96 sequential data.Each row of the input dataset is comprised of a TS, To, and Ti.The 96 sequential data are the historical data from t − 96 to t.Each t represents the number of TSs that present 15 min.The t means the number for the current time in the TS.Therefore, 96 of TS presents 1 h.Through the TPM, the Ti of t + 1 can be predicted.Similarly, the humidity prediction model (HPM) requires the historical data of Ho and Hi.The output of the HPM is the Hi of t + 1.
The prediction models are built by the RNN-based ML, which is good in scenarios where there are temporal or order dependencies through containing a memory component, to pass the selective knowledge down the time sequence.Figure 3 shows the sequential architecture of an RNN-based environmental prediction model for predicting the indoor temperature and humidity.
In the RNN-based indoor environment prediction model, the input parameters are continuous in the time axis, and the output parameter is also continued from the inputs.An RNN model enables efficient learning, to handle sequential data with temporal correlation based on connecting hidden layers with the former ones circularly.In the proposed RNN-based model, eight hidden layers are connected with the LSTM cells, which are the recurrent units, to save the historical information from the sequence.In an RNN model, there are numerous connections between current and previously hidden layers.However, training such a network becomes difficult because of the vanishing gradient problem [65].The LSTM cells were proposed to build recurrent units for the hidden layers in the network of RNN model.The LSTM cells are used for remembering the short-term memory that delivers information to the result.The input parameters are presented as x(n), which are continuous data.Each x has three dimensions: TS, To, and Ti for TPM; and TS, Ho, and Hi for HPM.In the model, the last outputs are taken to the fully-connected layer that outputs the power consumption value.

Comfort Index Model
The PMV results in a comfort index that predicts the mean value from the votes of a large group of people, based on the heat balance of the human body.The PMV presents seven points to represent the level of thermal sensation scale: hot, warm, slightly warm, neutral, slightly cool, cool, and cold.The PMV model is used for getting the comfort index to be used in the energy consumption optimization model.The parameters of the PMV-based comfort index model are the predicted environmental data for the indoor environmental parameters using TPM and HPM.Therefore, the PMV value presents a predicted comfort index for the person who is in the individual environment, as well as the environmental data collected to be used in the proposed prediction model.

Comfort Index Model
The PMV results in a comfort index that predicts the mean value from the votes of a large group of people, based on the heat balance of the human body.The PMV presents seven points to represent the level of thermal sensation scale: hot, warm, slightly warm, neutral, slightly cool, cool, and cold.The PMV model is used for getting the comfort index to be used in the energy consumption optimization model.The parameters of the PMV-based comfort index model are the predicted environmental data for the indoor environmental parameters using TPM and HPM.Therefore, the PMV value presents a predicted comfort index for the person who is in the individual environment, as well as the environmental data collected to be used in the proposed prediction model.

Comfort Index Model
The PMV results in a comfort index that predicts the mean value from the votes of a large group of people, based on the heat balance of the human body.The PMV presents seven points to represent the level of thermal sensation scale: hot, warm, slightly warm, neutral, slightly cool, cool, and cold.The PMV model is used for getting the comfort index to be used in the energy consumption optimization model.The parameters of the PMV-based comfort index model are the predicted environmental data for the indoor environmental parameters using TPM and HPM.Therefore, the PMV value presents a predicted comfort index for the person who is in the individual environment, as well as the environmental data collected to be used in the proposed prediction model.
For calculating the PMV, Equations ( 1)-( 8) are used.These equations refer the IOS 7730 2005 version that is mentioned in the Related Works section.The PMV formula is comprised of evaporation, respiration, radiation, convection, and other parameters.For the overall comfort index model, the input parameters are metabolic rate (M), effective mechanical power (W), air temperature (Ta), mean radiant temperature (Tr), relative humidity (Rh), air velocity (Va), and clothing insulation (icl) [66][67][68].
The overall mathematical model is presented in Equation ( 1), and accordingly the parameters in Equation ( 1) are further derived in Equations ( 2)-( 5): where the unit of M and W is watts per square meter (W/m 2 ); the unit of Pa is pascals (Pa), and the unit of Ta, Tr, and tcl is degrees Celsius.The parameter f cl is the clothing surface area factor that is derived by icl, and the parameter hc is the convective heat transfer coefficient in watts per square meter kelvin, derived from Equations ( 6) and ( 7) below: where the unit of parameter Va in Equation ( 7) is meters per second (m/s).The outputs hc1 and hc2 from Equations ( 6) and ( 7) are selected by the Algorithm 1 through the comparison between the results of the equations.For using the relative humidity in the PMV model, converting the relative humidity to saturation vapor pressure is required.In a space, the pressure of the air is affected by humidity and temperature.The mathematical model was given by Tetens [69], which is introduced in [70] and presented in below with Equation ( 8): Pa = Rh × (610.78 × e (17.2694×Ta/(Ta+238.3))/100 ) Algorithm 1 shows the steps of calculating the PMV based on given parameters, including M, W, Ta, Tr, Va, Rh, and icl, using the function getPMV (M, W, Ta, Tr, Va, Rh, icl).In the first step, the value of parameter icl is checked.Depending on whether or not the value is bigger than 0.078, the fcl is given a different value.For the hc, according to the comparison of Equations ( 6) and (7), hc is given a different value.Once the fcl and hc are confirmed, the Pa is given by Equation (8).The parameter tcl is given by Algorithm 2. Then all required values of parameters are prepared for equations, and values are assigned to the equations to derive the value of PMV.
Algorithm 2 shows the steps to calculate the tcl for Equations ( 4)-( 6), which are used in Algorithm 1.For deriving the value of tcl, the input parameters fcl, M, W, Ta, Tr, Va, and icl are required.The fcl is a result in Algorithm 1, and others are the inputs of the PMV model.The function getTcl(fcl, M, W, Ta, Tr, Va, icl) includes an iterator to get the minimum distance between two variables, resulting in the tcl.In this iteration the function, getTclf(tcl, fcl, ts, Ta, Tr, Va, icl) is used.temp = (q[0] * getTclf(q[1], fcl, ts, Ta, Tr, Va, icl) 7: −q[1] * getTclf (q[0], fcl, ts, Ta, Tr, Va, icl)) 8: /( getTclf (q[1], fcl, ts, Ta, Tr, Va, icl) 9: −getTclf (q[0], fcl, ts, Ta, Tr, Va, icl)); 10: q[0] = q[1]; 11: q[1] = temp; 12: } 13: return (q[0] + q[1]) / 2; To use the proposed comfort index model based on the PMV, the parameters M, W, Va, and icl are fixed, because of the lack of training data for the environmental prediction model.The proposed prediction models are used for resulting in the indoor temperature and humidity, which are the inputs of the comfort index model.Therefore, we assume other parameters for the occupant in the individual environment.The value of M is 58, W is 0, Va is 0, and icl is 1.1.In this case, these parameters refer to a person in a seated, quiet state, wearing long shirts and pants, when the wind cannot be detected by the person.Based on the experiment with the given values for the input parameters of the PMV model, the PMV value is derived correctly to compare with the American Society of Heating, Refrigerating and Air-Conditioning Engineers (ASHRAE) Standard 55-2017 from Center for the Built Environment (CBE) Thermal Comfort Tool [71].

Energy Consumption Optimization Model
The energy consumption model is a multi-objective function, and addresses minimizing energy while simultaneously achieving thermal comfort.Our formula is based on the derivation of House and Smith [22], where the cost is defined in terms of two distinct subparts.The first part is the differential quantity of the current temperature and predicted temperature at the next time interval (t + 1), and the second is the PMV subpart, which is also the differential quantity of the current and predicted PMVs.In addition to these two parameters, the predicted energy consumption (Eh t+1 ) is also considerd as given in Equation ( 9): where f (Eh t+1 ) is the objective function of energy consumption optimization; α is a weighting factor, and is taken as 10ˆ9; T t is the generated temperature; and T t+1 is the predicted temperature at time interval t + 1.These change with respect to time in these two differential quantities are integrated into the interval t and t + 1. Equation ( 9) is further expanded to form Equation ( 10): The value of the energy consumption optimization model is generated by an integration by parts formula, and the result shows that the cube average filter is applied to the main parts of the model, i.e., temperature and PMV.
Figure 5 shows the schematic of the energy consumption optimization model, using an objective function for operating the heater to change the indoor environment, including temperature and humidity.The TPM and HPM are adapted to provide the predicted indoor environment data for the objective function.Through the predicted indoor temperature and humidity data, the PMV, which is a parameter of the objective function, is derived for the future environment.The future indoor temperature is also a parameter of the objective function.From the historical dataset, the indoor temperature data for the time sequence t − 1 and t are required, and the PMV data for the same time sequence with the indoor temperature are required.The optimization model outputs the power consumption for the heater, which is a value to present the energy consumption from a time sequence t to t + 1.The heater consumes power according to the output of the optimization model, to affect the indoor environment.In the time t, the outdoor and indoor environments are the factors of the heater.From these factors, the heater updates the indoor environment based on the power value, in order to achieve the indoor environment in time t + 1.
In the implementation, we developed a Deep Neural Network (DNN)-based heater emulator trained by the same dataset with applied to the TPM and HPM.Therefore, when the indoor and outdoor temperature and humidity data for time t and the power value for time t + 1 are inputted into the heater emulator, the indoor temperature and humidity for time t + 1 are outputted.In the implementation, we developed a Deep Neural Network (DNN)-based heater emulator trained by the same dataset with applied to the TPM and HPM.Therefore, when the indoor and outdoor temperature and humidity data for time t and the power value for time t + 1 are inputted into the heater emulator, the indoor temperature and humidity for time t + 1 are outputted.

Experimental Results
For experimenting with the proposed occupant comfort management model, using energy optimization and environmental prediction for the individual home environment, we present the indoor temperature and humidity data comparison between the actual data and predicted results.The TensorFlow 1.8 was used to implement the environment prediction model with the ORNL dataset.The ORNL dataset is collected from a house in Compbell, United States.The dataset has 35,040 rows and includes various sensing data.The indoor and outdoor temperature and humidity data, as well as the heater power consumption data for a room of the house were used in our experiment.The indoor data, including temperature, humidity, and energy consumption of the heater, was collected from a great room titled as "Great RM/Room" in the dataset.The indoor environment of the room is controlled by the user, who adjusts the heater and other appliances to achieve comfort environment.We present the prediction result of the PMV data, which is derived by the predicted temperature and humidity for the future.Once the predicted indoor environment data is gathered from the TensorFlow-based RNN model, then the PMV data is determined through the Java application, which is the implementation of comfort index model.We present the environmental and PMV data assigned to the optimization model in order to get the optimal power consumption for the heater.Microsoft Office Excel was used for deriving the optimal value based the proposed objective function.For evaluating the result of proposed optimization model, the optimal heater power consumption data is presented, and the indoor temperature and humidity data comparisons between actual data and optimal results are presented.

Indoor Environmental Parameters Predictions
Figure 6 shows the data comparison between actual indoor temperature and predicted indoor temperature.The unit of the presented data is degrees Celsius (ºC), and the x-axis presents the sequence numbers.The actual data is presented for 10,512 values that show the indoor temperature in the experimental house from 13 September at 11:45 to 31 December at 23:30.The average temperature of actual data was 21.63 °C, the minimum temperature was 17.63 °C, and the maximum

Experimental Results
For experimenting with the proposed occupant comfort management model, using energy optimization and environmental prediction for the individual home environment, we present the indoor temperature and humidity data comparison between the actual data and predicted results.The TensorFlow 1.8 was used to implement the environment prediction model with the ORNL dataset.The ORNL dataset is collected from a house in Compbell, United States.The dataset has 35,040 rows and includes various sensing data.The indoor and outdoor temperature and humidity data, as well as the heater power consumption data for a room of the house were used in our experiment.The indoor data, including temperature, humidity, and energy consumption of the heater, was collected from a great room titled as "Great RM/Room" in the dataset.The indoor environment of the room is controlled by the user, who adjusts the heater and other appliances to achieve comfort environment.We present the prediction result of the PMV data, which is derived by the predicted temperature and humidity for the future.Once the predicted indoor environment data is gathered from the TensorFlow-based RNN model, then the PMV data is determined through the Java application, which is the implementation of comfort index model.We present the environmental and PMV data assigned to the optimization model in order to get the optimal power consumption for the heater.Microsoft Office Excel was used for deriving the optimal value based the proposed objective function.For evaluating the result of proposed optimization model, the optimal heater power consumption data is presented, and the indoor temperature and humidity data comparisons between actual data and optimal results are presented.

Indoor Environmental Parameters Predictions
Figure 6 shows the data comparison between actual indoor temperature and predicted indoor temperature.The unit of the presented data is degrees Celsius (ºC), and the x-axis presents the sequence numbers.The actual data is presented for 10,512 values that show the indoor temperature in the experimental house from 13 September at 11:45 to 31 December at 23:30.The average temperature of actual data was 21.63 • C, the minimum temperature was 17.63 • C, and the maximum temperature was 25.79 • C. The predicted data were the results from the TPM.The predicted data are also presented for 10,512 values.The average temperature of the predicted data was 21.57• C, the minimum temperature was 18.03 • C, and the maximum temperature was 25.53 • C. The mean absolute percentage error (MAPE) of the predicted data with actual data is 1.05%, the minimum absolute percentage error is 0.00%, and the maximum absolute percentage error is 6.72%.
Sustainability 2019, 11, x FOR PEER REVIEW 12 of 18 temperature was 25.79 °C.The predicted data were the results from the TPM.The predicted data are also presented for 10,512 values.The average temperature of the predicted data was 21.57°C, the minimum temperature was 18.03 °C, and the maximum temperature was 25.53 °C.The mean absolute percentage error (MAPE) of the predicted data with actual data is 1.05%, the minimum absolute percentage error is 0.00%, and the maximum absolute percentage error is 6.72%.Figure 7 shows the data comparison between actual indoor humidity and predicted indoor humidity.The unit of the presented data is percentage (%), and the x-axis presents the sequence numbers.The actual data is presented for 10,512 values that show the indoor humidity in the experimental house from 13 September at 11:45 to 31 December at 23:30.The average humidity of the actual data was 53.4%, the minimum humidity was 34.44%, and the maximum humidity was 64.49%.The predicted data resulted from the HPM.The predicted data are also presented for 10,512 values.The average humidity of the predicted data was 53.21%, the minimum humidity was 34.37%, and the maximum humidity was 64.49%.The MAPE of the predicted data with actual data is 0.56%, the minimum absolute percentage error is 0.00%, and the maximum absolute percentage error is 4.53%.Figure 7 shows the data comparison between actual indoor humidity and predicted indoor humidity.The unit of the presented data is percentage (%), and the x-axis presents sequence numbers.The actual data is presented for 10,512 values that show the humidity in the experimental house from 13 September 11:45 to 31 December at 23:30.The humidity of the actual data was 53.4%, the minimum humidity was 34.44%, and the maximum humidity was 64.49%.The predicted data from the HPM.The predicted data are also presented for 10,512 values.The average humidity of the predicted data was 53.21%, the minimum humidity 34.37%, and maximum humidity was The MAPE the predicted data with data is 0.56%, minimum error 0.00%, and the maximum absolute percentage error is 4.53%.

Indoor Environmental User Comfort Prediction
Sustainability 2019, 11, x FOR PEER REVIEW 12 of 18 temperature was 25.79 °C.The predicted data were the results from the TPM.The predicted data are also presented for 10,512 values.The average temperature of the predicted data was 21.57°C, the minimum temperature was 18.03 °C, and the maximum temperature was 25.53 °C.The mean absolute percentage error (MAPE) of the predicted data with actual data is 1.05%, the minimum absolute percentage error is 0.00%, and the maximum absolute percentage error is 6.72%.Figure 7 shows the data comparison between actual indoor humidity and predicted indoor humidity.The unit of the presented data is percentage (%), and the x-axis presents the sequence numbers.The actual data is presented for 10,512 values that show the indoor humidity in the experimental house from 13 September at 11:45 to 31 December at 23:30.The average humidity of the actual data was 53.4%, the minimum humidity was 34.44%, and the maximum humidity was 64.49%.The predicted data resulted from the HPM.The predicted data are also presented for 10,512 values.The average humidity of the predicted data was 53.21%, the minimum humidity was 34.37%, and the maximum humidity was 64.49%.The MAPE of the predicted data with actual data is 0.56%, the minimum absolute percentage error is 0.00%, and the maximum absolute percentage error is 4.53%.

Indoor Environmental User Comfort Prediction
Figure 8 shows the PMV data based on the predicted indoor temperature and humidity data using TPM and HPM.Through the TPM, the indoor temperature data is predicted based the Ti, and To.Using the same RNN architecture, the HPM is used for predicting the indoor humidity data, based on the TS, Hi, and Ho.The PMV model derives the PMV data using these predicted temperature and humidity data.The other parameters are fixed values for the inputs of the model.The length of the presented PMV data is 10,512, which presents the future comfort index of the environment based on the predicted temperature and humidity.The minimum comfort index is −1.1, then the indoor temperature is 18.30 • C and indoor humidity is 41.64%.The maximum comfort index is 0.81, then the indoor temperature is 25.28 Figure 8 shows the PMV data based on the predicted indoor temperature and humidity data using TPM and HPM.Through the TPM, the indoor temperature data is predicted based on the TS, Ti, and To.Using the same RNN architecture, the HPM is used for predicting the indoor humidity data, based on the TS, Hi, and Ho.The PMV model derives the PMV data using these predicted temperature and humidity data.The other parameters are fixed values for the inputs of the model.The length of the presented PMV data is 10,512, which presents the future comfort index of the environment based on the predicted temperature and humidity.The minimum comfort index is -1.1, then the indoor temperature is 18.30 °C and indoor humidity is 41.64%.The maximum comfort index is 0.81, then the indoor temperature is 25.28 °C and indoor humidity is 61.35%.

Optimal Energy Consumption
Figure 9 shows power consumption data based on the energy optimization model to operate the heater.Using the indoor temperature, humidity, and PMV data as the parameters of the input parameters for the optimization model, the optimal power value is derived be used in the heater.The purpose of the optimal energy consumption value is supporting high-level comfort, as well as minimum energy.To compare with actual energy consumption data, the optimized power consumption data is reduced by 8.43% for 10,400 collected values in the experiment.The total consumption of actual data was 414,887.06Watt (W), and the total optimized power consumption was 382,622.91W. The average of the actual data was 39.89 Watt-hour (Wh), the minimum was 26.75 Wh, and the maximum was 65.41 Wh.The average of the optimized power consumption is 36.79Wh, the minimum is 8.20 Wh, and the maximum is 127.95Wh. -

Optimal Energy Consumption
Figure 9 shows power consumption data based on the energy optimization model to operate the heater.Using the indoor temperature, humidity, and PMV data as the parameters the input parameters for the model, the optimal power value is derived be used in the heater.The purpose of the optimal energy consumption value is supporting high-level comfort, as well as minimum energy.To compare with actual energy consumption data, the optimized power consumption data is reduced by 8.43% for 10,400 collected values in the experiment.The total consumption of actual data was 414,887.06Watt (W), and the total optimized power consumption was 382,622.91W. The average of the actual data was 39.89 Watt-hour (Wh), the minimum was 26.75 Wh, and the maximum was 65.41 Wh.The average of the optimized power consumption is 36.79Wh, the minimum is 8.20 Wh, and the maximum is 127.95Wh.

Indoor Environment Using Optimal Power Consumption
Figure 10 shows the data comparison between the actual indoor temperature and optimal indoor temperature.The average temperature of the actual data was 21.60 °C, the minimum temperature was 17.67 °C, and the maximum temperature was 25.79 °C.The average temperature of the optimal data was 21.51 °C, the minimum temperature was 18.26 °C, and the maximum temperature was 25.51 °C.The MAPE of the optimal data with the actual data is 0.42%, the minimum absolute percentage error is 0.00%, and the maximum absolute percentage error is 4.27%.Figure 11 shows the data comparison between the actual indoor humidity and optimal indoor humidity.The average humidity of the actual data was 53.36%, the minimum humidity was 34.44%, and the maximum humidity was 64.72%.The average humidity of the optimal data was 53.36%, the minimum humidity was 23.66%, and the maximum humidity was 64.45%.The MAPE of the optimal data with actual data is 9.99%, the minimum absolute percentage error is 0.04%, and the maximum absolute percentage error is 46.09%.

Indoor Environment Using Optimal Power Consumption
Figure 10 shows the data comparison between the actual indoor temperature and optimal indoor temperature.The average temperature of the actual data was 21.60 • C, the minimum temperature was 17.67 • C, and the maximum temperature was 25.79 • C. The average temperature of the optimal data was 21.51 • C, the minimum temperature was 18.26 • C, and the maximum temperature was 25.51 • C. The MAPE of the optimal data with the actual data is 0.42%, the minimum absolute percentage error is 0.00%, and the maximum absolute percentage error is 4.27%.

Indoor Environment Using Optimal Power Consumption
Figure 10 shows the data comparison between the actual indoor temperature and optimal indoor temperature.The average temperature of the actual data was 21.60 °C, the minimum temperature was 17.67 °C, and the maximum temperature was 25.79 °C.The average temperature of the optimal data was 21.51 °C, the minimum temperature was 18.26 °C, and the maximum temperature was 25.51 °C.The MAPE of the optimal data with the actual data is 0.42%, the minimum absolute percentage error is 0.00%, and the maximum absolute percentage error is 4.27%.Figure 11 shows the data comparison between the actual indoor humidity and optimal indoor humidity.The average humidity of the actual data was 53.36%, the minimum humidity was 34.44%, and the maximum humidity was 64.72%.The average humidity of the optimal data was 53.36%, the minimum humidity was 23.66%, and the maximum humidity was 64.45%.The MAPE of the optimal data with actual data is 9.99%, the minimum absolute percentage error is 0.04%, and the maximum absolute percentage error is 46.09%.Figure 11 shows the data comparison between the actual indoor humidity and optimal indoor humidity.The average humidity of the actual data was 53.36%, the minimum humidity was 34.44%, and the maximum humidity was 64.72%.The average humidity of the optimal data was 53.36%, the minimum humidity was 23.66%, and the maximum humidity was 64.45%.The MAPE of the optimal data with actual data is 9.99%, the minimum absolute percentage error is 0.04%, and the maximum absolute percentage error is 46.09%.

Conclusions
In this paper, we propose an improved energy optimization model to recommend optimal power consumption for operating heaters, which is necessary to change the indoor environmental factors like temperature and humidity.We used indoor temperature and humidity as input parameters for the optimization model.We also used RNN and LSTM for prediction models to forecast energy consumption.The results of the prediction model suggest that the PMV values lead to the derivation of the comfort index values, which can be applied to the proposed optimization model.In the present experiment, we have exploited MAPE to predict indoor temperature values and indoor humidity values that have 1.05% and 0.56% differences with the actual data, respectively.Based on the predicted data with relation to the PMV data, the optimized power consumption for 10,400 records result in an 8.43% reduction compared to the actual data.Similarly, on the basis of the optimized power consumption, the indoor temperature data results in a 0.42% and indoor humidity data results in a 9.99% difference with the actual data.Consequently, the experimental results dictate that the proposed optimization scheme saves energy, as well as providing a comfortable environment, using the optimal power consumption to operate the heater and thus keep the userdesired temperature and humidity in the indoor environment.

Conclusions
In this paper, we propose an improved energy optimization model to recommend optimal power consumption for operating heaters, which is necessary to change the indoor environmental factors like temperature and humidity.We used indoor temperature and humidity as input parameters for the optimization model.We also used RNN and LSTM for prediction models to forecast energy consumption.The results of the prediction model suggest that the PMV values lead to the derivation of the comfort index values, which can be applied to the proposed optimization model.In the present experiment, we have exploited MAPE to predict indoor temperature values and indoor humidity values that have 1.05% and 0.56% differences with the actual data, respectively.Based on the predicted data with relation to the PMV data, the optimized power consumption for 10,400 records result in an 8.43% reduction compared to the actual data.Similarly, on the basis of the optimized power consumption, the indoor temperature data results in a 0.42% and indoor humidity data results in a 9.99% difference with the actual data.Consequently, the experimental results dictate that the proposed optimization scheme saves energy, as well as providing a comfortable environment, using the optimal power consumption to operate the heater and thus keep the user-desired temperature and humidity in the indoor environment.

Figure 1 .
Figure 1.Energy consumption optimization based on environmental parameter prediction.

Figure 1 .
Figure 1.Energy consumption optimization based on environmental parameter prediction.

Figure 2 .
Figure 2. Environmental prediction model based on indoor and outdoor temperature and humidity.

Figure 2 .
Figure 2. Environmental prediction model based on indoor and outdoor temperature and humidity.

Figure 4 Figure 4 .
Figure 4 presents an architecture of the proposed occupant comfort management based on the proposed environment prediction model.The inputs of the environment prediction model are collected from an environment where the occupant lives.The required data for the environmental parameters is for 1 hour, which is 96 sequential values.Through the prediction model, values of temperature and humidity are derived for the next time.The values are used for the PMV and optimization models to determine a power value.The power value is used for controlling an actuator to affect the environment.

Figure 4 Figure 3 .
Figure 4  presents an architecture of the proposed occupant comfort management based on the proposed environment prediction model.The inputs of the environment prediction model are collected from an environment where the occupant lives.The required data for the environmental parameters is for 1 h, which is 96 sequential values.Through the prediction model, values of temperature and humidity are derived for the next time.The values are used for the PMV and optimization models to determine a power value.The power value is used for controlling an actuator to affect the environment.

Figure 4 Figure 4 .
Figure 4 presents an architecture of the proposed occupant comfort management based on the proposed environment prediction model.The inputs of the environment prediction model are collected from an environment where the occupant lives.The required data for the environmental parameters is for 1 hour, which is 96 sequential values.Through the prediction model, values of temperature and humidity are derived for the next time.The values are used for the PMV and optimization models to determine a power value.The power value is used for controlling an actuator to affect the environment.

Figure 4 .
Figure 4. Architecture of the proposed occupant comfort management based on the prediction model.

Figure 5 .
Figure 5. Operation of a heater based on an optimization model using an objective function.

Figure 5 .
Figure 5. Operation of a heater based on an optimization model using an objective function.

Figure 6 .
Figure 6.Data comparison between the actual indoor temperature and predicted indoor temperature.

Figure 7 .
Figure 7. Data comparison between actual indoor humidity and predicted indoor humidity.

Figure 6 .
Figure 6.Data comparison between the actual indoor temperature and predicted indoor temperature.

Figure 6 .
Figure 6.Data comparison between the actual indoor temperature and predicted indoor temperature.

Figure 7 .
Figure 7. Data comparison between actual indoor humidity and predicted indoor humidity.

Figure 7 .
Figure 7. Data comparison between actual indoor humidity and predicted indoor humidity.

Figure 8 .
Figure 8. Predicted mean vote (PMV) data based on predicted indoor temperature and humidity data.

Figure 9 .
Figure 9. Optimal power consumption data for operating heater.

Figure 10 .
Figure 10.Data comparison between actual indoor temperature and optimal indoor temperature.

Figure 9 .
Figure 9. Optimal power consumption data for operating heater.

Figure 10 .
Figure 10.Data comparison between actual indoor temperature and optimal indoor temperature.

Figure 10 .
Figure 10.Data comparison between actual indoor temperature and optimal indoor temperature.

Figure 11 .
Figure 11.Data comparison between actual indoor humidity and optimal indoor humidity.

Figure 11 .
Figure 11.Data comparison between actual indoor humidity and optimal indoor humidity.
• C and indoor humidity is 61.35%.