Next Article in Journal
Portugal’s Wattle and Daub Constructive Legacy
Next Article in Special Issue
Strategies to Optimise Project Management Implementation in the Delivery of Renewable Energy Projects in Indonesia
Previous Article in Journal
Machine Learning for Resilient and Sustainable Cities: A Bibliometric Analysis of Smart Urban Technologies
Previous Article in Special Issue
Urban Management for Building-Sector Decarbonization: Focusing on the Role of Low-Carbon Policies
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Systematic Review

Artificial Intelligence Approaches to Energy Management in HVAC Systems: A Systematic Review

by
Seyed Abolfazl Aghili
1,
Amin Haji Mohammad Rezaei
1,
Mohammadsoroush Tafazzoli
2,
Mostafa Khanzadi
1,* and
Morteza Rahbar
3
1
School of Civil Engineering, Iran University of Science & Technology, Tehran 16846-13114, Iran
2
Department of Civil Engineering and Construction, Georgia Southern University, 201 COBA Dr, Bldg. 232, Statesboro, GA 30460, USA
3
School of Architecture and Environmental Design, Iran University of Science & Technology, Tehran 16846-13114, Iran
*
Author to whom correspondence should be addressed.
Buildings 2025, 15(7), 1008; https://doi.org/10.3390/buildings15071008
Submission received: 13 February 2025 / Revised: 15 March 2025 / Accepted: 20 March 2025 / Published: 21 March 2025
(This article belongs to the Special Issue Energy Efficiency and Carbon Neutrality in Buildings)

Abstract

Heating, Ventilation, and Air Conditioning (HVAC) systems contribute a considerable share of total global energy consumption and carbon dioxide emissions, putting them at the heart of the issues of decarbonization and removing barriers to achieving net-zero emissions and sustainable development goals. Nevertheless, the effective implementation of artificial intelligence (AI)-based methods to optimize energy efficiency while ensuring occupant comfort in multifarious settings remains to be fully realized. This paper provides a systematic review of state-of-the-art practices (2018 and later) using AI algorithms like machine learning (ML), deep learning (DL), and other computation-based techniques that have been deployed to boost HVAC system performance. The review highlights that AI-driven control strategies can reduce energy consumption by up to 40% by dynamically adapting to environmental conditions and occupancy levels. Compared to other work that focuses on single aspects of HVAC management, this work deals with the methods of control and maintenance in a comprehensive manner. Rather than focusing on abstract applications of machine learning models, this study underlines their applicability in HVAC systems, bridging the science–practice gap. This study highlights the prospective role AI could play, on the one hand, by enhancing HVAC systems’ incorporation, energy consumption, and building technologies, while, on the other hand, also addressing the potential uses AI can have in practical applications in the future, bridging gaps and addressing challenges.

Graphical Abstract

1. Introduction

With city growth, a rise in the number of factories and people, and improved living standards, energy use in buildings has sharply increased. Currently, buildings account for more than 40% of the world’s annual energy consumption and are responsible for 40% of total carbon dioxide emissions [1,2]. Due to global climate change, we may experience more extreme weather in the future. Therefore, when designing buildings, it is crucial to consider both climate change and future energy demands [3]. Nearly 40% of total energy is consumed by HVAC systems, including air conditioners, heat pumps, ventilation, and refrigeration equipment, making them significant contributors to energy use in commercial buildings [4,5]. Consequently, reducing energy costs and the carbon footprint requires a more efficient use of energy in buildings. Managing a building’s energy consumption is complex due to the influence of various factors, such as the building’s location, weather conditions, desired indoor temperature and humidity, the number of people present and their time spent indoors, the building’s thermal insulation, and its purpose. Since most people spend the majority of their time indoors [6], ensuring indoor comfort is essential for quality of life and productivity.
For HVAC systems to effectively transfer heat and mass, they have to contain specific elements such as air supply ducts, heating/cooling coils, boilers, and chillers. Their operations will depend on conditions such as air temperature, flow velocity, and humidity. These features, among others, are said to be influenced by other external factors that include weather conditions, sunlight, and outdoor temperature. The American Society of Heating, Refrigerating and Air-Conditioning Engineers (ASHRAE) has extensively studied HVAC systems and their applications [6]. HVAC systems consume nearly half of a building’s energy, so they must operate effectively to create a comfortable indoor environment. Enhancing the energy efficiency of HVAC systems has, therefore, become vital to improving the overall energy performance of buildings. Many researchers have worked on reducing the energy consumption of HVAC systems while maintaining occupant comfort.
The integration of Building Energy Management Systems (BEMSs) enables autonomous control of building activities, including HVAC [7], lighting, and equipment [8]. Studies suggest that, by employing intelligent technologies and analytics, office buildings can achieve 18% energy savings, while retail buildings can reach 12% [9]. BEMSs are designed to ensure the efficient operation of building systems, equipment, and services, thereby providing a more comfortable environment for occupants while reducing energy use and operational costs. BEMSs have greatly enhanced automated monitoring and control of HVAC systems, reducing the need for manual interventions and improving building efficiency, making them a key development in smart building technologies.
Different computer and software technologies bring more and more industries to automation; AI is playing a great role in it nowadays [1]. With the growing demand for optimization of energy usage, waste reduction, and maintaining comfort–security–health standards, the demand for smart buildings has appeared [2]. With the growing interest in building monitoring and control technologies like AI and the Internet of Things (IoT), the market for “smart buildings” is expected to expand rapidly. Both academia and industry are adopting AI in the building sector to improve design, construction, operations, and maintenance processes [8,9]. These could be AI algorithms merged with sensors that track and control indoor environmental conditions in real time. Such systems automatically analyze data, support predictions about performance into the future, and provide information to make informed decisions satisfactorily [3]. The McKinsey Global Institute [10] conducted a comparative study of AI adoptions across industries, further emphasizing the need for the building and construction sector to accelerate digital transformation and the adoption of AI. Investigating AI techniques is crucial for improving building energy efficiency and addressing related challenges, including the slow pace of AI adoption in this domain. There is a need for comprehensive analysis and evaluation of AI’s current applications and its potential in future building solutions. Given rising global energy demands, HVAC systems have become focal points in urban energy management strategies. This paper examines recent advancements in AI technologies designed to enhance HVAC efficiency in line with stricter global standards and policy reforms. Advanced control methods with AI and HVAC optimization through maintenance management have been studied in recent times, and machine learning algorithms were found to be highly effective in optimizing energy efficiency [11,12]. Further, it has been demonstrated through studies that integrating smart control algorithms with real-time analytics is very effective in optimizing HVAC, reducing energy consumption while keeping the interior comfortably cooled [13].
In this paper, we present a clear research hypothesis, demonstrate the novelty of our approach, and identify how our findings contribute to the field of AI-enhanced HVAC systems. Our hypothesis suggests that integrating advanced AI techniques, such as machine learning (ML) and deep learning (DL), into HVAC systems can improve energy savings while maintaining occupant comfort. This hypothesis shapes our research objectives and drives our comprehensive investigation into the application of these technologies across various building types.
Unlike previous studies that often focus on a single aspect of HVAC energy management, this research provides an integrated review of recent advancements in AI for HVAC systems. Our approach examines AI applications across multiple HVAC components, focusing on the dual goals of enhancing energy efficiency and operational effectiveness.
This paper primarily contributes to the academic and practical understanding of AI’s potential to transform energy management within buildings. Unlike prior studies that focus on isolated aspects of HVAC management, this work provides a comprehensive overview of both control and maintenance techniques. Rather than focusing on the theoretical aspects of machine learning models, this study emphasizes their practical applications in HVAC systems, bridging the gap between research and implementation. As such, this work is a valuable resource for researchers and practitioners looking to implement AI solutions in pursuit of broader sustainability and energy efficiency goals. This study is a general overview of AI in HVAC optimization, with more emphasis laid on summing up methodologies, trends, and challenges than in listing specific case studies. Practical implementations are mentioned, however, so that readers can refer to real-world applications when needed.
This research offers a comprehensive and systematic literature review (SLR) on the integration of AI techniques in HVAC energy management. The novelty of this study lies in its rigorous synthesis of current research across diverse databases, highlighting AI-driven approaches for optimizing HVAC systems’ energy efficiency while ensuring occupant comfort. Beyond merely reviewing existing literature, this study categorizes and assesses various AI algorithms and their applications within this domain, providing deeper insights into both control and maintenance strategies. Additionally, this research innovatively identifies significant research gaps and outlines potential future research directions, emphasizing the role of AI in enhancing both the operational efficiency and predictive maintenance of HVAC systems. Our systematic approach helps map the landscape of AI applications in HVAC energy management, making it a valuable resource for researchers and practitioners working toward improved building energy efficiencies. The significance of this research is further discussed in Section 5.

2. Review Methodology

2.1. Research Questions

An SLR process begins with defining the research questions (RQs). In this paper, we identify the following RQs:
RQ1. 
What methods are available that use AI techniques to improve the energy performance of HVAC systems?
RQ2. 
What AI algorithms are used most widely in each method of improving HVAC energy efficiency?
RQ3. 
What are the reported outcomes and effectiveness of AI techniques in improving the energy efficiency of HVAC systems?

2.2. Literature Search

In computer science and engineering, systematic literature reviews are commonly conducted using string-based searches in various digital libraries. Utilizing multiple databases to encompass a wide range of evidence during the database searching is strongly advised. As seen in Figure 1, this research searches the literature for pertinent contributions linked to the RQs outlined in Section 2.1 utilizing a database search based on three of the most used digital libraries for performing SLRs. Multiple databases, namely Science Direct, Google Scholar, and Scopus are discussed for conducting a systematic literature review (SLR). Since Science Direct has the highest level of coverage for an SLR, allowing it to facilitate reproducible and efficient searches through queries, filters, and hands-on searching, it is considered the main search engine. Unlike Scopus and Web of Science (WoS), Science Direct provides full-text access to several journals and books. Considering that there exists, in parallel, literature coming from other publishers, Google Scholar was utilized as a supplementary search tool, thereby retrieving roughly the same number of citations as WoS and Scopus. Scopus still had wider coverage of engineering records, which made it more appropriate to carry out evidence synthesis on engineering applications. Hence, Scopus was chosen as an additional specialized search database in the present study. Additionally, a forward and backward citation search was performed to ensure that all relevant studies, including those indexed in other databases, such as IEEE Xplore and Web of Science, were included. This approach ensured a comprehensive review of the available literature.
To conduct corresponding searches on the selected digital libraries described above, ‘‘Machine AND Learning’’ OR ‘‘Deep AND Learning’’ OR ‘‘AI’’ AND ‘‘Buildings AND Energy AND HVAC’’ search strings are defined based on the RQs introduced in Section 2.1.

2.3. Inclusion/Exclusion Criteria

The SLR undertaken in this study relies predominantly on peer-reviewed publications from reputable journals, books, and international conference proceedings, considered reliable sources of scholarly literature. Additionally, relevant articles from the grey literature may also be incorporated. To emphasize the contemporary advancements and trends in HVAC energy management utilizing AI methods and optimization, only articles published within the six-year timeframe from 2018 and later are included throughout this paper.

2.4. Literature Search Results

A comprehensive search of academic literature was carried out utilizing Figure 2 to locate relevant articles from the three specified databases mentioned in Section 2.2, namely Science Direct, Scopus, and Google Scholar. The search yielded a total of 374 articles. Articles that concentrated on applying AI approaches to enhance HVAC energy management were included in the analysis. Only peer-reviewed journal articles, conference papers, and books published by respectable publishers were regarded as high-quality sources to guarantee the research’s validity and legitimacy. The inclusion of such sources is illustrated in Table 1.
In contrast, non-peer-reviewed articles were omitted from consideration. Following the removal of duplicates, a total of 401 articles remained. These articles then underwent a screening process, in which we explicitly evaluated their abstracts to determine their relevance to the research questions outlined in Section 2.1. Subsequently, the full text of 267 relevant articles was meticulously analyzed to assess their quality and eligibility. A thorough review led to the exclusion of 16 studies that failed to address the research questions adequately. Our selection criteria also accounted for excluding articles that focused solely on AI methods in energy forecasting, indoor comfort, occupancy detection, control strategies, and fault detection without addressing the enhancement of HVAC energy management. Furthermore, articles were excluded if they demonstrated poor writing quality, needed more methodological clarity, inadequately explained their approaches, or presented insignificant results.

3. Scientometric Analysis

3.1. Publication Source

Journal articles are widely regarded as the most indispensable form of scholarly publication in terms of sources of dissemination. Based on estimations, a total of 56 scientific journals presently exist. Consequently, Figure 3 exclusively showcases the six journals that have published the highest volume of scientific articles. Among these, Building and Environment, Energies, and Energy and Buildings are the top three journals, having produced 16, 16, and 13 articles, respectively. These journals can be considered valuable references in the domain of HVAC systems and the efficacy of building energy systems. Furthermore, the fact that these journals are edited by Elsevier and MDPI enhances their credibility and authority within their specialized fields.

3.2. Most Cited Publications

Furthermore, research was conducted to assess the exact quantity of citations each paper obtained. A selection of over twenty citations from a total of carefully chosen articles that included both targeted research on energy saving and broad HVAC literature were included in the analysis. Examining each publication’s contribution, importance, and novelty in Table 1 sheds light on new developments in the area. It explains why some studies have attracted a lot of interest and citations. A significant finding of this analysis is the close relationship between a research paper’s citation count and uniqueness. Higher citation counts are typically seen in papers that present new uses of sophisticated machine learning methods, such as generative adversarial networks (GANs), deep reinforcement learning, and gradient boosting. Research that pushes the frontiers of what is feasible in the subject, offers new methodology, or dramatically improves current approaches is highly valued by the academic community based on this pattern.
It also emphasizes how crucial real-world applications are to maximizing the influence of research. Many of the most referenced publications deal with practical issues and provide answers that may be used immediately to build system management. Papers on occupancy-based control techniques, HVAC system defect detection, and predictive modeling for energy consumption, for instance, are essential because they address the pressing concerns of engineers and building managers. In addition to adding to the body of knowledge, these studies offer resources and techniques that may be applied to save expenses, increase energy efficiency, and improve the dependability of building systems. Additionally, the data demonstrate that more attention is often given to research that connects theoretical developments with real-world applications. Research and development efforts in energy management are frequently guided by studies that effectively integrate state-of-the-art AI and machine learning approaches. The studies that present novel frameworks for HVAC control—like those that use deep reinforcement learning—clarify this. They present fresh approaches to optimizing energy usage while preserving comfort and efficiency.
In conclusion, Table 1 shows how the uniqueness of the approaches presented and their applicability to real-world situations are directly related to the influence and significance of research in the field of energy management. Papers that present novel, creative solutions to practical issues are typically mentioned more frequently, which is a testament to their importance in advancing the discipline and benefiting society in concrete ways. This review emphasizes the importance of research that advances theoretical understanding while providing workable solutions for building energy system management.

3.3. Keywords Co-Occurrence

In order to investigate keywords with multiple interpretations, a thorough examination was conducted using varying search combinations, such as “Machine AND Learning”, “Deep AND Learning”, and “AI”, along with “Buildings AND Energy AND HVAC”. Subsequently, a network analysis was implemented to establish the interconnectedness among 27 frequently appearing keywords out of the total pool of 832 identified keywords in VOSviewer 1.6.18. The resulting visual representation in Figure 4 depicts the frequency of keyword occurrences through node size, while the thickness of the links illustrates the degree of co-occurrence between the keywords. In the constructed network, comprised of three main entities, namely “Machine Learning”, “HVAC”, and “Energy Efficiency”, the keyword co-occurrence network reveals notable associations between keywords like “Thermal Comfort”, “Artificial Intelligence”, “Deep Learning”, and “Smart Buildings” with the keyword “Machine Learning”. This correlation signifies that enhancing efficiency can be achieved by implementing machine learning techniques to assess its influence on the domains represented by these associated keywords. This analysis extends beyond theoretical advancements, offering practical implications for enhanced building codes and energy policies. Stakeholders, including policymakers and technology developers, are poised to benefit from these insights through improved regulatory frameworks and operational efficiencies.

3.4. Co-Authorship

The network visualization in Figure 5 displays co-authorship connections among countries, with various colors representing different connections. A major hub of this network is the USA, which indicates its extensive collaborative connections with numerous other nations. Lines between each country’s nodes show co-authorship links in academic or research publications.
There is a high volume of international collaborations between countries like the USA, China, and the UK. Different colors may be used to represent different regions or levels of collaboration. Among European countries, such as Germany, France, and the UK, connections could be displayed in one color. In contrast, connections between Asian countries, such as China, Japan, and Republic of Korea, could be displayed in another. There is likely a correlation between the thickness of the lines and the volume or frequency of collaborations, with thicker lines indicating stronger or more frequent collaborations. By identifying which countries are central in international research networks and the nature of their connections, the network effectively illustrates the global landscape of academic collaborations. The authors’ varied backgrounds offer insightful local knowledge, guaranteeing that the study encompasses a broad spectrum of viewpoints on AI applications in HVAC systems. This study improves the generalizability of its findings across a range of climatic conditions and building types by integrating knowledge from diverse geographic locations.

3.5. AI-Based Method

Based on empirical research, various AI methods have been studied and are divided into two broad categories: the control and maintenance of HVAC systems. These methods aim to automate the necessary processes for HVAC system operation through the assistance of AI. By reducing manual steps in energy management, these methods have the potential to optimize energy consumption and mitigate energy waste. Specifically, an analysis of Figure 6 reveals that most articles (82.93%) examined the control method of HVAC systems, whereas a smaller percentage (17.07%) focused on their maintenance technique. This suggests that the control method has received more attention in the literature. Various AI techniques are employed to control and maintain HVAC systems. Control strategy, occupancy detection, consumption forecasting, and thermal comfort analysis are utilized in the control method. In contrast, fault detection and diagnosis (FDD) and maintenance management techniques are employed in the maintenance method. Figure 6 further illustrates that many articles (110) have explored control strategies for HVAC systems using AI, highlighting its prevalence as a control technique. Consumption forecasting, another commonly used control technique, is explored in 40 articles. Additionally, FDD, the principal maintenance method technique, is discussed in 37 articles.
This distribution of research focus indicates a clear trend favoring AI-driven control strategies over maintenance-related applications in HVAC systems. The dominance of control-focused studies suggests that researchers prioritize immediate energy efficiency improvements, adaptive control mechanisms, and real-time system optimizations, as these provide direct operational benefits. However, while fault detection and predictive maintenance remain less explored, they are crucial for long-term system reliability, cost reduction, and sustainability. The relatively lower number of studies on maintenance techniques highlights an opportunity for future research to develop more advanced AI-based maintenance frameworks, integrating real-time diagnostics, predictive analytics, and automated fault prevention to enhance the overall efficiency and longevity of HVAC systems.

3.6. AI Algorithms

Within the library, a combined number of 44 distinct algorithms are available. To depict the prevalence of these algorithms, Figure 7 presents the top 25 commonly utilized methods, categorized according to control and maintenance fields. Deep reinforcement learning (DRL) emerged as the most favored algorithm for control applications. Following suit, artificial neural network (ANN), Random Forest (RF), and long short-term memory (LSTM) algorithms ranked as the second, third, and fourth most commonly employed methods. Similarly, in maintenance approaches, Support Vector Machines (SVMs) and ANNs were identified as the predominant methods. Each algorithm has distinct advantages and disadvantages, making it suitable for specific tasks. A thorough examination of the primary benefits and drawbacks of several well-known algorithms used in HVAC control and maintenance applications can be found in Table 2. This detailed comparison serves as a valuable resource for selecting the most suitable algorithm for specific tasks across various domains. By understanding the strengths and limitations of each algorithm, practitioners can make informed decisions tailored to the unique requirements and constraints of their applications. This approach enables the effective and efficient implementation of AI models, enhancing the overall performance and management of HVAC systems.
Figure 8, which presents a Sankey diagram, illustrates the flow and relationships between various AI methods, their techniques, and the specific algorithms used in HVAC systems for energy management. This visualization aids in understanding the predominant AI strategies that have been applied to control and maintenance operations within the sector. It highlights the significant emphasis on control methods, particularly those utilizing deep reinforcement learning (DRL) and machine learning (ML) techniques, which are prominent in optimizing energy efficiency and operational effectiveness. The diagram also shows the linkage between these methods and key outcomes like energy consumption reduction and improved system reliability. By delineating these connections, Figure 8 provides crucial insights into how AI integration influences HVAC performance metrics and assists stakeholders in identifying areas of potential development or further research. This enhanced interpretation helps to bridge the gap between theoretical AI applications and practical HVAC system improvements, offering a clearer understanding of the strategic value of these technologies in building management.

4. Systematic Literature Review

This section performs an exhaustive analysis utilizing the established library through a systematic literature review. After a comprehensive examination of these publications, significant subjects were clustered into primary informational classifications. These categories, their respective topics, and associated publications are exhibited in Table 3. AI models used for HVAC systems vary in complexity, precision, and computational needs. Model selection depends on data availability, real-time computing capacity, and system constraints [5,6]. Data quality issues, system integration, and fit to different building environments are also implementation challenges [7,8]. These challenges are key to delivering the successful implementation of AI-based HVAC systems [10,16].

4.1. Control HVAC System

This category consolidates subjects about artificial intelligence methods employed in managing HVAC systems, which can potentially enhance energy efficiency within buildings. Within this category, the principal areas of focus include control strategy, occupancy detection, consumption forecasting, and thermal comfort assessment.

4.1.1. Control Strategy

The lack of intelligent and remote controls in managing chillers and air handlers within HVAC systems leads to significant energy consumption. However, the Internet of Things (IoT) has introduced technological advancements that facilitate remote control functionalities for these devices. Alternatively, the progress of machine learning (ML) and artificial intelligence (AI) allows devices to be trained to autonomously make informed decisions that influence interactions between humans and machines [56,57,106]. These advancements are supported by combining wireless sensor data or IoT with user feedback within an AI system. Model predictive control (MPC), which utilizes ML techniques to generate optimal schedules for HVAC systems, can be optimized and simulated using artificial neural networks (ANNs) [61,89,116]. Nonetheless, designing an optimal energy management algorithm for scheduling HVAC systems is challenging due to uncertainty in the models, parameters, and temporally linked operational constraints. The deep reinforcement learning (DRL) algorithm overcomes these challenges, as it does not require prior knowledge of uncertain parameters or the construction of a thermal dynamics model, making it suitable for energy management and improving user comfort [17,94,131,138]. A comparison between DRL and MPC is provided in a separate study [81]. The integration of IoT with AI presents promising advancements for HVAC systems. However, significant research gaps in scalability and user adaptability must be addressed to harness these technologies fully.
Modern HVAC systems rely on advanced control methods that incorporate machine learning (ML) techniques and fuzzy logic to achieve energy efficiency. For example, Elman neural networks have demonstrated significant potential in load forecasting by predicting HVAC system requirements based on dynamic environmental and occupancy data. These adaptive control strategies ensure systems respond promptly to changing conditions, reducing energy waste while maintaining performance levels. Additionally, hybrid models that combine ML and IoT functionalities allow more granular control of chillers and air handlers, ensuring improved coordination between system components [41,45].
AI-driven control strategies have demonstrated energy savings of up to 40% in various studies, depending on factors such as building type, climatic conditions, and AI model selection. For instance, reinforcement learning-based HVAC optimization has been shown to reduce energy consumption by 30–40% in smart buildings [16], while ANN-based predictive control strategies have achieved savings in the range of 20–35% [31].

4.1.2. Occupancy Detection

Building occupancy detection and estimation play a crucial role in enhancing building energy efficiency. Over the last ten years, numerous approaches have been suggested to enhance the precision of detecting and estimating occupancy [144,152,160,169]. Employing machine learning models and methodologies in predicting occupancy behavior and routines in buildings has spawned their application in the operational management of building systems [150,153]. In identified studies, machine learning techniques are employed to forecast patterns of occupancy and behavior, particularly emphasizing their potential implementation in building systems to enhance energy efficiency, indoor air quality, and thermal comfort. The model system and prediction timeframes are different, making it challenging to develop a perfect prediction model for building occupancy. In general, occupancy prediction models usually include data collection, occupancy prediction, and validation [145]. Despite the potentially higher prediction accuracy of ANNs, they may not possess the same level of transferability as traditional ML models [23,157,167]. In order to identify and classify real-time entities, a convolutional neural network (CNN) architecture was trained and implemented [146,151,165]. Long short-term memory (LSTM) can capture time series data. An attention model can accentuate their significance in energy prediction by allocating weights to the most pertinent inputs. Moreover, integrating the attention mechanism during the training of convolutional neural networks (CNNs) allows for decreased communication overhead. This mechanism effectively disregards extraneous information while amplifying pertinent data [154].
Advancements in AI have introduced innovative methods for precise occupancy detection in HVAC systems, such as using competitive learning and sensor fusion. These methods optimize the functionality of HVAC components like air handlers and ventilation systems by ensuring they align with actual occupancy needs. Furthermore, predictive models trained on historical occupancy and behavioral data can forecast usage patterns, enabling energy-efficient HVAC operation in both residential and commercial buildings [40,41].

4.1.3. Forecasting Consumption

Accurately estimating energy consumption in buildings, particularly within the HVAC system, which contributes significantly to electricity usage, is crucial for effective energy management [45,192]. In this regard, data-driven models have become extensively employed for precise energy consumption prediction [197].
Considering that HVAC accounts for a large portion of the electricity load in buildings, forecasting consumption is vital for energy management [42,187]. Data-driven models are widely used to predict energy consumption [197]. Knowing the properties of outdoor air and the number of individuals using a space enables the estimation of energy consumption of a cooling system in a building with a considerable level of precision [170]. In load forecasting, LSTM networks have demonstrated impressive outcomes [195]. These networks possess LSTM layers that explicitly grasp the temporal associations in forecasting multivariate time series, thus presenting significant potential in energy-efficient building technologies [198]. The recurrent neural network (RNN) model is employed to predict the thermal load of a building as well as the temperatures within its different zones [168,176,183,197].
Energy consumption forecasting is an essential aspect of modern HVAC systems, particularly for components like compressors and air conditioners, which contribute heavily to peak energy usage. Recurrent neural networks (RNNs) and predictive analytics platforms are increasingly utilized to forecast cooling and heating loads. These methods incorporate factors like weather patterns and occupancy schedules, enabling HVAC systems to pre-adjust their operations and optimize energy use in real time [40,45].

4.1.4. Thermal Comfort

Most individuals utilizing shared office spaces express discontent with their thermal comfort due to HVAC systems’ inability to cater to individualized thermal environment needs [203,219]. By integrating considerations for both energy consumption and occupant thermal comfort, the regulation of thermal comfort can be approached as a problem of minimizing costs. One approach to predicting occupant thermal comfort involves the utilization of a Feedforward Neural Network (FNN) [217]. Additionally, certain studies employ an RF algorithm within HVAC systems to estimate the air quality index [202,204,217]. While AI significantly enhances HVAC efficiency, challenges such as system compatibility and data privacy remain prevalent. By using the environmental information, the HVAC system can be adjusted to predict thermal comfort in real time. Occupancy data, such as occupancy number and activity level, can be used to estimate indoor CO2 and minimum ventilation levels. Thermal comfort prediction models also use occupancy and activity levels. This information can be used to optimize HVAC operations and minimize energy consumption [145].
Achieving optimal thermal comfort while minimizing energy consumption is a key challenge in HVAC design. Recent innovations involve using AI models, such as fuzzy logic controllers and reinforcement learning systems, to regulate key components like air ducts and chillers. These systems dynamically adjust HVAC parameters based on real-time environmental and user feedback, improving indoor air quality and occupant satisfaction [41,49].

4.2. Maintenance HVAC System

This classification aims to provide insights into the potential of AI and its algorithms in enhancing the energy efficiency of HVAC systems through maintenance practices. By exploring maintenance management concepts and FDD, it is feasible to reduce energy consumption while ensuring optimal comfort levels. This classification aims to illustrate some insights into the potential role of artificial intelligence and its algorithms in increasing the energy efficiency of HVAC systems by enhancing maintenance practices.

4.2.1. Fault Detection and Diagnostics

In recent years, scholars have intensified their efforts in advancing the study of automated fault detection and diagnostics, prompted by the rise in energy consumption attributable to building faults [228]. Such faults have led to suboptimal thermal comfort and reduced occupant productivity [231]. By investigating computing-based FDD methods, two distinct categories emerge: knowledge-based and data-driven approaches [18,19]. As a result of the insufficient number of fault samples, the imbalanced class classification problem, which is prominent in machine learning, makes it challenging to categorize faults [19,241]. Discrete Bayesian Networks (DisBNs) are employed to diagnose faults across different levels in commercial HVAC systems. The implementation of DisBNs addresses a common challenge faced by other FDD methods, namely the lack of sufficient fault data for training purposes. A DisBN considers the interactions between faults and fault symptoms (referred to as fault indicators) within HVAC systems, considering the impacts of faults at various levels [227]. To enhance the effectiveness of HVAC system detection and isolation, this study combines a multiscale representation, Principal Component Analysis (PCA), and ML classifiers [252]. By identifying faults and predicting future states, machine learning algorithms have the potential to aid in scheduling maintenance tasks [226].
Efficient fault detection and diagnostics are crucial for maintaining HVAC systems like compressors, chillers, and air handlers. AI-driven approaches, such as fuzzy inference systems and predictive maintenance frameworks, enable early identification of potential faults. These methods leverage historical maintenance data and real-time monitoring to reduce downtime and operational costs, ensuring components remain in optimal condition. For example, predictive models applied to chiller plants can detect anomalies linked to external factors like weather fluctuations [48,49].
AI-driven fault detection and diagnosis (FDD) has significantly enhanced HVAC reliability by identifying system anomalies before they result in failures. Machine learning models, such as Random Forests and Bayesian Networks, are extensively used to detect irregularities in temperature, airflow, and energy consumption patterns [223].
Studies have demonstrated that predictive maintenance frameworks leveraging AI can reduce HVAC downtime and extend equipment lifespan by providing real-time fault detection alerts. These systems proactively diagnose potential failures, allowing facility managers to address issues before they escalate into costly repairs [9].

4.2.2. Maintenance Management

The role of the HVAC system in facility management and maintenance operations is of paramount importance, as any malfunction can result in substantial financial drawbacks. The implementation of DL techniques can enhance the overall performance of buildings by reducing energy consumption, facilitating maintenance planning, and overseeing equipment operations. Such improvements are particularly notable in the domain of predictive maintenance. Notably, significant advancements have emerged in building operation and maintenance, as evident in recent studies [12,44]. Upon analysis, extreme gradient boosting (XGB) has been identified as the most optimal machine learning algorithm for predictive maintenance [253].
Effective maintenance management ensures the longevity and efficiency of HVAC components, such as heat exchangers, evaporators, and ducts. AI-based predictive models, such as extreme gradient boosting (XGB), have been shown to excel in anticipating equipment failures and optimizing maintenance schedules. Furthermore, integrating digital twins with predictive analytics provides a real-time simulation of HVAC operations, allowing for proactive interventions to prevent component degradation [41,48].
AI-driven predictive maintenance strategies play a critical role in minimizing HVAC operational costs. By utilizing sensor-based monitoring and real-time analytics, AI models can detect wear and tear in HVAC components, triggering maintenance alerts before failures occur [255]. Cloud-based AI models have been implemented for large-scale HVAC maintenance optimization, allowing for remote diagnostics, automated scheduling of repairs, and performance tracking across multiple buildings. These intelligent maintenance strategies not only enhance system efficiency but also reduce energy waste and carbon footprints in smart buildings [254].

4.3. Machine Learning Model Applicability in HVAC Applications

Several machine learning (ML) models are applicable to some extent based on the specific HVAC application:
  • Supervised Learning (e.g., decision trees, Support Vector Machines, neural networks): Best suited for fault detection, energy consumption forecasting, and HVAC system diagnostics [14,19].
  • Unsupervised Learning (e.g., Clustering, Principal Component Analysis): Suitable for anomaly detection and system optimization with unlabeled data [23].
  • Reinforcement learning (e.g., deep Q-Networks, Actor–Critic Models): Most appropriate for adaptive HVAC control, real-time dynamic setpoint changes, and real-time energy optimization [26,32].
The model selection depends on the computational complexity, data availability, and requirement for real-time processing [30].

5. Discussion

This study elucidates the potential for AI to revolutionize energy management in HVAC systems globally, offering substantial benefits across various sectors. Even though this review is not focused on individual case studies, it combines major findings from various AI applications in HVAC systems, providing a systematic overview of their impact, challenges, and future directions. For the HVAC industry worldwide, the application of machine learning and deep learning highlights significant opportunities for energy savings and operational efficiencies crucial for commercial buildings. These adaptations enhance system performance and adjustment to diverse climatic conditions, making them versatile solutions, applicable globally. Further, by demonstrating AI’s effectiveness in reducing energy consumption and emissions, this research supports establishing stricter energy efficiency standards and regulations internationally. Such findings can guide policy decisions to encourage or mandate the integration of intelligent systems in new and existing structures, aiding in achieving energy conservation and emission reduction targets. From a financial perspective, leveraging AI in building energy systems presents a significant advantage by decreasing operational costs and boosting the sustainability profile of real estate assets. This shift can draw investments, particularly under the increasing focus on Environmental, Social, and Governance (ESG) criteria within investment practices.
In assessing the effectiveness of AI technologies in HVAC systems, it is crucial to acknowledge several inherent limitations that may influence the generalizability and applicability of our findings. Our analysis depends heavily on the data presented in previously published research. The variability and limited availability of detailed operational data can restrict the extent to which conclusions can be generalized across different real-world scenarios. This limitation is significant as data deficiencies may skew the perceived effectiveness of AI techniques in HVAC systems. Furthermore, the review extensively covers various AI methods applicable to HVAC energy management. However, the practical deployment of these techniques is often hindered by existing infrastructure and the technological readiness of specific regions or industries. This mismatch between theoretical potential and practical feasibility can significantly limit the immediate applicability of our findings. Additionally, the impact of AI-driven solutions on energy efficiency and system performance can vary markedly depending on building architecture and climatic conditions. The studies reviewed may need to adequately represent this diversity, potentially limiting the reliability of AI solutions across different building types. These factors are critical as they not only influence the outcomes of our study but also affect the scalability and practical implementation of AI-driven energy management strategies.
Figure 9 presents a comprehensive overview of the current landscape, challenges, and future prospects of integrating AI in HVAC systems. The current landscape emphasizes the dominant role of AI-driven control methods and maintenance techniques in optimizing system performance and energy efficiency. However, significant challenges, such as infrastructure compatibility, scalability issues, data privacy concerns, integration with legacy systems, and the lack of long-term effectiveness studies, create barriers to wider adoption. Despite these hurdles, we can envision a future landscape in which there is a transformative shift with advancements in IoT integration, adaptive algorithms, customization for regional climatic conditions, and zero-carbon energy management, highlighting AI’s potential to redefine HVAC operations sustainably and effectively.
This review identifies several potential sources of error that could impact the validity and applicability of the findings. One such source is algorithmic bias, where AI models, heavily reliant on historical data, may not adequately capture the diversity of operational scenarios, building types, or climatic conditions. This can lead to biased predictions and management recommendations, affecting the accuracy of AI-driven solutions for HVAC systems. Another risk involves model overfitting, where complex AI algorithms such as deep learning models might overfit specific datasets used in studies. This tendency can hinder the algorithms’ ability to generalize findings to other settings or adapt to evolving conditions due to climate change. Additionally, many studies utilize simulated data to train and validate AI algorithms. These simulations’ assumptions can introduce errors, especially if they fail to accurately mimic real-world HVAC system behaviors and interactions with building occupants. These potential errors could undermine the effectiveness of the recommendations derived from this analysis, possibly leading to higher-than-expected energy usage or diminished occupant comfort. Such discrepancies have significant implications for policymakers and the scientific community, particularly in terms of meeting climate change targets. Erroneous predictions and suboptimal recommendations could impede the deployment of effective AI-driven energy management systems, thereby delaying progress toward crucial sustainability goals.
Even with the advancements made by AI-based HVAC systems, there are various gaps in the research area that need to be addressed. Apart from machine learning and deep learning approaches, scalability and implementation challenges hold back the widespread use of AI-based HVAC systems. Various AI models perform well in simulations but lack implementation capability due to computational complexity, integration problems, and varying building conditions. Furthermore, most existing AI solutions are designed for specific building classes or climate zones, making it difficult to develop generic models that can be implemented in various HVAC systems.
Another important challenge is the explainability and interpretability of AI models. Deep learning approaches, particularly neural networks, act as “black-box” models, reducing trust in AI-based HVAC control. Explainable AI (XAI) approaches need to be explored in future studies in order to improve model transparency and user acceptance.
Another limitation is real-time adaptation, as most AI-based HVAC models utilize historical data rather than learning in real time from varying environmental conditions. Developing AI systems with real-time learning and adaptation would make them more efficient in uncertain environments.
In addition, integration with smart grids and renewable energy systems is yet to be fully investigated. AI systems must be able to coordinate HVAC control with energy demand-response planning and renewable energy supplies in order to optimize efficiency.
Finally, the lack of standardized, high-quality datasets for training AI models is a primary limitation. Most HVAC datasets contain missing, biased, or inconsistent information, limiting the reliability of AI-based predictions. In the future, more efforts should be dedicated to creating standardized, high-quality datasets for developing AI-driven HVAC control.
Future AI-driven HVAC systems should incorporate adaptive models for better energy efficiency. The selection of ML models should be guided by the specific application, balancing accuracy, computational cost, and real-time adaptability.

Study Significance

Rising energy needs and demands for efficiency and intelligent HVAC systems have motivated researchers to take up AI-powered systems. In the present work, a critical review of applications of AI in optimizing HVAC systems has been provided, with perspectives on energy efficiency, preventive maintenance, and adaptive control methods.
The usefulness of this study emanates from the following contributions:
  • Closing the theory and practice gap of AI in HVAC by categorizing AI techniques and determining their suitability in real situations.
  • Identifying the major challenges in AI-based HVAC implementation, including data availability, model interpretability, and integration with existing building management systems.
  • Highlighting the strengths of machine learning (ML) and deep learning (DL) models in improving HVAC performance, reducing operating costs, and improving occupant comfort.
  • Providing future research opportunities by emphasizing the significance of hybrid AI models, IoT-based smart HVAC systems, and more transparent AI-driven decision-making.
With the integration of the latest advances in AI for HVAC, this research is a valuable reference work for researchers and industry experts, guiding future developments in smart and sustainable building control.

6. Conclusions

This paper critically assesses the current literature on the use of artificial intelligence (AI) in the improvement of the energy efficiency of HVAC systems. The conclusions indicate that AI provides an opportunity to decrease energy usage and costs and, at the same time, improve the thermal comfort of the occupants. In particular, the integration of the machine learning and deep learning approaches has been identified as being capable of cutting energy consumption by as much as 40%, which presents a strong solution for energy management in buildings. The scientometric analysis reflects the increasing number of studies that concentrate on the application of AI to HVAC systems; it also indicates a focus on real-world usability. Nevertheless, our research also points to a major drawback in the form of the lack of research on long-term effectiveness and scenarios in various climatic conditions, which are recommended for future research.
This paper thus concludes that, while AI has the potential to revolutionize the HVAC industry, there are still issues that need to be addressed, such as standardization, data privacy, and integration with the current infrastructure. For policymakers and industry leaders, these findings call for the development of legal and regulatory frameworks that will encourage the integration of AI technologies in the right manner and in a way that will facilitate the achievement of sustainable development goals and net-zero targets. In addition, the criticism in this article does more than amplify the importance of AI developments. Rather, it examines the real effects of these advancements and paves the way for future research that should concentrate on the implementation issues and costs of AI-based energy systems. By addressing these aspects, future research should aim to continue the exploration of AI capabilities and ensure these technologies are accessible, efficient, and effective across various regions and building types, thereby contributing to global efforts in energy sustainability.
The key findings are as follows:
  • HVAC efficiency is improved significantly by the use of predictive control, supervision, and automated tuning thanks to the use of machine learning models.
  • Some of the machine learning models skilled in fault diagnosis, predictive maintenance, and energy consumption shifting forecasting are artificial neural networks, decision trees, and reinforcement learning techniques.
  • In comparison to other methods, deep reinforcement learning is more effective in the real-time controlling and regulating of HVAC systems with simultaneous adjustments in the environment and can lower the cost of operations.
  • Even with the advanced technologies, data quality and the interpretability of the models in the context of integration of all system components is still a challenge to the dominance of AI in HVAC systems.
  • Future research should focus on hybrid AI approaches, IoT integration, and explainable AI to enhance the practical application of AI-driven HVAC solutions.

Author Contributions

Conceptualization, A.H.M.R. and S.A.A.; Methodology, A.H.M.R. and S.A.A.; Software, A.H.M.R.; Validation, S.A.A. and M.T.; Formal analysis, S.A.A., A.H.M.R. and M.T.; Writing—original draft, A.H.M.R. and S.A.A.; Writing—Review and editing, M.K. and M.R.; Supervision and guidance throughout the project, M.K. and M.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
HVACHeating, Ventilation, and Air Conditioning
SLRsystematic literature review
BEMbuilding energy management
DRLdeep reinforcement learning
ANNartificial neural network
RFRandom Forest
SVMSupport Vector Machine
IoTInternet of Things
FDDfault detection and diagnosis
MPCmodel predictive control
CNNconvolutional neural network
LSTMlong short-term memory
RNNrecurrent neural network
GANgenerative adversarial network
WoSWeb of Science
XGBextreme gradient boosting
PCAPrincipal Component Analysis
DisBNDiscrete Bayesian Network
DQNdeep Q-Network
DDPGDeep Deterministic Policy Gradient
XAIExplainable Artificial Intelligence
GRUGated Recurrent Unit
MLPMulti-Layer Perceptron

References

  1. Neri, E.; Coppola, F.; Miele, V.; Bibbolino, C.; Grassi, R. Artificial Intelligence: Who Is Responsible for the Diagnosis? Radiol. Med. 2020, 125, 517–521. [Google Scholar] [CrossRef]
  2. Apanaviciene, R.; Vanagas, A.; Fokaides, P.A. Smart Building Integration into a Smart City (SBISC): Development of a New Evaluation Framework. Energies 2020, 13, 2190. [Google Scholar] [CrossRef]
  3. Lee, S.; Choi, D.-H. Energy Management of Smart Home with Home Appliances, Energy Storage System and Electric Vehicle: A Hierarchical Deep Reinforcement Learning Approach. Sensors 2020, 20, 2157. [Google Scholar] [CrossRef]
  4. Yousaf, S.; Bradshaw, C.R.; Kamalapurkar, R.; San, O. Investigating Critical Model Input Features for Unitary Air Conditioning Equipment. Energy Build. 2023, 284, 112823. [Google Scholar] [CrossRef]
  5. Peng, Y.; Lei, Y.; Tekler, Z.D.; Antanuri, N.; Lau, S.-K.; Chong, A. Hybrid System Controls of Natural Ventilation and HVAC in Mixed-Mode Buildings: A Comprehensive Review. Energy Build. 2022, 276, 112509. [Google Scholar] [CrossRef]
  6. Alanne, K.; Sierla, S. An Overview of Machine Learning Applications for Smart Buildings. Sustain. Cities Soc. 2022, 76, 103445. [Google Scholar] [CrossRef]
  7. Sierla, S.; Ihasalo, H.; Vyatkin, V. A Review of Reinforcement Learning Applications to Control of Heating, Ventilation and Air Conditioning Systems. Energies 2022, 15, 3526. [Google Scholar] [CrossRef]
  8. Tien, P.W.; Wei, S.; Darkwa, J.; Wood, C.; Calautit, J.K. Machine Learning and Deep Learning Methods for Enhancing Building Energy Efficiency and Indoor Environmental Quality—A Review. Energy AI 2022, 10, 100198. [Google Scholar] [CrossRef]
  9. Nelson, W.; Culp, C. Machine Learning Methods for Automated Fault Detection and Diagnostics in Building Systems—A Review. Energies 2022, 15, 5534. [Google Scholar] [CrossRef]
  10. Halhoul Merabet, G.; Essaaidi, M.; Ben Haddou, M.; Qolomany, B.; Qadir, J.; Anan, M.; Al-Fuqaha, A.; Abid, M.R.; Benhaddou, D. Intelligent Building Control Systems for Thermal Comfort and Energy-Efficiency: A Systematic Review of Artificial Intelligence-Assisted Techniques. Renew. Sustain. Energy Rev. 2021, 144, 110969. [Google Scholar] [CrossRef]
  11. Miao, Y.; Yao, Y.; Hong, X.; Xiong, L.; Zhang, F.; Chen, W. Research on Optimal Control of HVAC System Using Swarm Intelligence Algorithms. Build. Environ. 2023, 241, 110467. [Google Scholar] [CrossRef]
  12. Bouabdallaoui, Y.; Lafhaj, Z.; Yim, P.; Ducoulombier, L.; Bennadji, B. Predictive Maintenance in Building Facilities: A Machine Learning-Based Approach. Sensors 2021, 21, 1044. [Google Scholar] [CrossRef]
  13. Xiong, L.; Yao, Y. Study on an Adaptive Thermal Comfort Model with K-Nearest-Neighbors (KNN) Algorithm. Build. Environ. 2021, 202, 108026. [Google Scholar] [CrossRef]
  14. Touzani, S.; Granderson, J.; Fernandes, S. Gradient Boosting Machine for Modeling the Energy Consumption of Commercial Buildings. Energy Build. 2018, 158, 1533–1543. [Google Scholar] [CrossRef]
  15. Peng, Y.; Rysanek, A.; Nagy, Z.; Schlüter, A. Using Machine Learning Techniques for Occupancy-Prediction-Based Cooling Control in Office Buildings. Appl. Energy 2018, 211, 1343–1358. [Google Scholar] [CrossRef]
  16. Zhang, Z.; Chong, A.; Pan, Y.; Zhang, C.; Lam, K.P. Whole Building Energy Model for HVAC Optimal Control: A Practical Framework Based on Deep Reinforcement Learning. Energy Build. 2019, 199, 472–490. [Google Scholar] [CrossRef]
  17. Yu, L.; Xie, W.; Xie, D.; Zou, Y.; Zhang, D.; Sun, Z.; Zhang, L.; Zhang, Y.; Jiang, T. Deep Reinforcement Learning for Smart Home Energy Management. IEEE Internet Things J. 2020, 7, 2751–2762. [Google Scholar] [CrossRef]
  18. Deng, H.; Fannon, D.; Eckelman, M.J. Predictive Modeling for US Commercial Building Energy Use: A Comparison of Existing Statistical and Machine Learning Algorithms Using CBECS Microdata. Energy Build. 2018, 163, 34–43. [Google Scholar] [CrossRef]
  19. Yan, K.; Chong, A.; Mo, Y. Generative Adversarial Network for Fault Detection Diagnosis of Chillers. Build. Environ. 2020, 172, 106698. [Google Scholar] [CrossRef]
  20. Yu, L.; Sun, Y.; Xu, Z.; Shen, C.; Yue, D.; Jiang, T.; Guan, X. Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings. IEEE Trans. Smart Grid 2021, 12, 407–419. [Google Scholar] [CrossRef]
  21. Brandi, S.; Piscitelli, M.S.; Martellacci, M.; Capozzoli, A. Deep Reinforcement Learning to Optimise Indoor Temperature Control and Heating Energy Consumption in Buildings. Energy Build. 2020, 224, 110225. [Google Scholar] [CrossRef]
  22. Du, Y.; Zandi, H.; Kotevska, O.; Kurte, K.; Munk, J.; Amasyali, K.; Mckee, E.; Li, F. Intelligent Multi-Zone Residential HVAC Control Strategy Based on Deep Reinforcement Learning. Appl. Energy 2021, 281, 116117. [Google Scholar] [CrossRef]
  23. Dai, X.; Liu, J.; Zhang, X. A Review of Studies Applying Machine Learning Models to Predict Occupancy and Window-Opening Behaviours in Smart Buildings. Energy Build. 2020, 223, 110159. [Google Scholar] [CrossRef]
  24. Chen, B.; Cai, Z.; Bergés, M. Gnu-RL: A Precocial Reinforcement Learning Solution for Building HVAC Control Using a Differentiable MPC Policy. In Proceedings of the BuildSys 2019—Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, New York, NY, USA, 13–14 November 2019; Association for Computing Machinery, Inc.: New York, NY, USA, 2019; pp. 316–325. [Google Scholar]
  25. Gao, G.; Li, J.; Wen, Y. DeepComfort: Energy-Efficient Thermal Comfort Control in Buildings Via Reinforcement Learning. IEEE Internet Things J. 2020, 7, 8472–8484. [Google Scholar] [CrossRef]
  26. Zou, Z.; Yu, X.; Ergan, S. Towards Optimal Control of Air Handling Units Using Deep Reinforcement Learning and Recurrent Neural Network. Build. Environ. 2020, 168, 106535. [Google Scholar] [CrossRef]
  27. Ding, X.; Du, W.; Cerpa, A. OCTOPUS: Deep Reinforcement Learning for Holistic Smart Building Control. In Proceedings of the BuildSys 2019—Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, New York, NY, USA, 13–14 November 2019; Association for Computing Machinery, Inc.: New York, NY, USA, 2019; pp. 326–335. [Google Scholar]
  28. Ding, Y.; Zhang, Q.; Yuan, T.; Yang, K. Model Input Selection for Building Heating Load Prediction: A Case Study for an Office Building in Tianjin. Energy Build. 2018, 159, 254–270. [Google Scholar] [CrossRef]
  29. Huchuk, B.; Sanner, S.; O’Brien, W. Comparison of Machine Learning Models for Occupancy Prediction in Residential Buildings Using Connected Thermostat Data. Build. Environ. 2019, 160, 106177. [Google Scholar] [CrossRef]
  30. Zhang, C.; Kuppannagari, S.R.; Kannan, R.; Prasanna, V.K. Building HVAC Scheduling Using Reinforcement Learning via Neural Network Based Model Approximation. In Proceedings of the BuildSys 2019—Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, New York, NY, USA, 13–14 November 2019; Association for Computing Machinery, Inc.: New York, NY, USA, 2019; pp. 287–296. [Google Scholar]
  31. Esrafilian-Najafabadi, M.; Haghighat, F. Occupancy-Based HVAC Control Systems in Buildings: A State-of-the-Art Review. Build. Environ. 2021, 197, 107810. [Google Scholar] [CrossRef]
  32. Lee, K.-P.; Wu, B.-H.; Peng, S.-L. Deep-Learning-Based Fault Detection and Diagnosis of Air-Handling Units. Build. Environ. 2019, 157, 24–33. [Google Scholar] [CrossRef]
  33. Liu, T.; Xu, C.; Guo, Y.; Chen, H. A Novel Deep Reinforcement Learning Based Methodology for Short-Term HVAC System Energy Consumption Prediction. Int. J. Refrig. 2019, 107, 39–51. [Google Scholar] [CrossRef]
  34. Zhang, Z.; Lam, K.P. Practical Implementation and Evaluation of Deep Reinforcement Learning Control for a Radiant Heating System. In Proceedings of the BuildSys 2018—Proceedings of the 5th Conference on Systems for Built Environments, Shenzen, China, 7–8 November 2018; Association for Computing Machinery, Inc.: New York, NY, USA, 2018; pp. 148–157. [Google Scholar]
  35. Taheri, S.; Razban, A. Learning-Based CO2 Concentration Prediction: Application to Indoor Air Quality Control Using Demand-Controlled Ventilation. Build. Environ. 2021, 205, 108164. [Google Scholar] [CrossRef]
  36. Carreira, P.; Costa, A.A.; Mansur, V.; Arsénio, A. Can HVAC Really Learn from Users? A Simulation-Based Study on the Effectiveness of Voting for Comfort and Energy Use Optimization. Sustain. Cities Soc. 2018, 41, 275–285. [Google Scholar] [CrossRef]
  37. Ahn, K.U.; Park, C.S. Application of Deep Q-Networks for Model-Free Optimal Control Balancing between Different HVAC Systems. Sci. Technol. Built Environ. 2020, 26, 61–74. [Google Scholar] [CrossRef]
  38. Javed, A.; Larijani, H.; Wixted, A. Improving Energy Consumption of a Commercial Building with IoT and Machine Learning. IT Prof. 2018, 20, 30–38. [Google Scholar] [CrossRef]
  39. Zhang, Z.; Chong, A.; Pan, Y.; Zhang, C.; Lu, S.; Lam, K.P. A Deep Reinforcement Learning Approach to Using Whole Building Energy Model for HVAC Optimal Control. In Proceedings of the ASHRAE and IBPSA-USA Building Simulation Conference; American Society of Heating, Refrigerating and Air-Conditioning Engineers (ASHRAE), Chicago, IL, USA, 26–28 September 2018; pp. 675–682. [Google Scholar]
  40. Cai, W.; Wen, X.; Li, C.; Shao, J.; Xu, J. Predicting the Energy Consumption in Buildings Using the Optimized Support Vector Regression Model. Energy 2023, 273, 127188. [Google Scholar] [CrossRef]
  41. Qin, H.; Yu, Z.; Li, T.; Liu, X.; Li, L. Heating Control Strategy Based on Dynamic Programming for Building Energy Saving and Emission Reduction. Int. J. Environ. Res. Public Health 2022, 19, 14137. [Google Scholar] [CrossRef]
  42. Esrafilian-Najafabadi, M.; Haghighat, F. Impact of Occupancy Prediction Models on Building HVAC Control System Performance: Application of Machine Learning Techniques. Energy Build. 2022, 257, 111808. [Google Scholar] [CrossRef]
  43. Behravan, A.; Abboush, M.; Obermaisser, R. Deep Learning Application in Mechatronics Systems’ Fault Diagnosis, a Case Study of the Demand-Controlled Ventilation and Heating System. In Proceedings of the 2019 Advances in Science and Engineering Technology International Conferences, ASET 2019, Dubai, United Arab Emirates, 26 March–10 April 2019; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2019. [Google Scholar]
  44. Sanzana, M.R.; Maul, T.; Wong, J.Y.; Abdulrazic, M.O.M.; Yip, C.-C. Application of Deep Learning in Facility Management and Maintenance for Heating, Ventilation, and Air Conditioning. Autom. Constr. 2022, 141, 104445. [Google Scholar] [CrossRef]
  45. Meng, Q.; Xi, Y.; Ren, X.; Li, H.; Jiang, L.; Yang, L. Thermal Energy Storage Air-Conditioning Demand Response Control Using Elman Neural Network Prediction Model. Sustain. Cities Soc. 2022, 76, 103480. [Google Scholar] [CrossRef]
  46. Sankaranarayanan, C.; Shaju, S.; Sukhwani, M. Actor-Critic Based Adaptive Control Strategy for Effective Energy Management. In Proceedings of the Proceedings of the 2022 5th International Conference on Advanced Systems and Emergent Technologies, IC_ASET 2022, Hammamet, Tunisia, 22–25 March 2022; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2022; pp. 23–28. [Google Scholar]
  47. Scarcello, L.; Cicirelli, F.; Guerrieri, A.; Mastroianni, C.; Spezzano, G.; Vinci, A. Pursuing Energy Saving and Thermal Comfort With a Human-Driven DRL Approach. IEEE Trans. Hum. Mach. Syst. 2022, 53, 707–719. [Google Scholar] [CrossRef]
  48. Sanzana, M.R.; Abdulrazic, M.O.M.; Wong, J.Y.; Maul, T.; Yip, C.-C. Effects of External Weather on the Water Consumption of Thermal-Energy-Storage Air-Conditioning System. Energy Nexus 2023, 10, 100187. [Google Scholar] [CrossRef]
  49. Isikdemir, Y.E.; Erturk, G.; Ates, H.; Tas, M.O. Fuzzy Inference and Machine Learning Based HVAC Control System for Smart Buildings. In Proceedings of the IEEE Global Energy Conference, GEC 2022, Batman, Turkey, 26–29 October 2022; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2022; pp. 116–119. [Google Scholar]
  50. Alden, R.E.; Gong, H.; Jones, E.S.; Ababei, C.; Ionel, D.M. Artificial Intelligence Method for the Forecast and Separation of Total and HVAC Loads with Application to Energy Management of Smart and NZE Homes. IEEE Access 2021, 9, 160497–160509. [Google Scholar] [CrossRef]
  51. Xu, Y.; Gao, W.; Qian, F.; Li, Y. Potential Analysis of the Attention-Based LSTM Model in Ultra-Short-Term Forecasting of Building HVAC Energy Consumption. Front. Energy Res. 2021, 9, 730640. [Google Scholar] [CrossRef]
  52. Fan, C.; He, W.; Liao, L. Real-Time Machine Learning-Based Recognition of Human Thermal Comfort-Related Activities Using Inertial Measurement Unit Data. Energy Build. 2023, 294, 113216. [Google Scholar] [CrossRef]
  53. Naseem, T.; Javed, A.; Hamayun, M.T.; Jawad, M.; Ansari, E.A.; Fayyaz, M.A.B.; Ansari, A.R.; Nawaz, R. Design of an EnergyPlus Model-Based Smart Controller for Maintaining Thermal Comfortable Environment in Non-Domestic Building. IEEE Access 2023, 11, 33134–33147. [Google Scholar] [CrossRef]
  54. Yang, S.; Wan, M.P. Machine-Learning-Based Model Predictive Control with Instantaneous Linearization—A Case Study on an Air-Conditioning and Mechanical Ventilation System. Appl. Energy 2022, 306, 118041. [Google Scholar] [CrossRef]
  55. Xue, W.; Wang, H.; Li, K. PMV Inverse Model-Based Indoor Thermal Environment Control for Thermal Comfort and Energy Saving. In Proceedings of the Chinese Control Conference, CCC, Hefei, China, 25–27 July 2022; IEEE Computer Society: Washington, DC, USA, 2022; pp. 5294–5299. [Google Scholar]
  56. Frassanito, R.; Buso, T.; Aumann, S.; Toniolo, J.; Albrici, P.; Canevari, P.; Iemmi, M.; Mapelli, F. How IoT and Artificial Intelligence Can Improve Energy Efficiency in Hospitals—A North Italian Case Study. Proc. E3S Web Conf. 2022, 343, 02001. [Google Scholar] [CrossRef]
  57. Mahdi, M.N.; Bakare, T.A.; Ahmad, A.R.; Buhari, A.M.; Mohamed, K.S. Scalable Smartification of Commercial Buildings HVAC Systems Using the Internet of Things and Machine Learning. In Proceedings of the International Conference on Emerging Technologies and Intelligent Systems, Al Buraimi, Oman, 25–26 June 2021; Springer Science and Business Media Deutschland GmbH: Berlin/Heidelberg, Germany, 2022; Volume 322, pp. 165–174. [Google Scholar]
  58. Du, Y.; Li, F.; Kurte, K.; Munk, J.; Zandi, H. Demonstration of Intelligent HVAC Load Management with Deep Reinforcement Learning: Real-World Experience of Machine Learning in Demand Control. IEEE Power Energy Mag. 2022, 20, 42–53. [Google Scholar] [CrossRef]
  59. Aruta, G.; Ascione, F.; Bianco, N.; De Masi, R.F.; Mauro, G.M.; Vanoli, G.P. Model Predictive Control Based on Genetic Algorithm and Neural Networks to Optimize Heating Operation of a Real Low-Energy Building. In Proceedings of the 2022 7th International Conference on Smart and Sustainable Technologies, SpliTech 2022, Split, Croatia, 5–8 July 2022; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2022. [Google Scholar]
  60. Lin, X.; Guo, Q.; Yuan, D.; Gao, M. Bayesian Optimization Framework for HVAC System Control. Buildings 2023, 13, 314. [Google Scholar] [CrossRef]
  61. Deng, Z.; Wang, X.; Jiang, Z.; Zhou, N.; Ge, H.; Dong, B. Evaluation of Deploying Data-Driven Predictive Controls in Buildings on a Large Scale for Greenhouse Gas Emission Reduction. Energy 2023, 270, 126934. [Google Scholar] [CrossRef]
  62. Mohseni, S.-R.; Zeitouni, M.J.; Parvaresh, A.; Abrazeh, S.; Gheisarnejad, M.; Khooban, M.-H. FMI Real-Time Co-Simulation-Based Machine Deep Learning Control of HVAC Systems in Smart Buildings: Digital-Twins Technology. Trans. Inst. Meas. Control 2023, 45, 661–673. [Google Scholar] [CrossRef]
  63. Andrés, E.; Cuéllar, M.P.; Navarro, G. On the Use of Quantum Reinforcement Learning in Energy-Efficiency Scenarios. Energies 2022, 15, 6034. [Google Scholar] [CrossRef]
  64. Weinberg, D.; Wang, Q.; Timoudas, T.O.; Fischione, C. A Review of Reinforcement Learning for Controlling Building Energy Systems From a Computer Science Perspective. Sustain. Cities Soc. 2023, 89, 104351. [Google Scholar] [CrossRef]
  65. Gehbauer, C.; Rippl, A.; Lee, E.S. Advanced Control of Dynamic Facades and HVAC with Reinforcement Learning Based on Standardized Co-Simulation. In Proceedings of the Building Simulation 2021: 17th Conference of IBPSA, Bruges, Belgium, 1–3 September 2021; International Building Performance Simulation Association: Toronto, ON, Canada, 2022; pp. 231–238. [Google Scholar]
  66. Lavanya, R.; Murukesh, C.; Shanker, N.R. Development of Machine Learning Based Microclimatic HVAC System Controller for Nano Painted Rooms Using Human Skin Temperature. J. Electr. Eng. Technol. 2023, 18, 2343–2354. [Google Scholar] [CrossRef]
  67. Deng, X.; Zhang, Y.; Qi, H. Towards Optimal HVAC Control in Non-Stationary Building Environments Combining Active Change Detection and Deep Reinforcement Learning. Build. Environ. 2022, 211, 108680. [Google Scholar] [CrossRef]
  68. Abida, A.; Richter, P. HVAC Control in Buildings Using Neural Network. J. Build. Eng. 2023, 65, 105558. [Google Scholar] [CrossRef]
  69. Elnour, M.; Himeur, Y.; Fadli, F.; Mohammedsherif, H.; Meskin, N.; Ahmad, A.M.; Petri, I.; Rezgui, Y.; Hodorog, A. Neural Network-Based Model Predictive Control System for Optimizing Building Automation and Management Systems of Sports Facilities. Appl. Energy 2022, 318, 119153. [Google Scholar] [CrossRef]
  70. Liu, X.; Ren, M.; Yang, Z.; Yan, G.; Guo, Y.; Cheng, L.; Wu, C. A Multi-Step Predictive Deep Reinforcement Learning Algorithm for HVAC Control Systems in Smart Buildings. Energy 2022, 259, 124857. [Google Scholar] [CrossRef]
  71. Darwazeh, D.; Gunay, B.; Duquette, J. Development of Inverse Greybox Model-Based Virtual Meters for Air Handling Units. IEEE Trans. Autom. Sci. Eng. 2021, 18, 323–336. [Google Scholar] [CrossRef]
  72. Terzi, E.; Fagiano, L.; Farina, M.; Scattolini, R. Structured Modelling from Data and Optimal Control of the Cooling System of a Large Business Center. J. Build. Eng. 2020, 28, 101043. [Google Scholar] [CrossRef]
  73. Murade, G.B.; Soni, B.; Mukherjee, A. HVAC Hybrid Control Methods for HEE in Buildings: Overview. In Proceedings of the 2021 7th IEEE International Conference on Advances in Computing, Communication and Control, ICAC3 2021, Mumbai, India, 3–4 December 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021. [Google Scholar]
  74. Faddel, S.; Tian, G.; Zhou, Q.; Aburub, H. On the Performance of Data-Driven Reinforcement Learning for Commercial HVAC Control. In Proceedings of the 2020 IEEE Industry Applications Society Annual Meeting, IAS 2020, Detroit, MI, USA, 10–16 October 2020; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2020. [Google Scholar]
  75. Mawson, V.J.; Hughes, B.R. Coupling Simulation with Artificial Neural Networks for the Optimisation of HVAC Controls in Manufacturing Environments. Optim. Eng. 2021, 22, 103–119. [Google Scholar] [CrossRef]
  76. Talei, H.; Benhaddou, D.; Gamarra, C.; Benbrahim, H.; Essaaidi, M. Smart Building Energy Inefficiencies Detection through Time Series Analysis and Unsupervised Machine Learning. Energies 2021, 14, 6042. [Google Scholar] [CrossRef]
  77. Gao, Y.; Li, S.; Fu, X.; Dong, W.; Lu, B.; Li, Z. Energy Management and Demand Response with Intelligent Learning for Multi-Thermal-Zone Buildings. Energy 2020, 210, 118411. [Google Scholar] [CrossRef]
  78. Gan, V.J.L.; Luo, H.; Tan, Y.; Deng, M.; Kwok, H.L. Bim and Data-Driven Predictive Analysis of Optimum Thermal Comfort for Indoor Environment. Sensors 2021, 21, 4401. [Google Scholar] [CrossRef]
  79. Gonçalves, D.; Sheikhnejad, Y.; Oliveira, M.; Martins, N. One Step Forward toward Smart City Utopia: Smart Building Energy Management Based on Adaptive Surrogate Modelling. Energy Build. 2020, 223, 110146. [Google Scholar] [CrossRef]
  80. Lissa, P.; Schukat, M.; Barrett, E. Transfer Learning Applied to Reinforcement Learning-Based HVAC Control. SN Comput. Sci. 2020, 1, 127. [Google Scholar] [CrossRef]
  81. Biswas, D. Reinforcement Learning Based HVAC Optimization in Factories. In Proceedings of the e-Energy 2020—Proceedings of the 11th ACM International Conference on Future Energy Systems, Online, 22–26 June 2020; Association for Computing Machinery, Inc.: New York, NY, USA, 2020; pp. 428–433. [Google Scholar]
  82. Tien, P.W.; Wei, S.; Liu, T.; Calautit, J.; Darkwa, J.; Wood, C. A Deep Learning Approach towards the Detection and Recognition of Opening of Windows for Effective Management of Building Ventilation Heat Losses and Reducing Space Heating Demand. Renew. Energy 2021, 177, 603–625. [Google Scholar] [CrossRef]
  83. Demirezen, G.; Fung, A.S.; Deprez, M. Development and Optimization of Artificial Neural Network Algorithms for the Prediction of Building Specific Local Temperature for HVAC Control. Int. J. Energy Res. 2020, 44, 8513–8531. [Google Scholar] [CrossRef]
  84. Jang, Y.-E.; Kim, Y.-J.; Catalao, J.P.S. Optimal HVAC System Operation Using Online Learning of Interconnected Neural Networks. IEEE Trans. Smart Grid 2021, 12, 3030–3042. [Google Scholar] [CrossRef]
  85. Sheikhnejad, Y.; Gonçalves, D.; Oliveira, M.; Martins, N. Can Buildings Be More Intelligent than Users? The Role of Intelligent Supervision Concept Integrated into Building Predictive Control. In Proceedings of the 6th International Conference on Energy and Environment Research, ICEER 2019, Aveiro, Portugal, 22–25 July 2019; Elsevier Ltd.: Amsterdam, The Netherlands, 2020; Volume 6, pp. 409–416. [Google Scholar]
  86. Park, J.; Choi, H.; Kim, D.; Kim, T. Development of Novel PMV-Based HVAC Control Strategies Using a Mean Radiant Temperature Prediction Model by Machine Learning in Kuwaiti Climate. Build. Environ. 2021, 206, 108357. [Google Scholar] [CrossRef]
  87. Aguilar, J.; Garces-Jimenez, A.; Gomez-Pulido, J.M.; Moreno, M.D.R.; De Mesa, J.A.G.; Gallego-Salvador, N. Autonomic Management of a Building’s Multi-HVAC System Start-Up. IEEE Access 2021, 9, 70502–70515. [Google Scholar] [CrossRef]
  88. Eiras-Franco, C.; Flores, M.; Bolón-Canedo, V.; Zaragoza, S.; Fernández-Casal, R.; Naya, S.; Tarrío-Saavedra, J. Case Study of Anomaly Detection and Quality Control of Energy Efficiency and Hygrothermal Comfort in Buildings. In Proceedings of the DATA 2019—Proceedings of the 8th International Conference on Data Science, Technology and Applications, Prague, Czech Republic, 26–28 July 2019; SciTePress: Setúbal, Portugal, 2019; pp. 145–151. [Google Scholar]
  89. Pertzborn, A. Using Distributed Agents to Optimize Thermal Energy Storage. J. Energy Storage 2019, 23, 89–97. [Google Scholar] [CrossRef]
  90. Gupta, A.; Badr, Y.; Negahban, A.; Qiu, R.G. Energy-Efficient Heating Control for Smart Buildings with Deep Reinforcement Learning. J. Build. Eng. 2021, 34, 101739. [Google Scholar] [CrossRef]
  91. Ding, X.; Du, W.; Cerpa, A.E. MB2C: Model-Based Deep Reinforcement Learning for Multi-Zone Building Control. In Proceedings of the BuildSys 2020—Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, Online, 18–20 November 2020; Association for Computing Machinery, Inc.: New York, NY, USA, 2020; pp. 50–59. [Google Scholar]
  92. Chen, Y.; Shi, Y.; Zhang, B. Optimal Control via Neural Networks: A Convex Approach. In Proceedings of the 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, 6–9 May 2019; International Conference on Learning Representations, ICLR: Appleton, WI, USA, 2019. [Google Scholar]
  93. Jiang, Z.; Risbeck, M.J.; Ramamurti, V.; Murugesan, S.; Amores, J.; Zhang, C.; Lee, Y.M.; Drees, K.H. Building HVAC Control with Reinforcement Learning for Reduction of Energy Cost and Demand Charge. Energy Build. 2021, 239, 110833. [Google Scholar] [CrossRef]
  94. Nagarathinam, S.; Menon, V.; Vasan, A.; Sivasubramaniam, A. MARCO—Multi-Agent Reinforcement Learning Based COntrol of Building HVAC Systems. In Proceedings of the e-Energy 2020—Proceedings of the 11th ACM International Conference on Future Energy Systems, Online, 22–26 June 2020; Association for Computing Machinery, Inc.: New York, NY, USA, 2020; pp. 57–67. [Google Scholar]
  95. Xu, S.; Wang, Y.; Wang, Y.; O’Neill, Z.; Zhu, Q. One for Many: Transfer Learning for Building HVAC Control. In Proceedings of the BuildSys 2020—Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, Online, 22–26 June 2020; Association for Computing Machinery, Inc.: New York, NY, USA, 2020; pp. 230–239. [Google Scholar]
  96. Liu, B.; Akcakaya, M.; McDermott, T.E. Automated Control of Transactive HVACs in Energy Distribution Systems. IEEE Trans. Smart Grid 2021, 12, 2462–2471. [Google Scholar] [CrossRef]
  97. Wei, T.; Ren, S.; Zhu, Q. Deep Reinforcement Learning for Joint Datacenter and HVAC Load Control in Distributed Mixed-Use Buildings. IEEE Trans. Sustain. Comput. 2021, 6, 370–384. [Google Scholar] [CrossRef]
  98. Coraci, D.; Brandi, S.; Piscitelli, M.S.; Capozzoli, A. Online Implementation of a Soft Actor-Critic Agent to Enhance Indoor Temperature Control and Energy Efficiency in Buildings. Energies 2021, 14, 997. [Google Scholar] [CrossRef]
  99. Kurte, K.; Munk, J.; Kotevska, O.; Amasyali, K.; Smith, R.; McKee, E.; Du, Y.; Cui, B.; Kuruganti, T.; Zandi, H. Evaluating the Adaptability of Reinforcement Learning Based HVAC Control for Residential Houses. Sustainability 2020, 12, 7727. [Google Scholar] [CrossRef]
  100. Zhao, H.; Zhao, J.; Shu, T.; Pan, Z. Hybrid-Model-Based Deep Reinforcement Learning for Heating, Ventilation, and Air-Conditioning Control. Front. Energy Res. 2021, 8, 610518. [Google Scholar] [CrossRef]
  101. Brandi, S.; Fiorentini, M.; Capozzoli, A. Comparison of Online and Offline Deep Reinforcement Learning with Model Predictive Control for Thermal Energy Management. Autom. Constr. 2022, 135, 104128. [Google Scholar] [CrossRef]
  102. Ala’raj, M.; Radi, M.; Abbod, M.F.; Majdalawieh, M.; Parodi, M. Data-Driven Based HVAC Optimisation Approaches: A Systematic Literature Review. J. Build. Eng. 2022, 46, 103678. [Google Scholar] [CrossRef]
  103. Homod, R.Z.; Togun, H.; Kadhim Hussein, A.; Noraldeen Al-Mousawi, F.; Yaseen, Z.M.; Al-Kouz, W.; Abd, H.J.; Alawi, O.A.; Goodarzi, M.; Hussein, O.A. Dynamics Analysis of a Novel Hybrid Deep Clustering for Unsupervised Learning by Reinforcement of Multi-Agent to Energy Saving in Intelligent Buildings. Appl. Energy 2022, 313, 118863. [Google Scholar] [CrossRef]
  104. Wei, T.; Chen, X.; Li, X.; Zhu, Q. Model-Based and Data-Driven Approaches for Building Automation and Control. In Proceedings of the IEEE/ACM International Conference on Computer-Aided Design, Digest of Technical Papers, ICCAD, San Diego, CA, USA, 5–8 November 2018; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2018. [Google Scholar]
  105. Chen, Y.; Zheng, Y.; Samuelson, H. Fast Adaptation of Thermal Dynamics Model for Predictive Control of HVAC and Natural Ventilation Using Transfer Learning with Deep Neural Networks. In Proceedings of the Proceedings of the American Control Conference, Denver, CO, USA, 1–3 July 2020; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2020; pp. 2345–2350. [Google Scholar]
  106. Park, S.; Park, S.; Choi, M.-I.; Lee, S.; Lee, T.; Kim, S.; Cho, K.; Park, S. Reinforcement Learning-Based Bems Architecture for Energy Usage Optimization. Sensors 2020, 20, 4918. [Google Scholar] [CrossRef]
  107. Pathak, N.; Lachut, D.; Roy, N.; Banerjee, N.; Robucci, R. Non-Intrusive Air Leakage Detection in Residential Homes. In Proceedings of the ICDCN ‘18, 19th International Conference on Distributed Computing and Networking, Varanasi, India, 4–7 January 2018; Association for Computing Machinery: New York, NY, USA, 2018. [Google Scholar]
  108. Mosaico, G.; Saviozzi, M.; Silvestro, F.; Bagnasco, A.; Vinci, A. Simplified State Space Building Energy Model and Transfer Learning Based Occupancy Estimation for HVAC Optimal Control. In Proceedings of the 5th International Forum on Research and Technologies for Society and Industry: Innovation to Shape the Future, RTSI 2019—Proceedings, Florence, Italy, 9–12 September 2019; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2019; pp. 353–358. [Google Scholar]
  109. He, T.; Jazizadeh, F.; Arpan, L. AI-Powered Virtual Assistants Nudging Occupants for Energy Saving: Proactive Smart Speakers for HVAC Control. Build. Res. Inf. 2022, 50, 394–409. [Google Scholar] [CrossRef]
  110. Wei, S.; Tien, P.W.; Chow, T.W.; Wu, Y.; Calautit, J.K. Deep Learning and Computer Vision Based Occupancy CO2 Level Prediction for Demand-Controlled Ventilation (DCV). J. Build. Eng. 2022, 56, 104715. [Google Scholar] [CrossRef]
  111. Fang, X.; Gong, G.; Li, G.; Chun, L.; Peng, P.; Li, W.; Shi, X.; Chen, X. Deep Reinforcement Learning Optimal Control Strategy for Temperature Setpoint Real-Time Reset in Multi-Zone Building HVAC System. Appl. Therm. Eng. 2022, 212, 118552. [Google Scholar] [CrossRef]
  112. Zhang, T.; Baasch, G.; Ardakanian, O.; Evins, R. On the Joint Control of Multiple Building Systems with Reinforcement Learning. In Proceedings of the e-Energy 2021—Proceedings of the 2021 12th ACM International Conference on Future Energy Systems, Online, 28 June–2 July 2021; Association for Computing Machinery, Inc: New York, NY, USA, 2021; pp. 60–72. [Google Scholar]
  113. Fu, Q.; Chen, X.; Ma, S.; Fang, N.; Xing, B.; Chen, J. Optimal Control Method of HVAC Based on Multi-Agent Deep Reinforcement Learning. Energy Build. 2022, 270, 112284. [Google Scholar] [CrossRef]
  114. Cicirelli, F.; Guerrieri, A.; Mastroianni, C.; Scarcello, L.; Spezzano, G.; Vinci, A. Balancing Energy Consumption and Thermal Comfort with Deep Reinforcement Learning. In Proceedings of the Proceedings of the 2021 IEEE International Conference on Human-Machine Systems, ICHMS 2021, Magdeburg, Germany, 8–10 September 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021. [Google Scholar]
  115. Martinez-Molina, A.; Alamaniotis, M. Enhancing Historic Building Performance with the Use of Fuzzy Inference System to Control the Electric Cooling System. Sustainability 2020, 12, 5848. [Google Scholar] [CrossRef]
  116. Fu, C.; Zhang, Y. Research and Application of Predictive Control Method Based on Deep Reinforcement Learning for HVAC Systems. IEEE Access 2021, 9, 130845–130852. [Google Scholar] [CrossRef]
  117. Mason, K.; Grijalva, S. Building HVAC Control via Neural Networks and Natural Evolution Strategies. In Proceedings of the 2021 IEEE Congress on Evolutionary Computation, CEC 2021—Proceedings, Kraków, Poland, 28 June–2 July 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021; pp. 2483–2490. [Google Scholar]
  118. Kurte, K.; Amasyali, K.; Munk, J.; Zandi, H. Comparative Analysis of Model-Free and Model-Based HVAC Control for Residential Demand Response. In Proceedings of the BuildSys 2021—Proceedings of the 2021 ACM International Conference on Systems for Energy-Efficient Built Environments, Coimbra, Portugal, 17–18 November 2021; Association for Computing Machinery, Inc: New York, NY, USA, 2021; pp. 309–313. [Google Scholar]
  119. Ayadi, M.I.; Maizate, A.; Ouzzif, M.; Mahmoudi, C. Deep Learning in Building Management Systems over NDN: Use Case of Forwarding and HVAC Control. In Proceedings of the 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData), Atlanta, GA, USA, 14–17 July 2019; IEEE: New York, NY, USA, 2019; pp. 1192–1198. [Google Scholar]
  120. Kurte, K.; Munk, J.; Amasyali, K.; Kotevska, O.; Cui, B.; Kuruganti, T.; Zandi, H. Electricity Pricing Aware Deep Reinforcement Learning Based Intelligent HVAC Control. In Proceedings of the RLEM 2020—Proceedings of the 1st International Workshop on Reinforcement Learning for Energy Management in Buildings and Cities, Online, 17 November 2020; Association for Computing Machinery, Inc.: New York, NY, USA, 2020; pp. 6–10. [Google Scholar]
  121. Tao, Y.; Qiu, J.; Lai, S. A Hybrid Cloud and Edge Control Strategy for Demand Responses Using Deep Reinforcement Learning and Transfer Learning. IEEE Trans. Cloud Comput. 2022, 10, 56–71. [Google Scholar] [CrossRef]
  122. Blad, C.; Bøgh, S.; Kallesøe, C. A Multi-Agent Reinforcement Learning Approach to Price and Comfort Optimization in Hvac-Systems. Energies 2021, 14, 7491. [Google Scholar] [CrossRef]
  123. Naug, A.; Quinones-Grueiro, M.; Biswas, G. A Relearning Approach to Reinforcement Learning for Control of Smart Buildings. In Proceedings of the Annual Conference of the Prognostics and Health Management Society, PHM, Online, 9–13 November 2020; Prognostics and Health Management Society: Rochester, NY, USA, 2020; Volume 12. [Google Scholar]
  124. Zhang, C.; Zhang, Z.; Loftness, V. Bio-Sensing and Reinforcement Learning Approaches for Occupant-Centric Control. ASHRAE Trans. 2019, 125, 364–371. [Google Scholar]
  125. Naug, A.; Quiñones-Grueiro, M.; Biswas, G. Continual Adaptation in Deep Reinforcement Learning-Based Control Applied to Non-Stationary Building Environments. In Proceedings of the RLEM 2020—Proceedings of the 1st International Workshop on Reinforcement Learning for Energy Management in Buildings and Cities, Online, 17 November 2020; Association for Computing Machinery, Inc.: New York, NY, USA, 2020; pp. 24–28. [Google Scholar]
  126. Fang, X.; Gong, G.; Li, G.; Chun, L.; Peng, P.; Li, W.; Shi, X. Cross Temporal-Spatial Transferability Investigation of Deep Reinforcement Learning Control Strategy in the Building HVAC System Level. Energy 2023, 263, 125679. [Google Scholar] [CrossRef]
  127. Murugesan, S.; Jiang, Z.; Risbeck, M.J.; Amores, J.; Zhang, C.; Ramamurti, V.; Drees, K.H.; Lee, Y.M. Less Is More: Simplified State-Action Space for Deep Reinforcement Learning Based HVAC Control. In Proceedings of the RLEM 2020—Proceedings of the 1st International Workshop on Reinforcement Learning for Energy Management in Buildings and Cities, Online, 17 November 2020; Association for Computing Machinery, Inc.: New York, NY, USA, 2020; pp. 20–23. [Google Scholar]
  128. Liu, H.-Y.; Balaji, B.; Gao, S.; Gupta, R.; Hong, D. Safe HVAC Control via Batch Reinforcement Learning. In Proceedings of the Proceedings—13th ACM/IEEE International Conference on Cyber-Physical Systems, ICCPS 2022, Milano, Italy, 4–6 May 2022; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2022; pp. 181–192. [Google Scholar]
  129. Zenginis, I.; Vardakas, J.; Koltsaklis, N.E.; Verikoukis, C. Smart Home’s Energy Management Through a Clustering-Based Reinforcement Learning Approach. IEEE Internet Things J. 2022, 9, 16363–16371. [Google Scholar] [CrossRef]
  130. Dawood, S.M.; Hatami, A.; Homod, R.Z. Trade-off Decisions in a Novel Deep Reinforcement Learning for Energy Savings in HVAC Systems. J. Build. Perform. Simul. 2022, 15, 809–831. [Google Scholar] [CrossRef]
  131. Masburah, R.; Sinha, S.; Jana, R.L.; Dey, S.; Zhu, Q. Co-Designing Intelligent Control of Building HVACs and Microgrids. In Proceedings of the 2021 24th Euromicro Conference on Digital System Design, DSD 2021, Online, 1–3 September 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021; pp. 457–464. [Google Scholar]
  132. Jneid, K.; Ploix, S.; Reignier, P.; Jallon, P. Deep Q-Network Boosted with External Knowledge for HVAC Control. In Proceedings of the BuildSys 2021—Proceedings of the 2021 ACM International Conference on Systems for Energy-Efficient Built Environments, Coimbra, Portugal, 17–18 November 2021; Association for Computing Machinery, Inc.: New York, NY, USA, 2021; pp. 329–332. [Google Scholar]
  133. Zhong, X.; Zhang, Z.; Zhang, R.; Zhang, C. End-to-End Deep Reinforcement Learning Control for HVAC Systems in Office Buildings. Designs 2022, 6, 52. [Google Scholar] [CrossRef]
  134. Chae, M.; Kang, K.; Koo, D.; Oh, S.; Chun, J.Y. Fuzzy Controller Algorithm for Automated HVAC Control. In Proceedings of the 37th International Symposium on Automation and Robotics in Construction, ISARC 2020: From Demonstration to Practical Use—To New Stage of Construction Robot, Kitakyushu, Japan, 27–28 October 2020; International Association on Automation and Robotics in Construction (IAARC): Oulu, Finland, 2020; pp. 566–570. [Google Scholar]
  135. Xu, D. Learning Efficient Dynamic Controller for HVAC System. Mob. Inf. Syst. 2022, 2022, 157511. [Google Scholar] [CrossRef]
  136. Deng, X.; Zhang, Y.; Zhang, Y.; Qi, H. Toward Smart Multizone HVAC Control by Combining Context-Aware System and Deep Reinforcement Learning. IEEE Internet Things J. 2022, 9, 21010–21024. [Google Scholar] [CrossRef]
  137. Xu, S.; Fu, Y.; Wang, Y.; Yang, Z.; O’Neill, Z.; Wang, Z.; Zhu, Q. Accelerate Online Reinforcement Learning for Building HVAC Control with Heterogeneous Expert Guidances. In Proceedings of the BuildSys 2022—Proceedings of the 2022 9th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, Boston, MA, USA, 9–10 November 2022; Association for Computing Machinery, Inc.: New York, NY, USA, 2022; pp. 89–98. [Google Scholar]
  138. Scarcello, L.; Mastroianni, C. Cognitive Systems for Energy Efficiency and Thermal Comfort in Smart Buildings. In IoT Edge Solutions for Cognitive Buildings; Internet of Things; Springer Science and Business Media Deutschland GmbH: Berlin/Heidelberg, Germany, 2023; pp. 329–345. ISBN 21991073. [Google Scholar]
  139. Homod, R.Z.; Yaseen, Z.M.; Hussein, A.K.; Almusaed, A.; Alawi, O.A.; Falah, M.W.; Abdelrazek, A.H.; Ahmed, W.; Eltaweel, M. Deep Clustering of Cooperative Multi-Agent Reinforcement Learning to Optimize Multi Chiller HVAC Systems for Smart Buildings Energy Management. J. Build. Eng. 2023, 65, 105689. [Google Scholar] [CrossRef]
  140. Naug, A.; Quinones-Grueiro, M.; Biswas, G. Deep Reinforcement Learning Control for Non-Stationary Building Energy Management. Energy Build. 2022, 277, 112584. [Google Scholar] [CrossRef]
  141. Kurte, K.; Amasyali, K.; Munk, J.; Zandi, H. Deep Reinforcement Learning with Online Data Augmentation to Improve Sample Efficiency for Intelligent HVAC Control. In Proceedings of the BuildSys 2022—Proceedings of the 2022 9th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation, Boston, MA, USA, 9–10 November 2022; Association for Computing Machinery, Inc.: New York, NY, USA, 2022; pp. 479–483. [Google Scholar]
  142. Qin, H.; Yu, Z.; Li, T.; Liu, X.; Li, L. Energy-Efficient Heating Control for Nearly Zero Energy Residential Buildings with Deep Reinforcement Learning. Energy 2023, 264, 126209. [Google Scholar] [CrossRef]
  143. Liao, Y.; Liu, Y.; Chen, C.; Zhang, L. Green Building Energy Cost Optimization with Deep Belief Network and Firefly Algorithm. Front. Energy Res. 2021, 9, 805206. [Google Scholar] [CrossRef]
  144. Aliero, M.S.; Pasha, M.F.; Toosi, A.N.; Ghani, I. The COVID-19 Impact on Air Condition Usage: A Shift towards Residential Energy Saving. Environ. Sci. Pollut. Res. 2022, 29, 85727–85741. [Google Scholar] [CrossRef]
  145. Zhang, W.; Wu, Y.; Calautit, J.K. A Review on Occupancy Prediction through Machine Learning for Enhancing Energy Efficiency, Air Quality and Thermal Comfort in the Built Environment. Renew. Sustain. Energy Rev. 2022, 167, 112704. [Google Scholar] [CrossRef]
  146. Tien, P.W.; Wei, S.; Calautit, J.K.; Darkwa, J.; Wood, C. Real-Time Monitoring of Occupancy Activities and Window Opening within Buildings Using an Integrated Deep Learning-Based Approach for Reducing Energy Demand. Appl. Energy 2022, 308, 118336. [Google Scholar] [CrossRef]
  147. Al Mohammad, A.; Hirmiz, H.; Perera, G.; Maleki, M. Motif-Based Occupancy Prediction for Energy Efficiency in HVAC. In Proceedings of the 2022 3rd International Conference on Pattern Recognition and Machine Learning, PRML 2022, Chengdu, China, 22–24 July 2022; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2022; pp. 465–469. [Google Scholar]
  148. Elkhoukhi, H.; NaitMalek, Y.; Bakhouya, M.; Berouine, A.; Kharbouch, A.; Lachhab, F.; Hanifi, M.; El Ouadghiri, D.; Essaaidi, M. A Platform Architecture for Occupancy Detection Using Stream Processing and Machine Learning Approaches. Concurr. Comput. 2020, 32, e5651. [Google Scholar] [CrossRef]
  149. Jacoby, M.; Tan, S.Y.; Katanbaf, M.; Saffari, A.; Saha, H.; Kapetanovic, Z.; Garland, J.; Florita, A.; Henze, G.; Sarkar, S.; et al. Whisper: Wireless Home Identification and Sensing Platform for Energy Reduction. J. Sens. Actuator Netw. 2021, 10, 71. [Google Scholar] [CrossRef]
  150. Acquaah, Y.; Steele, J.B.; Gokaraju, B.; Tesiero, R.; Monty, G.H. Occupancy Detection for Smart Hvac Efficiency in Building Energy: A Deep Learning Neural Network Framework Using Thermal Imagery. In Proceedings of the Applied Imagery Pattern Recognition Workshop, Washington, DC, USA, 13–15 October 2020; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2020. [Google Scholar]
  151. Acquaah, Y.T.; Gokaraju, B.; Tesiero, R.C.; Monty, G.H. Thermal Imagery Feature Extraction Techniques and the Effects on Machine Learning Models for Smart Hvac Efficiency in Building Energy. Remote Sens. 2021, 13, 3847. [Google Scholar] [CrossRef]
  152. Khalil, M.; McGough, S.; Pourmirza, Z.; Pazhoohesh, M.; Walker, S. Transfer Learning Approach for Occupancy Prediction in Smart Buildings. In Proceedings of the 2021 12th International Renewable Engineering Conference, IREC 2021, Amman, Jordan, 14–15 April 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021. [Google Scholar]
  153. Issaraviriyakul, A.; Pora, W.; Panitantum, N. Cloud-Based Machine Learning Framework for Residential HVAC Control System. In Proceedings of the KST 2021—13th International Conference Knowledge and Smart Technology, Bangsaen, Thailand, 21–24 January 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021; pp. 12–16. [Google Scholar]
  154. Ye, Z.; O’neill, Z.; Hu, F. Hardware-Based Emulator with Deep Learning Model for Building Energy Control and Prediction Based on Occupancy Sensors’ Data. Information 2021, 12, 499. [Google Scholar] [CrossRef]
  155. McKee, E.; Du, Y.; Li, F.; Munk, J.; Johnston, T.; Kurte, K.; Kotevska, O.; Amasyali, K.; Zandi, H. Deep Reinforcement Learning for Residential Hvac Control with Consideration of Human Occupancy. In Proceedings of the IEEE Power and Energy Society General Meeting, Montreal, QC, Canada, 2–6 August 2020; IEEE Computer Society: Washington, DC, USA, 2020. [Google Scholar]
  156. Momeni, M.; Wu, D.-C.; Razban, A.; Chen, J. Data-Driven Demand Control Ventilation Using Machine Learning CO2 occupancy Detection Method. In Proceedings of the ECOS 2020—Proceedings of the 33rd International Conference on Efficiency, Cost, Optimization, Simulation and Environmental Impact of Energy Systems, Osaka, Japan, 29 June–3 July 2020; pp. 2060–2071. [Google Scholar]
  157. Chitu, C.; Stamatescu, G.; Stamatescu, I.; Sgarciu, V. Assessment of Occupancy Estimators for Smart Buildings. In Proceedings of the 2019 10th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications, IDAACS 2019, Metz, France, 18–21 September 2019; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2019; Volume 1, pp. 228–233. [Google Scholar]
  158. Chandrasiri, A.P.; Geekiyanage, D. Real-Time Object Detection System for Building Energy Conservation: An IP Camera Based System. In Proceedings of the 34th Annual ARCOM Conference, ARCOM 2018, Belfast, Ireland, 3–5 September 2018; pp. 567–576. [Google Scholar]
  159. Wang, C.; Lee, H. Economical and Non-Invasive Residential Human Presence Sensing via Temperature Measurement. In Proceedings of the ASME International Mechanical Engineering Congress and Exposition, Proceedings (IMECE), Pitsburgh, PA, USA, 9–15 November 2018; American Society of Mechanical Engineers (ASME): New York, NY, USA, 2018; Volume 6A-144113. [Google Scholar]
  160. Tien, P.W.; Wei, S.; Calautit, J.K.; Darkwa, J.; Wood, C. A Vision-Based Deep Learning Approach for the Detection and Prediction of Occupancy Heat Emissions for Demand-Driven Control Solutions. Energy Build. 2020, 226, 110386. [Google Scholar] [CrossRef]
  161. Choi, H.; Um, C.Y.; Kang, K.; Kim, H.; Kim, T. Application of Vision-Based Occupancy Counting Method Using Deep Learning and Performance Analysis. Energy Build. 2021, 252, 111389. [Google Scholar] [CrossRef]
  162. Esrafilian-Najafabadi, M.; Haghighat, F. Occupancy-Based HVAC Control Using Deep Learning Algorithms for Estimating Online Preconditioning Time in Residential Buildings. Energy Build. 2021, 252, 111377. [Google Scholar] [CrossRef]
  163. Lei, Y.; Zhan, S.; Ono, E.; Peng, Y.; Zhang, Z.; Hasama, T.; Chong, A. A Practical Deep Reinforcement Learning Framework for Multivariate Occupant-Centric Control in Buildings. Appl. Energy 2022, 324, 119742. [Google Scholar] [CrossRef]
  164. Tien, P.W.; Wei, S.; Calautit, J.K.; Darkwa, J.; Wood, C. A Computer Vision Deep Learning Method for the Detection and Recognition of Manual Window Openings for Effective Operations of HVAC Systems in Buildings. In Proceedings of the International Conference of Architectural Science Association, Auckland, New Zeland, 26–28 November 2018; pp. 21–30. [Google Scholar]
  165. Wei, S.; Tien, P.W.; Wu, Y.; Calautit, J.K. The Impact of Deep Learning–Based Equipment Usage Detection on Building Energy Demand Estimation. Build. Serv. Eng. Res. Technol. 2021, 42, 545–557. [Google Scholar] [CrossRef]
  166. Esrafilian-Najafabadi, M.; Haghighat, F. Towards Self-Learning Control of HVAC Systems with the Consideration of Dynamic Occupancy Patterns: Application of Model-Free Deep Reinforcement Learning. Build. Environ. 2022, 226, 109747. [Google Scholar] [CrossRef]
  167. Yayla, A.; Świerczewska, K.S.; Kaya, M.; Karaca, B.; Arayıcı, Y.; Ayözen, Y.E.; Tokdemir, O.B. Artificial Intelligence (AI)-Based Occupant-Centric Heating Ventilation and Air Conditioning (HVAC) Control System for Multi-Zone Commercial Buildings. Sustainability 2022, 14, 16107. [Google Scholar] [CrossRef]
  168. Wei, S.; Tien, P.W.; Calautit, J.K.; Boukhanouf, R.; Wu, Y. Equipment Load Detection Using Deep Learning for Building Energy Management. Proc. IOP Conf. Ser. Earth Environ. Sci. 2020, 463, 012027. [Google Scholar]
  169. Wei, S.; Tien, P.W.; Wu, Y.; Calautit, J.K. A Coupled Deep Learning-Based Internal Heat Gains Detection and Prediction Method for Energy-Efficient Office Building Operation. J. Build. Eng. 2022, 47, 103778. [Google Scholar] [CrossRef]
  170. Zhou, Y. Advanced Renewable Dispatch with Machine Learning-Based Hybrid Demand-Side Controller: The State of the Art and a Novel Approach. In Sustainable Developments by Artificial Intelligence and Machine Learning for Renewable Energies; Elsevier: Amsterdam, The Netherlands, 2022; pp. 237–256. ISBN 978-032391228-0. [Google Scholar]
  171. Kim, D.; Lee, Y.; Chin, K.; Mago, P.J.; Cho, H.; Zhang, J. Implementation of a Long Short-Term Memory Transfer Learning (LSTM-TL)-Based Data-Driven Model for Building Energy Demand Forecasting. Sustainability 2023, 15, 2340. [Google Scholar] [CrossRef]
  172. Wang, B.; Wang, X.; Wang, N.; Javaheri, Z.; Moghadamnejad, N.; Abedi, M. Machine Learning Optimization Model for Reducing the Electricity Loads in Residential Energy Forecasting. Sustain. Comput. Inform. Syst. 2023, 38, 100876. [Google Scholar] [CrossRef]
  173. Ma, H.; Xu, L.; Javaheri, Z.; Moghadamnejad, N.; Abedi, M. Reducing the Consumption of Household Systems Using Hybrid Deep Learning Techniques. Sustain. Comput. Inform. Syst. 2023, 38, 100874. [Google Scholar] [CrossRef]
  174. Alawadi, S.; Mera, D.; Fernández-Delgado, M.; Alkhabbas, F.; Olsson, C.M.; Davidsson, P. A Comparison of Machine Learning Algorithms for Forecasting Indoor Temperature in Smart Buildings. Energy Syst. 2022, 13, 689–705. [Google Scholar] [CrossRef]
  175. Rana, M.; Sethuvenkatraman, S.; Goldsworthy, M. A Data-Driven Approach Based on Quantile Regression Forest to Forecast Cooling Load for Commercial Buildings. Sustain. Cities Soc. 2022, 76, 103511. [Google Scholar] [CrossRef]
  176. Metsä-Eerola, I.; Pulkkinen, J.; Niemitalo, O.; Koskela, O. On Hourly Forecasting Heating Energy Consumption of HVAC with Recurrent Neural Networks. Energies 2022, 15, 5084. [Google Scholar] [CrossRef]
  177. Li, M. Optimizing HVAC Systems in Buildings with Machine Learning Prediction Models: An Algorithm Based Economic Analysis. In Proceedings of the—2020 Management Science Informatization and Economic Innovation Development Conference, MSIEID 2020, Guangzhou, China, 18–20 December 2020; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2020; pp. 210–217. [Google Scholar]
  178. Chen, Y.; Zhang, F.; Berardi, U. Day-Ahead Prediction of Hourly Subentry Energy Consumption in the Building Sector Using Pattern Recognition Algorithms. Energy 2020, 211, 118530. [Google Scholar] [CrossRef]
  179. Borowski, M.; Zwolińska, K. Prediction of Cooling Energy Consumption in Hotel Building Using Machine Learning Techniques. Energies 2020, 13, 6226. [Google Scholar] [CrossRef]
  180. Mawson, V.J.; Hughes, B.R. Optimisation of HVAC Control and Manufacturing Schedules for the Reduction of Peak Energy Demand in the Manufacturing Sector. Energy 2021, 227, 120436. [Google Scholar] [CrossRef]
  181. Goyal, M.; Pandey, M. Extreme Gradient Boosting Algorithm for Energy Optimization in Buildings Pertaining to HVAC Plants. EAI Endorsed Trans. Energy Web 2020, 21, e1. [Google Scholar] [CrossRef]
  182. Kajewska-Szkudlarek, J.; Bylicki, J.; Stańczyk, J.; Licznar, P. Neural Approach in Short-Term Outdoor Temperature Prediction for Application in Hvac Systems. Energies 2021, 14, 7512. [Google Scholar] [CrossRef]
  183. Li, Y.; Peng, Y.; Zhang, D.; Mai, Y.; Ruan, Z.; Liang, S. Energy Usage Prediction Based on Multi-System Data for Public Buildings Using Machine Learning Methods. In Proceedings of the—2021 International Conference on Computers and Automation, CompAuto 2021, Paris, France, 7–9 September 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021; pp. 7–13. [Google Scholar]
  184. Chalapathy, R.; Khoa, N.L.D.; Sethuvenkatraman, S. Comparing Multi-Step Ahead Building Cooling Load Prediction Using Shallow Machine Learning and Deep Learning Models. Sustain. Energy Grids Netw. 2021, 28, 100543. [Google Scholar] [CrossRef]
  185. Khamma, T.R.; Zhang, Y.; Guerrier, S.; Boubekri, M. Generalized Additive Models: An Efficient Method for Short-Term Energy Prediction in Office Buildings. Energy 2020, 213, 118834. [Google Scholar] [CrossRef]
  186. Goyal, M.; Pandey, M. Ensemble-Based Data Modeling for the Prediction of Energy Consumption in HVAC Plants. J. Reliab. Intell. Environ. 2021, 7, 49–64. [Google Scholar] [CrossRef]
  187. Zheng, J.; Ling, Z.; Kang, Y.; You, L.; Zhao, Y.; Xiao, Z.; Chen, X. HVAC Load Forecasting in Office Buildings Using Machine Learning. In Proceedings of the 2021 6th International Conference on Power and Renewable Energy, ICPRE 2021, Shanghai, China, 17–20 September 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021; pp. 877–881. [Google Scholar]
  188. Moayedi, H.; Mosavi, A. Double-Target Based Neural Networks in Predicting Energy Consumption in Residential Buildings. Energies 2021, 14, 1331. [Google Scholar] [CrossRef]
  189. Kanewala, U.; Weerakoon, S.; Nawarathna, R. Exploring Deep Learning and Tree-Based Ensemble Models for Chiller Energy Consumption Predictions. In Proceedings of the 2021 IEEE 16th International Conference on Industrial and Information Systems, ICIIS 2021—Proceedings, Kandy, Sri Lanka, 9–11 December 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021; pp. 306–311. [Google Scholar]
  190. Kim, J.-H.; Seong, N.-C.; Choi, W. Modeling and Optimizing a Chiller System Using a Machine Learning Algorithm. Energies 2019, 12, 2860. [Google Scholar] [CrossRef]
  191. Wang, J.; Li, G.; Chen, H.; Liu, J.; Guo, Y.; Sun, S.; Hu, Y. Energy Consumption Prediction for Water-Source Heat Pump System Using Pattern Recognition-Based Algorithms. Appl. Therm. Eng. 2018, 136, 755–766. [Google Scholar] [CrossRef]
  192. Goyal, M.; Pandey, M. Towards Prediction of Energy Consumption of HVAC Plants Using Machine Learning. In Proceedings of the International Conference on Recent Developments in Science, Engineering and Technology, Gurugram, India, 15–16 November 2019; Springer: Berlin/Heidelberg, Germany, 2020; Volume 1229, pp. 254–265. [Google Scholar]
  193. Sala-Cardoso, E.; Delgado-Prieto, M.; Kampouropoulos, K.; Romeral, L. Activity-Aware HVAC Power Demand Forecasting. Energy Build. 2018, 170, 15–24. [Google Scholar] [CrossRef]
  194. Ahmad, M.W.; Mouraud, A.; Rezgui, Y.; Mourshed, M. Deep Highway Networks and Tree-Based Ensemble for Predicting Short-Term Building Energy Consumption. Energies 2018, 11, 3408. [Google Scholar] [CrossRef]
  195. Bellatreche, L.; Garcia, F.; Pham, D.N.; Jiménez, P.Q. Sonder: A Data-Driven Methodology for Designing Net-Zero Energy Public Buildings. In Proceedings of the International Conference on Big Data Analytics and Knowledge Discovery, DaWaK 2020, Bratislava, Slovakia, 14–17 September 2020; Springer Science and Business Media Deutschland GmbH: Berlin/Heidelberg, Germany, 2020; Volume 12393, pp. 48–59. [Google Scholar]
  196. Tian, W.; Lei, C.; Tian, M. Dynamic Prediction of Building HVAC Energy Consumption by Ensemble Learning Approach. In Proceedings of the—2018 International Conference on Computational Science and Computational Intelligence, CSCI 2018, Las Vegas, NV, USA, 12–14 December 2018; pp. 254–257. [Google Scholar]
  197. Xiao, Z.; Gang, W.; Yuan, J.; Chen, Z.; Li, J.; Wang, X.; Feng, X. Impacts of Data Preprocessing and Selection on Energy Consumption Prediction Model of HVAC Systems Based on Deep Learning. Energy Build. 2022, 258, 111832. [Google Scholar] [CrossRef]
  198. Liu, Z.; Jiang, G. Optimization of Intelligent Heating Ventilation Air Conditioning System in Urban Building Based on Bim and Artificial Intelligence Technology. Comput. Sci. Inf. Syst. 2021, 18, 1379–1394. [Google Scholar] [CrossRef]
  199. Chen, Y.; Chandan, V.; Huang, Y.; Alam, M.J.E.; Ahmed, O.; Smith, L. Coordination of Behind-the-Meter Energy Storage and Building Loads: Optimization with Deep Learning Model. In Proceedings of the e-Energy 2019—Proceedings of the 10th ACM International Conference on Future Energy Systems, Phoenix, AZ, USA, 25–28 June 2019; Association for Computing Machinery, Inc.: New York, NY, USA, 2019; pp. 492–499. [Google Scholar]
  200. Gangopadhyay, T.; Tan, S.Y.; Jiang, Z.; Sarkar, S. Interpretable Deep Attention Model for Multivariate Time Series Prediction in Building Energy Systems. In Proceedings of the International Conference on Dynamic Data Driven Applications Systems, DDDAS 2020, Boston, MA, USA, 2–4 October 2020; Springer Science and Business Media Deutschland GmbH: Berlin/Heidelberg, Germany, 2020; Volume 12312, pp. 93–101. [Google Scholar]
  201. Runge, J.; Zmeureanu, R. Deep Learning Forecasting for Electric Demand Applications of Cooling Systems in Buildings. Adv. Eng. Inform. 2022, 53, 101674. [Google Scholar] [CrossRef]
  202. Qiao, D.; Shen, B.; Dong, X.; Zheng, H.; Song, W.; Wu, S. MTL-Deep-STF: A Multitask Learning Based Deep Spatiotemporal Fusion Model for Outdoor Air Temperature Prediction in Building HVAC Systems. J. Build. Eng. 2022, 62, 105364. [Google Scholar] [CrossRef]
  203. Singh, A. Optimal Thermal Comfort Based Energy Efficient Strategy of HVAC System Using Supervised Learning Based Classifier with Demand Response. In Proceedings of the 10th IEEE International Conference on Power Electronics, Drives and Energy Systems, PEDES 2022, Jaipur, India, 14–17 December 2022; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2022. [Google Scholar]
  204. Metzmacher, H.; Syndicus, M.; Warthmann, A.; van Treeck, C. Exploratory Comparison of Control Algorithms and Machine Learning as Regulators for a Personalized Climatization System. Energy Build. 2022, 255, 111653. [Google Scholar] [CrossRef]
  205. Yu, L.; Xu, Z.; Zhang, T.; Guan, X.; Yue, D. Energy-Efficient Personalized Thermal Comfort Control in Office Buildings Based on Multi-Agent Deep Reinforcement Learning. Build. Environ. 2022, 223, 109458. [Google Scholar] [CrossRef]
  206. Boutahri, Y.; Tilioua, A. Artificial Intelligent-Based System for Thermal Comfort Control in Smart Building. In Proceedings of the International Conference on Artificial Intelligence and Smart Environment, Errachidia, Morocco, 24–26 November 2022; Springer Science and Business Media Deutschland GmbH: Berlin/Heidelberg, Germany, 2023; Volume 635, pp. 240–246. [Google Scholar]
  207. Acquaah, Y.T.; Gokaraju, B.; Tesioro, R.C.; Monty, G.; Roy, K. Occupancy and Thermal Preference-Based HVAC Control Strategy Using Multisensor Network. IEEE Sens. J. 2023, 23, 11785–11795. [Google Scholar] [CrossRef]
  208. Hou, F.; Ma, J.; Kwok, H.H.L.; Cheng, J.C.P. Prediction and Optimization of Thermal Comfort, IAQ and Energy Consumption of Typical Air-Conditioned Rooms Based on a Hybrid Prediction Model. Build. Environ. 2022, 225, 109576. [Google Scholar] [CrossRef]
  209. Alsaleem, F.; Tesfay, M.K.; Rafaie, M.; Sinkar, K.; Besarla, D.; Arunasalam, P. An IoT Framework for Modeling and Controlling Thermal Comfort in Buildings. Front. Built Environ. 2020, 6, 87. [Google Scholar] [CrossRef]
  210. Qian, J.; Cheng, X.; Yang, B.; Li, Z.; Ren, J.; Olofsson, T.; Li, H. Vision-Based Contactless Pose Estimation for Human Thermal Discomfort. Atmosphere 2020, 11, 376. [Google Scholar] [CrossRef]
  211. Ghahramani, A.; Galicia, P.; Lehrer, D.; Varghese, Z.; Wang, Z.; Pandit, Y. Artificial Intelligence for Efficient Thermal Comfort Systems: Requirements, Current Applications and Future Directions. Front. Built Environ. 2020, 6, 49. [Google Scholar] [CrossRef]
  212. Gao, N.; Shao, W.; Rahaman, M.S.; Zhai, J.; David, K.; Salim, F.D. Transfer Learning for Thermal Comfort Prediction in Multiple Cities. Build. Environ. 2021, 195, 107725. [Google Scholar] [CrossRef]
  213. Somu, N.; Sriram, A.; Kowli, A.; Ramamritham, K. A Hybrid Deep Transfer Learning Strategy for Thermal Comfort Prediction in Buildings. Build. Environ. 2021, 204, 108133. [Google Scholar] [CrossRef]
  214. Abdulgader, M.; Lashhab, F. Energy-Efficient Thermal Comfort Control in Smart Buildings. In Proceedings of the 2021 IEEE 11th Annual Computing and Communication Workshop and Conference, CCWC 2021, Online, 27–30 January 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021; pp. 22–26. [Google Scholar]
  215. Lu, S.; Cochran Hameen, E. An Interactive Task Conditioning System Featuring Personal Comfort Models and Non-Intrusive Sensing Techniques: A Field Study in Shanghai. Technologies 2021, 9, 90. [Google Scholar] [CrossRef]
  216. Chen, Z.; Tao, Z.; Chang, A. A Data-Driven Approach to Optimize Building Energy Performance and Thermal Comfort Using Machine Learning Models. In Proceedings of the ICCIR ‘21: Proceedings of the 2021 1st International Conference on Control and Intelligent Robotics, Guangzhou, China, 18–20 June 2021; Association for Computing Machinery: New York, NY, USA, 2021; pp. 464–469. [Google Scholar]
  217. Ding, Z.; Fu, Q.; Chen, J.; Wu, H.; Lu, Y.; Hu, F. Multi-Zone Residential HVAC Control with Satisfying Occupants’ Thermal Comfort Requirements and Saving Energy via Reinforcement Learning. In Proceedings of the International Conference on Parallel and Distributed Computing: Applications and Technologies, PDCAT 2021, Guangzhou, China, 17–19 December 2021; Springer Science and Business Media Deutschland GmbH: Berlin/Heidelberg, Germany, 2022; Volume 13148, pp. 441–451. [Google Scholar]
  218. Syed Ahmad, S.S.; Yung, S.M.; Kausar, N.; Karaca, Y.; Pamucar, D.; Al Din Ide, N. Nonlinear Integrated Fuzzy Modeling to Predict Dynamic Occupant Environment Comfort for Optimized Sustainability. Sci. Program. 2022, 2022, 1–13. [Google Scholar] [CrossRef]
  219. Qin, S.; Yu, L.; Yue, D.; Shen, C. Optimal HVAC Control in Shared Office Spaces Based on Deep Reinforcement Learning. In Proceedings—2021 China Automation Congress, CAC 2021; Beijing, China, 22–24 October 2021, Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021; pp. 1599–1604. [Google Scholar]
  220. Cho, S.; Nam, H.J.; Shi, C.; Kim, C.Y.; Byun, S.-H.; Agno, K.-C.; Lee, B.C.; Xiao, J.; Sim, J.Y.; Jeong, J.-W. Wireless, AI-Enabled Wearable Thermal Comfort Sensor for Energy-Efficient, Human-in-the-Loop Control of Indoor Temperature. Biosens. Bioelectron. 2023, 223, 115018. [Google Scholar] [CrossRef]
  221. Bezyan, B.; Zmeureanu, R. Detection and Diagnosis of Dependent Faults That Trigger False Symptoms of Heating and Mechanical Ventilation Systems Using Combined Machine Learning and Rule-Based Techniques. Energies 2022, 15, 1691. [Google Scholar] [CrossRef]
  222. Hosamo, H.H.; Svennevig, P.R.; Svidt, K.; Han, D.; Nielsen, H.K. A Digital Twin Predictive Maintenance Framework of Air Handling Units Based on Automatic Fault Detection and Diagnostics. Energy Build. 2022, 261, 111988. [Google Scholar] [CrossRef]
  223. Chen, Y.; Wen, J.; Pradhan, O.; Lo, L.J.; Wu, T. Using Discrete Bayesian Networks for Diagnosing and Isolating Cross-Level Faults in HVAC Systems. Appl. Energy 2022, 327, 120050. [Google Scholar] [CrossRef]
  224. Martinez-Viol, V.; Urbano, E.M.; Torres Rangel, J.E.; Delgado-Prieto, M.; Romeral, L. Semi-Supervised Transfer Learning Methodology for Fault Detection and Diagnosis in Air-Handling Units. Appl. Sci. 2022, 12, 8837. [Google Scholar] [CrossRef]
  225. Yan, K.; Zhou, X. Chiller Faults Detection and Diagnosis with Sensor Network and Adaptive 1D CNN. Digit. Commun. Netw. 2022, 8, 531–539. [Google Scholar] [CrossRef]
  226. Zhang, C.; Zhao, Y.; Zhao, Y.; Li, T.; Zhang, X. Causal Discovery and Inference-Based Fault Detection and Diagnosis Method for Heating, Ventilation and Air Conditioning Systems. Build. Environ. 2022, 212, 108760. [Google Scholar] [CrossRef]
  227. Du, Z.; Chen, S.; Li, P.; Chen, K.; Liang, X.; Zhu, X.; Jin, X. Knowledge-Extracted Deep Learning Diagnosis and Its Cloud-Based Management for Multiple Faults of Chiller. Build. Environ. 2023, 235, 110228. [Google Scholar] [CrossRef]
  228. Mertens, N.; Wohlfahrt, T.; Hartmann, N.; Reddy, C.B.V. Automatic Transformation of HVAC Diagrams into Machine-Readable Format. In Product Lifecycle Management. PLM in Transition Times: The Place of Humans and Transformative Technologies, Proceedings of the 19th IFIP WG 5.1 International Conference, PLM 2022, Grenoble, France, 10–13 July 2022; Noël, F., Nyffenegger, F., Rivest, L., Bouras, A., Eds.; Springer Science and Business Media Deutschland GmbH: Berlin/Heidelberg, Germany, 2023; Volume 667, pp. 410–419. [Google Scholar]
  229. Chen, J.; Zhang, L.; Li, Y.; Shi, Y.; Gao, X.; Hu, Y. A Review of Computing-Based Automated Fault Detection and Diagnosis of Heating, Ventilation and Air Conditioning Systems. Renew. Sustain. Energy Rev. 2022, 161, 112395. [Google Scholar] [CrossRef]
  230. Albayati, M.G.; Faraj, J.; Thompson, A.; Patil, P.; Gorthala, R.; Rajasekaran, S. Semi-Supervised Machine Learning for Fault Detection and Diagnosis of a Rooftop Unit. Big Data Min. Anal. 2023, 6, 170–184. [Google Scholar] [CrossRef]
  231. Yang, C.; Gunay, B.; Shi, Z.; Shen, W. Machine Learning-Based Prognostics for Central Heating and Cooling Plant Equipment Health Monitoring. IEEE Trans. Autom. Sci. Eng. 2021, 18, 346–355. [Google Scholar] [CrossRef]
  232. Li, G.; Zheng, Y.; Liu, J.; Zhou, Z.; Xu, C.; Fang, X.; Yao, Q. An Improved Stacking Ensemble Learning-Based Sensor Fault Detection Method for Building Energy Systems Using Fault-Discrimination Information. J. Build. Eng. 2021, 43, 102812. [Google Scholar] [CrossRef]
  233. Zhu, X.; Chen, K.; Anduv, B.; Jin, X.; Du, Z. Transfer Learning Based Methodology for Migration and Application of Fault Detection and Diagnosis between Building Chillers for Improving Energy Efficiency. Build. Environ. 2021, 200, 107957. [Google Scholar] [CrossRef]
  234. Parzinger, M.; Wellisch, U.; Hanfstaengl, L.; Sigg, F.; Wirnsberger, M.; Spindler, U. Identifying Faults in the Building System Based on Model Prediction and Residuum Analysis. Proc. E3S Web Conf. 2020, 172, 22001. [Google Scholar]
  235. Alghanmi, A.; Yunusa-Kaltungo, A.; Edwards, R. A Comparative Study of Faults Detection Techniques on HVAC Systems. In Proceedings of the 2021 IEEE PES/IAS PowerAfrica, PowerAfrica 2021, Nairobi, Kenya, 23–27 August 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021. [Google Scholar]
  236. Dey, M.; Rana, S.P.; Dudley, S. Smart Building Creation in Large Scale HVAC Environments through Automated Fault Detection and Diagnosis. Future Gener. Comput. Syst. 2020, 108, 950–966. [Google Scholar] [CrossRef]
  237. Dey, M.; Rana, S.P.; Dudley, S. A Case Study Based Approach for Remote Fault Detection Using Multi-Level Machine Learning in a Smart Building. Smart Cities 2020, 3, 401–419. [Google Scholar] [CrossRef]
  238. Parzinger, M.; Hanfstaengl, L.; Sigg, F.; Spindler, U.; Wellisch, U.; Wirnsberger, M. Residual Analysis of Predictive Modelling Data for Automated Fault Detection in Building’s Heating, Ventilation and Air Conditioning Systems. Sustainability 2020, 12, 6758. [Google Scholar] [CrossRef]
  239. Dowling, C.P.; Zhang, B. Transfer Learning for HVAC System Fault Detection. In Proceedings of the American Control Conference, Denver, CO, USA, 1–3 July 2020; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2020; pp. 3879–3885. [Google Scholar]
  240. Gharsellaoui, S.; Mansouri, M.; Trabelsi, M.; Harkat, M.-F.; Refaat, S.S.; Messaoud, H. Interval-Valued Features Based Machine Learning Technique for Fault Detection and Diagnosis of Uncertain HVAC Systems. IEEE Access 2020, 8, 171892–171902. [Google Scholar] [CrossRef]
  241. Zhong, C.; Yan, K.; Dai, Y.; Jin, N.; Lou, B. Energy Efficiency Solutions for Buildings: Automated Fault Diagnosis of Air Handling Units Using Generative Adversarial Networks. Energies 2019, 12, 527. [Google Scholar] [CrossRef]
  242. McHugh, M.K.; Isakson, T.; Nagy, Z. Data-Driven Leakage Detection in Air-Handling Units on a University Campus. ASHRAE Trans. 2019, 125, 381–388. [Google Scholar]
  243. Gharsellaoui, S.; Mansouri, M.; Refaat, S.S.; Abu-Rub, H.; Messaoud, H. Multivariate Features Extraction and Effective Decision Making Using Machine Learning Approaches. Energies 2020, 13, 609. [Google Scholar] [CrossRef]
  244. Yang, C.; Shen, W.; Gunay, B.; Shi, Z. Toward Machine Learning-Based Prognostics for Heating Ventilation and Air-Conditioning Systems. ASHRAE Trans. 2019, 125, 106–115. [Google Scholar]
  245. Gharsellaoui, S.; Mansouri, M.; Refaat, S.S.; Abu-Rub, H.; Messaoud, H. Enhanced Machine Learning Approaches for Diagnosing Building Systems. In Proceedings of the 2019 International Conference on Internet of Things, Embedded Systems and Communications, IINTEC 2019—Proceedings, Tunis, Tunisia, 20–22 December 2019; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2019; pp. 136–141. [Google Scholar]
  246. Li, G.; Yao, Q.; Fan, C.; Zhou, C.; Wu, G.; Zhou, Z.; Fang, X. An Explainable One-Dimensional Convolutional Neural Networks Based Fault Diagnosis Method for Building Heating, Ventilation and Air Conditioning Systems. Build. Environ. 2021, 203, 108057. [Google Scholar] [CrossRef]
  247. Li, Y.; O’Neill, Z. An Innovative Fault Impact Analysis Framework for Enhancing Building Operations. Energy Build. 2019, 199, 311–331. [Google Scholar] [CrossRef]
  248. Tasfi, N.L.; Higashino, W.A.; Grolinger, K.; Capretz, M.A.M. Deep Neural Networks with Confidence Sampling for Electrical Anomaly Detection. In Proceedings of the—2017 IEEE International Conference on Internet of Things, IEEE Green Computing and Communications, IEEE Cyber, Physical and Social Computing, IEEE Smart Data, iThings-GreenCom-CPSCom-SmartData 2017, Exeter, UK, 21–23 June 2017; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2018; pp. 1038–1045. [Google Scholar]
  249. Xu, S.; Fu, Y.; Wang, Y.; O’Neill, Z.; Zhu, Q. Learning-Based Framework for Sensor Fault-Tolerant Building HVAC Control with Model-Assisted Learning. In Proceedings of the BuildSys 2021—Proceedings of the 2021 ACM International Conference on Systems for Energy-Efficient Built Environments, Coimbra, Portugal, 17–18 November 2021; Association for Computing Machinery, Inc.: New York, NY, USA, 2021; pp. 1–10. [Google Scholar]
  250. Wang, D.; Li, X. A Novel Virtual Sensor Modeling Method Based on Deep Learning and Its Application in Heating, Ventilation, and Air-Conditioning System. Energies 2022, 15, 5743. [Google Scholar] [CrossRef]
  251. Li, G.; Chen, L.; Liu, J.; Fang, X. Comparative Study on Deep Transfer Learning Strategies for Cross-System and Cross-Operation-Condition Building Energy Systems Fault Diagnosis. Energy 2023, 263, 125943. [Google Scholar] [CrossRef]
  252. Du, Z.; Chen, S.; Anduv, B.; Zhu, X.; Jin, X. IoT Intelligent Agent Based Cloud Management System by Integrating Machine Learning Algorithm for HVAC Systems. Int. J. Refrig. 2023, 146, 158–173. [Google Scholar] [CrossRef]
  253. Hosamo, H.H.; Nielsen, H.K.; Kraniotis, D.; Svennevig, P.R.; Svidt, K. Improving Building Occupant Comfort through a Digital Twin Approach: A Bayesian Network Model and Predictive Maintenance Method. Energy Build. 2023, 288, 112992. [Google Scholar] [CrossRef]
  254. Haque, N.I.; Rahman, M.A.; Shahriar, H. Ensemble-Based Efficient Anomaly Detection for Smart Building Control Systems. In Proceedings of the—2021 IEEE 45th Annual Computers, Software, and Applications Conference, COMPSAC 2021, Madrid, Spain, 12–16 July 2021; Institute of Electrical and Electronics Engineers Inc.: Piscataway, NJ, USA, 2021; pp. 504–513. [Google Scholar]
  255. Alonso, S.; Morán, A.; Pérez, D.; Prada, M.A.; Díaz, I.; Domínguez, M. Estimating Cooling Production and Monitoring Efficiency in Chillers Using a Soft Sensor. Neural Comput. Appl. 2020, 32, 17291–17308. [Google Scholar] [CrossRef]
Figure 1. Search script flow diagram.
Figure 1. Search script flow diagram.
Buildings 15 01008 g001
Figure 2. Literature search flow diagram.
Figure 2. Literature search flow diagram.
Buildings 15 01008 g002
Figure 3. Publication sources.
Figure 3. Publication sources.
Buildings 15 01008 g003
Figure 4. Keyword co-occurrence network.
Figure 4. Keyword co-occurrence network.
Buildings 15 01008 g004
Figure 5. Co-authorship connections among countries.
Figure 5. Co-authorship connections among countries.
Buildings 15 01008 g005
Figure 6. Number of articles per type of AI-based methods and technique.
Figure 6. Number of articles per type of AI-based methods and technique.
Buildings 15 01008 g006
Figure 7. Number of articles per AI algorithm used.
Figure 7. Number of articles per AI algorithm used.
Buildings 15 01008 g007
Figure 8. Sankey diagram between methods, techniques, and AI algorithms.
Figure 8. Sankey diagram between methods, techniques, and AI algorithms.
Buildings 15 01008 g008
Figure 9. Overview of AI in HVAC Systems, highlighting the current landscape.
Figure 9. Overview of AI in HVAC Systems, highlighting the current landscape.
Buildings 15 01008 g009
Table 1. Top cited publications.
Table 1. Top cited publications.
TitleContributionImportanceNoveltyInstitution
Gradient boosting machine for modeling the energy consumption of commercial buildings [14]Significant for modeling energy consumptionHigh impact on commercial building designIntroduces gradient boosting, an advanced machine learning technique, for energy modeling. This method offers a sophisticated approach compared to traditional models, improving prediction accuracy.Lawrence Berkeley National Laboratory [USA]
Using machine learning techniques for occupancy-prediction-based cooling control in office buildings [15]Key for energy-efficient cooling controlCritical for reducing office energy usageApplies machine learning techniques to predict occupancy and optimize cooling control, providing a modern solution for building management and improving energy efficiency.ETH Zürich [Switzerland]
Whole building energy model for HVAC optimal control: A practical framework based on deep reinforcement learning [16]Practical framework for HVAC controlHigh impact on HVAC optimizationUtilizes deep reinforcement learning for HVAC control, a cutting-edge method that offers a significant innovation in optimizing energy usage and system performance.Carnegie Mellon University [USA]
Deep Reinforcement Learning for Smart Home Energy Management [17]Advances smart home energy managementImportant for residential energy efficiencyApplies deep reinforcement learning to optimize energy management in smart homes, introducing a novel approach to improving energy efficiency and control.National Natural Science Foundation [China]
Predictive modeling for US commercial building energy use: A comparison of existing statistical and machine learning algorithms using CBECS microdata [18]Comparison of various modelsSignificant for improving predictive accuracyCompares statistical and machine learning models for energy prediction, providing insights into the effectiveness and advancements of newer algorithms in the field.Northeastern University [USA]
Generative adversarial network for fault detection diagnosis of chillers [19]Fault detection using advanced techniquesEssential for fault diagnosis in chillersInnovatively applies generative adversarial networks (GANs) for diagnosing faults in chillers, a novel approach that enhances fault detection by leveraging GANs’ unique capabilities.National University of Singapore [Singapore]
Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings [20]Multi-agent approach to HVAC controlImportant for complex building systemsIntroduces a multi-agent deep reinforcement learning approach for controlling HVAC systems, offering a sophisticated method for managing complex systems with multiple agents.Nanjing University [China]
Deep reinforcement learning to optimize indoor temperature control and heating energy consumption in buildings [21]Optimization of temperature controlCrucial for energy savings in buildingsUses deep reinforcement learning to optimize indoor temperature and heating energy consumption, presenting a novel and advanced method for improving building energy efficiency.Politecnico di Torino [Italy]
Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning [22]Multi-zone HVAC control strategyHigh relevance for residential HVAC systemsApplies deep reinforcement learning to control multiple zones in residential HVAC systems, offering a new approach for enhanced and efficient multi-zone control.University of Tennessee [USA]
A review of studies applying machine learning models to predict occupancy and window-opening behaviors in smart buildings [23]Comprehensive review of machine learningImportant for understanding occupancy modelsProvides a comprehensive review of machine learning applications for predicting occupancy and window-opening behaviors, summarizing significant advancements and methodologies.Tianjin University [China]
Gnu-RL: A precocial reinforcement learning solution for building HVAC control using a differentiable MPC policy [24]New reinforcement learning solutionSignificant for optimizing HVAC controlPresents a novel reinforcement learning solution with a differentiable MPC policy for HVAC control, offering an innovative approach to managing building systems.Carnegie Mellon University [USA]
Intelligent building control systems for thermal comfort and energy-efficiency: A systematic review of artificial intelligence-assisted techniques [10]Systematic review of AI in building controlValuable for understanding AI applicationsReviews various AI-assisted techniques for building control, offering valuable insights into innovative methods and their applications in achieving thermal comfort and energy efficiency.Smart Systems Laboratory [Morocco]
Deep Comfort: Energy-Efficient Thermal Comfort Control in Buildings Via Reinforcement Learning [25]Energy-efficient comfort controlImportant for residential thermal comfortUtilizes reinforcement learning to achieve energy-efficient thermal comfort control in buildings, presenting a novel approach to balancing comfort and energy use.Nanjing University of Science and Technology [China]
Towards optimal control of air handling units using deep reinforcement learning and recurrent neural network [26]Optimal control of air handling unitsHigh impact on HVAC systemsIntroduces a novel method combining deep reinforcement learning and recurrent neural networks for optimizing air handling units, providing an advanced approach to building control.New York University [USA]
OCTOPUS: Deep reinforcement learning for holistic smart building control [27]Holistic approach to building controlSignificant for smart building managementEmploys deep reinforcement learning for comprehensive smart building control, offering an innovative approach to managing various aspects of building systems holistically.University of California [USA]
Model input selection for building heating load prediction: A case study for an office building in Tianjin [28]Model input selection for heating predictionImportant for accurate heating load forecastingProposes a new methodology for selecting model inputs in heating load prediction, providing a novel approach to improving prediction accuracy for building heating systems.Tianjin University [China]
Comparison of machine learning models for occupancy prediction in residential buildings using connected thermostat data [29]Comparison of ML models for occupancyImportant for improving occupancy predictionsCompares various machine learning models for predicting occupancy using thermostat data, offering valuable insights into the effectiveness of different algorithms.University of Toronto [Canada]
Building HVAC scheduling using reinforcement learning via neural network based model approximation [30]Scheduling HVAC systems using reinforcement learningCrucial for efficient HVAC schedulingApplies reinforcement learning with neural network model approximation for HVAC scheduling, presenting a novel approach to optimizing building energy management.University of Southern California [USA]
Occupancy-based HVAC control systems in buildings: A state-of-the-art review [31]Comprehensive review of occupancy-based controlImportant for understanding current technologiesReviews state-of-the-art occupancy-based HVAC control systems, summarizing recent advancements and providing a comprehensive overview of current technologies.Concordia University [Canada]
Deep-learning-based fault detection and diagnosis of air-handling units [32]Fault detection in HVAC systemsImportant for HVAC maintenance and efficiencyUtilizes deep learning techniques for fault detection and diagnosis in air-handling units, offering a novel approach to improving maintenance and system reliability.National Taipei University of Technology [China]
A novel deep reinforcement learning based methodology for short-term HVAC system energy consumption prediction [33]Short-term prediction of HVAC energy consumptionUseful for short-term energy managementIntroduces a novel deep reinforcement learning methodology for predicting short-term HVAC energy consumption, providing a sophisticated approach to energy forecasting.Zhengzhou University [China]
Practical implementation and evaluation of deep reinforcement learning control for a radiant heating system [34]Practical implementation of DRL for heatingImportant for radiant heating controlEvaluates the practical implementation of deep reinforcement learning for controlling radiant heating systems, offering a novel and practical approach to system optimization.
Learning-based CO2 concentration prediction: Application to indoor air quality control using demand-controlled ventilation [35]CO2 prediction for air quality controlImportant for indoor air quality managementUses learning-based methods for predicting CO2 concentrations to enhance indoor air quality control, presenting a novel approach to demand-controlled ventilation.Indiana University-Purdue University Indianapolis [USA]
Can HVAC really learn from users? A simulation-based study on the effectiveness of voting for comfort and energy use optimization [36]Simulation study on user interaction with HVACRelevant for user-centric HVAC optimizationSimulates user voting for HVAC control and energy optimization, offering a novel approach to understanding user preferences and their impact on system performance.Universidade de Lisboa [Portugal]
Application of deep Q-networks for model-free optimal control balancing between different HVAC systems [37]Model-free HVAC control with deep Q-networksSignificant for balancing multiple HVAC systemsApplies deep Q-networks for model-free control balancing different HVAC systems, introducing a novel method for optimizing complex HVAC controls.College of Engineering, Seoul National University [Republic of Korea]
Improving Energy Consumption of a Commercial Building with IoT and Machine Learning [38]IoT and ML for improving energy consumptionImportant for integrating IoT in buildingsCombines IoT and machine learning to improve energy consumption in commercial buildings, providing a novel approach to energy management through advanced technologies.COMSATS Institute of Information Technology [Pakistan]
A deep reinforcement learning approach to using whole building energy model for HVAC optimal control [39]Deep reinforcement learning for HVAC controlHigh impact on building energy managementApplies deep reinforcement learning to a whole building energy model for HVAC control, offering an advanced and novel approach to optimizing building systems.
Table 2. Advantages and disadvantages, associated techniques, and impacted components of each algorithm.
Table 2. Advantages and disadvantages, associated techniques, and impacted components of each algorithm.
AlgorithmAdvantages/DisadvantagesTechniqueComponent
ANNAdvantages: High accuracy in load forecasting; handles non-linear relationships.
Disadvantages: Requires extensive training data; computationally intensive.
Forecasting ConsumptionChillers, Air Handlers [40]
Control StrategyCompressors [41]
Occupancy DetectionVentilation Systems [42]
Thermal ComfortDuct Systems, Thermostats
SVMAdvantages: Effective for small datasets; robust to overfitting.
Disadvantages: Not ideal for large datasets; kernel selection can be challenging.
Fault Detection and DiagnosticsAirflow Systems [43]
Occupancy DetectionAir Quality Monitors [15]
Maintenance ManagementCompressors, Fans [44]
DRLAdvantages: Learns optimal control strategies without predefined models; adapts dynamically to uncertainties.
Disadvantages: High complexity; slow convergence for large systems.
Control StrategyEntire HVAC System [45]
Forecasting ConsumptionCooling Towers, Air Handlers [46]
Thermal ComfortThermostats, Sensors [47]
RFAdvantages: High accuracy for classification problems; resistant to overfitting.
Disadvantages: May struggle with high-dimensional data; less interpretable.
Thermal ComfortThermostats [48]
Fault Detection and DiagnosticsVentilation Systems [49]
Forecasting ConsumptionZone Equipment, Variable Air Volume (VAV) Systems [50]
LSTMAdvantages: Excellent for multivariate time series data; suitable for energy demand forecasting.
Disadvantages: High memory requirements; slower training compared to traditional methods.
Forecasting ConsumptionZone Temperature Controllers, Heat Pumps [40,51]
Maintenance ManagementDuct Systems, Heat Exchangers [44]
Thermal ComfortBuilding Zones [52]
Table 3. Categories and topics identified.
Table 3. Categories and topics identified.
CategoriesTopicsPublications
Control HVAC systemControl Strategy[5,7,10,16,17,20,21,22,24,26,27,30,34,37,38,39,46,47,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115,116,117,118,119,120,121,122,123,124,125,126,127,128,129,130,131,132,133,134,135,136,137,138,139,140,141,142,143]
Occupancy Detection[15,23,29,31,36,42,144,145,146,147,148,149,150,151,152,153,154,155,156,157,158,159,160,161,162,163,164,165,166,167,168,169]
Forecasting Consumption[14,18,28,33,45,50,51,170,171,172,173,174,175,176,177,178,179,180,181,182,183,184,185,186,187,188,189,190,191,192,193,194,195,196,197,198,199,200,201,202]
Thermal Comfort[25,35,41,49,203,204,205,206,207,208,209,210,211,212,213,214,215,216,217,218,219,220]
Maintenance HVAC systemFault Detection and Diagnostics[9,19,32,40,43,221,222,223,224,225,226,227,228,229,230,231,232,233,234,235,236,237,238,239,240,241,242,243,244,245,246,247,248,249,250,251,252]
Maintenance Management[12,44,253,254,255]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Aghili, S.A.; Haji Mohammad Rezaei, A.; Tafazzoli, M.; Khanzadi, M.; Rahbar, M. Artificial Intelligence Approaches to Energy Management in HVAC Systems: A Systematic Review. Buildings 2025, 15, 1008. https://doi.org/10.3390/buildings15071008

AMA Style

Aghili SA, Haji Mohammad Rezaei A, Tafazzoli M, Khanzadi M, Rahbar M. Artificial Intelligence Approaches to Energy Management in HVAC Systems: A Systematic Review. Buildings. 2025; 15(7):1008. https://doi.org/10.3390/buildings15071008

Chicago/Turabian Style

Aghili, Seyed Abolfazl, Amin Haji Mohammad Rezaei, Mohammadsoroush Tafazzoli, Mostafa Khanzadi, and Morteza Rahbar. 2025. "Artificial Intelligence Approaches to Energy Management in HVAC Systems: A Systematic Review" Buildings 15, no. 7: 1008. https://doi.org/10.3390/buildings15071008

APA Style

Aghili, S. A., Haji Mohammad Rezaei, A., Tafazzoli, M., Khanzadi, M., & Rahbar, M. (2025). Artificial Intelligence Approaches to Energy Management in HVAC Systems: A Systematic Review. Buildings, 15(7), 1008. https://doi.org/10.3390/buildings15071008

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop