Search Results (74)

This paper proposes a novel Twin Delayed Deep Deterministic Policy Gradient (TDDPG)-based joint optimization algorithm for hybrid reconfigurable intelligent surface (RIS)-assisted integrated sensing and communication (ISAC) systems in Internet of Vehicles (IoV) scenarios. The proposed system model achieves deep integration of sensing and communication by superimposing the communication and sensing signals within the same waveform. To decouple the complex joint design problem, a dual-DDPG architecture is introduced, in which one agent optimizes the transmit beamforming vector and the other adjusts the RIS phase shift matrix. Both agents share a unified reward function that comprehensively considers multi-user interference (MUI), total transmit power, RIS noise power, and sensing accuracy via the CRLB constraint. Simulation results demonstrate that the proposed TDDPG algorithm significantly outperforms conventional DDPG in terms of sum rate and interference suppression. Moreover, the adoption of a hybrid RIS enables an effective trade-off between communication performance and system energy efficiency, highlighting its practical deployment potential in dynamic IoV environments. Full article

This comprehensive review maps the fast-evolving landscape in which artificial intelligence (AI) and deep-learning (DL) techniques converge with the Internet of Things (IoT) to manage energy, comfort, and sustainability across smart environments. A PRISMA-guided search of four databases retrieved 1358 records; after applying inclusion criteria, 143 peer-reviewed studies published between January 2019 and April 2025 were analyzed. This review shows that AI-driven controllers—especially deep-reinforcement-learning agents—deliver median energy savings of 18–35% for HVAC and other major loads, consistently outperforming rule-based and model-predictive baselines. The evidence further reveals a rapid diversification of methods: graph-neural-network models now capture spatial interdependencies in dense sensor grids, federated-learning pilots address data-privacy constraints, and early integrations of large language models hint at natural-language analytics and control interfaces for heterogeneous IoT devices. Yet large-scale deployment remains hindered by fragmented and proprietary datasets, unresolved privacy and cybersecurity risks associated with continuous IoT telemetry, the growing carbon and compute footprints of ever-larger models, and poor interoperability among legacy equipment and modern edge nodes. The authors of researches therefore converges on several priorities: open, high-fidelity benchmarks that marry multivariate IoT sensor data with standardized metadata and occupant feedback; energy-aware, edge-optimized architectures that lower latency and power draw; privacy-centric learning frameworks that satisfy tightening regulations; hybrid physics-informed and explainable models that shorten commissioning time; and digital-twin platforms enriched by language-model reasoning to translate raw telemetry into actionable insights for facility managers and end users. Addressing these gaps will be pivotal to transforming isolated pilots into ubiquitous, trustworthy, and human-centered IoT ecosystems capable of delivering measurable gains in efficiency, resilience, and occupant wellbeing at scale. Full article

Multiple-resolution modeling (MRM) has emerged as a foundational paradigm in modern simulation, enabling the integration of models with varying levels of granularity to address complex and evolving operational demands. By supporting seamless transitions between high-resolution and low-resolution representations, MRM facilitates scalability and interoperability, particularly within distributed simulation environments such as military command and control systems. This paper provides a structured review and comparative analysis of prominent MRM methodologies, including multi-resolution entities (MRE), agent-based modeling (from a federation viewpoint), hybrid frameworks, and the novel MR mode, synchronizing resolution transitions with time advancement and interaction management. Each approach is evaluated across critical dimensions such as consistency, computational efficiency, flexibility, and integration with legacy systems. Emphasis is placed on the applicability of MRM in distributed military simulations, where it enables dynamic interplay between strategic-level planning and tactical-level execution, supporting real-time decision-making, mission rehearsal, and scenario-based training. The paper also explores emerging trends involving artificial intelligence (AI) and large language models (LLMs) as enablers for adaptive resolution management and automated model interoperability. Full article

This study presents the design and validation of an integrated fire safety system that leverages edge AI, hybrid sensing, and precision suppression to overcome the latency and collateral limitations of conventional smoke detection and sprinkler systems. The proposed platform features a dual-mode sensor array for early fire recognition, motorized ventilation units for rapid smoke extraction, and a 360° directional nozzle for targeted agent discharge using a residue-free clean extinguishing agent. Experimental trials demonstrated an average fire detection time of 5.8 s and complete flame suppression within 13.2 s, with 90% smoke clearance achieved in under 95 s. No false positives were recorded during non-fire simulations, and the system remained fully functional under simulated cloud communication failure, confirming its edge-resilient architecture. A probabilistic risk analysis based on ISO 31000 and NFPA 551 frameworks showed risk reductions of 75.6% in life safety, 58.0% in property damage, and 67.1% in business disruption. The system achieved a composite risk reduction of approximately 73%, shifting the operational risk level into the ALARP region. These findings demonstrate the system’s capacity to provide proactive, energy-efficient, and spatially targeted fire response suitable for high-value infrastructure. The modular design and SmartThings Edge integration further support scalable deployment and real-time system intelligence, establishing a strong foundation for future adaptive fire protection frameworks. Full article

Despite notable advancements in smart home technologies, residential energy management continues to face critical challenges. These include the complex integration of intermittent renewable energy sources, issues related to data latency, interoperability, and standardization across diverse systems, the inflexibility of centralized control architectures in dynamic environments, and the difficulty of accurately modeling and influencing occupant behavior. To address these challenges, this study proposes an intelligent multi-agent system designed to accurately estimate and control energy consumption in residential buildings, with the overarching objective of optimizing energy usage while maintaining occupant comfort and satisfaction. The methodological approach employed is a hybrid framework, integrating multi-agent system architecture with system dynamics modeling and agent-based modeling. This integration enables decentralized and intelligent control while simultaneously simulating physical processes such as heat exchange, insulation performance, and energy consumption, alongside behavioral interactions and real-time adaptive responses. The system is tested under varying conditions, including changes in building insulation quality and external temperature profiles, to assess its capability for accurate control and estimation of energy use. The proposed tool offers significant added value by supporting real-time responsiveness, behavioral adaptability, and decentralized coordination. It serves as a risk-free simulation platform to test energy-saving strategies, evaluate cost-effective insulation configurations, and fine-tune thermostat settings without incurring additional cost or real-world disruption. The high fidelity and predictive accuracy of the system have important implications for policymakers, building designers, and homeowners, offering a practical foundation for informed decision making and the promotion of sustainable residential energy practices. Full article

Urban systems are transforming as artificial intelligence (AI) evolves from automation to Agentic Urban AI (AI systems with autonomous goal-setting and decision-making capabilities), which independently define and pursue urban objectives. This shift necessitates reassessing governance, planning, and ethics. Using a conceptual-methodological approach, this study integrates urban studies, AI ethics, and governance theory. Through a literature review and case studies of platforms like Alibaba’s City Brain and CityMind AI Agent, it identifies early agency indicators, such as strategic adaptation and goal re-prioritisation. A typology distinguishing automation, autonomy, and agency clarifies AI-driven urban decision-making. Three trajectories are proposed: fully autonomous Agentic AI, collaborative Hybrid Urban Agency, and constrained Non-Agentic AI to mitigate ethical risks. The findings highlight the need for participatory, transparent governance to ensure democratic accountability and social equity in cognitive urban ecosystems. Full article

With the rapid development of artificial intelligence technology, DRL has shown great potential in solving complex real-time optimal power flow problems of modern power systems. Nevertheless, traditional DRL methodologies confront dual bottlenecks: (a) suboptimal coordination between exploratory behavior policies and experience-based data exploitation in practical applications, compounded by (b) users’ distrust from the opacity of model decision mechanics. To address these, a model–data hybrid-driven physics-informed reinforcement learning (PIRL) algorithm is proposed in this paper. Specifically, the proposed methodology uses the proximal policy optimization (PPO) algorithm as the agent’s foundational framework and constructs a PI-actor network embedded with prior model knowledge derived from power flow sensitivity into the agent’s actor network via the PINN method, which achieves dual optimization objectives: (a) enhanced environmental perceptibility to improve experience utilization efficiency via gradient-awareness from model knowledge during actor network updates, and (b) improved user trustworthiness through mathematically constrained action gradient information derived from explicit model knowledge, ensuring actor updates adhere to safety boundaries. The simulation and validation results show that the PIRL algorithm outperforms the baseline PPO algorithm in terms of training stability, exploration efficiency, economy, and security. Full article

Traditional Chinese medicine (TCM), as a vital component of traditional healthcare systems, relies heavily on its chemical constituents, which serve as a bridge between ancient therapeutic theories and modern biomedical science. Efficient access to compound-related information is crucial for promoting the modernization and scientific understanding of TCM. However, existing approaches primarily rely on fragmented databases and literature-based retrieval methods, which suffer from low intelligence, poor data integration, and limited retrieval efficiency.This study presents a novel AI agent-based retrieval system tailored for compound information in TCM. The core innovation of the system lies in its hybrid retrieval-augmented generation framework, which seamlessly combines structured database queries with semantic vector retrieval. Furthermore, it integrates knowledge from three complementary sources—locally built knowledge bases, domain-specific APIs, and open web search—allowing for comprehensive coverage and adaptive handling of diverse natural language queries. Experiments conducted on a benchmark dataset of 150 compound-related queries demonstrate that the system achieves a peak accuracy of 96.67% across multiple mainstream LLMs. Ablation studies further reveal that removing either the hybrid RAG or multi-source knowledge module leads to a notable accuracy decline, while the full system outperforms typical RAG baselines by over 25%. These results confirm the effectiveness and robustness of the proposed architecture in TCM compound retrieval, and highlight the advantage of combining structured matching with dynamic knowledge access in specialized biomedical applications. Full article

Background/Objectives: Radiodermitis is an inflammatory or dystrophic skin process caused by the direct action of ionizing radiation. The primary objective was to study two clinical cases. The secondary objective was to propose the foundations of an intelligent system for decision support in complex cases of radiodermitis diagnosis that can operate even in the case of a low amount of available clinical data that can be used for training. Methods: The first case is a female patient, aged 74 years, with squamous cell carcinoma on a chronic radiodermitis site, which appeared after 20 years of local radiotherapy treatment for mammary adenocarcinoma. Dermatologic examination revealed five round-oval nodules between 2 and 8 cm in diameter. They were pink colored with lilac edges, hard and infiltrated on palpation, adherent to the subcutaneous tissue, painless, and located above and lateral on the right chest and the upper region of the right hypochondrium. The second case concerns a 60-year-old patient with verrucous squamous cell carcinoma appearing on a chronic radiodermatitis 40 years after local radio-therapeutic treatment with Chaoul rays for a deep right temporal region mycosis. There are presented artificial intelligence (AI) challenges regarding the application of advanced hybrid models in decision support for diagnosis of difficult radiodermitis cases, in that intelligent computing must be made in the context of very little available data, and collaboration between physicians is necessary. Results: Both cases were confirmed by histology as squamos cell carcinomas. In the AI research, the adaptation of the IntMediSys intelligent system was proposed for solving complex cases of radiodermitis. The proposal integrates different AI technologies, which include agents, intelligent computing, and blackboard systems. Conclusions: The presented first cases confirm the presence of a squamous cell carcinoma that appeared on chronic radiodermitis after a long latency. The foundations of a highly complex collaboration and decision support system that can assist physicians in the radiodermitis diagnostics establishment that opens the path for further development are presented. Full article

This study proposes a robust methodology for vibration suppression and trajectory tracking in rotary flexible-link systems by leveraging guided reinforcement learning (GRL). The approach integrates the twin delayed deep deterministic policy gradient (TD3) algorithm with a linear quadratic regulator (LQR) acting as a guiding controller during training. Flexible-link mechanisms common in advanced robotics and aerospace systems exhibit oscillatory behavior that complicates precise control. To address this, the system is first identified using experimental input-output data from a Quanser^® virtual plant, generating an accurate state-space representation suitable for simulation-based policy learning. The hybrid control strategy enhances sample efficiency and accelerates convergence by incorporating LQR-generated trajectories during TD3 training. Internally, the TD3 agent benefits from architectural features such as twin critics, delayed policy updates, and target action smoothing, which collectively improve learning stability and reduce overestimation bias. Comparative results show that the guided TD3 controller achieves superior performance in terms of vibration damping, transient response, and robustness, when compared to conventional LQR, fuzzy logic, neural networks, and GA-LQR approaches. Although the controller was validated using a high-fidelity digital twin, it has not yet been deployed on the physical plant. Future work will focus on real-time implementation and structural robustness testing under parameter uncertainty. Overall, this research demonstrates that guided reinforcement learning can yield stable and interpretable policies that comply with classical control criteria, offering a scalable and generalizable framework for intelligent control of flexible mechanical systems. Full article

This paper explores the evolving relationship between Digital Twins (DT) and the Metaverse, two foundational yet often conflated digital paradigms in digital architecture. While DTs function as mirrored models of real-world systems—integrating IoT, BIM, and real-time analytics to support decision-making—Metaverses are typically fictional, immersive, multi-user environments shaped by social, cultural, and speculative narratives. Through several research projects, the team investigate the divergence between DTs and Metaverses through the lens of their purpose, data structure, immersion, and interactivity, while highlighting areas of convergence driven by emerging technologies in Artificial Intelligence (AI) and Extended Reality (XR).This study aims to investigate the convergence of DTs and the Metaverse in digital architecture, examining how emerging technologies—such as AI, XR, and Large Language Models (LLMs)—are blurring their traditional boundaries. By analyzing their divergent purposes, data structures, and interactivity modes, as well as hybrid applications (e.g., data-integrated virtual environments and AI-driven collaboration), this study seeks to define the opportunities and challenges of this integration for architectural design, decision-making, and immersive user experiences. Our research spans multiple projects utilizing XR and AI to develop DT and the Metaverse. The team assess the capabilities of AI in DT environments, such as reality capture and smart building management. Concurrently, the team evaluates metaverse platforms for online collaboration and architectural education, focusing on features facilitating multi-user engagement. The paper presents evaluations of various virtual environment development pipelines, comparing traditional BIM+IoT workflows with novel approaches such as Gaussian Splatting and generative AI for content creation. The team further explores the integration of Large Language Models (LLMs) in both domains, such as virtual agents or LLM-powered Non-Player-Controlled Characters (NPC), enabling autonomous interaction and enhancing user engagement within spatial environments. Finally, the paper argues that DTs and Metaverse’s once-distinct boundaries are becoming increasingly porous. Hybrid digital spaces—such as virtual buildings with data-integrated twins and immersive, social metaverses—demonstrate this convergence. As digital environments mature, architects are uniquely positioned to shape these dual-purpose ecosystems, leveraging AI, XR, and spatial computing to fuse data-driven models with immersive and user-centered experiences. Full article

Neural network (NN)-based controllers have emerged as a paradigm-shifting approach in modern control systems, demonstrating unparalleled capabilities in governing nonlinear dynamical systems with inherent uncertainties. This comprehensive review systematically investigates the theoretical foundations and practical implementations of NN controllers through the prism of Lyapunov stability theory, NN controller frameworks, and robustness analysis. The review establishes that recurrent neural architectures inherently address time-delayed state compensation and disturbance rejection, achieving superior trajectory tracking performance compared to classical control strategies. By integrating imitation learning with barrier certificate constraints, the proposed methodology ensures provable closed-loop stability while maintaining safety-critical operation bounds. Experimental evaluations using chaotic system benchmarks confirm the exceptional modeling capacity of NN controllers in capturing complex dynamical behaviors, complemented by formal verification advances through reachability analysis techniques. Practical demonstrations in aerial robotics and intelligent transportation systems highlight the efficacy of controllers in real-world scenarios involving environmental uncertainties and multi-agent interactions. The theoretical framework synergizes data-driven learning with nonlinear control principles, introducing hybrid automata formulations for transient response analysis and adjoint sensitivity methods for network optimization. These innovations position NN controllers as a transformative technology in control engineering, offering fundamental advances in stability-guaranteed learning and topology optimization. Future research directions will emphasize the integration of physics-informed neural operators for distributed control systems and event-triggered implementations for resource-constrained applications, paving the way for next-generation intelligent control architectures. Full article

Airports are complex environments where efficient localization and intelligent traffic management are essential for ensuring smooth navigation and operational efficiency for both pedestrians and Autonomous Guided Vehicles (AGVs). This study presents an Artificial Intelligence (AI)-driven airport traffic management system that integrates Visible Light Communication (VLC), rerouting techniques, and adaptive reward mechanisms to optimize traffic flow, reduce congestion, and enhance safety. VLC-enabled luminaires serve as transmission points for location-specific guidance, forming a hybrid mesh network based on tetrachromatic LEDs with On-Off Keying (OOK) modulation and SiC optical receivers. AI agents, driven by Deep Reinforcement Learning (DRL), continuously analyze traffic conditions, apply adaptive rewards to improve decision-making, and dynamically reroute agents to balance traffic loads and avoid bottlenecks. Traffic states are encoded and processed through Q-learning algorithms, enabling intelligent phase activation and responsive control strategies. Simulation results confirm that the proposed system enables more balanced green time allocation, with reductions of up to 43% in vehicle-prioritized phases (e.g., Phase 1 at C1) to accommodate pedestrian flows. These adjustments lead to improved route planning, reduced halting times, and enhanced coordination between AGVs and pedestrian traffic across multiple intersections. Additionally, traffic flow responsiveness is preserved, with critical clearance phases maintaining stability or showing slight increases despite pedestrian prioritization. Simulation results confirm improved route planning, reduced halting times, and enhanced coordination between AGVs and pedestrian flows. The system also enables accurate indoor localization without relying on a Global Positioning System (GPS), supporting seamless movement and operational optimization. By combining VLC, adaptive AI models, and rerouting strategies, the proposed approach contributes to safer, more efficient, and human-centered airport mobility. Full article

Hybrid Reality (HyR) is the place where human beings and artificial entities interact. HyR modelling relies simultaneously on the cognitive power of humans and artificial entities. In addition, HyR is an evolving paradigm where natural and artificial intelligence can intervene in processes that demand proper control. This work aims to lay the foundation for a systematic approach to understanding and modeling present and future human–machine symbiosis under a systems engineering perspective. It introduces a novel cyber-systemic methodology for managing the engineering of purposeful regulation for HyR phenomena by integrating the Blockchain technology framework and principled methods of cybernetics. This formalized interdisciplinary methodology integrates system dynamics, agent-based computation, artificial intelligence, and Blockchain-powered security and safety layers. The Blockchain framework, seen under a new cyber-systemic perspective, provides new opportunities and tools for the organization and control of HyR. A Cybersystemic Security Kit is here defined as a major component of the methodology, representing a candidate to offer viable breakthroughs in the field with respect to the best practices of Industry 5.0 when a systemically augmented perspective is adopted. Ongoing research and experimentation in the real field of sustainable supply chains is used as a motivating use case to support the proposed position. The industrial target is the primary one in its multi-dimensional and multi-faceted sustainability impacts, but this study will also reveal other potential societal areas of intervention. Full article

The subway power supply system, as a critical component of urban rail transit infrastructure, plays a pivotal role in ensuring operational efficiency and safety. However, current systems remain heavily dependent on manual interventions for fault diagnosis and recovery, limiting their ability to meet the growing demand for automation and efficiency in modern urban environments. While the concept of “self-healing” has been successfully implemented in power grids and distribution networks, adapting these technologies to subway power systems presents distinct challenges. This review introduces an innovative approach by integrating multi-agent systems (MASs) with advanced artificial intelligence (AI) algorithms, focusing on their potential to create fully autonomous self-healing control architectures for subway power networks. The novel contribution of this review lies in its hybrid model, which combines MASs with the IEC 61850 communication standard to develop fault diagnosis, isolation, and recovery mechanisms specifically tailored for subway systems. Unlike traditional methods, which rely on centralized control, the proposed approach leverages distributed decision-making capabilities within MASs, enhancing fault detection accuracy, speed, and system resilience. Through a thorough review of the state of the art in self-healing technologies, this work demonstrates the unique benefits of applying MASs and AI to address the specific challenges of subway power systems, offering significant advancement over existing methodologies in the field. Full article