Search Results (139)

Rotating compressors are foundational in various industrial processes, particularly in the oil-and-gas sector, where reliable fault detection is crucial for maintaining operational continuity. While Graph Attention Network (GAT) frameworks are widely available, this study advances the state of the art by introducing a Bayesian GAT method specifically tailored for vibration-based compressor fault diagnosis. The approach integrates domain-specific digital-twin simulations built with Rotordynamic software (1.3.0), and constructs dual adjacency matrices to encode both physically informed and data-driven sensor relationships. Additionally, a hybrid forecasting-and-reconstruction objective enables the model to capture short-term deviations as well as long-term waveform fidelity. Monte Carlo dropout further decomposes prediction uncertainty into aleatoric and epistemic components, providing a more robust and interpretable model. Comparative evaluations against conventional Long Short-Term Memory (LSTM)-based autoencoder and forecasting methods demonstrate that the proposed framework achieves superior fault-detection performance across multiple fault types, including misalignment, bearing failure, and unbalance. Moreover, uncertainty analyses confirm that fault severity correlates with increasing levels of both aleatoric and epistemic uncertainty, reflecting heightened noise and reduced model confidence under more severe conditions. By enhancing GAT fundamentals with a domain-tailored dual-graph strategy, specialized Bayesian inference, and digital-twin data generation, this research delivers a comprehensive and interpretable solution for compressor fault diagnosis, paving the way for more reliable and risk-aware predictive maintenance in complex rotating machinery. Full article

With the increasing integration of renewable energy and smart technologies in residential energy systems, proactive household energy management (HEM) have become critical for reducing costs, enhancing grid stability, and achieving sustainability goals. This study proposes a ultra-short-term forecasting-driven proactive energy consumption optimization strategy that integrates advanced forecasting models with multi-objective scheduling algorithms. By leveraging deep learning techniques like Graph Attention Network (GAT) architectures, the system predicts ultra-short-term household load profiles with high accuracy, addressing the volatility of residential energy use. Then, based on the predicted data, a comprehensive consideration of electricity costs, user comfort, carbon emission pricing, and grid load balance indicators is undertaken. This study proposes an enhanced mixed-integer optimization algorithm to collaboratively optimize multiple objective functions, thereby refining appliance scheduling, energy storage utilization, and grid interaction. Case studies demonstrate that integrating photovoltaic (PV) power generation forecasting and load forecasting models into a home energy management system, and adjusting the original power usage schedule based on predicted PV output and water heater demand, can effectively reduce electricity costs and carbon emissions without compromising user engagement in optimization. This approach helps promote energy-saving and low-carbon electricity consumption habits among users. Full article

The selection of appropriate biomarkers in clinical practice aids in the early detection, treatment, and prevention of disease while also assisting in the development of targeted therapeutics. Recently, multi-omics data generated from advanced technology platforms has become available for disease studies. Therefore, the integration of this data with associated clinical data provides a unique opportunity to gain a deeper understanding of disease. However, the effective integration of large-scale multi-omics data remains a major challenge. To address this, we propose a novel deep learning model—the Multi-Omics Graph Attention biomarker Discovery network (MOGAD). MOGAD aims to efficiently classify diseases and discover biomarkers by integrating various omics data such as DNA methylation, gene expression, and miRNA expression. The model consists of three main modules: Multi-head GAT network (MGAT), Multi-Graph Attention Fusion (MGAF), and Attention Fusion (AF), which work together to dynamically model the complex relationships among different omics layers. We incorporate clinical data (e.g., APOE genotype) which enables a systematic investigation of the influence of non-omics factors on disease classification. The experimental results demonstrate that MOGAD achieves a superior performance compared to existing single-omics and multi-omics integration methods in classification tasks for Alzheimer’s disease (AD). In the comparative experiment on the ROSMAP dataset, our model achieved the highest ACC (0.773), F1-score (0.787), and MCC (0.551). The biomarkers identified by MOGAD show strong associations with the underlying pathogenesis of AD. We also apply a Hi-C dataset to validate the biological rationality of the identified biomarkers. Furthermore, the incorporation of clinical data enhances the model’s robustness and uncovers synergistic interactions between omics and non-omics features. Thus, our deep learning model is able to successfully integrate multi-omics data to efficiently classify disease and discover novel biomarkers. Full article

Kinase is an enzyme responsible for cell signaling and other complex processes. Mutations or changes in kinase can cause cancer and other diseases in humans, including leukemia, neuroblastomas, glioblastomas, and more. Considering these concerns, inhibiting overexpressed or dysregulated kinases through small drug molecules is very important. In the past, many machine learning and deep learning approaches have been used to inhibit unregulated kinase enzymes. In this work, we employ a Graph Neural Network (GNN) to predict the inhibition activities of kinases. A separate Graph Convolution Network (GCN) and combined Graph Convolution and Graph Attention Network (GCN_GAT) are developed and trained on two large datasets (Kinase Datasets 1 and 2) consisting of small drug molecules against the targeted kinase using 10-fold cross-validation. Furthermore, a wide range of molecules are used as independent datasets on which the performance of the models is evaluated. On both independent kinase datasets, our model combining GCN and GAT provides the best evaluation and outperforms previous models in terms of accuracy, Matthews Correlation Coefficient (MCC), sensitivity, specificity, and precision. On the independent Kinase Dataset 1, the values of accuracy, MCC, sensitivity, specificity, and precision are 0.96, 0.89, 0.90, 0.98, and 0.91, respectively. Similarly, the performance of our model combining GCN and GAT on the independent Kinase Dataset 2 is 0.97, 0.90, 0.91, 0.99, and 0.92 in terms of accuracy, MCC, sensitivity, specificity, and precision, respectively. Full article

The construction of transition rules is the core and difficulty faced by the cellular automata (CA) model. Dynamic mining of transition rules can more accurately simulate urban land use change. By introducing a graph attention network (GAT) to mine CA model transition rules, the temporal and spatial dynamics of the model are increased based on the construction of a real-time dynamic graph structure. At the same time, by adding an agent-based model (ABM) to the CA model, the simulation evolution of different human decision-making behaviors can be achieved. Based on this, an urban expansion scenario prediction (UESP) model has been proposed: (1) the UESP model employs a multi-head attention mechanism to dynamically capture high-order spatial dependencies, supporting the efficient processing of large-scale datasets with over 50,000 points of interest (POIs); (2) it incorporates the behaviors of agents such as residents, governments, and transportation systems to more realistically reflect human micro-level decision-making; and (3) by integrating macro-structural learning with micro-behavioral modeling, it effectively addresses the existing limitations in representing high-order spatial relationships and human decision-making processes in urban expansion simulations. Based on the policy context of the Outline of the Beijing–Tianjin–Hebei (BTH) Coordinated Development Plan, four development scenarios were designed to simulate construction land change by 2030. The results show that (1) the UESP model achieved an overall accuracy of 0.925, a Kappa coefficient of 0.878, and a FoM index of 0.048, outperforming traditional models, with the FoM being 3.5% higher; (2) through multi-scenario simulation prediction, it is found that under the scenario of ecological conservation and farmland protection, forest and grassland increase by 3142 km², and cultivated land increases by 896 km², with construction land showing a concentrated growth trend; and (3) the expansion of construction land will mainly occur at the expense of farmland, concentrated around Beijing, Tianjin, Tangshan, Shijiazhuang, and southern core cities in Hebei, forming a “core-driven, axis-extended, and cluster-expanded” spatial pattern. Full article

This paper introduces a novel dual-stream collaborative architecture for remote sensing road segmentation, designed to overcome multi-scale feature conflicts, limited dynamic adaptability, and compromised topological integrity. Our network employs a parallel “local–global” encoding scheme: the local stream uses depth-wise separable convolutions to capture fine-grained details, while the global stream integrates a Swin-Transformer with a graph-attention module (Swin-GAT) to model long-range contextual and topological relationships. By decoupling detailed feature extraction from global context modeling, the proposed framework more faithfully represents complex road structures. Comprehensive experiments on multiple aerial datasets demonstrate that our approach outperforms conventional baselines—especially under shadow occlusion and for thin-road delineation—while achieving real-time inference at 31 FPS. Ablation studies further confirm the critical roles of the Swin Transformer and GAT components in preserving topological continuity. Overall, this dual-stream dynamic-fusion network sets a new benchmark for remote sensing road extraction and holds promise for real-world, real-time applications. Full article

Graph attention networks are pivotal for modeling non-Euclidean data, yet they face dual challenges: training oscillations induced by projection-based high-dimensional constraints and gradient anomalies due to poor adaptation to heterophilic structure. To address these issues, we propose LDC-GAT (Lyapunov-Stable Graph Attention Network with Dynamic Filtering and Constraint-Aware Optimization), which jointly optimizes both forward and backward propagation processes. In the forward path, we introduce Dynamic Residual Graph Filtering, which integrates a tunable self-loop coefficient to balance neighborhood aggregation and self-feature retention. This filtering mechanism, constrained by a lower bound on Dirichlet energy, improves multi-head attention via multi-scale fusion and mitigates overfitting. In the backward path, we design the Fro-FWNAdam, a gradient descent algorithm guided by a learning-rate-aware perceptron. An explicit Frobenius norm bound on weights is derived from Lyapunov theory to form the basis of the perceptron. This stability-aware optimizer is embedded within a Frank–Wolfe framework with Nesterov acceleration, yielding a projection-free constrained optimization strategy that stabilizes training dynamics. Experiments on six benchmark datasets show that LDC-GAT outperforms GAT by 10.54% in classification accuracy, which demonstrates strong robustness on heterophilic graphs. Full article

Single-cell Assay for Transposase-Accessible Chromatin using sequencing (scATAC-seq) technology enables single-cell resolution analysis of chromatin accessibility, offering critical insights into gene regulation, epigenetic heterogeneity, and cellular differentiation across various biological contexts. However, existing cell annotation methods face notable limitations. Cross-omics approaches, which rely on single-cell RNA sequencing (scRNA-seq) as a reference, often struggle with data alignment due to fundamental differences between transcriptional and chromatin accessibility modalities. Meanwhile, intra-omics methods, which rely solely on scATAC-seq data, are frequently affected by batch effects and fail to fully utilize genomic sequence information for accurate annotation. To address these challenges, we propose scAttG, a novel deep learning framework that integrates graph attention networks (GATs) and convolutional neural networks (CNNs) to capture both chromatin accessibility signals and genomic sequence features. By utilizing the nucleotide sequences corresponding to scATAC-seq peaks, scAttG enhances both the robustness and accuracy of cell-type annotation. Experimental results across multiple scATAC-seq datasets suggest that scAttG generally performs favorably compared to existing methods, showing competitive performance in single-cell chromatin accessibility-based cell-type annotation. Full article

A variety of cast product defects may occur in the continuous casting process. By establishing a Continuous Casting Quality Knowledge Graph (C2Q-KG) focusing on the causes of cast product defects, enterprises can systematically sort out and express the relations between various production factors and cast product defects, which makes the reasoning process for the causes of cast product defects more objective and comprehensive. However, reasoning schemes for general KGs often use the same processing method to deal with different types of relations, without considering the difference in the number distribution of the head and tail entities in the relation, leading to a decrease in reasoning accuracy. In order to improve the reasoning accuracy of C2Q-KGs, this paper proposes a model based on a two-branch reasoning network. Our model classifies the continuous casting triples according to the number distribution of the head and tail entities in the relation and connects a two-branch reasoning network consisting of one connection layer and one capsule layer behind the convolutional layer. The connection layer is used to deal with the sparsely distributed entity-side reasoning task in the triple, while the capsule layer is used to deal with the densely distributed entity-side reasoning task in the triple. In addition, the Graph Attention Network (GAT) is introduced to enable our model to better capture the complex information hidden in the neighborhood of each entity and improve the overall reasoning accuracy. The experimental results show that compared with other cutting-edge methods on the continuous casting data set, our model significantly improves performance and infers more accurate root causes of cast product defects, which provides powerful guidance for enterprise production. Full article

The problem of inadequate object detection accuracy in complex remote sensing scenarios has been identified as a primary concern. Traditional YOLO-series algorithms encounter challenges such as poor robustness in small object detection and significant interference from complex backgrounds. In this paper, a multi-scale feature fusion framework based on an improved version of YOLOv8_L is proposed. The combination of a graph attention network (GAT) and Dilated Encoder network significantly improves the algorithm detection and recognition performance for space remote sensing objects. It mainly includes abandoning the original Feature Pyramid Network (FPN) structure, proposing an adaptive fusion strategy based on multi-level features of backbone network, enhancing the expression ability of multi-scale objects through upsampling and feature stacking, and reconstructing the FPN. The local features extracted by convolutional neural networks are mapped to graph-structured data, and the nodal attention mechanism of GAT is used to capture the global topological association of space objects, which makes up for the deficiency of the convolutional operation in weight allocation and realizes GAT integration. The Dilated Encoder network is introduced to cover different-scale targets by differentiating receptive fields, and the feature weight allocation is optimized by combining it with a Convolutional Block Attention Module (CBAM). According to the characteristics of space missions, an annotated dataset containing 8000 satellite and space station images is constructed, covering a variety of lighting, attitude and scale scenes, and providing benchmark support for model training and verification. Experimental results on the space object dataset reveal that the enhanced algorithm achieves a mean average precision (mAP) of 97.2%, representing a 2.1% improvement over the original YOLOv8_L. Comparative experiments with six other models demonstrate that the proposed algorithm outperforms its counterparts. Ablation studies further validate the synergistic effect between the graph attention network (GAT) and the Dilated Encoder. The results indicate that the model maintains a high detection accuracy under challenging conditions, including strong light interference, multi-scale variations, and low-light environments. Full article

Traditional cattle health monitoring systems rely on centralized data collection, posing significant challenges related to data privacy, network connectivity, model reliability, and trust. This study introduces a novel, nature-inspired federated learning (FL) framework for cattle health monitoring, integrating blockchain to ensure model validation, system resilience, and reputation management. Inspired by the fission–fusion dynamics of elephant herds, the framework adaptively forms and merges subgroups of edge nodes based on six key parameters: health metrics, activity levels, geographical proximity, resource availability, temporal activity, and network connectivity. Graph attention networks (GATs) enable dynamic fission, while Density-Based Spatial Clustering of Applications with Noise (DBSCAN) supports subgroup fusion based on model similarity. Blockchain smart contracts validate model contributions and ensure that only high-performing models participate in global aggregation. A reputation-driven mechanism promotes reliable nodes and discourages unstable participants. Experimental results show the proposed framework achieves 94.3% model accuracy, faster convergence, and improved resource efficiency. This adaptive and privacy-preserving approach transforms cattle health monitoring into a more trustworthy, efficient, and resilient process. Full article

Accurate address matching is crucial for the analysis, integration, and intelligent management of urban geospatial data and is also a key step in achieving geocoding. However, due to the complexity, diversity, and irregularity of address expression, address matching becomes a challenging task. This paper proposes a multi-semantic feature fusion method for complex address matching of Chinese addresses that formulates address matching as a classification task that directly predicts whether two addresses refer to the same location, without relying on predefined similarity thresholds. First, the address is resolved into address elements, and the Word2vec model is trained to generate word vector representations using these address elements. Then, multi-semantic features of the addresses are extracted using a Text Recurrent Convolutional Neural Network (Text-RCNN) and a Graph Attention Network (GAT). Finally, the Enhanced Sequential Inference Model (ESIM) is used to perform both local inference and inference composition on the multi-semantic features of the addresses to achieve accurate matching of addresses. Experiments were conducted using Points of Interest (POI) address data from Baidu Maps, Tencent Maps, and Amap within the Chengdu area. The results demonstrate that the proposed method outperforms existing address matching methods, with precision, recall, and F1 values all exceeding 95%. In addition, transfer experiments using datasets from five other cities including Beijing, Shanghai, Xi’an, Guangzhou, and Wuhan show that the model maintains strong generalization ability, achieving F1 values above 84% in cities such as Xi’an and Wuhan. Full article

Knowledge graph-enhanced recommendation has gained increasing attention for its ability to provide structured semantic context. However, most existing approaches struggle with two critical challenges: the sparsity of long-tail relations in knowledge graphs and the lack of adaptability to users’ dynamic preferences. In this paper, we propose GLARA, a novel recommendation framework that combines semantic abstraction and behavioral adaptation through a two-stage modeling process. First, a Virtual Relational Knowledge Graph (VRKG) is constructed by clustering semantically similar relations into higher-level virtual groups, which alleviates relation sparsity and enhances generalization. Then, a global Local Weighted Smoothing (LWS) module and a local Graph Attention Network (GAT) are integrated to jointly refine item and user representations: LWS propagates information within each virtual relation subgraph to improve semantic consistency, while GAT dynamically adjusts neighbor importance based on recent interaction signals. Extensive experiments on Last.FM and MovieLens-1M demonstrate that GLARA outperforms state-of-the-art methods, achieving up to 5.8% improvements in NDCG@20, especially in long-tail and cold-start scenarios. Additionally, case studies confirm the model’s interpretability by tracing recommendation paths through clustered semantic relations. This work offers a flexible and interpretable solution for robust recommendation under sparse and dynamic conditions. Full article

Air conditioning loads in power systems exhibit spatiotemporal heterogeneity across geographical regions, complicating accurate load forecasting. This study proposes a framework that integrates Deep Reinforcement Learning-guided DBSCAN (DRL-DBSCAN) clustering with a Graph Attention Network (GAT)-based Graph Neural Network to model spatial dependencies and temporal dynamics. Using meteorological features like temperature and humidity, the framework clusters geographical grids and applies GAT to capture spatial patterns. On a Pecan Street dataset of 25 households in Austin, the GAT with DRL-DBSCAN achieves a Test MSE of 0.0216 and MAE of 0.0884, outperforming K-Means (MSE: 0.0523, MAE: 0.1456), Hierarchical clustering (MSE: 0.0478, MAE: 0.1321), no-clustering (MSE: 0.0631, MAE: 0.1678), LSTM (MSE: 0.3259, MAE: 0.3442), Transformer (MSE: 0.6415, MAE: 0.4835), and MLP (MSE: 0.7269, MAE: 0.5240) baselines. This approach enhances forecasting accuracy for real-time grid management and energy efficiency in smart grids, though further refinement is needed for standardizing predicted load ranges. Full article

Accurate topological connectivity is critical for the safe operation and management of low-voltage distribution grids (LVDGs). However, due to the complexity of the structure and the lack of measurement equipment, obtaining and maintaining these topological connections has become a challenge. This paper proposes a topology identification strategy for LVDGs based on a feature-enhanced graph attention network (F-GAT). First, the topology of the LVDG is represented as a graph structure using measurement data collected from intelligent terminals, with a feature matrix encoding the basic information of each entity. Secondly, the meta-path form of the heterogeneous graph is designed according to the connection characteristics of the LVDG, and the walking sequence is enhanced using a heterogeneous skip-gram model to obtain an embedded representation of the structural characteristics of each node. Then, the F-GAT model is used to learn potential association patterns and structural information in the graph topology, achieving a joint low-dimensional representation of electrical attributes and graph semantics. Finally, case studies on five urban LVDGs in the Wuhan region are conducted to validate the effectiveness and practicality of the proposed F-GAT model. Full article