Advancing Logic-Driven and Complex Event Perception Frameworks for Entity Alignment in Knowledge Graphs
Abstract
1. Introduction
- Time Consistency: The temporal overlap in affiliations (2005–2010 at MIT, 2010 onwards at Stanford) validates the alignment between “John Doe” in KG1 and “J. Doe” in KG2, ensuring that the entity’s temporal affiliations are consistent across both graphs.
- Event Linkage: The publication of “Paper A” in 2006 links “John Doe” in KG1 with “J. Doe” in KG2 through the shared event of authoring the paper. This ensures that critical events such as publications are aligned even when they are not explicitly tied to affiliations.
- Transitions: The movement from MIT to Stanford in 2010 is observed in both graphs, showing a continuity in the academic trajectory. The transition is represented as “J. Doe was affiliated with MIT until joining Stanford”.
- Temporal Path Pruning: EAL prioritizes temporal paths linking “2005–2010 at MIT” to “2010 onwards at Stanford” for alignment, ensuring that only relevant temporal paths are considered.
- Event Reasoning: The model focuses on critical events such as the publication of “Paper A” to strengthen the alignment of “John Doe” with “J. Doe”.
- Adaptive Attention: During inference, temporal paths that do not align (e.g., affiliations outside 2005–2010) are pruned to optimize reasoning efficiency by focusing only on the relevant temporal-event relationships.
2. Related Work
2.1. Alignments Methods
2.2. Motivating Example
2.2.1. Limitations of Existing Methods
- Limited Logical Reasoning: Most embedding-based models focus on semantic similarity and fail to capture critical logical dependencies such as temporal or event-based relationships.
- Inefficient Handling of Sparse Graphs: Many methods struggle with sparse graphs in which entities and relations are not densely connected.
- Lack of Scalability: Existing methods often do not scale well with large knowledge graphs, as they rely on exhaustive pairwise comparisons or inefficient message propagation.
2.2.2. Key Contributions of EAL for Entity Alignment
- Logic-Enhanced Feature Learning: Unlike conventional embedding-based and GNN-based models that primarily rely on semantic similarity, EAL introduces an RNN-based logical feature learning mechanism to explicitly capture temporal-event dependencies. This enables a deeper understanding of complex entity relationships, resulting in significantly improved alignment accuracy.
- Adaptive Hierarchical Attention for Sparse Graphs: Many existing methods struggle with entity alignment in sparsely connected knowledge graphs. To address this, EAL incorporates a hierarchical logical attention mechanism that dynamically prioritizes informative relationships, ensuring robust performance even in cases of missing or incomplete entity connections.
- Scalable and Efficient Entity Alignment: Traditional GNN-based approaches often suffer from high computational costs due to excessive message passing. EAL overcomes this issue by employing a dynamic path pruning strategy, which selectively propagates only the most relevant logical paths. This reduces computational overhead while maintaining high alignment precision, making the proposed framework scalable for large-scale knowledge graphs.
3. Methodology
3.1. Proposed Framework for Entity Alignment
- Feature Extraction: Initial processing of knowledge graph entities and relations in order to obtain their representations.
- Logical Feature Learning: Capturing logical dependencies using an RNN-based reasoning mechanism.
- Attention Mechanism: Prioritizing the most relevant logical connections for effective alignment.
- Entity Alignment Optimization: Refining alignment predictions using an iterative learning process.
3.2. RNN-Based Logical Path Capture and Attention for Entity Alignment
3.2.1. Logical Path Capture and Encoding with EAL
Path Initialization
Logical Path Capture with RNN
3.2.2. RNN-Logics for Temporal-Event Reasoning in EAL
Temporal Logic Discovery
- Always Operator (□): The Always operator ensures the persistence of a condition over time, represented asThis operator ensures that the model retains a consistent state for logical conditions across all future temporal entities. For instance, in a health KG, it could capture the persistence of a chronic disease state across time periods.
- Until Operator (U): The Until operator models transitions in logical states, and is defined asThis operator models transitions in conditions, such as when a machine remains in an “operational” state until a “maintenance” event is triggered in a manufacturing KG.
- Eventually Operator (♢): The Eventually operator ensures that a condition holds at some point in the future, as expressed byThis supports reasoning about future occurrences of conditions, such as predicting future events in a social network KG.
Dynamic Logical Feature Encoding
Hierarchical Feature Propagation with RNN
Logical Triple Scoring with EAL
4. Experimental Results and Analysis
4.1. Datasets Overview
4.1.1. FB15K-DB15K
4.1.2. FB15K-YAGO15K
4.2. Experimental Setup
4.2.1. Hyperparameter Settings
- Learning Rate: We use an initial learning rate of , with exponential decay applied after every 10,000 steps to prevent overfitting and ensure convergence.
- Batch Size: The model was trained using a batch size of 32 for better memory utilization and training efficiency.
- Embedding Dimension: The entity and relation embeddings were set to a dimension of 100 to capture sufficient semantic information without introducing excessive model complexity.
- Number of Epochs: The model was trained for 50 epochs, with early stopping applied to prevent overfitting if the validation performance plateaued.
- Optimization Strategy: The model was trained with the Adam optimizer.
4.2.2. Evaluation Metrics
- Hits@K: This metric measures the proportion of correctly aligned entities ranked within the top-K predictions. A higher Hits@K score indicates better retrieval performance. We report Hits@1, Hits@5, and Hits@10 to evaluate the alignment accuracy across different ranking thresholds.
- Mean Reciprocal Rank (MRR): This metric evaluates the ranking quality of the correct entity by computing the average of the reciprocal ranks of the correct matches. Given a set of queries, MRR is defined as
4.2.3. Baseline Comparisons
- IPTransE [6]: IPTransE is an iterative extension of traditional translational embedding models like TransE.
- SEA [10]: A semantic-enhanced alignment framework that integrates additional linguistic features to improve alignment performance. It uses semi-supervised learning to better handle incomplete or noisy data.
- GCN-Align [13]: A graph convolutional network-based model that leverages structural information from knowledge graphs. GCN-Align combines both structural and semantic features of the graph for improved entity alignment.
- PoE-Ini [18]: A multimodal entity alignment model that incorporates visual and textual data sources, with an emphasis on aligning multimodal knowledge graphs. This method combines different knowledge sources for enhanced alignment performance.
- HMEA [14]: A multimodal entity alignment approach that explores various types of data, such as textual and visual, in order to enhance alignment accuracy. HMEA focuses on handling multimodal information to improve the alignment results in complex knowledge graphs.
- MMEA [15]: Multimodal entity alignment that combines multiple sources of knowledge (such as text, image, and structured data) to improve the accuracy of entity matching across different graphs. This method achieves a high level of alignment by fusing multimodal information.
- EVA [16]: A method focused on visual alignment, particularly for tasks where the visual properties of entities play a crucial role in aligning knowledge graphs. EVA uses visual features to complement traditional alignment techniques.
- MultiJAF [17]: A multimodal joint alignment framework that combines different types of data sources and structures to improve the accuracy of entity alignment across diverse knowledge graphs. It emphasizes a joint attention mechanism to optimize alignment precision.
4.3. Experimental Results and Analysis
4.3.1. Superior Accuracy on FB15K-DB15K
4.3.2. Scalability and Effectiveness on FB15K-YAGO15K
4.3.3. Computational Efficiency Analysis
4.4. Ablation Study
4.4.1. Impact of Model Components
- Without Logical Feature Learning (w/o LFL): The logical feature learning module is removed, leaving only structural and semantic features.
- Without Attention Mechanism (w/o Att): The attention mechanism is disabled, treating all paths equally in feature propagation.
4.4.2. Hyperparameter Sensitivity
- Embedding Dimension: The embedding size of 300 was varied to observe its effect on alignment accuracy.
- Learning Rate: We tested learning rates of {0.0001, 0.001, 0.01} to assess training stability.
4.5. Results of Entity Alignment with Complex-Event Logic
4.6. Error Analysis
- entities with generic labels, such as “National Park”, are occasionally misaligned due to insufficient distinguishing features.
- In sparse knowledge graphs, the absence of strong logical dependencies impacts the performance of temporal operators.
- Logical Feature Prioritization: By embedding logical operators and leveraging adaptive attention, EAL effectively captures both temporal and event-centric dependencies, which are often overlooked by traditional methods.
- Generalizability Across Graph Structures: The model exhibits consistent performance across datasets with varying levels of complexity, indicating its robustness and versatility in handling diverse knowledge graph scenarios.
- Enhanced Hierarchical Reasoning: EAL’s hierarchical feature aggregation mechanism enables it to integrate local and global relational patterns, providing a more comprehensive understanding of entity alignments.
5. Conclusions and Future Work
- Scalability Improvements: Although EAL shows good performance on existing benchmarks, its scalability can be further enhanced to handle extremely large knowledge graphs. Future work could focus on optimizing the feature propagation and attention mechanisms to ensure efficient alignment in highly sparse and large-scale graphs.
- Exploration of Additional Logical Reasoning Techniques: Our current approach primarily focuses on temporal and event-centric logical dependencies. Further research could explore other logical reasoning techniques, such as causal reasoning or spatial relationships, to help improve alignment accuracy in more complex scenarios.
- Extension to Temporal Reasoning: One promising direction is to extend the EAL framework to handle explicit temporal reasoning, thereby enabling it to effectively model dynamic knowledge graphs where entities evolve over time. This could be particularly useful in domains such as healthcare, finance, and social networks.
- Integration with Multimodal Knowledge Graphs: Another interesting direction is to extend EAL to multimodal knowledge graphs, where entities and relations are described using different data types such as text, images, and sensor data. Incorporating multimodal reasoning could significantly enhance the alignment of heterogeneous knowledge sources.
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Xia, Y.; Lan, M.; Luo, J.; Chen, X.; Zhou, G. Iterative rule-guided reasoning over sparse knowledge graphs with deep reinforcement learning. Inf. Process. Manag. 2022, 59, 103040. [Google Scholar] [CrossRef]
- Anelli, V.W.; Di Noia, T.; Di Sciascio, E.; Ferrara, A.; Mancino, A.C.M. Sparse feature factorization for recommender systems with knowledge graphs. In Proceedings of the Proceedings of the 15th ACM Conference on Recommender Systems, Amsterdam, The Netherlands, 27 September–1 October 2021; pp. 154–165. [Google Scholar]
- Bordes, A.; Usunier, N.; Garcia-Duran, A.; Weston, J.; Yakhnenko, O. Translating embeddings for modeling multi-relational data. In Proceedings of the NIPS’13: 27th International Conference on Neural Information Processing Systems, Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA, 5–8 December 2013; Volume 26. [Google Scholar]
- Hao, Y.; Zhang, Y.; He, S.; Liu, K.; Zhao, J. A Joint Embedding Method for Entity Alignment of Knowledge Bases. In Knowledge Graph and Semantic Computing: Semantic, Knowledge, and Linked Big Data; Chen, H., Ji, H., Sun, L., Wang, H., Qian, T., Ruan, T., Eds.; Springer: Singapore, 2016; p. 314. [Google Scholar]
- Chen, M.; Tian, Y.; Yang, M.; Zaniolo, C. Multilingual Knowledge Graph Embeddings for Cross-lingual Knowledge Alignment. In Proceedings of the 26th International Joint Conference on Artificial Intelligence, Melbourne, Australia, 19–25 August 2017; AAAI Press: Washington, DC, USA, 2017; pp. 1511–1517. [Google Scholar]
- Zhu, H.; Xie, R.; Liu, Z.; Sun, M. Iterative Entity Alignment via Joint Knowledge Embeddings. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17, Melbourne, Australia, 19–25 August 2017; pp. 4258–4264. [Google Scholar] [CrossRef]
- Qu, M.; Tang, J. Probabilistic logic neural networks for reasoning. In Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, BC, Canada, 8–14 December 2019; Volume 32. [Google Scholar]
- Sen, P.; de Carvalho, B.W.; Riegel, R.; Gray, A. Neuro-symbolic inductive logic programming with logical neural networks. In Proceedings of the AAAI Conference on Artificial Intelligence, Pomona, CA, USA, 24–28 October 2022; Volume 36, pp. 8212–8219. [Google Scholar]
- Qu, M.; Chen, J.; Xhonneux, L.P.; Bengio, Y.; Tang, J. RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphs. In Proceedings of the International Conference on Learning Representations, Addis Ababa, Ethiopia, 30 April 2020. [Google Scholar]
- Pei, S.; Yu, L.; Hoehndorf, R.; Zhang, X. Semi-supervised Entity Alignment via Knowledge Graph Embedding with Awareness of Degree Difference. In Proceedings of the The World Wide Web Conference, San Francisco, CA, USA, 13–17 May 2019; pp. 3130–3136. [Google Scholar]
- Wu, Y.; Liu, X.; Feng, Y.; Wang, Z.; Zhao, D. Jointly Learning Entity and Relation Representations for Entity Alignment. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, 3–7 November 2019; pp. 240–249. [Google Scholar] [CrossRef]
- Wu, Y.; Liu, X.; Feng, Y.; Wang, Z.; Yan, R.; Zhao, D. Relation-aware Entity Alignment for Heterogeneous Knowledge Graphs. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19), Macao, China, 10–16 August 2019; pp. 5278–5284. [Google Scholar]
- Wang, Z.; Lv, Q.; Lan, X.; Zhang, Y. Cross-lingual Knowledge Graph Alignment via Graph Convolutional Networks. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, 31 October–4 November 2018; pp. 349–357. [Google Scholar] [CrossRef]
- Guo, H.; Tang, J.; Zeng, W.; Zhao, X.; Liu, L. Multi-modal Entity Alignment in Hyperbolic Space. Neurocomputing 2021, 461, 598–607. [Google Scholar] [CrossRef]
- Chen, L.; Li, Z.; Wang, Y.; Xu, T.; Wang, Z.; Chen, E. Mmea: Entity Alignment for Multi-modal Knowledge Graph. In Knowledge Science, Engineering and Management; Li, G., Shen, H., Yuan, Y., Wang, X., Liu, H., Zhao, X., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 134–147. [Google Scholar]
- Liu, F.; Chen, M.; Roth, D.; Collier, N. Visual Pivoting for (Unsupervised) Entity Alignment. In Proceedings of the AAAI Conference on Artificial Intelligence, Virtual, 2–9 February 2021. [Google Scholar]
- Cheng, B.; Zhu, J.; Guo, M. MultiJAF: Multi-modal joint entity alignment framework for multi-modal knowledge graph. Neurocomputing 2022, 500, 581–591. [Google Scholar] [CrossRef]
- Liu, Y.; Li, H.; Garcia-Duran, A.; Niepert, M.; Onoro-Rubio, D.; Rosenblum, D. Mmkg: Multi-modal Knowledge Graphs. In The Semantic Web; Hitzler, P., Fernández, M., Janowicz, K., Zaveri, A., Gray, A., Lopez, V., Haller, A., Hammar, K., Eds.; Springer International Publishing: Cham, Switzerland, 2019; pp. 459–474. [Google Scholar]
- Lin, Y.; Liu, Z.; Sun, M.; Liu, Y.; Zhu, X. Learning entity and relation embeddings for knowledge graph completion. In Proceedings of the AAAI Conference on Artificial Intelligence, Austin, TX, USA, 25–30 January 2015; Volume 29. [Google Scholar]
- Wang, Z.; Zhang, J.; Feng, J.; Chen, Z. Knowledge graph embedding by translating on hyperplanes. In Proceedings of the AAAI Conference on Artificial Intelligence, Quebec City, QC, Canada, 27–31 July 2014; Volume 28. [Google Scholar]
- Vashishth, S.; Sanyal, S.; Nitin, V.; Talukdar, P. Composition-based Multi-Relational Graph Convolutional Networks. In Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA, 6–9 May 2019. [Google Scholar]
- Li, Z.; Huang, W.; Gong, X.; Luo, X.; Xiao, K.; Deng, H.; Zhang, M.; Zhang, Y. Decoupled semantic graph neural network for knowledge graph embedding. Neurocomputing 2025, 611, 128614. [Google Scholar] [CrossRef]
- Zhao, X.; Zeng, W.; Tang, J.; Wang, W.; Suchanek, F.M. An experimental study of state-of-the-art entity alignment approaches. IEEE Trans. Knowl. Data Eng. 2020, 34, 2610–2625. [Google Scholar] [CrossRef]
- Ge, C.; Liu, X.; Chen, L.; Zheng, B.; Gao, Y. Make it easy: An effective end-to-end entity alignment framework. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual, 11–15 July 2021; pp. 777–786. [Google Scholar]
- Zeng, W.; Zhao, X.; Tang, J.; Li, X.; Luo, M.; Zheng, Q. Towards entity alignment in the open world: An unsupervised approach. In Proceedings of the Database Systems for Advanced Applications: 26th International Conference, DASFAA 2021, Taipei, Taiwan, 11–14 April 2021; Proceedings, Part I 26. Springer: Cham, Switzerland, 2021; pp. 272–289. [Google Scholar]
Model | FB15K-DB15K | FB15K-YAGO15K | ||||||
---|---|---|---|---|---|---|---|---|
Hits@1 | Hits@5 | Hits@10 | MRR | Hits@1 | Hits@5 | Hits@10 | MRR | |
IPTransE [6] | 0.039 | 0.112 | 0.173 | 0.086 | 0.031 | 0.095 | 0.144 | 0.070 |
SEA [10] | 0.169 | 0.335 | 0.425 | 0.260 | 0.141 | 0.287 | 0.372 | 0.218 |
GCN-Align [13] | 0.043 | 0.109 | 0.155 | 0.082 | 0.023 | 0.072 | 0.107 | 0.053 |
PoE-Ini [18] | 0.120 | - | 0.256 | 0.167 | 0.109 | - | 0.241 | 0.154 |
HMEA [14] | 0.127 | - | 0.369 | - | 0.105 | - | 0.313 | - |
MMEA [15] | 0.265 | 0.451 | 0.541 | 0.357 | 0.234 | 0.398 | 0.479 | 0.317 |
EVA [16] | 0.213 | 0.391 | 0.475 | 0.301 | 0.171 | 0.335 | 0.417 | 0.260 |
MultiJAF [17] | 0.480 | 0.576 | 0.601 | 0.523 | 0.463 | 0.658 | 0.731 | 0.554 |
EAL(Ours) | 0.491 | 0.583 | 0.614 | 0.532 | 0.475 | 0.663 | 0.748 | 0.560 |
Model | Memory Usage (GB) |
---|---|
GCN-Align | 6.8 |
MultiJAF | 6.4 |
EAL (Ours) | 5.5 |
Model Variant | Hits@1 | Hits@5 | Hits@10 | MRR |
---|---|---|---|---|
Full Model (EAL) | 0.490 | 0.581 | 0.612 | 0.529 |
w/o Att | 0.482 | 0.572 | 0.610 | 0.517 |
w/o LFL | 0.467 | 0.562 | 0.595 | 0.511 |
w/o LFL and Att | 0.461 | 0.559 | 0.592 | 0.504 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Zeng, Y.; Hou, X.; Wang, X.; Li, J. Advancing Logic-Driven and Complex Event Perception Frameworks for Entity Alignment in Knowledge Graphs. Electronics 2025, 14, 670. https://doi.org/10.3390/electronics14040670
Zeng Y, Hou X, Wang X, Li J. Advancing Logic-Driven and Complex Event Perception Frameworks for Entity Alignment in Knowledge Graphs. Electronics. 2025; 14(4):670. https://doi.org/10.3390/electronics14040670
Chicago/Turabian StyleZeng, Yajian, Xiaorong Hou, Xinrui Wang, and Junying Li. 2025. "Advancing Logic-Driven and Complex Event Perception Frameworks for Entity Alignment in Knowledge Graphs" Electronics 14, no. 4: 670. https://doi.org/10.3390/electronics14040670
APA StyleZeng, Y., Hou, X., Wang, X., & Li, J. (2025). Advancing Logic-Driven and Complex Event Perception Frameworks for Entity Alignment in Knowledge Graphs. Electronics, 14(4), 670. https://doi.org/10.3390/electronics14040670