Fractional Complex Representation Learning with Memory Effects for Multi-Scale Knowledge Graph Modeling
Abstract
1. Introduction
1.1. Main Contributions
- We introduce a novel embedding model—Fractional ComplEx—that integrates fractional calculus with complex-valued knowledge graph embeddings.
- We provide a theoretical analysis that shows how fractional transformations introduce non-local memory, enhance embedding regularization, and preserve relational ranking consistency [1].
- We conduct extensive experiments on benchmark knowledge graph datasets, including FB15k-237, WN18RR, and CoDEx-M, demonstrating that the proposed model consistently improves link prediction performance.
- We perform a comprehensive sensitivity analysis examining the impact of fractional order parameters on model performance and embedding stability.
- We show that fractional embeddings provide a flexible mechanism for capturing multi-scale relational structures in knowledge graphs of various sizes and complexities.
1.2. Paper Organization
2. State of the Art
2.1. Translation-Based Knowledge Graph Embeddings
2.2. Semantic Matching and Bilinear Models
2.3. Geometric and Rotational Embedding Models
2.4. Graph Neural Network-Based Knowledge Graph Embeddings
2.5. Probabilistic and Generative Knowledge Graph Embeddings
2.6. Temporal and Dynamic Knowledge Graph Embeddings
2.7. Emerging Trends: Neuro-Symbolic and Multimodal Knowledge Graph Learning
2.8. Positioning of Fractional ComplEx
3. Fractional ComplEx: Theoretical Background
3.1. Fractional Calculus
3.2. Complex Embeddings (ComplEx)
3.3. Fractional ComplEx
3.4. Theoretical Insights Behind Fractional ComplEx
- Case 1: .
- Case 2: .
- Case 3: Crossing zero.
- Time Complexity Analysis:
- 2.
- Space Complexity Analysis:
4. Experimental Evaluation
4.1. Datasets
- FB15k-237 [45]: A subset of Freebase containing 14,541 entities and 237 relations, which removes inverse relation redundancy to prevent test leakage. It is widely used for link prediction evaluation.
- WN18RR [46]: A subset of WordNet designed to eliminate test leakage through inverse relations. It contains 40,943 entities and 11 relations, featuring challenging sparse link prediction tasks.
- CoDEx-Medium (CoDEx-M) [47]: A medium-sized knowledge graph extracted from Wikidata and DBpedia with over 16,000 entities and 200 relations, suitable for evaluating KGE models on moderate-scale graph structures.
4.2. Baseline Selection and Architectural Boundaries
4.3. Main Results and Comparative Analysis
4.4. Sensitivity Analysis of FracComplEx
- Analysis:
- Across all datasets, Fractional ComplEx consistently outperforms the baseline models (TransE, DistMult, ComplEx, RotatE, etc.), as evidenced by the higher MRR and Hits@10 values (Table 1, Table 2 and Table 3). This demonstrates the effectiveness of applying fractional-order transformations to complex embeddings to capture long-range and multi-scale relational dependencies.
- Sensitivity analysis indicates that the performance of Fractional ComplEx depends strongly on the fractional order . For FB15k-237 and WN18RR, moderate values of , around –, achieve the highest MRR and Hits@10 (Figure 2 and Figure 3). Values that are too small () or too large () lead to a significant degradation in performance, indicating an optimal fractional range for balancing memory effects and embedding flexibility.
- For CoDEx-M, higher values of (–) provide the best results in terms of both MRR and Hits@10 (Figure 4), reflecting the influence of dataset-dependent features such as sparsity, relation complexity, and graph connectivity. The model benefits from stronger fractional contributions in medium-sized knowledge graphs, where capturing multi-hop relationships is critical.
- The shaded confidence intervals in the sensitivity plots exhibit low variance over multiple runs. For example, on WN18RR at , the MRR varies around and the Hits@10 around , confirming the robustness and stability of the model under repeated training.
- Analyzing the trends across datasets reveals that smaller graphs (e.g., FB15k-237) achieve maximum performance at lower values than larger graphs (WN18RR, CoDEx-M), indicating that the optimal fractional order changes with the dataset size and relationship complexity.
- Overall, Fractional ComplEx not only improves absolute performance indicators, but also provides a controllable mechanism through that fine-tunes embedding expressiveness, thereby striking a balance between over-smoothing and under-regularization in the learned representations.
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Acknowledgments
Conflicts of Interest
Abbreviations
| KGE | Knowledge Graph Embedding |
| KG | Knowledge Graph |
| MRR | Mean Reciprocal Rank |
| MR | Mean Rank |
| GNN | Graph Neural Network |
| R-GCN | Relational Graph Convolutional Network |
| CompGCN | Composition-based Graph Convolutional Network |
References
- Nickel, M.; Murphy, K.; Tresp, V.; Gabrilovich, E. A review of relational machine learning for knowledge graphs. Proc. IEEE 2016, 104, 11–33. [Google Scholar] [CrossRef] [Scilit]
- Wang, Q.; Mao, Z.; Wang, B.; Guo, L. Knowledge graph embedding: A survey of approaches and applications. IEEE Trans. Knowl. Data Eng. 2017, 29, 2724–2743. [Google Scholar] [CrossRef] [Scilit]
- Bordes, A.; Usunier, N.; Garcia-Duran, A.; Weston, J.; Yakhnenko, O. Translating embeddings for modeling multi-relational data. Adv. Neural Inf. Process. Syst. 2013, 26, 2787–2795. [Google Scholar]
- Wang, Z.; Zhang, J.; Feng, J.; Chen, Z. Knowledge graph embedding by translating on hyperplanes. Proc. AAAI Conf. Artif. Intell. 2014, 28, 1112–1119. [Google Scholar] [CrossRef] [Scilit]
- Lin, Y.; Liu, Z.; Sun, M.; Liu, Y.; Zhu, X. Learning entity and relation embeddings for knowledge graph completion. Proc. AAAI Conf. Artif. Intell. 2015, 29, 2181–2187. [Google Scholar] [CrossRef] [Scilit]
- Ji, G.; He, S.; Xu, L.; Liu, K.; Zhao, J. Knowledge graph embedding via dynamic mapping matrix. In Proceedings of the 53rd Annual Meeting of the ACL and the 7th International Joint Conference on NLP, Beijing, China, 26–31 July 2015; Volume 1, pp. 687–696. [Google Scholar]
- Yang, B.; Yih, W.; He, X.; Gao, J.; Deng, L. Embedding entities and relations for learning and inference in knowledge bases. In Proceedings of the International Conference on Learning Representations (ICLR), San Diego, CA, USA, 7–9 May 2015. [Google Scholar]
- Trouillon, T.; Welbl, J.; Riedel, S.; Gaussier, E.; Bouchard, G. Complex embeddings for simple link prediction. In Proceedings of the 33rd International Conference on Machine Learning (ICML), JMLR 48, New York, NY, USA, 20–22 June 2016; pp. 2071–2080. [Google Scholar]
- Sun, Z.; Deng, Z.; Nie, J.; Tang, J. RotatE: Knowledge graph embedding by relational rotation in complex space. In Proceedings of the International Conference on Learning Representations (ICLR), New Orleans, LA, USA, 6–9 May 2019. [Google Scholar]
- Schlichtkrull, M.; Kipf, T.N.; Bloem, P.; van den Berg, R.; Titov, I.; Welling, M. Modeling relational data with graph convolutional networks. In The Semantic Web: 15th International Conference, ESWC 2018; Springer: Berlin/Heidelberg, Germany, 2018; pp. 593–607. [Google Scholar]
- Vashishth, S.; Sanyal, S.; Nitin, V.; Talukdar, P. Composition-based multi-relational graph convolutional networks. In Proceedings of the International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia, 26–30 April 2020. [Google Scholar]
- Podlubny, I. Fractional Differential Equations; Academic Press: San Diego, CA, USA, 1998. [Google Scholar]
- Kilbas, A.A.; Srivastava, H.M.; Trujillo, J.J. Theory and Applications of Fractional Differential Equations; Elsevier: Amsterdam, The Netherlands, 2006. [Google Scholar]
- Ji, G.; Liu, K.; He, S.; Zhao, J. Knowledge graph completion with adaptive sparse transfer matrix. In Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA, 12–17 February 2016; pp. 985–991. [Google Scholar]
- Xiao, H.; Huang, M.; Zhu, X. TransG: A generative mixture model for knowledge graph embedding. In Proceedings of the 54th Annual Meeting of the ACL, Berlin, Germany, 7–12 August 2016; Volume 1, pp. 2316–2325. [Google Scholar]
- Nickel, M.; Tresp, V.; Kriegel, H. A three-way model for collective learning on multi-relational data. In Proceedings of the 28th International Conference on Machine Learning (ICML), Bellevue, WA, USA, 28 June–2 July 2011; pp. 809–816. [Google Scholar]
- Nickel, M.; Rosasco, L.; Poggio, T. Holographic embeddings of knowledge graphs. Proc. AAAI Conf. Artif. Intell. 2016, 30, 1955–1961. [Google Scholar] [CrossRef] [Scilit]
- Kazemi, S.; Poole, D. SimplE embedding for link prediction in knowledge graphs. In Proceedings of the 32nd Conference on Neural Information Processing Systems (NeurIPS 2018), Montréal, QC, Canada, 3–8 December 2018; pp. 4289–4300. [Google Scholar]
- Ebisu, T.; Ichise, R. TorusE: Knowledge graph embedding on a Lie group. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI-18), New Orleans, LA, USA, 2–7 February 2018; pp. 1819–1826. [Google Scholar]
- Zhang, S.; Tay, Y.; Yao, L.; Liu, Q. Quaternion knowledge graph embeddings. Adv. Neural Inf. Process. Syst. 2019, 32, 2731–2741. [Google Scholar]
- Nickel, M.; Kiela, D. Poincaré embeddings for learning hierarchical representations. Adv. Neural Inf. Process. Syst. 2017, 30, 6338–6347. [Google Scholar]
- Chami, I.; Ying, Z.; Ré, C.; Leskovec, J. Hyperbolic graph convolutional neural networks. Adv. Neural Inf. Process. Syst. 2019, 32, 4869–4880. [Google Scholar] [PubMed]
- Veličković, P.; Cucurull, G.; Casanova, A.; Romero, A.; Liò, P.; Bengio, Y. Graph attention networks. In Proceedings of the 6th International Conference on Learning Representations (ICLR 2018), Vancouver, BC, Canada, 30 April–3 May 2018. [Google Scholar]
- Nathani, D.; Chauhan, J.; Sharma, C.; Kaul, M. Learning attention-based embeddings for relation prediction. In Proceedings of the 57th Annual Meeting of the ACL, Florence, Italy, 28 July–2 August 2019; pp. 4710–4723. [Google Scholar]
- Shi, Y.; Huang, Z.; Feng, S.; Zhong, H.; Wang, W.; Sun, Y. Masked label prediction: Unified message passing model for semi-supervised classification. In Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI-21), Montreal, QC, Canada, 19–27 August 2021; pp. 1548–1554. [Google Scholar]
- He, S.; Liu, K.; Ji, G.; Zhao, J. Learning to represent knowledge graphs with Gaussian embedding. In Proceedings of the 24th ACM International Conference on Information and Knowledge Management (CIKM’15), Melbourne, Australia, 18–23 October 2015; pp. 623–632. [Google Scholar]
- Abboud, R.; Ceylan, I.; Lukasiewicz, T.; Salvatori, T. BoxE: A box embedding model for knowledge base completion. Adv. Neural Inf. Process. Syst. 2020, 33, 9649–9661. [Google Scholar]
- Kipf, T.; Welling, M. Variational graph auto-encoders. arXiv 2016, arXiv:1611.07308. [Google Scholar]
- Cai, L.; Wang, W.Y. KBGAN: Adversarial learning for knowledge graph embeddings. In Proceedings of the 2018 Conference of the North American Chapter of the ACL (NAACL-HLT), New Orleans, LA, USA, 1–6 June 2018; pp. 1470–1480. [Google Scholar]
- Jiang, T.; Liu, T.; Ge, T.; Sha, L.; Li, S.; Chang, B.; Sui, Z. Encoding temporal information for time-aware link prediction. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP), Austin, TX, USA, 1–4 November 2016; pp. 2350–2354. [Google Scholar]
- Dasgupta, S.; Ray, S.; Talukdar, P. HyTE: Hyperplane-based temporally aware knowledge graph embedding. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP), Brussels, Belgium, 31 October–4 November 2018; pp. 1001–1011. [Google Scholar]
- Trivedi, R.; Dai, H.; Wang, Y.; Song, L. Know-Evolve: Deep temporal reasoning for dynamic knowledge graphs. In Proceedings of the 34th ICML 2017, Sydney, Australia, 6–11 August 2017; pp. 3462–3471. [Google Scholar]
- Kazemi, S.; Goel, R.; Jain, K.; Kobyzev, I.; Sethi, A.; Forsyth, P.; Poupart, P. Representation learning for dynamic graphs: A survey. J. Mach. Learn. Res. 2020, 21, 1–73. [Google Scholar] [CrossRef] [Scilit]
- Rossi, E.; Chamberlain, B.; Frasca, F.; Eynard, D.; Monti, F.; Bronstein, M. Temporal graph networks for deep learning on dynamic graphs. In Proceedings of the 37th International Conference on Machine Learning (ICML) Workshop, PMLR 119, Virtual, 13–18 July 2020. [Google Scholar]
- Pan, S.; Luo, L.; Wang, Y.; Chen, C.; Wang, J.; Wu, X. Unifying large language models and knowledge graphs: A roadmap. IEEE Trans. Knowl. Data Eng. 2024, 36, 3580–3599. [Google Scholar] [CrossRef] [Scilit]
- Ji, S.; Pan, S.; Cambria, E.; Marttinen, P.; Yu, P.S. A survey on knowledge graphs: Representation, acquisition, and applications. IEEE Trans. Neural Netw. Learn. Syst. 2022, 33, 494–514. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Zhu, X.; Li, Z.; Wang, X.; Jiang, X.; Sun, P.; Wang, X.; Xiao, Y.; Yuan, N.J. Multi-modal knowledge graph construction and application: A survey. IEEE Trans. Knowl. Data Eng. 2024, 36, 715–735. [Google Scholar] [CrossRef] [Scilit]
- Chen, Z.; Zhang, Y.; Fang, Y.; Geng, Y.; Guo, L.; Chen, X.; Li, Q.; Wen, Z.; Chen, J.; Zhu, Y.; et al. Knowledge graphs meet multi-modal learning: A comprehensive survey. arXiv 2024, arXiv:2402.05391. [Google Scholar]
- Luo, L.; Li, Y.-F.; Haffari, G.; Pan, S. Reasoning on graphs: Faithful and interpretable large language model reasoning. In Proceedings of the 12th International Conference on Learning Representations (ICLR 2024), Vienna, Austria, 7–11 May 2024. [Google Scholar]
- Galkin, M.; Yuan, X.; Mostafa, H.; Tang, J.; Zhu, Z. Towards foundation models for knowledge graph reasoning. In Proceedings of the 12th International Conference on Learning Representations (ICLR 2024), Vienna, Austria, 7–11 May 2024. [Google Scholar]
- Tarasov, V.E. Fractional Dynamics: Applications of Fractional Calculus to Dynamics of Particles, Fields and Media; Springer: Berlin/Heidelberg, Germany, 2019. [Google Scholar]
- Wang, J.; Wen, Y.; Gou, Y.; Ye, Z.; Chen, H. Fractional-order gradient descent learning of BP neural networks with Caputo derivative. Neural Netw. 2017, 89, 19–30. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Harrak, M.I.E.; Bahou, O.; Moutaouakil, K.E.; Nuino, A.; Abdellatif, E.; Patriciu, A.M. Fractional Variational Graph Autoencoders for Enhancing Non-Local Representation Learning on Graphs. Information 2026, 17, 446. [Google Scholar] [CrossRef] [Scilit]
- Oldham, K.B.; Spanier, J. The Fractional Calculus; Academic Press: New York, NY, USA, 1974. [Google Scholar]
- Toutanova, K.; Chen, D. Observed versus latent features for knowledge base and text inference. In Proceedings of the 3rd Workshop on Continuous Vector Space Models and Their Compositionality, Beijing, China, 26–31 July 2015; pp. 57–66. [Google Scholar]
- Dettmers, T.; Minervini, P.; Stenetorp, P.; Riedel, S. Convolutional 2D knowledge graph embeddings. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI), New Orleans, LA, USA, 2–7 February 2018; pp. 1811–1818. [Google Scholar]
- Safavi, T.; Koutra, D. CoDEx: A comprehensive knowledge graph completion benchmark. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online, 16–20 November 2020; pp. 8328–8350. [Google Scholar]




| Model/ | MR | MRR | Hits@1 | Hits@10 |
|---|---|---|---|---|
| Classical Models | ||||
| TransE | 363.08 | 0.2439 | 0.1743 | 0.3845 |
| TransH | 343.91 | 0.2443 | 0.1735 | 0.3875 |
| TransR | 292.64 | 0.2259 | 0.1473 | 0.3856 |
| TransD | 544.66 | 0.2336 | 0.1627 | 0.3806 |
| RESCAL | 278.44 | 0.2524 | 0.1794 | 0.4041 |
| DistMult | 746.59 | 0.1896 | 0.1363 | 0.2982 |
| ComplEx | 305.12 | 0.2558 | 0.1800 | 0.4133 |
| RotatE | 1034.98 | 0.0949 | 0.0415 | 0.2089 |
| Fractional ComplEx | ||||
| 289.84 | 0.2602 | 0.1797 | 0.4284 | |
| 292.92 | 0.2596 | 0.1797 | 0.4255 | |
| 269.34 | 0.2591 | 0.1795 | 0.4266 | |
| 269.76 | 0.2576 | 0.1777 | 0.4257 | |
| 268.88 | 0.2584 | 0.1788 | 0.4261 | |
| 290.33 | 0.2541 | 0.1757 | 0.4193 | |
| 311.19 | 0.2524 | 0.1744 | 0.4149 | |
| 387.93 | 0.2466 | 0.1706 | 0.4057 | |
| 501.02 | 0.2321 | 0.1598 | 0.3803 | |
| Model/ | MR | MRR | Hits@1 | Hits@10 |
|---|---|---|---|---|
| Classical Models | ||||
| TransE | 9227.95 | 0.0329 | 0.0174 | 0.0622 |
| TransH | 9429.58 | 0.0321 | 0.0174 | 0.0640 |
| TransR | 7493.73 | 0.0085 | 0.0010 | 0.0178 |
| TransD | 10,145.29 | 0.0280 | 0.0154 | 0.0540 |
| RESCAL | 17,921.81 | 0.0008 | 0.0003 | 0.0007 |
| DistMult | 12,078.26 | 0.0082 | 0.0017 | 0.0202 |
| ComplEx | 6835.71 | 0.0694 | 0.0434 | 0.1221 |
| RotatE | 8754.80 | 0.0423 | 0.0000 | 0.1320 |
| RGCN | 3963.19 | 0.0611 | 0.0342 | 0.1142 |
| CompGCN | 4544.10 | 0.0532 | 0.0301 | 0.0988 |
| Fractional ComplEx | ||||
| 4276.37 | 0.1227 | 0.0769 | 0.2035 | |
| 4313.43 | 0.1584 | 0.0978 | 0.2722 | |
| 3852.47 | 0.1509 | 0.0923 | 0.2633 | |
| 3859.64 | 0.1687 | 0.1012 | 0.3064 | |
| 3742.88 | 0.1755 | 0.1019 | 0.3140 | |
| 4039.79 | 0.1947 | 0.1180 | 0.3468 | |
| 4029.05 | 0.2093 | 0.1207 | 0.3803 | |
| 4301.57 | 0.2349 | 0.1412 | 0.4022 | |
| 5456.70 | 0.2249 | 0.1402 | 0.3724 | |
| Model/ | MR | MRR | Hits@1 | Hits@10 |
|---|---|---|---|---|
| Classical Models | ||||
| TransE | 151.06 | 0.2380 | 0.1357 | 0.4459 |
| TransH | 148.99 | 0.2389 | 0.1362 | 0.4528 |
| TransR | 140.73 | 0.1911 | 0.0712 | 0.4350 |
| TransD | 231.11 | 0.2376 | 0.1317 | 0.4674 |
| RESCAL | 140.36 | 0.2536 | 0.1435 | 0.4835 |
| DistMult | 161.19 | 0.2902 | 0.1729 | 0.5374 |
| ComplEx | 108.13 | 0.3238 | 0.1988 | 0.5917 |
| ConvE | 163.16 | 0.2927 | 0.1723 | 0.5454 |
| RGCN | 159.00 | 0.2312 | 0.1152 | 0.4913 |
| CompGCN | 144.48 | 0.2467 | 0.1306 | 0.4981 |
| SACN | 157.85 | 0.2405 | 0.1256 | 0.4957 |
| Fractional ComplEx | ||||
| 189.73 | 0.2908 | 0.1734 | 0.5487 | |
| 131.60 | 0.3065 | 0.1790 | 0.5925 | |
| 119.36 | 0.3213 | 0.1892 | 0.6175 | |
| 100.44 | 0.3270 | 0.1930 | 0.6318 | |
| 131.10 | 0.2808 | 0.1554 | 0.6078 | |
| 117.03 | 0.2827 | 0.1583 | 0.6088 | |
| 96.48 | 0.3376 | 0.2044 | 0.6335 | |
| 94.28 | 0.3309 | 0.1963 | 0.6328 | |
| 96.46 | 0.3348 | 0.2042 | 0.6299 | |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Nuino, A.; Bahou, O.; Yassine, S.; Ez-zaiym, M.; El Moutaouakil, K.; Treanta, S. Fractional Complex Representation Learning with Memory Effects for Multi-Scale Knowledge Graph Modeling. AppliedMath 2026, 6, 109. https://doi.org/10.3390/appliedmath6070109
Nuino A, Bahou O, Yassine S, Ez-zaiym M, El Moutaouakil K, Treanta S. Fractional Complex Representation Learning with Memory Effects for Multi-Scale Knowledge Graph Modeling. AppliedMath. 2026; 6(7):109. https://doi.org/10.3390/appliedmath6070109
Chicago/Turabian StyleNuino, Ahmed, Omar Bahou, Senhaji Yassine, Mustapha Ez-zaiym, Karim El Moutaouakil, and Savin Treanta. 2026. "Fractional Complex Representation Learning with Memory Effects for Multi-Scale Knowledge Graph Modeling" AppliedMath 6, no. 7: 109. https://doi.org/10.3390/appliedmath6070109
APA StyleNuino, A., Bahou, O., Yassine, S., Ez-zaiym, M., El Moutaouakil, K., & Treanta, S. (2026). Fractional Complex Representation Learning with Memory Effects for Multi-Scale Knowledge Graph Modeling. AppliedMath, 6(7), 109. https://doi.org/10.3390/appliedmath6070109

