Learning Robust Node Representations via Graph Neural Network and Multilayer Perceptron Classifier
Abstract
1. Introduction
- We implement a two-stage node classification pipeline in the first phase, a GNN-based approach to generate node embeddings, and an MLP architecture to make smooth decisions for each node classification. This architecture enables the GNN to focus on producing informative, topology-aware representations.
- A comprehensive analysis of six different GNN algorithms is presented by incorporating them into the proposed architecture. This unified framework ensures a fair and consistent comparison by keeping the classification head and training protocol fixed while varying only the GNN encoder. Each technique is rigorously evaluated using multiple performance metrics, including Macro-F1, Micro-F1, Precision, and Recall, enabling a detailed assessment.
- Seven graph datasets are used for evaluating results, and each dataset is tested across different models. By applying every model to every dataset under identical experimental settings, the study enables a fair comparison and highlights the generalization capability and robustness of different GNN architectures across heterogeneous graph domains. Furthermore, we present comprehensive noise resilience experiments for each model to systematically assess their robustness against feature and label corruption.
2. GNN Datasets and Methods
2.1. Graph Benchmark Datasets
2.2. Graph Neural Network Methods
3. Proposed System Architecture
4. Experiment Results
4.1. Training of Each Model
4.2. Node Embedding Comparison
4.3. Comprehensive Evaluation of Models
4.4. Performance Under Noise Condition
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- L’Heureux, A.; Grolinger, K.; Elyamany, H.F.; Capretz, M.A.M. Machine Learning With Big Data: Challenges and Approaches. IEEE Access 2017, 5, 7776–7797. [Google Scholar] [CrossRef]
- Sejan, M.A.S.; Rahman, M.H.; Aziz, M.A.; Tabassum, R.; Baik, J.I.; Song, H.K. Powerful graph neural network for node classification of the IoT network. Internet Things 2024, 28, 101410. [Google Scholar] [CrossRef]
- Zhang, S.; Tong, H.; Xu, J.; Maciejewski, R. Graph convolutional networks: A comprehensive review. Comput. Soc. Netw. 2019, 6, 11. [Google Scholar] [CrossRef] [PubMed]
- Paul, S.G.; Saha, A.; Hasan, M.Z.; Noori, S.R.H.; Moustafa, A. A Systematic Review of Graph Neural Network in Healthcare-Based Applications: Recent Advances, Trends, and Future Directions. IEEE Access 2024, 12, 15145–15170. [Google Scholar] [CrossRef]
- Gupta, A.; Matta, P.; Pant, B. Graph neural network: Current state of Art, challenges and applications. Mater. Today Proc. 2021, 46, 10927–10932. [Google Scholar] [CrossRef]
- Sejan, M.A.S.; Rahman, M.H.; Aziz, M.A.; Tabassum, R.; Hameed, I.; Nasser, N.; Song, H.K. Graph neural network enhanced internet of things node classification with different node connections. J. Netw. Comput. Appl. 2025, 244, 104363. [Google Scholar] [CrossRef]
- Perozzi, B.; Al-Rfou, R.; Skiena, S. DeepWalk: Online learning of social representations. In KDD ’14: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, 24–27 August 2014; Association for Computing Machinery: New York, NY, USA, 2014; pp. 701–710. [Google Scholar] [CrossRef]
- Grover, A.; Leskovec, J. node2vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; Association for Computing Machinery: New York, NY, USA, 2016; pp. 855–864. [Google Scholar]
- Kipf, T. Semi-supervised classification with graph convolutional networks. arXiv 2016, arXiv:1609.02907. [Google Scholar]
- Veličković, P.; Cucurull, G.; Casanova, A.; Romero, A.; Liò, P.; Bengio, Y. Graph Attention Networks. In Proceedings of the ICLR; 2710 E Corridor Drive: Appleton, WI, USA, 2018. [Google Scholar]
- Li, Y.; Jian, C.; Zang, G.; Song, C.; Yuan, X. Node classification oriented adaptive multichannel heterogeneous graph neural network. Knowl.-Based Syst. 2024, 292, 111618. [Google Scholar] [CrossRef]
- Khemani, B.; Patil, S.; Kotecha, K.; Tanwar, S. A review of graph neural networks: Concepts, architectures, techniques, challenges, datasets, applications, and future directions. J. Big Data 2024, 11, 18. [Google Scholar] [CrossRef]
- Shchur, O.; Mumme, M.; Bojchevski, A.; Günnemann, S. Pitfalls of Graph Neural Network Evaluation. arXiv 2018, arXiv:1811.05868. [Google Scholar]
- Seo, C.; Jeong, K.J.; Lim, S.; Shin, W.Y. SiReN: Sign-aware recommendation using graph neural networks. IEEE Trans. Neural Netw. Learn. Syst. 2022, 35, 4729–4743. [Google Scholar] [CrossRef] [PubMed]
- Ye, M.; Liang, X.; Pan, C.; Xu, Y.; Jiang, M.; Li, C. Graph Neural Networks Based Channel Estimation for mmWave Massive MIMO Systems. IEEE Trans. Veh. Technol. 2025, 74, 19420–19435. [Google Scholar] [CrossRef]
- Yuan, L.; Jiang, P.; Hou, W.; Huang, W. G-MLP: Graph Multi-Layer Perceptron for Node Classification Using Contrastive Learning. IEEE Access 2024, 12, 104909–104919. [Google Scholar] [CrossRef]
- Shin, J.; Kaneko, Y.; Miah, A.S.M.; Hassan, N.; Nishimura, S. Anomaly detection in weakly supervised videos using multistage graphs and general deep learning based spatial-temporal feature enhancement. IEEE Access 2024, 12, 65213–65227. [Google Scholar] [CrossRef]
- Yang, Z.; Cohen, W.W.; Salakhutdinov, R. Revisiting Semi-Supervised Learning with Graph Embeddings. In ICML’16: Proceedings of the 33rd International Conference on International Conference on Machine Learning—Volume 48; PMLR: New York, NY, USA, 2016. [Google Scholar]
- Morris, C.; Ritzert, M.; Fey, M.; Hamilton, W.L.; Lenssen, J.E.; Rattan, G.; Grohe, M. Weisfeiler and Leman Go Neural: Higher-Order Graph Neural Networks. In AAAI’19/IAAI’19/EAAI’19: Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence and Thirty-First Innovative Applications of Artificial Intelligence Conference and Ninth AAAI Symposium on Educational Advances in Artificial Intelligence; AAAI Press: Honolulu, HI, USA, 2020. [Google Scholar]
- Du, J.; Zhang, S.; Wu, G.; Moura, J.M.F.; Kar, S. Topology Adaptive Graph Convolutional Networks. arXiv 2017, arXiv:1710.10370. [Google Scholar]
- Hamilton, W.; Ying, Z.; Leskovec, J. Inductive representation learning on large graphs. In NIPS’17: Proceedings of the 31st International Conference on Neural Information Processing Systems; Curran Associates Inc.: Red Hook, NY, USA, 2017; Volume 30. [Google Scholar]
- Li, G.; Xiong, C.; Thabet, A.; Ghanem, B. Deepergcn: All you need to train deeper gcns. arXiv 2020, arXiv:2006.07739. [Google Scholar] [CrossRef]
- Mo, Y.; Peng, L.; Xu, J.; Shi, X.; Zhu, X. Simple unsupervised graph representation learning. In Proceedings of the AAAI Conference on Artificial Intelligence; AAAI Press: Menlo Park, CA, USA, 2022; Volume 36, pp. 7797–7805. [Google Scholar]
- Peng, Z.; Huang, W.; Luo, M.; Zheng, Q.; Rong, Y.; Xu, T.; Huang, J. Graph representation learning via graphical mutual information maximization. In Proceedings of the Web Conference 2020; Association for Computing Machinery: New York, NY, USA, 2020; pp. 259–270. [Google Scholar]
- Zhu, Y.; Xu, Y.; Yu, F.; Liu, Q.; Wu, S.; Wang, L. Deep graph contrastive representation learning. arXiv 2020, arXiv:2006.04131. [Google Scholar] [CrossRef]
- Hassani, K.; Khasahmadi, A.H. Contrastive multi-view representation learning on graphs. In Proceedings of the International Conference on Machine Learning; Proceedings of Machine Learning Research: Waterloo, ON, Canada, 2020; pp. 4116–4126. [Google Scholar]
- Shou, Y.; Lan, H.; Cao, X. Contrastive graph representation learning with adversarial cross-view reconstruction and information bottleneck. Neural Netw. 2025, 184, 107094. [Google Scholar] [CrossRef] [PubMed]
- Zhu, Y.; Xu, Y.; Yu, F.; Liu, Q.; Wu, S.; Wang, L. Graph contrastive learning with adaptive augmentation. In Proceedings of the Web Conference 2021; Association for Computing Machinery: New York, NY, USA, 2021; pp. 2069–2080. [Google Scholar]
- Peng, L.; Mo, Y.; Xu, J.; Shen, J.; Shi, X.; Li, X.; Shen, H.T.; Zhu, X. GRLC: Graph representation learning with constraints. IEEE Trans. Neural Netw. Learn. Syst. 2023, 35, 8609–8622. [Google Scholar] [CrossRef] [PubMed]





| Dataset | Metric | TAGConv | SAGEConv | GCNConv | GATConv | GENConv | ChebConv |
|---|---|---|---|---|---|---|---|
| Amazon-computer | Training accuracy | ||||||
| Validation Accuracy | |||||||
| Test Accuracy | |||||||
| Amazon-photo | Training accuracy | ||||||
| Validation Accuracy | |||||||
| Test Accuracy | |||||||
| Citeseer | Training accuracy | ||||||
| Validation Accuracy | |||||||
| Test Accuracy | |||||||
| Cora | Training accuracy | ||||||
| Validation Accuracy | |||||||
| Test Accuracy | |||||||
| Corafull | Training accuracy | ||||||
| Validation Accuracy | |||||||
| Test Accuracy | |||||||
| PubMed | Training accuracy | ||||||
| Validation Accuracy | |||||||
| Test Accuracy | |||||||
| Wikics | Training accuracy | ||||||
| Validation Accuracy | |||||||
| Test Accuracy |
| Dataset | Model | TAGConv | SAGEConv | GCNConv | GATConv | GENConv | ChebConv |
|---|---|---|---|---|---|---|---|
| Amazon- computer | Only GNN | 4% increase | 6% increase | 7% increase | 5% increase | 19% increase | 6% increase |
| Only MLP | 33% increase | 34% increase | 33% increase | 32% increase | 33% increase | 31% increase | |
| Amazon- Photo | Only GNN | 3% increase | 3% increase | 1% increase | 1% increase | 7% increase | 2% increase |
| Only MLP | 36% increase | 36% increase | 27% increase | 27% increase | 33% increase | 29% increase | |
| Citeseer | Only GNN | 4% increase | 1% increase | 2% increase | 3% increase | 17% increase | 6% increase |
| Only MLP | 5% increase | 2% increase | 3% increase | 4% increase | 4% increase | 2% increase | |
| Cora | Only GNN | 4% increase | 3% increase | 2% increase | 2% increase | 23% increase | 7% increase |
| Only MLP | 12% increase | 12% increase | 8% increase | 8% increase | 8% increase | 11% increase | |
| PubMed | Only GNN | 4% increase | 1% increase | 3% increase | 2% increase | 6% increase | 3% increase |
| Only MLP | 5% increase | 3% increase | 3% increase | 1% increase | 4% increase | 2% increase | |
| Wikics | Only GNN | 4% increase | 3% increase | 5% increase | 6% increase | 6% increase | 3% increase |
| Only MLP | 8% increase | 11% increase | 1% increase | 10% increase | 13% increase | 8% increase |
| Dataset | Model | Macro-F1 | Micro-F1 | Precision | Recall | Time in Seconds |
|---|---|---|---|---|---|---|
| Amazon-computer | TAGConv | 827 | ||||
| SAGEConv | 327 | |||||
| GCNConv | 391 | |||||
| GATConv | 180 | |||||
| GENConv | 38,105 | |||||
| ChebConv | 235 | |||||
| Amazon-photo | TAGConv | 235 | ||||
| SAGEConv | 156 | |||||
| GCNConv | 170 | |||||
| GATConv | 70 | |||||
| GENConv | 13,092 | |||||
| ChebConv | 119 | |||||
| Citeseer | TAGConv | 35 | ||||
| SAGEConv | 65 | |||||
| GCNConv | 18 | |||||
| GATConv | 21 | |||||
| GENConv | 31 | |||||
| ChebConv | 37 | |||||
| Cora | TAGConv | 25 | ||||
| SAGEConv | 47 | |||||
| GCNConv | 19 | |||||
| GATConv | 24 | |||||
| GENConv | 28 | |||||
| ChebConv | 28 | |||||
| Corafull | TAGConv | 463 | ||||
| SAGEConv | 476 | |||||
| GCNConv | 91 | |||||
| GATConv | 113 | |||||
| GENConv | 296 | |||||
| ChebConv | 4273 | |||||
| PubMed | TAGConv | 378 | ||||
| SAGEConv | 239 | |||||
| GCNConv | 177 | |||||
| GATConv | 288 | |||||
| GENConv | 196 | |||||
| ChebConv | 99 | |||||
| Wikics | TAGConv | 688 | ||||
| SAGEConv | 261 | |||||
| GCNConv | 331 | |||||
| GATConv | 19,906 | |||||
| GENConv | 123,079 | |||||
| ChebConv | 507 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Sejan, M.A.S.; Rahman, M.H.; Aziz, M.A.; Hameed, I.; Islam, M.S.; Sabuj, S.R.; Song, H.-K. Learning Robust Node Representations via Graph Neural Network and Multilayer Perceptron Classifier. Mathematics 2026, 14, 680. https://doi.org/10.3390/math14040680
Sejan MAS, Rahman MH, Aziz MA, Hameed I, Islam MS, Sabuj SR, Song H-K. Learning Robust Node Representations via Graph Neural Network and Multilayer Perceptron Classifier. Mathematics. 2026; 14(4):680. https://doi.org/10.3390/math14040680
Chicago/Turabian StyleSejan, Mohammad Abrar Shakil, Md Habibur Rahman, Md Abdul Aziz, Iqra Hameed, Md Shofiqul Islam, Saifur Rahman Sabuj, and Hyoung-Kyu Song. 2026. "Learning Robust Node Representations via Graph Neural Network and Multilayer Perceptron Classifier" Mathematics 14, no. 4: 680. https://doi.org/10.3390/math14040680
APA StyleSejan, M. A. S., Rahman, M. H., Aziz, M. A., Hameed, I., Islam, M. S., Sabuj, S. R., & Song, H.-K. (2026). Learning Robust Node Representations via Graph Neural Network and Multilayer Perceptron Classifier. Mathematics, 14(4), 680. https://doi.org/10.3390/math14040680

