Dual Graph Laplacian RPCA Method for Face Recognition Based on Anchor Points
Abstract
:1. Introduction
- 1.
- Integration of Graph Laplacian Embedding with RPCA We incorporate graph Laplacian embedding into RPCA to account for the spatial information inherent in the data. By representing the data as a graph, where nodes correspond to data points and edges reflect pairwise relationships (such as similarity or distance), the graph Laplacian matrix effectively captures the dataset’s underlying geometric structure.
- 2.
- Exploitation of Two-Sided Data Structure We leverage a dual perspective by obtaining the graph Laplacian from both the sample and feature dimensions. This approach enables us to capture intrinsic relationships not only among data points (samples) but also among features, thereby providing a more holistic representation of the data.
- 3.
- Introduction of Anchors for Computational Efficiency We introduce the concept of anchors to enhance the model’s running speed and reduce computational complexity. Anchors serve as representative points that summarize the data’s structure, thereby minimizing the number of pairwise comparisons needed during graph construction. Instead of computing relationships between all data points, we select a subset of anchors (using methods like random sampling, K-means, or other clustering techniques) and construct the graph based on the relationships between data points and these anchors. This method significantly reduces the size of the adjacency matrix and, consequently, the computational burden associated with the graph Laplacian.
2. Preliminaries
2.1. Quaternion and Quaternion Matrix
- 1.
- .
- 2.
- , where denotes transpose operation.
- 3.
- A is a column unitary matrix if and only if is a column orthogonal matrix.
2.2. Graph
- 1.
- For each vector , we have
- 2.
- L is symmetric and positive semi-definite.
- 3.
- The smallest eigenvalue of L is 0, and corresponding eigenvector is 1 whose elements are all ones.
- 4.
- L has n non-negative real eigenvalues .
2.3. Graph Laplacian Embedding
2.4. Anchors
- 1.
- K-means method for anchor pointsWe adopt the K-means clustering algorithm to derive a set of anchor points, which serve as representative prototypes for the underlying data distribution. Considering a dataset , the K-means algorithm aims to partition X into k disjoint clusters by minimizing the within-cluster sum of squares, formulated as [31]
- 2.
- BKHK method for anchor pointsThe Balanced and Hierarchical K-means (BKHK) algorithm is a hierarchical anchor point selection method that combines K-means and hierarchical clustering to recursively construct evenly distributed anchor points, thereby improving representation ability. In contrast to conventional K-means algorithms that execute a single-step partitioning of the dataset into a predetermined number of clusters, BKHK employs a hierarchical partitioning strategy. It recursively divides the dataset X into m sub-clusters, performing binary K-means at each step. This process continues until the desired number of clusters is achieved. The objective function of Balanced Binary K-means is defined as follows [32]
3. Methodology
Algorithm 1 The solution to optimize (26) |
- 1.
- The graph Laplacian matrices are positive semi-definite,
- 2.
- The iterative matrices and maintain full column rank,
- 3.
- The parameters satisfy , , and ,
- 1.
- Monotonic decrease of the objective function:
- 2.
- Convergence of primal variables:
- 3.
- Convergence of Lagrangian multipliers:
- Z-subproblem:
- S-subproblem:
- V-subproblem:
- U-subproblem:
4. Experiments
4.1. Datasets
4.2. Parameter Selection
4.3. Experiment Results
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Notation
Notation | Description |
X | data matrix of size |
n | number of samples |
m | number of features |
the i-th column of X | |
the i-th row of X | |
the trace norm of the matrix A | |
the Frobenius norm of the matrix A |
References
- Kirby, M.; Sirovich, L. Application of the Karhunen-Loeve procedure for the characterization of human faces. IEEE Trans. Pattern Anal. Mach. Intell. 1990, 12, 103–108. [Google Scholar]
- Turk, M.; Pentland, A. Eigenfaces for recognition. J. Cognit. Neurosci. 1991, 3, 71–86. [Google Scholar]
- Yang, J.; Zhang, D.; Frangi, A.F.; Yang, J.Y. Two-dimensional PCA: A new approach to appearance-based face representation and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2004, 26, 131–137. [Google Scholar] [PubMed]
- Torres, L.; Reutter, J.Y.; Lorente, L. The importance of the color information in face recognition. In Proceedings of the 1999 International Conference on Image Processing (Cat. 99CH36348), Kobe, Japan, 24–28 October 1999; Volume 3, pp. 627–631. [Google Scholar]
- Yang, J.; Liu, C. A general discriminant model for color face recognition. In Proceedings of the IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil, 14–21 October 2007; pp. 1–6. [Google Scholar]
- Xiang, X.; Yang, J.; Chen, Q. Color face recognition by PCA-like approach. Neurocomputing 2015, 228, 231–235. [Google Scholar]
- Zhu, Y.; Zhu, C.; Li, X. Improved principal component analysis and linear regression classification for face recognition. Signal Process. 2018, 145, 175–182. [Google Scholar]
- Wright, J.; Ganesh, A.; Rao, S.; Peng, Y.; Ma, Y. Robust Principal Component Analysis: Exact Recovery of Corrupted Low-rank Matrices via Convex Optimization. Adv. Neural Inf. Process. Syst.s 2009, 22, 2080–2088. [Google Scholar]
- Candès, E.J.; Li, X.; Ma, Y.; Wright, J. Robust principal component analysis. J. ACM 2009, 58, 1–37. [Google Scholar]
- Wright, J.; Ma, Y. Dense error correction via l1-minimization. lEEE Trans. Inf. Theory 2010, 56, 3540–3560. [Google Scholar]
- Zhou, T.; Tao, D. Greedy Bilateral Sketch, Completion & Smoothing. In Artificial Intelligence and Statistics; PMLR: Birmingham, UK, 2013; Volume 31, pp. 650–658. [Google Scholar]
- Le Bihan, N.; Sangwine, S.J. Quaternion principal component analysis of color images. In Proceedings of the 2003 International Conference on Image Processing (Cat. No.03CH37429), Barcelona, Spain, 14–17 September 2003; pp. 809–812. [Google Scholar]
- Jia, Z. The Eigenvalue Problem of Quaternion Matrix: Structure-Preserving Algorithms and Applications; Science Press: Beijing, China, 2019. [Google Scholar]
- Denis, P.; Carre, P.; Fernandez-Maloigne, C. Spatial and spectral quaternionic approaches for colour images. Comput. Vis. Image Understand. 2007, 107, 74–87. [Google Scholar]
- Shi, L.; Funt, B. Quaternion color texture segmentation. Comput. Vis. Image Understand. 2007, 107, 88–96. [Google Scholar]
- Zou, C.; Kou, K.I.; Wang, Y. Quaternion collaborative and sparse representation with application to color face recognition. IEEE Trans. Image Process. 2016, 25, 3287–3302. [Google Scholar]
- Xiao, X.; Chen, Y.; Gong, Y.J.; Zhou, Y. 2D quaternion sparse discriminant analysis. IEEE Trans. Image Process. 2020, 29, 2271–2286. [Google Scholar]
- Chen, Y.; Xiao, X.; Zhou, Y. Low-rank quaternion approximation for color image processing. IEEE Trans. Image Process. 2020, 29, 1426–1439. [Google Scholar]
- Wang, Q.W.; Xie, L.M.; Gao, Z.H. A Survey on Solving the Matrix Equation AXB = C with Applications. Mathematics 2025, 13, 450. [Google Scholar] [CrossRef]
- Jia, Z.R.; Wang, Q.W. The General Solution to a System of Tensor Equations over the Split Quaternion Algebra with Applications. Mathematics 2025, 13, 644. [Google Scholar] [CrossRef]
- Cai, D.; He, X.F.; Han, J.W.; Huang, T.S. Graph regularized nonnegative matrix factorization for data representation. IEEE Trans. Pattern Anal. Mach. Intell. 2011, 33, 1548–1560. [Google Scholar]
- Jiang, B.; Ding, C.; Luo, B.; Tang, J. Graph-laplacian PCA: Closed-form solution and robustness. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA, 25–27 June 2013. [Google Scholar]
- Feng, C.; Gao, Y.L.; Liu, J.X.; Zheng, C.H.; Yu, J. PCA based on graph laplacian regularization and P-norm for gene selection and clustering. IEEE Trans. Nanobiosci. 2017, 16, 257–265. [Google Scholar]
- Liu, J.X.; Wang, D.; Gao, Y.L.; Zheng, C.H.; Shang, J.L.; Liu, F.; Xu, Y. A joint-L2,1-norm-constraint-based semi-supervised feature extraction for RNA Seq data analysis. Neurocomputing 2017, 228, 263–269. [Google Scholar]
- Wang, J.; Liu, J.X.; Kong, X.Z.; Yuan, S.S.; Dai, L.Y. Laplacian regularized low-rank representation for cancer samples clustering. Comput. Biol. Chem. 2019, 78, 504–509. [Google Scholar]
- Yang, N.Y.; Duan, X.F.; Li, C.M.; Wang, Q.W. A new algorithm for solving a class of matrix optimization problem arising in unsupervised feature selection. Numer. Algorithms 2024. [Google Scholar] [CrossRef]
- Hamilton, W.R. Lectures on Quaternions. In Landmark Writings in Western Mathematics 1640–1940; Hodges and Smith: Dublin, Ireland, 1853. [Google Scholar]
- Jiang, T. Algebraic methods for diagonalization of a quaternion matrix in quaternionic quantum theory. J. Math. Phys. 2005, 46, 052106. [Google Scholar]
- Ding, L.; Li, C.; Jin, D.; Ding, S.F. Survey of spectral clustering based on graph theory. Pattern Recognit. 2024, 151, 110366. [Google Scholar]
- Kong, X.Z.; Song, Y.; Liu, J.X.; Zheng, C.H.; Yuan, S.S.; Wang, J.; Dai, L.Y. Joint Lp-Norm and L2,1-Norm Constrained Graph Laplacian PCA for Robust Tumor Sample Clustering and Gene Network Module Discovery. Front. Genet. 2021, 12, 621317. [Google Scholar]
- Zhao, H. Design and Implementation of an Improved K-Means Clustering algorithm. Mob. Inf. Syst. 2022, 2022, 6041484. [Google Scholar] [CrossRef]
- Gao, C.H.; Chen, W.Z.; Nie, F.P.; Yu, W.Z.; Wang, Z.H. Spectral clustering with linear embedding: A discrete clustering method for large-scale data. Pattern Recognit. 2024, 151, 110396. [Google Scholar]
- The Georgia Tech Face Database. Available online: http://www.anefian.com/research/face_reco.htm (accessed on 15 February 2025).
- The VGG Face2 Dataset. Available online: https://www.robots.ox.ac.uk/~vgg/data/vgg_face2/ (accessed on 15 February 2025).
Method | Accuracy (%) | Running Time (s) | Notes |
---|---|---|---|
Standard graph Laplacian | 73.8% | 991.94 | Baseline method |
K-means + graph Laplacian | 73.3% | 935.39 | K-means for anchor selection |
BKHK + graph Laplacian | 73.3% | 973.15 | BKHK for anchor selection |
Method | Accuracy (%) | Running Time (s) | Notes |
---|---|---|---|
Standard graph Laplacian | 73.3% | 2924.71 | Baseline method |
K-means + graph Laplacian | 72.9% | 2765.83 | K-means for anchor selection |
BKHK + graph Laplacian | 72.9% | 2132.40 | BKHK for anchor selection |
Method | Accuracy (%) | Running Time (s) | Notes |
---|---|---|---|
Standard graph Laplacian | 45.75 | 920.59 | Baseline method |
K-means + graph Laplacian | 43.75 | 914.04 | K-means for anchor selection |
BKHK + graph Laplacian | 43.75 | 844.23 | BKHK for anchor selection |
Method | Accuracy (%) | Running Time (s) | Notes |
---|---|---|---|
Standard graph Laplacian | 45.0 | 921.32 | Baseline method |
K-means + graph Laplacian | 42.5 | 896.81 | K-means for anchor selection |
BKHK + graph Laplacian | 42.5 | 802.37 | BKHK for anchor selection |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Zhuang, S.-T.; Wang, Q.-W.; Chen, J.-F. Dual Graph Laplacian RPCA Method for Face Recognition Based on Anchor Points. Symmetry 2025, 17, 691. https://doi.org/10.3390/sym17050691
Zhuang S-T, Wang Q-W, Chen J-F. Dual Graph Laplacian RPCA Method for Face Recognition Based on Anchor Points. Symmetry. 2025; 17(5):691. https://doi.org/10.3390/sym17050691
Chicago/Turabian StyleZhuang, Shu-Ting, Qing-Wen Wang, and Jiang-Feng Chen. 2025. "Dual Graph Laplacian RPCA Method for Face Recognition Based on Anchor Points" Symmetry 17, no. 5: 691. https://doi.org/10.3390/sym17050691
APA StyleZhuang, S.-T., Wang, Q.-W., & Chen, J.-F. (2025). Dual Graph Laplacian RPCA Method for Face Recognition Based on Anchor Points. Symmetry, 17(5), 691. https://doi.org/10.3390/sym17050691