Feature extraction by dimensionality reduction is a critical step in pattern recognition. Principal component analysis (PCA) is a classic method for dimensionality reduction in the field of face recognition, which was proposed by Turk and Pentland in Ref. 1. Yang et al.2 presented two-dimensional PCA (2DPCA) to improve the efficiency of feature extraction, in which image matrices were used directly. Two-dimensional weighted PCA (2DWPCA) was developed in Ref. 3 to improve the performance of 2DPCA. The complete 2DPCA method was presented in Ref. 4 to reduce the feature coefficients needed for face recognition compared to 2DPCA. In kernel PCA (KPCA),5 samples were mapped into a high dimensional and linearly separable kernel space and then PCA was employed for feature extraction. Chen et al.6 presented a pattern classification method based on PCA and KPCA (kernel principal component analysis), in which within-class auxiliary training samples were used to improve the performance. Liu et al.7 proposed a 2DECA method, in which features are selected in 2DPCA subspace based on the Renyi entropy contribution instead of cumulative variance contribution. Moreover, some approaches based on linear

discriminant analysis (LDA) were explored.8–10

Contrast to the above Lnorm based methods, Kwak11 developed L-PCA by using LDing et al.12 proposed a rotational invariant Lnorm PCA (R-PCA). These none Lnorm based algorithms are less sensitive to the presence of outliers.

In this paper we propose 2DR-PCA and 2DL-PCA algorithms for face recognition by utilizing the advantages of Lnorm method and 2DPCA. Instead of using image vectors in Rand L-PCA, we use image matrices in 2DR-PCA and 2DL-PCA directly for features extraction. Compared to the 1-D methods, the corresponding 2-D methods have two main advantages: higher efficiency and recognition accuracy. We extend R-PCA to their two dimensional case and the 2DR-PCA and 2DL-PCA methods are proposed.

This paper is organized as follows: We give a brief introduction to the Ralgorithms in Section 2. In Section 3, the 2DR-PCA and 2DL-PCA algorithms are proposed. In Section 4, the mentioned methods are compared through experiments. Finally, conclusions are drawn in Section 5.

In this paper, we use to denote the training set of 1-D methods, where -dimensional vector.

2.1 R1-PCA

R-PCA algorithm tries to find a subspace by minimizing the following error function

where W is the projection matrix, V is defined as denotes the R

which is defined as

In R-PCA algorithm, the training set X should be centered, i.e.,mean vector of X, which is given by

The principal eigenvectors of the R-covariance matrix is the solution to R-PCA algorithm.

The weighted version of R-covariance matrix is defined as

The weight has many forms of definitions. For the Cauchy robust function, the weight is

The basic idea of R-PCA is starting with an initial guess and then iterate W with the

following equations until convergence

The concrete algorithm is given in Algorithm 1.

2.2 L1-PCA

The Lnorm is used in L-PCA for minimizing the following error function

where W is the projection matrix, V is defined as denotes the L

which is defined as

In order to obtain a subspace with the property of robust to outliers and invariant to rotations,

the Lnorm is adopted to maximize the following equation

It is difficult to solve the multidimensional version. Instead of using projection matrix W, a

column vector w is used in equation (8) and the following equation is obtained

Then a greedy search method is used for solving (9), which is summarized in Algorithm 2.

One best feature is extracted by the above algorithm. In order to obtain a k dimensional projection matrix instead of a vector, an algorithm based on the greedy search method is given as

follows

For j = 1 to k

End

In 2-D methods, is used to denote the training set, where

3.1 2DR1-PCA

In this paper we propose 2DR-PCA algorithm, in which we iterate the projection matrix W with an initial matrix until convergence.

First, the training set F is centered, i.e., is the mean matrix of F, defined

The Rcovariance matrix is defined as

The Cauchy weight is defined as

The residue is defined as

After obtaining the eigenvectors of , the iterative formula is similar to which used in the

The 2DR-PCA algorithm is outlined in Algorithm 3.

3.2 2DL1-PCA

Compared to L-PCA, in the two dimensional case we want to find a column vector to solve the

following problem

In fact, is a row vector. The number of maximum absolute value in a vector contributes most to its Lnorm. Assume that the column index of the maximum absolute value in we can calculate th column of -PCA algorithm is given in Algorithm 4.

Then we can obtain a k dimensional projection matrix from the following algorithm.

For j = 1 to k

End

Three databases: ORL, Yale and XM2VTS are used to test methods mentioned above. The recognition accuracy and running time of extracting features are recorded.

The ORL database contains face images from 40 different people and each person has 10 images, the resolution of which is 92112. Variation of expression (smile or not) and face details (wear a glass or not) are contained in the ORL database images. In the following experiments, 5 images are selected as the training samples and the rest are selected as the test samples.

The Yale database is provided by Yale University. This database contains face images from 15 different people and each has 11 images. The resolution of Yale database images is 160the following experiments, 6 images are selected as the training samples and the rest are selected as the test samples.

The XM2VTS13 database offers synchronized video and speech data as well as image sequences allowing multiple view of the face. It contains frontal face images taken of 295 subjects at one month intervals taken over a period of few months. The resolution of XM2VTS is 55the following experiments, 4 images are selected as the training samples and the rest are selected as the test samples.

4.1 R1-PCA and 2DR1-PCA

The experimental results of R-PCA and 2DR-PCA are shown in Table 1, and the number of iterations of R-PCA and 2DR-PCA is 120.

Table 1 Experimental results of R-PCA and 2DR

The initial projection matrix is obtained by PCA (2DPCA) at the beginning of R(2DR-PCA). The final projection matrix W is obtained by an iterative method starting with As a result of the iteration, the computational complexity is high. Meanwhile, they have nearly the same recognition accuracy.

In the experiment of R-PCA algorithm tested on the ORL database, the convergence process is shown in Fig. 1 (a), in which the y-coordinate denotes the norm of projection matrix and the x-coordinate denotes the number of iterations. The norm of a projection matrix is used to observe its convergent process. After iterating at least 100 times the projection matrix W converges. As a comparison, 2DR-PCA just needs less than 30 iteration to obtain a convergent projection matrix, which is shown in Fig. 1 (b). Image matrices used in 2DR-PCA leads to a faster convergence.

Fig 1 The convergence illustration of iterating 120 times on the ORL database. (a) R-PCA. (b) 2DR

The convergence illustration tested on the Yale database is shown in Fig. 2. The convergent speed of R-PCA is similar to that of 2DR-PCA. In the experiment tested on the XM2VTS database, the convergent speed of 2DR-PCA is much faster than that of R-PCA shown in Fig. 3. In other words, the efficiency of 2DR-PCA is higher than that of R

Fig 2 The convergence illustration of iterating 120 times on the Yale database. (a) R-PCA. (b) 2DR

Fig 3 The convergence illustration of iterating 120 times on the XM2VTS database. (a) R-PCA. (b) 2DR

4.2 L1-PCA and 2DL1-PCA

The experimental results of L-PCA and 2DL-PCA are shown in Table 2.

Table 2 Experimental results of L-PCA and 2DL

From Table 2 we can see that the performance of 2DL-PCA is better than that of LPCA. In 2DL-PCA, image matrices are used directly for feature extraction. Features extracted by 2DL-PCA is less than features extracted by L

We implement another experiment on the ORL database. Different number of features is extracted by PCA, L-PCA and 2DL-PCA, respectively. Then these features are used for face recognition. The experimental result is shown in Fig. 4, from which we can see that less features extracted by 2DL-PCA achieves a higher recognition accuracy.

Fig 4 Recognition accuracy versus different number of features on the ORL database.

In this paper we proposed 2DR-PCA and 2DL-PCA for face recognition. We extend Rand L-PCA to their 2-D case so that image matrices could be directly used for feature extraction. Compared to the Lnorm based methods, these Lnorm based methods are less sensitive to outliers. We analyze the performance of 2DR-PCA and 2DL-PCA against RPCA algorithms based on experiments. The experimental results show that the performance of 2DR-PCA and 2DL-PCA is better than that of R-PCA, respectively.

This work was partially supported by the National Natural Science Foundation of China (Grant No.61672265 and U1836218) and the 111 Project of Ministry of Education of China (Grant No.

B12018).

1 M. Turk and A. Pentland, “Eigenfaces for recognition,” Journal of cognitive neuroscience 3(1), 71–86 (1991).

2 J. Yang, D. Zhang, A. F. Frangi, et al., “Two-dimensional pca: a new approach to appearancebased face representation and recognition,” IEEE transactions on pattern analysis and machine intelligence 26(1), 131–137 (2004).

3 V. D. M. Nhat and S. Lee, “Two-dimensional weighted pca algorithm for face recognition,” in 2005 International Symposium on Computational Intelligence in Robotics and Automation, 219–223, IEEE (2005).

4 A. Xu, X. Jin, Y. Jiang, et al., “Complete two-dimensional pca for face recognition,” in 18th International Conference on Pattern Recognition (ICPR’06), 3, 481–484, IEEE (2006).

5 M.-H. Yang, N. Ahuja, and D. Kriegman, “Face recognition using kernel eigenfaces,” in Proceedings 2000 International Conference on Image Processing (Cat. No. 00CH37101), 1, 37–40, IEEE (2000).

6 S. Chen, X. Wu, and H. Yin, “Kpca method based on within-class auxiliary training samples and its application to pattern classification,” Pattern Analysis and Applications 20(3), 749– 767 (2017).

7 X. Liu and X.-J. Wu, “Eca and 2deca: Entropy contribution based methods for face recog- nition inspired by keca,” in 2011 International Conference of Soft Computing and Pattern Recognition (SoCPaR), 544–549, IEEE (2011).

8 W. Xiao-Jun, J. Kittler, Y. Jing-Yu, et al., “A new direct lda (d-lda) algorithm for feature extraction in face recognition,” in Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004., 4, 545–548, IEEE (2004).

9 Y.-J. Zheng, J.-Y. Yang, J. Yang, et al., “Nearest neighbour line nonparametric discriminant analysis for feature extraction,” Electronics Letters 42(12), 679–680 (2006).

analysis for robust subspace factorization,” in Proceedings of the 23rd international conference on Machine learning, 281–288, ACM (2006).

international conference on audio and video-based biometric person authentication, 964, 965–966 (1999).

List of Figures

1 The convergence illustration of iterating 120 times on the ORL database. (a) R

2 The convergence illustration of iterating 120 times on the Yale database. (a) R

3 The convergence illustration of iterating 120 times on the XM2VTS database. (a)

4 Recognition accuracy versus different number of features on the ORL database.

List of Tables

1 Experimental results of R-PCA and 2DR

2 Experimental results of L-PCA and 2DL