CN106203256A - A kind of low resolution face identification method based on sparse holding canonical correlation analysis - Google Patents

A kind of low resolution face identification method based on sparse holding canonical correlation analysis Download PDF

Info

Publication number
CN106203256A
CN106203256A CN201610473709.2A CN201610473709A CN106203256A CN 106203256 A CN106203256 A CN 106203256A CN 201610473709 A CN201610473709 A CN 201610473709A CN 106203256 A CN106203256 A CN 106203256A
Authority
CN
China
Prior art keywords
resolution
face image
low
sparse
canonical correlation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610473709.2A
Other languages
Chinese (zh)
Inventor
贲晛烨
张鹏
张振月
刘吉松
张振卿
王云静
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong University
Original Assignee
Shandong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong University filed Critical Shandong University
Priority to CN201610473709.2A priority Critical patent/CN106203256A/en
Publication of CN106203256A publication Critical patent/CN106203256A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification

Abstract

The present invention provides a kind of low resolution face identification method based on sparse holding canonical correlation analysis.The present invention combines the sparse and thought of canonical correlation analysis, propose a kind of low resolution face identification method based on sparse holding canonical correlation analysis, the thought using canonical correlation analysis meets the maximum correlation requirement of the feature of extraction, achieve the fusion of high-resolution and low-resolution face characteristic authentication information, use sparse thought to keep structural information, improve the robustness of low resolution recognition of face.The present invention not only achieves the effective integration of high-resolution and low-resolution face characteristic collection authentication information, and enhances character representation and distinguishing ability, meets dependency and keeps structural information requirement.

Description

A kind of low resolution face identification method based on sparse holding canonical correlation analysis
Technical field
The present invention relates to a kind of low resolution face identification method based on sparse holding canonical correlation analysis, belong to calculating Machine vision and the technical field of pattern recognition.
Background technology
Face recognition technology obtains in recent decades and develops rapidly, especially under controlled scene, and recognition of face skill Art has begun to be applied.But, recognition of face is an extremely complex problem, and its difficulty is the transmutability of pattern, The face intrinsic factor such as major influence factors has age, the colour of skin, expression, illumination, the environmental factors such as block and video acquisition sets The standby changing factor brought.At present, in order to overcome the impact of face intrinsic factor and environmental factors, researcher has been devised by Various different algorithms, and achieve good effect;But, the always recognition of face of low resolution problem is difficult to overcome Difficult point.The difficulty of low resolution recognition of face problem essentially consists in data dimension between high-resolution human face and low resolution face Do not mate and diversity between data.
Under non-controllable scene, under the conditions of remote, testee is unconscious, facial image is caught by low quality photographic head Obtain.Owing to quality of human face image ratio is relatively low, lacking a large amount of discriminant information in low-resolution face image, this has challenged tradition significantly Face recognition algorithms.At present, face identification method based on low resolution is largely divided into two classes: one is by low resolution Facial image to identical size, then passes through principal component analysis, linear discriminant analysis with high-resolution human face image normalization And the conventional subspace dimension reduction method such as locality preserving projections carries out feature extraction.Although this kind of method overcomes high-resolution human face The unmatched problem of dimension between image and low-resolution face image, but the recognition effect that can not obtain.Two be based on The method of Coupling Metric study, its thought is by high-resolution human face image and low resolution face by coupling sub-space learning Image study one group mapping, and project to a common subspace, reduces the difference between face image data in class, increases class Between divergence between facial image.Based on this thought, Zhou et al. is inspired by linear discriminant analysis, proposes simultaneous differentiation point Analysis (Simultaneous Discriminant Analysis, SDA) algorithm, is incorporated into supervision message in sub-space learning; Similarly, Siena et al. is inspired and analyzes in big spacing Fisher, proposes a kind of coupling space Fisher and analyzes (Coupled Marginal Fisher Analysis, CMFA), CMFA to SDA has similar object function, but empty to low-dimensional after projection Interior data are made that different hypothesis;Ben et al. proposes a kind of coupling distance metric learning method, introduces similarity measurements Amount, not only achieves preferable effect in low resolution recognition of face and is also applied to cross-domain gait certification;It addition, canonical correlation divides Analysis is often used for weighing the similarity between two groups of data, obtains preferable effect in recent years in low resolution recognition of face, It addition, sparse thought is also widely used in recognition of face.
Low resolution recognition of face problem, owing to quality of human face image is low and dimension does not mates, has been challenged traditional significantly Face identification method.
Summary of the invention
For the problem existing for prior art, the present invention provides a kind of based on sparse holding canonical correlation analysis low point Resolution face identification method.The present invention combines the sparse and thought of canonical correlation analysis, it is proposed that a kind of based on sparse holding The low resolution face identification method of canonical correlation analysis, the thought of employing canonical correlation analysis meets the maximum of the feature of extraction Correlation requirement, it is achieved that the fusion of high-resolution and low-resolution face characteristic authentication information, uses sparse thought to keep structure letter Breath, improves the robustness of low resolution recognition of face.The present invention not only achieves high-resolution and low-resolution face characteristic collection authentication information Effective integration, and enhance character representation and distinguishing ability, meet dependency and keep structural information requirement.
Technical scheme is as follows:
A kind of low resolution face identification method based on sparse holding canonical correlation analysis includes training part and test Part;
Described training department divides and comprises the following steps that
First, effective spy of high-resolution human face image and low-resolution face image is extracted respectively by principal component analysis Levy and respectively obtain the principal component analysis projection matrix corresponding to high-resolution human face image and low-resolution face image;
Then, construct sparse reconstruction weights matrix, make sparse reconstructed error minimum, learn one group of matrix of a linear transformation, make Correlation maximum between the resolution that secures satisfactory grades facial image and low-resolution face image data, by low resolution training sample set and height Resolution training sample set projects in a common subspace;
Described part of detecting comprises the following steps that
First, the principal component analysis projection matrix corresponding to low-resolution face image using training department to get is treated The low-resolution face image sample surveyed carries out preliminary feature extraction;
Then, the throwing corresponding to low resolution training sample set then by sparse holding Canonical Correlation Analysis obtained The feature that upper step principal component analysis extracts is carried out Linear Mapping by shadow matrix;
Finally, by nearest neighbor classifier based on Euclidean distance, the sample after mapping is carried out Classification and Identification.
According to currently preferred, specifically comprising the following steps that of described training part
The high-resolution human face image training sample set making high-resolution human face image construction is H=[h1,h2,…,hN]∈ RM×N, the low-resolution face image training sample set that low-resolution face image is constituted is L=[l1,l2,…,lN]∈Rm×N, Wherein, hi∈RM,li∈RmRepresent respectively in high-resolution human face image training sample set and low-resolution face image training set I-th sample, M, m represent high-resolution human face image and the dimension of low-resolution face image sample respectively;
A. principal component analysis
As a example by high-resolution human face sample set, provide Principal Component Analysis Algorithm.Principal component analysis is a kind of effective special Levying linear transformation method, in essence, the data of higher-dimension are projected in lower dimensional space by linear transformation by PCA, maximize Variance, the data that projection obtains can represent initial data, eliminate noise and existence of redundant;
First the average facial image of N number of high-resolution human face image pattern is calculatedDivide according to main constituent Analysis principle, for N number of high-resolution human face image pattern object function be
a = arg m a x u T u = I a T 1 N Σ i = 1 N ( h i - h ‾ ) ( h i - h ‾ ) T a - - - ( 1 )
OrderThe most above-mentioned formula (1) is expressed asAccording to drawing Ge Lang function, formula (1) is converted into the following eigenvalue problem of solution
∑ a=λ a (2)
In formula (2), λ is the eigenvalue of ∑, and a is eigenvalue characteristic of correspondence vector;Covariance matrix is carried out eigenvalue Decompose, the front d obtainedhIndividual eigenvalue of maximum characteristic of correspondence vector is exactly optimal dhReform feature, Therefore, sample set is mapped in lower dimensional space,
X=ATH (3)
Similarly, the low-resolution face image training sample set constituted for low-resolution face image passes through above-mentioned master Component analysis procedure study projection matrixLow-resolution face image training sample is mapped to low-dimensional Space Y=BTL;
The most sparse holding canonical correlation analysis
Assuming that after above-mentioned principal component analysis process high-resolution human face image training sample set and low resolution face figure As training sample set is each mapped toWithFor each high score Distinguish facial image sample xi, all there is a corresponding subsample collectionBased on 1 model The target of number rarefaction representation finds one group of factor alpha exactlyi∈RN-1, meet xi=Miαi, and require αiMiddle absolute coefficient sum The least, it is expressed as follows by mathematical form:
min | | α i | | 1 s . t . x i = M i α i - - - ( 4 )
In actual applications, formula (4) condition is difficult to set up, and therefore considers the reconstruct of sample in above-mentioned Optimized model by mistake Difference, proposes a kind of stable rarefaction representation, is expressed as follows:
min | | α i ; t i | | s . t . x i = [ M i I ] α i t i - - - ( 5 )
Formula (5),Representing with intrinsic dimensionality with the unit matrix tieed up, above-mentioned Optimized model can be converted into convex programming Problem;
When obtaining sample xiIn corresponding subset MiOn rarefaction representation factor alphaiAfter, construct current sparse reconstruct power accordingly Weight matrix S=[s1,s2,…,sN], wherein, si=[αi,1,…,αi,i-1,0,αi,i,…,αi,N-1]T, αi,jRepresent αiJth Coefficient;Rarefaction representation is owing to can give, in the case of instructing without supervision message, the weighted value that similar sample is bigger;Therefore, Sparse Remodeling between this sample can represent an important measurement index with distinguishing ability as measures characteristic;
Assume that high-resolution human face image training sample set and low-resolution face image training sample set are led respectively The eigenmatrix obtained after component analysis is respectively In employing State sparse reconstruction weights matrix method, construct the sparse reconstruction weights matrix R=[r of two feature sets respectively1,r2,…,rN]∈ RN×NWith S=[s1,s2,…,sN]∈RN×N;Sparse holding canonical correlation analysis is intended to find a pair projection vector w and u, makes to carry Not only there is between high-resolution human face characteristics of image and low-resolution face image feature after taking the correlation coefficient of maximum, with Time projection latter two feature set in sparse reconstructed error the least;To sum up, sparse holding canonical correlation analysis object function It is defined as
m a x w , u w T S x y u min w ≠ 0 w T X ( I - R ) ( I - R ) T X T w min u ≠ 0 u T Y ( I - S ) ( I - S ) T Y T u - - - ( 6 )
In formula (6), SxyRepresent the Cross-covariance of X and Y, describe the dependency between two groups of variablees;Due to formula (6) Cannot direct solution, use the multiplication and division in evaluation function method that formula (6) is converted into following single object optimization model herein:
arg max w , u ≠ 0 ρ = w T S x y u w T S ~ x x w u T S ~ y y u - - - ( 7 )
In formula (7),WithIt is respectively the sparse of feature set X and Y Keep Scatter Matrix;They need to meet matrix positive definition condition simultaneously, and otherwise denominator may be 0 to cause model degradation;Adopt With method of Lagrange multipliers commonly used in canonical correlation analysis model optimization, the optimization problem of formula (7) is converted into following two Individual generalized eigenvalue problem:
S x y S ~ y y - 1 S x y T w = λ 2 S ~ x x w S x y T S ~ x x - 1 S x y u = λ 2 S ~ y y u - - - ( 8 )
And meet between w and u
{ S x y u = λ S ~ x x w S x y T w = λ S ~ y y u - - - ( 9 )
For generalized eigenvalue problem in formula (8), (9), front d group eigenvalue of maximum characteristic of correspondence vector wi,ui(i= 1 ..., d) constitute the projection matrix W=on high-resolution human face image pattern collection and low-resolution face image sample set [w1,…,wd]∈Rm×dWith U=[u1,…,ud]∈Rn×d;Therefore, high-resolution human face image and low-resolution face image are thrown The feature of movie queen is
Z = W T X Q = U T Y - - - ( 10 ) .
According to currently preferred, described part of detecting specifically includes following steps:
Given low-resolution face image test sample ltest, through principal component analysis and sparse holding canonical correlation Analyze to be characterized as after linear transformation
qtest=UTBTltest (11)
Finally use the described low resolution face figure based on sparse holding canonical correlation analysis of nearest neighbor classifier checking As the effectiveness of recognition methods feature extraction, carry out by calculating the Euclidean distance between training sample and test sample eigenvalue Classification, if
D i s ( l i , l t e s t ) = arg m i n i D i s ( q i , q t e s t ) = | | q i - q t e s t | | 2 - - - ( 12 )
Then ltestBelong to liThe classification at place, otherwise, ltestIt is not belonging to liThe classification at place, wherein, | | | |2Represent 2 models Number.The invention has the beneficial effects as follows:
1, the present invention proposes a kind of low resolution face identification method based on sparse holding canonical correlation analysis, by sparse Differentiate that thought incorporates in canonical correlation analysis model, not only maintain the dependency between two category features, and maintain data Structural information.
2, sparse holding canonical correlation analysis algorithm is applied to low resolution recognition of face by the present invention, it is to avoid high-resolution The unmatched problem of dimension between rate facial image and low-resolution face image.
3, the present invention provides a kind of effective low resolution face identification method, not only makes the high-resolution human face after projection Image and low-resolution face image have a correlation coefficient of maximum, and after making projection the reconstructed error in two feature sets is Little.
Accompanying drawing explanation
The flow chart of Fig. 1 present invention;
In Fig. 2 present invention, described high-resolution human face image and the comparison diagram of low resolution facial image;
Fig. 3 method proposed by the invention discrimination is with dimension situation of change.
Detailed description of the invention
With example, the present invention is described in detail below in conjunction with the accompanying drawings, but is not limited to this.
Embodiment,
A kind of low resolution face identification method based on sparse holding canonical correlation analysis, shown in accompanying drawing 1, including training Part and part of detecting;
Described training department divides and comprises the following steps that
First, effective spy of high-resolution human face image and low-resolution face image is extracted respectively by principal component analysis Levy and respectively obtain the principal component analysis projection matrix corresponding to high-resolution human face image and low-resolution face image;
Then, construct sparse reconstruction weights matrix, make sparse reconstructed error minimum, learn one group of matrix of a linear transformation, make Correlation maximum between the resolution that secures satisfactory grades facial image and low-resolution face image data, by low resolution training sample set and height Resolution training sample set projects in a common subspace;
Described part of detecting comprises the following steps that
First, the principal component analysis projection matrix corresponding to low-resolution face image using training department to get is treated The low-resolution face image sample surveyed carries out preliminary feature extraction;
Then, the throwing corresponding to low resolution training sample set then by sparse holding Canonical Correlation Analysis obtained The feature that upper step principal component analysis extracts is carried out Linear Mapping by shadow matrix;
Finally, by nearest neighbor classifier based on Euclidean distance, the sample after mapping is carried out Classification and Identification.
Specifically comprising the following steps that of described training part
The high-resolution human face image training sample set making high-resolution human face image construction is H=[h1,h2,…,hN]∈ RM×N, the low-resolution face image training sample set that low-resolution face image is constituted is L=[l1,l2,…,lN]∈Rm×N, Wherein, hi∈RM,li∈RmRepresent respectively in high-resolution human face image training sample set and low-resolution face image training set I-th sample, M, m represent high-resolution human face image and the dimension of low-resolution face image sample respectively;
High-resolution human face image contrasts as shown in Figure 2 with low-resolution face image, and low-resolution face image is relatively For high-resolution human face image, lacking substantial amounts of identification information, image visual effect the most drastically declines.
A. principal component analysis
As a example by high-resolution human face sample set, provide Principal Component Analysis Algorithm.Principal component analysis is a kind of effective special Levying linear transformation method, in essence, the data of higher-dimension are projected in lower dimensional space by linear transformation by PCA, maximize Variance, the data that projection obtains can represent initial data, eliminate noise and existence of redundant;
First the average facial image of N number of high-resolution human face image pattern is calculatedDivide according to main constituent Analysis principle, for N number of high-resolution human face image pattern object function be
a = arg m a x u T u = I a T 1 N Σ i = 1 N ( h i - h ‾ ) ( h i - h ‾ ) T a - - - ( 1 )
OrderThe most above-mentioned formula (1) is expressed asAccording to drawing Ge Lang function, formula (1) is converted into the following eigenvalue problem of solution
∑ a=λ a (2)
In formula (2), λ is the eigenvalue of ∑, and a is eigenvalue characteristic of correspondence vector;Covariance matrix is carried out eigenvalue Decompose, the front d obtainedhIndividual eigenvalue of maximum characteristic of correspondence vector is exactly optimal dhReform feature, Therefore, sample set is mapped in lower dimensional space,
X=ATH (3)
Similarly, the low-resolution face image training sample set constituted for low-resolution face image passes through above-mentioned master Component analysis procedure study projection matrixLow-resolution face image training sample is mapped to low-dimensional Space Y=BTL;
The most sparse holding canonical correlation analysis
Assuming that after above-mentioned principal component analysis process high-resolution human face image training sample set and low resolution face figure As training sample set is each mapped toWithFor each high score Distinguish facial image sample xi, all there is a corresponding subsample collectionBased on 1 model The target of number rarefaction representation finds one group of factor alpha exactlyi∈RN-1, meet xi=Miαi, and require αiMiddle absolute coefficient sum The least, it is expressed as follows by mathematical form:
min | | α i | | 1 s . t . x i = M i α i - - - ( 4 )
In actual applications, formula (4) condition is difficult to set up, and therefore considers the reconstruct of sample in above-mentioned Optimized model by mistake Difference, proposes a kind of stable rarefaction representation, is expressed as follows:
min | | α i ; t i | | s . t . x i = [ M i I ] α i t i - - - ( 5 )
Formula (5),Representing with intrinsic dimensionality with the unit matrix tieed up, above-mentioned Optimized model can be converted into convex programming Problem;
When obtaining sample xiIn corresponding subset MiOn rarefaction representation factor alphaiAfter, construct current sparse reconstruct power accordingly Weight matrix S=[s1,s2,…,sN], wherein, si=[αi,1,…,αi,i-1,0,αi,i,…,αi,N-1]T, αi,jRepresent αiJth Coefficient;Rarefaction representation is owing to can give, in the case of instructing without supervision message, the weighted value that similar sample is bigger;Therefore, Sparse Remodeling between this sample can represent an important measurement index with distinguishing ability as measures characteristic;
Assume that high-resolution human face image training sample set and low-resolution face image training sample set are led respectively The eigenmatrix obtained after component analysis is respectively In employing State sparse reconstruction weights matrix method, construct the sparse reconstruction weights matrix R=[r of two feature sets respectively1,r2,…,rN]∈ RN×NWith S=[s1,s2,…,sN]∈RN×N;Sparse holding canonical correlation analysis is intended to find a pair projection vector w and u, makes to carry Not only there is between high-resolution human face characteristics of image and low-resolution face image feature after taking the correlation coefficient of maximum, with Time projection latter two feature set in sparse reconstructed error the least;To sum up, sparse holding canonical correlation analysis object function It is defined as
m a x w , u w T S x y u min w ≠ 0 w T X ( I - R ) ( I - R ) T X T w min u ≠ 0 u T Y ( I - S ) ( I - S ) T Y T u - - - ( 6 )
In formula (6), SxyRepresent the Cross-covariance of X and Y, describe the dependency between two groups of variablees;Due to formula (6) Cannot direct solution, use the multiplication and division in evaluation function method that formula (6) is converted into following single object optimization model herein:
arg max w , u ≠ 0 ρ = w T S x y u w T S ~ x x w u T S ~ y y u - - - ( 7 )
In formula (7),WithIt is respectively the sparse of feature set X and Y Keep Scatter Matrix;They need to meet matrix positive definition condition simultaneously, and otherwise denominator may be 0 to cause model degradation;Adopt With method of Lagrange multipliers commonly used in canonical correlation analysis model optimization, the optimization problem of formula (7) is converted into following two Individual generalized eigenvalue problem:
S x y S ~ y y - 1 S x y T w = λ 2 S ~ x x w S x y T S ~ x x - 1 S x y u = λ 2 S ~ y y u - - - ( 8 )
And meet between w and u
{ S x y u = λ S ~ x x w S x y T w = λ S ~ y y u - - - ( 9 )
For generalized eigenvalue problem in formula (8), (9), front d group eigenvalue of maximum characteristic of correspondence vector wi,ui(i= 1 ..., d) constitute the projection matrix W=on high-resolution human face image pattern collection and low-resolution face image sample set [w1,…,wd]∈Rm×dWith U=[u1,…,ud]∈Rn×d;Therefore, high-resolution human face image and low-resolution face image are thrown The feature of movie queen is
Z = W T X Q = U T Y - - - ( 10 ) .
Described part of detecting specifically includes following steps:
Given low-resolution face image test sample ltest, through principal component analysis and sparse holding canonical correlation Analyze to be characterized as after linear transformation
qtest=UTBTltest (11)
Finally use the described low resolution face figure based on sparse holding canonical correlation analysis of nearest neighbor classifier checking As the effectiveness of recognition methods feature extraction, carry out by calculating the Euclidean distance between training sample and test sample eigenvalue Classification, if
D i s ( l i , l t e s t ) = arg m i n i D i s ( q i , q t e s t ) = | | q i - q t e s t | | 2 - - - ( 12 )
Then ltestBelong to liThe classification at place, otherwise, ltestIt is not belonging to liThe classification at place, wherein, | | | |2Represent 2 models Number.
Checking test:
On Extend YaleB face database, 38 people are carried out low resolution face recognition experiment.Wherein, each person 10 facial images also sample into high-resolution human face image that size is 24 × 21 as training sample, similarly, and 10 people Face image sampling becomes the low-resolution face image of 8 × 7 as test sample, and remaining 11 facial images are sampled into size and are The low-resolution face image of 8 × 7 is tested, and the method for the invention is under difference retains dimension, and discrimination change is as attached Shown in Fig. 3.Test respectively Selective principal component analysis (PCA), linear discriminant analysis (LDA), locality preserving projections (LPP), multi-thread Property dimensional analysis (MDS) and canonical correlation analysis (CCA) carry out contrast experiment, the highest discrimination comparing result under various methods As shown in table 1 below.
Table 1: the highest discrimination of various methods contrasts
Method PCA LDA LPP MDS CCA SPCCA
Discrimination 0.42 0.67 0.66 0.76 0.70 0.88
By accompanying drawing 3 it can be seen that the present invention propose low resolution based on sparse holding canonical correlation analysis (SPCCA) People's image-recognizing method discrimination is affected by dimension, and its highest discrimination is 0.88, by table 1 comparing result it can be seen that Method proposed by the invention has best recognition effect.

Claims (3)

1. a low resolution face identification method based on sparse holding canonical correlation analysis, it is characterised in that the method bag Include training part and part of detecting;
Described training department divides and comprises the following steps that
First, the validity feature of high-resolution human face image and low-resolution face image is extracted respectively by principal component analysis also Respectively obtain the principal component analysis projection matrix corresponding to high-resolution human face image and low-resolution face image;
Then, construct sparse reconstruction weights matrix, make sparse reconstructed error minimum, learn one group of matrix of a linear transformation so that be high Correlation maximum between resolution facial image and low-resolution face image data, by low resolution training sample set and high-resolution Rate training sample set projects in a common subspace;
Described part of detecting comprises the following steps that
First, use the principal component analysis projection matrix corresponding to low-resolution face image that training department gets to be measured Low-resolution face image sample carries out preliminary feature extraction;
Then, the projection square corresponding to low resolution training sample set then by sparse holding Canonical Correlation Analysis obtained The feature that upper step principal component analysis extracts is carried out Linear Mapping by battle array;
Finally, by nearest neighbor classifier based on Euclidean distance, the sample after mapping is carried out Classification and Identification.
A kind of low resolution face identification method based on sparse holding canonical correlation analysis the most according to claim 1, It is characterized in that, specifically comprising the following steps that of described training part
The high-resolution human face image training sample set making high-resolution human face image construction is H=[h1,h2,…,hN]∈RM×N, The low-resolution face image training sample set that low-resolution face image is constituted is L=[l1,l2,…,lN]∈Rm×N, wherein, hi∈RM,li∈RmRepresent i-th in high-resolution human face image training sample set and low-resolution face image training set respectively Sample, M, m represent high-resolution human face image and the dimension of low-resolution face image sample respectively;
A. principal component analysis
First the average facial image of N number of high-resolution human face image pattern is calculatedFor N number of high-resolution human Face image pattern object function is
a = arg m a x u T u = I a T 1 N Σ i = 1 N ( h i - h ‾ ) ( h i - h ‾ ) T a - - - ( 1 )
OrderThe most above-mentioned formula (1) is expressed asBright according to glug Day function, formula (1) is converted into the following eigenvalue problem of solution
∑ a=λ a (2)
In formula (2), λ is the eigenvalue of ∑, and a is eigenvalue characteristic of correspondence vector;Covariance matrix is carried out eigenvalue divide Solve, the front d obtainedhIndividual eigenvalue of maximum characteristic of correspondence vector is exactly optimal dhReform feature, Therefore, sample set is mapped in lower dimensional space,
X=ATH (3)
For low-resolution face image constitute low-resolution face image training sample set by above-mentioned principal component analysis mistake Journey study projection matrixLow-resolution face image training sample is mapped to lower dimensional space Y=BTL;
The most sparse holding canonical correlation analysis
Assuming that high-resolution human face image training sample set and low-resolution face image are instructed after above-mentioned principal component analysis process Practice sample set to be each mapped toWithFor each high-resolution people Face image pattern xi, all there is a corresponding subsample collectionDilute based on 1 norm The target that relieving the exterior syndrome shows finds one group of factor alpha exactlyi∈RN-1, meet xi=Miαi, and require αiMiddle absolute coefficient sum to the greatest extent may be used Can be little, it is expressed as follows by mathematical form:
min | | α i | | 1 s . t . x i = M i α i - - - ( 4 )
Propose a kind of stable rarefaction representation, be expressed as follows:
min | | α i ; t i | | s . t . x i = M i I α i t i - - - ( 5 )
Formula (5),Represent with intrinsic dimensionality with the unit matrix tieed up;
When obtaining sample xiIn corresponding subset MiOn rarefaction representation factor alphaiAfter, construct current sparse reconstruction weights square accordingly Battle array S=[s1,s2,…,sN], wherein, si=[αi,1,…,αi,i-1,0,αi,i,…,αi,N-1]T, αi,jRepresent αiJth coefficient;
Assume that high-resolution human face image training sample set and low-resolution face image training sample set carry out main constituent respectively The eigenmatrix obtained after analysis is respectively Use above-mentioned dilute Dredge reconstruction weights matrix method, construct the sparse reconstruction weights matrix R=[r of two feature sets respectively1,r2,…,rN]∈RN×NWith S=[s1,s2,…,sN]∈RN×N;Sparse holding canonical correlation analysis is intended to find a pair projection vector w and u, after making extraction Not only there is between high-resolution human face characteristics of image and low-resolution face image feature the correlation coefficient of maximum, project simultaneously Sparse reconstructed error in latter two feature set is the least;To sum up, sparse holding canonical correlation analysis object function is defined as
m a x w , u w T S x y u min w ≠ 0 w T X ( I - R ) ( I - R ) T X T w min u ≠ 0 u T Y ( I - S ) ( I - S ) T Y T u - - - ( 6 )
In formula (6), SxyRepresent the Cross-covariance of X and Y, describe the dependency between two groups of variablees;Owing to formula (6) cannot Direct solution, uses the multiplication and division in evaluation function method that formula (6) is converted into following single object optimization model herein:
arg max w , u ≠ 0 ρ = w T S x y u w T S ~ x x w u T S ~ y y u - - - ( 7 )
In formula (7),WithIt is respectively feature set X and the sparse holding of Y Scatter Matrix;Using method of Lagrange multipliers commonly used in canonical correlation analysis model optimization, the optimization problem of formula (7) turns Turn to following two generalized eigenvalue problems:
S x y S ~ y y - 1 S x y T w = λ 2 S ~ x x w S x y T S ~ x x - 1 S x y u = λ 2 S ~ y y u - - - ( 8 )
And meet between w and u
S x y u = λ S ~ x x w S x y T w = λ S ~ y y u - - - ( 9 )
For generalized eigenvalue problem in formula (8), (9), front d group eigenvalue of maximum characteristic of correspondence vector wi, ui(i=1 ..., D) the projection matrix W=[w on high-resolution human face image pattern collection and low-resolution face image sample set is constituted1..., wd] ∈Rm×dWith U=[u1..., ud]∈Rn×d;Therefore, the feature after high-resolution human face image and low-resolution face image project For
Z = W T X Q = U T Y - - - ( 10 ) .
A kind of low resolution face identification method based on sparse holding canonical correlation analysis the most according to claim 1, It is characterized in that, described part of detecting specifically includes following steps:
Given low-resolution face image test sample ltest, through principal component analysis and sparse holding canonical correlation analysis It is characterized as after obtaining linear transformation
qtest=UTBTltest (11)
The described low-resolution face image based on sparse holding canonical correlation analysis of nearest neighbor classifier checking is finally used to know The effectiveness that other method feature extracts, is carried out point by calculating the Euclidean distance between training sample and test sample eigenvalue Class, if
D i s ( l i , l t e s t ) = arg m i n i D i s ( q i , q t e s t ) = | | q i - q t e s t | | 2 - - - ( 12 )
Then ltestBelong to liThe classification at place, otherwise, ltestIt is not belonging to liThe classification at place, wherein, | | | |2Represent 2 norms.
CN201610473709.2A 2016-06-24 2016-06-24 A kind of low resolution face identification method based on sparse holding canonical correlation analysis Pending CN106203256A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610473709.2A CN106203256A (en) 2016-06-24 2016-06-24 A kind of low resolution face identification method based on sparse holding canonical correlation analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610473709.2A CN106203256A (en) 2016-06-24 2016-06-24 A kind of low resolution face identification method based on sparse holding canonical correlation analysis

Publications (1)

Publication Number Publication Date
CN106203256A true CN106203256A (en) 2016-12-07

Family

ID=57461831

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610473709.2A Pending CN106203256A (en) 2016-06-24 2016-06-24 A kind of low resolution face identification method based on sparse holding canonical correlation analysis

Country Status (1)

Country Link
CN (1) CN106203256A (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107133648A (en) * 2017-05-05 2017-09-05 南京航空航天大学 The sparse one-dimensional range profile recognition methods for keeping projecting is merged based on self-adapting multi-dimension
CN107832705A (en) * 2017-11-08 2018-03-23 天津大学 A kind of non-intrusion type load recognition methods based on canonical correlation analysis
CN108154495A (en) * 2017-11-17 2018-06-12 天津大学 Across the sensor remote sensing images relative spectral alignment algorithms of multidate based on DCCAE networks
CN109063565A (en) * 2018-06-29 2018-12-21 中国科学院信息工程研究所 A kind of low resolution face identification method and device
CN109191412A (en) * 2018-08-17 2019-01-11 河南工程学院 Based on the sparse canonical correlation analysis thermal infrared facial image visible light method for reconstructing of core
CN110188684A (en) * 2019-05-30 2019-08-30 湖南城市学院 A kind of face identification device and method
CN110796618A (en) * 2019-10-28 2020-02-14 公安部交通管理科学研究所 Digital portrait processing method, storage medium and system for certificate card laser endorsement
US10685428B2 (en) 2018-11-09 2020-06-16 Hong Kong Applied Science And Technology Research Institute Co., Ltd. Systems and methods for super-resolution synthesis based on weighted results from a random forest classifier
CN111611963A (en) * 2020-05-29 2020-09-01 扬州大学 Face recognition method based on neighbor preserving canonical correlation analysis
CN111986078A (en) * 2019-05-21 2020-11-24 四川大学 Multi-scale core CT image fusion reconstruction method based on guide data
CN112784857A (en) * 2021-01-29 2021-05-11 北京三快在线科技有限公司 Model training and image processing method and device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101697197A (en) * 2009-10-20 2010-04-21 西安交通大学 Method for recognizing human face based on typical correlation analysis spatial super-resolution
CN101710386A (en) * 2009-12-25 2010-05-19 西安交通大学 Super-resolution face recognition method based on relevant characteristic and non-liner mapping
CN103218795A (en) * 2013-05-05 2013-07-24 西安电子科技大学 Partial K space sequence image reconstruction method based on self-adapted double-dictionary learning

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101697197A (en) * 2009-10-20 2010-04-21 西安交通大学 Method for recognizing human face based on typical correlation analysis spatial super-resolution
CN101710386A (en) * 2009-12-25 2010-05-19 西安交通大学 Super-resolution face recognition method based on relevant characteristic and non-liner mapping
CN103218795A (en) * 2013-05-05 2013-07-24 西安电子科技大学 Partial K space sequence image reconstruction method based on self-adapted double-dictionary learning

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
侯书东: ""基于相关投影分析的特征提取研究及在图像识别中的应用"", 《万方》 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107133648B (en) * 2017-05-05 2020-08-04 南京航空航天大学 One-dimensional range profile identification method based on adaptive multi-scale fusion sparse preserving projection
CN107133648A (en) * 2017-05-05 2017-09-05 南京航空航天大学 The sparse one-dimensional range profile recognition methods for keeping projecting is merged based on self-adapting multi-dimension
CN107832705A (en) * 2017-11-08 2018-03-23 天津大学 A kind of non-intrusion type load recognition methods based on canonical correlation analysis
CN108154495A (en) * 2017-11-17 2018-06-12 天津大学 Across the sensor remote sensing images relative spectral alignment algorithms of multidate based on DCCAE networks
CN109063565B (en) * 2018-06-29 2021-12-10 中国科学院信息工程研究所 Low-resolution face recognition method and device
CN109063565A (en) * 2018-06-29 2018-12-21 中国科学院信息工程研究所 A kind of low resolution face identification method and device
CN109191412A (en) * 2018-08-17 2019-01-11 河南工程学院 Based on the sparse canonical correlation analysis thermal infrared facial image visible light method for reconstructing of core
US10685428B2 (en) 2018-11-09 2020-06-16 Hong Kong Applied Science And Technology Research Institute Co., Ltd. Systems and methods for super-resolution synthesis based on weighted results from a random forest classifier
CN111986078A (en) * 2019-05-21 2020-11-24 四川大学 Multi-scale core CT image fusion reconstruction method based on guide data
CN111986078B (en) * 2019-05-21 2023-02-10 四川大学 Multi-scale core CT image fusion reconstruction method based on guide data
CN110188684A (en) * 2019-05-30 2019-08-30 湖南城市学院 A kind of face identification device and method
CN110796618A (en) * 2019-10-28 2020-02-14 公安部交通管理科学研究所 Digital portrait processing method, storage medium and system for certificate card laser endorsement
CN110796618B (en) * 2019-10-28 2022-05-31 公安部交通管理科学研究所 Digital portrait processing method, storage medium and system for certificate card laser endorsement
CN111611963A (en) * 2020-05-29 2020-09-01 扬州大学 Face recognition method based on neighbor preserving canonical correlation analysis
CN111611963B (en) * 2020-05-29 2023-12-26 扬州大学 Face recognition method based on neighbor preservation canonical correlation analysis
CN112784857A (en) * 2021-01-29 2021-05-11 北京三快在线科技有限公司 Model training and image processing method and device

Similar Documents

Publication Publication Date Title
CN106203256A (en) A kind of low resolution face identification method based on sparse holding canonical correlation analysis
CN104866829B (en) A kind of across age face verification method based on feature learning
CN107463920A (en) A kind of face identification method for eliminating partial occlusion thing and influenceing
CN103605972B (en) Non-restricted environment face verification method based on block depth neural network
CN107403142B (en) A kind of detection method of micro- expression
CN106295124B (en) The method of a variety of image detecting technique comprehensive analysis gene subgraph likelihood probability amounts
CN109117826A (en) A kind of vehicle identification method of multiple features fusion
CN102013011B (en) Front-face-compensation-operator-based multi-pose human face recognition method
CN106897669A (en) A kind of pedestrian based on consistent iteration various visual angles transfer learning discrimination method again
CN102982322A (en) Face recognition method based on PCA (principal component analysis) image reconstruction and LDA (linear discriminant analysis)
CN105138972A (en) Face authentication method and device
CN106845397A (en) A kind of confirming face method based on measuring similarity
CN106529504B (en) A kind of bimodal video feeling recognition methods of compound space-time characteristic
CN107480623B (en) Neighbor preserving face recognition method based on collaborative representation
CN106295694A (en) A kind of face identification method of iteration weight set of constraints rarefaction representation classification
CN106169073A (en) A kind of expression recognition method and system
CN101853397A (en) Bionic human face detection method based on human visual characteristics
CN110969073B (en) Facial expression recognition method based on feature fusion and BP neural network
CN105844221A (en) Human face expression identification method based on Vadaboost screening characteristic block
CN109389045A (en) Micro- expression recognition method and device based on mixing space-time convolution model
CN109377429A (en) A kind of recognition of face quality-oriented education wisdom evaluation system
Qi et al. Learning complex spatio-temporal configurations of body joints for online activity recognition
CN107145841A (en) A kind of low-rank sparse face identification method and its system based on matrix
CN108960201A (en) A kind of expression recognition method extracted based on face key point and sparse expression is classified
CN103714340B (en) Self-adaptation feature extracting method based on image partitioning

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20161207