CN104881634A - Illumination face recognition method based on completed local convex-and-concave pattern - Google Patents

Illumination face recognition method based on completed local convex-and-concave pattern Download PDF

Info

Publication number
CN104881634A
CN104881634A CN201510223240.2A CN201510223240A CN104881634A CN 104881634 A CN104881634 A CN 104881634A CN 201510223240 A CN201510223240 A CN 201510223240A CN 104881634 A CN104881634 A CN 104881634A
Authority
CN
China
Prior art keywords
clccp
image
pixel
characteristic
block
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510223240.2A
Other languages
Chinese (zh)
Other versions
CN104881634B (en
Inventor
陈熙
晋杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kunming University of Science and Technology
Original Assignee
Kunming University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kunming University of Science and Technology filed Critical Kunming University of Science and Technology
Priority to CN201510223240.2A priority Critical patent/CN104881634B/en
Publication of CN104881634A publication Critical patent/CN104881634A/en
Application granted granted Critical
Publication of CN104881634B publication Critical patent/CN104881634B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/162Detection; Localisation; Normalisation using pixel segmentation or colour matching

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

The invention relates to an illumination face recognition method based on a completed local convex-and-concave pattern, and belongs to the pattern recognition field. The method includes the steps of dividing an image; carrying out bilinear interpolation for each piece of the image; encoding the symbol characteristic and the amplitude characteristic of a local difference of each pixel point in each piece of the image to obtain a symbol characteristic matrix and an amplitude characteristic matrix of each piece of the image; encoding pixel points of each piece of the image to obtain a central pixel characteristic matrix of each piece of the image, extracting the histogram characteristics of the three characteristic matrixes to obtain three characteristic vectors, and successively connecting the three characteristic vectors to obtain histogram characteristic vectors of all pieces of the image; and finally connecting the histogram characteristic vectors of all pieces of the image to obtain a histogram characteristic vector of the original image, sending the characteristic vector to the nearest neighboring classifier to be classified, and verifying the identity of an original face image. The method is an image texture description method based on second-order differential, and is capable of effectively identifying human faces in an illumination environment.

Description

A kind of illumination face recognition method based on complete Local Convex diesinking
Technical field
The present invention relates to a kind of illumination face recognition method based on complete Local Convex diesinking, belong to mode identification technology.
Background technology
Local binary patterns (Local binary pattern, LBP) [L.Wang and D.C.He, " Texture classification usingtexture spectrum ", Pattern Recognition, vol.23, pp.905-910,1990.] be a kind of important image characteristics extraction operator, there is the little and effective feature of calculated amount.Although LBP is successful in computer vision and area of pattern recognition, its working mechanism still has worth improvements.Dominant local binary patterns (Dominant local binary patterns, DLBP) [S.Liao, M.W.K.Law, and A.C.S.Chung, " Dominant local binary patterns for texture classification; " IEEETrans.Image Process., vol.18, no.5, pp.1107 – 1118, May 2009.] on all pattern bases of the LBP of statistical picture, filter out the pattern of upper frequency, and the high frequency mode that cumulative frequency reaches 80% is formed final proper vector.LBP only considers the symbolic information of center pixel and surrounding pixel difference, complete local binary patterns (Completed local binary pattern, CLBP) [Z.Guo, L.Zhang and D.Zhang, " A completed modeling of local binary pattern operator for textureclassification; " IEEE Trans.Image Process., vol.19, no.6, pp.1657-1663,2010.] not only consider symbolic information, also contemplate the amplitude information of difference and the feature of central pixel point.What LBP extracted is the first differential information of image, infinitesimal pattern (Local derivative pattern, LDP) [B.Zhang, Y.Gao, S.Zhao, and J.Liu, " Local derivative pattern versuslocal binary pattern:Face recognition with higher-order local pattern descriptor; " IEEE Trans.Image Process., vol.19, no.2, pp.533 – 544, Feb.2010.] improve LBP algorithm, be extracted the second-order differential information of image.In order to reduce the number of pattern in LBP algorithm, researchist proposes Central Symmetry infinitesimal pattern (Center-Symmetric Local derivativePattern, CS-LDP) [G.Xue, L.Song, J.Sun, M.Wu, Hybrid Center-Symmetric Local Pattern for DynamicBackground Subtraction, ICME, Barcelona, Spain (2011), pp.1 – 6, July 2011.] and Central Symmetry local binary patterns algorithm (Center-symmetric local binary pattern, CS-LBP) [Marko H, Matti P, Cordelia S.Description of interestregions with center-symmetric local binary pattern [C] //Conference on Computer Vision Graphics and ImageProcessing.2006, 4338:58-69].Local binary counting (Local binary count, LBC) [Zhao Y, Huang D S, Jia W, " Completed local binary count for rotation invariant texture classification, " IEEE Trans.Image Process., vol.21, no.10, pp.4492-4497,2012.] only consider that in binary pattern, pattern is the number of " 1 ".Unified local binary patterns decreases model number, decreases calculated amount [T.Ojala, M. t. " Gray scale and rotation invariant textureclassification with local binary patterns; " in:D.Vernon (Ed.), Proceedings of the Sixth European Conference onComputer Vision (ECCV2000), Dublin, Ireland, pp.404 – 420,2000.].In order to strengthen LBP algorithm extract the distinctive of texture, LBP algorithm also combines [Zhang W C with Gabor filter and some Data Dimensionality Reduction Algorithms, Shan S G, Gao W, et a1.Local Gabor Binary Pattern Histogram Sequence. (LGBPHS): A Novel Non-Statistical Model for FaceRepresentation and Recognition [C] Proc of the 10th IEEE Int ' l Conf on Computer Vision, 2005:786-791.; B.Zhang, S.Shan, X.Chen, and W.Gao, " Histogram of Gabor Phase Patterns (HGPP): A novel object representationapproach for face recognition, " IEEE Trans.Image Process., vol.16, no.1, pp.57 – 68,2007.].
LBP only considers the first differential information of image, the object of the present invention is to provide a kind of facial image second-order differential textural characteristics describing method based on image complete local convexo-concave characteristic (Completed Local convex-and-concave Pattern, CLCCP).
Summary of the invention
The invention provides a kind of illumination face recognition method based on complete Local Convex diesinking, for solution photoenvironment human face identification problem.Only can the defect of Description Image first differential for local binary patterns, the complete Local Convex diesinking that the present invention proposes can the second-order differential feature of effective Description Image.Complete Local Convex diesinking not only considers the symbolic information of local difference, and considers the amplitude characteristic of difference, also take into account the distinctive of central pixel point.
The illumination face recognition method that the present invention is based on complete Local Convex diesinking is achieved in that and first carries out piecemeal to image; Then bilinear interpolation is carried out to each block image, make each pixel in image can build 8 symmetry directions, then to calculate in block image each pixel along local, 8 directions difference; The symbolic feature CLCCP_S of this local difference of then encoding and amplitude characteristic CLCCP_M; Each pixel of each image block is encoded, obtains the center pixel feature CLCCP-C of each image block; Next the CLCCP_S to each block image, CLCCP_M and CLCCP_C eigenmatrix extracts histogram feature vector, connect this block image CLCCP_S successively, the histogram feature vector of CLCCP_S and CLCCP_C feature obtains the histogram feature vector of each block image; The histogram feature vector finally connecting each block image obtains the histogram feature vector of this original image, this proper vector is sent into and classifies based on the nearest neighbor classifier of chi amount, identify the identity of original facial image.
The concrete steps of the described illumination face recognition method based on complete Local Convex diesinking are as follows:
Step1, first image is carried out piecemeal: image I (l)evenly be divided into the zero lap square of 4 × 4,16 pieces altogether, be expressed as
Step2, bilinear interpolation computing is carried out to each block image, make each pixel can build about point-symmetric 8 directions of this pixel, then calculate the local difference of each pixel along different directions, this local difference is decomposed into symbolic component and and amplitude portion;
As shown in Figure 2, pixel P 1and P 2between can increase pixel Q by interpolation 1.Interpolation method as shown in Figure 4, wherein P 11, P 12, P 21, P 22be four neighbor pixels original in image, insert by interpolation method the pixel Q that makes new advances 0.Interpolation formula is as follows:
I R 1 ≈ x 2 - x x 2 - x 1 I P 11 + x - x 1 x 2 - x 1 I P 21 ,
I R 2 ≈ x 2 - x x 2 - x 1 I P 12 + x - x 1 x 2 - x 1 I P 22 ,
I Q 0 ≈ y 2 - y y 2 - y 1 I R 1 + y - y 1 y 2 - y 1 I R 2 ;
Wherein with represent R respectively 1, R 2with the pixel value of position, x 1, x and x 2represent pixel P respectively 11, R 1and P 21the horizontal ordinate at place, y 1, y and y 2represent pixel P respectively 11, Q 0and P 12the ordinate at place.Fig. 3 represents pixel X in original image 0there is P around 0, P 1, P 2, P 3, P 4, P 5, P 6and P 78 Neighbor Points, only can form four about pixel X 0symmetry direction.Fig. 2 represents pixel X after interpolation 0there is Q around 0, Q 1, Q 2, Q 3, Q 4, Q 5, Q 6and Q 78 interpolation points, therefore pixel X after interpolation 0one co-exist in 16 Neighbor Points around, 8 can be obtained about pixel X 0symmetry direction.Owing to adding interpolation point, the resolution of image is enhanced;
Pixel X in image block 0partial error along 8 directions is divided into with wherein i=0,1,2,3 and j=0,1,2,3;
Step3, symbolic component and amplitude portion carried out respectively to corresponding Local Convex diesinking coding, obtain symbolic feature CLCCP-S and the amplitude characteristic CLCCP-M of each block image, wherein pixel X 0symbolic feature and the coding formula of amplitude characteristic be respectively:
CLCCP - S 1,8 ( X 0 ) D = Σ i = 0 3 [ f ( I X 0 - 0.5 * ( I P i + I P i + 4 ) ) * 2 i * 2 ] + Σ j = 0 3 [ f ( I X 0 - 0.5 * ( I Q j + I Q j + 4 ) ) * 2 j * 2 + 1 ]
CLCCP - M 1,8 ( X 0 ) D = Σ i = 0 3 [ f ( abs ( I X 0 - 0.5 * ( I P i + I P i + 4 ) ) - c ) * 2 i * 2 ] + Σ j = 0 3 [ f ( abs ( I X 0 - 0.5 * ( I Q j + I Q j + 4 ) ) - c ) * 2 j * 2 + 1 ]
Wherein, CLCCP-S 1,8(X 0) drepresent pixel X 0the Local Convex concavity symbolic feature at place, CLCCP-M 1,8(X 0) drepresent pixel X 0the Local Convex concavity amplitude characteristic at place, f ( x ) = 0 , if x ≤ threshold 1 , if x > threshold , represent X in image 0the pixel value at place, with represent P in image iand P i+4the pixel value at place, with represent Q in image jand Q j+4the pixel value at place, abs () expression asks for signed magnitude arithmetic(al), CLCCP-S 1,8(X 0) dand CLCCP-M 1,8(X 0) dmiddle subscript " 1 " represents the pixel distance X that calculating convex-concave characteristic is used 0distance be 1, namely yardstick is 1, subscript " 8 " represent calculate through pixel X 0the convexo-concave characteristic in 8 directions, it is decimal system amount that subscript " D " represents, threshold is the threshold value pre-set;
Step4, to encode to each pixel of each image block, obtain the center pixel feature CLCCP-C of each image block, coding formula is: here c irepresent the mean value of entire image, represent X in image 0the pixel value at place, f ( x ) = 0 , if x ≤ threshold 1 , if x > threshold , CLCCP-C 1,8(X 0) dmiddle subscript " 1 " represents the pixel distance X that calculating convex-concave characteristic is used 0distance be 1, namely yardstick is 1, subscript " 8 " represent calculate through pixel X 0the convexo-concave characteristic in 8 directions, subscript " D " represents decimal system amount, and threshold is the threshold value pre-set;
Step5, through step Step2, Step3 and Step4, be extracted image block complete local convexo-concave characteristic, comprise and meet feature, amplitude characteristic and center pixel feature, work as image block in pixel X 0when traveling through whole image block, obtain each block image the eigenmatrix of CLCCP-S, CLCCP-M, CLCCP-C, be respectively
The histogram feature vector of Step6, the next each image block of extraction three eigenmatrixes, image block three eigenmatrixes histogram feature vector be expressed as: connect this three histogram feature vectors successively, obtain image block histogram feature vector H i ( l ) CLCCP = [ H i ( l ) CLCCP - S , H i ( l ) CLCCP - M , H i ( l ) CLCCP - C ] , Herein subscript CLCCP represent complete Local Convex diesinking feature, it comprises symbolic feature CLCCP-S, amplitude characteristic CLCCP-M and center pixel point patterns CLCCP-C;
Step7, connect each image block histogram feature vector, the complete Local Convex diesinking histogram feature vector obtaining original image is: I ( l ) CLCCP = [ H 0 ( l ) CLCCP , H 1 ( l ) CLCCP , . . . , H 15 ( l ) CLCCP ] ;
Step8, this proper vector send into classify based on the nearest neighbor classifier of chi amount, identify the identity of original facial image;
In described step Step8, when the nearest neighbor classifier based on chi amount is classified, first computer card side statistic; Set two width facial image I (0)and I (1)complete Local Convex diesinking histogram feature vector be respectively: I ( 0 ) CLCCP = [ H 0 ( 0 ) CLCCP , H 1 ( 0 ) CLCCP , . . . , H 15 ( 0 ) CLCCP ] With I ( 1 ) CLCCP = [ H 0 ( 1 ) CLCCP , H 1 ( 1 ) CLCCP , . . . , H 15 ( 1 ) CLCCP ] , Distance then between these two vectors, namely chi span is from the following formulae discovery of employing:
χ 2 ( I ( 0 ) CLCCP , I ( 1 ) CLCCP ) = Σ i = 1 K ′ ( I ( 0 ) CLCCP ( i ) - I ( 1 ) CLCCP ( i ) ) 2 ( I ( 0 ) CLCCP ( i ) + I ( 1 ) CLCCP ( i ) + eps )
Wherein I (0) cLCCP(i) and I (1) cLCCPi () represents texture feature vector I respectively (0) cLCCPand I (1) cLCCPi-th element, K' represents the length of texture, and eps is a fixed value, is positive number minimum in Matlab, represents one and makes I (0) cLCCP(i)+I (1) cLCCPthe very little normal number of (i)+eps ≠ 0.
The invention has the beneficial effects as follows:
1, the complete Local Convex diesinking facial image Texture Segmentation Algorithm of the present invention's structure is a kind of texture description operator based on image second order differential characteristics, and overcoming LBP can only the defect of Description Image first differential information;
2, the complete Local Convex diesinking facial image Texture Segmentation Algorithm of the present invention's structure not only describes the symbolic information of image local convexo-concave characteristic, also describe the amplitude characteristic of image local convexo-concave characteristic, and consider the distinguishing ability of picture centre pixel, merge the distinctive that this three improves texture;
3, this method not only considers the concavity of facial image local grain, also contemplates the size of image local texture concavity.When the experiment of recognition of face aspect shows that this algorithm carries out illumination recognition of face, computation complexity is low, and accuracy of identification is high, has insensitivity to illumination;
4, in the match cognization stage, the present invention adopts chi amount (Chi square statistic) as the distance metric between two texture feature vectors, employing nearest neighbor classifier is classified, and algorithm is simple, convenience of calculation, can accomplish real-time images match identification.
Accompanying drawing explanation
Fig. 1 is image complete Local Convex diesinking characteristic extraction step schematic block diagram in the present invention;
Fig. 2 is present invention pixel point X 08 symmetry direction schematic diagram;
Fig. 3 is pixel 4 symmetry direction schematic diagram in image of the present invention;
Fig. 4 is bilinear interpolation schematic diagram in the present invention;
Fig. 5 is 64 sample images of a people in embodiment of the present invention the extended used YaleB face database illumination subset;
Fig. 6 is local binary patterns in the present invention, unified local binary patterns (Uniform local binary pattern, UniformLBP), complete local binary patterns and the cumulative matching characteristic curve of this method on the extended Yale B database;
Fig. 7 is local binary patterns in the present invention, the correct recognition rata curve of unified local binary patterns, complete local binary patterns and this method on theextended Yale B database.
Embodiment
Embodiment 1: as shown in figs. 1-7, a kind of illumination face recognition method based on complete Local Convex diesinking, first carries out piecemeal to image; Then bilinear interpolation is carried out to each block image, make each pixel in image can build 8 symmetry directions, then to calculate in block image each pixel along local, 8 directions difference; The symbolic feature of this local difference of then encoding and amplitude characteristic; Each pixel of each image block is encoded, obtains the center pixel feature of each image block; The eigenmatrix of the following symbolic feature to each block image, amplitude characteristic, center pixel feature extracts histogram feature vector, connects the vectorial histogram feature vector obtaining each block image of histogram feature of this block image symbolic feature, amplitude characteristic, center pixel feature successively; The histogram feature vector finally connecting each block image obtains the histogram feature vector of this original image, this proper vector is sent into and classifies based on the nearest neighbor classifier of chi amount, identify the identity of original facial image.
The concrete steps of the described illumination face recognition method based on complete Local Convex diesinking are as follows:
Step1, first image is carried out piecemeal: image I (l)evenly be divided into the zero lap square of 4 × 4,16 pieces altogether, be expressed as
Step2, bilinear interpolation computing is carried out to each block image, make each pixel can build about point-symmetric 8 directions of this pixel, then calculate the local difference of each pixel along different directions, this local difference is decomposed into symbolic component and and amplitude portion;
Step3, symbolic component and amplitude portion carried out respectively to corresponding Local Convex diesinking coding, obtain symbolic feature CLCCP-S and the amplitude characteristic CLCCP-M of each block image, wherein pixel X 0symbolic feature and the coding formula of amplitude characteristic be respectively:
CLCCP - S 1,8 ( X 0 ) D = Σ i = 0 3 [ f ( I X 0 - 0.5 * ( I P i + I P i + 4 ) ) * 2 i * 2 ] + Σ j = 0 3 [ f ( I X 0 - 0.5 * ( I Q j + I Q j + 4 ) ) * 2 j * 2 + 1 ]
CLCCP - M 1,8 ( X 0 ) D = Σ i = 0 3 [ f ( abs ( I X 0 - 0.5 * ( I P i + I P i + 4 ) ) - c ) * 2 i * 2 ] + Σ j = 0 3 [ f ( abs ( I X 0 - 0.5 * ( I Q j + I Q j + 4 ) ) - c ) * 2 j * 2 + 1 ]
Wherein, CLCCP-S 1,8(X 0) drepresent pixel X 0the Local Convex concavity symbolic feature at place, CLCCP-M 1,8(X 0) drepresent pixel X 0the Local Convex concavity amplitude characteristic at place, f ( x ) = 0 , if x ≤ threshold 1 , if x > threshold , represent X in image 0the pixel value at place, with represent P in image iand P i+4the pixel value at place, with represent Q in image jand Q j+4the pixel value at place, abs () expression asks for signed magnitude arithmetic(al), CLCCP-S 1,8(X 0) dand CLCCP-M 1,8(X 0) dmiddle subscript " 1 " represents the pixel distance X that calculating convex-concave characteristic is used 0distance be 1, namely yardstick is 1, subscript " 8 " represent calculate through pixel X 0the convexo-concave characteristic in 8 directions, it is decimal system amount that subscript " D " represents, threshold is the threshold value pre-set;
Step4, to encode to each pixel of each image block, obtain the center pixel feature CLCCP-C of each image block, coding formula is: here c irepresent the mean value of entire image, represent X in image 0the pixel value at place, f ( x ) = 0 , if x ≤ threshold 1 , if x > threshold , CLCCP-C 1,8(X 0) dmiddle subscript " 1 " represents the pixel distance X that calculating convex-concave characteristic is used 0distance be 1, namely yardstick is 1, subscript " 8 " represent calculate through pixel X 0the convexo-concave characteristic in 8 directions, subscript " D " represents decimal system amount, and threshold is the threshold value pre-set;
Step5, through step Step2, Step3 and Step4, be extracted image block complete local convexo-concave characteristic, comprise and meet feature, amplitude characteristic and center pixel feature, work as image block in pixel X 0when traveling through whole image block, obtain each block image the eigenmatrix of CLCCP-S, CLCCP-M, CLCCP-C, be respectively
The histogram feature vector of Step6, the next each image block of extraction three eigenmatrixes, image block three eigenmatrixes histogram feature vector be expressed as: connect this three histogram feature vectors successively, obtain image block histogram feature vector H i ( l ) CLCCP = [ H i ( l ) CLCCP - S , H i ( l ) CLCCP - M , H i ( l ) CLCCP - C ] , Herein subscript CLCCP represent complete Local Convex diesinking feature, it comprises symbolic feature CLCCP-S, amplitude characteristic CLCCP-M and center pixel point patterns CLCCP-C;
Step7, connect each image block histogram feature vector, the complete Local Convex diesinking histogram feature vector obtaining original image is: I ( l ) CLCCP = [ H 0 ( l ) CLCCP , H 1 ( l ) CLCCP , . . . , H 15 ( l ) CLCCP ] ;
Step8, this proper vector send into classify based on the nearest neighbor classifier of chi amount, identify the identity of original facial image.
In described step Step8, when the nearest neighbor classifier based on chi amount is classified, first computer card side statistic; Set two width facial image I (0)and I (1)complete Local Convex diesinking histogram feature vector be respectively: I ( 0 ) CLCCP = [ H 0 ( 0 ) CLCCP , H 1 ( 0 ) CLCCP , . . . , H 15 ( 0 ) CLCCP ] With I ( 1 ) CLCCP = [ H 0 ( 1 ) CLCCP , H 1 ( 1 ) CLCCP , . . . , H 15 ( 1 ) CLCCP ] , Distance then between these two vectors, namely chi span is from the following formulae discovery of employing:
χ 2 ( I ( 0 ) CLCCP , I ( 1 ) CLCCP ) = Σ i = 1 K ′ ( I ( 0 ) CLCCP ( i ) - I ( 1 ) CLCCP ( i ) ) 2 ( I ( 0 ) CLCCP ( i ) + I ( 1 ) CLCCP ( i ) + eps )
Wherein I (0) cLCCP(i) and I (1) cLCCPi () represents texture feature vector I respectively (0) cLCCPand I (1) cLCCPi-th element, K' represents the length of texture, and eps is a fixed value, is positive number minimum in Matlab.
Embodiment 2: as shown in figs. 1-7, a kind of illumination face recognition method based on complete Local Convex diesinking, first carries out piecemeal to image; Then bilinear interpolation is carried out to each block image, make each pixel in image can build 8 symmetry directions, then to calculate in block image each pixel along local, 8 directions difference; The symbolic feature of this local difference of then encoding and amplitude characteristic; Each pixel of each image block is encoded, obtains the center pixel feature of each image block; The eigenmatrix of the following symbolic feature to each block image, amplitude characteristic, center pixel feature extracts histogram feature vector, connects the vectorial histogram feature vector obtaining each block image of histogram feature of this block image symbolic feature, amplitude characteristic, center pixel feature successively; The histogram feature vector finally connecting each block image obtains the histogram feature vector of this original image, this proper vector is sent into and classifies based on the nearest neighbor classifier of chi amount, identify the identity of original facial image.
The concrete steps of the described illumination face recognition method based on complete Local Convex diesinking are as follows:
Step1, first image is carried out piecemeal: image I (l)evenly be divided into the zero lap square of 4 × 4,16 pieces altogether, be expressed as
Step2, bilinear interpolation computing is carried out to each block image, make each pixel can build about point-symmetric 8 directions of this pixel, then calculate the local difference of each pixel along different directions, this local difference is decomposed into symbolic component and and amplitude portion;
As shown in Figure 2, pixel P 1and P 2between can increase pixel Q by interpolation 1.Interpolation method as shown in Figure 4, wherein P 11, P 12, P 21, P 22be four neighbor pixels original in image, insert by interpolation method the pixel Q that makes new advances 0.Interpolation formula is as follows:
I R 1 ≈ x 2 - x x 2 - x 1 I P 11 + x - x 1 x 2 - x 1 I P 21 ,
I R 2 ≈ x 2 - x x 2 - x 1 I P 12 + x - x 1 x 2 - x 1 I P 22 ,
I Q 0 ≈ y 2 - y y 2 - y 1 I R 1 + y - y 1 y 2 - y 1 I R 2 ;
Wherein with represent R respectively 1, R 2with the pixel value of position, x 1, x and x 2represent pixel P respectively 11, R 1and P 21the horizontal ordinate at place, y 1, y and y 2represent pixel P respectively 11, Q 0and P 12the ordinate at place.Fig. 3 represents pixel X in original image 0there is P around 0, P 1, P 2, P 3, P 4, P 5, P 6and P 78 Neighbor Points, only can form four about pixel X 0symmetry direction.Fig. 2 represents pixel X after interpolation 0there is Q around 0, Q 1, Q 2, Q 3, Q 4, Q 5, Q 6and Q 78 interpolation points, therefore pixel X after interpolation 0one co-exist in 16 Neighbor Points around, 8 can be obtained about pixel X 0symmetry direction.Owing to adding interpolation point, the resolution of image is enhanced;
Pixel X in image block 0partial error along 8 directions is divided into with wherein i=0,1,2,3 and j=0,1,2,3;
Step3, symbolic component and amplitude portion carried out respectively to corresponding Local Convex diesinking coding, obtain symbolic feature CLCCP-S and the amplitude characteristic CLCCP-M of each block image, wherein pixel X 0symbolic feature and the coding formula of amplitude characteristic be respectively:
CLCCP - S 1,8 ( X 0 ) D = Σ i = 0 3 [ f ( I X 0 - 0.5 * ( I P i + I P i + 4 ) ) * 2 i * 2 ] + Σ j = 0 3 [ f ( I X 0 - 0.5 * ( I Q j + I Q j + 4 ) ) * 2 j * 2 + 1 ]
CLCCP - M 1,8 ( X 0 ) D = Σ i = 0 3 [ f ( abs ( I X 0 - 0.5 * ( I P i + I P i + 4 ) ) - c ) * 2 i * 2 ] + Σ j = 0 3 [ f ( abs ( I X 0 - 0.5 * ( I Q j + I Q j + 4 ) ) - c ) * 2 j * 2 + 1 ]
Wherein, CLCCP-S 1,8(X 0) drepresent pixel X 0the Local Convex concavity symbolic feature at place, CLCCP-M 1,8(X 0) drepresent pixel X 0the Local Convex concavity amplitude characteristic at place, f ( x ) = 0 , if x ≤ threshold 1 , if x > threshold , represent X in image 0the pixel value at place, with represent P in image iand P i+4the pixel value at place, with represent Q in image jand Q j+4the pixel value at place, abs () expression asks for signed magnitude arithmetic(al), CLCCP-S 1,8(X 0) dand CLCCP-M 1,8(X 0) dmiddle subscript " 1 " represents the pixel distance X that calculating convex-concave characteristic is used 0distance be 1, namely yardstick is 1, subscript " 8 " represent calculate through pixel X 0the convexo-concave characteristic in 8 directions, it is decimal system amount that subscript " D " represents, threshold is the threshold value pre-set;
Step4, to encode to each pixel of each image block, obtain the center pixel feature CLCCP-C of each image block, coding formula is: here c irepresent the mean value of entire image, represent X in image 0the pixel value at place, f ( x ) = 0 , if x ≤ threshold 1 , if x > threshold , CLCCP-C 1,8(X 0) dmiddle subscript " 1 " represents the pixel distance X that calculating convex-concave characteristic is used 0distance be 1, namely yardstick is 1, subscript " 8 " represent calculate through pixel X 0the convexo-concave characteristic in 8 directions, subscript " D " represents decimal system amount, and threshold is the threshold value pre-set;
Step5, through step Step2, Step3 and Step4, be extracted image block complete local convexo-concave characteristic, comprise and meet feature, amplitude characteristic and center pixel feature, work as image block in pixel X 0when traveling through whole image block, obtain each block image the eigenmatrix of CLCCP-S, CLCCP-M, CLCCP-C, be respectively
The histogram feature vector of Step6, the next each image block of extraction three eigenmatrixes, image block three eigenmatrixes histogram feature vector be expressed as: connect this three histogram feature vectors successively, obtain image block histogram feature vector H i ( l ) CLCCP = [ H i ( l ) CLCCP - S , H i ( l ) CLCCP - M , H i ( l ) CLCCP - C ] , Herein subscript CLCCP represent complete Local Convex diesinking feature, it comprises symbolic feature CLCCP-S, amplitude characteristic CLCCP-M and center pixel point patterns CLCCP-C;
Step7, connect each image block histogram feature vector, the complete Local Convex diesinking histogram feature vector obtaining original image is: I ( l ) CLCCP = [ H 0 ( l ) CLCCP , H 1 ( l ) CLCCP , . . . , H 15 ( l ) CLCCP ] ;
Step8, this proper vector send into classify based on the nearest neighbor classifier of chi amount, identify the identity of original facial image.
In described step Step8, when the nearest neighbor classifier based on chi amount is classified, first computer card side statistic; Set two width facial image I (0)and I (1)complete Local Convex diesinking histogram feature vector be respectively: I ( 0 ) CLCCP = [ H 0 ( 0 ) CLCCP , H 1 ( 0 ) CLCCP , . . . , H 15 ( 0 ) CLCCP ] With I ( 1 ) CLCCP = [ H 0 ( 1 ) CLCCP , H 1 ( 1 ) CLCCP , . . . , H 15 ( 1 ) CLCCP ] , Distance then between these two vectors, namely chi span is from the following formulae discovery of employing:
χ 2 ( I ( 0 ) CLCCP , I ( 1 ) CLCCP ) = Σ i = 1 K ′ ( I ( 0 ) CLCCP ( i ) - I ( 1 ) CLCCP ( i ) ) 2 ( I ( 0 ) CLCCP ( i ) + I ( 1 ) CLCCP ( i ) + eps )
Wherein I (0) cLCCP(i) and I (1) cLCCPi () represents texture feature vector I respectively (0) cLCCPand I (1) cLCCPi-th element, K' represents the length of texture, and eps is a fixed value, is positive number minimum in Matlab.
In order to prove the beneficial effect of described method, proved by statistics this method and the discrimination of other related algorithms in illumination face database, the match cognization rate that adds up comparing with other algorithms;
First add up the discrimination of this method in illumination face database, and compare with related algorithm, draw corresponding recognition performance curve.The present embodiment adopts MATLAB software environment, in the present embodiment, threshold gets 0, in the present embodiment, face picture used is the illumination subset of the extended YaleB face database, this subset has 38 individuals, everyone takes 64 photos in different light situation, 2432 photos altogether, photo size is 64x64, is 64 samples pictures of a people in this database as shown in Figure 5.This database can in all face picture cut of the upper download of this database website (http://vision.ucsd.edu/ ~ leekc/ExtYaleDatabase/ExtYaleB.html).In this embodiment, correct recognition rata and cumulative matching properties (the cumulative match characteristic) curve of this method, local binary patterns, unified local binary patterns and complete local binary patterns four kinds of algorithms is calculated.Adopt nearest neighbor classifier to calculate discrimination, when calculating discrimination, training sample set is by everyone difference 1,2,3,4, and 5 compositions of sample, remaining image is used as test.Test sample book and all training samples compare, if with test sample book apart from the identity of minimum training sample and test sample book consistent, then think that it is correct for identifying.The sample number of all correct identification is correct recognition rata divided by all test sample book numbers.
Also calculate the cumulative matching properties curve of this method, local binary patterns, complete local binary patterns, unified local binary patterns in addition.Gallery picture library collection and Probe picture library collection is needed when calculating cumulative matching properties curve.Gallery picture library collection is by the extended Yale B database, everyone provides a pictures to form, and everyone other 63 pictures remaining form Probe picture library collection.Supposing Gallery picture library to concentrate number of pictures to be L, P be a length is the full null vector of L.Picture library Probe concentrates a pictures I and Gallery to concentrate all pictures to carry out distance coupling, obtains a distance vector D={d 1, d 2..., d l, if Probe concentrates picture I and Gallery to concentrate the distance between common identity picture to be d, then d must be an element of vectorial D, if by arranging D vector from small to large, now suppose that d is arranged in D position l, then the element value on the l position of vectorial P adds 1.So picture is concentrated to repeat once Probe picture library, then by the length of each element of vectorial P divided by vectorial P, then " order (rank) 1 " discrimination is exactly first element value of vectorial P, " order (rank) 2 " discrimination is exactly second element value of vectorial P, the like.In the present embodiment, when calculating cumulative matching properties curve, from everyone photo, one is selected to form Gallery picture library collection at random, 63 formation Probe collection that everyone is left.Local binary patterns, unified local binary patterns, complete local binary patterns, the cumulative match curve of this method under this Gallery and Probe picture library collection are as shown in Figure 6;
As can be seen from Figure 6, the Performance comparision of local binary patterns and unified local binary patterns is close, but is all weaker than complete local binary patterns, and complete local binary patterns is substantially weaker than this method.Along with " order (rank) " be increased to concentrate number of pictures close to Gallery picture library time, several algorithm performance is close, but now few of engineering practice has been worth.
Also simulate the correct recognition rata of each algorithm in different training sample number situation in the present embodiment.We, by emulation repetition 5 times, calculate average correct recognition rata and standard deviation, and result are drawn in the figure 7; As can be seen from Figure 7, the performance of this method is better than other several algorithms greatly, when number of training is 5, by calculating local binary patterns based on the nearest neighbor classifier of chi amount, unifying the average recognition rate of local binary patterns, complete local binary patterns and this method be: 66.09%, 62.34%, 70.92%, 76.76%.Wherein this method will exceed 10.67% than local binary patterns algorithm discrimination, exceeds 14.42% than unified local binary patterns, exceeds 5.84% than complete local binary patterns, and this illustrates that this method is one illumination face recognition method very efficiently.
By reference to the accompanying drawings the specific embodiment of the present invention is explained in detail above, but the present invention is not limited to above-mentioned embodiment, in the ken that those of ordinary skill in the art possess, various change can also be made under the prerequisite not departing from present inventive concept.

Claims (3)

1. based on an illumination face recognition method for complete Local Convex diesinking, it is characterized in that: first piecemeal is carried out to image; Then bilinear interpolation is carried out to each block image, make each pixel in image can build 8 symmetry directions, then to calculate in block image each pixel along local, 8 directions difference; The symbolic feature of this local difference of then encoding and amplitude characteristic; Each pixel of each image block is encoded, obtains the center pixel feature of each image block; The eigenmatrix of the following symbolic feature to each block image, amplitude characteristic, center pixel feature extracts histogram feature vector, connects the vectorial histogram feature vector obtaining each block image of histogram feature of this block image symbolic feature, amplitude characteristic, center pixel feature successively; The histogram feature vector finally connecting each block image obtains the histogram feature vector of this original image, this proper vector is sent into and classifies based on the nearest neighbor classifier of chi amount, identify the identity of original facial image.
2. the illumination face recognition method based on complete Local Convex diesinking according to claim 1, is characterized in that: the concrete steps of the described illumination face recognition method based on complete Local Convex diesinking are as follows:
Step1, first image is carried out piecemeal: image I (l)evenly be divided into the zero lap square of 4 × 4,16 pieces altogether, be expressed as I i ( l ) ( i = 0,1,2 , . . . , 15 ) ;
Step2, bilinear interpolation computing is carried out to each block image, make each pixel can build about point-symmetric 8 directions of this pixel, then calculate the local difference of each pixel along different directions, this local difference is decomposed into symbolic component and and amplitude portion;
Step3, symbolic component and amplitude portion carried out respectively to corresponding Local Convex diesinking coding, obtain symbolic feature CLCCP-S and the amplitude characteristic CLCCP-M of each block image, wherein pixel X 0symbolic feature and the coding formula of amplitude characteristic be respectively:
CLCCP - S 1,8 ( X 0 ) D = Σ i = 0 3 [ f ( I X 0 - 0.5 * ( I P i + I P i + 4 ) ) * 2 i * 2 ] + Σ j = 0 3 [ f ( I X 0 - 0.5 * ( I Q j + I Q j + 4 ) ) * 2 j * 2 + 1 ]
CLCCP - M 1,8 ( X 0 ) D = Σ i = 0 3 [ f ( abs ( I X 0 - 0.5 * ( I P i + I P i + 4 ) ) - c ) * 2 i * 2 ] + Σ j = 0 3 [ f ( abs ( I X 0 - 0.5 * ( I Q j + I Q j + 4 ) ) - c ) * 2 j * 2 + 1 ]
Wherein, CLCCP-S 1,8(X 0) drepresent pixel X 0the Local Convex concavity symbolic feature at place, CLCCP-M 1,8(X 0) drepresent pixel X 0the Local Convex concavity amplitude characteristic at place, f ( x ) = 0 , ifx ≤ threshold 1 , ifx > threshold , represent X in image 0the pixel value at place, with represent P in image iand P i+4the pixel value at place, with represent Q in image jand Q j+4the pixel value at place, abs () expression asks for signed magnitude arithmetic(al), CLCCP-S 1,8(X 0) dand CLCCP-M 1,8(X 0) dmiddle subscript " 1 " represents the pixel distance X that calculating convex-concave characteristic is used 0distance be 1, namely yardstick is 1, subscript " 8 " represent calculate through pixel X 0the convexo-concave characteristic in 8 directions, it is decimal system amount that subscript " D " represents, threshold is the threshold value pre-set;
Step4, to encode to each pixel of each image block, obtain the center pixel feature CLCCP-C of each image block, coding formula is: here c irepresent the mean value of entire image, represent X in image 0the pixel value at place, f ( x ) = 0 , ifx ≤ threshold 1 , ifx > threshold , CLCCP-C 1,8(X 0) dmiddle subscript " 1 " represents the pixel distance X that calculating convex-concave characteristic is used 0distance be 1, namely yardstick is 1, subscript " 8 " represent calculate through pixel X 0the convexo-concave characteristic in 8 directions, subscript " D " represents decimal system amount, and threshold is the threshold value pre-set;
Step5, through step Step2, Step3 and Step4, be extracted image block complete local convexo-concave characteristic, comprise and meet feature, amplitude characteristic and center pixel feature, work as image block in pixel X 0when traveling through whole image block, obtain each block image the eigenmatrix of CLCCP-S, CLCCP-M, CLCCP-C, be respectively
The histogram feature vector of Step6, the next each image block of extraction three eigenmatrixes, image block three eigenmatrixes histogram feature vector be expressed as: connect this three histogram feature vectors successively, obtain image block histogram feature vector H i ( i ) CLCCP = [ H i ( l ) CLCCP - S , H i ( l ) CLCCP - M , H i ( l ) CLCCP - C ] , Herein subscript CLCCP represent complete Local Convex diesinking feature, it comprises symbolic feature CLCCP-S, amplitude characteristic CLCCP-M and center pixel point patterns CLCCP-C;
Step7, connect each image block histogram feature vector, the complete Local Convex diesinking histogram feature vector obtaining original image is: I ( l ) CLCCP = [ H 0 ( l ) CLCCP , H 1 ( l ) CLCCP , . . . , H 15 ( L ) CLCCP ] ;
Step8, this proper vector send into classify based on the nearest neighbor classifier of chi amount, identify the identity of original facial image.
3. the illumination face recognition method based on complete Local Convex diesinking according to claim 1, is characterized in that: in described step Step8, when the nearest neighbor classifier based on chi amount is classified, and first computer card side statistic; Set two width facial image I (0)and I (1)complete Local Convex diesinking histogram feature vector be respectively: I ( 0 ) CLCCP = H 0 ( 0 ) CLCCP , H 1 ( 0 ) CLCCP , . . . , H 15 ( 0 ) CLCCP ] With I ( 1 ) CLCCP = H 0 ( 1 ) CLCCP , H 1 ( 1 ) CLCCP , . . . , H 15 ( 1 ) CLCCP ] , Distance then between these two vectors, namely chi span is from the following formulae discovery of employing:
χ 2 ( I ( 0 ) CLCCP , I ( 1 ) CLCCP ) = Σ i = 1 K ′ ( i ( 0 ) CLCCP ( i ) - I ( 1 ) CLCCP ( i ) ) 2 ( I ( 0 ) CLCCP ( i ) + I ( 1 ) CLCCP ( i ) + eps )
Wherein I (0) cLCCP(i) and I (1) cLCCPi () represents texture feature vector I respectively (0) cLCCPand I (1) cLCCPi-th element, K' represents the length of texture, and eps is a fixed value, is positive number minimum in Matlab.
CN201510223240.2A 2015-05-05 2015-05-05 A kind of illumination face recognition method based on complete Local Convex diesinking Expired - Fee Related CN104881634B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510223240.2A CN104881634B (en) 2015-05-05 2015-05-05 A kind of illumination face recognition method based on complete Local Convex diesinking

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510223240.2A CN104881634B (en) 2015-05-05 2015-05-05 A kind of illumination face recognition method based on complete Local Convex diesinking

Publications (2)

Publication Number Publication Date
CN104881634A true CN104881634A (en) 2015-09-02
CN104881634B CN104881634B (en) 2018-02-09

Family

ID=53949122

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510223240.2A Expired - Fee Related CN104881634B (en) 2015-05-05 2015-05-05 A kind of illumination face recognition method based on complete Local Convex diesinking

Country Status (1)

Country Link
CN (1) CN104881634B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107292230A (en) * 2017-05-09 2017-10-24 华南理工大学 Embedded finger vein identification method based on convolutional neural network and having counterfeit detection capability
CN109410258A (en) * 2018-09-26 2019-03-01 重庆邮电大学 Texture image feature extracting method based on non local binary pattern
CN110059606A (en) * 2019-04-11 2019-07-26 新疆大学 A kind of improved increment Non-negative Matrix Factorization face recognition algorithms

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101317183A (en) * 2006-01-11 2008-12-03 三菱电机株式会社 Method for localizing pixels representing an iris in an image acquired of an eye
CN101551858A (en) * 2009-05-13 2009-10-07 北京航空航天大学 Target recognition method based on differential code and differential code mode
US20100074496A1 (en) * 2008-09-23 2010-03-25 Industrial Technology Research Institute Multi-dimensional empirical mode decomposition (emd) method for image texture analysis
CN101835037A (en) * 2009-03-12 2010-09-15 索尼株式会社 Method and system for carrying out reliability classification on motion vector in video
CN102722699A (en) * 2012-05-22 2012-10-10 湖南大学 Face identification method based on multiscale weber local descriptor and kernel group sparse representation
CN103246880A (en) * 2013-05-15 2013-08-14 中国科学院自动化研究所 Human face recognizing method based on multi-level local obvious mode characteristic counting

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101317183A (en) * 2006-01-11 2008-12-03 三菱电机株式会社 Method for localizing pixels representing an iris in an image acquired of an eye
US20100074496A1 (en) * 2008-09-23 2010-03-25 Industrial Technology Research Institute Multi-dimensional empirical mode decomposition (emd) method for image texture analysis
CN101835037A (en) * 2009-03-12 2010-09-15 索尼株式会社 Method and system for carrying out reliability classification on motion vector in video
CN101551858A (en) * 2009-05-13 2009-10-07 北京航空航天大学 Target recognition method based on differential code and differential code mode
CN102722699A (en) * 2012-05-22 2012-10-10 湖南大学 Face identification method based on multiscale weber local descriptor and kernel group sparse representation
CN103246880A (en) * 2013-05-15 2013-08-14 中国科学院自动化研究所 Human face recognizing method based on multi-level local obvious mode characteristic counting

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
毋小省 等: "《基于凹凸局部二值模式的纹理图像分类》", 《光电子·激光》 *
毋小省 等: "《基于纹理与特征选择的前视红外目标识别》", 《光电子·激光》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107292230A (en) * 2017-05-09 2017-10-24 华南理工大学 Embedded finger vein identification method based on convolutional neural network and having counterfeit detection capability
CN109410258A (en) * 2018-09-26 2019-03-01 重庆邮电大学 Texture image feature extracting method based on non local binary pattern
CN109410258B (en) * 2018-09-26 2021-12-10 重庆邮电大学 Texture image feature extraction method based on non-local binary pattern
CN110059606A (en) * 2019-04-11 2019-07-26 新疆大学 A kind of improved increment Non-negative Matrix Factorization face recognition algorithms

Also Published As

Publication number Publication date
CN104881634B (en) 2018-02-09

Similar Documents

Publication Publication Date Title
CN105719188B (en) The anti-method cheated of settlement of insurance claim and server are realized based on plurality of pictures uniformity
CN105956560B (en) A kind of model recognizing method based on the multiple dimensioned depth convolution feature of pondization
CN112396607B (en) Deformable convolution fusion enhanced street view image semantic segmentation method
Thai et al. Image classification using support vector machine and artificial neural network
CN102324047B (en) Hyper-spectral image ground object recognition method based on sparse kernel representation (SKR)
CN110728209A (en) Gesture recognition method and device, electronic equipment and storage medium
CN104881676B (en) A kind of facial image convex-concave pattern texture feature extraction and recognition methods
CN111191654B (en) Road data generation method and device, electronic equipment and storage medium
CN104008369A (en) Method and device for recognizing authenticity of seal
CN103514456A (en) Image classification method and device based on compressed sensing multi-core learning
Ye et al. Detecting USM image sharpening by using CNN
CN103226831B (en) Image matching method utilizing block Boolean operation
CN111275070B (en) Signature verification method and device based on local feature matching
CN104143091A (en) Single-sample face recognition method based on improved mLBP
CN103714326A (en) One-sample face identification method
CN102880870B (en) The extracting method of face characteristic and system
CN104881634A (en) Illumination face recognition method based on completed local convex-and-concave pattern
CN104598898B (en) A kind of Aerial Images system for rapidly identifying and its method for quickly identifying based on multitask topology learning
Wang et al. Deep blind synthesized image quality assessment with contextual multi-level feature pooling
CN110188646A (en) The human ear identification method merged based on gradient orientation histogram with local binary patterns
He et al. Classification of metro facilities with deep neural networks
Yang et al. Age invariant face recognition based on texture embedded discriminative graph model
CN102609732B (en) Object recognition method based on generalization visual dictionary diagram
CN113392786B (en) Cross-domain pedestrian re-identification method based on normalization and feature enhancement
CN112818926B (en) Sketch identification method and system based on multilayer residual learning

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
EXSB Decision made by sipo to initiate substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Chen Xi

Inventor after: Jin Jie

Inventor after: Pan Xiaolu

Inventor before: Chen Xi

Inventor before: Jin Jie

CB03 Change of inventor or designer information
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180209

CF01 Termination of patent right due to non-payment of annual fee