CN104933414A - Living body face detection method based on WLD-TOP (Weber Local Descriptor-Three Orthogonal Planes) - Google Patents

Living body face detection method based on WLD-TOP (Weber Local Descriptor-Three Orthogonal Planes) Download PDF

Info

Publication number
CN104933414A
CN104933414A CN201510350814.2A CN201510350814A CN104933414A CN 104933414 A CN104933414 A CN 104933414A CN 201510350814 A CN201510350814 A CN 201510350814A CN 104933414 A CN104933414 A CN 104933414A
Authority
CN
China
Prior art keywords
wld
living body
training
body faces
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510350814.2A
Other languages
Chinese (zh)
Other versions
CN104933414B (en
Inventor
赖剑煌
梅岭
冯展祥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sun Yat Sen University
Original Assignee
Sun Yat Sen University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sun Yat Sen University filed Critical Sun Yat Sen University
Priority to CN201510350814.2A priority Critical patent/CN104933414B/en
Publication of CN104933414A publication Critical patent/CN104933414A/en
Application granted granted Critical
Publication of CN104933414B publication Critical patent/CN104933414B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/162Detection; Localisation; Normalisation using pixel segmentation or colour matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/167Detection; Localisation; Normalisation using comparisons between temporally consecutive images
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a living body face detection method based on WLD-TOP (Weber Local Descriptor-Three Orthogonal Planes). The method comprises the following steps: (1) training stage: reading a training set video, performing face region detection on each frame, converting the frames into a gray level facial image frame sequence to construct a three-dimensional image matrix, constructing a filtering template, calculating WLD features, generating a WLD-TOP feature vector, and inputting the feature vector into an SVM classifier for training to establish an SVM model; and (2) testing stage: for an image sequence under test, performing face detection on each frame, converting the frames into a gray level facial image sequence, constructing a three-dimensional image matrix and a filtering template, calculating WLD features, generating a WLD-TO feature vector, and feeding the WLD-TOP feature vector into a trained SVM model to obtain a living body face detection result. The Weber law is adopted on the basis of the LBP-TOP, so that the size relationships between neighborhood pixels and a center pixel are reflected, and the differences between the neighborhood pixels and the center pixel are quantified. Thus, the features of a descriptor are more complete.

Description

A kind of living body faces detection method based on WLD-TOP
Technical field
The present invention relates to the research field of Face datection, particularly a kind of living body faces detection method based on WLD-TOP.
Background technology
Face recognition technology by comparing and analyze the biological characteristic of face, thus differentiates the identity of people.Face recognition technology in the past few decades between achieve significant progress, the product of recognition of face is applied to multiple occasions such as gate inhibition, important place monitoring, entry and exit.An advantage of face recognition technology automatically identifies target, without the need to supervision, but also leave safe hidden danger, if lawless person use the photo of user even video can to out-trick easily face identification system, will work the mischief, social safety and stability has been arrived in serious threat.
Common face spoofing attack comprises photo and attacks and video attack.Photo is attacked with the face characteristic of user, and video is attacked more with the behavioral characteristics of validated user, as the change of nictation and facial expression, has more duplicity, seriously have impact on the accuracy of face identification system differentiation.
Present living body faces detection method mainly contains following several: one is the method analyzed based on texture structure, and the method, by the otherness of analyzing three-dimensional living body faces with face imaging of retaking, is extracted associated texture feature and differentiated; Two is the methods based on facial movement information analysis, and the essential distinction of living body faces and face of retaking is that the former is three-dimensional body, and the latter is two-dimension plane structure, and there is the secondary shooting of face, the movement effects that they produce is diverse; Three is the methods based on living body characteristics information analysis, and the method analyzes the living body characteristics such as the thermal infrared images of face, nictation and lip motion, the checkout equipment support that this method may need some extra, on promoting, therefore there is the restriction of hardware.
The realization of above-mentioned three kinds of methods all will use suitable iamge description, and it can improve the accuracy rate that living body faces detects greatly.Because face spoofing attack means get more and more, especially based on the fraud of video, there is the behavioral characteristics of living body faces, such as can be obtained the change of the facial expressions such as nictation by the dynamic video of validated user thus reach the object of spoofing attack, so we need the descriptor of an energy joining day and spatial information to distinguish.
Summary of the invention
Fundamental purpose of the present invention is that the shortcoming overcoming prior art is with not enough, a kind of living body faces detection method based on WLD-TOP is provided, by extracting WLD descriptor, and add the timeline information of frame of video, thus form WLD-TOP (Weber Local Descriptor-Three Orthogonal Planes) descriptor, it has merged the space characteristics of WLD descriptor and the temporal characteristics of frame of video, improves the accuracy rate that living body faces detects.
In order to achieve the above object, the present invention is by the following technical solutions:
Based on a living body faces detection method for WLD-TOP descriptor, comprise the steps:
S1, training stage: read training set video, human face region detection is carried out to each frame, and convert Gray Face sequence of image frames to, structure three-dimensional image matrix, then construct Filtering Template and calculate WLD feature, regeneration WLD-TOP proper vector, finally inputs SVM classifier by proper vector and trains, thus sets up SVM model;
S2, test phase: for the image sequence of test, Face datection is carried out to each frame and is converted to Gray Face image sequence, then three-dimensional image matrix and Filtering Template is constructed, calculate WLD feature, generate WLD-TOP proper vector, finally send into the SVM model trained, draw living body faces testing result.
Preferably, in step S1, described training set video is living body faces video, the photo face of recording, Replay Attack or print picture and attack.
Preferably, in step S1, after reading in frame of video, extract haar feature and carry out human face region detection with adaboosting algorithm, extract colored human face figure wherein and transfer the consistent gray-scale map of size dimension to.
Preferably, in step S1, the method for described structure three-dimensional image matrix is:
The frame of video length R once read is set, chooses the boundary threshold L of T coordinate t, then the actual frame of video length R as center pixel process t=R-2L t, then the gray-scale value of this group frame of video is read in one containing in the three-dimensional matrice I (x, y, t) of X, Y and T coordinate.
Preferably, in step S1, structure Filtering Template the method calculating WLD feature are:
Choose X, the abundant value L in Y-coordinate border respectively x, L y, determine the glide filter template length p of WLD descriptor, the Filtering Template forming p*p, to three of I orthogonal planes XY, XT and YT, utilizes the difference excitation ξ and direction gradient Φ of each central pixel point after the abundant value in p*p formwork calculation removing border of WLD method respectively t, computing method are as follows: first suppose that the central point calculated is x c, its eight consecutive point are x respectively i, i=0 ..., p 2-1, v 0 = Σ i = 0 p 2 - 1 ( Δx i ) = Σ i = 0 p 2 - 1 ( x i - x c ) , Definition ξ ′ ( x c ) = a r c t a n [ v 0 x c ] = a r c t a n [ Σ i = 0 p 2 - 1 ( x i - x c x c ) ] , Make v 1=x 5-x 1, v 2=x 7-x 3, get definition
then wherein θ ' ∈ [0,2 π), S is the dimension of direction gradient feature, then Φ t=0,1 ..., S-1, by above-mentioned steps obtain WLD descriptor ξ ' (x c), Φ t.
Preferably, in step S1,
WLD-TOP computation process is: first to ξ ' (x c) do following normalization:
therefore ξ (x c) value is 0 to this N number of round values of N-1; Φ tnormalize to S the direction represented to S-1 with integer 0, for XY plane, to WLD{ ξ (x c), Φ ttwo-dimensional histogram carries out dimensionality reduction, fixing Φ t, ask corresponding ξ (x c) sub-histogram, according to the Φ of S dimension tbe divided into the sub-histogram of S group, according to Φ torder from small to large connects this S sub-histogram successively, definition
F (x, y)=N × Φ t+ ξ (x c), then the histogram of XY plane
H i, XY=Σ x,ym{f (x, y)=i}, i=0,1 ..., N Φ t-1, wherein M ( A ) = 0 , i f A i s f a 1 s e ; 1 , i f A i s t r u e . , Thus form N Φ tthe WLD histogram H of dimension xY, then obtain three orthogonal planes by this method
The histogram h of (n=0:XY, n=1:XT, n=2:YT) i,nx, y, tm{f (x, y, t)=i}, i=0,1 ..., N Φ t-1, they are transferred to N Φ tthe row vector H of dimension n, connect successively, generate 3N Φ tthe WLD-TOP feature row vector H of dimension wT=[H 0h 1h 2].
Preferably, in step S1,
Described SVM classifier uses the SVM implementation tool based on LIBSVM; All k the proper vector composing training collection eigenmatrixes that training set is obtained H t r a i n = H W T , t r a i n , 1 . . . H W T , t r a i n , k , Adopt SVM training, and with the model of training out to the test set eigenmatrix containing j proper vector H t e s t = H W T , t e s t , 1 . . . H W T , t e s t , j Whether classification is the differentiation label of living body faces, and with true tag comparison, thus obtain the accuracy rate that In vivo detection differentiates.
Preferably, in step S1,
Described SVM classifier, for the training sample set of input, adopts cross validation method to train, and utilizes trellis search method to find the optimized parameter collection { C, γ } of SVM.
Compared with prior art, tool has the following advantages and beneficial effect in the present invention:
1, the WLD-TOP method of the present invention's proposition, utilize Weber('s)law, on LBP-TOP basis, not only embody the magnitude relationship of neighborhood territory pixel and center pixel, also quantize the difference of neighborhood territory pixel and center pixel, and using this species diversity as a kind of feature, then bonding position Gradient Features, make the feature of descriptor more comprehensive.
2, WLD descriptor is expanded to three dimensions by the present invention, adds timeline information, Time and place information fusion is integrated, and attacks improve detection accuracy to the video with behavioral characteristics.
3, this invention simplifies traditional WLD calculated direction gradient and histogrammic mathematical procedure, computing method of the present invention only change the order of proper vector element in classic method, on the basis not changing traditional WLD proper vector element size, construct these features with more intuitive mathematic(al) representation.
4, the present invention does training and testing on different pieces of information collection, detects data set by constructing SYSU living body faces, and and CASIA data set combine and done the experiment of cross datasets, improve the Generalization Capability of WLD-TOP.
Accompanying drawing explanation
Fig. 1 is method flow diagram of the present invention;
Fig. 2 (a)-Fig. 2 (c) is the effect exemplary plot that WLD-TOP of the present invention describes face;
Fig. 3 is the schematic diagram of WLD difference of the present invention excitation and direction gradient;
Fig. 4 is the histogram of WLD-TOP descriptor of the present invention;
Fig. 5 (a)-Fig. 5 (d) is the CASIA human face region figure of the present invention for training and testing;
Fig. 6 (a)-Fig. 6 (d) is the SYSU human face region figure of the present invention for training and testing.
Embodiment
Below in conjunction with embodiment and accompanying drawing, the present invention is described in further detail, but embodiments of the present invention are not limited thereto.
Embodiment
As shown in Figure 1, the present invention is based on the living body faces detection method of WLD-TOP, comprise the following steps:
(1) training stage: read training set video, human face region detection is carried out to each frame, and convert Gray Face sequence of image frames to, structure three-dimensional image matrix, then construct Filtering Template and calculate WLD feature, regeneration WLD-TOP proper vector, finally inputs SVM classifier by proper vector and trains, thus sets up SVM model;
The particular content in (1) stage is:
(1.1) training set video is read: read training set video, it may be living body faces video, also may be the photo face, Replay Attack, the attack of printing picture etc. recorded, we read in frame of video, then extract haar feature and carry out human face region detection with adaboosting algorithm, extract colored human face figure wherein and transfer the consistent gray-scale map of size dimension to;
(1.2) three-dimensional image matrix is constructed: the frame of video length R once read is set, chooses the boundary threshold L of T coordinate t, then the actual frame of video length R as center pixel process t=R-2L t, then the gray-scale value of this group frame of video is read in one containing in the three-dimensional matrice I (x, y, t) of X, Y and T coordinate.
(1.3) WLD feature is calculated: choose X, the abundant value L in Y-coordinate border respectively x, L y, determine the glide filter template length p of WLD descriptor, form Filtering Template (p=3, the L in experiment of p*p x=L y=L t=1); To three orthogonal planes XY, XT and YT of I, utilize the difference excitation ξ (x of each central pixel point after the abundant value in p*p formwork calculation removing border of WLD method respectively c) and direction gradient Φ t, computing method are as follows: first suppose that the central point calculated is x c, its eight consecutive point are x respectively i, i=0 ..., p 2-1, v 0 = Σ i = 0 p 2 - 1 ( Δx i ) = Σ i = 0 p 2 - 1 ( x i - x c ) , Definition ξ ′ ( x c ) = a r c t a n [ v 0 x c ] = a r c t a n [ Σ i = 0 p 2 - 1 ( x i - x c x c ) ] , Make v 1=x 5-x 1, v 2=x 7-x 3, get θ ( x c ) = a r c t a n ( v 2 v 1 ) , Definition then wherein θ ' ∈ [0,2 π), S is the dimension of direction gradient feature, then Φ t=0,1 ..., S-1, by above-mentioned steps obtain WLD descriptor ξ ' (x c), Φ t, as shown in Figure 3,
(1.4) WLD-TOP proper vector is generated: first to ξ ' (x c) do following normalization:
therefore ξ (x c) value is 0 to this N number of round values of N-1; Φ tnormalize to S the direction represented to S-1 with integer 0, for XY plane, to WLD{ ξ (x c), Φ ttwo-dimensional histogram carries out dimensionality reduction, fixing Φ t, ask corresponding ξ (x c) sub-histogram, according to the Φ of S dimension tbe divided into the sub-histogram of S group, according to Φ torder from small to large connects this S sub-histogram successively, definition
F (x, y)=N × Φ t+ ξ (x c), then the histogram of XY plane
H i, XYx,ym{f (x, y)=i}, i=0,1 ..., N Φ t-1, wherein M ( A ) = 0 , i f A i s f a 1 s e ; 1 , i f A i s t r u e . , Thus form N Φ tthe WLD histogram H of dimension xY, then obtain three orthogonal planes by this method
The histogram h of (n=0:XY, n=1:XT, n=2:YT) i,nx, y, tm{f (x, y, t)=i}, i=0,1 ..., N Φ t-1, they are transferred to N Φ tthe row vector H of dimension n, connect successively, generate 3N Φ tthe WLD-TOP feature row vector H of dimension wT=[H 0h 1h 2], as shown in Figure 4.
(1.5) proper vector is inputted SVM classifier to train: SVM classifier uses the SVM implementation tool based on LIBSVM; All k the proper vector composing training collection eigenmatrixes that training set is obtained H t r a i n = H W T , t r a i n , 1 . . . H W T , t r a i n , k , Adopt SVM training, and with the model of training out to the test set eigenmatrix containing j proper vector H t e s t = H W T , t e s t , 1 . . . H W T , t e s t , j Whether classification is the differentiation label of living body faces, and with true tag comparison, thus obtain the accuracy rate that In vivo detection differentiates.
(1.6) SVM model is set up: SVM classifier, for the training sample set of input, adopts cross validation method to train, and utilizes trellis search method to find the optimized parameter collection { C, γ } of SVM.
(2) test phase: for the image sequence of test, Face datection is carried out to each frame and is converted to Gray Face image sequence, then three-dimensional image matrix and Filtering Template is constructed, calculate WLD feature, generate WLD-TOP proper vector, finally send into the SVM model trained, draw living body faces testing result.
Structure three-dimensional image matrix in above-mentioned steps (2), calculate WLD feature, generate WLD-TOP proper vector and proper vector inputted Methods and steps (1) that SVM classifier carries out training in method identical.
The present invention is described effect of the present invention by following experiment: (1) experimental data collection selects CASIA living body faces to detect data set (as shown in Fig. 5 (a)-Fig. 5 (d), Fig. 5 (a), Fig. 5 (b) is respectively live body and the non-living body picture of training set, Fig. 5 (c), Fig. 5 (d) is respectively live body and the non-living body picture of test set) and the homemade SYSU living body faces of applicant detect data set (as shown in Fig. 6 (a)-Fig. 6 (d), Fig. 6 (a), Fig. 6 (b) is respectively live body and the non-living body picture of training set, Fig. 6 (c), Fig. 6 (d) is respectively live body and the non-living body picture of test set), the CASIA dataset acquisition face video of 50 users, wherein 20 are used as training set, 30 are used as test set, each user recorded live body, shearing photo is attacked, manual bending photo is attacked, video attacks the video of Four types, every type has 3 sections of videos, be divided into low, in, high-resolution human face video, namely unique user has 3 sections of living body faces videos, 9 sections of personation face video, the SYSU dataset acquisition face video of 29 users, wherein 20 are used as training, 9 are used as test, attack pattern is the secondary face video that iphone mobile phone and ipad flat board are recorded, each user has 3 photographed scenes, corresponding each scene, unique user always has 3 sections of living body faces videos and 6 sections of personation face video.
CASIA data set and SYSU data set Internal Experiment: the video of experimental data collection is extracted human face region by every frame, and the face gray scale picture of (62 × 62 pixel) in the same size is become as normalized, the glide filter template length p=3 of WLD descriptor, boundary threshold is set to L x=L y=L t=1; Reading each user's length in training set is R tthe face video frame of=3, as a three-dimensional image matrix, the design sketch of image as shown in Fig. 2 (a)-Fig. 2 (c), then calculates WLD{ ξ (x to each orthogonal plane XY, XT, YT according to method shown in Fig. 3 successively c), Φ t, the dimension N=256 of difference excitation, the number S=8 of direction gradient, adopt process flow diagram as shown in Figure 4 to calculate WLD two-dimensional histogram; Different Φ is pressed to the WLD two-dimensional histogram of each orthogonal plane treduce to 8 sub-histograms of one dimension, they are pressed Φ tsize order is stitched together and obtains the WLD one dimensional histograms of this pixel, this histogram contains 2048 dimensional feature row vectors, then splices according to the order of XY, XT, YT plane the histogram that these one dimensional histograms obtain 6144 dimension WLD-TOP feature row vectors of this point successively; By that analogy, the face frame under the different video of each user of training set is trained, obtain the eigenmatrix H of a training set train, the different user of test set is also obtained eigenmatrix H by (1)-(2) process test; To H traincarry out with LIBSVM software package the training of svmtrain function, obtain training pattern model, utilize model to carry out SVM prediction and draw differentiation accuracy rate,-the t of adjustment svmtrain function,-c, the parameters such as-g, find the optimized parameter making accuracy rate the highest, draw the final differentiation accuracy rate accuracy of WLD-TOP on CASIA (or SYSU) data set.
CASIA data set and SYSU data set cross-over experiment: train with CASIA data set in the application, test with SUSU, and then train with SYSU data set, test with CASIA.The video of two data sets is extracted human face region by every frame, and becomes the face gray scale picture of (62 × 62 pixel) in the same size as normalized, the glide filter template length p=3 of WLD descriptor, boundary threshold is set to L x=L y=L t=1; Reading each user's length in training set is R tthe face video frame of=3, as a three-dimensional image matrix, then calculates WLD{ ξ (x to each orthogonal plane XY, XT, YT according to method shown in Fig. 3 successively c), Φ t, the dimension N=256 of difference excitation, the number S=8 of direction gradient, adopt process flow diagram as shown in Figure 4 to calculate WLD two-dimensional histogram; Different Φ is pressed to the WLD two-dimensional histogram of each orthogonal plane treduce to 8 sub-histograms of one dimension, they are pressed Φ tsize order is stitched together and obtains the WLD one dimensional histograms of this pixel, then splices according to the order of XY, XT, YT plane the histogram that these one dimensional histograms obtain 6144 dimension WLD-TOP feature row vectors of this point successively; By that analogy, the face frame under the different video of each user of training set is trained, obtain the eigenmatrix H of a training set train, the different user of test set is also obtained eigenmatrix H by (1)-(2) process test; To H traincarry out with LIBSVM software package the training of svmtrain function, obtain training pattern model, utilize model to carry out SVM prediction and draw differentiation accuracy rate,-the t of adjustment svmtrain function,-c, the parameters such as-g, find the optimized parameter making accuracy rate the highest, draw the final differentiation accuracy rate accuracy of WLD-TOP on cross datasets.
In experiment, the application also compares with WLD, LBPTOP and LBP tri-kinds of methods.Concrete comparative result is as shown in table 1-table 4:
The experiment of table 1:CASIA data set
Method Accuracy rate %
WLD-top 90.78
LBP-top 79.06
WLD 87.08
LBP 78.35
The experiment of table 2:SYSU data set
Method Accuracy rate %
WLD-top 93.44
LBP-top 81.97
WLD 85.27
LBP 81.42
Table 3 CASIA data set and SYSU data set cross-over experiment
Method Accuracy rate %
WLD-top 74.62
LBP-top 53.96
WLD 64.81
LBP 53.85
The each descriptor of table 4 differentiates (R averaging time of a video t=3)
Method Time
WLD-top 0.29s
LBP-top 0.20s
WLD 0.22s
LBP 0.16s
From the result of experiment, the effect of WLD-TOP descriptor In vivo detection of the present invention is adopted to be better than existing LBP-TOP and WLD descriptor, the present invention not only has a certain upgrade in accuracy rate, has improve significantly in actual, complicated video human face Attack Scenarios than the accuracy rate based on the descriptor of LBP-TOP and WLD.Because WLD-TOP calculates WLD feature in three planes, so speed can be slightly slower than other two kinds of methods.
Above-described embodiment is the present invention's preferably embodiment; but embodiments of the present invention are not restricted to the described embodiments; change, the modification done under other any does not deviate from Spirit Essence of the present invention and principle, substitute, combine, simplify; all should be the substitute mode of equivalence, be included within protection scope of the present invention.

Claims (8)

1., based on a living body faces detection method for WLD-TOP descriptor, it is characterized in that, comprise the steps:
S1, training stage: read training set video, human face region detection is carried out to each frame, and convert Gray Face sequence of image frames to, structure three-dimensional image matrix, then construct Filtering Template and calculate WLD feature, regeneration WLD-TOP proper vector, finally inputs SVM classifier by proper vector and trains, thus sets up SVM model;
S2, test phase: for the image sequence of test, Face datection is carried out to each frame and is converted to Gray Face image sequence, then three-dimensional image matrix and Filtering Template is constructed, calculate WLD feature, generate WLD-TOP proper vector, finally send into the SVM model trained, draw living body faces testing result.
2. the living body faces detection method based on WLD-TOP descriptor according to claim 1, is characterized in that, in step S1, described training set video is living body faces video, the photo face of recording, Replay Attack or print picture and attack.
3. the living body faces detection method based on WLD-TOP descriptor according to claim 1, it is characterized in that, in step S1, after reading in frame of video, extract haar feature and carry out human face region detection with adaboosting algorithm, extract colored human face figure wherein and transfer the consistent gray-scale map of size dimension to.
4. the living body faces detection method based on WLD-TOP descriptor according to claim 1, is characterized in that, in step S1, the method for described structure three-dimensional image matrix is:
The frame of video length R once read is set, chooses the boundary threshold L of T coordinate t, then the actual frame of video length R as center pixel process t=R-2L t, then the gray-scale value of this group frame of video is read in one containing in the three-dimensional matrice I (x, y, t) of X, Y and T coordinate.
5. the living body faces detection method based on WLD-TOP descriptor according to right 1, is characterized in that, in step S1, structure Filtering Template the method calculating WLD feature are:
Choose X, the abundant value L in Y-coordinate border respectively x, L y, determine the glide filter template length p of WLD descriptor, the Filtering Template forming p*p, to three of I orthogonal planes XY, XT and YT, utilizes the difference excitation ξ and direction gradient Φ of each central pixel point after the abundant value in p*p formwork calculation removing border of WLD method respectively t, computing method are as follows: first suppose that the central point calculated is x c, its eight consecutive point are x respectively i, i=0 ..., p 2-1, v 0 = Σ i = 0 p 2 - 1 ( Δx i ) = Σ i = 0 p 2 - 1 ( x i - x c ) , Definition ξ ′ ( x c ) = arctan [ v 0 x c ] = a r c t a n [ Σ i = 0 p 2 - 1 ( x i - x c x c ) ] , Make v 1=x 5-x 1, v 2=x 7-x 3, get definition order wherein θ ' ∈ [0,2 π), S is the dimension of direction gradient feature, then Φ t=0,1 ..., S-1, by above-mentioned steps obtain WLD descriptor ξ ' (x c), Φ t.
6. the living body faces detection method based on WLD-TOP descriptor according to right 5, is characterized in that, in step S1,
WLD-TOP computation process is: first to ξ ' (x c) do following normalization: therefore ξ (x c) value is 0 to this N number of round values of N-1; Φ tnormalize to S the direction represented to S-1 with integer 0, for XY plane, to WLD{ ξ (x c), Φ ttwo-dimensional histogram carries out dimensionality reduction, fixing Φ t, ask corresponding ξ (x c) sub-histogram, according to the Φ of S dimension tbe divided into the sub-histogram of S group, according to Φ torder from small to large connects this S sub-histogram successively, definition f (x, y)=N × Φ t+ ξ (x c), then the histogram h of XY plane i, XYx,ym{f (x, y)=i}, i=0,1 ..., N Φ t-1, wherein M ( A ) = 0 , i f A i s f a l s e ; 1 , i f A i s t r u e . , Thus form N Φ tthe WLD histogram H of dimension xY, then the histogram h of three orthogonal planes (n=0:XY, n=1:XT, n=2:YT) is obtained by this method i,nx, y, tm{f (x, y, t)=i}, i=0,1 ..., N Φ t-1, they are transferred to N Φ tthe row vector H of dimension n, connect successively, generate 3N Φ tthe WLD-TOP feature row vector H of dimension wT=[H 0h 1h 2].
7. the living body faces detection method based on WLD-TOP descriptor according to right 1, is characterized in that, in step S1,
Described SVM classifier uses the SVM implementation tool based on LIBSVM; All k the proper vector composing training collection eigenmatrixes that training set is obtained H t r a i n = H W T , t r a i n , 1 . . . H W T , t r a i n , k , Adopt SVM training, and with the model of training out to the test set eigenmatrix containing j proper vector H t e s t = H W T , t e s t , 1 . . . H W T , t e s t , j Whether classification is the differentiation label of living body faces, and with true tag comparison, thus obtain the accuracy rate that In vivo detection differentiates.
8. the living body faces detection method based on WLD-TOP descriptor according to right 1, is characterized in that, in step S1,
Described SVM classifier, for the training sample set of input, adopts cross validation method to train, and utilizes trellis search method to find the optimized parameter collection { C, γ } of SVM.
CN201510350814.2A 2015-06-23 2015-06-23 A kind of living body faces detection method based on WLD-TOP Active CN104933414B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510350814.2A CN104933414B (en) 2015-06-23 2015-06-23 A kind of living body faces detection method based on WLD-TOP

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510350814.2A CN104933414B (en) 2015-06-23 2015-06-23 A kind of living body faces detection method based on WLD-TOP

Publications (2)

Publication Number Publication Date
CN104933414A true CN104933414A (en) 2015-09-23
CN104933414B CN104933414B (en) 2018-06-05

Family

ID=54120574

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510350814.2A Active CN104933414B (en) 2015-06-23 2015-06-23 A kind of living body faces detection method based on WLD-TOP

Country Status (1)

Country Link
CN (1) CN104933414B (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105320950A (en) * 2015-11-23 2016-02-10 天津大学 A video human face living body detection method
CN105701495A (en) * 2016-01-05 2016-06-22 贵州大学 Image texture feature extraction method
CN105740775A (en) * 2016-01-25 2016-07-06 北京天诚盛业科技有限公司 Three-dimensional face living body recognition method and device
CN105975926A (en) * 2016-04-29 2016-09-28 中山大学 Human face living detection method based on light field camera
CN106228129A (en) * 2016-07-18 2016-12-14 中山大学 A kind of human face in-vivo detection method based on MATV feature
CN107122709A (en) * 2017-03-17 2017-09-01 上海云从企业发展有限公司 Biopsy method and device
CN107563283A (en) * 2017-07-26 2018-01-09 百度在线网络技术(北京)有限公司 Method, apparatus, equipment and the storage medium of generation attack sample
CN107808115A (en) * 2017-09-27 2018-03-16 联想(北京)有限公司 A kind of biopsy method, device and storage medium
CN107992842A (en) * 2017-12-13 2018-05-04 深圳云天励飞技术有限公司 Biopsy method, computer installation and computer-readable recording medium
CN108021892A (en) * 2017-12-06 2018-05-11 上海师范大学 A kind of human face in-vivo detection method based on extremely short video
WO2018133791A1 (en) * 2017-01-19 2018-07-26 腾讯科技(深圳)有限公司 Living body discrimination method and system based on video analysis, and storage medium
CN108596041A (en) * 2018-03-28 2018-09-28 中科博宏(北京)科技有限公司 A kind of human face in-vivo detection method based on video
CN108875464A (en) * 2017-05-16 2018-11-23 南京农业大学 A kind of light music control system and control method based on three-dimensional face Emotion identification
CN111259792A (en) * 2020-01-15 2020-06-09 暨南大学 Face living body detection method based on DWT-LBP-DCT characteristics
CN111797702A (en) * 2020-06-11 2020-10-20 南京信息工程大学 Face counterfeit video detection method based on spatial local binary pattern and optical flow gradient
CN112001429A (en) * 2020-08-06 2020-11-27 中山大学 Depth forgery video detection method based on texture features
CN112132000A (en) * 2020-09-18 2020-12-25 睿云联(厦门)网络通讯技术有限公司 Living body detection method and device, computer readable medium and electronic equipment
CN112507847A (en) * 2020-12-03 2021-03-16 江苏科技大学 Face anti-fraud method based on neighborhood pixel difference weighting mode
CN114120452A (en) * 2021-09-02 2022-03-01 北京百度网讯科技有限公司 Living body detection model training method and device, electronic equipment and storage medium
CN114596638A (en) * 2020-11-30 2022-06-07 华为技术有限公司 Face living body detection method, device and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040048753A (en) * 2002-12-04 2004-06-10 삼성전자주식회사 Apparatus and method for distinguishing photograph in face recognition system
CN101216887A (en) * 2008-01-04 2008-07-09 浙江大学 An automatic computer authentication method for photographic faces and living faces

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040048753A (en) * 2002-12-04 2004-06-10 삼성전자주식회사 Apparatus and method for distinguishing photograph in face recognition system
CN101216887A (en) * 2008-01-04 2008-07-09 浙江大学 An automatic computer authentication method for photographic faces and living faces

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
CHU HE ET AL: "WLD: A Robust Local Image Descriptor", 《IEEE TRANSACTIONS ON SOFTWARE ENGINEERING》 *
TIAGO DE FREITAS PEREIRA ET AL: "LBP-TOP based countermeasure against face spoofing attacks", 《ACCVWORKSHOPS 2012》 *

Cited By (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105320950A (en) * 2015-11-23 2016-02-10 天津大学 A video human face living body detection method
CN105701495A (en) * 2016-01-05 2016-06-22 贵州大学 Image texture feature extraction method
CN105740775A (en) * 2016-01-25 2016-07-06 北京天诚盛业科技有限公司 Three-dimensional face living body recognition method and device
CN105975926B (en) * 2016-04-29 2019-06-21 中山大学 Human face in-vivo detection method based on light-field camera
CN105975926A (en) * 2016-04-29 2016-09-28 中山大学 Human face living detection method based on light field camera
CN106228129A (en) * 2016-07-18 2016-12-14 中山大学 A kind of human face in-vivo detection method based on MATV feature
CN106228129B (en) * 2016-07-18 2019-09-10 中山大学 A kind of human face in-vivo detection method based on MATV feature
WO2018133791A1 (en) * 2017-01-19 2018-07-26 腾讯科技(深圳)有限公司 Living body discrimination method and system based on video analysis, and storage medium
CN107122709B (en) * 2017-03-17 2020-12-04 上海云从企业发展有限公司 Living body detection method and device
CN107122709A (en) * 2017-03-17 2017-09-01 上海云从企业发展有限公司 Biopsy method and device
CN108875464A (en) * 2017-05-16 2018-11-23 南京农业大学 A kind of light music control system and control method based on three-dimensional face Emotion identification
CN107563283B (en) * 2017-07-26 2023-01-06 百度在线网络技术(北京)有限公司 Method, device, equipment and storage medium for generating attack sample
CN107563283A (en) * 2017-07-26 2018-01-09 百度在线网络技术(北京)有限公司 Method, apparatus, equipment and the storage medium of generation attack sample
CN107808115A (en) * 2017-09-27 2018-03-16 联想(北京)有限公司 A kind of biopsy method, device and storage medium
CN108021892B (en) * 2017-12-06 2021-11-19 上海师范大学 Human face living body detection method based on extremely short video
CN108021892A (en) * 2017-12-06 2018-05-11 上海师范大学 A kind of human face in-vivo detection method based on extremely short video
CN107992842A (en) * 2017-12-13 2018-05-04 深圳云天励飞技术有限公司 Biopsy method, computer installation and computer-readable recording medium
CN107992842B (en) * 2017-12-13 2020-08-11 深圳励飞科技有限公司 Living body detection method, computer device, and computer-readable storage medium
CN108596041B (en) * 2018-03-28 2019-05-14 中科博宏(北京)科技有限公司 A kind of human face in-vivo detection method based on video
CN108596041A (en) * 2018-03-28 2018-09-28 中科博宏(北京)科技有限公司 A kind of human face in-vivo detection method based on video
CN111259792B (en) * 2020-01-15 2023-05-12 暨南大学 DWT-LBP-DCT feature-based human face living body detection method
CN111259792A (en) * 2020-01-15 2020-06-09 暨南大学 Face living body detection method based on DWT-LBP-DCT characteristics
CN111797702A (en) * 2020-06-11 2020-10-20 南京信息工程大学 Face counterfeit video detection method based on spatial local binary pattern and optical flow gradient
CN112001429A (en) * 2020-08-06 2020-11-27 中山大学 Depth forgery video detection method based on texture features
CN112001429B (en) * 2020-08-06 2023-07-11 中山大学 Depth fake video detection method based on texture features
CN112132000B (en) * 2020-09-18 2024-01-23 睿云联(厦门)网络通讯技术有限公司 Living body detection method, living body detection device, computer readable medium and electronic equipment
CN112132000A (en) * 2020-09-18 2020-12-25 睿云联(厦门)网络通讯技术有限公司 Living body detection method and device, computer readable medium and electronic equipment
CN114596638A (en) * 2020-11-30 2022-06-07 华为技术有限公司 Face living body detection method, device and storage medium
CN112507847A (en) * 2020-12-03 2021-03-16 江苏科技大学 Face anti-fraud method based on neighborhood pixel difference weighting mode
CN112507847B (en) * 2020-12-03 2022-11-08 江苏科技大学 Face anti-fraud method based on neighborhood pixel difference weighting mode
CN114120452A (en) * 2021-09-02 2022-03-01 北京百度网讯科技有限公司 Living body detection model training method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN104933414B (en) 2018-06-05

Similar Documents

Publication Publication Date Title
CN104933414A (en) Living body face detection method based on WLD-TOP (Weber Local Descriptor-Three Orthogonal Planes)
Almaev et al. Local gabor binary patterns from three orthogonal planes for automatic facial expression recognition
CN103679158B (en) Face authentication method and device
CN102938065B (en) Face feature extraction method and face identification method based on large-scale image data
CN108537743A (en) A kind of face-image Enhancement Method based on generation confrontation network
Guo et al. Extended local binary patterns for efficient and robust spontaneous facial micro-expression recognition
CN107392187B (en) Face in-vivo detection method based on gradient direction histogram
Damer et al. Ear recognition using multi-scale histogram of oriented gradients
Xian et al. Evaluation of low-level features for real-world surveillance event detection
CN103605993B (en) Image-to-video face identification method based on distinguish analysis oriented to scenes
Yohanes et al. Real time face recognition comparison using fisherfaces and local binary pattern
CN104143091A (en) Single-sample face recognition method based on improved mLBP
Zuo et al. Face liveness detection algorithm based on livenesslight network
Yuan et al. A review of recent advances in ear recognition
Chen et al. Face deduplication in video surveillance
CN116645718A (en) Micro-expression recognition method and system based on multi-stream architecture
Geetha et al. 3D face recognition using Hadoop
CN114360058B (en) Cross-view gait recognition method based on walking view prediction
Patel et al. Robust face detection using fusion of haar and daubechies orthogonal wavelet template
Wang et al. Face recognition algorithm using wavelet decomposition and Support Vector Machines
Yang et al. Improving action units recognition using dense flow-based face registration in video
Ismaila et al. A study of features extraction algorithms for human face recognition
Li et al. Intelligent terminal face spoofing detection algorithm based on deep belief network
Li et al. Face anti-spoofing methods based on physical technology and deep learning
Bharathi et al. Discriminative dct-mlp based approach for off-line signature verification

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
OL01 Intention to license declared
OL01 Intention to license declared