WO2017070923A1 - Human face recognition method and apparatus - Google Patents

Human face recognition method and apparatus Download PDF

Info

Publication number
WO2017070923A1
WO2017070923A1 PCT/CN2015/093340 CN2015093340W WO2017070923A1 WO 2017070923 A1 WO2017070923 A1 WO 2017070923A1 CN 2015093340 W CN2015093340 W CN 2015093340W WO 2017070923 A1 WO2017070923 A1 WO 2017070923A1
Authority
WO
WIPO (PCT)
Prior art keywords
gradient
glac
feature
face image
order
Prior art date
Application number
PCT/CN2015/093340
Other languages
French (fr)
Chinese (zh)
Inventor
杨奇
陈书楷
Original Assignee
厦门中控生物识别信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 厦门中控生物识别信息技术有限公司 filed Critical 厦门中控生物识别信息技术有限公司
Priority to PCT/CN2015/093340 priority Critical patent/WO2017070923A1/en
Priority to CN201580000705.6A priority patent/CN105518717B/en
Publication of WO2017070923A1 publication Critical patent/WO2017070923A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions

Definitions

  • the present invention relates to the field of biometrics, and in particular, to a face recognition method and apparatus.
  • face recognition technology has made great progress and has begun to be widely used.
  • face recognition technologies including, for example, a face recognition technology based on the gradient local auto-correlation feature (Gradient Local Auto-Correlation feature, English abbreviation: glac).
  • the face recognition process will be affected by factors such as uneven illumination, face occlusion, and face posture changes, resulting in noise and reduced recognition. Precision.
  • Embodiments of the present invention provide a face recognition method and apparatus to solve the technical problem that the existing face recognition technology is not robust enough.
  • a first aspect of the present invention provides a face recognition method, including:
  • the pre-processed face image is direction-encoded to generate a gradient direction vector f, and the direction partition index of the gradient direction vector f is:
  • the chi-square test is used to calculate the distance between the glac features to be matched, and the similarity is identified.
  • a second aspect of the present invention provides a face recognition device, including:
  • a preprocessing module for preprocessing the face image by using linear spatial filtering
  • a direction coding module configured to perform direction coding on the pre-processed face image to generate a gradient direction vector f, where the direction partition index of the gradient direction vector f is:
  • a feature extraction module configured to extract a gradient local autocorrelation property glac feature according to the gradient direction vector
  • a calculation module is configured to calculate a distance between the glac features to be matched by using a chi-square test to identify the similarity.
  • a third aspect of the present invention provides a terminal device, including: a processor and a memory; the memory is configured to store a program; the processor is configured to execute a program in the memory, so that the terminal device performs the first method according to the present invention.
  • Aspects provide a face recognition method.
  • a fourth aspect of the present invention provides a storage medium storing one or more programs, the one or more programs including instructions that, when executed by a terminal device including one or more processors, cause the terminal The device performs the face recognition method as provided by the first aspect of the present invention.
  • an improved glac feature-based face recognition technical solution in which the direction of the pre-processed face image is performed.
  • Face recognition improves the ability to resist noise interference and can effectively improve the robustness of face recognition.
  • FIG. 1 is a schematic flowchart of a face recognition method according to an embodiment of the present invention.
  • Figure 2 (a) is a schematic diagram of a gradient direction vector f
  • 2(b) is a schematic diagram of a second-order adjacent position autocorrelation mode
  • Figure 2(c) is versus Schematic diagram of the autocorrelation legend
  • Figure 3 (a) is a schematic diagram showing the results of the FAR and FRR evaluation indicators of Experiment (1);
  • Figure 3 (b) is a schematic diagram of the results of the FAR and FRR evaluation indicators of Experiment (2);
  • Figure 3 (c) is a schematic diagram showing the results of the FAR and FRR evaluation indicators of Experiment (3);
  • Figure 3 (d) is a schematic diagram of the results of the FAR and FRR evaluation indicators of Experiment (4);
  • Figure 3(e) is a schematic diagram showing the results of the FAR and FRR evaluation indicators of Experiment (5);
  • Figure 3 (f) is a schematic diagram of the results of the FAR and FRR evaluation indicators of Experiment (6);
  • FIG. 4 is a schematic structural diagram of a face recognition device according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
  • the technical solution of the embodiment of the present invention is applicable to various application scenarios, for example, applicable to the Internet financial core, face recognition, face attribute recognition, face beautification, face cartoon drawing, face tracking, lip language recognition, living body Identify and other scenes.
  • the method of the embodiment of the invention can be implemented by various terminal devices such as an attendance machine, an access control system, a computer, a mobile phone, a notebook computer and the like.
  • a first embodiment of the present invention provides a face recognition method, which may include:
  • the direction partition index of the gradient direction vector f is:
  • an improved glac feature-based face recognition technical solution in which a gradient direction is generated by directionally encoding a pre-processed face image.
  • the ability to resist noise interference can effectively improve the robustness and recognition accuracy of face recognition.
  • the face recognition method provided by the embodiment of the present invention is a face recognition method based on the glac feature.
  • the glac feature describes the autocorrelation feature of the local image gradient in space and direction, and it can sparsely express the gradient of the pixel according to the amplitude and direction of each pixel on the image. She has 2nd-order autocorrelation statistics. It is a continuation of the extension of the 1st order histogram with displacement and no additivity.
  • the face recognition method based on glac feature can include three processes: one, image preprocessing; second, extracting glac features; third, using chi-square test to calculate the distance between glac features to be matched, and obtaining similarity scores, identifying similarities Sex, complete face recognition.
  • the second step of extracting the glac feature can be further divided into two steps: 1. Direction coding, 2. Using the gradient direction vector and the gradient magnitude, calculating the 1st and 2nd order autocorrelation gradient values in the local neighborhood, Get the glac feature. This is described in further detail below.
  • the step of pre-processing the face image may further include two processes:
  • the first pre-processing specifically, Gaussian difference filtering (Difference of Gaussian, English abbreviation: DoG) can be used for the first pre-processing of the face image.
  • Gaussian filters are a class of linear smoothing filters that select weights based on the shape of a Gaussian function.
  • Gaussian difference filtering is very effective for suppressing noise that obeys a normal distribution. By performing DoG processing on the face image, the influence of uneven illumination can be reduced.
  • the second pre-processing specifically, the linear pre-processing of the first pre-processed face image may be performed by linear spatial filtering.
  • Linear spatial filtering belongs to smoothing filtering.
  • the signal is to remove the glitch of a wave or a part above a certain frequency, which is simply low-pass filtering; the response to the image is noise reduction and image blurring (due to high-frequency response details, Therefore, the details are removed to obtain a blurred outline. Since the edges of the image are generally at a high frequency portion, such smoothing filtering causes edge blurring, that is, the image and the background are not distinct but blurred.
  • the output of the linear spatial filter is included in the filter mask
  • the simple average value of the pixels in the neighborhood of the film that is, the value of a certain pixel point is replaced by the average gray value of several pixels in the neighborhood, and the high frequency portion of the modified point is made smaller by the method of averaging.
  • Linear spatial filtering is applied to the prewitt operator.
  • the prewitt operator is an edge detection of a first-order differential operator.
  • the gray-scale difference between the upper and lower adjacent points of the pixel is used to reach the extreme detection edge at the edge, and some pseudo-edges are removed, which has a smooth effect on noise.
  • the linear spatial filtering uses a presitt operator as shown below:
  • the presitt operator is in the x direction In the y direction
  • linear spatial filtering can effectively enhance the ability of anti-noise interference by adopting the above presitt operator.
  • the pre-processed face image is I
  • r(x, y) is an arbitrary pixel point
  • I is a function of r(x, y)
  • the gradient is:
  • the amplitude is:
  • the direction is:
  • the face image signal I is a two-dimensional discrete function
  • the image gradient g is actually a derivative of the two-dimensional discrete function I.
  • the gradient g, the magnitude n, and the direction ⁇ are all functions of r(x, y). It should be noted that in the function of the direction ⁇ , arctan represents the arctangent in the inverse trigonometric function.
  • a gradient orientation vector (G-O vector) can be generated.
  • the gradient direction vector is represented by f.
  • the calculation of the gradient direction vector f is divided into two parts: a direction partition index and a direction vector. specific:
  • the direction partition index is:
  • is the gradient direction
  • bin is the number of direction partitions
  • index is the rounding of dindex
  • FIG. 2(a) is a schematic diagram of the gradient direction vector f in an example.
  • noise interference can be further suppressed by improving the calculation method of wei.
  • the glac feature is calculated by calculating the 1st and 2nd order autocorrelation gradient values according to the gradient direction vector f and the amplitude n, and concatenating the 1st and 2nd order autocorrelation gradient values to obtain the glac feature.
  • the gradient direction vectors f of the 1st order and the 2nd order are respectively recorded as orders in the order of with
  • a 1 is the displacement vector relative to the reference pixel point r
  • n(r) is the magnitude of the gradient relative to the reference pixel point r
  • f d is the dth gradient direction vector
  • d can be taken as d 0 , d 1 , etc.
  • 0 th order represents a first-order calculation mode
  • 1 th order represents a second-order calculation mode.
  • the specific steps of calculating the first-order and second-order autocorrelation gradient values include:
  • the value of the coefficient gamma is preferably 0.035;
  • the weights are voted according to the three-dimensional voting (Trilinear voting) to calculate the 1st order and 2nd autocorrelation gradient values.
  • bias is the position offset of the pixel in the 2*2 neighborhood.
  • the complete weight calculations for the 1st and 2nd orders use the above formula (9).
  • mag in equation (9) is equal to that in equation (7).
  • mag is equal to n(r) in the formula (6).
  • the direction partition index index is used.
  • the variables that calculate the dimension map include the spatial position of the pixel, the number of direction partitions, and the number of image partitions. Therefore, the numerical calculation of the glac feature is:
  • Glac v weight ⁇ wei;(10)
  • This formula (10) is applicable to both 1st and 2nd order and 3rd order calculations.
  • dim 2 bin ⁇ nw ⁇ nh+model ⁇ bin ⁇ bin ⁇ nw ⁇ nh; (12)
  • model is a 2nd-order adjacent position autocorrelation mode, such as shown in Figure 2(b);
  • Figure 2(c) shows versus Autocorrelation legend.
  • the glac feature is calculated, and the glac feature is used for the numerical values and dimensional representations calculated by the above formulas (10)-(11).
  • formulas (6)-(7) are numerical theoretical formulas of glac features, which can be derived from equations (4), (5), (8)-(12), and equations (4), (5). ), (8)-(10) are the actual calculation formulas (6)(7), and the formulas (11), (12) are the dimensional calculations of the glac features.
  • formula (6) It can be calculated by equations (4) and (5), where n(r) is the mag of the first order.
  • the formulas (4), (5), and (8)-(12) can be actually used for calculation.
  • the coefficient before the center point (x 0 , y 0 ) of the image width and height from 0.5 to 0.55, that is, the horizontal and vertical of the center point.
  • the coordinates are located 0.55 times the width and height of the image, respectively. Improvements can improve the robustness of the face recognition method.
  • min(n(r)+n(r+a 1 )) in the formula (7) is changed. Based on such improvements, the amplitude variation can be made more stable, avoiding large fluctuations due to noise.
  • the mag in the prior art is equal to min(n(r)+n(r+a 1 )), and is improved to mag equal to For the 1st order calculation, still make mag equal to n(r). Based on such improvements, the amplitude variation can be made more stable, avoiding large fluctuations due to noise.
  • the formula (7) Changed
  • the 1st and 2st stepwise direction vector values are mapped from the plane to the circular surface, and have convex and concave properties, which can reduce the influence of noise.
  • the value of gamma generally takes 0, indicating that the position of the center point (x 0 , y 0 ) does not affect the weight of formula (9).
  • the calculation formula of w p is changed to be as shown in formula (8), and wherein the value of gamma is preferably 0.035, such an improvement can make the pixel point have a discriminative weight distribution due to different spatial positions. .
  • the corresponding weight is added, for example, the weight of the first order is 0.1, the weight of the second order is 0.5, and the weight of the third order is 0.4, and these weights can be reflected in the parameter weight.
  • the variation pattern of the displacement vector a 1 relative to the reference pixel point r is represented by a matrix: [01; 11; 1-1], and only one model of the 3rd order is currently added: [1] , 0, 1], the 3rd order autocorrelation gradient value calculation method is similar to the 2nd order and will not be described in detail.
  • the glac feature is extracted separately, and different weights are also added to the segment. For example, a real number less than one may be multiplied in front of each chunk value, and the sum of such real numbers multiplied by each chunk is equal to one.
  • the distance between the glac features to be matched is calculated by using the chi-square test to identify the similarity, thereby implementing face recognition.
  • the distance between the glac features to be matched is calculated by the chi-square test
  • the first-order autocorrelation gradient values are removed, and weights are added to each image segment. Also, it is preferably the same as the block weight used to calculate the glac feature.
  • the embodiment of the invention improves the anti-noise interference ability by the feature matching method, and can effectively improve the robustness and recognition accuracy of the face recognition.
  • the embodiment of the present invention also performs a simulation experiment on the provided face recognition method, and uses FAR (False Acceptance Rate) and FRR (False Rejection Rate) indicators to evaluate the performance of the face recognition algorithm. In order to improve the face recognition method based on the glac feature at one time.
  • FAR False Acceptance Rate
  • FRR False Rejection Rate
  • the method of the embodiment of the present invention has improved the image pre-processing, extracting the glac feature and the feature matching, and can effectively reduce the FAR and FRR indicators of the face recognition algorithm, so that when the face is recognized, the method is more Great.
  • the ability to resist noise interference can effectively improve the robustness of face recognition.
  • a second embodiment of the present invention provides a face recognition device 400, which may include:
  • the preprocessing module 410 is configured to perform preprocessing on the face image by using linear spatial filtering
  • the direction coding module 420 is configured to perform direction coding on the pre-processed face image to generate a gradient direction vector f, where the direction partition index of the gradient direction vector f is:
  • a feature extraction module 430 configured to extract a gradient local autocorrelation property glac feature according to the gradient direction vector
  • the calculating module 440 is configured to calculate a distance between the glac features to be matched by using a chi-square test to identify the similarity.
  • the pre-processing module 410 may include:
  • a first pre-processing unit for performing a first pre-processing of the face image by using Gaussian difference filtering DoG;
  • a second pre-processing unit configured to perform a second pre-processing on the first pre-processed face image by using linear spatial filtering
  • linear spatial filtering uses the following presitt operator:
  • the direction encoding module 420 is specifically configured to:
  • the gradient is:
  • the amplitude is:
  • the direction is:
  • the direction ⁇ is encoded to generate a gradient direction vector f.
  • the feature extraction module 430 is specifically configured to calculate 1st order and 2nd order autocorrelation gradient values according to the gradient direction vector f and the amplitude n, and connect in series to obtain a glac feature.
  • the calculation module 440 uses the chi-square test to calculate the distance between the glac features to be matched, removes the 1st order autocorrelation gradient values, and adds weights to each image segmentation.
  • the face recognition device of the embodiment of the present invention may be, for example, an attendance machine, an access control system, or the like.
  • each function module of the face recognition device in the embodiment of the present invention may be specifically implemented according to the method in the foregoing method embodiment.
  • specific implementation process reference may be made to the related description in the foregoing method embodiment, and details are not described herein again. .
  • the ability to resist noise interference can effectively improve the robustness of face recognition.
  • an embodiment of the present invention further provides a terminal device 500.
  • the terminal device 500 can be a micro-processing computer device, and can include: a processor 510 and a memory 520; the memory 520 is configured to store a program; the processor 510 is configured to execute the program in the memory, such that The terminal device 500 performs some or all of the steps of the face recognition method provided in the above method embodiment.
  • the terminal device may further include a communication interface 530 and a bus 540.
  • the processor 510, the memory 520, and the communication interface 530 communicate with each other through the bus 540.
  • the communication interface 530 is configured to receive and send data. .
  • the processor 510 can perform the following steps:
  • the pre-processed face image is direction-encoded to generate a gradient direction vector f, and the direction partition index of the gradient direction vector f is:
  • the chi-square test is used to calculate the distance between the glac features to be matched, and the similarity is identified.
  • the terminal device may specifically be an attendance machine, an access control system, a computer, a mobile phone, a notebook computer, and the like.
  • an improved glac feature-based face recognition technical solution in which a gradient direction is generated by directionally encoding a pre-processed face image.
  • the ability to resist noise interference can effectively improve the robustness of face recognition.
  • Embodiments of the present invention also provide a storage medium storing one or more programs, the one or more programs including instructions that, when executed by a terminal device including one or more processors, cause the terminal
  • the apparatus performs some or all of the steps of the face recognition method as provided in the above method embodiments.
  • the program may be stored in a computer readable storage medium, and the storage medium may include: ROM, RAM, disk or CD.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

A human face recognition method and apparatus for solving the technical problem that the robustness of existing human face recognition techniques is not good enough. The method comprises: pre-processing a human face image by means of linear spatial filtering; performing direction encoding on the pre-processed human face image, and generating a gradient direction vector f, wherein a direction partition index of the gradient direction vector f is: dindex = θ × bin/2π, and a direction weight is: wei = (1 + index - dindex)3, where θ is the gradient direction, bin is the number of direction partitions, and index is an integer obtained after dindex is rounded off; extracting gradient local auto-correlation (glac) features according to the gradient direction vector; and utilizing a chi-squared test to calculate a distance between glac features to be matched, and recognizing the similarity.

Description

一种人脸识别方法和装置Face recognition method and device 技术领域Technical field
本发明涉及生物识别技术领域,具体涉及一种人脸识别方法和装置。The present invention relates to the field of biometrics, and in particular, to a face recognition method and apparatus.
背景技术Background technique
近年来,人脸识别技术取得了很大进步,开始被广泛应用。人脸识别技术包括很多种,例如包括一种基于梯度局部自相关特性(英文全称:Gradient Local Auto-Correlation feature,英文简称:glac)特征的人脸识别技术。In recent years, face recognition technology has made great progress and has begun to be widely used. There are many kinds of face recognition technologies, including, for example, a face recognition technology based on the gradient local auto-correlation feature (Gradient Local Auto-Correlation feature, English abbreviation: glac).
但是,人脸识别研究中仍然有一些问题没有被很好的解决,例如,人脸识别过程中会受到光照不均,人脸遮挡,人脸姿态变化等因素的影响,从而产生噪声,降低识别精度。However, there are still some problems in the face recognition research that are not well solved. For example, the face recognition process will be affected by factors such as uneven illumination, face occlusion, and face posture changes, resulting in noise and reduced recognition. Precision.
实践发现,现有的人脸识别技术例如基于glac特征的人脸识别技术,其鲁棒性不够好。Practice has found that existing face recognition techniques such as face recognition based on glac features are not robust enough.
发明内容Summary of the invention
本发明实施例提供一种人脸识别方法和装置,以解决现有的人脸识别技术的鲁棒性不够好的技术问题。Embodiments of the present invention provide a face recognition method and apparatus to solve the technical problem that the existing face recognition technology is not robust enough.
本发明第一方面提供一种人脸识别方法,包括:A first aspect of the present invention provides a face recognition method, including:
采用线性空间滤波对人脸图像进行预处理;Preprocessing the face image with linear spatial filtering;
对预处理后的人脸图像进行方向编码,生成梯度方向向量f,所述梯度方向向量f的方向分区索引为:
Figure PCTCN2015093340-appb-000001
方向权重为:wei=(1+index-dindex)3,其中,θ为梯度方向,bin为方向分区数量,index是对dindex的取整;
The pre-processed face image is direction-encoded to generate a gradient direction vector f, and the direction partition index of the gradient direction vector f is:
Figure PCTCN2015093340-appb-000001
The direction weight is: wei=(1+index-dindex) 3 , where θ is the gradient direction, bin is the number of direction partitions, and index is the rounding of dindex;
根据所述梯度方向向量提取梯度局部自相关特性glac特征;Extracting a gradient local autocorrelation property glac feature according to the gradient direction vector;
利用卡方检验计算待匹配glac特征之间的距离,识别相似性。The chi-square test is used to calculate the distance between the glac features to be matched, and the similarity is identified.
本发明第二方面提供一种人脸识别装置,包括:A second aspect of the present invention provides a face recognition device, including:
预处理模块,用于采用线性空间滤波对人脸图像进行预处理;a preprocessing module for preprocessing the face image by using linear spatial filtering;
方向编码模块,用于对预处理后的人脸图像进行方向编码,生成梯度方向向量f,所述梯度方向向量f的方向分区索引为:
Figure PCTCN2015093340-appb-000002
方向权重为: wei=(1+index-dindex)3,其中,θ为梯度方向,bin为方向分区数量,index是对dindex的取整;
a direction coding module, configured to perform direction coding on the pre-processed face image to generate a gradient direction vector f, where the direction partition index of the gradient direction vector f is:
Figure PCTCN2015093340-appb-000002
The direction weight is: wei=(1+index-dindex) 3 , where θ is the gradient direction, bin is the number of direction partitions, and index is the rounding of dindex;
特征提取模块,用于根据所述梯度方向向量提取梯度局部自相关特性glac特征;a feature extraction module, configured to extract a gradient local autocorrelation property glac feature according to the gradient direction vector;
计算模块,用于利用卡方检验计算待匹配glac特征之间的距离,识别相似性。A calculation module is configured to calculate a distance between the glac features to be matched by using a chi-square test to identify the similarity.
本发明第三方面提供一种终端设备,包括:处理器和存储器;所述存储器用于存储程序;所述处理器用于执行所述存储器中的程序,使得所述终端设备执行如本发明第一方面提供人脸识别方法。A third aspect of the present invention provides a terminal device, including: a processor and a memory; the memory is configured to store a program; the processor is configured to execute a program in the memory, so that the terminal device performs the first method according to the present invention. Aspects provide a face recognition method.
本发明第四方面提供一种存储一个或多个程序的存储介质,所述一个或多个程序包括指令,所述指令当被包括一个或多个处理器的终端设备执行时,使所述终端设备执行如本发明第一方面提供的人脸识别方法。A fourth aspect of the present invention provides a storage medium storing one or more programs, the one or more programs including instructions that, when executed by a terminal device including one or more processors, cause the terminal The device performs the face recognition method as provided by the first aspect of the present invention.
由上可见,由上可见,在本发明的一些可行的实施方式中,提供了一种改进的、基于glac特征的人脸识别技术方案,该方案中通过对预处理后的人脸图像进行方向编码生成梯度方向向量,并将梯度方向向量f的方向权重定义为wei=(1+index-dindex)3,以及,提取glac特征,利用卡方检验计算待匹配glac特征之间的距离来实现人脸识别,提高了抗噪声干扰的能力,可有效提高人脸识别的鲁棒性。As can be seen from the above, in some feasible embodiments of the present invention, an improved glac feature-based face recognition technical solution is provided, in which the direction of the pre-processed face image is performed. The code generates a gradient direction vector, and defines the direction weight of the gradient direction vector f as wei=(1+index-dindex) 3 , and extracts the glac feature, and calculates the distance between the glac features to be matched by using the chi-square test to realize the person. Face recognition improves the ability to resist noise interference and can effectively improve the robustness of face recognition.
附图说明DRAWINGS
为了更清楚地说明本发明实施例技术方案,下面将对实施例和现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其它的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments and the prior art description will be briefly described below. Obviously, the drawings in the following description are only some implementations of the present invention. For example, other drawings may be obtained from those skilled in the art without any inventive effort.
图1是本发明实施例提供的一种人脸识别方法的流程示意图;1 is a schematic flowchart of a face recognition method according to an embodiment of the present invention;
图2(a)是梯度方向向量f的示意图;Figure 2 (a) is a schematic diagram of a gradient direction vector f;
图2(b)是2阶相邻位置自相关模式示意图;2(b) is a schematic diagram of a second-order adjacent position autocorrelation mode;
图2(c)是
Figure PCTCN2015093340-appb-000003
Figure PCTCN2015093340-appb-000004
的自相关图例示意图;
Figure 2(c) is
Figure PCTCN2015093340-appb-000003
versus
Figure PCTCN2015093340-appb-000004
Schematic diagram of the autocorrelation legend;
图3(a)是实验(1)的FAR和FRR评价指标结果示意图;Figure 3 (a) is a schematic diagram showing the results of the FAR and FRR evaluation indicators of Experiment (1);
图3(b)是实验(2)的FAR和FRR评价指标结果示意图;Figure 3 (b) is a schematic diagram of the results of the FAR and FRR evaluation indicators of Experiment (2);
图3(c)是实验(3)的FAR和FRR评价指标结果示意图;Figure 3 (c) is a schematic diagram showing the results of the FAR and FRR evaluation indicators of Experiment (3);
图3(d)是实验(4)的FAR和FRR评价指标结果示意图;Figure 3 (d) is a schematic diagram of the results of the FAR and FRR evaluation indicators of Experiment (4);
图3(e)是实验(5)的FAR和FRR评价指标结果示意图;Figure 3(e) is a schematic diagram showing the results of the FAR and FRR evaluation indicators of Experiment (5);
图3(f)是实验(6)的FAR和FRR评价指标结果示意图;Figure 3 (f) is a schematic diagram of the results of the FAR and FRR evaluation indicators of Experiment (6);
图4是本发明实施例提供的一种人脸识别装置的结构示意图;4 is a schematic structural diagram of a face recognition device according to an embodiment of the present invention;
图5是本发明实施例提供的一种终端设备的结构示意图。FIG. 5 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
具体实施方式Detailed ways
为了使本技术领域的人员更好地理解本发明方案,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分的实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is an embodiment of the invention, but not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts shall fall within the scope of the present invention.
本发明实施例技术方案适用于多种应用场景,例如,可应用于互联网金融核身,人脸识别,人脸属性识别,人脸美化,人脸卡通画,人脸跟踪,唇语识别,活体识别等场景。本发明实施例方法可以由考勤机,门禁系统,计算机,手机,笔记本电脑等各种终端设备实施。The technical solution of the embodiment of the present invention is applicable to various application scenarios, for example, applicable to the Internet financial core, face recognition, face attribute recognition, face beautification, face cartoon drawing, face tracking, lip language recognition, living body Identify and other scenes. The method of the embodiment of the invention can be implemented by various terminal devices such as an attendance machine, an access control system, a computer, a mobile phone, a notebook computer and the like.
请参考图1,本发明的第一实施例提供一种人脸识别方法,该方法可包括:Referring to FIG. 1, a first embodiment of the present invention provides a face recognition method, which may include:
101、采用线性空间滤波对人脸图像进行预处理;101. Preprocessing the face image by linear spatial filtering;
102、对预处理后的人脸图像进行方向编码,生成梯度方向向量f,所述梯度方向向量f的方向分区索引为:
Figure PCTCN2015093340-appb-000005
方向权重为:wei=(1+index-dindex)3,其中,θ为梯度方向,bin为方向分区数量,index是对dindex的取整;
102. Perform direction coding on the pre-processed face image to generate a gradient direction vector f. The direction partition index of the gradient direction vector f is:
Figure PCTCN2015093340-appb-000005
The direction weight is: wei=(1+index-dindex) 3 , where θ is the gradient direction, bin is the number of direction partitions, and index is the rounding of dindex;
103、根据所述梯度方向向量提取梯度局部自相关特性glac特征;103. Extract a gradient local autocorrelation property glac feature according to the gradient direction vector;
104、利用卡方检验计算待匹配glac特征之间的距离,识别相似性。104. Calculate the distance between the glac features to be matched by using a chi-square test to identify the similarity.
由上可见,在本发明的一些可行的实施方式中,提供了一种改进的、基于 glac特征的人脸识别技术方案,该方案中通过对预处理后的人脸图像进行方向编码生成梯度方向向量,并将梯度方向向量f的方向权重定义为wei=(1+index-dindex)3,以及,提取glac特征,利用卡方检验计算待匹配glac特征之间的距离来实现人脸识别,提高了抗噪声干扰的能力,可有效提高人脸识别的鲁棒性和识别精度。It can be seen that, in some feasible embodiments of the present invention, an improved glac feature-based face recognition technical solution is provided, in which a gradient direction is generated by directionally encoding a pre-processed face image. Vector, and define the direction weight of the gradient direction vector f as wei=(1+index-dindex) 3 , and extract the glac feature, and calculate the distance between the glac features to be matched by the chi-square test to realize face recognition and improve The ability to resist noise interference can effectively improve the robustness and recognition accuracy of face recognition.
需要说明的是,本发明实施例提供的人脸识别方法是基于glac特征的人脸识别方法。glac特征是描述局部图像梯度在空间和方向上的自相关特征,而且它可以根据图像上每个像素点的幅值和方向,稀疏表述该像素点的梯度,她具有2阶自相关统计信息,是1阶直方图的扩展的延续,具有位移不变形和可加性。It should be noted that the face recognition method provided by the embodiment of the present invention is a face recognition method based on the glac feature. The glac feature describes the autocorrelation feature of the local image gradient in space and direction, and it can sparsely express the gradient of the pixel according to the amplitude and direction of each pixel on the image. She has 2nd-order autocorrelation statistics. It is a continuation of the extension of the 1st order histogram with displacement and no additivity.
基于glac特征的人脸识别方法可包括三个过程:一、图像预处理;二、提取glac特征;三、利用卡方检验计算待匹配glac特征之间的距离,得出相似性分数,识别相似性,完成人脸识别。其中,第二步的提取glac特征可进一步分为两个步骤:1、方向编码,2、利用梯度方向向量和梯度幅值,计算在局部邻域中的1阶和2阶自相关梯度值,得到glac特征。下面进一步详细说明。The face recognition method based on glac feature can include three processes: one, image preprocessing; second, extracting glac features; third, using chi-square test to calculate the distance between glac features to be matched, and obtaining similarity scores, identifying similarities Sex, complete face recognition. The second step of extracting the glac feature can be further divided into two steps: 1. Direction coding, 2. Using the gradient direction vector and the gradient magnitude, calculating the 1st and 2nd order autocorrelation gradient values in the local neighborhood, Get the glac feature. This is described in further detail below.
一、图像预处理:First, image preprocessing:
本发明实例中,对人脸图像进行预处理的步骤可进一步包括两个过程:In the example of the present invention, the step of pre-processing the face image may further include two processes:
第一次预处理;具体的,可采用高斯差分滤波(Difference of Gaussian,英文简称:DoG)对人脸图像进行第一次预处理。高斯滤波器是一类根据高斯函数的形状来选择权值的线性平滑滤波器,高斯差分滤波对于抑制服从正态分布的噪声非常有效。通过对人脸图像进行DoG处理,可以减少光照不均的影响。The first pre-processing; specifically, Gaussian difference filtering (Difference of Gaussian, English abbreviation: DoG) can be used for the first pre-processing of the face image. Gaussian filters are a class of linear smoothing filters that select weights based on the shape of a Gaussian function. Gaussian difference filtering is very effective for suppressing noise that obeys a normal distribution. By performing DoG processing on the face image, the influence of uneven illumination can be reduced.
第二次预处理;具体的,可采用线性空间滤波对第一次预处理后的人脸图像进行第二次预处理。线性空间滤波属于平滑滤波,信号上就是将一个波的毛刺或某一频率以上的部分去掉,简单说就是低通滤波;反应到图像上就是降噪和图像模糊处理(由于高频反应了细节,故而去除细节得到模糊的轮廓),由于图像的边缘一般处于高频部分,所以这种平滑滤波就会造成边缘模糊,即图像与背景不会泾渭分明而是模糊过渡。线性空间滤波器的输出为包含在滤波掩 膜邻域内像素的简单平均值,即某个像素点的值用邻域这若干个像素点的平均灰度值来代替,通过求平均的方法使得改点的高频部分变小。The second pre-processing; specifically, the linear pre-processing of the first pre-processed face image may be performed by linear spatial filtering. Linear spatial filtering belongs to smoothing filtering. The signal is to remove the glitch of a wave or a part above a certain frequency, which is simply low-pass filtering; the response to the image is noise reduction and image blurring (due to high-frequency response details, Therefore, the details are removed to obtain a blurred outline. Since the edges of the image are generally at a high frequency portion, such smoothing filtering causes edge blurring, that is, the image and the background are not distinct but blurred. The output of the linear spatial filter is included in the filter mask The simple average value of the pixels in the neighborhood of the film, that is, the value of a certain pixel point is replaced by the average gray value of several pixels in the neighborhood, and the high frequency portion of the modified point is made smaller by the method of averaging.
线性空间滤波应用到prewitt算子。prewitt算子是一种一阶微分算子的边缘检测,利用像素点上下、左右邻点的灰度差,在边缘处达到极值检测边缘,去掉部分伪边缘,对噪声具有平滑作用。本发明实施例中,线性空间滤波采用如下所示的presitt算子:Linear spatial filtering is applied to the prewitt operator. The prewitt operator is an edge detection of a first-order differential operator. The gray-scale difference between the upper and lower adjacent points of the pixel is used to reach the extreme detection edge at the edge, and some pseudo-edges are removed, which has a smooth effect on noise. In the embodiment of the present invention, the linear spatial filtering uses a presitt operator as shown below:
该presitt算子在x方向上为
Figure PCTCN2015093340-appb-000006
在y方向上为
Figure PCTCN2015093340-appb-000007
The presitt operator is in the x direction
Figure PCTCN2015093340-appb-000006
In the y direction
Figure PCTCN2015093340-appb-000007
本发明实例中,线性空间滤波通过采用上述的presitt算子,可以有效增强抗噪声干扰的能力。In the example of the present invention, linear spatial filtering can effectively enhance the ability of anti-noise interference by adopting the above presitt operator.
二、提取glac特征Second, extract glac features
1、方向编码:1, direction coding:
本发明实施例中,设预处理后的人脸图像为I,r(x,y)为任意像素点,I是r(x,y)的函数,则在x和y方向上,In the embodiment of the present invention, it is assumed that the pre-processed face image is I, r(x, y) is an arbitrary pixel point, and I is a function of r(x, y), then in the x and y directions,
梯度为:
Figure PCTCN2015093340-appb-000008
The gradient is:
Figure PCTCN2015093340-appb-000008
幅值为:
Figure PCTCN2015093340-appb-000009
The amplitude is:
Figure PCTCN2015093340-appb-000009
方向为:
Figure PCTCN2015093340-appb-000010
The direction is:
Figure PCTCN2015093340-appb-000010
可见,人脸图像信号I为二维离散函数,图像梯度g其实就是对这个二维离散函数I的求导。梯度g,幅值n,方向θ都是r(x,y)的函数。其中需要说明的是,方向θ的函数中,arctan表示反三角函数中的反正切。It can be seen that the face image signal I is a two-dimensional discrete function, and the image gradient g is actually a derivative of the two-dimensional discrete function I. The gradient g, the magnitude n, and the direction θ are all functions of r(x, y). It should be noted that in the function of the direction θ, arctan represents the arctangent in the inverse trigonometric function.
然后,对方向θ进行编码,即可生成梯度方向向量(gradient orientation vector,简称G-O vector),本文中用f来表示梯度方向向量。梯度方向向量f的计算分为两部分:方向分区索引和方向向量。具体的: Then, by encoding the direction θ, a gradient orientation vector (G-O vector) can be generated. In this paper, the gradient direction vector is represented by f. The calculation of the gradient direction vector f is divided into two parts: a direction partition index and a direction vector. specific:
方向分区索引为:
Figure PCTCN2015093340-appb-000011
The direction partition index is:
Figure PCTCN2015093340-appb-000011
方向权重为:wei=(1+index-dindex)3;(5)The direction weight is: wei=(1+index-dindex) 3 ;(5)
其中,θ为梯度方向,bin为方向分区数量,index是对dindex的取整。Where θ is the gradient direction, bin is the number of direction partitions, and index is the rounding of dindex.
请参考图2(a)所示,是一个实例中梯度方向向量f的示意图。Please refer to FIG. 2(a), which is a schematic diagram of the gradient direction vector f in an example.
需要说明的是,传统的glac特征提取方法中,方法权重wei的计算公式为:wei=1+index-dindex。本发明实施例中,通过改进wei的计算方法,可进一步抑制噪声干扰。It should be noted that in the conventional glac feature extraction method, the calculation formula of the method weight wei is: wei=1+index-dindex. In the embodiment of the present invention, noise interference can be further suppressed by improving the calculation method of wei.
2、glac特征的计算2, the calculation of glac features
glac特征的计算,就是根据所述梯度方向向量f和幅值n等,计算1阶和2阶自相关梯度值,并将1阶和2阶自相关梯度值串联,从而得到glac特征。需要说明的是,本文中按阶数将1阶和2阶的梯度方向向量f分别记为
Figure PCTCN2015093340-appb-000012
Figure PCTCN2015093340-appb-000013
The glac feature is calculated by calculating the 1st and 2nd order autocorrelation gradient values according to the gradient direction vector f and the amplitude n, and concatenating the 1st and 2nd order autocorrelation gradient values to obtain the glac feature. It should be noted that the gradient direction vectors f of the 1st order and the 2nd order are respectively recorded as orders in the order of
Figure PCTCN2015093340-appb-000012
with
Figure PCTCN2015093340-appb-000013
glac特征的理论计算公式为:The theoretical calculation formula for the glac feature is:
Figure PCTCN2015093340-appb-000014
Figure PCTCN2015093340-appb-000014
Figure PCTCN2015093340-appb-000015
Figure PCTCN2015093340-appb-000015
其中,a1为相对参考像素点r的位移向量(displacement vector),n(r)为相对参考像素点r的梯度的幅值,fd为第d个梯度方向向量;d可以取为d0,d1等;RN=0(d0)为1阶自相关梯度值,RN=1(d0,d1,a1)为2阶自相关梯度值。0thorder表示1阶计算模式,1thorder表示2阶计算模式。Where a 1 is the displacement vector relative to the reference pixel point r, n(r) is the magnitude of the gradient relative to the reference pixel point r, f d is the dth gradient direction vector; d can be taken as d 0 , d 1 , etc.; R N=0 (d 0 ) is a first-order autocorrelation gradient value, and R N=1 (d 0 , d 1 , a 1 ) is a second-order autocorrelation gradient value. 0 th order represents a first-order calculation mode, and 1 th order represents a second-order calculation mode.
需要说明的是,本发明实施例中,实际上的计算不采用上述理论计算公式。本发明实施例中,具体的计算1阶和2阶自相关梯度值的步骤包括:It should be noted that, in the embodiment of the present invention, the actual calculation formula is not adopted in the actual calculation. In the embodiment of the present invention, the specific steps of calculating the first-order and second-order autocorrelation gradient values include:
2.1、设人脸图像宽和高的中心像素点(x0,y0),以此为参考像素点,计算每个像素点(x,y)的空间位置权重wp,计算公式如下:2.1. Set the center pixel point (x 0 , y 0 ) of the face image width and height as the reference pixel point, and calculate the spatial position weight w p of each pixel point (x, y). The calculation formula is as follows:
Figure PCTCN2015093340-appb-000016
Figure PCTCN2015093340-appb-000016
其中,系数gamma的值优选为0.035;Wherein the value of the coefficient gamma is preferably 0.035;
并在该像素点(x,y)处2*2领域内,按照三维方向线性投票(Trilinear voting)选举权重,以计算1阶和2接自相关梯度值。 And in the 2*2 field at the pixel (x, y), the weights are voted according to the three-dimensional voting (Trilinear voting) to calculate the 1st order and 2nd autocorrelation gradient values.
2.2、完整的权重计算公式为:weight=wp·mag·bias;(9)2.2, the complete weight calculation formula is: weight=w p ·mag·bias; (9)
其中,bias是像素点在2*2邻域内的位置偏置。1阶和2阶的完整权重计算均采用上述公式(9)。Among them, bias is the position offset of the pixel in the 2*2 neighborhood. The complete weight calculations for the 1st and 2nd orders use the above formula (9).
以2阶的完整权重计算为例,公式(9)中mag等于公式(7)中的
Figure PCTCN2015093340-appb-000017
Taking the second-order full weight calculation as an example, the mag in equation (9) is equal to that in equation (7).
Figure PCTCN2015093340-appb-000017
1阶的完整权重计算中,mag等于公式(6)中的n(r)。In the complete weight calculation of the 1st order, mag is equal to n(r) in the formula (6).
2.3、fd在实际应用中,体现在两个方面:2.3, f d in practical applications, reflected in two aspects:
一方面,在自相关梯度值计算上,应用方向权重wei;On the one hand, in the calculation of the autocorrelation gradient value, the direction weight wei is applied;
另一方面,在glac特征的维数映射上,使用方向分区索引index。On the other hand, on the dimensional mapping of the glac feature, the direction partition index index is used.
计算维数映射的变量包括该像素点的空间位置、方向分区数量和图像分块数量,所以,glac特征的数值计算就为:The variables that calculate the dimension map include the spatial position of the pixel, the number of direction partitions, and the number of image partitions. Therefore, the numerical calculation of the glac feature is:
glacv=weight·wei;(10)Glac v =weight·wei;(10)
该公式(10)同时适用于1阶和2阶以及3阶计算。This formula (10) is applicable to both 1st and 2nd order and 3rd order calculations.
而在维数计算上,1阶维数的计算公式为:dim1=bin·nw·nh;(11)In the dimension calculation, the formula for calculating the 1st dimension is: dim 1 = bin·nw·nh; (11)
2阶维数的计算公式为:dim2=bin·nw·nh+model·bin·bin·nw·nh;(12)The formula for calculating the second-order dimension is: dim 2 = bin·nw·nh+model·bin·bin·nw·nh; (12)
其中,nw和nh分别是在图像的宽和高上的等分数;model是2阶相邻位置自相关模式,例如图2(b)所示;图2(c)所示是
Figure PCTCN2015093340-appb-000018
Figure PCTCN2015093340-appb-000019
的自相关图例。
Where nw and nh are equal fractions on the width and height of the image, respectively; model is a 2nd-order adjacent position autocorrelation mode, such as shown in Figure 2(b); Figure 2(c) shows
Figure PCTCN2015093340-appb-000018
versus
Figure PCTCN2015093340-appb-000019
Autocorrelation legend.
至此,计算得到glac特征,glac特征用于上述公式(10)-(11)计算得到的数值和维数表示。So far, the glac feature is calculated, and the glac feature is used for the numerical values and dimensional representations calculated by the above formulas (10)-(11).
需要说明的是,上述公式(6)-(7)是glac特征的数值理论公式,可以由公式(4),(5),(8)-(12)得出,公式(4),(5),(8)-(10)是实际计算公式(6)(7),而公式(11),(12)是glac特征的维数计算。其中,公式(6)中
Figure PCTCN2015093340-appb-000020
可用公式(4)和(5)计算,n(r)就是1阶的mag。本发明实施例中可实际采用公式(4),(5),(8)-(12)计算。
It should be noted that the above formulas (6)-(7) are numerical theoretical formulas of glac features, which can be derived from equations (4), (5), (8)-(12), and equations (4), (5). ), (8)-(10) are the actual calculation formulas (6)(7), and the formulas (11), (12) are the dimensional calculations of the glac features. Among them, in formula (6)
Figure PCTCN2015093340-appb-000020
It can be calculated by equations (4) and (5), where n(r) is the mag of the first order. In the embodiment of the present invention, the formulas (4), (5), and (8)-(12) can be actually used for calculation.
2.4、下面,对本发明实施例中glac特征的计算步骤相对于现有技术的改进作出说明。2.4. In the following, the calculation steps of the glac feature in the embodiment of the present invention are described with respect to the improvement of the prior art.
(1)经过在红外人脸数据库上的实验,本发明实施例中优选把图像宽和高的中心点(x0,y0)前的系数由0.5该为0.55,即,中心点的横纵坐标分别位于 图像宽和高的0.55倍处。改进后,可改善人脸识别方法的鲁棒性。(1) After experiments on the infrared face database, in the embodiment of the present invention, it is preferable to set the coefficient before the center point (x 0 , y 0 ) of the image width and height from 0.5 to 0.55, that is, the horizontal and vertical of the center point. The coordinates are located 0.55 times the width and height of the image, respectively. Improvements can improve the robustness of the face recognition method.
(2)对于公式(7)和(8):(2) For equations (7) and (8):
现有技术中的公式(7)为:The formula (7) in the prior art is:
Figure PCTCN2015093340-appb-000021
Figure PCTCN2015093340-appb-000021
本发明实施例中,将公式(7)中的min(n(r)+n(r+a1))改为了
Figure PCTCN2015093340-appb-000022
基于这样的改进,可以使幅值变化更加平稳,避免出现因噪声带来的较大波动。
In the embodiment of the present invention, min(n(r)+n(r+a 1 )) in the formula (7) is changed.
Figure PCTCN2015093340-appb-000022
Based on such improvements, the amplitude variation can be made more stable, avoiding large fluctuations due to noise.
相应的,公式(8)中,对于2阶计算,将现有技术中的mag等于min(n(r)+n(r+a1)),改进为mag等于
Figure PCTCN2015093340-appb-000023
对于1阶计算,仍令mag等于n(r)。基于这样的改进,可以使幅值变化更加平稳,避免出现因噪声带来的较大波动。
Correspondingly, in the formula (8), for the second-order calculation, the mag in the prior art is equal to min(n(r)+n(r+a 1 )), and is improved to mag equal to
Figure PCTCN2015093340-appb-000023
For the 1st order calculation, still make mag equal to n(r). Based on such improvements, the amplitude variation can be made more stable, avoiding large fluctuations due to noise.
本发明实施例中,将公式(7)中的改为了
Figure PCTCN2015093340-appb-000025
使得1阶和2阶梯度方向向量值由平面映射到圆面,具有凸凹性质,能减少噪声影响。
In the embodiment of the present invention, the formula (7) Changed
Figure PCTCN2015093340-appb-000025
The 1st and 2st stepwise direction vector values are mapped from the plane to the circular surface, and have convex and concave properties, which can reduce the influence of noise.
(3)对于公式(8)中的空间位置权重计算方法:(3) For the calculation of the spatial position weight in formula (8):
现有技术中的空间位置权重计算方法的计算公式为:The calculation formula of the spatial position weight calculation method in the prior art is:
Figure PCTCN2015093340-appb-000026
其中,gamma的值一般取0,表示中心点(x0,y0)的位置不影响公式(9)的权重。
Figure PCTCN2015093340-appb-000026
Among them, the value of gamma generally takes 0, indicating that the position of the center point (x 0 , y 0 ) does not affect the weight of formula (9).
本发明实施例中,wp的计算公式改为如公式(8)所示,并且,其中gamma的值优选为0.035,这样的改进,可以使像素点因空间位置不同而具有判别性的权重分布。In the embodiment of the present invention, the calculation formula of w p is changed to be as shown in formula (8), and wherein the value of gamma is preferably 0.035, such an improvement can make the pixel point have a discriminative weight distribution due to different spatial positions. .
(4)对于公式(10)中的glac特征的数值计算:(4) Numerical calculation of the glac feature in equation (10):
本发明实施例中,加上相应的权重,比如1阶的权重为0.1,2阶的权重是0.5,3阶的权重是0.4,这些权重可反映的参数weight中。在2阶的4个model中,位移向量a1相对参考像素点r的变化模式,用一个矩阵表示为:[01;11;1-1],目前只增加一个3阶的一个model:[1,0,1],3阶的自相关梯度值计算方法与2阶的类似,不再详细描述。 In the embodiment of the present invention, the corresponding weight is added, for example, the weight of the first order is 0.1, the weight of the second order is 0.5, and the weight of the third order is 0.4, and these weights can be reflected in the parameter weight. In the 4 models of the 2nd order, the variation pattern of the displacement vector a 1 relative to the reference pixel point r is represented by a matrix: [01; 11; 1-1], and only one model of the 3rd order is currently added: [1] , 0, 1], the 3rd order autocorrelation gradient value calculation method is similar to the 2nd order and will not be described in detail.
其中,[01;11;1-1]写成标准的矩阵形式为:
Figure PCTCN2015093340-appb-000027
Among them, [01;11;1-1] is written as a standard matrix form:
Figure PCTCN2015093340-appb-000027
(5)本发明实施例中,对于图像分块,分别提取glac特征的情况,也对分块添加不同的权重。例如,可以在每个分块值的前面乘以小于1的实数,各分块前面乘的这种实数之和等于1。(5) In the embodiment of the present invention, for the image segmentation, the glac feature is extracted separately, and different weights are also added to the segment. For example, a real number less than one may be multiplied in front of each chunk value, and the sum of such real numbers multiplied by each chunk is equal to one.
3、特征匹配3, feature matching
本发明实施例中,利用卡方检验计算待匹配glac特征之间的距离,来识别相似性,从而实现人脸识别。In the embodiment of the present invention, the distance between the glac features to be matched is calculated by using the chi-square test to identify the similarity, thereby implementing face recognition.
需要说明的是,本发明优选实施例中,在利用卡方检验计算待匹配glac特征之间的距离时,去掉1阶自相关梯度值,并为每个图像分块加上权重。并且,优选与计算glac特征所用的分块权重相同。It should be noted that, in a preferred embodiment of the present invention, when the distance between the glac features to be matched is calculated by the chi-square test, the first-order autocorrelation gradient values are removed, and weights are added to each image segment. Also, it is preferably the same as the block weight used to calculate the glac feature.
本发明实施例通过该种特征匹配方法,提高了抗噪声干扰的能力,可有效提高人脸识别的鲁棒性和识别精度。The embodiment of the invention improves the anti-noise interference ability by the feature matching method, and can effectively improve the robustness and recognition accuracy of the face recognition.
4、实验结果4. Experimental results
本发明实施例还对提供的人脸识别方法进行了仿真实验,利用FAR(False Acceptance Rate,认假率)和FRR(False Rejection Rate,拒真率)指标,来评价该人脸识别算法的性能,以便一次改进基于glac特征的人脸识别方法。The embodiment of the present invention also performs a simulation experiment on the provided face recognition method, and uses FAR (False Acceptance Rate) and FRR (False Rejection Rate) indicators to evaluate the performance of the face recognition algorithm. In order to improve the face recognition method based on the glac feature at one time.
实验结果如下:The experimental results are as follows:
(1)在用线性空间滤波时,把滤波器换成prewitt算子,在包含29800副人脸图像的face-std数据库上,得到的FAR和FRR评价指标结果如图3(a)所示。(1) When using linear spatial filtering, the filter is replaced by the prewitt operator. The result of the FAR and FRR evaluation indicators obtained on the face-std database containing 29,800 face images is shown in Fig. 3(a).
(2)在改进方向编码算法后,在face-std数据库上,得到的FAR和FRR评价指标结果如图3(b)所示。(2) After improving the direction coding algorithm, the results of the FAR and FRR evaluation indicators obtained on the face-std database are shown in Fig. 3(b).
(3)在改进glac特征计算方法后,在face-std数据库上,得到的FAR和FRR评价指标结果如图3(c)所示。(3) After improving the glac feature calculation method, the results of the FAR and FRR evaluation indicators obtained on the face-std database are shown in Fig. 3(c).
(4)增加3阶自相关梯度后,在有38225副人脸图像的faceenrll-std数据库上,得到的FAR和FRR评价指标结果如图3(d)所示。(4) After adding the 3rd-order autocorrelation gradient, the results of FAR and FRR evaluation indicators obtained on the faceenrll-std database with 38225 face images are shown in Fig. 3(d).
(5)在其余部分不变的情况下,对faceenrll-std人脸数据库,采用DoG处 理,得到的FAR和FRR评价指标结果如图3(e)所示。(5) In the case where the rest of the same, the faceenrll-std face database, using DoG The results of the obtained FAR and FRR evaluation indicators are shown in Fig. 3(e).
(6)把公式(7)中的
Figure PCTCN2015093340-appb-000028
改为了
Figure PCTCN2015093340-appb-000029
后,对faceenrll-std人脸数据库,采用DoG处理,得到的FAR和FRR评价指标结果如图3(f)所示。
(6) in the formula (7)
Figure PCTCN2015093340-appb-000028
Changed
Figure PCTCN2015093340-appb-000029
After that, the facenrll-std face database is processed by DoG, and the obtained FAR and FRR evaluation index results are shown in Fig. 3(f).
由上可见,本发明实施例方法进过在图像预处理,提取glac特征和特征匹配上的改进,可有效降低评价人脸识别算法的FAR和FRR指标,使得在识别人脸时,更具鲁棒性。It can be seen from the above that the method of the embodiment of the present invention has improved the image pre-processing, extracting the glac feature and the feature matching, and can effectively reduce the FAR and FRR indicators of the face recognition algorithm, so that when the face is recognized, the method is more Great.
综上,在本发明的一些可行的实施方式中,提供了一种改进的、基于glac特征的人脸识别技术方案,该方案中通过对预处理后的人脸图像进行方向编码生成梯度方向向量,并将梯度方向向量f的方向权重定义为wei=(1+index-dindex)3,以及,提取glac特征,利用卡方检验计算待匹配glac特征之间的距离来实现人脸识别,提高了抗噪声干扰的能力,可有效提高人脸识别的鲁棒性。In summary, in some feasible embodiments of the present invention, an improved glac feature-based face recognition technical solution is provided, in which a gradient direction vector is generated by directionally encoding a preprocessed face image. And define the direction weight of the gradient direction vector f as wei=(1+index-dindex) 3 , and extract the glac feature, and calculate the distance between the glac features to be matched by the chi-square test to realize face recognition, and improve the face recognition. The ability to resist noise interference can effectively improve the robustness of face recognition.
为了更好的实施本发明实施例的上述方案,下面还提供用于配合实施上述方案的相关装置。In order to better implement the above solution of the embodiments of the present invention, related devices for cooperating to implement the above solutions are also provided below.
请参考图4,本发明第二实施例提供一种人脸识别装置400,可包括:Referring to FIG. 4, a second embodiment of the present invention provides a face recognition device 400, which may include:
预处理模块410,用于采用线性空间滤波对人脸图像进行预处理;The preprocessing module 410 is configured to perform preprocessing on the face image by using linear spatial filtering;
方向编码模块420,用于对预处理后的人脸图像进行方向编码,生成梯度方向向量f,所述梯度方向向量f的方向分区索引为:
Figure PCTCN2015093340-appb-000030
方向权重为:wei=(1+index-dindex)3,其中,θ为梯度方向,bin为方向分区数量,index是对dindex的取整;
The direction coding module 420 is configured to perform direction coding on the pre-processed face image to generate a gradient direction vector f, where the direction partition index of the gradient direction vector f is:
Figure PCTCN2015093340-appb-000030
The direction weight is: wei=(1+index-dindex) 3 , where θ is the gradient direction, bin is the number of direction partitions, and index is the rounding of dindex;
特征提取模块430,用于根据所述梯度方向向量提取梯度局部自相关特性glac特征;a feature extraction module 430, configured to extract a gradient local autocorrelation property glac feature according to the gradient direction vector;
计算模块440,用于利用卡方检验计算待匹配glac特征之间的距离,识别相似性。The calculating module 440 is configured to calculate a distance between the glac features to be matched by using a chi-square test to identify the similarity.
在本发明的一些实施例中,所述预处理模块410可以包括: In some embodiments of the present invention, the pre-processing module 410 may include:
第一预处理单元,用于采用高斯差分滤波DoG对人脸图像进行第一次预处理;a first pre-processing unit for performing a first pre-processing of the face image by using Gaussian difference filtering DoG;
第二预处理单元,用于采用线性空间滤波对第一次预处理后的人脸图像进行第二次预处理;a second pre-processing unit, configured to perform a second pre-processing on the first pre-processed face image by using linear spatial filtering;
其中,线性空间滤波采用如下presitt算子:Among them, linear spatial filtering uses the following presitt operator:
在x方向上为
Figure PCTCN2015093340-appb-000031
在x方向上为
Figure PCTCN2015093340-appb-000032
In the x direction
Figure PCTCN2015093340-appb-000031
In the x direction
Figure PCTCN2015093340-appb-000032
在本发明的一些实施例中,所述方向编码模块420具体用于:In some embodiments of the present invention, the direction encoding module 420 is specifically configured to:
设预处理后的人脸图像为I,r(x,y)为任意像素点,则在x和y方向上,Let the pre-processed face image be I, r(x, y) be any pixel point, then in the x and y directions,
梯度为:
Figure PCTCN2015093340-appb-000033
The gradient is:
Figure PCTCN2015093340-appb-000033
幅值为:
Figure PCTCN2015093340-appb-000034
The amplitude is:
Figure PCTCN2015093340-appb-000034
方向为:
Figure PCTCN2015093340-appb-000035
The direction is:
Figure PCTCN2015093340-appb-000035
对方向θ进行编码,生成梯度方向向量f。The direction θ is encoded to generate a gradient direction vector f.
在本发明的一些实施例中,所述特征提取模块430具体用于根据所述梯度方向向量f和幅值n,计算1阶和2阶自相关梯度值并串联,得到glac特征。In some embodiments of the present invention, the feature extraction module 430 is specifically configured to calculate 1st order and 2nd order autocorrelation gradient values according to the gradient direction vector f and the amplitude n, and connect in series to obtain a glac feature.
在本发明的一些实施例中,所述计算模块440利用卡方检验计算待匹配glac特征之间的距离时,去掉1阶自相关梯度值,并为每个图像分块加上权重。In some embodiments of the invention, the calculation module 440 uses the chi-square test to calculate the distance between the glac features to be matched, removes the 1st order autocorrelation gradient values, and adds weights to each image segmentation.
本发明实施例的人脸识别装置例如可以是考勤机、门禁系统等设备。The face recognition device of the embodiment of the present invention may be, for example, an attendance machine, an access control system, or the like.
可以理解,本发明实施例的人脸识别装置的各个功能模块的功能可根据上述方法实施例中的方法具体实现,其具体实现过程可参照上述方法实施例中的相关描述,此处不再赘述。The function of each function module of the face recognition device in the embodiment of the present invention may be specifically implemented according to the method in the foregoing method embodiment. For the specific implementation process, reference may be made to the related description in the foregoing method embodiment, and details are not described herein again. .
综上,在本发明的一些可行的实施方式中,提供了一种改进的、基于glac特征的人脸识别技术方案,该方案中通过对预处理后的人脸图像进行方向编码生成梯度方向向量,并将梯度方向向量f的方向权重定义为 wei=(1+index-dindex)3,以及,提取glac特征,利用卡方检验计算待匹配glac特征之间的距离来实现人脸识别,提高了抗噪声干扰的能力,可有效提高人脸识别的鲁棒性。In summary, in some feasible embodiments of the present invention, an improved glac feature-based face recognition technical solution is provided, in which a gradient direction vector is generated by directionally encoding a preprocessed face image. And define the direction weight of the gradient direction vector f as wei=(1+index-dindex) 3 , and extract the glac feature, and calculate the distance between the glac features to be matched by the chi-square test to realize face recognition, and improve the face recognition. The ability to resist noise interference can effectively improve the robustness of face recognition.
请参考图5,本发明实施例还提供一种终端设备500。Referring to FIG. 5, an embodiment of the present invention further provides a terminal device 500.
该终端设备500可以是一微处理计算机设备,可以包括:处理器510和存储器520;所述存储器520用于存储程序;所述处理器510用于执行所述存储器中的所述程序,使得所述终端设备500执行如上述方法实施例中提供的人脸识别方法的部分或全部步骤。The terminal device 500 can be a micro-processing computer device, and can include: a processor 510 and a memory 520; the memory 520 is configured to store a program; the processor 510 is configured to execute the program in the memory, such that The terminal device 500 performs some or all of the steps of the face recognition method provided in the above method embodiment.
可选的,该终端设备还可以包括通信接口530和总线540;所述处理器510,存储器520,通信接口530通过所述总线540相互的通信;所述通信接口530,用于接收和发送数据。Optionally, the terminal device may further include a communication interface 530 and a bus 540. The processor 510, the memory 520, and the communication interface 530 communicate with each other through the bus 540. The communication interface 530 is configured to receive and send data. .
具体的,处理器510可执行如下步骤:Specifically, the processor 510 can perform the following steps:
采用线性空间滤波对人脸图像进行预处理;Preprocessing the face image with linear spatial filtering;
对预处理后的人脸图像进行方向编码,生成梯度方向向量f,所述梯度方向向量f的方向分区索引为:
Figure PCTCN2015093340-appb-000036
方向权重为:wei=(1+index-dindex)3,其中,θ为梯度方向,bin为方向分区数量,index是对dindex的取整;
The pre-processed face image is direction-encoded to generate a gradient direction vector f, and the direction partition index of the gradient direction vector f is:
Figure PCTCN2015093340-appb-000036
The direction weight is: wei=(1+index-dindex) 3 , where θ is the gradient direction, bin is the number of direction partitions, and index is the rounding of dindex;
根据所述梯度方向向量提取梯度局部自相关特性glac特征;Extracting a gradient local autocorrelation property glac feature according to the gradient direction vector;
利用卡方检验计算待匹配glac特征之间的距离,识别相似性。The chi-square test is used to calculate the distance between the glac features to be matched, and the similarity is identified.
其中,所述的终端设备具体可以是考勤机,门禁系统,计算机,手机,笔记本电脑等。The terminal device may specifically be an attendance machine, an access control system, a computer, a mobile phone, a notebook computer, and the like.
由上可见,在本发明的一些可行的实施方式中,提供了一种改进的、基于glac特征的人脸识别技术方案,该方案中通过对预处理后的人脸图像进行方向编码生成梯度方向向量,并将梯度方向向量f的方向权重定义为wei=(1+index-dindex)3,以及,提取glac特征,利用卡方检验计算待匹配glac特征之间的距离来实现人脸识别,提高了抗噪声干扰的能力,可有效提高人脸识别的鲁棒性。 It can be seen that, in some feasible embodiments of the present invention, an improved glac feature-based face recognition technical solution is provided, in which a gradient direction is generated by directionally encoding a pre-processed face image. Vector, and define the direction weight of the gradient direction vector f as wei=(1+index-dindex) 3 , and extract the glac feature, and calculate the distance between the glac features to be matched by the chi-square test to realize face recognition and improve The ability to resist noise interference can effectively improve the robustness of face recognition.
本发明实施例还提供一种存储一个或多个程序的存储介质,所述一个或多个程序包括指令,所述指令当被包括一个或多个处理器的终端设备执行时,使所述终端设备执行如上述方法实施例中提供的人脸识别方法的部分或全部步骤。Embodiments of the present invention also provide a storage medium storing one or more programs, the one or more programs including instructions that, when executed by a terminal device including one or more processors, cause the terminal The apparatus performs some or all of the steps of the face recognition method as provided in the above method embodiments.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详细描述的部分,可以参见其它实施例的相关描述。In the above embodiments, the descriptions of the various embodiments are different, and the parts that are not described in detail in a certain embodiment can be referred to the related description of other embodiments.
需要说明的是,对于前述的各方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本发明并不受所描述动作顺序的限制,因为依据本发明,某些步骤可以采用其它顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定是本发明所必须的。It should be noted that, for the foregoing method embodiments, for the sake of brevity, they are all described as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence, because In accordance with the present invention, certain steps may be performed in other sequences or concurrently. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:ROM、RAM、磁盘或光盘等。A person skilled in the art may understand that all or part of the various steps of the foregoing embodiments may be performed by a program to instruct related hardware. The program may be stored in a computer readable storage medium, and the storage medium may include: ROM, RAM, disk or CD.
以上对本发明实施例所提供的人脸识别方法和装置进行了详细介绍,本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。 The method and device for recognizing a face provided by the embodiments of the present invention are described in detail above. The principles and embodiments of the present invention are described in the following. The description of the above embodiments is only for helping to understand the present invention. The method and its core idea; at the same time, those skilled in the art, according to the idea of the present invention, there will be changes in the specific embodiments and application scope. In summary, the contents of this specification should not be construed as Limitations of the invention.

Claims (13)

  1. 一种人脸识别方法,其特征在于,包括:A face recognition method, comprising:
    采用线性空间滤波对人脸图像进行预处理;Preprocessing the face image with linear spatial filtering;
    对预处理后的人脸图像进行方向编码,生成梯度方向向量f,所述梯度方向向量f的方向分区索引为:
    Figure PCTCN2015093340-appb-100001
    方向权重为:wei=(1+index-dindex)3,其中,θ为梯度方向,bin为方向分区数量,index是对dindex的取整;
    The pre-processed face image is direction-encoded to generate a gradient direction vector f, and the direction partition index of the gradient direction vector f is:
    Figure PCTCN2015093340-appb-100001
    The direction weight is: wei=(1+index-dindex) 3 , where θ is the gradient direction, bin is the number of direction partitions, and index is the rounding of dindex;
    根据所述梯度方向向量提取梯度局部自相关特性glac特征;Extracting a gradient local autocorrelation property glac feature according to the gradient direction vector;
    利用卡方检验计算待匹配glac特征之间的距离,识别相似性。The chi-square test is used to calculate the distance between the glac features to be matched, and the similarity is identified.
  2. 根据权利要求1所述的方法,其特征在于,所述采用线性空间滤波对人脸图像进行预处理的步骤包括:The method according to claim 1, wherein the step of preprocessing the face image by using linear spatial filtering comprises:
    采用高斯差分滤波DoG对人脸图像进行第一次预处理;The Gaussian differential filtering DoG is used to perform the first preprocessing of the face image;
    采用线性空间滤波对第一次预处理后的人脸图像进行第二次预处理;The second pre-processed face image is preprocessed by linear spatial filtering;
    其中,线性空间滤波采用如下presitt算子:Among them, linear spatial filtering uses the following presitt operator:
    在x方向上为
    Figure PCTCN2015093340-appb-100002
    在y方向上为
    Figure PCTCN2015093340-appb-100003
    In the x direction
    Figure PCTCN2015093340-appb-100002
    In the y direction
    Figure PCTCN2015093340-appb-100003
  3. 根据权利要求1所述的方法,其特征在于,所述对预处理后的人脸图像进行方向编码,生成梯度方向向量包括:The method according to claim 1, wherein the direction encoding the pre-processed face image to generate a gradient direction vector comprises:
    设预处理后的人脸图像为I,r(x,y)为任意像素点,则在x和y方向上,Let the pre-processed face image be I, r(x, y) be any pixel point, then in the x and y directions,
    梯度为:
    Figure PCTCN2015093340-appb-100004
    The gradient is:
    Figure PCTCN2015093340-appb-100004
    幅值为:
    Figure PCTCN2015093340-appb-100005
    The amplitude is:
    Figure PCTCN2015093340-appb-100005
    方向为:
    Figure PCTCN2015093340-appb-100006
    The direction is:
    Figure PCTCN2015093340-appb-100006
    对方向θ进行编码,生成梯度方向向量f。The direction θ is encoded to generate a gradient direction vector f.
  4. 根据权利要求3所述的方法,其特征在于,所述根据所述梯度方向向量 f提取梯度局部自相关特性glac特征的步骤包括:The method according to claim 3, wherein said gradient direction vector f The steps of extracting the gradient local autocorrelation property glac feature include:
    根据所述梯度方向向量f和幅值n,计算1阶和2阶自相关梯度值并串联,得到glac特征。According to the gradient direction vector f and the amplitude n, the first-order and second-order autocorrelation gradient values are calculated and connected in series to obtain a glac feature.
  5. 根据权利要求4所述的方法,其特征在于,所述根据所述梯度方向向量f和幅值n,计算1阶和2阶自相关梯度值并串联,得到glac特征的步骤包括:The method according to claim 4, wherein the calculating the first-order and second-order autocorrelation gradient values according to the gradient direction vector f and the amplitude n and connecting in series to obtain the glac feature comprises:
    设人脸图像宽和高的中心像素点为(x0,y0),以(x0,y0)为参考像素点,计算每个像素点(x,y)的空间位置权重wp为:
    Figure PCTCN2015093340-appb-100007
    The central pixel point of the face image width and height is (x 0 , y 0 ), and (x 0 , y 0 ) is used as the reference pixel point, and the spatial position weight w p of each pixel point (x, y) is calculated as :
    Figure PCTCN2015093340-appb-100007
    完整位置权重weight为:weight=wp·mag·bias,The full position weight is: weight=w p ·mag·bias,
    其中,gamma为预设的系数,bias是像素点(x,y)在2*2邻域内的位置偏置,在1阶计算中mag等于n(r),2阶计算中mag等于
    Figure PCTCN2015093340-appb-100008
    a1为相对参考像素点的位移向量;
    Where gamma is the preset coefficient, bias is the position offset of the pixel point (x, y) in the 2*2 neighborhood, mag is equal to n(r) in the first-order calculation, and mag is equal to the second-order calculation
    Figure PCTCN2015093340-appb-100008
    a 1 is a displacement vector with respect to a reference pixel point;
    则,glac特征的数值为:glacv=weight·wei;Then, the value of the glac feature is: glac v = weight·wei;
    glac特征的1阶维数为:dim1=bin·nw·nh;The first order dimension of the glac feature is: dim 1 = bin·nw·nh;
    glac特征的2阶维数为:dim2=bin·nw·nh+model·bin·bin·nw·nh;The second-order dimension of the glac feature is: dim 2 = bin·nw·nh+model·bin·bin·nw·nh;
    其中,nw和nh分别是在图像的宽和高上的等分数,model是2阶相邻位置自相关模式。Where nw and nh are equal fractions on the width and height of the image, respectively, and model is a 2nd-order adjacent position autocorrelation mode.
  6. 根据权利要求4所述的方法,其特征在于,所述利用卡方检验计算待匹配glac特征之间的距离的步骤包括:The method of claim 4 wherein said step of calculating a distance between glac features to be matched using a chi-square test comprises:
    利用卡方检验计算待匹配glac特征之间的距离时,去掉1阶自相关梯度值,并为每个图像分块加上权重。When the chi-square test is used to calculate the distance between the glac features to be matched, the first-order autocorrelation gradient values are removed, and weights are added to each image block.
  7. 一种人脸识别装置,其特征在于,包括:A face recognition device, comprising:
    预处理模块,用于采用线性空间滤波对人脸图像进行预处理;a preprocessing module for preprocessing the face image by using linear spatial filtering;
    方向编码模块,用于对预处理后的人脸图像进行方向编码,生成梯度方向向量f,所述梯度方向向量f的方向分区索引为:
    Figure PCTCN2015093340-appb-100009
    方向权重为:wei=(1+index-dindex)3,其中,θ为梯度方向,bin为方向分区数量,index是对dindex的取整;
    a direction coding module, configured to perform direction coding on the pre-processed face image to generate a gradient direction vector f, where the direction partition index of the gradient direction vector f is:
    Figure PCTCN2015093340-appb-100009
    The direction weight is: wei=(1+index-dindex) 3 , where θ is the gradient direction, bin is the number of direction partitions, and index is the rounding of dindex;
    特征提取模块,用于根据所述梯度方向向量提取梯度局部自相关特性glac特征;a feature extraction module, configured to extract a gradient local autocorrelation property glac feature according to the gradient direction vector;
    计算模块,用于利用卡方检验计算待匹配glac特征之间的距离,识别相似性。A calculation module is configured to calculate a distance between the glac features to be matched by using a chi-square test to identify the similarity.
  8. 根据权利要求7所述的装置,其特征在于,所述预处理模块包括:The apparatus according to claim 7, wherein the preprocessing module comprises:
    第一预处理单元,用于采用高斯差分滤波DoG对人脸图像进行第一次预处理;a first pre-processing unit for performing a first pre-processing of the face image by using Gaussian difference filtering DoG;
    第二预处理单元,用于采用线性空间滤波对第一次预处理后的人脸图像进行第二次预处理;a second pre-processing unit, configured to perform a second pre-processing on the first pre-processed face image by using linear spatial filtering;
    其中,线性空间滤波采用如下presitt算子:Among them, linear spatial filtering uses the following presitt operator:
    在x方向上为
    Figure PCTCN2015093340-appb-100010
    在x方向上为
    Figure PCTCN2015093340-appb-100011
    In the x direction
    Figure PCTCN2015093340-appb-100010
    In the x direction
    Figure PCTCN2015093340-appb-100011
  9. 根据权利要求7所述的装置,其特征在于,The device of claim 7 wherein:
    所述方向编码模块具体用于:The direction coding module is specifically configured to:
    设预处理后的人脸图像为I,r(x,y)为任意像素点,则在x和y方向上,Let the pre-processed face image be I, r(x, y) be any pixel point, then in the x and y directions,
    梯度为:
    Figure PCTCN2015093340-appb-100012
    The gradient is:
    Figure PCTCN2015093340-appb-100012
    幅值为:
    Figure PCTCN2015093340-appb-100013
    The amplitude is:
    Figure PCTCN2015093340-appb-100013
    方向为:
    Figure PCTCN2015093340-appb-100014
    The direction is:
    Figure PCTCN2015093340-appb-100014
    对方向θ进行编码,生成梯度方向向量f。The direction θ is encoded to generate a gradient direction vector f.
  10. 根据权利要求7所述的装置,其特征在于,The device of claim 7 wherein:
    所述特征提取模块具体用于根据所述梯度方向向量f和幅值n,计算1阶和2阶自相关梯度值并串联,得到glac特征。The feature extraction module is specifically configured to calculate the first-order and second-order autocorrelation gradient values according to the gradient direction vector f and the amplitude n, and connect in series to obtain a glac feature.
  11. 根据权利要求10所述的装置,其特征在于,The device of claim 10 wherein:
    所述计算模块利用卡方检验计算待匹配glac特征之间的距离时,去掉1阶 自相关梯度值,并为每个图像分块加上权重。When the calculation module calculates the distance between the glac features to be matched by using the chi-square test, the first order is removed. Autocorrelate the gradient values and add weights to each image block.
  12. 一种终端设备,其特征在于,包括:处理器和存储器;所述存储器用于存储程序;所述处理器用于执行所述存储器中的程序,使得所述终端设备执行如权利要求1至6任一项所述的人脸识别方法。A terminal device, comprising: a processor and a memory; the memory is for storing a program; the processor is configured to execute a program in the memory, so that the terminal device performs any of claims 1 to 6 A face recognition method as described.
  13. 一种存储一个或多个程序的存储介质,所述一个或多个程序包括指令,所述指令当被包括一个或多个处理器的终端设备执行时,使所述终端设备执行如权利要求1至6任一项所述的人脸识别方法。 A storage medium storing one or more programs, the instructions including instructions that, when executed by a terminal device including one or more processors, cause the terminal device to perform as claimed in claim 1. The face recognition method according to any one of the six.
PCT/CN2015/093340 2015-10-30 2015-10-30 Human face recognition method and apparatus WO2017070923A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2015/093340 WO2017070923A1 (en) 2015-10-30 2015-10-30 Human face recognition method and apparatus
CN201580000705.6A CN105518717B (en) 2015-10-30 2015-10-30 A kind of face identification method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/093340 WO2017070923A1 (en) 2015-10-30 2015-10-30 Human face recognition method and apparatus

Publications (1)

Publication Number Publication Date
WO2017070923A1 true WO2017070923A1 (en) 2017-05-04

Family

ID=55725031

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/093340 WO2017070923A1 (en) 2015-10-30 2015-10-30 Human face recognition method and apparatus

Country Status (2)

Country Link
CN (1) CN105518717B (en)
WO (1) WO2017070923A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109960975A (en) * 2017-12-23 2019-07-02 四川大学 A kind of face generation and its face identification method based on human eye
CN111079802A (en) * 2019-12-02 2020-04-28 易思维(杭州)科技有限公司 Matching method based on gradient information
CN112001262A (en) * 2020-07-28 2020-11-27 山东师范大学 Method for generating accessory capable of influencing face authentication
CN112733895A (en) * 2020-12-30 2021-04-30 杭州海康威视数字技术股份有限公司 Method and device for determining image similarity and computer storage medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106651815B (en) * 2017-01-18 2020-01-17 聚龙融创科技有限公司 Method and device for processing Bayer format video image
CN112084927B (en) * 2020-09-02 2022-12-20 中国人民解放军军事科学院国防科技创新研究院 Lip language identification method fusing multiple visual information

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101354254A (en) * 2008-09-08 2009-01-28 北京航空航天大学 Method for tracking aircraft course
US20100142819A1 (en) * 2008-12-04 2010-06-10 Tomohisa Suzuki Image evaluation device and image evaluation method
CN101833647A (en) * 2009-03-11 2010-09-15 中国科学院自动化研究所 Acquisition device and processing method of palm print image
CN102298779A (en) * 2011-08-16 2011-12-28 淮安盈科伟力科技有限公司 Image registering method for panoramic assisted parking system
CN103106645A (en) * 2013-03-15 2013-05-15 天津工业大学 Recognition method for woven fabric structure
CN103761507A (en) * 2014-01-03 2014-04-30 东南大学 Local multi-value pattern face recognition method based on Weber law

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101354254A (en) * 2008-09-08 2009-01-28 北京航空航天大学 Method for tracking aircraft course
US20100142819A1 (en) * 2008-12-04 2010-06-10 Tomohisa Suzuki Image evaluation device and image evaluation method
CN101833647A (en) * 2009-03-11 2010-09-15 中国科学院自动化研究所 Acquisition device and processing method of palm print image
CN102298779A (en) * 2011-08-16 2011-12-28 淮安盈科伟力科技有限公司 Image registering method for panoramic assisted parking system
CN103106645A (en) * 2013-03-15 2013-05-15 天津工业大学 Recognition method for woven fabric structure
CN103761507A (en) * 2014-01-03 2014-04-30 东南大学 Local multi-value pattern face recognition method based on Weber law

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109960975A (en) * 2017-12-23 2019-07-02 四川大学 A kind of face generation and its face identification method based on human eye
CN109960975B (en) * 2017-12-23 2022-07-01 四川大学 Human face generation and human face recognition method based on human eyes
CN111079802A (en) * 2019-12-02 2020-04-28 易思维(杭州)科技有限公司 Matching method based on gradient information
CN111079802B (en) * 2019-12-02 2023-04-07 易思维(杭州)科技有限公司 Matching method based on gradient information
CN112001262A (en) * 2020-07-28 2020-11-27 山东师范大学 Method for generating accessory capable of influencing face authentication
CN112001262B (en) * 2020-07-28 2022-07-29 山东师范大学 Method for generating accessory capable of influencing face authentication
CN112733895A (en) * 2020-12-30 2021-04-30 杭州海康威视数字技术股份有限公司 Method and device for determining image similarity and computer storage medium
CN112733895B (en) * 2020-12-30 2024-03-15 杭州海康威视数字技术股份有限公司 Method, device and computer storage medium for determining image similarity

Also Published As

Publication number Publication date
CN105518717A (en) 2016-04-20
CN105518717B (en) 2019-03-01

Similar Documents

Publication Publication Date Title
WO2017070923A1 (en) Human face recognition method and apparatus
US10776936B2 (en) Point cloud matching method
WO2017219391A1 (en) Face recognition system based on three-dimensional data
Song et al. Mesh saliency via spectral processing
CN109859305B (en) Three-dimensional face modeling and recognizing method and device based on multi-angle two-dimensional face
Holte et al. View-invariant gesture recognition using 3D optical flow and harmonic motion context
Wei et al. Tensor voting guided mesh denoising
US10147017B2 (en) Systems and methods for obtaining structural information from a digital image
CN110334762B (en) Feature matching method based on quad tree combined with ORB and SIFT
US20100328311A1 (en) system and method for establishing correspondence, matching and repairing three dimensional surfaces of arbitrary genus and arbitrary topology in two dimensions using global parameterization
CN109684969B (en) Gaze position estimation method, computer device, and storage medium
CN107301643B (en) Well-marked target detection method based on robust rarefaction representation Yu Laplce's regular terms
CN110069989B (en) Face image processing method and device and computer readable storage medium
KR20140110586A (en) Image matching apparatus, image matching system and image matching mehod
Direkoğlu et al. Shape classification via image-based multiscale description
CN115631112B (en) Building contour correction method and device based on deep learning
JP2016014954A (en) Method for detecting finger shape, program thereof, storage medium of program thereof, and system for detecting finger shape
US9940718B2 (en) Apparatus and method for extracting peak image from continuously photographed images
CN112435211B (en) Method for describing and matching dense contour feature points in endoscope image sequence
KR101279484B1 (en) Apparatus and method for processing image
Boukamcha et al. 3D face landmark auto detection
Gupta et al. Facial range image matching using the complexwavelet structural similarity metric
CN109815791B (en) Blood vessel-based identity recognition method and device
CN112348069B (en) Data enhancement method, device, computer readable storage medium and terminal equipment
CN112884817B (en) Dense optical flow calculation method, dense optical flow calculation device, electronic device, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15906986

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15906986

Country of ref document: EP

Kind code of ref document: A1