WO2021243926A1 - 指静脉识别与防伪一体化方法、装置、存储介质和设备 - Google Patents
指静脉识别与防伪一体化方法、装置、存储介质和设备 Download PDFInfo
- Publication number
- WO2021243926A1 WO2021243926A1 PCT/CN2020/123182 CN2020123182W WO2021243926A1 WO 2021243926 A1 WO2021243926 A1 WO 2021243926A1 CN 2020123182 W CN2020123182 W CN 2020123182W WO 2021243926 A1 WO2021243926 A1 WO 2021243926A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- counterfeiting
- recognition
- finger vein
- task
- finger
- Prior art date
Links
- 210000003462 vein Anatomy 0.000 title claims abstract description 202
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000013527 convolutional neural network Methods 0.000 claims abstract description 46
- 238000007781 pre-processing Methods 0.000 claims abstract description 9
- 238000012549 training Methods 0.000 claims description 27
- 238000000605 extraction Methods 0.000 claims description 14
- 230000008569 process Effects 0.000 claims description 7
- 238000011176 pooling Methods 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 5
- 238000011156 evaluation Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 5
- 230000006870 function Effects 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000002474 experimental method Methods 0.000 description 3
- 238000012937 correction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 210000002615 epidermis Anatomy 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 210000000538 tail Anatomy 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000003542 behavioural effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000002860 competitive effect Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 230000005021 gait Effects 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000007648 laser printing Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 210000001179 synovial fluid Anatomy 0.000 description 1
- 210000001519 tissue Anatomy 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2415—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
Definitions
- the present invention relates to the field of image processing technology, and more specifically, to a method, device, storage medium and equipment for integrating finger vein recognition and anti-counterfeiting.
- Biometric recognition technology is a promising technology that uses the physiological or behavioral characteristics of the human body to identify individuals through feature extraction methods.
- biometric recognition technologies include fingerprints, face, iris, gait, voiceprint, palmprint, palm vein, finger vein, signature and so on.
- Finger veins are distributed under the epidermis, which has unique advantages compared with other biometrics in terms of its recognition principle: (1) Finger vein collection is captured by infrared camera, the collection method does not need to be touched, and the user-friendliness is good; (2) Vein imaging The required camera is not demanding, and the acquisition hardware is light, easy to realize commercialization; (3) The finger veins are distributed under the epidermis, which is not easy to be damaged, and the safety is high.
- the existing research often regards the anti-counterfeiting algorithm and the recognition algorithm as two independent subtasks, which reduces the convenience and real-time performance of the system to a certain extent.
- the combination of the identification algorithm and the anti-counterfeiting algorithm is still a blank in the prior art.
- the purpose of the present invention is to provide an integrated method, device, storage medium and equipment for finger vein recognition and anti-counterfeiting; the present invention integrates the two tasks of finger vein recognition and finger vein anti-counterfeiting.
- the unified algorithm can improve the efficiency of vein recognition and the real-time performance of the system while ensuring the accuracy of recognition and anti-counterfeiting.
- an integrated method for finger vein recognition and anti-counterfeiting which is characterized in that it includes:
- the pre-processed finger vein data is input to the finger vein recognition anti-counterfeiting task convolutional neural network model, and the finger vein image is identified and anti-counterfeit processed through the finger vein recognition anti-counterfeiting task convolutional neural network model to obtain anti-counterfeiting Task classification probability p and recognition task feature vector v; wherein the finger vein recognition anti-counterfeiting task convolutional neural network model is a model obtained by training the initial finger vein recognition anti-counterfeiting task convolutional neural network model;
- the recognition task feature vector v of the vein data is output and saved as the registration sample recognition task feature vector;
- the recognition mode by comparing the classification probability p of the anti-counterfeiting task of the vein data with the probability threshold s 1 , and the identification task feature vector v of the vein data and the cosine distance of the identification task feature vector of each registered sample and the distance threshold s 2 Compare and output the judgment result.
- the finger vein recognition anti-counterfeiting task convolutional neural network model includes a basic recognition network and an anti-counterfeiting branch;
- the basic recognition network includes two convolutional networks, three convolutional modules, and a fully connected layer connected in sequence;
- the anti-counterfeiting branch includes a convolution module and two fully connected layers connected in sequence; the front end of the convolution module of the anti-counterfeiting branch is inserted after the first convolution module of the basic recognition network, thereby constructing a single-input and multiple-output finger vein recognition anti-counterfeiting Task convolutional neural network model.
- each of the three convolution modules of the basic recognition network includes two convolution sub-modules and a maximum pooling layer connected in sequence.
- the size of the convolution kernel is 3*3, the number of channels is 64, and the step size is 2 and 1, respectively;
- the number of input channels is 64, 128, and 256 respectively; among the three convolution modules, the convolution kernel of the former convolution submodule is 3*3, and the latter convolution
- the convolution kernel of the submodule is 1*1, the step size of the convolution submodule is 1, the number of input channels of the convolution submodule is the number of input channels of the corresponding convolution module, and the convolution kernel of the maximum pooling layer is 2*2;
- the fully connected layer of the basic identification network the number of output channels is 512;
- the output channels are 16 and 2 respectively.
- the preprocessing of the finger vein image refers to:
- the active window summation method is used to obtain the brightness statistical curve trend of the finger axial direction of the original finger vein image; the active window adopts the same height as the original finger vein image, and slides column by column with the width of 1/20 of the original finger vein image. Calculate the pixel sum in the window; the two peaks of the brightness statistical curve trend are set as the two interphalangeal joints of the finger; the ROI is intercepted between the two interphalangeal joints as the preprocessed finger vein data.
- the finger vein recognition anti-counterfeiting task convolutional neural network model is a model obtained by training the initial finger vein recognition anti-counterfeiting task convolutional neural network model, which refers to:
- the center loss is used as the loss function, and the center loss is:
- N represents the number of samples
- x represents the feature vector of the recognition task output by the network
- c represents the center of the category
- Training evaluation indicators are:
- ⁇ represents the proportion of the basic recognition network and the anti-counterfeiting branch
- SEER represents the equal error rate of the anti-counterfeiting branch
- EER represents the equal error rate of the basic recognition network
- An integrated device for finger vein recognition and anti-counterfeiting which is characterized in that it comprises:
- the preprocessing module is used to preprocess finger vein images to obtain preprocessed finger vein data
- the feature extraction module is used to input the preprocessed finger vein data to the finger vein recognition anti-counterfeiting task convolutional neural network model, and recognize the finger vein image through the finger vein recognition anti-counterfeiting task convolutional neural network model And anti-counterfeiting processing to obtain the anti-counterfeiting task classification probability p and the recognition task feature vector v; wherein the finger vein recognition anti-counterfeiting task convolutional neural network model is a model obtained by training the initial finger vein recognition anti-counterfeiting task convolutional neural network model ;
- the registration module is used to implement the registration mode.
- the identification task feature vector v of the vein data is output and saved as the registration sample identification task feature vector;
- the recognition module is used to realize the recognition mode by comparing the anti-counterfeiting task classification probability p of the vein data with the probability threshold s 1 , and the cosine distance and distance between the recognition task feature vector v of the vein data and the recognition task feature vector of each registered sample The threshold s 2 is compared, and the judgment result is output.
- a storage medium wherein the storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the above-mentioned integrated method for finger vein recognition and anti-counterfeiting.
- a computing device includes a processor and a memory for storing an executable program for the processor, wherein the processor implements the above-mentioned integrated method for finger vein recognition and anti-counterfeiting when the processor executes the program stored in the memory.
- the present invention has the following advantages and beneficial effects:
- the present invention integrates the two tasks of finger vein recognition and finger vein anti-counterfeiting into a unified algorithm, utilizes the powerful learning and fitting ability of neural network, and guarantees the performance of both based on multi-task learning, which can ensure the accuracy of recognition and anti-counterfeiting at the same time, Improved the efficiency of vein recognition and the real-time performance of the system;
- the basic recognition network has the characteristics of lightweight, its network layers are small, and the two-dimensional convolution kernel is adopted, which greatly reduces the amount of network parameters ;
- the training process of the finger vein recognition anti-counterfeiting task convolutional neural network model proposed in the present invention uses multi-task evaluation indicators to screen the finger vein recognition anti-counterfeiting task convolutional neural network model, which can effectively guarantee the finger vein recognition anti-counterfeiting task convolutional nerve The performance of the network model.
- Figure 1 is a flow chart of the integrated method for finger vein recognition and anti-counterfeiting of the present invention
- FIG. 2 is a model diagram of the convolutional neural network model of the finger vein recognition anti-counterfeiting task of the present invention
- Fig. 3 is a finger vein image input by the present invention.
- FIG. 4 is a schematic diagram of the process of preprocessing finger vein images according to the present invention.
- Figure 5 (a) is the upper edge extraction operator of the present invention.
- Figure 5(b) is the edge extraction operator of the present invention.
- Figure 6 is the real and fake vein images input by the present invention.
- Fig. 7 is a training schematic diagram of the convolutional neural network model of the finger vein recognition anti-counterfeiting task of the present invention.
- an integrated method for finger vein recognition and anti-counterfeiting includes:
- the pre-processed finger vein data is input to the finger vein recognition anti-counterfeiting task convolutional neural network model, and the finger vein image is identified and anti-counterfeit processed through the finger vein recognition anti-counterfeiting task convolutional neural network model to obtain anti-counterfeiting Task classification probability p and recognition task feature vector v; wherein the finger vein recognition anti-counterfeiting task convolutional neural network model is a model obtained by training the initial finger vein recognition anti-counterfeiting task convolutional neural network model;
- the recognition task feature vector v of the vein data is output and saved as the registration sample recognition task feature vector;
- the recognition mode by comparing the anti-counterfeiting task classification probability p of the vein data with the probability threshold s 1 , and the identification task feature vector v of the vein data and the cosine distance and distance threshold s 2 of the identification task feature vector of each registered sample Compare and output the judgment result.
- the finger vein recognition anti-counterfeiting task convolutional neural network model includes a basic recognition network and an anti-counterfeiting branch; the basic recognition network includes two convolutional networks, three convolutional modules, and full connections connected in sequence
- the anti-counterfeiting branch includes a convolution module and two fully connected layers connected in sequence; the front end of the convolution module of the anti-counterfeiting branch is inserted after the first convolution module of the basic recognition network, thereby constructing a single-input multiple-output Finger vein recognition anti-counterfeiting task convolutional neural network model.
- the basic recognition network mainly focuses on extracting vein texture features, and the anti-counterfeiting branch focuses on the background information of vein samples. Because the feature information extracted by the basic recognition network and the anti-counterfeiting branch are different, the front and back positions of the two branch points will have a key impact on the two tasks.
- the shared feature extraction part When the branch point is more forward, the shared feature extraction part will be reduced, which increases the difficulty of feature extraction of the anti-counterfeiting branch, thereby reducing its anti-counterfeiting performance; while the branch point is back, the shared feature extraction part of the two tasks increases, which will lead to the generation of both tasks Influencing each other, the difference in the focus of feature extraction between the two will lead to a decline in the performance of shared feature extraction, thereby reducing the performance of the two tasks.
- Each of the three convolution modules of the basic recognition network includes two convolution sub-modules and a maximum pooling layer connected in sequence.
- the size of the convolution kernel is 3*3, the number of channels is 64, and the step size is 2 and 1, respectively;
- the number of input channels is 64, 128, and 256 respectively; among the three convolution modules, the convolution kernel of the former convolution submodule is 3*3, and the latter convolution
- the convolution kernel of the submodule is 1*1, the step size of the convolution submodule is 1, the number of input channels of the convolution submodule is the number of input channels of the corresponding convolution module, and the convolution kernel of the maximum pooling layer is 2*2;
- the fully connected layer of the basic identification network the number of output channels is 512;
- the output channels are 16 and 2 respectively.
- the input finger vein image is shown in Figure 3.
- the finger vein image used in the present invention uses infrared light to irradiate one side of the finger, and uses an infrared camera to image the other side to obtain the finger vein image after preliminary collection. Then it is necessary to pre-process the finger vein image. This is because there is a certain degree of flexibility in placing the finger on the vein acquisition device, and the vein pattern changes caused by the offset rotation of the finger vein image will also exist. In addition, the collected finger vein images contain most of the background information. This information that has nothing to do with the finger veins will interfere and affect the subsequent recognition to a certain extent. In the preprocessing stage, the ROI interception and rotation correction of the finger image are required. Minimize the influence of finger shift and background noise.
- the demarcation characteristics of the edge of the finger are mainly embodied as the upper and lower edge features.
- ordinary first-order differential operators can be used. Because the left and right directions of the fingers are along the axial direction of the fingers, there is no need to consider, so only use The vertical edge template is fine.
- the feature of the upper edge is that the upper gray value is greater than the lower gray value, while the lower edge has the opposite gray value.
- the lower gray value is greater than the upper gray value. Therefore, the operator shown in Figure 5(a) can be used as the upper gray value.
- the edge extraction operator, the operator shown in Figure 5(b) is used as the lower edge extraction operator for extraction.
- the vertical midpoint set can be calculated from the upper and lower edges of the finger extracted in the previous step, and then the midline of the finger can be fitted by the least square method to obtain The tilt angle of the finger from the horizontal direction. Then rotate the image to the corresponding angle to correct the finger to the horizontal direction. Because the finger veins are mainly concentrated in the center area of the finger, by calculating the lowest point and highest point of the upper and lower edges of the finger after rotation, the vertical intercepting contour line is determined.
- the collection of finger veins generally collects images of the index finger, middle finger and ring finger. These fingers have two interphalangeal joints. There is less tissue between these phalangeal joints due to the presence of synovial fluid. The absorption rate of infrared light is It is lower, so that the average brightness of the knuckle area is greater than that of other finger areas. Using this feature, the user can locate the intercepted area in the axial direction more stably.
- the active window summation method is used to obtain the trend of the brightness statistical curve of the finger axis of the original image.
- the active window adopts the same height as the original image, and slides column by column with 1/20 the width of the original image, and calculates the sum of pixels in the window.
- Gaussian smoothing is performed on the data first to eliminate the interference of outliers. In the figure, it can be seen that there are two obvious wave crests, which correspond to the two interphalangeal joints of the fingers.
- this article only uses the position information at the maximum peak, extending to the left to 1/3 of the starting point distance as the left end point, extending 2/3 of the image length to the right, and intercepting horizontally according to this area , Get the final ROI as the pre-processed finger vein data.
- the finger vein recognition anti-counterfeiting task convolutional neural network model is a model obtained by training the initial finger vein recognition anti-counterfeiting task convolutional neural network model, which refers to:
- Figure 6 shows the comparison between fake veins and real veins.
- the forgery generation method is to select a sample in one of the categories of the identification sample set, print the sample on two laser printing films using a printer, and then stack the two films and align them. Place a piece of high-quality white paper in the aligned two films to make a fake model; then put the fake model into the vein collection model for collection, and finally get a fake sample.
- the basic recognition network and the anti-counterfeiting branch in the convolutional neural network model of the finger vein recognition anti-counterfeiting task are alternately trained, as shown in Figure 7; in the training process, only One of the basic recognition network and the anti-counterfeiting branch participates in the training, and the weight of the other is fixed; reducing the performance impact of samples between tasks.
- the center loss is used as the loss function, and the center loss is:
- N represents the number of samples
- x represents the feature vector of the recognition task output by the network
- c represents the center of the category
- Training evaluation indicators are:
- ⁇ represents the proportion of the basic recognition network and the anti-counterfeiting branch
- SEER represents the equal error rate of the anti-counterfeiting branch
- EER represents the equal error rate of the basic recognition network
- the method of the present invention was compared with the existing anti-counterfeiting methods. Then, in order to verify the robustness and generalization ability of the algorithm, relevant experiments were carried out on the IDIAP anti-counterfeiting database and the SCUT database. In order to verify the impact of additional identification tasks on anti-counterfeiting tasks, a network of the same structure is trained separately under anti-counterfeiting tasks for comparison and verification. The results are shown in Table 1 below.
- the anti-counterfeiting task is a binary classification task, and its difficulty is relatively simpler than the recognition task. Therefore, the deep network can handle the combination of the two tasks relatively effectively.
- the addition of the recognition task has less impact on the anti-counterfeiting task.
- the proposed algorithm is in the identification and anti-counterfeiting tasks. There are unique advantages in combining tasks.
- the use of unified identification and anti-counterfeiting indicators can more effectively evaluate the performance of the system.
- the equal error rate EER of the identification task and the HTER index of the anti-counterfeiting task are combined using weights, and a simplified weight combination method is used as the GEER index as an evaluation index for the combination of anti-counterfeiting and identification.
- the indicators are shown in Table 3 below.
- the proposed integrated model of vein recognition and anti-counterfeiting is evaluated in terms of time consumption.
- the deployment platform of the algorithm is carried out on the JetsonTK1 development board.
- the realization of the algorithm is mainly based on the C++ language for reproduction.
- the framework of the deep model uses the Tensorflow framework on the platform.
- the final time consumption is shown in Table 4 below.
- the average value of the proposed algorithm model in 100 forward operations is 13.11, and its real-time performance is effectively guaranteed in the application system where the algorithm is deployed.
- the present invention is compared with a variety of traditional methods and depth methods. After the anti-counterfeiting task is added, its performance results are still relatively competitive. In addition, through simplified anti-counterfeiting and identification task indicators, the performance of the overall identification and anti-counterfeiting integrated system is evaluated, and finally time-consuming experiments are used to prove that the algorithm has high real-time performance.
- this embodiment provides an integrated finger vein recognition and anti-counterfeiting device, including:
- the preprocessing module is used to preprocess finger vein images to obtain preprocessed finger vein data
- the feature extraction module is used to input the preprocessed finger vein data to the finger vein recognition anti-counterfeiting task convolutional neural network model, and recognize the finger vein image through the finger vein recognition anti-counterfeiting task convolutional neural network model And anti-counterfeiting processing to obtain the anti-counterfeiting task classification probability p and the recognition task feature vector v; wherein the finger vein recognition anti-counterfeiting task convolutional neural network model is a model obtained by training the initial finger vein recognition anti-counterfeiting task convolutional neural network model ;
- the registration module is used to implement the registration mode.
- the identification task feature vector v of the vein data is output and saved as the registration sample identification task feature vector;
- the recognition module is used to realize the recognition mode, by comparing the anti-counterfeiting task classification probability p of the vein data with the probability threshold s 1 , and the cosine distance and distance between the recognition task feature vector v of the vein data and the recognition task feature vector of each registered sample The threshold s 2 is compared, and the judgment result is output.
- the storage medium of this embodiment is characterized in that the storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the integrated finger vein recognition and anti-counterfeiting described in the first embodiment. ⁇ method.
- a computing device of this embodiment includes a processor and a memory for storing an executable program for the processor.
- the feature is that when the processor executes the program stored in the memory, it implements the finger vein recognition and anti-counterfeiting described in the first embodiment. Integrated approach.
Abstract
Description
Claims (10)
- 一种指静脉识别与防伪一体化方法,其特征在于:包括:获取待识别的指静脉图像;对指静脉图像进行预处理,得到预处理后的指静脉数据;将所述预处理后的指静脉数据输入至指静脉识别防伪任务卷积神经网络模型,通过所述指静脉识别防伪任务卷积神经网络模型对所述指静脉图像进行识别和防伪处理,得到防伪任务分类概率p和识别任务特征向量v;其中,所述指静脉识别防伪任务卷积神经网络模型为对初始指静脉识别防伪任务卷积神经网络模型进行训练处理得到的模型;在注册模式下,当指静脉数据的防伪任务分类概率p≤概率阈值s 1,则将静脉数据的识别任务特征向量v输出并保存为注册样本识别任务特征向量;在识别模式下,通过对静脉数据的防伪任务分类概率p与概率阈值s 1进行比较,以及对静脉数据的识别任务特征向量v与各个注册样本识别任务特征向量的余弦距离与距离阈值s 2进行比较,输出判定结果。
- 根据权利要求1所述的指静脉识别与防伪一体化方法,其特征在于:所述指静脉识别防伪任务卷积神经网络模型包括基础识别网络和防伪分支;所述基础识别网络包括依次连接的两个卷积网络、三个卷积模块和全连接层;所述防伪分支包括依次连接的一个卷积模块和两个全连接层;防伪分支的卷积模块前端插入于基础识别网络的第一个卷积模块之后,从而构建出单输入多输出的指静脉识别防伪任务卷积神经网络模型。
- 根据权利要求2所述的指静脉识别与防伪一体化方法,其特征在于:所述基础识别网络的三个卷积模块均包括依次连接的两个卷积子模块和最大值池化层。
- 根据权利要求3所述的指静脉识别与防伪一体化方法,其特征在于:所述基础识别网络的两个卷积网络中,卷积核大小均为3*3,通道数均为64,步长分别为2和1;所述基础识别网络的三个卷积模块中,输入通道数分别为64、128和256;三个卷积模块中,前一卷积子模块的卷积核为3*3,后一卷积子模块的卷积核为1*1,卷积子模块的步长均为1,卷积子模块的输入通道数为对应卷积模块的输 入通道数,最大值池化层的卷积核为2*2;所述基础识别网络的全连接层,输出通道数为512;所述防伪分支的全连接层中,输出通道分别为16和2。
- 根据权利要求2所述的指静脉识别与防伪一体化方法,其特征在于:所述对指静脉图像进行预处理,是指:在指静脉图像提取手指上下边缘;提取手指上下边缘的垂直中点集合,通过最小二乘法拟合手指中线,从而求出手指与水平方向的倾斜角;然后对指静脉图像旋转,将手指矫正到水平方向;采用活动窗口求和的方法来获取原始指静脉图像手指轴向方的亮度统计曲线趋势;亮度统计曲线趋势的两个波峰设定为手指的两个指间关节;在两个指间关节之间截取ROI作为预处理后的指静脉数据。
- 根据权利要求2所述的指静脉识别与防伪一体化方法,其特征在于:所述指静脉识别防伪任务卷积神经网络模型为对初始指静脉识别防伪任务卷积神经网络模型进行训练处理得到的模型,是指:训练样本包括识别注册样本集合和防伪样本集合;识别样本集合为R={r 1,r 2,...,r n},防伪样本集合为S={s 1,s 2,...,s n};其中,防伪样本集合中的伪造样本,根据识别样本中的类别进行伪造生成,即s i=f(r i),0≤i<n;以遍历识别样本集合和防伪样本集合为迭代单位,交替对指静脉识别防伪任务卷积神经网络模型中的基础识别网络和防伪分支进行训练;在训练过程中,每次只有基础识别网络和防伪分支的其中一项参与训练,另一项的权重固定;在基础识别网络和防伪分支的训练中,均使用中心损失作为损失函数,其中中心损失为:其中,N表示样本数目,x代表网络输出的识别任务特征向量,c表示该类别的中心;训练评价指标为:GEER ω=ω·SEER+(1-ω)·EER′其中,ω表示基础识别网络和防伪分支的比重,SEER表示防伪分支的等误 率,EER表示基础识别网络的等误率。
- 根据权利要求1所述的指静脉识别与防伪一体化方法,其特征在于:在所述识别模式下,采用如下两种方式之一:一、先判断指静脉数据的防伪任务分类概率p与概率阈值s 1之间大小:若指静脉数据的防伪任务分类概率p<阈值s 1,则判定指静脉图像为伪造样本,并输出拒绝结果;否则将指静脉数据的识别任务特征向量v与各个注册样本识别任务特征向量的余弦距离进行逐一比较:若存在余弦距离大于距离阈值s 2时,则输出通过结果;否则输出拒绝结果;二、先将指静脉数据的识别任务特征向量v与各个注册样本识别任务特征向量的余弦距离进行逐一比较:若不存在余弦距离大于距离阈值s 2时,则输出拒绝结果;否则继续判断指静脉数据的防伪任务分类概率p与概率阈值s 1之间大小:若指静脉数据的防伪任务分类概率p<阈值s 1,则判定指静脉图像为伪造样本,并输出拒绝结果;否则输出通过结果。
- 一种指静脉识别与防伪一体化装置,其特征在于,包括:预处理模块,用于对指静脉图像进行预处理,得到预处理后的指静脉数据;特征提取模块,用于将所述预处理后的指静脉数据输入至指静脉识别防伪任务卷积神经网络模型,通过所述指静脉识别防伪任务卷积神经网络模型对所述指静脉图像进行识别和防伪处理,得到防伪任务分类概率p和识别任务特征向量v;其中,所述指静脉识别防伪任务卷积神经网络模型为对初始指静脉识别防伪任务卷积神经网络模型进行训练处理得到的模型;注册模块,用于实现注册模式,当指静脉数据的防伪任务分类概率p≤概率阈值s 1,则将静脉数据的识别任务特征向量v输出并保存为注册样本识别任务特征向量;识别模块,用于实现识别模式,通过对静脉数据的防伪任务分类概率p与概率阈值s 1进行比较,以及对静脉数据的识别任务特征向量v与各个注册样本识别任务特征向量的余弦距离与距离阈值s 2进行比较,输出判定结果。
- 一种存储介质,其特征在于,其中所述存储介质存储有计算机程序,所述计算机程序当被处理器执行时使所述处理器执行权利要求1-7中任一项所述的指静脉识别与防伪一体化方法。
- 一种计算设备,包括处理器以及用于存储处理器可执行程序的存储器, 其特征在于,所述处理器执行存储器存储的程序时,实现权利要求1-7中任一项所述的指静脉识别与防伪一体化方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2020432845A AU2020432845B2 (en) | 2020-06-05 | 2020-10-23 | An integrated method for finger vein recognition and anti-spoofing, and device, storage medium and equipment therefor |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010505303.4 | 2020-06-05 | ||
CN202010505303.4A CN111914616B (zh) | 2020-06-05 | 2020-06-05 | 指静脉识别与防伪一体化方法、装置、存储介质和设备 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021243926A1 true WO2021243926A1 (zh) | 2021-12-09 |
Family
ID=73238045
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/123182 WO2021243926A1 (zh) | 2020-06-05 | 2020-10-23 | 指静脉识别与防伪一体化方法、装置、存储介质和设备 |
Country Status (3)
Country | Link |
---|---|
CN (1) | CN111914616B (zh) |
AU (1) | AU2020432845B2 (zh) |
WO (1) | WO2021243926A1 (zh) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114913610A (zh) * | 2022-06-15 | 2022-08-16 | 南京邮电大学 | 一种基于指纹和指静脉的多模态识别方法 |
CN116363712A (zh) * | 2023-03-21 | 2023-06-30 | 中国矿业大学 | 一种基于模态信息度评估策略的掌纹掌静脉识别方法 |
CN117218686A (zh) * | 2023-10-20 | 2023-12-12 | 广州脉泽科技有限公司 | 一种开放场景下的掌静脉roi提取方法及系统 |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112766142B (zh) * | 2021-01-15 | 2022-12-20 | 天津大学 | 足底压力图像处理方法、识别方法及步态分析系统 |
CN114821825B (zh) * | 2022-06-30 | 2022-12-06 | 广州中平智能科技有限公司 | 一种多粒度人脸伪造检测方法、系统、设备和介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110304720A1 (en) * | 2010-06-10 | 2011-12-15 | The Hong Kong Polytechnic University | Method and apparatus for personal identification using finger imaging |
CN106295555A (zh) * | 2016-08-08 | 2017-01-04 | 深圳芯启航科技有限公司 | 一种活体指纹图像的检测方法 |
CN109522798A (zh) * | 2018-10-16 | 2019-03-26 | 平安科技(深圳)有限公司 | 基于活体识别的视频防伪方法、系统、装置及可存储介质 |
CN110717372A (zh) * | 2019-08-13 | 2020-01-21 | 平安科技(深圳)有限公司 | 基于指静脉识别的身份验证方法和装置 |
CN111178221A (zh) * | 2019-12-24 | 2020-05-19 | 珠海格力电器股份有限公司 | 身份识别方法及装置 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110390282A (zh) * | 2019-07-12 | 2019-10-29 | 西安格威西联科技有限公司 | 一种基于余弦中心损失的指静脉识别方法及系统 |
-
2020
- 2020-06-05 CN CN202010505303.4A patent/CN111914616B/zh active Active
- 2020-10-23 WO PCT/CN2020/123182 patent/WO2021243926A1/zh active Application Filing
- 2020-10-23 AU AU2020432845A patent/AU2020432845B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110304720A1 (en) * | 2010-06-10 | 2011-12-15 | The Hong Kong Polytechnic University | Method and apparatus for personal identification using finger imaging |
CN106295555A (zh) * | 2016-08-08 | 2017-01-04 | 深圳芯启航科技有限公司 | 一种活体指纹图像的检测方法 |
CN109522798A (zh) * | 2018-10-16 | 2019-03-26 | 平安科技(深圳)有限公司 | 基于活体识别的视频防伪方法、系统、装置及可存储介质 |
CN110717372A (zh) * | 2019-08-13 | 2020-01-21 | 平安科技(深圳)有限公司 | 基于指静脉识别的身份验证方法和装置 |
CN111178221A (zh) * | 2019-12-24 | 2020-05-19 | 珠海格力电器股份有限公司 | 身份识别方法及装置 |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114913610A (zh) * | 2022-06-15 | 2022-08-16 | 南京邮电大学 | 一种基于指纹和指静脉的多模态识别方法 |
CN116363712A (zh) * | 2023-03-21 | 2023-06-30 | 中国矿业大学 | 一种基于模态信息度评估策略的掌纹掌静脉识别方法 |
CN116363712B (zh) * | 2023-03-21 | 2023-10-31 | 中国矿业大学 | 一种基于模态信息度评估策略的掌纹掌静脉识别方法 |
CN117218686A (zh) * | 2023-10-20 | 2023-12-12 | 广州脉泽科技有限公司 | 一种开放场景下的掌静脉roi提取方法及系统 |
CN117218686B (zh) * | 2023-10-20 | 2024-03-29 | 广州脉泽科技有限公司 | 一种开放场景下的掌静脉roi提取方法及系统 |
Also Published As
Publication number | Publication date |
---|---|
AU2020432845B2 (en) | 2023-03-16 |
CN111914616A (zh) | 2020-11-10 |
CN111914616B (zh) | 2024-04-16 |
AU2020432845A1 (en) | 2021-12-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021243926A1 (zh) | 指静脉识别与防伪一体化方法、装置、存储介质和设备 | |
WO2017059591A1 (zh) | 手指静脉识别方法及装置 | |
CN104239769B (zh) | 基于手指静脉特征的身份识别方法及系统 | |
CN102542281B (zh) | 非接触式生物特征识别方法和系统 | |
CN100492400C (zh) | 手指静脉特征提取与匹配识别方法 | |
CN101055618A (zh) | 基于方向特征的掌纹识别方法 | |
CN101030244A (zh) | 基于人体生理图像中排序测度特征的自动身份识别方法 | |
Zhang et al. | Graph fusion for finger multimodal biometrics | |
CN109544523B (zh) | 基于多属性人脸比对的人脸图像质量评价方法及装置 | |
CN105760841A (zh) | 一种身份识别方法及系统 | |
CN1912889A (zh) | 基于局部三角结构特征集的形变指纹识别方法 | |
CN1421815A (zh) | 基于知识的指纹图像增强方法 | |
CN104091145A (zh) | 人体掌脉特征图像采集方法 | |
CN113469143A (zh) | 一种基于神经网络学习的手指静脉图像识别方法 | |
Kisku et al. | Multispectral palm image fusion for person authentication using ant colony optimization | |
Qin et al. | Finger-vein image quality evaluation based on the representation of grayscale and binary image | |
Ting et al. | A review of finger vein recognition system | |
Prashanth et al. | Off-line signature verification based on angular features | |
Latha et al. | A robust person authentication system based on score level fusion of left and right irises and retinal features | |
CN1457015A (zh) | 基于人脸识别和手形识别的双模态生物认证系统 | |
Akulwar et al. | Secured multi modal biometric system: a review | |
Khoirunnisaa et al. | The biometrics system based on iris image processing: a review | |
Gopinath et al. | Exploration of finger vein recognition systems | |
Sujatha et al. | Multimodal biometric authentication algorithm at score level fusion using hybrid optimization | |
Radouane et al. | Fusion of Gabor filter and steerable pyramid to improve iris recognition system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2020432845 Country of ref document: AU Date of ref document: 20201023 Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20938622 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 28.03.2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20938622 Country of ref document: EP Kind code of ref document: A1 |