CN112069482A - An Identity Authentication System Based on Footprint Comparison Algorithm - Google Patents
An Identity Authentication System Based on Footprint Comparison Algorithm Download PDFInfo
- Publication number
- CN112069482A CN112069482A CN202010912788.9A CN202010912788A CN112069482A CN 112069482 A CN112069482 A CN 112069482A CN 202010912788 A CN202010912788 A CN 202010912788A CN 112069482 A CN112069482 A CN 112069482A
- Authority
- CN
- China
- Prior art keywords
- footprint
- image
- information
- area
- identity authentication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000007781 pre-processing Methods 0.000 claims description 22
- 238000012549 training Methods 0.000 claims description 18
- 238000004364 calculation method Methods 0.000 claims description 10
- 238000010200 validation analysis Methods 0.000 claims description 9
- 238000005457 optimization Methods 0.000 claims description 7
- 230000002159 abnormal effect Effects 0.000 claims description 3
- 238000013528 artificial neural network Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 claims description 3
- 238000005070 sampling Methods 0.000 claims description 3
- 241001270131 Agaricus moelleri Species 0.000 claims 1
- 238000000034 method Methods 0.000 abstract description 11
- 230000004913 activation Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/36—User authentication by graphic or iconic representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C9/00—Individual registration on entry or exit
- G07C9/30—Individual registration on entry or exit not involving the use of a pass
- G07C9/32—Individual registration on entry or exit not involving the use of a pass in combination with an identity check
- G07C9/37—Individual registration on entry or exit not involving the use of a pass in combination with an identity check using biometric data, e.g. fingerprints, iris scans or voice recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Evolutionary Computation (AREA)
- Computational Linguistics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Biophysics (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Computer Hardware Design (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Collating Specific Patterns (AREA)
Abstract
本发明公开了一种基于足迹比对算法的身份认证系统,本发明涉及身份认证技术领域,具体为一种基于足迹比对算法的身份认证系统,可以帮助仓库、银行、监狱的特定场所实现出入场身份认证的自动化;足迹是生物特征的一种,能够表征一个人的身份信息;足迹在采集过程中不需要被采集人员刻意的配合,将采集装置安装在相关场所出入口的必经之处,伪装成正常的地面即可进行隐蔽的足迹采集;采用本发明提出的基于足迹比对算法的身份认证系统,相关场所的内部人员只需在注册信息时采集一次足迹数据,身份认证的工作都由铺设在出入口处的足迹身份认证系统完成;解决了目前仓库、银行、监狱的相关场所的安防系统安全防范能力不够强的问题。
The invention discloses an identity authentication system based on a footprint comparison algorithm. The invention relates to the technical field of identity authentication, in particular to an identity authentication system based on a footprint comparison algorithm, which can help warehouses, banks and prisons in specific places to achieve Automation of admission identity authentication; footprints are a type of biometrics, which can represent a person's identity information; footprints do not need the deliberate cooperation of the collected personnel during the collection process, and the collection device is installed at the entrance and exit of the relevant place. , disguised as normal ground to collect hidden footprints; using the identity authentication system based on the footprint comparison algorithm proposed by the present invention, the insiders of the relevant places only need to collect footprint data once when registering information, and the work of identity authentication will be completed. It is completed by the footprint identity authentication system laid at the entrance and exit; it solves the problem that the current security systems of warehouses, banks, and prisons have insufficient security protection capabilities.
Description
技术领域technical field
本发明涉及身份认证技术领域,具体为一种基于足迹比对算法的身份认证系统。The invention relates to the technical field of identity authentication, in particular to an identity authentication system based on a footprint comparison algorithm.
背景技术Background technique
储存货物的仓库、银行办公区域、监狱这些场景原则上是不允许非内部人员进入的,因此需要对这些区域进行安防监控。传统的安防方法需要在出入口设置摄像头或者基于IC卡的门禁系统,这在实际操作过程中会给安防工作人员带来工作量的增加,也给需要经常出入这些场所的人员带来了麻烦。并且这些方式隐蔽性不强,很容易被不法分子蒙混过关。In principle, non-internal personnel are not allowed to enter the warehouses, bank office areas, and prisons where goods are stored. Therefore, security monitoring of these areas is required. The traditional security method requires cameras or IC card-based access control systems at the entrances and exits, which will increase the workload of security staff in the actual operation process, and also bring trouble to those who need to frequent these places. And these methods are not very concealed, and it is easy to be fooled by criminals.
本发明提出一种基于足迹比对算法的身份认证系统,可构建一个身份认证系统,可以帮助仓库、银行、监狱的特定场所实现出入场身份认证的自动化;足迹是生物特征的一种,能够表征一个人的身份信息;足迹在采集过程中不需要被采集人员刻意的配合,将采集装置安装在相关场所出入口的必经之处,伪装成正常的地面即可进行隐蔽的足迹采集。The invention proposes an identity authentication system based on a footprint comparison algorithm, which can construct an identity authentication system and can help warehouses, banks, and prisons to realize the automation of entry and exit identity authentication; Indicates a person's identity information; footprints do not need the deliberate cooperation of the collectors during the collection process. Install the collection device at the entrance and exit of the relevant place, and disguise it as a normal ground to collect hidden footprints.
采用本发明提出的基于足迹比对算法的身份认证系统,相关场所的内部人员只需在注册信息时采集一次足迹数据,此后即可自由出入,身份认证的工作都由铺设在出入口处的足迹身份认证系统完成。By adopting the identity authentication system based on the footprint comparison algorithm proposed by the present invention, the internal personnel of the relevant places only need to collect the footprint data once when registering the information, and then they can enter and exit freely. The authentication system is complete.
发明内容SUMMARY OF THE INVENTION
(一)解决的技术问题(1) Technical problems solved
针对现有技术的不足,本发明提供了一种基于足迹比对算法的身份认证系统,解决了目前仓库、银行、监狱的相关场所的安防系统安全防范能力不够强,操作过程比较麻烦的问题。Aiming at the deficiencies of the prior art, the present invention provides an identity authentication system based on a footprint comparison algorithm, which solves the problems that the current security systems of warehouses, banks, and prisons have insufficient security protection capability and troublesome operation processes.
(二)技术方案(2) Technical solutions
为实现上述目的,本发明提供如下技术方案:一种基于足迹比对算法的身份认证系统,包括监管区域、闸机通道、足迹采集器和足迹认证系统,在所述的监管区域进入通道和外出通道各设置一台闸机通道,并在所述的闸机通道的进入端设置足迹采集器;所述的闸机通道和足迹采集器均与足迹认证系统通讯连接。In order to achieve the above purpose, the present invention provides the following technical solutions: an identity authentication system based on a footprint comparison algorithm, including a supervision area, a gate channel, a footprint collector and a footprint authentication system, and entering the channel and going out in the supervision area. Each channel is provided with a gate channel, and a footprint collector is arranged at the entry end of the gate channel; the gate channel and the footprint collector are both connected in communication with the footprint authentication system.
作为优化,所述的足迹认证系统的主干网络是VGG11;首先将待比对的两幅足迹图像进行深度方向上的拼接,输入到VGG11中提取比对特征,将VGG11最后一层输出的1000维向量作为比对特征向量,输入到本发明设计的相似度分数计算网络(Similarity ScoreComputing Network,SSCN)中即可计算出两个足迹之间的相似度;如果相似度大于设定的阈值TH即可认为两个足迹属于同一个人,反之则认为两个足迹不属于同一个人。在足迹比对网络中,相似度分数计算网络共有两层全连接层,第一层全连接层接收VGG11输出的1000维比对特征向量,将维度降到30维,后面接了一个BN(Batch Normalization)层和一个ReLU激活函数层,第二层全连接层接受第一层输出的30维特征向量,输出一个一维的向量作为预测的相似度值,这个相似度值还不能直接用作最终的相似度预测结果,还需要利用Sigmoid激活函数转换成一个0到1之间的值作为最终的预测结果。As an optimization, the backbone network of the footprint authentication system is VGG11; first, the two footprint images to be compared are spliced in the depth direction, input into VGG11 to extract comparison features, and the 1000-dimensional output of the last layer of VGG11 is used. The vector is used as a comparison feature vector, and the similarity between the two footprints can be calculated by being input into the similarity score calculation network (Similarity ScoreComputing Network, SSCN) designed by the present invention; if the similarity is greater than the set threshold TH It is considered that two footprints belong to the same person, and vice versa, that the two footprints do not belong to the same person. In the footprint comparison network, the similarity score calculation network has two fully connected layers. The first fully connected layer receives the 1000-dimensional comparison feature vector output by VGG11, reduces the dimension to 30 dimensions, and is followed by a BN (Batch Normalization) layer and a ReLU activation function layer, the second fully connected layer accepts the 30-dimensional feature vector output by the first layer, and outputs a one-dimensional vector as the predicted similarity value. This similarity value cannot be directly used as the final The similarity prediction result also needs to be converted into a value between 0 and 1 using the Sigmoid activation function as the final prediction result.
一种足迹比对算法,包括下列步骤:A footprint alignment algorithm includes the following steps:
步骤1:身份采集:对工作人员的信息进行采集,其中1,2,3三个号码分别代表三个人的身份信息,在注册信息时,将会采集这三个人的若干足迹图像,以及身份证号、工号等其他信息,其中,每个人的足迹图像和各自的个人信息是对应的;Step 1: Identity collection: Collect the information of the staff. The three
步骤2:足迹图像采集预处理、信息存档:将注册人的足迹图像进行预处理之后,图像上的无关信息将会被去除,图像分辨率减小到可以进行较大规模存储又不影响身份认证精度的程度,预处理后,注册时采集的图像将会被存档进入数据库保存起来;Step 2: Footprint image collection preprocessing, information archiving: After preprocessing the registrant's footprint image, irrelevant information on the image will be removed, and the image resolution will be reduced to a large scale storage without affecting identity authentication The degree of accuracy, after preprocessing, the images collected during registration will be archived and stored in the database;
步骤3:信息比对:在人员入场时,将会采集他们的足迹图像,然后将他们的图像和数据库中的图像组成比对图像对,送入足迹认证系统中,足迹认证系统经过对图像的比对,将输出图像之间的相似度分数;假设系统设置的阈值TH=0.7,进行身份认证的人员足迹和1号足迹数据的相似度为0.8>TH,说明这个人是数据库中的1号人员;比对通过,可以予以放行;如果数据库里面没有任何一个足迹图像和待认证图像之间的相似度大于阈值,则足迹认证系统会认为该人员未进行信息注册,不予放行。Step 3: Information comparison: When people enter the venue, their footprint images will be collected, and then their images will be compared with the images in the database to form a pair of images, which will be sent to the footprint authentication system. , the similarity score between the images will be output; assuming that the threshold set by the system TH=0.7, the similarity between the identity authentication person’s footprint and the footprint data of No. 1 is 0.8>TH, indicating that this person is 1 in the database. If the similarity between any footprint image in the database and the image to be authenticated is greater than the threshold, the footprint authentication system will consider that the person has not registered information and will not be released.
作为优化,所述的步骤2:足迹图像采集预处理、信息存档,在足迹采集的时候:被采集人走过足迹采集器,足迹采集器采集到的图像是一幅有256个灰度级的灰度图像;As an optimization, the step 2: footprint image collection preprocessing, information archiving, during footprint collection: the person to be collected walks through the footprint collector, and the image collected by the footprint collector is an image with 256 gray levels. Grayscale image;
足迹图像预处理:对于图像进行预处理的目的主要是去除图像上的噪声以及采集仪器自带的标尺信息以便于进行图像比对,缩小图像的尺寸以便于存档。Footprint image preprocessing: The main purpose of image preprocessing is to remove the noise on the image and collect the scale information that comes with the instrument to facilitate image comparison, and to reduce the size of the image for archiving.
作为优化,所述的步骤2:足迹图像采集预处理、信息存档,包括以下步骤:As an optimization, the step 2: footprint image acquisition preprocessing, information archiving, includes the following steps:
a.去除足迹图像上的标尺信息,足迹采集器采集的图像固定区域会自带一个用于计算足迹大小的标尺信息,这个信息对于足迹比对用处不大,因此需要予以去除,具体的操作就是将图像固定区域灰度值直接赋值为255;a. Remove the ruler information on the footprint image. The fixed area of the image collected by the footprint collector will have a ruler information for calculating the size of the footprint. This information is not useful for the comparison of the footprint, so it needs to be removed. The specific operation is The gray value of the fixed area of the image is directly assigned to 255;
b.基于Otsu算法进行去噪和足迹定位,由于采集到的足迹图像足迹区域和背景区域很容易区分开,因此基于Otsu算法确定一个区分阈值th;图像中灰度小于th的像素点被认为是足迹区域的点,其余点被认为是背景,确定th之后就可以以此为依据,从上下左右四个方向扫描足迹图像,检测出足迹区域的四个边界,从而完成足迹定位;完成了足迹定位之后,由于大部分噪声都是在足迹区域外的,实际上此时也完成了去噪的工作;b. Based on the Otsu algorithm for denoising and footprint positioning, since the footprint area and the background area of the collected footprint image are easy to distinguish, a distinction threshold th is determined based on the Otsu algorithm; the pixels with a grayscale less than th in the image are considered to be The points in the footprint area, and the rest of the points are considered as the background. After determining th, you can scan the footprint image from four directions, up, down, left, and right, and detect the four boundaries of the footprint area, thereby completing the footprint positioning; the footprint positioning is completed. After that, since most of the noise is outside the footprint area, the denoising work is actually completed at this time;
c.调整足迹图像大小并进行灰度反转,在b中已经确定了足迹区域的位置,一般情况下,足迹的上下边界的距离要大于左右边界的距离,因此系统认为上下边界距离小于左右边界的足迹图像是异常足迹图像,在系统的具体实施中应发出警报;在确定了上下边界的距离之后,定义一个像素值全为255的正方形区域,边长就是上下边界的距离;然后将足迹区域直接复制到正方形区域的正中央,并用255减去正方形区域的每个点的像素值,进行像素级别的灰度反转;最后将得到的正方形区域进行下采样,调整分辨率,并进行保存。c. Adjust the size of the footprint image and perform grayscale inversion. The location of the footprint area has been determined in b. Generally, the distance between the upper and lower boundaries of the footprint is greater than the distance between the left and right boundaries, so the system considers that the distance between the upper and lower boundaries is smaller than the left and right boundaries. The footprint image is an abnormal footprint image, and an alarm should be issued in the specific implementation of the system; after determining the distance between the upper and lower boundaries, define a square area with a pixel value of 255, and the side length is the distance between the upper and lower boundaries; Copy directly to the center of the square area, and subtract the pixel value of each point in the square area from 255 to perform grayscale inversion at the pixel level; finally, downsample the obtained square area, adjust the resolution, and save it.
作为优化,所述的步骤3:信息比对包括以下步骤:As optimization, the described step 3: the information comparison includes the following steps:
第一步,网络训练:将采集的足迹样本按照被采集对象分成两部分,一部分对象的足迹样本作为训练集样本,另一部分作为验证集样本;The first step, network training: Divide the collected footprint samples into two parts according to the collected objects, one part of the object's footprint samples are used as training set samples, and the other part is used as validation set samples;
假如输入网络的两幅足迹图像属于同一个人,则这两幅图像组成了一个正样本X,标签Y为1,反之,两幅图像组成一个负样本X,标签Y为0;每次从训练集中随机抽样,获取一批(Batch)正样本或者负样本,输入到网络中进行相似度计算,并将输出值和标签做一个MSE损失,损失的表达式为: If the two footprint images input to the network belong to the same person, the two images form a positive sample X, and the label Y is 1; otherwise, the two images form a negative sample X, and the label Y is 0; each time from the training set Random sampling, obtain a batch of positive samples or negative samples, input them into the network for similarity calculation, and make an MSE loss on the output value and label. The expression of the loss is:
式中,B代表训练时的批大小,FCN表示足迹比对网络,将任意样本X输入网络即可得到网络的预测标签;In the formula, B represents the batch size during training, and FCN represents the footprint comparison network. Input any sample X into the network to obtain the predicted label of the network;
训练时,对每批样本的损失L进行反向传播,然后用梯度下降法优化模型;当训练的批次足够多,网络就相当于在所有可能的正负样本空间上进行了参数优化;经过反复随机抽取正负样本进行模型优化,最终模型将逐渐收敛;During training, the loss L of each batch of samples is back-propagated, and then the model is optimized by gradient descent; when there are enough training batches, the network is equivalent to optimizing parameters on all possible positive and negative sample spaces; Repeatedly randomly select positive and negative samples for model optimization, and the final model will gradually converge;
第二步,模型选择:神经网络最终要保存的模型一般需要使用一个验证集从训练的中间模型中选取,模型选择时需要在验证集上随机选择足够多的样本,将其输入到网络中进行相似度计算,相似度大于0.5则认为是同一人的足迹,小于0.5则不是同一人的足迹,取足迹比对准确率最高的中间模型作为最终保存的模型。The second step, model selection: The model to be saved by the neural network generally needs to be selected from the intermediate model trained by a validation set. When selecting the model, it is necessary to randomly select enough samples from the validation set and input them into the network for Similarity calculation, if the similarity is greater than 0.5, it is considered to be the footprint of the same person, and if the similarity is less than 0.5, it is not the footprint of the same person, and the intermediate model with the highest footprint comparison accuracy is taken as the final saved model.
(三)有益效果(3) Beneficial effects
本发明提供了一种基于足迹比对算法的身份认证系统。具备以下有益效果:The invention provides an identity authentication system based on a footprint comparison algorithm. Has the following beneficial effects:
本发明,提供了一种基于足迹比对算法的身份认证系统可以帮助仓库、银行、监狱的特定场所实现出入场身份认证的自动化;足迹是生物特征的一种,能够表征一个人的身份信息;足迹在采集过程中不需要被采集人员刻意的配合,将采集装置安装在相关场所出入口的必经之处,伪装成正常的地面即可进行隐蔽的足迹采集;采用本发明提出的足迹比对算法的身份认证系统,相关场所的内部人员只需在注册信息时采集一次足迹数据,此后即可自由出入,身份认证的工作都由铺设在出入口处的足迹身份认证系统完成;解决了目前仓库、银行、监狱的相关场所的安防系统安全防范能力不够强,操作过程比较麻烦的问题。The invention provides an identity authentication system based on a footprint comparison algorithm, which can help warehouses, banks, and prisons realize the automation of identity authentication for entry and exit; footprints are a kind of biological feature, which can represent a person's identity information The footprints do not need the deliberate cooperation of the collected personnel during the collection process, and the collection device is installed at the entrance and exit of the relevant place, and the hidden footprints can be collected by disguising the normal ground; Algorithmic identity authentication system, insiders of relevant places only need to collect footprint data once when registering information, and then they can freely enter and exit. The work of identity authentication is completed by the footprint identity authentication system laid at the entrance and exit; The security systems of banks and prisons have insufficient security capabilities, and the operation process is more troublesome.
附图说明Description of drawings
图1为本发明的结构示意图。FIG. 1 is a schematic structural diagram of the present invention.
图2为本发明的足迹图像预处理过程示意图。FIG. 2 is a schematic diagram of a footprint image preprocessing process of the present invention.
图3为本发明的足迹比对网络图。FIG. 3 is a network diagram of footprint comparison of the present invention.
图4为本发明的足迹身份认证流程图。FIG. 4 is a flowchart of the footprint identity authentication of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
实施例1Example 1
如图1-4所示,本发明提供一种技术方案:一种基于足迹比对算法的身份认证系统,包括监管区域、闸机通道、足迹采集器和足迹认证系统,在所述的监管区域进入通道和外出通道各设置一台闸机通道,并在所述的闸机通道的进入端设置足迹采集器;所述的闸机通道和足迹采集器均与足迹认证系统通讯连接。As shown in Figures 1-4, the present invention provides a technical solution: an identity authentication system based on a footprint comparison algorithm, including a supervision area, a gate channel, a footprint collector and a footprint authentication system. The entry channel and the exit channel are each provided with a gate channel, and a footprint collector is arranged at the entry end of the gate channel; the gate channel and the footprint collector are both connected in communication with the footprint authentication system.
在本实施例中,所述的足迹认证系统的主干网络是VGG11;首先将待比对的两幅足迹图像进行深度方向上的拼接,输入到VGG11中提取比对特征,将VGG11最后一层输出的1000维向量作为比对特征向量,输入到本发明设计的相似度分数计算网络(SimilarityScore Computing Network,SSCN)中即可计算出两个足迹之间的相似度;如果相似度大于设定的阈值TH即可认为两个足迹属于同一个人,反之则认为两个足迹不属于同一个人。在足迹比对网络中,相似度分数计算网络共有两层全连接层,第一层全连接层接收VGG11输出的1000维比对特征向量,将维度降到30维,后面接了一个BN(Batch Normalization)层和一个ReLU激活函数层,第二层全连接层接受第一层输出的30维特征向量,输出一个一维的向量作为预测的相似度值,这个相似度值还不能直接用作最终的相似度预测结果,还需要利用Sigmoid激活函数转换成一个0到1之间的值作为最终的预测结果。In this embodiment, the backbone network of the footprint authentication system is VGG11; first, the two footprint images to be compared are spliced in the depth direction, input into VGG11 to extract comparison features, and the last layer of VGG11 is output. The 1000-dimensional vector is used as the comparison feature vector, and the similarity between the two footprints can be calculated by being input into the similarity score calculation network (SimilarityScore Computing Network, SSCN) designed by the present invention; if the similarity is greater than the set threshold TH can think that the two footprints belong to the same person, and vice versa, that the two footprints do not belong to the same person. In the footprint comparison network, the similarity score calculation network has two fully connected layers. The first fully connected layer receives the 1000-dimensional comparison feature vector output by VGG11, reduces the dimension to 30 dimensions, and is followed by a BN (Batch Normalization) layer and a ReLU activation function layer, the second fully connected layer accepts the 30-dimensional feature vector output by the first layer, and outputs a one-dimensional vector as the predicted similarity value. This similarity value cannot be directly used as the final The similarity prediction result also needs to be converted into a value between 0 and 1 using the Sigmoid activation function as the final prediction result.
一种足迹比对算法,包括下列步骤:A footprint alignment algorithm includes the following steps:
步骤1:身份采集:对工作人员的信息进行采集,其中1,2,3三个号码分别代表三个人的身份信息,在注册信息时,将会采集这三个人的若干足迹图像,以及身份证号、工号等其他信息,其中,每个人的足迹图像和各自的个人信息是对应的;Step 1: Identity collection: Collect the information of the staff. The three
步骤2:足迹图像采集预处理、信息存档:将注册人的足迹图像进行预处理之后,图像上的无关信息将会被去除,图像分辨率减小到可以进行较大规模存储又不影响身份认证精度的程度,预处理后,注册时采集的图像将会被存档进入数据库保存起来;Step 2: Footprint image collection preprocessing, information archiving: After preprocessing the registrant's footprint image, irrelevant information on the image will be removed, and the image resolution will be reduced to a large scale storage without affecting identity authentication The degree of accuracy, after preprocessing, the images collected during registration will be archived and stored in the database;
步骤3:信息比对:在人员入场时,将会采集他们的足迹图像,然后将他们的图像和数据库中的图像组成比对图像对,送入足迹认证系统中,足迹认证系统经过对图像的比对,将输出图像之间的相似度分数;假设系统设置的阈值TH=0.7,进行身份认证的人员足迹和1号足迹数据的相似度为0.8>TH,说明这个人是数据库中的1号人员;比对通过,可以予以放行;如果数据库里面没有任何一个足迹图像和待认证图像之间的相似度大于阈值,则足迹认证系统会认为该人员未进行信息注册,不予放行。Step 3: Information comparison: When people enter the venue, their footprint images will be collected, and then their images will be compared with the images in the database to form a pair of images, which will be sent to the footprint authentication system. , the similarity score between the images will be output; assuming that the threshold set by the system TH=0.7, the similarity between the identity authentication person’s footprint and the footprint data of No. 1 is 0.8>TH, indicating that this person is 1 in the database. If the similarity between any footprint image in the database and the image to be authenticated is greater than the threshold, the footprint authentication system will consider that the person has not registered information and will not be released.
在本实施例中,所述的步骤2:足迹图像采集预处理、信息存档,在足迹采集的时候:被采集人走过足迹采集器,足迹采集器采集到的图像是一幅有256个灰度级的灰度图像;In this embodiment, the step 2: footprint image collection preprocessing, information archiving, during footprint collection: the person to be collected walks through the footprint collector, and the image collected by the footprint collector is a piece of 256 gray degree-level grayscale image;
足迹图像预处理:对于图像进行预处理的目的主要是去除图像上的噪声以及采集仪器自带的标尺信息以便于进行图像比对,缩小图像的尺寸以便于存档。Footprint image preprocessing: The main purpose of image preprocessing is to remove the noise on the image and collect the scale information that comes with the instrument to facilitate image comparison, and to reduce the size of the image for archiving.
在本实施例中,所述的步骤2:足迹图像采集预处理、信息存档,包括以下步骤:In this embodiment, the step 2: footprint image acquisition preprocessing, information archiving, includes the following steps:
a.去除足迹图像上的标尺信息,足迹采集器采集的图像固定区域会自带一个用于计算足迹大小的标尺信息,这个信息对于足迹比对用处不大,因此需要予以去除,具体的操作就是将图像固定区域灰度值直接赋值为255;a. Remove the ruler information on the footprint image. The fixed area of the image collected by the footprint collector will have a ruler information for calculating the size of the footprint. This information is not useful for the comparison of the footprint, so it needs to be removed. The specific operation is The gray value of the fixed area of the image is directly assigned to 255;
b.基于Otsu算法进行去噪和足迹定位,由于采集到的足迹图像足迹区域和背景区域很容易区分开,因此基于Otsu算法确定一个区分阈值th;图像中灰度小于th的像素点被认为是足迹区域的点,其余点被认为是背景,确定th之后就可以以此为依据,从上下左右四个方向扫描足迹图像,检测出足迹区域的四个边界,从而完成足迹定位;完成了足迹定位之后,由于大部分噪声都是在足迹区域外的,实际上此时也完成了去噪的工作;b. Based on the Otsu algorithm for denoising and footprint positioning, since the footprint area and the background area of the collected footprint image are easy to distinguish, a distinction threshold th is determined based on the Otsu algorithm; the pixels with a grayscale less than th in the image are considered to be The points in the footprint area, and the rest of the points are considered as the background. After determining th, you can scan the footprint image from four directions, up, down, left, and right, and detect the four boundaries of the footprint area, thereby completing the footprint positioning; the footprint positioning is completed. After that, since most of the noise is outside the footprint area, the denoising work is actually completed at this time;
c.调整足迹图像大小并进行灰度反转,在b中已经确定了足迹区域的位置,一般情况下,足迹的上下边界的距离要大于左右边界的距离,因此系统认为上下边界距离小于左右边界的足迹图像是异常足迹图像,在系统的具体实施中应发出警报;在确定了上下边界的距离之后,定义一个像素值全为255的正方形区域,边长就是上下边界的距离;然后将足迹区域直接复制到正方形区域的正中央,并用255减去正方形区域的每个点的像素值,进行像素级别的灰度反转;最后将得到的正方形区域进行下采样,调整分辨率,并进行保存。c. Adjust the size of the footprint image and perform grayscale inversion. The location of the footprint area has been determined in b. Generally, the distance between the upper and lower boundaries of the footprint is greater than the distance between the left and right boundaries, so the system considers that the distance between the upper and lower boundaries is smaller than the left and right boundaries. The footprint image is an abnormal footprint image, and an alarm should be issued in the specific implementation of the system; after determining the distance between the upper and lower boundaries, define a square area with a pixel value of 255, and the side length is the distance between the upper and lower boundaries; Copy directly to the center of the square area, and subtract the pixel value of each point in the square area from 255 to perform grayscale inversion at the pixel level; finally, downsample the obtained square area, adjust the resolution, and save it.
在本实施例中,所述的步骤3:信息比对包括以下步骤:In this embodiment, the step 3: the information comparison includes the following steps:
第一步,网络训练:将采集的足迹样本按照被采集对象分成两部分,一部分对象的足迹样本作为训练集样本,另一部分作为验证集样本;The first step, network training: Divide the collected footprint samples into two parts according to the collected objects, one part of the object's footprint samples are used as training set samples, and the other part is used as validation set samples;
假如输入网络的两幅足迹图像属于同一个人,则这两幅图像组成了一个正样本X,标签Y为1,反之,两幅图像组成一个负样本X,标签Y为0;每次从训练集中随机抽样,获取一批(Batch)正样本或者负样本,输入到网络中进行相似度计算,并将输出值和标签做一个MSE损失,损失的表达式为: If the two footprint images input to the network belong to the same person, the two images form a positive sample X, and the label Y is 1; otherwise, the two images form a negative sample X, and the label Y is 0; each time from the training set Random sampling, obtain a batch of positive samples or negative samples, input them into the network for similarity calculation, and make an MSE loss on the output value and label. The expression of the loss is:
式中,B代表训练时的批大小,FCN表示足迹比对网络,将任意样本X输入网络即可得到网络的预测标签;In the formula, B represents the batch size during training, and FCN represents the footprint comparison network. Input any sample X into the network to obtain the predicted label of the network;
训练时,对每批样本的损失L进行反向传播,然后用梯度下降法优化模型;当训练的批次足够多,网络就相当于在所有可能的正负样本空间上进行了参数优化;经过反复随机抽取正负样本进行模型优化,最终模型将逐渐收敛;During training, the loss L of each batch of samples is back-propagated, and then the model is optimized by gradient descent; when there are enough training batches, the network is equivalent to optimizing parameters on all possible positive and negative sample spaces; Repeatedly randomly select positive and negative samples for model optimization, and the final model will gradually converge;
第二步,模型选择:神经网络最终要保存的模型一般需要使用一个验证集从训练的中间模型中选取,模型选择时需要在验证集上随机选择足够多的样本,将其输入到网络中进行相似度计算,相似度大于0.5则认为是同一人的足迹,小于0.5则不是同一人的足迹,取足迹比对准确率最高的中间模型作为最终保存的模型。The second step, model selection: The model to be saved by the neural network generally needs to be selected from the intermediate model trained by a validation set. When selecting the model, it is necessary to randomly select enough samples from the validation set and input them into the network for Similarity calculation, if the similarity is greater than 0.5, it is considered to be the footprint of the same person, and if the similarity is less than 0.5, it is not the footprint of the same person, and the intermediate model with the highest footprint comparison accuracy is taken as the final saved model.
工作原理:working principle:
使用时,首先对工作人员进行信息采集,被采集人走过足迹采集器,足迹采集器采集到的图像是一幅有256个灰度级的灰度图像,足迹采集器采集的图像固定区域会自带一个用于计算足迹大小的标尺信息,这个信息对于足迹比对用处不大,因此需要予以去除,具体的操作就是将图像固定区域灰度值直接赋值为255,由于采集到的足迹图像足迹区域和背景区域很容易区分开,因此基于Otsu算法确定一个区分阈值th;图像中灰度小于th的像素点被认为是足迹区域的点,其余点被认为是背景,确定th之后就可以以此为依据,从上下左右四个方向扫描足迹图像,检测出足迹区域的四个边界,从而完成足迹定位;完成了足迹定位之后,由于大部分噪声都是在足迹区域外的,实际上此时也完成了去噪的工作;调整足迹图像大小并进行灰度反转,在确定了上下边界的距离之后,定义一个像素值全为255的正方形区域,边长就是上下边界的距离;然后将足迹区域直接复制到正方形区域的正中央,并用255减去正方形区域的每个点的像素值,进行像素级别的灰度反转;最后将得到的正方形区域进行下采样,调整分辨率,并进行保存,在使用过程中,人员入场时,将会采集他们的足迹图像,然后将他们的图像和数据库中的图像组成比对图像对,送入足迹认证系统中,足迹认证系统经过对图像的比对,将输出图像之间的相似度分数;假设系统设置的阈值TH=0.7,进行身份认证的人员足迹和1号足迹数据的相似度为0.8>TH,说明这个人是数据库中的1号人员;比对通过,可以予以放行;如果数据库里面没有任何一个足迹图像和待认证图像之间的相似度大于阈值,则足迹认证系统会认为该人员未进行信息注册,不予放行。When using, first collect information on the staff. The person to be collected walks through the footprint collector. The image collected by the footprint collector is a grayscale image with 256 gray levels. The fixed area of the image collected by the footprint collector will be It comes with a ruler for calculating the size of the footprint. This information is not very useful for the comparison of the footprint, so it needs to be removed. The specific operation is to directly assign the gray value of the fixed area of the image to 255, because the collected footprint image footprint The area and the background area are easy to distinguish, so a distinction threshold th is determined based on the Otsu algorithm; the pixel points in the image whose gray level is less than th are considered as the points of the footprint area, and the remaining points are considered as the background. Based on this, the footprint image is scanned from the four directions of up, down, left, and right, and the four boundaries of the footprint area are detected to complete the footprint location; after the footprint location is completed, since most of the noise is outside the footprint area, it is actually Complete the denoising work; adjust the size of the footprint image and perform grayscale inversion, after determining the distance between the upper and lower boundaries, define a square area with a pixel value of 255, and the side length is the distance between the upper and lower boundaries; Copy directly to the center of the square area, and subtract the pixel value of each point in the square area from 255 to perform grayscale inversion at the pixel level; finally, downsample the obtained square area, adjust the resolution, and save it. In the process of use, when people enter the venue, their footprint images will be collected, and then their images will be compared with the images in the database to form an image pair, which will be sent to the footprint authentication system. , will output the similarity score between the images; assuming that the threshold TH=0.7 set by the system, the similarity between the person's footprint and the No. 1 footprint data for identity authentication is 0.8>TH, indicating that this person is the No. 1 person in the database; If the comparison is passed, it can be released; if the similarity between any footprint image in the database and the image to be authenticated is greater than the threshold, the footprint authentication system will consider that the person has not registered information and will not be released.
尽管已经示出和描述了本发明的实施例,对于本领域的普通技术人员而言,可以理解在不脱离本发明的原理和精神的情况下可以对这些实施例进行多种变化、修改、替换和变型,本发明的范围由所附权利要求及其等同物限定。Although embodiments of the present invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, and substitutions can be made in these embodiments without departing from the principle and spirit of the invention and modifications, the scope of the invention is defined by the appended claims and their equivalents.
Claims (5)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010912788.9A CN112069482B (en) | 2020-09-03 | 2020-09-03 | Identity authentication system based on footprint comparison method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010912788.9A CN112069482B (en) | 2020-09-03 | 2020-09-03 | Identity authentication system based on footprint comparison method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112069482A true CN112069482A (en) | 2020-12-11 |
CN112069482B CN112069482B (en) | 2023-04-07 |
Family
ID=73666392
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010912788.9A Active CN112069482B (en) | 2020-09-03 | 2020-09-03 | Identity authentication system based on footprint comparison method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112069482B (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010261159A (en) * | 2009-04-30 | 2010-11-18 | Yamatake Corp | Entrance / exit management system and method |
CN103985175A (en) * | 2014-05-21 | 2014-08-13 | 清华大学 | Control method and system of home entrance guard |
CN205091816U (en) * | 2015-11-06 | 2016-03-16 | 天津大学 | Personnel management system based on identity information |
CN111382629A (en) * | 2018-12-28 | 2020-07-07 | 中国科学院半导体研究所 | Footprint recognition and information mining method and system based on convolutional neural network |
CN111402202A (en) * | 2020-02-24 | 2020-07-10 | 安徽大学 | A method for evaluating similarity of plantar pressure images |
-
2020
- 2020-09-03 CN CN202010912788.9A patent/CN112069482B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010261159A (en) * | 2009-04-30 | 2010-11-18 | Yamatake Corp | Entrance / exit management system and method |
CN103985175A (en) * | 2014-05-21 | 2014-08-13 | 清华大学 | Control method and system of home entrance guard |
CN205091816U (en) * | 2015-11-06 | 2016-03-16 | 天津大学 | Personnel management system based on identity information |
CN111382629A (en) * | 2018-12-28 | 2020-07-07 | 中国科学院半导体研究所 | Footprint recognition and information mining method and system based on convolutional neural network |
CN111402202A (en) * | 2020-02-24 | 2020-07-10 | 安徽大学 | A method for evaluating similarity of plantar pressure images |
Non-Patent Citations (1)
Title |
---|
陈扬等: "一种基于CNN的足迹图像检索与匹配方法", 《南京师范大学学报(工程技术版)》 * |
Also Published As
Publication number | Publication date |
---|---|
CN112069482B (en) | 2023-04-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6830707B1 (en) | Person re-identification method that combines random batch mask and multi-scale expression learning | |
CN102629319B (en) | A Robust Iris Region Segmentation Method Based on Specific Boundary Detectors | |
CN105956578B (en) | A kind of face verification method of identity-based certificate information | |
US10354472B2 (en) | Self-learning system and methods for automatic document recognition, authentication, and information extraction | |
KR100974293B1 (en) | Facial recognition method and system | |
CA3164651C (en) | Efficient management of facial recognition systems and methods in multiple areas | |
CN102156887A (en) | Human face recognition method based on local feature learning | |
CN113269070A (en) | Pedestrian re-identification method fusing global and local features, memory and processor | |
CN107657209B (en) | Template image registration mechanism based on finger vein image quality | |
CN103049736A (en) | Face identification method based on maximum stable extremum area | |
US9378406B2 (en) | System for estimating gender from fingerprints | |
CN102831441A (en) | Comparing device | |
Ojo et al. | Development of an Improved Convolutional Neural Network for an Automated Face-Based University Attendance System | |
CN113221086A (en) | Offline face authentication method and device, electronic equipment and storage medium | |
CN105184236A (en) | Robot-based face identification system | |
TWI325568B (en) | A method for face varification | |
CN118334758B (en) | Image recognition method and system applied to building access control system | |
CN112069482A (en) | An Identity Authentication System Based on Footprint Comparison Algorithm | |
CN118658185A (en) | Finger and palm vein authentication method combining CNN and Transformer | |
CN111753710A (en) | A Subdivision Neural Network Face Recognition Method Applied in Logistics Distribution | |
CN118014479A (en) | Warehouse entry and exit management method and system based on image recognition | |
Farhi et al. | Smart identity management system by face detection using multitasking convolution network | |
Verma et al. | Static Signature Recognition System for User Authentication Based Two Level Cog, Hough Tranform and Neural Network | |
Singh et al. | Identify a person from Iris Pattern using GLCM features and Machine Learning Techniques | |
Sable et al. | Pretrained Deep Neural Networks for Age Prediction from Iris Biometrics |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |