WO2023124745A1 - Fingerprint comparison method and apparatus, storage medium, and device - Google Patents

Fingerprint comparison method and apparatus, storage medium, and device Download PDF

Info

Publication number
WO2023124745A1
WO2023124745A1 PCT/CN2022/135830 CN2022135830W WO2023124745A1 WO 2023124745 A1 WO2023124745 A1 WO 2023124745A1 CN 2022135830 W CN2022135830 W CN 2022135830W WO 2023124745 A1 WO2023124745 A1 WO 2023124745A1
Authority
WO
WIPO (PCT)
Prior art keywords
minutiae
matching
points
group
pair
Prior art date
Application number
PCT/CN2022/135830
Other languages
French (fr)
Chinese (zh)
Inventor
孔勇
周军
Original Assignee
北京眼神智能科技有限公司
北京眼神科技有限公司
深圳爱酷智能科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202111612355.2A external-priority patent/CN116363703A/en
Priority claimed from CN202210075001.7A external-priority patent/CN116563896A/en
Application filed by 北京眼神智能科技有限公司, 北京眼神科技有限公司, 深圳爱酷智能科技有限公司 filed Critical 北京眼神智能科技有限公司
Publication of WO2023124745A1 publication Critical patent/WO2023124745A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31User authentication
    • G06F21/32User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints

Definitions

  • the present application relates to the field of fingerprint identification, in particular to a fingerprint comparison method, device, storage medium and equipment.
  • Fingerprint identification technology is one of the most mature and common technologies in the field of biometric identification. Fingerprints are made up of alternating ridges and valleys on the surface of the finger. Because of the convenient fingerprint collection process, low hardware cost, reliable performance and convenient use, it has been widely used in many aspects such as identity verification and access control, such as mobile phone unlocking, access control equipment, fingerprint collection when applying for ID cards, and entry and exit. Fast pass system, etc.
  • the present application provides a fingerprint comparison method, the method comprising:
  • the distance and angle difference between two minutiae points of the matching minutiae point pair and the neighborhood minutiae point information are used to calculate the matching minutiae point pair Similarity median value; and according to the similarity median value of each minutiae matching pair, calculate the matching score of the first fingerprint image and the second fingerprint image, including:
  • the neighborhood minutiae point pair sets all matching minutiae point pairs within the neighborhood range for the matching minutiae point pair
  • the matching score between the first fingerprint image and the second fingerprint image is calculated according to the contribution values of all matching minutiae point pairs.
  • calculating the contribution value of the matching detail point pair according to the matching detail point pair and the corresponding neighborhood detail point pair includes:
  • each neighborhood minutiae point pair calculates the second contribution value of each neighborhood minutiae point pair according to the distance and angle difference between the two minutiae points of the neighborhood minutiae point pair, and the corresponding interior angle value;
  • the inner angle value is an angle value of an inner angle formed by two minutiae points of the neighborhood minutiae point pair and the matching minutiae point pair;
  • the contribution value of the matching minutiae point pair is calculated according to the first contribution value of the matching minutiae point pair and the second contribution values of all neighborhood minutiae point pairs.
  • the first contribution value of the matching minutiae point pair is calculated by the following formula
  • sd is the first contribution value of the pair of matching minutiae points
  • Z(,,) is a sigmoid function
  • d i and ⁇ i are respectively the distance and angle difference between two minutiae points of i matching minutiae point pairs
  • i 1,2,...,N
  • N is the number of matching minutiae point pairs
  • ⁇ 1 , ⁇ 1 , ⁇ 2 , ⁇ 2 are the set parameters
  • the second contribution value of each neighborhood detail point pair is calculated by the following formula
  • pairscore i is the contribution value of the i-th matching minutiae point pair
  • np and nq are respectively the number of the first group of minutiae points and the number of the second group of minutiae points within the set neighborhood of the matching minutiae point ;
  • the matching score between the first fingerprint image and the second fingerprint image is calculated by the following formula:
  • N1 and N2 are the numbers of the first group of minutiae points and the number of the second group of minutiae points respectively.
  • the selection of a matching minutiae point pair as a reference minutiae point pair includes:
  • performing a rigid transformation on all the minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincides including:
  • (x2, y2, ⁇ 2) are the coordinates and direction angles of the first group of minutiae points of the reference minutiae point pair
  • (x1, y1, ⁇ 1) are the coordinates of the second group of minutiae points of the reference minutiae point pair and orientation angle
  • (x, y, ⁇ ) are the coordinates and orientation angles of the second group of minutiae points before rigid transformation
  • (x′, y′, ⁇ ′) are the coordinates and orientation angles of the second group of minutiae points after rigid transformation.
  • the method also includes:
  • a fingerprint comparison result is obtained according to the matching score between the first fingerprint image and the second fingerprint image.
  • the obtaining the matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points includes:
  • the distance and angle difference between two minutiae points of the matching minutiae point pair and the neighborhood minutiae point information are used to calculate the matching minutiae point pair Similarity median value; and according to the similarity median value of each minutiae matching pair, calculate the matching score of the first fingerprint image and the second fingerprint image, including:
  • the sexual similarity matrix is the median value of the similarity
  • the matching certainty similarity matrix of each matching pair is calculated by the following formula:
  • the matching pair includes the a-th minutiae point in the first group of minutiae points and the b-th minutiae point in the second group of minutiae points
  • ml(i,j) is the i-th minutiae of the matching certainty similarity matrix
  • d , ⁇ , ⁇ are the absolute values of the three elements of the three-dimensional vector v0
  • Fl i is the 2-nearest neighbor structure representation of the i-th minutiae F i in the first group of minutiae points
  • p and q are the two minutiae points F p and F q closest to the i-th minutiae F i respectively serial number, t l , (x l ,y l ) and Respectively, the type, coordinates and angle of the lth detail point F i , l takes i, p, q;
  • n ip is the number of ridge lines on the line between the i-th detail point and the p-th detail point in the first group of detail points
  • n iq is the i-th detail point and the q-th detail point in the first group of detail points The number of ridges on the connection;
  • d ⁇ (t 1 ,t 2 ) is the angle difference function, which is defined as:
  • Gl j is the 2-nearest neighbor structure representation of the jth minutiae G j in the second group of minutiae points
  • m and n are the two minutiae points G m and G n closest to the jth minutiae G j respectively serial number, t h , (x h ,y h ) and Respectively, the type, coordinates and angle of the hth detail point G h , where h takes j, m, n;
  • n jm is the number of ridge lines on the line between the jth minutiae point and the mth minutiae point in the second group of minutiae points
  • n jn is the jth minutiae point and the nth minutiae point in the second group of minutiae points The number of ridges on the link.
  • A is the dot product of the weighting coefficient vector W and the vector V;
  • the selecting matching detail point pairs of each matching deterministic similarity matrix and calculating the matching score of each matching deterministic similarity matrix includes:
  • the matching score s of each matching deterministic similarity matrix is calculated by the following formula:
  • the method also includes:
  • the fingerprint comparison result is obtained according to the total matching score.
  • the present application provides a fingerprint comparison device, the device comprising:
  • the data preparation module is used to obtain the first group of minutiae points of the first fingerprint image and the second group of minutiae points of the second fingerprint image;
  • An acquisition module configured to acquire the matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points;
  • An intermediate value calculation module for each matching detail point pair, according to the distance and angle difference between two detail points of the matching detail point pair, and the neighborhood detail point information to calculate the similarity of the matching detail point pair degree median;
  • a matching score calculation module configured to calculate a matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each matching pair of minutiae points.
  • the intermediate value calculation module includes a rigid transformation module and a contribution value calculation module:
  • the rigid transformation module is configured to select a matching minutiae point pair as a reference minutiae point pair, and perform a rigid transformation on all minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincide ;
  • the contribution value calculation module is used to calculate the contribution value of the matching detail point pair according to the matching detail point pair and the corresponding neighborhood detail point pair for each matching detail point pair;
  • the neighborhood minutiae point pair sets all matching minutiae point pairs within the neighborhood range for the matching minutiae point pair
  • the matching score calculation module is used to calculate the matching score between the first fingerprint image and the second fingerprint image according to the contribution values of all matching minutiae point pairs.
  • the acquisition module includes a 2-nearest neighbor structure representation calculation module, a local similarity matrix calculation module, and a matching pair determination module
  • the intermediate value calculation module includes a matching certainty similarity matrix calculation module:
  • the 2-nearest neighbor structure representation calculation module is used to calculate the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points ;
  • the local similarity matrix calculation module is used to calculate according to the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points The local similarity matrix of the first group of minutiae points and the second group of minutiae points;
  • the matching pair determination module is configured to select several elements from the local similarity matrix in descending order, and obtain two minutiae points corresponding to each selected element as a matching minutiae point pair;
  • the matching deterministic similarity matrix calculation module calculates the matching determination of the matching pair according to the distance difference and angle difference between the local similarity matrix and the two minutiae points of the matching pair sex similarity matrix;
  • the matching score calculation module is used to select the matching detail point pairs of each matching deterministic similarity matrix and calculate the matching score of each matching deterministic similarity matrix; and calculate the total matching score according to all matching scores.
  • the present application provides a computer-readable storage medium for fingerprint comparison, including a memory for storing processor-executable instructions. The steps of the fingerprint comparison method.
  • the present application provides a device for fingerprint comparison, including at least one processor and a memory storing computer-executable instructions, and the processor implements the fingerprint comparison described in the first aspect when executing the instructions method steps.
  • Fig. 1 is an example diagram of terminal points and bifurcation points on the fingerprint
  • Figure 2a is an example diagram of the first fingerprint image
  • Fig. 2b is an example diagram of the second fingerprint image
  • Figure 3a is an example diagram of the first fingerprint image and its first group of minutiae points
  • Figure 3b is an example diagram of the second fingerprint image and its second group of minutiae points
  • Fig. 4 is an example diagram of the first group of minutiae points and their numbers and the second group of minutiae points and their numbers;
  • Fig. 5 is an example diagram of matching minutiae point-to-connection lines
  • Figure 6a and Figure 6b are schematic diagrams of the situation where two minutiae points match
  • Figure 7a and Figure 7b are schematic diagrams of the situation where two minutiae do not match
  • FIG. 8 is a flowchart of a fingerprint comparison method according to an embodiment of the present application.
  • FIG. 9 is a flowchart of a fingerprint comparison method according to another embodiment of the present application.
  • FIG. 10 is a schematic diagram of an interior angle ⁇ j formed by two minutiae points of a neighborhood minutiae point pair and a matching minutiae point pair in an embodiment of the present application;
  • Fig. 11 is a flowchart of a fingerprint comparison method according to another embodiment of the present application.
  • Fig. 12 is a schematic diagram of an embodiment of the present application when there are two minutiae points to be matched that may match the minutiae points to be matched in the limit box;
  • FIG. 13 is a schematic diagram of the 2-nearest neighbor structure representation of the i-th minutiae point in the first group of minutiae points in an embodiment of the present application;
  • FIG. 14 is a schematic diagram of a fingerprint matching device in an embodiment of the present application.
  • FIG. 15 is a schematic diagram of a fingerprint matching device in another embodiment of the present application.
  • Fig. 16 is a schematic diagram of a fingerprint matching device in another embodiment of the present application.
  • FIG. 17 is a schematic structural diagram of a device for fingerprint comparison in an embodiment of the present application.
  • Fingerprint recognition technology mainly includes two algorithmic processes of fingerprint feature extraction and fingerprint matching.
  • the most commonly used and basic features are minutiae, which include two types of terminal points and bifurcation points, which correspond to the end of a ridge line and the division of a ridge line into The case of two ridges.
  • the circles represent the minutiae points of the bifurcation point type
  • the boxes represent the minutiae points of the terminal point type.
  • Each detail point can be specified with type t, coordinates (x, y) and angle Composed of four-dimensional coordinates (x, y, t) to represent.
  • fingerprint minutiae is recognized as the most discriminative and reliable local feature of fingerprints, and the local structure of minutiae has good adaptability to nonlinear deformation and noise.
  • the fingerprint matching algorithm based on minutiae is the most important method in the research of fingerprint matching algorithm. Its core problem is to find the matching minutiae pair and calculate a matching score or similarity value according to certain rules.
  • the minutiae points of the first fingerprint image are called the first group of minutiae points
  • the minutiae points of the second fingerprint image are called the second group of minutiae points.
  • the main steps of the minutiae-based fingerprint matching algorithm are: calculating the local descriptor of each minutiae, calculating each The local similarity of two minutiae points, and find those matching minutiae point pairs that can be matched through the set rules, and finally get a matching score based on the number of these matching minutiae point pairs or the matching certainty similarity value between them .
  • FIG. 2a and Fig. 2b respectively give an example of the first fingerprint image and the second fingerprint image.
  • Figure 2a is the first fingerprint image
  • Figure 2b is the second fingerprint image
  • the first fingerprint image and the second fingerprint image are from the same fingerprint.
  • the minutiae points of the two are shown in Figure 3a and Figure 3b respectively, where Figure 3a is the first fingerprint image and its first group of minutiae points, and Figure 3b is the second fingerprint image and its second group of minutiae points.
  • Each detail point is numbered as shown in Figure 4, the left side of Figure 4 is the first group of detail points (50 in total), and the right side is the second group of detail points (38 in total).
  • the matching score can be calculated according to the matching detail point pair. Assume that the number of detail points in the first group of detail points is N1, and the number of detail points in the second group of detail points is N2. The number is N (that is, there are N pairs of minutiae points matched), then the formula for calculating the matching score s in the related art generally has the following types:
  • the main steps of the minutiae-based fingerprint matching algorithm are: calculate the local similarity matrix of the first group of minutiae points and the second group of minutiae points, select a minutiae point pair according to the local similarity, and refer to this Make a rigid change of the detail point pairs, that is, let the two detail points in this detail point pair completely overlap, and then count the matching detail point pairs that can be paired after the rigidity change, and finally based on the number of these matching detail point pairs and the distance between them
  • the match certainty similarity value for a given match yields a match score.
  • the Bounding box technology is used when counting those matching detail point pairs that can be matched after the rigidity changes.
  • the bounding box also known as the bounding box, is used to limit whether two detail points are close and match.
  • two groups of fingerprint minutiae are rotated and translated according to a matching pair, they are used to find more matching minutiae pairs. For example, when two minutiae points meet the condition of the bounding box, that is, when the distance between them is very close and the direction is also very close, then the two minutiae points can be considered as matching minutiae point pairs (candidates to be selected).
  • a black circle plus a short line (the direction of this short line can represent the angle of this detail point) represents a detail point, which is recorded as the matched detail point, and the surrounding box is the matched detail point. Click to determine the limited box.
  • the white circle plus a short line is a minutiae point to be matched to judge whether it matches the minutiae point to be matched.
  • the two matching situations are shown in Fig. 6a and Fig. 6b respectively.
  • the two cases of mismatch are shown in Fig. 7a and Fig.
  • the first case is that the minutiae point to be matched is not in the bounding box
  • the second case is that the minutiae point to be matched is in the bounding box but is matched with The direction of the detail point is too different.
  • the minutiae-based fingerprint matching algorithm of this kind of related technology adopts the method of limiting the box when counting those matching minutiae pairs that can be matched after the rigidity changes, but this method cannot obtain better matching minutiae pairs, resulting in fingerprint
  • the reduction of the comparison accuracy reduces the evaluation indicators such as the equal error rate.
  • a fingerprint comparison method is designed to better evaluate the similarity of two fingerprint images and improve the accuracy of fingerprint comparison.
  • the fingerprint comparison method includes:
  • S1 Obtain the first set of minutiae points of the first fingerprint image and the second set of minutiae points of the second fingerprint image.
  • the first group of minutiae points and the second group of minutiae points are obtained by extracting the first fingerprint image and the second fingerprint image participating in the comparison through a fingerprint feature extraction algorithm.
  • This application does not limit the specific implementation of the fingerprint feature extraction algorithm.
  • S2 Obtain matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points.
  • S3 For each matching minutiae point pair, calculate the median similarity value of the matching minutiae point pair according to the distance and angle difference between two minutiae points of the matching minutiae point pair and the neighborhood minutiae point information.
  • S4 Calculate the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each matching pair of minutiae points.
  • This embodiment provides a fingerprint comparison method, as shown in Figure 9, the method includes:
  • S1 Obtain the first set of minutiae points of the first fingerprint image and the second set of minutiae points of the second fingerprint image.
  • S2 Obtain matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points.
  • the first group of minutiae points and the second group of minutiae points in this embodiment are obtained by extracting the first fingerprint image and the second fingerprint image participating in the comparison through the fingerprint feature extraction algorithm, and this application does not limit the specific implementation of the fingerprint feature extraction algorithm Way. Moreover, the present application does not limit the manner of obtaining the matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points, and various methods in the prior art may be used.
  • the number of minutiae points of the first group of minutiae points is N1
  • the number of minutiae points of the second group of minutiae points is N2
  • the aforementioned step S3 For each matching minutiae point pair, calculate the matching minutiae according to the distance difference and angle difference between two minutiae points of the matching minutiae point pair, and the neighborhood minutiae point information
  • the intermediate value of similarity between point pairs specifically includes the following steps S31a and S32a.
  • S31a Select a matching minutiae point pair as a reference minutiae point pair, and perform a rigid transformation on all minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincide.
  • the selected reference minutiae point pair can be recorded as (p a , q a ), where pa is the minutiae point belonging to the first group of minutiae points, and q a is the minutiae point belonging to the second group of minutiae points. Then q a is subjected to rigid transformation, so that q a coincides with p a , and other minutiae points in the second group of minutiae points are also subjected to the same rigid transformation. Convert the second group of minutiae points to the coordinates of the coordinate system of the first group of minutiae points to facilitate subsequent operations.
  • S32a For each matching minutiae point pair, calculate the contribution value of the matching minutiae point pair according to the distance and angle difference between two minutiae points in the matching minutiae point pair and the corresponding neighborhood minutiae point pair.
  • the contribution value is the median similarity value described in Example 1.
  • the neighborhood minutiae point pair sets all the matching minutiae point pairs within the neighborhood range for the matching minutiae point pair.
  • This application improves the method of calculating the contribution value of the matching minutiae point pair.
  • the contribution value of the matching minutiae point pair it is not only calculated according to the two minutiae points of the matching minutiae point pair, but also according to the neighbors in the neighborhood of the matching minutiae point pair.
  • the domain minutiae point pair calculation makes full use of the useful information contained in the matching minutiae point pair, which can improve the accuracy of fingerprint comparison.
  • the foregoing step S4 calculate the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each minutiae matching pair, specifically the following step S41a .
  • S41a Calculate the matching score between the first fingerprint image and the second fingerprint image according to the contribution values of all matching minutiae point pairs.
  • the matching score is the statistical value of the contribution value of all minutiae point pairs. After the matching score is calculated, the fingerprint comparison result can be obtained according to the matching score.
  • This embodiment first obtains the first group of minutiae points of the first fingerprint image and the second group of minutiae points of the second fingerprint image, and obtains the matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points; then select A matching minutiae point pair is used as a reference minutiae point pair, and a rigid transformation is performed on all minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincide; for each matching minutiae point pair, according to the matching The two minutiae points of the minutiae point pair and the minutiae points of the minutiae point pair within the set neighborhood range of the matching minutiae point pair calculate the contribution value of the matching minutiae point pair; finally, the matching score is calculated according to the contribution values of all minutiae point pairs .
  • the aforementioned step S32a includes:
  • S320 Calculate the first contribution value of the matching minutiae point pair according to the distance and angle difference between the two minutiae points of the matching minutiae point pair
  • the first contribution value of the matching minutiae point pair can be calculated by the following formula
  • sd is the first contribution value of the pair of matching minutiae points
  • Z(,,) is a sigmoid function
  • N is the number of matching minutiae point pairs
  • ⁇ 1 , ⁇ 1 , ⁇ 2 , ⁇ 2 are set parameters.
  • v is a variable
  • ⁇ and ⁇ are two parameters
  • the value range of the sigmoid function is [0,1].
  • the distance d i and the angle difference ⁇ i are respectively passed into the sigmoid function as variables, and a value between 0 and 1 can be calculated according to the set ⁇ , ⁇ parameters to represent a certain similarity, such as the closer the distance The larger the value, the smaller the angle difference, the larger the value, and so on.
  • S321 For the matching minutiae point pair (p i , q i ), set the second group of minutiae points of each neighborhood minutiae point pair within the neighborhood range so that the two minutiae points of the matching minutiae point pair Coincident rigid transformation.
  • the number of the first group of minutiae points in the neighborhood of pi with a radius of 90 is np
  • the number of the second group of minutiae points in the neighborhood of q i with a radius of 90 is nq
  • p i and q i are within a radius of
  • S322 For each neighborhood minutiae point pair, calculate the second contribution value of each neighborhood minutiae point pair according to the distance and angle difference between the two minutiae points of the neighborhood minutiae point pair and the corresponding inner angle value.
  • the internal angle value is an angle value of an internal angle formed by two minutiae points of the neighborhood minutiae point pair and the matching minutiae point pair.
  • the second contribution value of each neighborhood detail point pair can be calculated by the following formula
  • M is the set neighborhood range of the matching detail point pair
  • d j and ⁇ j are the distance and angle difference between the two detail points of the jth neighborhood detail point pair (pNeighbor j , qNeighbor j )
  • ⁇ j is the jth neighborhood detail point pair (pNeighbor j , qNeighbor j )
  • the angle value of the internal angle formed by the two minutiae points and the pair of matching minutiae points (p i , q i ), ⁇ j is shown in
  • S323 Calculate the contribution value of the matching minutiae point pair according to the first contribution value of the matching minutiae point pair and the second contribution values of all neighborhood minutiae point pairs.
  • the contribution value of the matching detail point pair can be calculated by the following formula
  • pairscore i is the contribution value of the i-th matching minutiae point pair
  • np and nq are respectively the number of the first group of minutiae points and the number of the second group of minutiae points within the set neighborhood of the matching minutiae point ;
  • the matching score between the first fingerprint image and the second fingerprint image is calculated by the following formula:
  • N1 and N2 are the number of minutiae points in the first group and the number of minutiae points in the second group respectively.
  • the method for selecting the reference detail point pair includes:
  • S310 Calculate the center of gravity of the first group of minutiae points of all matching minutiae point pairs.
  • S311 Find a first group of minutiae points closest to the center of gravity from the first group of minutiae points of all matching minutiae point pairs, and use the matching minutiae point pair to which the found first group of minutiae points belong as a reference minutiae point pair.
  • rigid transformation After obtaining the reference detail point pair, rigid transformation can be performed. This application does not limit the specific implementation of rigid transformation.
  • An example includes:
  • S312 Calculate the angle difference ⁇ and the coordinate difference ⁇ x, ⁇ y of the two minutiae points of the reference minutiae point pair;
  • (x2, y2, ⁇ 2) are the coordinates and orientation angles of the first group of minutiae points of the reference minutiae point pair
  • (x1, y1, ⁇ 1) are the coordinates and orientation angles of the second group of minutiae points of the reference minutiae point pair.
  • S313 Calculate the coordinates and orientation angles of the second group of minutiae after rigid transformation according to the angle difference ⁇ and the coordinate difference ⁇ x, ⁇ y between the two minutiae of the reference minutiae point pair.
  • (x, y, ⁇ ) are the coordinates and orientation angles of the second group of minutiae points before rigid transformation
  • (x′, y′, ⁇ ′) are the coordinates and orientation angles of the second group of minutiae points after rigid transformation.
  • the rigid transformation that makes q a and p a coincident includes a rotation and translation operation T, and the angles of the second set of minutiae points are all subtracted by ⁇ .
  • a fingerprint test set is constructed, and the fingerprint matching algorithm based on the minutiae of the prior art is completely tested, and its equal error rate is 5.5%, while the fingerprint of the present application
  • the equal error rate of the comparison method is 3.5%. Compared with the prior art, the equal error rate is reduced by about 36.3%, and the result has been greatly improved.
  • this application optimizes the method of calculating the fingerprint comparison score.
  • it not only considers the distance and angle difference between the two minutiae points of the matching minutiae point itself, Also consider information such as the distance between the two minutiae points of the neighborhood minutiae point pair within a certain neighborhood of the matching minutiae point pair, the angle difference, and the inner angle value formed with the matching minutiae point pair.
  • the information that is helpful for fingerprint comparison such as the distance and angle contained in the matching minutiae point pair itself and the matching minutiae point pair within a certain range around it, can be fully utilized, and the accuracy of fingerprint comparison is improved.
  • the test results on the test set have been greatly improved, the accuracy of fingerprint comparison has been improved, and the evaluation indicators such as the equal error rate have been reduced.
  • This embodiment provides a fingerprint comparison method, as shown in Figure 11, the method includes:
  • S1 Obtain the first set of minutiae points of the first fingerprint image and the second set of minutiae points of the second fingerprint image.
  • the first group of minutiae points and the second group of minutiae points in this step are obtained by extracting the first fingerprint image and the second fingerprint image participating in the comparison through the fingerprint feature extraction algorithm.
  • This application does not limit the specific implementation of the fingerprint feature extraction algorithm. .
  • the comparison between the first fingerprint image and the second fingerprint image can be called the matching between the first set of minutiae points and the second set of minutiae points.
  • the foregoing step S2: obtaining matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points specifically includes the following steps S21b-S23b.
  • S21b Calculate the 2-nearest neighbor structure representation of each minutiae point in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points.
  • t q , (x q ,y q ) are respectively the type, coordinates and angle of the qth minutiae point F q in the first group of minutiae points.
  • the present application does not limit the specific calculation method of the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points. In one example, it can be calculated by the following formula:
  • Fl i is the 2-neighbor structure representation of the i-th minutiae F i in the first group of minutiae points
  • Fl i is an 11-dimensional vector
  • p and q are the two nearest neighbors to the i-th minutiae F i , respectively.
  • the numbers of minutiae points F p and F q , t l , (x l ,y l ) and Respectively, the type, coordinates and angle of the lth minutiae point F i in the first group of minutiae points, l takes i, p, q;
  • n ip is the number of ridge lines on the line between the i-th detail point and the p-th detail point in the first group of detail points
  • n iq is the i-th detail point and the q-th detail point in the first group of detail points The number of ridges on the link.
  • FIG. 13 An example of the 2-neighbor structure representation of the ith minutiae F i in the first group of minutiae points is shown in Fig. 13 .
  • Gl j is the 2-nearest neighbor structure representation of the jth minutiae G j in the second group of minutiae points
  • m and n are the two minutiae points G m and G n closest to the jth minutiae G j respectively serial number, t h , (x h ,y h ) and Respectively, the type, coordinates and angle of the hth minutiae point G h in the second group of minutiae points, where h takes j, m, n;
  • n jm is the number of ridge lines on the line between the jth minutiae point and the mth minutiae point in the second group of minutiae points
  • n jn is the jth minutiae point and the nth minutiae point in the second group of minutiae points The number of ridges on the link.
  • S22b According to the 2-nearest neighbor structure representation of each minutiae point in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points, calculate the local parts of the first group of minutiae points and the second group of minutiae points similarity matrix.
  • the local similarity matrix is a matrix of size M*N, and the element sl(i, j) in the i-th row and j-column is the i-th minutiae point in the first group of minutiae points and the j-th minutiae point in the second group of minutiae points
  • the local similarity of minutiae points, the local similarity represents Fl i through the 2-nearest neighbor structure of the i-th minutiae point in the first group of minutiae points and the 2-nearest neighbor of the j-th minutiae point in the second group of minutiae points
  • the structure represents Gl i calculated.
  • S23b Select several elements from the local similarity matrix in descending order, and obtain two minutiae points corresponding to each selected element as a matching pair.
  • the element is the maximum value of all elements in the local similarity matrix, which corresponds to a matching pair.
  • the matching pair includes the a-th minutiae point in the first group of minutiae points and the b-th minutiae point in the second group of minutiae points.
  • the local similarity value between the bth minutiae in the group minutiae is the largest.
  • the significance of the matching pair (a, b) is that the relative transformation of translation and rotation between the first two fingerprint images is unknown in advance, and operations such as translation and rotation need to be performed according to the matching pair (a, b) to find the two fingerprint images. Matching pairs of other minutiae between group fingerprint minutiae.
  • this step can also select multiple elements from large to small, for example, 5, and each element corresponds to a matching pair. Subsequent processing is performed separately for each matching pair.
  • step S3 For each matching minutiae point pair, calculate the matching minutiae point pair according to the distance and angle difference between two minutiae points of the matching minutiae point pair and the neighborhood minutiae point information
  • the intermediate value of the similarity specifically includes the following step S31b.
  • S31b For each pair, calculate a matching certainty similarity matrix of the matching pair according to the local similarity matrix and the distance difference and angle difference between two minutiae points of the matching pair.
  • the matching deterministic similarity matrix is the median similarity value described in Embodiment 1.
  • the size of the matching deterministic similarity matrix is M*N, and the element ml(i, j) in the i-th row and j-column represents the i-th minutiae point in the first group of minutiae points and the i-th minutiae point in the second group of minutiae points The similarity of j minutiae points.
  • This step is illustrated by taking only one matching pair (a, b) as an example.
  • the matching certainty similarity matrix is calculated for each matching pair.
  • a specific calculation method of the matching deterministic similarity matrix corresponding to the matching pair (a, b) is:
  • each minutiae F i in the first group of minutiae points takes the ath minutiae as a reference to carry out the polar coordinate conversion operation, and converts the four-dimensional vector of the i-th minutiae point Convert to 3D eigenvectors
  • (x a ,y a ) are the coordinates and angles of the ath minutiae point in the first group of minutiae points, respectively.
  • each minutiae point G j in the second group of minutiae points takes the bth minutiae point as a reference to carry out polar coordinate transformation operation, and converts the four-dimensional vector of the jth minutiae point Convert to 3D eigenvectors
  • the matching certainty similarity matrix corresponding to the matching pair (a, b) is calculated by the following formula:
  • the threshold ⁇ 8, ⁇ /6, ⁇ /6 ⁇ is the set limit box.
  • the method in this embodiment does not add a fixed item after 0.5*sl(i,j), but adds a dynamic value, namely (8-d)*cos( ⁇ ) 2 *cos ( ⁇ ) 2 /16, the dynamic value changes according to the vertical dynamics of d, ⁇ , ⁇ , d represents the distance difference between two detail points, ⁇ , ⁇ represents the angle difference between two detail points, so that ml(i,j ) integrates the distance difference and angle difference information of two minutiae points, which can better measure the similarity between two minutiae points, ultimately improve the accuracy of fingerprint comparison, and reduce the evaluation indicators such as the equal error rate. And when there are two or more minutiae points to be matched that may match the minutiae points to be matched in the limited box, it is helpful to select a more optimal pair of matching minutiae points.
  • step S4 calculate the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each pair of minutiae points, specifically the following step S41b.
  • S41b Select the matching detail point pairs of each matching deterministic similarity matrix and calculate the matching score of each matching deterministic similarity matrix; and calculate the total matching score according to all matching scores.
  • the matching pair (a, b) corresponds to a matching deterministic similarity matrix, for example, the matching deterministic similarity of the matching pair (a, b)
  • a specific calculation method of matching detail point pairs and matching scores of the degree matrix is:
  • the ml( i,j) in the i-th row and j-th column is not the maximum value in the i-th row or not the maximum value in the j-th column, then the ml( i, j) are set to 0.
  • those non-zero elements in the matching deterministic similarity matrix correspond to corresponding matching detail point pairs.
  • the matching score s of the matching certainty similarity matrix is calculated by the following formula:
  • each matching pair is calculated to obtain a matching score.
  • a matching score is calculated for each matching pair, and the total matching score is calculated according to the statistics of these matching scores, which can improve the fingerprint comparison results and achieve lower etc. Error rate.
  • the highest value among these matching scores may be taken as the total matching score, or the average value of the two highest values among some matching scores may be taken as the total matching score.
  • the fingerprint comparison result can be obtained according to the total matching score.
  • the following test has been carried out: construct a fingerprint test set that is all 500DPI, if it is tested according to the fingerprint matching algorithm based on the minutiae of the prior art, its equal error rate is 5.5%, while this The equal error rate of the applied fingerprint comparison method is 3.7%, which is about 32.7% lower than the prior art, and the result has been greatly improved.
  • the embodiment of the present application improves the calculation method of the matching deterministic similarity matrix, and combines the distance difference and angle difference information and the information related to the bounding box to calculate the matching deterministic similarity value, which can better measure the two The similarity between minutiae points and helps to select a better matching minutiae point pair.
  • the test results on the test set have been greatly improved, and the evaluation indicators such as the equal error rate have been reduced.
  • steps in the flow charts involved in the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in the flow charts involved in the above-mentioned embodiments may include multiple steps or stages, and these steps or stages are not necessarily executed at the same time, but may be performed at different times For execution, the execution order of these steps or stages is not necessarily performed sequentially, but may be executed in turn or alternately with other steps or at least a part of steps or stages in other steps.
  • An embodiment of the present application provides a fingerprint comparison device, as shown in Figure 14, the device includes:
  • the data preparation module 1 is used to obtain the first group of minutiae points of the first fingerprint image and the second group of minutiae points of the second fingerprint image.
  • the acquiring module 2 is configured to acquire matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points.
  • Intermediate value calculation module 3 for each matching detail point pair, according to the distance and angle difference between two detail points of the matching detail point pair, and the neighborhood detail point information to calculate the value of the matching detail point pair The median value of the similarity.
  • the matching score calculation module 4 is configured to calculate the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each matching pair of minutiae points.
  • FIG. 15 Another embodiment of the present application provides a fingerprint comparison device, as shown in Figure 15, the device includes:
  • the data preparation module 1a is used to obtain the first group of minutiae points of the first fingerprint image and the second group of minutiae points of the second fingerprint image.
  • the data acquisition module 2a is configured to acquire matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points.
  • the intermediate value acquisition module 3 may include a rigid transformation module 3a and a contribution value calculation module 4a.
  • the rigid transformation module 3a is configured to select a matching minutiae point pair as a reference minutiae point pair, and perform a rigid transformation on all minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincide.
  • the contribution value calculation module 4a is configured to, for each matching minutiae point pair, calculate the contribution value of the matching minutiae point pair according to the matching minutiae point pair and the corresponding neighborhood minutiae point pair.
  • the contribution value is the median similarity value described in Embodiment 4.
  • the neighborhood minutiae point pair sets all the matching minutiae point pairs within the neighborhood range for the matching minutiae point pair.
  • the matching score calculation module 5a is configured to calculate the matching score between the first fingerprint image and the second fingerprint image according to the contribution values of all matching minutiae point pairs.
  • this application When calculating the contribution value of a matching minutiae point pair, this application not only calculates based on the two minutiae points of the matching minutiae point pair, but also calculates the neighborhood minutiae point pair within the neighborhood of the matching minutiae point pair, making full use of the matching minutiae point pair itself It can evaluate the similarity of two fingerprint images very well and improve the accuracy of fingerprint comparison.
  • the contribution numerical calculation module includes:
  • the first calculation unit is configured to calculate the first contribution value of the matching minutiae point pair according to the distance and angle difference between two minutiae points of the matching minutiae point pair.
  • a rigid transformation unit configured to perform rigidity on the second group of minutiae points of each neighborhood minutiae point pair within the set neighborhood range of the matching minutiae point pair so that the two minutiae points of the matching minutiae point pair coincide transform.
  • the second calculation unit is used to calculate the first-th value of each neighborhood detail point pair according to the distance and angle difference between the two detail points of the neighborhood detail point pair and the corresponding interior angle value for each neighborhood detail point pair. 2. Contribution value.
  • the internal angle value is an angle value of an internal angle formed by two minutiae points of the neighborhood minutiae point pair and the matching minutiae point pair.
  • the third calculation unit is configured to calculate the contribution value of the matching minutiae point pair according to the first contribution value of the matching minutiae point pair and the second contribution values of all neighborhood minutiae point pairs.
  • the first contribution value of the matching detail point pair can be calculated by the following formula
  • sd is the first contribution value of the pair of matching minutiae points
  • Z(,,) is a sigmoid function
  • d i and ⁇ i are respectively the distance and angle difference between two minutiae points of i matching minutiae point pairs
  • i 1,2,...,N
  • N is the number of matching minutiae point pairs
  • ⁇ 1 , ⁇ 1 , ⁇ 2 , ⁇ 2 are the set parameters
  • the second contribution value of each neighborhood detail point pair is calculated by the following formula
  • pairscpre i is the contribution value of the ith matching minutiae point pair
  • np and nq are respectively the number of the first group of minutiae points and the number of the second group of minutiae points in the set neighborhood of the matching minutiae point ;
  • the application can calculate the matching score between the first fingerprint image and the second fingerprint image through the following formula:
  • N1 and N2 are the numbers of the first group of minutiae points and the number of the second group of minutiae points respectively.
  • the aforementioned rigid transformation modules include:
  • the center of gravity calculation unit is used to calculate the center of gravity of the first group of minutiae points of all matching minutiae point pairs.
  • the reference minutiae point pair selection unit is used to find out the first group of minutiae points closest to the center of gravity from the first group of minutiae points of all matching minutiae point pairs, and the matching minutiae to which the found first group of minutiae points belong point pair as the reference detail point pair.
  • the fourth calculation unit is used to calculate the angle difference ⁇ and the coordinate difference ⁇ x, ⁇ y of the two minutiae points of the reference minutiae point pair.
  • (x2, y2, ⁇ 2) are the coordinates and direction angles of the first group of minutiae points of the reference minutiae point pair
  • (x1, y1, ⁇ 1) are the coordinates of the second group of minutiae points of the reference minutiae point pair and orientation angle.
  • the transformation unit is configured to calculate the coordinates and direction angles of the second group of minutiae after rigid transformation according to the angle difference ⁇ and the coordinate difference ⁇ x, ⁇ y between the two minutiae of the reference minutiae point pair.
  • (x, y, ⁇ ) are the coordinates and orientation angles of the second group of minutiae points before rigid transformation
  • (x′, y′, ⁇ ′) are the coordinates and orientation angles of the second group of minutiae points after rigid transformation.
  • the device of the present application may also include:
  • a comparison module configured to obtain a fingerprint comparison result according to the matching score between the first fingerprint image and the second fingerprint image.
  • Embodiment 6 is a diagrammatic representation of Embodiment 6
  • FIG. 16 Another embodiment of the present application provides a fingerprint comparison device, as shown in Figure 16, the device includes:
  • the data preparation module 1b is used to acquire the first group of minutiae points of the first fingerprint image and the second group of minutiae points of the second fingerprint image.
  • the data acquisition module 2 in Embodiment 4 may include a 2-nearest neighbor structure representation calculation module 2b, a local similarity matrix calculation module 3b, and a matching pair determination module 4b.
  • the 2-nearest neighbor structure representation calculation module 2b is configured to calculate the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points.
  • the local similarity matrix calculation module 3b is used to calculate the first group of minutiae points according to the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points and the local similarity matrix of the second set of minutiae points.
  • the matching pair determination module 4b is configured to select several elements from the local similarity matrix in descending order, and obtain two minutiae points corresponding to each selected element as a matching pair.
  • the intermediate value calculation module 3 in Embodiment 4 may include a matching deterministic similarity matrix calculation module 5b.
  • Matching certainty similarity matrix calculation module 5b for each matching pair, calculate the matching certainty of the matching pair according to the distance difference and angle difference between the local similarity matrix and the two minutiae points of the matching pair similarity matrix.
  • the matching deterministic similarity matrix is the median similarity value described in Embodiment 4.
  • the matching score calculation module 6b is used to select the matching detail point pairs of each matching deterministic similarity matrix and calculate the matching score of each matching deterministic similarity matrix; and calculate the total matching score according to all matching scores.
  • the matching certainty similarity matrix of each matching pair is calculated by the following formula:
  • the matching pair includes the a-th minutiae point in the first group of minutiae points and the b-th minutiae point in the second group of minutiae points
  • sl(i,j) is the element of row i, column j of the local similarity matrix
  • d, ⁇ , ⁇ are three-dimensional the absolute value of the three elements of vector v0
  • the embodiment of the present application improves the calculation method of the matching deterministic similarity matrix, and combines the distance difference and angle difference information and the information related to the bounding box to calculate the matching deterministic similarity value, which can better measure the relationship between two detail points similarity, and help to select better matching detail point pairs.
  • the test results on the test set have been greatly improved, and the evaluation indicators such as the equal error rate have been reduced.
  • the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae is calculated by the following formula:
  • Fl i is the 2-nearest neighbor structure representation of the i-th minutiae F i in the first group of minutiae points
  • p and q are the two minutiae points F p and F q closest to the i-th minutiae F i respectively serial number, t l , (x l ,y l ) and Respectively, the type, coordinates and angle of the lth detail point F i , l takes i, p, q;
  • n ip is the number of ridge lines on the line between the i-th detail point and the p-th detail point in the first group of detail points
  • n iq is the i-th detail point and the q-th detail point in the first group of detail points The number of ridges on the connection;
  • d ⁇ (t 1 ,t 2 ) is the angle difference function, which is defined as:
  • the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points is calculated by the following formula:
  • Gl j is the 2-nearest neighbor structure representation of the jth minutiae G j in the second group of minutiae points
  • m and n are the two minutiae points G m and G n closest to the jth minutiae G j respectively serial number, t h , (x h ,y h ) and Respectively, the type, coordinates and angle of the hth detail point G h , where h takes j, m, n;
  • n jm is the number of ridge lines on the line between the jth minutiae point and the mth minutiae point in the second group of minutiae points
  • n jn is the jth minutiae point and the nth minutiae point in the second group of minutiae points The number of ridges on the link.
  • the local similarity matrix is calculated by the following formula:
  • A is the dot product of the weighting coefficient vector W and the vector V;
  • the matching score calculation module includes:
  • the matching detail point pair determination unit is used for each matching deterministic similarity matrix, if the element ml(i, j) in the i-th row and j-th column is not the maximum value in its i-th row or not its j-th column The maximum value in , set ml(i,j) to 0.
  • the matching score calculation unit is used to calculate the matching score s of each matching certainty similarity matrix by the following formula:
  • the comparison result determination module is used to obtain the fingerprint comparison result according to the total matching score.
  • Each module in the above-mentioned device can be fully or partially realized by software, hardware and a combination thereof.
  • the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules.
  • Embodiment 7 is a diagrammatic representation of Embodiment 7:
  • the methods described in the above-mentioned embodiments 1-3 provided by this application can implement business logic through computer programs and record them on storage media, and the storage media can be read and executed by computers to realize the methods described in embodiments 1-3 of this specification. Describe the effects of the program. Therefore, the present application also provides a computer-readable storage medium for fingerprint comparison, including a memory for storing processor-executable instructions. When the instructions are executed by the processor, the steps of the fingerprint comparison method of Embodiments 1-3 are realized. .
  • the present application calculates the contribution value of a matching minutiae pair, it is not only calculated based on the two minutiae points of the matching minutiae point pair, but also calculated based on the neighborhood minutiae point pair within the neighborhood of the matching minutiae point pair, fully Utilizing the useful information contained in the matching minutiae point itself and within a certain range around it, the similarity of two fingerprint images is well evaluated, and the accuracy of fingerprint comparison is improved.
  • the present application improves the calculation method of the matching deterministic similarity matrix, and combines the distance difference and angle difference information and the information related to the bounding box to calculate the matching deterministic similarity value, which can better measure the two
  • the similarity between minutiae points helps to select better matching minutiae pairs.
  • the test results on the test set have been greatly improved, and the evaluation indicators such as the equal error rate have been reduced.
  • the storage medium may include a physical device for storing information, and information is usually digitized and then stored using an electrical, magnetic, or optical medium. Described storage medium can include: the device that utilizes electric energy mode to store information such as, various memory, as RAM, ROM etc.; USB stick; a device that stores information optically, such as a CD or DVD. Of course, there are other readable storage media, such as quantum memory, graphene memory and so on.
  • the above-mentioned storage medium may also include other implementations according to the descriptions of method embodiments 1-3.
  • the implementation principle and technical effects of this embodiment are the same as those of the aforementioned method embodiments 1-3.
  • Embodiment 8 is a diagrammatic representation of Embodiment 8
  • the present application also provides a device for fingerprint comparison, which may be a separate computer, or may include the actual operation of using one or more of the methods described in this specification or one or more embodiments of the device device etc.
  • the device for fingerprint comparison may include at least one processor and a memory storing computer-executable instructions. When the processor executes the instructions, the steps of the fingerprint comparison method described in any one or more of the above-mentioned embodiments 1-3 are implemented. .
  • the contribution value of a matching minutiae pair when calculating the contribution value of a matching minutiae pair, it is not only calculated based on the two minutiae points of the matching minutiae point pair, but also calculated based on the neighborhood minutiae point pair within the neighborhood of the matching minutiae point pair, making full use of
  • the useful information contained in the matching minutiae within a certain range of itself and its surroundings can be used to evaluate the similarity of two fingerprint images and improve the accuracy of fingerprint comparison.
  • the calculation method of the matching deterministic similarity matrix is improved, and the distance difference and angle difference information and the information related to the limited box are fused to calculate the matching deterministic similarity value, which can better measure the two details The similarity between points, and helps to select a better pair of matching minutiae points.
  • the test results on the test set have been greatly improved, and the evaluation indicators such as the equal error rate have been reduced.
  • the above-mentioned equipment can also include other implementations according to the descriptions of method embodiments 1-3.
  • the implementation principle and technical effects of this embodiment are the same as those of the aforementioned method embodiments 1-3.
  • please refer to related method embodiments The descriptions of 1-3 will not be repeated here.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Collating Specific Patterns (AREA)

Abstract

The present application discloses a fingerprint comparison method and apparatus, a storage medium, and a device, relating to the field of fingerprint recognition. The method comprises: acquiring a first group of minutiae of a first fingerprint image and a second group of minutiae of a second fingerprint image; acquiring matching minutiae pairs of the first group of minutiae and the second group of minutiae; for each matching minutiae pair, calculating a similarity median of the each matching minutiae pair according to a distance and an angle difference between the two minutiae of the each matching minutiae pair and neighborhood minutiae information; and calculating a matching score of the first fingerprint image and the second fingerprint image according to the similarity median of the each matching minutiae pair.

Description

指纹比对方法、装置、存储介质及设备Fingerprint comparison method, device, storage medium and equipment
相关申请related application
本申请要求于2021年12月27日提交中国专利局的申请号为202111612355.2、名称为“指纹比对方法、装置、存储介质及设备”的中国专利申请,以及于2022年01月22日提交中国专利局的申请号为202210075001.7、名称为“指纹比对方法、装置、存储介质及设备”的中国专利申请的优先权,前述两件专利的全部内容通过引用结合在本申请中。This application requires that the Chinese patent application with the application number 202111612355.2 and the name "fingerprint comparison method, device, storage medium and equipment" be submitted to the China Patent Office on December 27, 2021, and the Chinese patent application filed on January 22, 2022. The patent office's application number is 202210075001.7, and the title is "fingerprint comparison method, device, storage medium and equipment". The entire content of the aforementioned two patents is incorporated in this application by reference.
技术领域technical field
本申请涉及指纹识别领域,特别是指一种指纹比对方法、装置、存储介质及设备。The present application relates to the field of fingerprint identification, in particular to a fingerprint comparison method, device, storage medium and equipment.
背景技术Background technique
指纹识别技术是目前生物特征识别领域应用中最为成熟和普遍的技术之一。指纹由手指表面上交错的脊线和谷线组成。因为指纹的采集过程方便、硬件成本低廉、性能可靠和使用方便,目前已广泛应用在身份鉴定、访问控制等很多方面,比如手机解锁、门禁设备、办身份证时的指纹采集、出入境中的快速通关系统等。Fingerprint identification technology is one of the most mature and common technologies in the field of biometric identification. Fingerprints are made up of alternating ridges and valleys on the surface of the finger. Because of the convenient fingerprint collection process, low hardware cost, reliable performance and convenient use, it has been widely used in many aspects such as identity verification and access control, such as mobile phone unlocking, access control equipment, fingerprint collection when applying for ID cards, and entry and exit. Fast pass system, etc.
发明内容Contents of the invention
第一方面,本申请提供一种指纹比对方法,所述方法包括:In a first aspect, the present application provides a fingerprint comparison method, the method comprising:
获取第一张指纹图像的第一组细节点和第二张指纹图像的第二组细节点;Obtain the first set of minutiae points of the first fingerprint image and the second set of minutiae points of the second fingerprint image;
获取第一组细节点和第二组细节点的匹配细节点对;Obtain the matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points;
针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值;以及For each matching minutiae point pair, calculate the median similarity value of the matching minutiae point pair according to the distance and angle difference between two minutiae points of the matching minutiae point pair and the neighborhood minutiae point information; and
根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数。Calculate the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each matching pair of minutiae points.
在一些实施例中,所述针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值;以及根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数,包括:In some embodiments, for each matching minutiae point pair, the distance and angle difference between two minutiae points of the matching minutiae point pair and the neighborhood minutiae point information are used to calculate the matching minutiae point pair Similarity median value; and according to the similarity median value of each minutiae matching pair, calculate the matching score of the first fingerprint image and the second fingerprint image, including:
选取一个匹配细节点对作为基准细节点对,并对第二组细节点中的所有细节点均做使得所述基准细节点对的两个细节点重合的刚性变换;Selecting a matching minutiae point pair as a reference minutiae point pair, and performing a rigid transformation on all minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincide;
对每一个匹配细节点对,根据所述匹配细节点对以及对应的邻域细节点对计算所述匹配细节点对的贡献数值,其中,所述贡献数值为所述相似度中间值;For each matching minutiae point pair, calculate the contribution value of the matching minutiae point pair according to the matching minutiae point pair and the corresponding neighborhood minutiae point pair, wherein the contribution value is the median value of the similarity;
其中,所述邻域细节点对为所述匹配细节点对设定邻域范围内的所有匹配细节点对;Wherein, the neighborhood minutiae point pair sets all matching minutiae point pairs within the neighborhood range for the matching minutiae point pair;
根据所有匹配细节点对的贡献数值计算所述第一张指纹图像与所述第二张指纹图像之间的匹配分数。The matching score between the first fingerprint image and the second fingerprint image is calculated according to the contribution values of all matching minutiae point pairs.
进一步的,所述对每一个匹配细节点对,根据所述匹配细节点对以及对应的邻域细节点对计算所述匹配细节点对的贡献数值,包括:Further, for each matching detail point pair, calculating the contribution value of the matching detail point pair according to the matching detail point pair and the corresponding neighborhood detail point pair includes:
根据所述匹配细节点对的两个细节点的距离和角度差计算所述匹配细节点对的第一贡献数值;calculating the first contribution value of the matching minutiae point pair according to the distance and angle difference between two minutiae points of the matching minutiae point pair;
对所述匹配细节点对设定邻域范围内的每个邻域细节点对的第二组细节点均做使得所述匹配细节点对的两个细节点重合的刚性变换;performing a rigid transformation on the second group of minutiae points of each neighborhood minutiae point pair within the set neighborhood range of the matching minutiae point pair so that the two minutiae points of the matching minutiae point pair coincide;
对每一个邻域细节点对,根据所述邻域细节点对的两个细节点的距离和角度差,以及对应的内角值计算每个邻域细节点对的第二贡献数值;For each neighborhood minutiae point pair, calculate the second contribution value of each neighborhood minutiae point pair according to the distance and angle difference between the two minutiae points of the neighborhood minutiae point pair, and the corresponding interior angle value;
其中,所述内角值为所述邻域细节点对的两个细节点与所述匹配细节点对形成的内角的角度值;Wherein, the inner angle value is an angle value of an inner angle formed by two minutiae points of the neighborhood minutiae point pair and the matching minutiae point pair;
根据所述匹配细节点对的第一贡献数值和所有邻域细节点对的第二贡献数值计算所述匹配细节点对的贡献数值。The contribution value of the matching minutiae point pair is calculated according to the first contribution value of the matching minutiae point pair and the second contribution values of all neighborhood minutiae point pairs.
进一步的,通过如下公式计算所述匹配细节点对的第一贡献数值;Further, the first contribution value of the matching minutiae point pair is calculated by the following formula;
sd=Z(d i11)*Z(Δθ i22) sd=Z(d i11 )*Z(Δθ i22 )
其中,sd为所述匹配细节点对的第一贡献数值,Z(,,)为sigmoid函数,d i和Δθ i分别为i个匹配细节点对的两个细节点的距离和角度差,i=1,2,…,N,N为匹配细节点对的个数,μ 1122为设定的参数; Wherein, sd is the first contribution value of the pair of matching minutiae points, Z(,,) is a sigmoid function, d i and Δθ i are respectively the distance and angle difference between two minutiae points of i matching minutiae point pairs, i =1,2,...,N, N is the number of matching minutiae point pairs, μ 1 , τ 1 , μ 2 , τ 2 are the set parameters;
通过如下公式计算每个邻域细节点对的第二贡献数值;The second contribution value of each neighborhood detail point pair is calculated by the following formula;
其中,sn j为第j个邻域细节点对的第二贡献数值,j=1,2,…,M,M为所述匹配细节点对设定邻域范围内的邻 域细节点对的个数,sn j=Z(d j11)*Z(Δθ j22)*Z(α j33),d j和Δθ j分别为第j个邻域细节点对的两个细节点的距离和角度差,α j为第j个邻域细节点对的两个细节点与所述匹配细节点对形成的内角的角度值,μ 33为设定的参数; Among them, sn j is the second contribution value of the jth neighborhood detail point pair, j=1, 2,..., M, M is the neighborhood detail point pair within the neighborhood range of the matching detail point pair number, sn j = Z(d j11 )*Z(Δθ j22 )*Z(α j33 ), d j and Δθ j are respectively The distance and angle difference between the two minutiae points of the j neighborhood minutiae point pair, α j is the angle value of the interior angle formed by the two minutiae points of the jth neighborhood minutiae point pair and the matching minutiae point pair, μ 3 , τ 3 is the set parameter;
通过如下公式计算所述匹配细节点对的贡献数值;Calculate the contribution value of the matching detail point pair by the following formula;
Figure PCTCN2022135830-appb-000001
Figure PCTCN2022135830-appb-000001
其中,pairscore i为第i个匹配细节点对的贡献数值,np和nq分别为所述匹配细节点对设定邻域范围内第一组细节点的个数和第二组细节点的个数; Among them, pairscore i is the contribution value of the i-th matching minutiae point pair, np and nq are respectively the number of the first group of minutiae points and the number of the second group of minutiae points within the set neighborhood of the matching minutiae point ;
Figure PCTCN2022135830-appb-000002
Figure PCTCN2022135830-appb-000002
.
进一步的,通过如下公式计算所述第一张指纹图像与所述第二张指纹图像之间的匹配分数:Further, the matching score between the first fingerprint image and the second fingerprint image is calculated by the following formula:
Figure PCTCN2022135830-appb-000003
Figure PCTCN2022135830-appb-000003
其中,s为所述第一张指纹图像与所述第二张指纹图像之间的匹配分数,N1和N2分别为第一组细节点的个数和第二组细节点的个数。Wherein, s is the matching score between the first fingerprint image and the second fingerprint image, N1 and N2 are the numbers of the first group of minutiae points and the number of the second group of minutiae points respectively.
进一步的,所述选取一个匹配细节点对作为基准细节点对,包括:Further, the selection of a matching minutiae point pair as a reference minutiae point pair includes:
计算所有匹配细节点对的第一组细节点的重心;Calculate the center of gravity of the first set of minutiae points of all matching minutiae point pairs;
从所有匹配细节点对的第一组细节点中找出距离所述重心最近的一个第一组细节点,将找出的第一组细节点所属的匹配细节点对作为所述基准细节点对。Find a first group of minutiae points closest to the center of gravity from the first group of minutiae points of all matching minutiae point pairs, and use the matching minutiae point pair to which the found first group of minutiae points belong as the reference minutiae point pair .
进一步的,所述对第二组细节点中的所有细节点均做使得所述基准细节点对的两个细节点重合的刚性变换,包括:Further, performing a rigid transformation on all the minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincides, including:
计算所述基准细节点对的两个细节点的角度差Δθ和坐标差Δx,Δy;Calculate the angle difference Δθ and the coordinate difference Δx, Δy of the two minutiae points of the reference minutiae point pair;
Δθ=θ2-θ1Δθ=θ2-θ1
Figure PCTCN2022135830-appb-000004
Figure PCTCN2022135830-appb-000004
其中,(x2,y2,θ2)为所述基准细节点对的第一组细节点的坐标和方向角,(x1,y1,θ1)为所述基准细节点对的第二组细节点的坐标和方向角;Among them, (x2, y2, θ2) are the coordinates and direction angles of the first group of minutiae points of the reference minutiae point pair, and (x1, y1, θ1) are the coordinates of the second group of minutiae points of the reference minutiae point pair and orientation angle;
根据所述基准细节点对的两个细节的角度差Δθ和坐标差Δx,Δy计算刚性变换后第二组细节点的坐标和方向角;Calculate the coordinates and orientation angles of the second group of minutiae points after the rigid transformation according to the angle difference Δθ and the coordinate difference Δx, Δy of the two details of the reference minutiae point pair;
Figure PCTCN2022135830-appb-000005
Figure PCTCN2022135830-appb-000005
θ′=θ-Δθθ'=θ-Δθ
其中,(x,y,θ)为刚性变换前第二组细节点的坐标和方向角,(x′,y′,θ′)为刚性变换后第二组细节点的坐标和方向角。Among them, (x, y, θ) are the coordinates and orientation angles of the second group of minutiae points before rigid transformation, and (x′, y′, θ′) are the coordinates and orientation angles of the second group of minutiae points after rigid transformation.
进一步的,所述方法还包括:Further, the method also includes:
根据所述第一张指纹图像与所述第二张指纹图像之间的匹配分数得到指纹比对结果。A fingerprint comparison result is obtained according to the matching score between the first fingerprint image and the second fingerprint image.
在一些实施例中,所述获取第一组细节点和第二组细节点的匹配细节点对包括:In some embodiments, the obtaining the matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points includes:
计算所述第一组细节点中每个细节点的2-近邻结构表示和所述第二组细节点中每个细节点的2-近邻结构表示;calculating a 2-nearest neighbor structure representation of each minutiae in the first set of minutiae points and a 2-nearest neighbor structure representation of each minutiae point in the second set of minutiae points;
根据所述第一组细节点中每个细节点的2-近邻结构表示和所述第二组细节点中每个细节点的2-近邻结构表示计算第一组细节点和第二组细节点的局部相似度矩阵;Calculate the first group of minutiae points and the second group of minutiae points according to the 2-nearest neighbor structure representation of each minutiae point in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points The local similarity matrix of ;
按照从大到小的顺序从所述局部相似度矩阵中选取若干个元素,并获取选取的每个元素对应的两个细节点作为匹配对。Select several elements from the local similarity matrix in descending order, and obtain two minutiae points corresponding to each selected element as a matching pair.
在一些实施例中,所述针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值;以及根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数,包括:In some embodiments, for each matching minutiae point pair, the distance and angle difference between two minutiae points of the matching minutiae point pair and the neighborhood minutiae point information are used to calculate the matching minutiae point pair Similarity median value; and according to the similarity median value of each minutiae matching pair, calculate the matching score of the first fingerprint image and the second fingerprint image, including:
对每个匹配对,根据所述局部相似度矩阵和所述匹配对的两个细节点之间的距离差和角度差计算所述匹配对的匹配确定性相似度矩阵,其中,所述匹配确定性相似度矩阵为所述相似度中间值;以及For each matching pair, calculate the matching certainty similarity matrix of the matching pair according to the local similarity matrix and the distance difference and angle difference between two minutiae points of the matching pair, wherein the matching determination The sexual similarity matrix is the median value of the similarity; and
选取每个匹配确定性相似度矩阵的匹配细节点对并计算每个匹配确定性相似度矩阵的匹配分数;并根据所有匹配分数计算计算总匹配分数。Select the matching detail point pairs of each matching deterministic similarity matrix and calculate the matching score of each matching deterministic similarity matrix; and calculate the total matching score according to all matching scores.
进一步地,通过如下公式计算每个匹配对的匹配确定性相似度矩阵:Further, the matching certainty similarity matrix of each matching pair is calculated by the following formula:
Figure PCTCN2022135830-appb-000006
Figure PCTCN2022135830-appb-000006
其中,所述匹配对包括第一组细节点中的第a个细节点和第二组细节点中的第b个细节点,ml(i,j)为所述匹配确定性相似度矩阵第i行第j列的元素,i=1,2,…,M,j=1,2,…,N,sl(i,j)为所述局部相似度矩阵第i行第j列的元素,d,α,β为三维向量v0的三个元素的绝对值,
Figure PCTCN2022135830-appb-000007
为以第一组细节点中的第a个细节点为参照对第一组细节点中的第i个细节点进行极坐标运算得到的特征向量,
Figure PCTCN2022135830-appb-000008
为以第二组细节点中的第b个细节点为参照对第二组细节点中的第j个细节点进行极坐标运算得到的特征向量。
Wherein, the matching pair includes the a-th minutiae point in the first group of minutiae points and the b-th minutiae point in the second group of minutiae points, ml(i,j) is the i-th minutiae of the matching certainty similarity matrix The element in the jth column of the row, i=1, 2,..., M, j=1, 2,..., N, sl(i, j) is the element in the jth row of the local similarity matrix, d , α, β are the absolute values of the three elements of the three-dimensional vector v0,
Figure PCTCN2022135830-appb-000007
is the eigenvector obtained by performing the polar coordinate operation on the i-th minutiae point in the first group of minutiae points with reference to the a-th minutiae point in the first group of minutiae points,
Figure PCTCN2022135830-appb-000008
is a feature vector obtained by performing polar coordinate operation on the jth minutiae point in the second group of minutiae points with reference to the bth minutiae point in the second group of minutiae points.
进一步地,通过如下公式计算所述第一组细节点中每个细节点的2-近邻结构表示:Further, the 2-nearest neighbor structure representation of each minutiae point in the first group of minutiae points is calculated by the following formula:
Figure PCTCN2022135830-appb-000009
Figure PCTCN2022135830-appb-000009
其中,Fl i为第一组细节点中第i个细节点F i的2-近邻结构表示,p和q分别为与第i个细节点F i最近的两个细节点F p和F q的编号,
Figure PCTCN2022135830-appb-000010
t l、(x l,y l)和
Figure PCTCN2022135830-appb-000011
分别为第l个细节点F i的类型、坐标和角度,l取i,p,q;
Among them, Fl i is the 2-nearest neighbor structure representation of the i-th minutiae F i in the first group of minutiae points, p and q are the two minutiae points F p and F q closest to the i-th minutiae F i respectively serial number,
Figure PCTCN2022135830-appb-000010
t l , (x l ,y l ) and
Figure PCTCN2022135830-appb-000011
Respectively, the type, coordinates and angle of the lth detail point F i , l takes i, p, q;
Figure PCTCN2022135830-appb-000012
Figure PCTCN2022135830-appb-000012
Figure PCTCN2022135830-appb-000013
Figure PCTCN2022135830-appb-000013
Figure PCTCN2022135830-appb-000014
Figure PCTCN2022135830-appb-000014
Figure PCTCN2022135830-appb-000015
Figure PCTCN2022135830-appb-000015
Figure PCTCN2022135830-appb-000016
Figure PCTCN2022135830-appb-000016
Figure PCTCN2022135830-appb-000017
Figure PCTCN2022135830-appb-000017
n ip为第一组细节点中第i个细节点和第p个细节点连线上的脊线的条数,n iq为第一组细节点中第i个细节点和第q个细节点连线上的脊线的条数; n ip is the number of ridge lines on the line between the i-th detail point and the p-th detail point in the first group of detail points, and n iq is the i-th detail point and the q-th detail point in the first group of detail points The number of ridges on the connection;
dφ(t 1,t 2)为角度差函数,其定义为: dφ(t 1 ,t 2 ) is the angle difference function, which is defined as:
Figure PCTCN2022135830-appb-000018
Figure PCTCN2022135830-appb-000018
通过如下公式计算所述第二组细节点中每个细节点的2-近邻结构表示:Calculate the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points by the following formula:
Figure PCTCN2022135830-appb-000019
Figure PCTCN2022135830-appb-000019
其中,Gl j为第二组细节点中第j个细节点G j的2-近邻结构表示,m和n分别为与第j个细节点G j最近的两个细节点G m和G n的编号,
Figure PCTCN2022135830-appb-000020
t h、(x h,y h)和
Figure PCTCN2022135830-appb-000021
分别为第h个细节点G h的类型、坐标和角度,h取j,m,n;
Among them, Gl j is the 2-nearest neighbor structure representation of the jth minutiae G j in the second group of minutiae points, m and n are the two minutiae points G m and G n closest to the jth minutiae G j respectively serial number,
Figure PCTCN2022135830-appb-000020
t h , (x h ,y h ) and
Figure PCTCN2022135830-appb-000021
Respectively, the type, coordinates and angle of the hth detail point G h , where h takes j, m, n;
Figure PCTCN2022135830-appb-000022
Figure PCTCN2022135830-appb-000022
Figure PCTCN2022135830-appb-000023
Figure PCTCN2022135830-appb-000023
Figure PCTCN2022135830-appb-000024
Figure PCTCN2022135830-appb-000024
Figure PCTCN2022135830-appb-000025
Figure PCTCN2022135830-appb-000025
Figure PCTCN2022135830-appb-000026
Figure PCTCN2022135830-appb-000026
Figure PCTCN2022135830-appb-000027
Figure PCTCN2022135830-appb-000027
n jm为第二组细节点中第j个细节点和第m个细节点连线上的脊线的条数,n jn为第二组细节点中第j个细节点和第n个细节点连线上的脊线的条数。 n jm is the number of ridge lines on the line between the jth minutiae point and the mth minutiae point in the second group of minutiae points, and n jn is the jth minutiae point and the nth minutiae point in the second group of minutiae points The number of ridges on the link.
进一步地,通过如下公式计算所述局部相似度矩阵:Further, the local similarity matrix is calculated by the following formula:
Figure PCTCN2022135830-appb-000028
Figure PCTCN2022135830-appb-000028
其中,A为加权系数向量W与向量V的点积;Among them, A is the dot product of the weighting coefficient vector W and the vector V;
Figure PCTCN2022135830-appb-000029
w d=1,w θ=0.3*180/π,
Figure PCTCN2022135830-appb-000030
w n=3,w t=3,V=|V0|,V0=Fl i-Gl i
Figure PCTCN2022135830-appb-000029
w d =1,w θ =0.3*180/π,
Figure PCTCN2022135830-appb-000030
w n =3, w t =3, V=|V0|, V0=Fl i -Gl i .
进一步地,通过如下公式计算特征向量
Figure PCTCN2022135830-appb-000031
Figure PCTCN2022135830-appb-000032
Further, the eigenvectors are calculated by the following formula
Figure PCTCN2022135830-appb-000031
and
Figure PCTCN2022135830-appb-000032
Figure PCTCN2022135830-appb-000033
Figure PCTCN2022135830-appb-000033
Figure PCTCN2022135830-appb-000034
Figure PCTCN2022135830-appb-000034
其中,(x a,y a)和
Figure PCTCN2022135830-appb-000035
分别为第一组细节点中的第a个细节点的坐标和角度,(x b,y b)和
Figure PCTCN2022135830-appb-000036
分别为第二组细节点中的第b个细节点的坐标和角度。
Among them, (x a ,y a ) and
Figure PCTCN2022135830-appb-000035
are respectively the coordinates and angles of the ath minutiae point in the first group of minutiae points, (x b , y b ) and
Figure PCTCN2022135830-appb-000036
are the coordinates and angles of the bth minutiae point in the second group of minutiae points, respectively.
进一步地,所述选取每个匹配确定性相似度矩阵的匹配细节点对并计算每个匹配确定性相似度矩阵的匹配分数,包括:Further, the selecting matching detail point pairs of each matching deterministic similarity matrix and calculating the matching score of each matching deterministic similarity matrix includes:
对于每个匹配确定性相似度矩阵,若其第i行第j列的元素ml(i,j)不是其第i行中的最大值或者不是其第j列中的最大值,则将ml(i,j)置为0;For each matching deterministic similarity matrix, if the element ml(i,j) in the i-th row and j-th column is not the maximum value in its i-th row or not the maximum value in its j-th column, then ml( i, j) is set to 0;
通过如下公式计算每个匹配确定性相似度矩阵的匹配分数s:The matching score s of each matching deterministic similarity matrix is calculated by the following formula:
Figure PCTCN2022135830-appb-000037
Figure PCTCN2022135830-appb-000037
进一步地,所述方法还包括:Further, the method also includes:
在根据所有匹配分数计算计算总匹配分数之后,根据所述总匹配分数得到指纹比对结果。After the total matching score is calculated according to all the matching scores, the fingerprint comparison result is obtained according to the total matching score.
第二方面,本申请提供一种指纹比对装置,所述装置包括:In a second aspect, the present application provides a fingerprint comparison device, the device comprising:
数据准备模块,用于获取第一张指纹图像的第一组细节点和第二张指纹图像的第二组细节点;The data preparation module is used to obtain the first group of minutiae points of the first fingerprint image and the second group of minutiae points of the second fingerprint image;
获取模块,用于获取第一组细节点和第二组细节点的匹配细节点对;An acquisition module, configured to acquire the matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points;
中间值计算模块,用于针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值;以及An intermediate value calculation module, for each matching detail point pair, according to the distance and angle difference between two detail points of the matching detail point pair, and the neighborhood detail point information to calculate the similarity of the matching detail point pair degree median; and
匹配分数计算模块,用于根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数。A matching score calculation module, configured to calculate a matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each matching pair of minutiae points.
在一些实施例中,所述中间值计算模块包括刚性变换模块和贡献数值计算模块:In some embodiments, the intermediate value calculation module includes a rigid transformation module and a contribution value calculation module:
所述刚性变换模块,用于选取一个匹配细节点对作为基准细节点对,并对第二组细节点中的所有细节点均做使得所述基准细节点对的两个细节点重合的刚性变换;The rigid transformation module is configured to select a matching minutiae point pair as a reference minutiae point pair, and perform a rigid transformation on all minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincide ;
所述贡献数值计算模块,用于对每一个匹配细节点对,根据所述匹配细节点对以及对应的邻域细节点对计算所述匹配细节点对的贡献数值;The contribution value calculation module is used to calculate the contribution value of the matching detail point pair according to the matching detail point pair and the corresponding neighborhood detail point pair for each matching detail point pair;
其中,所述邻域细节点对为所述匹配细节点对设定邻域范围内的所有匹配细节点对;Wherein, the neighborhood minutiae point pair sets all matching minutiae point pairs within the neighborhood range for the matching minutiae point pair;
所述匹配分数计算模块,用于根据所有匹配细节点对的贡献数值计算所述第一张指纹图像与所述第二张指纹图像之间的匹配分数。The matching score calculation module is used to calculate the matching score between the first fingerprint image and the second fingerprint image according to the contribution values of all matching minutiae point pairs.
在一些实施例中,所述获取模块包括2-近邻结构表示计算模块、局部相似度矩阵计算模块以及匹配对确定模块,所述中间值计算模块包括匹配确定性相似度矩阵计算模块:In some embodiments, the acquisition module includes a 2-nearest neighbor structure representation calculation module, a local similarity matrix calculation module, and a matching pair determination module, and the intermediate value calculation module includes a matching certainty similarity matrix calculation module:
所述2-近邻结构表示计算模块,用于计算所述第一组细节点中每个细节点的2-近邻结构表示和所述第二组细节 点中每个细节点的2-近邻结构表示;The 2-nearest neighbor structure representation calculation module is used to calculate the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points ;
所述局部相似度矩阵计算模块,用于根据所述第一组细节点中每个细节点的2-近邻结构表示和所述第二组细节点中每个细节点的2-近邻结构表示计算第一组细节点和第二组细节点的局部相似度矩阵;The local similarity matrix calculation module is used to calculate according to the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points The local similarity matrix of the first group of minutiae points and the second group of minutiae points;
所述匹配对确定模块,用于按照从大到小的顺序从所述局部相似度矩阵中选取若干个元素,并获取选取的每个元素对应的两个细节点作为匹配细节点对;The matching pair determination module is configured to select several elements from the local similarity matrix in descending order, and obtain two minutiae points corresponding to each selected element as a matching minutiae point pair;
所述匹配确定性相似度矩阵计算模块,对每个匹配对,根据所述局部相似度矩阵和所述匹配对的两个细节点之间的距离差和角度差计算所述匹配对的匹配确定性相似度矩阵;The matching deterministic similarity matrix calculation module, for each matching pair, calculates the matching determination of the matching pair according to the distance difference and angle difference between the local similarity matrix and the two minutiae points of the matching pair sex similarity matrix;
所述匹配分数计算模块,用于选取每个匹配确定性相似度矩阵的匹配细节点对并计算每个匹配确定性相似度矩阵的匹配分数;并根据所有匹配分数计算计算总匹配分数。The matching score calculation module is used to select the matching detail point pairs of each matching deterministic similarity matrix and calculate the matching score of each matching deterministic similarity matrix; and calculate the total matching score according to all matching scores.
第三方面,本申请提供一种用于指纹比对的计算机可读存储介质,包括用于存储处理器可执行指令的存储器,所述指令被所述处理器执行时实现包括第一方面所述的指纹比对方法的步骤。In a third aspect, the present application provides a computer-readable storage medium for fingerprint comparison, including a memory for storing processor-executable instructions. The steps of the fingerprint comparison method.
第四方面,本申请提供一种用于指纹比对的设备,包括至少一个处理器以及存储计算机可执行指令的存储器,所述处理器执行所述指令时实现第一方面所述的指纹比对方法的步骤。In a fourth aspect, the present application provides a device for fingerprint comparison, including at least one processor and a memory storing computer-executable instructions, and the processor implements the fingerprint comparison described in the first aspect when executing the instructions method steps.
本申请的一个或多个实施例的细节在下面的附图和描述中提出。本申请的其他特征、目的和优点将从说明书、附图以及权利要求书变得明显。The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below. Other features, objects and advantages of the present application will be apparent from the description, drawings and claims.
附图说明Description of drawings
为了更好地描述和说明本申请的实施例,可参考一幅或多幅附图,但用于描述附图的附加细节或示例不应当被认为是对本申请的发明创造、目前所描述的实施例或优选方式中任何一者的范围的限制。In order to better describe and illustrate the embodiments of the application, reference may be made to one or more drawings, but additional details or examples used to describe the drawings should not be regarded as an invention of the application, the presently described implementation limitations on the scope of any of the examples or preferred modes.
图1为指纹上的终端点和分叉点的示例图;Fig. 1 is an example diagram of terminal points and bifurcation points on the fingerprint;
图2a为第一张指纹图像的一个示例图;Figure 2a is an example diagram of the first fingerprint image;
图2b为第二张指纹图像的一个示例图;Fig. 2b is an example diagram of the second fingerprint image;
图3a为第一张指纹图像及其第一组细节点的一个示例图;Figure 3a is an example diagram of the first fingerprint image and its first group of minutiae points;
图3b为第二张指纹图像及其第二组细节点的一个示例图;Figure 3b is an example diagram of the second fingerprint image and its second group of minutiae points;
图4为第一组细节点及其编号和第二组细节点及其编号的一个示例图;Fig. 4 is an example diagram of the first group of minutiae points and their numbers and the second group of minutiae points and their numbers;
图5为匹配细节点对连线的一个示例图;Fig. 5 is an example diagram of matching minutiae point-to-connection lines;
图6a和图6b为两个细节点相匹配的情形的示意图;Figure 6a and Figure 6b are schematic diagrams of the situation where two minutiae points match;
图7a和图7b为两个细节点不相匹配的情形的示意图;Figure 7a and Figure 7b are schematic diagrams of the situation where two minutiae do not match;
图8为本申请一实施例的指纹比对方法的流程图;FIG. 8 is a flowchart of a fingerprint comparison method according to an embodiment of the present application;
图9为本申请另一实施例的指纹比对方法的流程图;FIG. 9 is a flowchart of a fingerprint comparison method according to another embodiment of the present application;
图10为本申请一实施例中一个邻域细节点对的两个细节点与一个匹配细节点对形成的内角α j的示意图; 10 is a schematic diagram of an interior angle α j formed by two minutiae points of a neighborhood minutiae point pair and a matching minutiae point pair in an embodiment of the present application;
图11为本申请又一实施例的指纹比对方法的流程图;Fig. 11 is a flowchart of a fingerprint comparison method according to another embodiment of the present application;
图12为本申请一实施例中当限定盒存在两个可能与被匹配细节点相匹配的待匹配细节点的示意图;Fig. 12 is a schematic diagram of an embodiment of the present application when there are two minutiae points to be matched that may match the minutiae points to be matched in the limit box;
图13为本申请一实施例中第一组细节点中第i个细节点的2-近邻结构表示的示意图;13 is a schematic diagram of the 2-nearest neighbor structure representation of the i-th minutiae point in the first group of minutiae points in an embodiment of the present application;
图14为本申请一实施例中的指纹比对装置的示意图。FIG. 14 is a schematic diagram of a fingerprint matching device in an embodiment of the present application.
图15为本申请另一实施例中的指纹比对装置的示意图。FIG. 15 is a schematic diagram of a fingerprint matching device in another embodiment of the present application.
图16为本申请又一实施例中的指纹比对装置的示意图。Fig. 16 is a schematic diagram of a fingerprint matching device in another embodiment of the present application.
图17为本申请一实施例中用于指纹比对的设备的结构示意图。FIG. 17 is a schematic structural diagram of a device for fingerprint comparison in an embodiment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.
指纹识别技术主要包括指纹特征提取和指纹匹配两个算法过程。在提取的指纹特征中,最常用和最基本的特征是细节点(minutiae),细节点包括终端点和分叉点两种类型,这两种类型分别对应于脊线结束和一条脊线分为两条脊线的情形。如图1所示,圆圈处代表的是分叉点类型的细节点,方框处代表的是终端点类型的细节点。每个细节点 都可以用类型t、坐标(x,y)和角度
Figure PCTCN2022135830-appb-000038
组成的四维坐标(x,y,
Figure PCTCN2022135830-appb-000039
t)来表示。
Fingerprint recognition technology mainly includes two algorithmic processes of fingerprint feature extraction and fingerprint matching. Among the extracted fingerprint features, the most commonly used and basic features are minutiae, which include two types of terminal points and bifurcation points, which correspond to the end of a ridge line and the division of a ridge line into The case of two ridges. As shown in Figure 1, the circles represent the minutiae points of the bifurcation point type, and the boxes represent the minutiae points of the terminal point type. Each detail point can be specified with type t, coordinates (x, y) and angle
Figure PCTCN2022135830-appb-000038
Composed of four-dimensional coordinates (x, y,
Figure PCTCN2022135830-appb-000039
t) to represent.
目前,指纹细节点被公认为是指纹最具鉴别能力且最可靠的局部特征,细节点的局部结构对非线性形变、噪声等具有很好的适应能力。基于细节点的指纹匹配算法是指纹匹配算法研究中最主要的方法,其核心问题是找到相匹配的细节点对并依据某些规则计算出一个匹配分数或相似度数值。At present, fingerprint minutiae is recognized as the most discriminative and reliable local feature of fingerprints, and the local structure of minutiae has good adaptability to nonlinear deformation and noise. The fingerprint matching algorithm based on minutiae is the most important method in the research of fingerprint matching algorithm. Its core problem is to find the matching minutiae pair and calculate a matching score or similarity value according to certain rules.
将第一张指纹图像的细节点称为第一组细节点,第二张指纹图像的细节点称为第二组细节点。申请人在研究过程中发现,在一些相关技术中,基于细节点的指纹匹配算法的主要步骤为:计算每个细节点的局部描述子,计算第一组细节点和第二组细节点的每两个细节点的局部相似度,并通过设定的规则找到那些能配对的匹配细节点对,最后依据这些匹配细节点对的个数或者它们之间的匹配确定性相似度数值得出一个匹配分数。The minutiae points of the first fingerprint image are called the first group of minutiae points, and the minutiae points of the second fingerprint image are called the second group of minutiae points. During the research process, the applicant found that in some related technologies, the main steps of the minutiae-based fingerprint matching algorithm are: calculating the local descriptor of each minutiae, calculating each The local similarity of two minutiae points, and find those matching minutiae point pairs that can be matched through the set rules, and finally get a matching score based on the number of these matching minutiae point pairs or the matching certainty similarity value between them .
例如,图2a和图2b分别给出了第一张指纹图像和第二张指纹图像的一个示例。其中图2a为第一张指纹图像,图2b为第二张指纹图像,第一张指纹图像和第二张指纹图像来自同一指纹。两者的细节点分别如图3a和图3b所示,其中图3a为第一张指纹图像及其第一组细节点,图3b为第二张指纹图像及其第二组细节点。给每个细节点进行如图4所示的编号,图4中左侧为第一组细节点(共50个),右侧为第二组细节点(共38个)。利用算法得到的匹配细节点对有36对,用连线将匹配细节点对标记出来,如图5所示。For example, Fig. 2a and Fig. 2b respectively give an example of the first fingerprint image and the second fingerprint image. Figure 2a is the first fingerprint image, Figure 2b is the second fingerprint image, the first fingerprint image and the second fingerprint image are from the same fingerprint. The minutiae points of the two are shown in Figure 3a and Figure 3b respectively, where Figure 3a is the first fingerprint image and its first group of minutiae points, and Figure 3b is the second fingerprint image and its second group of minutiae points. Each detail point is numbered as shown in Figure 4, the left side of Figure 4 is the first group of detail points (50 in total), and the right side is the second group of detail points (38 in total). There are 36 pairs of matching detail points obtained by using the algorithm, and the matching detail point pairs are marked with connecting lines, as shown in Figure 5.
找到匹配细节点对之后,即可根据匹配细节点对计算匹配分数,假设第一组细节点的细节点个数为N1,第二组细节点的细节点个数为N2,匹配细节点对的个数为N(即有N对细节点相配对),则相关技术中计算匹配分数s的公式大体有如下几种:After the matching detail point pair is found, the matching score can be calculated according to the matching detail point pair. Assume that the number of detail points in the first group of detail points is N1, and the number of detail points in the second group of detail points is N2. The number is N (that is, there are N pairs of minutiae points matched), then the formula for calculating the matching score s in the related art generally has the following types:
Figure PCTCN2022135830-appb-000040
Figure PCTCN2022135830-appb-000040
Figure PCTCN2022135830-appb-000041
Figure PCTCN2022135830-appb-000041
Figure PCTCN2022135830-appb-000042
Figure PCTCN2022135830-appb-000042
有研究指出,如果存在13个"完全"能配对的匹配细节点对,则说明参与比对的两个指纹图像来源于同一个指纹,但这里的"完全"是专家人为表示的,很难通过具体的度量来表达的一个概念。申请人经实验发现,非同一手指的两个指纹也能达到13个甚至29个匹配细节点对,而同一手指的两个指纹因为重合区域过小质量差等原因只有8个匹配细节点对,所以由于匹配细节点对判断标准的不同,只是根据匹配细节点对的个数或者它们的相似度不能很好的评价两个指纹图像的相似程度。Some studies have pointed out that if there are 13 "completely" matching detail point pairs, it means that the two fingerprint images participating in the comparison come from the same fingerprint, but the "completely" here is artificially expressed by experts, and it is difficult to pass A concept expressed by a specific measure. The applicant found through experiments that two fingerprints of non-same fingers can also reach 13 or even 29 matching detail point pairs, while two fingerprints of the same finger only have 8 matching detail point pairs due to the small overlapping area and poor quality. Therefore, due to the different judging criteria of matching minutiae pairs, the similarity between two fingerprint images cannot be well evaluated only by the number of matching minutiae pairs or their similarity.
在另一些相关技术中,基于细节点的指纹匹配算法的主要步骤为:计算第一组细节点和第二组细节点的局部相似度矩阵,根据局部相似度选取一个细节点对,并参照这个细节点对做刚性变化,即让这个细节点对中的两个细节点完全重合,之后统计刚性变化后能配对的那些匹配细节点对,最后依据这些匹配细节点对的个数和它们之间的匹配确定性相似度数值得出一个匹配分数。In other related technologies, the main steps of the minutiae-based fingerprint matching algorithm are: calculate the local similarity matrix of the first group of minutiae points and the second group of minutiae points, select a minutiae point pair according to the local similarity, and refer to this Make a rigid change of the detail point pairs, that is, let the two detail points in this detail point pair completely overlap, and then count the matching detail point pairs that can be paired after the rigidity change, and finally based on the number of these matching detail point pairs and the distance between them The match certainty similarity value for a given match yields a match score.
其中,在统计刚性变化后能配对的那些匹配细节点对时,用到了限定盒(Bounding box)技术。限定盒又称边界框,用在限制两个细节点是否相近、相匹配。当两组指纹细节点根据一个匹配对旋转平移后,用来查找更多的匹配的细节点对。比如当两个细节点满足限定盒的条件时,即它们之间的距离很近且方向也很近时,则可认为这两个细节点是相匹配的细节点对(待候选的)。Among them, the Bounding box technology is used when counting those matching detail point pairs that can be matched after the rigidity changes. The bounding box, also known as the bounding box, is used to limit whether two detail points are close and match. When two groups of fingerprint minutiae are rotated and translated according to a matching pair, they are used to find more matching minutiae pairs. For example, when two minutiae points meet the condition of the bounding box, that is, when the distance between them is very close and the direction is also very close, then the two minutiae points can be considered as matching minutiae point pairs (candidates to be selected).
如图6a-7b所示,用黑圈加上一条短线(这个短线的方向可以代表这个细节点的角度)代表一个细节点,记为被匹配细节点,外围的方框是由该被匹配细节点决定的限定盒。白圈加上一条短线是一个要判断是否与被匹配细节点相匹配的待匹配细节点。相匹配的两种情形分别如图6a和图6b所示。不相匹配的两种情形分别如图7a和图7b所示,其中,第一种情况是待匹配细节点不在限定盒内,第二种情况是待匹配细节点在限定盒内但与被匹配细节点方向差异太大。As shown in Figure 6a-7b, a black circle plus a short line (the direction of this short line can represent the angle of this detail point) represents a detail point, which is recorded as the matched detail point, and the surrounding box is the matched detail point. Click to determine the limited box. The white circle plus a short line is a minutiae point to be matched to judge whether it matches the minutiae point to be matched. The two matching situations are shown in Fig. 6a and Fig. 6b respectively. The two cases of mismatch are shown in Fig. 7a and Fig. 7b respectively, in which, the first case is that the minutiae point to be matched is not in the bounding box, and the second case is that the minutiae point to be matched is in the bounding box but is matched with The direction of the detail point is too different.
此种相关技术的基于细节点的指纹匹配算法在统计刚性变化后能配对的那些匹配细节点对时,采用了限定盒的方法,但该方法不能得到更优的匹配细节点对,导致了指纹比对精度的降低,降低了等错误率等评价指标。The minutiae-based fingerprint matching algorithm of this kind of related technology adopts the method of limiting the box when counting those matching minutiae pairs that can be matched after the rigidity changes, but this method cannot obtain better matching minutiae pairs, resulting in fingerprint The reduction of the comparison accuracy reduces the evaluation indicators such as the equal error rate.
基于以上问题,经申请人进一步深入研究,设计了一种指纹比对方法,以更好的评价两个指纹图像的相似程度,提高指纹比对的精度。Based on the above problems, after further in-depth research by the applicant, a fingerprint comparison method is designed to better evaluate the similarity of two fingerprint images and improve the accuracy of fingerprint comparison.
实施例1:Example 1:
本申请一些实施例中,如图8所述,所述指纹比对方法包括:In some embodiments of the present application, as shown in Figure 8, the fingerprint comparison method includes:
S1:获取第一张指纹图像的第一组细节点和第二张指纹图像的第二组细节点。S1: Obtain the first set of minutiae points of the first fingerprint image and the second set of minutiae points of the second fingerprint image.
所述第一组细节点和第二组细节点通过指纹特征提取算法对参与比对的第一张指纹图像和第二张指纹图像提 取得到,本申请不限制指纹特征提取算法的具体实现方式。The first group of minutiae points and the second group of minutiae points are obtained by extracting the first fingerprint image and the second fingerprint image participating in the comparison through a fingerprint feature extraction algorithm. This application does not limit the specific implementation of the fingerprint feature extraction algorithm.
S2:获取所述第一组细节点和所述第二组细节点的匹配细节点对。S2: Obtain matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points.
获取所述匹配细节点对的方法将在下面的实施例中详细介绍。The method for obtaining the pair of matching detail points will be described in detail in the following embodiments.
S3:针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值。S3: For each matching minutiae point pair, calculate the median similarity value of the matching minutiae point pair according to the distance and angle difference between two minutiae points of the matching minutiae point pair and the neighborhood minutiae point information.
所述相似度中间值的计算方法将结合下面的实施例详细介绍。The method for calculating the intermediate value of the similarity will be described in detail in conjunction with the following embodiments.
S4:根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数。S4: Calculate the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each matching pair of minutiae points.
所述匹配分数的计算方法将结合下面的实施例详细介绍。The method for calculating the matching score will be described in detail in conjunction with the following embodiments.
实施例2:Example 2:
本实施例提供一种指纹比对方法,如图9所示,该方法包括:This embodiment provides a fingerprint comparison method, as shown in Figure 9, the method includes:
S1:获取第一张指纹图像的第一组细节点和第二张指纹图像的第二组细节点。S1: Obtain the first set of minutiae points of the first fingerprint image and the second set of minutiae points of the second fingerprint image.
S2:获取第一组细节点和第二组细节点的匹配细节点对。S2: Obtain matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points.
本实施例的第一组细节点和第二组细节点通过指纹特征提取算法对参与比对的第一张指纹图像和第二张指纹图像提取得到,本申请不限制指纹特征提取算法的具体实现方式。并且本申请也不限制得到第一组细节点和第二组细节点的匹配细节点对的方式,可以通过现有技术中的各种方法进行。The first group of minutiae points and the second group of minutiae points in this embodiment are obtained by extracting the first fingerprint image and the second fingerprint image participating in the comparison through the fingerprint feature extraction algorithm, and this application does not limit the specific implementation of the fingerprint feature extraction algorithm Way. Moreover, the present application does not limit the manner of obtaining the matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points, and various methods in the prior art may be used.
例如,第一组细节点的细节点个数为N1,第二组细节点的细节点个数为N2,第一组细节点和第二组细节点的匹配细节点对的个数为N(N<=N1,并且N<=N2),这N个匹配细节点对用(p i,q i),i=1,2,…,N来表示,其中p i,i=1,2,…,N为属于第一组细节点的N个细节点,q i,i=1,2,…,N为属于第二组细节点的N个细节点。 For example, the number of minutiae points of the first group of minutiae points is N1, the number of minutiae points of the second group of minutiae points is N2, and the number of matching minutiae points of the first group of minutiae points and the second group of minutiae points is N( N<=N1, and N<=N2), the N matching detail point pairs are represented by (p i , q i ), i=1, 2,..., N, where p i , i=1, 2, ..., N are N minutiae points belonging to the first group of minutiae points, q i , i=1, 2, ..., N are N minutiae points belonging to the second group of minutiae points.
在本实施例中,前述步骤S3:针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离差和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值,具体包括下述步骤S31a和S32a。In this embodiment, the aforementioned step S3: For each matching minutiae point pair, calculate the matching minutiae according to the distance difference and angle difference between two minutiae points of the matching minutiae point pair, and the neighborhood minutiae point information The intermediate value of similarity between point pairs specifically includes the following steps S31a and S32a.
S31a:选取一个匹配细节点对作为基准细节点对,并对第二组细节点中的所有细节点均做使得基准细节点对的两个细节点重合的刚性变换。S31a: Select a matching minutiae point pair as a reference minutiae point pair, and perform a rigid transformation on all minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincide.
选取的基准细节点对可以记为(p a,q a),p a为属于第一组细节点的细节点,q a为属于第二组细节点的细节点。然后将q a进行刚性变换,使得q a与p a重合,并且第二组细节点中的其他细节点也做同样的刚性变换。将第二组细节点转换为第一组细节点的坐标系的坐标,方便后续的操作。 The selected reference minutiae point pair can be recorded as (p a , q a ), where pa is the minutiae point belonging to the first group of minutiae points, and q a is the minutiae point belonging to the second group of minutiae points. Then q a is subjected to rigid transformation, so that q a coincides with p a , and other minutiae points in the second group of minutiae points are also subjected to the same rigid transformation. Convert the second group of minutiae points to the coordinates of the coordinate system of the first group of minutiae points to facilitate subsequent operations.
S32a:对每一个匹配细节点对,根据所述匹配细节点对中两个细节点的距离和角度差、以及对应的邻域细节点对计算所述匹配细节点对的贡献数值。S32a: For each matching minutiae point pair, calculate the contribution value of the matching minutiae point pair according to the distance and angle difference between two minutiae points in the matching minutiae point pair and the corresponding neighborhood minutiae point pair.
所述贡献数值即为实施例1中所述的相似度中间值。The contribution value is the median similarity value described in Example 1.
其中,所述邻域细节点对为所述匹配细节点对设定邻域范围内的所有匹配细节点对。Wherein, the neighborhood minutiae point pair sets all the matching minutiae point pairs within the neighborhood range for the matching minutiae point pair.
本申请改善了计算匹配细节点对的贡献数值的方式,在计算配细节点对的贡献数值时,不仅根据匹配细节点对的两个细节点计算,还根据匹配细节点对的邻域内的邻域细节点对计算,充分利用匹配细节点对蕴含的有用信息,能够提高指纹比对的精度。This application improves the method of calculating the contribution value of the matching minutiae point pair. When calculating the contribution value of the matching minutiae point pair, it is not only calculated according to the two minutiae points of the matching minutiae point pair, but also according to the neighbors in the neighborhood of the matching minutiae point pair. The domain minutiae point pair calculation makes full use of the useful information contained in the matching minutiae point pair, which can improve the accuracy of fingerprint comparison.
在本实施例中,前述步骤S4:根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数,具体为如下步骤S41a。In this embodiment, the foregoing step S4: calculate the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each minutiae matching pair, specifically the following step S41a .
S41a:根据所有匹配细节点对的贡献数值计算所述第一张指纹图像与所述第二张指纹图像之间的匹配分数。S41a: Calculate the matching score between the first fingerprint image and the second fingerprint image according to the contribution values of all matching minutiae point pairs.
匹配分数为所有细节点对的贡献数值的统计值,计算得到匹配分数后,即可以根据匹配分数得到指纹比对结果。The matching score is the statistical value of the contribution value of all minutiae point pairs. After the matching score is calculated, the fingerprint comparison result can be obtained according to the matching score.
本实施例首先获取第一张指纹图像的第一组细节点和第二张指纹图像的第二组细节点,并得到第一组细节点和第二组细节点的匹配细节点对;然后选取一个匹配细节点对作为基准细节点对,并对第二组细节点中的所有细节点均做使得基准细节点对的两个细节点重合的刚性变换;针对每一个匹配细节点对,根据匹配细节点对的两个细节点,以及匹配细节点对设定邻域范围内的邻域细节点对的细节点计算匹配细节点对的贡献数值;最后根据所有细节点对的贡献数值计算匹配分数。This embodiment first obtains the first group of minutiae points of the first fingerprint image and the second group of minutiae points of the second fingerprint image, and obtains the matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points; then select A matching minutiae point pair is used as a reference minutiae point pair, and a rigid transformation is performed on all minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincide; for each matching minutiae point pair, according to the matching The two minutiae points of the minutiae point pair and the minutiae points of the minutiae point pair within the set neighborhood range of the matching minutiae point pair calculate the contribution value of the matching minutiae point pair; finally, the matching score is calculated according to the contribution values of all minutiae point pairs .
本实施例在计算配细节点对的贡献数值时,不仅根据匹配细节点对的两个细节点计算,还根据匹配细节点对的邻域内的邻域细节点对计算,充分利用匹配细节点对自身和周围一定范围内蕴含的有用信息,很好的评价两个指纹图像的相似程度,提高了指纹比对的精度。In this embodiment, when calculating the contribution value of a matching minutiae point pair, it is not only calculated based on the two minutiae points of the matching minutiae point pair, but also calculated based on the neighborhood minutiae point pair within the neighborhood of the matching minutiae point pair, making full use of the matching minutiae point pair The useful information contained within a certain range of itself and its surroundings can well evaluate the similarity of two fingerprint images and improve the accuracy of fingerprint comparison.
作为本实施例的一种改进,前述的步骤S32a包括:As an improvement of this embodiment, the aforementioned step S32a includes:
S320:根据所述匹配细节点对的两个细节点的距离和角度差计算所述匹配细节点对的第一贡献数值S320: Calculate the first contribution value of the matching minutiae point pair according to the distance and angle difference between the two minutiae points of the matching minutiae point pair
在其中一个示例中,可以通过如下公式计算所述匹配细节点对的第一贡献数值;In one of the examples, the first contribution value of the matching minutiae point pair can be calculated by the following formula;
sd=Z(di,μ 11)*Z(Δθ i22) sd=Z(di,μ 11 )*Z(Δθ i22 )
其中,sd为所述匹配细节点对的第一贡献数值,Z(,,)为sigmoid函数,d i和Δθ i分别为i个匹配细节点对(p i,q i)的两个细节点的距离和角度差,i=1,2,…,N,N为匹配细节点对的个数,μ 1122为设定的参数。 Among them, sd is the first contribution value of the pair of matching minutiae points, Z(,,) is a sigmoid function, and d i and Δθ i are two minutiae points of i matching minutiae point pairs (p i , q i ) , i=1,2,...,N, N is the number of matching minutiae point pairs, μ 1 , τ 1 , μ 2 , τ 2 are set parameters.
sigmoid函数的公式如下:The formula of the sigmoid function is as follows:
Figure PCTCN2022135830-appb-000043
Figure PCTCN2022135830-appb-000043
其中v为变量,μ,τ为两个参数,sigmoid函数的取值范围为[0,1]。将距离d i和角度差Δθ i分别作为变量传入sigmoid函数,并根据设定的μ,τ参数可以计算出一个在0和1之间的数值用来表征某种相似度,比如距离越近该数值越大,角度差越小该数值越大等。 Where v is a variable, μ and τ are two parameters, and the value range of the sigmoid function is [0,1]. The distance d i and the angle difference Δθ i are respectively passed into the sigmoid function as variables, and a value between 0 and 1 can be calculated according to the set μ, τ parameters to represent a certain similarity, such as the closer the distance The larger the value, the smaller the angle difference, the larger the value, and so on.
S321:对所述匹配细节点对(p i,q i)设定邻域范围内的每个邻域细节点对的第二组细节点均做使得所述匹配细节点对的两个细节点重合的刚性变换。 S321: For the matching minutiae point pair (p i , q i ), set the second group of minutiae points of each neighborhood minutiae point pair within the neighborhood range so that the two minutiae points of the matching minutiae point pair Coincident rigid transformation.
假设p i的半径90的邻域范围内第一组细节点的个数为np,q i的半径90的邻域范围内第二组细节点的个数为nq,p i和q i在半径90的邻域范围内存在M个匹配的邻域细节点对,M<=np并且M<=nq,因为并不是邻域范围内每个细节点都有匹配对。 Assume that the number of the first group of minutiae points in the neighborhood of pi with a radius of 90 is np, the number of the second group of minutiae points in the neighborhood of q i with a radius of 90 is nq, and p i and q i are within a radius of There are M matching pairs of neighborhood minutiae points in the neighborhood range of 90, M<=np and M<=nq, because not every minutiae point in the neighborhood range has a matching pair.
将邻域范围内M个邻域细节点对记作(pNeighbor j,qNeighbor j),j=1,2,…,M,使用类似S31a中的方法做刚性变化使得p i和q i重合,同时,邻域范围内M个邻域细节点对的qNeighbor j也做同样的刚性变换。 Denote the M neighborhood detail point pairs within the neighborhood range as (pNeighbor j ,qNeighbor j ), j=1,2,...,M, use a method similar to that in S31a to make rigid changes so that p i and q i coincide, and at the same time , the qNeighbor j of the M neighborhood detail point pairs in the neighborhood also undergoes the same rigid transformation.
S322:对每一个邻域细节点对,根据所述邻域细节点对的两个细节点的距离和角度差,以及对应的内角值计算每个邻域细节点对的第二贡献数值。S322: For each neighborhood minutiae point pair, calculate the second contribution value of each neighborhood minutiae point pair according to the distance and angle difference between the two minutiae points of the neighborhood minutiae point pair and the corresponding inner angle value.
其中,所述内角值为所述邻域细节点对的两个细节点与所述匹配细节点对形成的内角的角度值。Wherein, the internal angle value is an angle value of an internal angle formed by two minutiae points of the neighborhood minutiae point pair and the matching minutiae point pair.
在其中一个示例中,可以通过如下公式计算每个邻域细节点对的第二贡献数值;In one example, the second contribution value of each neighborhood detail point pair can be calculated by the following formula;
其中,sn j为第j个邻域细节点对(pNeighbor j,qNeighbor j)的第二贡献数值,j=1,2,…,M,M为所述匹配细节点对设定邻域范围内的邻域细节点对的个数,sn j=Z(d j11)*Z(Δθ j22)*Z(α j33),d j和Δθ j分别为第j个邻域细节点对(pNeighbor j,qNeighbor j)的两个细节点的距离和角度差,α j为第j个邻域细节点对(pNeighbor j,qNeighbor j)的两个细节点与所述匹配细节点对(p i,q i)形成的内角的角度值,α j如图10所示,μ 33为设定的参数。 Among them, sn j is the second contribution value of the jth neighborhood detail point pair (pNeighbor j , qNeighbor j ), j=1, 2,..., M, M is the set neighborhood range of the matching detail point pair The number of detail point pairs in the neighborhood of sn j =Z(d j11 )*Z(Δθ j22 )*Z(α j33 ), d j and Δθ j are the distance and angle difference between the two detail points of the jth neighborhood detail point pair (pNeighbor j , qNeighbor j ), and α j is the jth neighborhood detail point pair (pNeighbor j , qNeighbor j ) The angle value of the internal angle formed by the two minutiae points and the pair of matching minutiae points (p i , q i ), α j is shown in Figure 10, and μ 3 , τ 3 are set parameters.
S323:根据所述匹配细节点对的第一贡献数值和所有邻域细节点对的第二贡献数值计算所述匹配细节点对的贡献数值。S323: Calculate the contribution value of the matching minutiae point pair according to the first contribution value of the matching minutiae point pair and the second contribution values of all neighborhood minutiae point pairs.
在其中一个示例中,可以通过如下公式计算所述匹配细节点对的贡献数值;In one example, the contribution value of the matching detail point pair can be calculated by the following formula;
Figure PCTCN2022135830-appb-000044
Figure PCTCN2022135830-appb-000044
其中,pairscore i为第i个匹配细节点对的贡献数值,np和nq分别为所述匹配细节点对设定邻域范围内第一组细节点的个数和第二组细节点的个数; Among them, pairscore i is the contribution value of the i-th matching minutiae point pair, np and nq are respectively the number of the first group of minutiae points and the number of the second group of minutiae points within the set neighborhood of the matching minutiae point ;
Figure PCTCN2022135830-appb-000045
Figure PCTCN2022135830-appb-000045
.
本实施例在计算匹配细节点对的贡献数值时,既考虑匹配细节点对本身的两个细节点的距离和角度差,又考虑匹配细节点对一定邻域范围内的邻域细节点对的两个细节点的距离、角度差以及与所述匹配细节点对形成的内角值。能够充分利用匹配细节点对自身和周围一定范围内的匹配细节点对的距离、角度等信息,提高了指纹比对的精度。In this embodiment, when calculating the contribution value of a matching minutiae point pair, not only the distance and angle difference between the two minutiae points of the matching minutiae point pair, but also the neighborhood minutiae point pairs within a certain neighborhood of the matching minutiae point pair are considered. The distance between two minutiae points, the angle difference, and the value of the internal angle formed with the pair of matching minutiae points. It can make full use of information such as the distance and angle of the matching minutiae point pair itself and the matching minutiae point pair within a certain range around it, thereby improving the accuracy of fingerprint comparison.
然后,通过如下公式计算第一张指纹图像与第二张指纹图像之间的匹配分数:Then, the matching score between the first fingerprint image and the second fingerprint image is calculated by the following formula:
Figure PCTCN2022135830-appb-000046
Figure PCTCN2022135830-appb-000046
其中,s为第一张指纹图像与第二张指纹图像之间的匹配分数,N1和N2分别为第一组细节点的个数和第二组细节点的个数。Among them, s is the matching score between the first fingerprint image and the second fingerprint image, N1 and N2 are the number of minutiae points in the first group and the number of minutiae points in the second group respectively.
本实施例中,可以通过多种方法选择基准细节点对,在其中一个示例中,选取基准细节点对的方法包括:In this embodiment, multiple methods can be used to select the reference detail point pair. In one example, the method for selecting the reference detail point pair includes:
S310:计算所有匹配细节点对的第一组细节点的重心。S310: Calculate the center of gravity of the first group of minutiae points of all matching minutiae point pairs.
匹配细节点为(p i,q i),i=1,2,…,N,其中,p i,i=1,2,…,N为属于第一组细节点的N个细节点,也就是所有匹 配细节点对的第一组细节点,则其重心C的坐标(xc,yc)为: The matching minutiae points are (p i ,q i ), i=1,2,...,N, where p i ,i=1,2,...,N are N minutiae points belonging to the first group of minutiae points, and It is the first group of minutiae points of all matching minutiae point pairs, and the coordinates (xc, yc) of its center of gravity C are:
Figure PCTCN2022135830-appb-000047
Figure PCTCN2022135830-appb-000047
S311:从所有匹配细节点对的第一组细节点中找出距离重心最近的一个第一组细节点,将找出的第一组细节点所属的匹配细节点对作为基准细节点对。S311: Find a first group of minutiae points closest to the center of gravity from the first group of minutiae points of all matching minutiae point pairs, and use the matching minutiae point pair to which the found first group of minutiae points belong as a reference minutiae point pair.
在上述N个细节点p i中,假设距离(例如欧式距离等)重心C最近的细节点为p a,且其对应的匹配细节点对为(p a,q a),将(p a,q a)作为基准细节点对。 Among the above N minutiae points p i , assuming that the minutiae point closest to the center of gravity C (such as Euclidean distance, etc.) is p a , and its corresponding pair of matching minutiae points is (p a , q a ), the (p a , q a ) as the reference minutiae point pair.
得到基准细节点对后,即可进行刚性变换,本申请不限制刚性变换的具体实现方式,其一个示例包括:After obtaining the reference detail point pair, rigid transformation can be performed. This application does not limit the specific implementation of rigid transformation. An example includes:
S312:计算基准细节点对的两个细节点的角度差Δθ和坐标差Δx,Δy;S312: Calculate the angle difference Δθ and the coordinate difference Δx, Δy of the two minutiae points of the reference minutiae point pair;
Δθ=θ2-θ1Δθ=θ2-θ1
Figure PCTCN2022135830-appb-000048
Figure PCTCN2022135830-appb-000048
其中,(x2,y2,θ2)为基准细节点对的第一组细节点的坐标和方向角,(x1,y1,θ1)为基准细节点对的第二组细节点的坐标和方向角。Among them, (x2, y2, θ2) are the coordinates and orientation angles of the first group of minutiae points of the reference minutiae point pair, and (x1, y1, θ1) are the coordinates and orientation angles of the second group of minutiae points of the reference minutiae point pair.
假设基准细节点对(p a,q a)中q a的坐标和方向角为(x2,y2,θ2),p a的坐标和方向角为(x1,y1,θ1),计算q a和p a的角度差Δθ和坐标差Δx,Δy。 Assuming that the coordinates and orientation angle of q a in the reference detail point pair (p a , q a ) are (x2, y2, θ2), and the coordinates and orientation angle of p a are (x1, y1, θ1), calculate q a and p a Angle difference Δθ and coordinate difference Δx, Δy.
S313:根据基准细节点对的两个细节的角度差Δθ和坐标差Δx,Δy计算刚性变换后第二组细节点的坐标和方向角。S313: Calculate the coordinates and orientation angles of the second group of minutiae after rigid transformation according to the angle difference Δθ and the coordinate difference Δx, Δy between the two minutiae of the reference minutiae point pair.
Figure PCTCN2022135830-appb-000049
Figure PCTCN2022135830-appb-000049
θ′=θ-Δθθ'=θ-Δθ
其中,(x,y,θ)为刚性变换前第二组细节点的坐标和方向角,(x′,y′,θ′)为刚性变换后第二组细节点的坐标和方向角。Among them, (x, y, θ) are the coordinates and orientation angles of the second group of minutiae points before rigid transformation, and (x′, y′, θ′) are the coordinates and orientation angles of the second group of minutiae points after rigid transformation.
使得q a和p a重合的刚性变换包括一个旋转和平移操作T,且第二组细节点的角度都减掉Δθ。 The rigid transformation that makes q a and p a coincident includes a rotation and translation operation T, and the angles of the second set of minutiae points are all subtracted by Δθ.
为更清楚的说明本申请的效果,进行了如下测试:构造一个指纹测试集,完全按照现有技术的基于细节点的指纹匹配算法进行测试,其等误率为5.5%,而本申请的指纹比对方法的等误率为3.5%,与现有技术相比,等误率降低了约36.3%,结果有了较大的改善。In order to illustrate the effect of the present application more clearly, the following test is carried out: a fingerprint test set is constructed, and the fingerprint matching algorithm based on the minutiae of the prior art is completely tested, and its equal error rate is 5.5%, while the fingerprint of the present application The equal error rate of the comparison method is 3.5%. Compared with the prior art, the equal error rate is reduced by about 36.3%, and the result has been greatly improved.
综上所述,本申请在计算指纹比对分数的方法上进行优化,在计算匹配细节点对的贡献数值时,既考虑匹配细节点对本身的两个细节点的距离和角度差等信息,又考虑匹配细节点对一定邻域范围内的邻域细节点对的两个细节点的距离、角度差以及与所述匹配细节点对形成的内角值等信息。能够充分利用匹配细节点对自身和周围一定范围内的匹配细节点对蕴含的距离、角度等有助于指纹比对的信息,提高了指纹比对的精度。在测试集上的测试结果与现有技术相比有较大的改善,提高了指纹比对的精度,降低了等误率等评价指标。To sum up, this application optimizes the method of calculating the fingerprint comparison score. When calculating the contribution value of the matching minutiae point pair, it not only considers the distance and angle difference between the two minutiae points of the matching minutiae point itself, Also consider information such as the distance between the two minutiae points of the neighborhood minutiae point pair within a certain neighborhood of the matching minutiae point pair, the angle difference, and the inner angle value formed with the matching minutiae point pair. The information that is helpful for fingerprint comparison, such as the distance and angle contained in the matching minutiae point pair itself and the matching minutiae point pair within a certain range around it, can be fully utilized, and the accuracy of fingerprint comparison is improved. Compared with the existing technology, the test results on the test set have been greatly improved, the accuracy of fingerprint comparison has been improved, and the evaluation indicators such as the equal error rate have been reduced.
实施例3:Example 3:
本实施例提供一种指纹比对方法,如图11所示,该方法包括:This embodiment provides a fingerprint comparison method, as shown in Figure 11, the method includes:
S1:获取第一张指纹图像的第一组细节点和第二张指纹图像的第二组细节点。S1: Obtain the first set of minutiae points of the first fingerprint image and the second set of minutiae points of the second fingerprint image.
本步骤的第一组细节点和第二组细节点通过指纹特征提取算法对参与比对的第一张指纹图像和第二张指纹图像提取得到,本申请不限制指纹特征提取算法的具体实现方式。The first group of minutiae points and the second group of minutiae points in this step are obtained by extracting the first fingerprint image and the second fingerprint image participating in the comparison through the fingerprint feature extraction algorithm. This application does not limit the specific implementation of the fingerprint feature extraction algorithm. .
第一组细节点和第二组特征点的一个示例为:第一张指纹图像对应的第一组细节点包括M个细节点,记为
Figure PCTCN2022135830-appb-000050
Figure PCTCN2022135830-appb-000051
i=1,2,…,M,t i、(x i,y i)和
Figure PCTCN2022135830-appb-000052
分别为第一组细节点中第i个细节点F i的类型、坐标和角度;第二张指纹图像对应的第二组细节点包括N个细节点,记为
Figure PCTCN2022135830-appb-000053
j=1,2,…,N,t j、(x j,y j)和
Figure PCTCN2022135830-appb-000054
分别为第二组细节点中第j个细节点G j的类型、坐标和角度。
An example of the first group of minutiae points and the second group of feature points is: the first group of minutiae points corresponding to the first fingerprint image includes M minutiae points, denoted as
Figure PCTCN2022135830-appb-000050
Figure PCTCN2022135830-appb-000051
i=1,2,...,M, t i , (xi , y i ) and
Figure PCTCN2022135830-appb-000052
are respectively the type, coordinates and angle of the i-th minutiae F i in the first group of minutiae points; the second group of minutiae points corresponding to the second fingerprint image includes N minutiae points, denoted as
Figure PCTCN2022135830-appb-000053
j=1,2,...,N, t j , (x j ,y j ) and
Figure PCTCN2022135830-appb-000054
are respectively the type, coordinates and angle of the jth minutiae point G j in the second group of minutiae points.
第一张指纹图像和第二张指纹图像的比对可以称为第一组细节点和第二组细节点之间的匹配。The comparison between the first fingerprint image and the second fingerprint image can be called the matching between the first set of minutiae points and the second set of minutiae points.
本实施例中,前述步骤S2:获取第一组细节点和第二组细节点的匹配细节点对具体包括下述步骤S21b-S23b。In this embodiment, the foregoing step S2: obtaining matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points specifically includes the following steps S21b-S23b.
S21b:计算第一组细节点中每个细节点的2-近邻结构表示和第二组细节点中每个细节点的2-近邻结构表示。S21b: Calculate the 2-nearest neighbor structure representation of each minutiae point in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points.
对于第一组细节点中第i个细节点
Figure PCTCN2022135830-appb-000055
其2-近邻结构表示与距其最近的两个细节点F p和F q有关,其中:
For the i-th minutiae point in the first group of minutiae points
Figure PCTCN2022135830-appb-000055
Its 2-nearest neighbor structure representation is related to the two closest minutiae points F p and F q , where:
Figure PCTCN2022135830-appb-000056
21bt p、(x p,y p)和
Figure PCTCN2022135830-appb-000057
分别为第一组细节点中第p个细节点F p的类型、坐标和角度。
Figure PCTCN2022135830-appb-000056
21bt p , (x p ,y p ) and
Figure PCTCN2022135830-appb-000057
are respectively the type, coordinates and angle of the pth minutiae point F p in the first group of minutiae points.
Figure PCTCN2022135830-appb-000058
t q、(x q,y q)和
Figure PCTCN2022135830-appb-000059
分别为第一组细节点中第q个细节点F q的类型、坐标和角度。
Figure PCTCN2022135830-appb-000058
t q , (x q ,y q ) and
Figure PCTCN2022135830-appb-000059
are respectively the type, coordinates and angle of the qth minutiae point F q in the first group of minutiae points.
本申请不限制第一组细节点中每个细节点的2-近邻结构表示的具体计算方法,在其中一个示例中,可以通过如下公式计算:The present application does not limit the specific calculation method of the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points. In one example, it can be calculated by the following formula:
Figure PCTCN2022135830-appb-000060
Figure PCTCN2022135830-appb-000060
其中,Fl i为第一组细节点中第i个细节点F i的2-近邻结构表示,Fl i为一个11维的向量,p和q分别为与第i个细节点F i最近的两个细节点F p和F q的编号,
Figure PCTCN2022135830-appb-000061
t l、(x l,y l)和
Figure PCTCN2022135830-appb-000062
分别为第一组细节点中第l个细节点F i的类型、坐标和角度,l取i,p,q;
Among them, Fl i is the 2-neighbor structure representation of the i-th minutiae F i in the first group of minutiae points, Fl i is an 11-dimensional vector, and p and q are the two nearest neighbors to the i-th minutiae F i , respectively. The numbers of minutiae points F p and F q ,
Figure PCTCN2022135830-appb-000061
t l , (x l ,y l ) and
Figure PCTCN2022135830-appb-000062
Respectively, the type, coordinates and angle of the lth minutiae point F i in the first group of minutiae points, l takes i, p, q;
Figure PCTCN2022135830-appb-000063
表示第i个细节点和第p个细节点之间的距离;
Figure PCTCN2022135830-appb-000063
Indicates the distance between the i-th minutiae point and the p-th minutiae point;
Figure PCTCN2022135830-appb-000064
表示第i个细节点和第q个细节点之间的距离;
Figure PCTCN2022135830-appb-000064
Indicates the distance between the i-th minutiae point and the q-th minutiae point;
Figure PCTCN2022135830-appb-000065
表示第i个细节点和第p个细节点连接的直线与x轴的夹角与第i个细节点的角度的差值;
Figure PCTCN2022135830-appb-000065
Indicates the difference between the angle between the line connecting the i-th detail point and the p-th detail point and the x-axis and the angle of the i-th detail point;
Figure PCTCN2022135830-appb-000066
表示第i个细节点和第q个细节点连接的直线与x轴的夹角与第i个细节点的角度的差值;
Figure PCTCN2022135830-appb-000066
Indicates the difference between the angle between the line connecting the i-th detail point and the q-th detail point and the x-axis and the angle of the i-th detail point;
Figure PCTCN2022135830-appb-000067
表示第i个细节点的角度与第p个细节点的角度的差值;
Figure PCTCN2022135830-appb-000067
Indicates the difference between the angle of the i-th minutiae point and the angle of the p-th minutiae point;
Figure PCTCN2022135830-appb-000068
表示第i个细节点的角度与第q个细节点的角度的差值;
Figure PCTCN2022135830-appb-000068
Indicates the difference between the angle of the i-th detail point and the angle of the q-th detail point;
前述的dφ(t 1,t 2)为角度差函数,其定义为: The aforementioned dφ(t 1 ,t 2 ) is an angle difference function, which is defined as:
Figure PCTCN2022135830-appb-000069
Figure PCTCN2022135830-appb-000069
n ip为第一组细节点中第i个细节点和第p个细节点连线上的脊线的条数,n iq为第一组细节点中第i个细节点和第q个细节点连线上的脊线的条数。 n ip is the number of ridge lines on the line between the i-th detail point and the p-th detail point in the first group of detail points, and n iq is the i-th detail point and the q-th detail point in the first group of detail points The number of ridges on the link.
第一组细节点中第i个细节点F i的2-近邻结构表示的一个示例如图13所示。 An example of the 2-neighbor structure representation of the ith minutiae F i in the first group of minutiae points is shown in Fig. 13 .
相应的,对于第二组细节点中第j个细节点
Figure PCTCN2022135830-appb-000070
其2-近邻结构表示与距其最近的两个细节点G m和G n有关,具体计算公式如下:
Correspondingly, for the jth minutiae point in the second group of minutiae points
Figure PCTCN2022135830-appb-000070
Its 2-nearest neighbor structure indicates that it is related to the two nearest minutiae points Gm and Gn , and the specific calculation formula is as follows:
Figure PCTCN2022135830-appb-000071
Figure PCTCN2022135830-appb-000071
其中,Gl j为第二组细节点中第j个细节点G j的2-近邻结构表示,m和n分别为与第j个细节点G j最近的两个细节点G m和G n的编号,
Figure PCTCN2022135830-appb-000072
t h、(x h,y h)和
Figure PCTCN2022135830-appb-000073
分别为第二组细节点中第h个细节点G h的类型、坐标和角度,h取j,m,n;
Among them, Gl j is the 2-nearest neighbor structure representation of the jth minutiae G j in the second group of minutiae points, m and n are the two minutiae points G m and G n closest to the jth minutiae G j respectively serial number,
Figure PCTCN2022135830-appb-000072
t h , (x h ,y h ) and
Figure PCTCN2022135830-appb-000073
Respectively, the type, coordinates and angle of the hth minutiae point G h in the second group of minutiae points, where h takes j, m, n;
Figure PCTCN2022135830-appb-000074
Figure PCTCN2022135830-appb-000074
Figure PCTCN2022135830-appb-000075
Figure PCTCN2022135830-appb-000075
Figure PCTCN2022135830-appb-000076
Figure PCTCN2022135830-appb-000076
Figure PCTCN2022135830-appb-000077
Figure PCTCN2022135830-appb-000077
Figure PCTCN2022135830-appb-000078
Figure PCTCN2022135830-appb-000078
Figure PCTCN2022135830-appb-000079
Figure PCTCN2022135830-appb-000079
n jm为第二组细节点中第j个细节点和第m个细节点连线上的脊线的条数,n jn为第二组细节点中第j个细节点和第n个细节点连线上的脊线的条数。 n jm is the number of ridge lines on the line between the jth minutiae point and the mth minutiae point in the second group of minutiae points, and n jn is the jth minutiae point and the nth minutiae point in the second group of minutiae points The number of ridges on the link.
S22b:根据第一组细节点中每个细节点的2-近邻结构表示和第二组细节点中每个细节点的2-近邻结构表示计算第一组细节点和第二组细节点的局部相似度矩阵。S22b: According to the 2-nearest neighbor structure representation of each minutiae point in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points, calculate the local parts of the first group of minutiae points and the second group of minutiae points similarity matrix.
局部相似度矩阵是大小M*N的矩阵,其第i行第j列的元素sl(i,j)是第一组细节点中的第i个细节点与第二组细节点中的第j个细节点的局部相似度,该局部相似度通过第一组细节点中的第i个细节点的2-近邻结构表示Fl i和第二组细节点中的第j个细节点的2-近邻结构表示Gl i计算得到。 The local similarity matrix is a matrix of size M*N, and the element sl(i, j) in the i-th row and j-column is the i-th minutiae point in the first group of minutiae points and the j-th minutiae point in the second group of minutiae points The local similarity of minutiae points, the local similarity represents Fl i through the 2-nearest neighbor structure of the i-th minutiae point in the first group of minutiae points and the 2-nearest neighbor of the j-th minutiae point in the second group of minutiae points The structure represents Gl i calculated.
示例性的,局部相似度矩阵的一个具体计算方式为:Exemplarily, a specific calculation method of the local similarity matrix is:
计算两个2-近邻结构表示Fl i和Gl j的差,得到向量V0=Fl i-Gl j,对向量V0的每个元素均取绝对值,得到一个新的向量V=|V0|。 Calculate the difference between two 2-nearest neighbor structures representing Fl i and Gl j to obtain a vector V0=Fl i -Gl j , and take the absolute value of each element of the vector V0 to obtain a new vector V=|V0|.
另有一个11维的向量
Figure PCTCN2022135830-appb-000080
W为加权系数向量,其具体的数值为:w d=1,w θ=0.3*180/π,
Figure PCTCN2022135830-appb-000081
w n=3,w t=3。
Another 11-dimensional vector
Figure PCTCN2022135830-appb-000080
W is a weighting coefficient vector, and its specific values are: w d =1, w θ =0.3*180/π,
Figure PCTCN2022135830-appb-000081
w n =3, w t =3.
计算加权系数向量W与向量V的点积,得到参数A,即:Calculate the dot product of the weighting coefficient vector W and the vector V to obtain the parameter A, namely:
Figure PCTCN2022135830-appb-000082
Figure PCTCN2022135830-appb-000082
计算第一组细节点中的第i个细节点与第二组细节点中的第j个细节点的局部相似度sl(i,j):Calculate the local similarity sl(i,j) between the i-th minutiae in the first group of minutiae and the j-th minutiae in the second group of minutiae:
Figure PCTCN2022135830-appb-000083
Figure PCTCN2022135830-appb-000083
i=1,2,…,M;j=1,2,…,N。i=1,2,...,M; j=1,2,...,N.
S23b:按照从大到小的顺序从局部相似度矩阵中选取若干个元素,并获取选取的每个元素对应的两个细节点作为匹配对。S23b: Select several elements from the local similarity matrix in descending order, and obtain two minutiae points corresponding to each selected element as a matching pair.
本步骤中,可以只选取一个元素,此时该元素为局部相似度矩阵中所有元素的最大值,其对应一个匹配对。假设该匹配对包括第一组细节点中的第a个细节点和第二组细节点中的第b个细节点。将该匹配对记为(a,b),其满足sl(a,b)=max i,j(sl(i,j)),表示第一组细节点中的第a个细节点和第二组细节点中的第b个细节点之间的局部相似度数值最大。 In this step, only one element may be selected, and at this time, the element is the maximum value of all elements in the local similarity matrix, which corresponds to a matching pair. Assume that the matching pair includes the a-th minutiae point in the first group of minutiae points and the b-th minutiae point in the second group of minutiae points. The matching pair is denoted as (a,b), which satisfies sl(a,b)=max i,j (sl(i,j)), which means the ath minutiae point and the second minutiae point in the first group of minutiae points The local similarity value between the bth minutiae in the group minutiae is the largest.
匹配对(a,b)的意义在于最初两幅指纹图像之间的平移和旋转的相对变换是事先未知的,需要根据匹配对(a,b)来做平移和旋转等操作,用来找到两组指纹细节点之间的其他的细节点匹配对。The significance of the matching pair (a, b) is that the relative transformation of translation and rotation between the first two fingerprint images is unknown in advance, and operations such as translation and rotation need to be performed according to the matching pair (a, b) to find the two fingerprint images. Matching pairs of other minutiae between group fingerprint minutiae.
当然,本不步骤也可以从大到小选取多个元素,例如5个等,每个元素对应一个匹配对。后续的处理中,是针对每个匹配对分别进行的。Of course, this step can also select multiple elements from large to small, for example, 5, and each element corresponds to a matching pair. Subsequent processing is performed separately for each matching pair.
本实施例中,前述步骤S3:针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值,具体包括如下步骤S31b。In this embodiment, the foregoing step S3: For each matching minutiae point pair, calculate the matching minutiae point pair according to the distance and angle difference between two minutiae points of the matching minutiae point pair and the neighborhood minutiae point information The intermediate value of the similarity, specifically includes the following step S31b.
S31b:对每个配对,根据所述局部相似度矩阵和所述匹配对的两个细节点之间的距离差和角度差计算所述匹配对的匹配确定性相似度矩阵。S31b: For each pair, calculate a matching certainty similarity matrix of the matching pair according to the local similarity matrix and the distance difference and angle difference between two minutiae points of the matching pair.
其中,所述匹配确定性相似度矩阵即为实施例1所述的相似度中间值。Wherein, the matching deterministic similarity matrix is the median similarity value described in Embodiment 1.
匹配确定性相似度矩阵的大小是M*N,其第i行第j列的元素ml(i,j)代表第一组细节点中的第i个细节点和第二组细节点中的第j个细节点的相似度。The size of the matching deterministic similarity matrix is M*N, and the element ml(i, j) in the i-th row and j-column represents the i-th minutiae point in the first group of minutiae points and the i-th minutiae point in the second group of minutiae points The similarity of j minutiae points.
本步骤以只获取一个匹配对(a,b)进行举例说明,当获取了多个匹配对时,对每个匹配对分别计算其匹配确定性相似度矩阵。示例性的,匹配对(a,b)对应的匹配确定性相似度矩阵的一个具体计算方式为:This step is illustrated by taking only one matching pair (a, b) as an example. When multiple matching pairs are obtained, the matching certainty similarity matrix is calculated for each matching pair. Exemplarily, a specific calculation method of the matching deterministic similarity matrix corresponding to the matching pair (a, b) is:
首先,第一组细节点中的每个细节点F i以第a个细节点为参照进行极坐标转换运算,将第i个细节点的四维向量
Figure PCTCN2022135830-appb-000084
转换为三维的特征向量
Figure PCTCN2022135830-appb-000085
Firstly, each minutiae F i in the first group of minutiae points takes the ath minutiae as a reference to carry out the polar coordinate conversion operation, and converts the four-dimensional vector of the i-th minutiae point
Figure PCTCN2022135830-appb-000084
Convert to 3D eigenvectors
Figure PCTCN2022135830-appb-000085
Figure PCTCN2022135830-appb-000086
Figure PCTCN2022135830-appb-000086
其中,(x a,y a)和
Figure PCTCN2022135830-appb-000087
分别为第一组细节点中的第a个细节点的坐标和角度。
Among them, (x a ,y a ) and
Figure PCTCN2022135830-appb-000087
are the coordinates and angles of the ath minutiae point in the first group of minutiae points, respectively.
类似的,第二组细节点中的每个细节点G j以第b个细节点为参照进行极坐标转换运算,将第j个细节点的四维向量
Figure PCTCN2022135830-appb-000088
转换为三维的特征向量
Figure PCTCN2022135830-appb-000089
Similarly, each minutiae point G j in the second group of minutiae points takes the bth minutiae point as a reference to carry out polar coordinate transformation operation, and converts the four-dimensional vector of the jth minutiae point
Figure PCTCN2022135830-appb-000088
Convert to 3D eigenvectors
Figure PCTCN2022135830-appb-000089
Figure PCTCN2022135830-appb-000090
Figure PCTCN2022135830-appb-000090
其中,(x b,y b)和
Figure PCTCN2022135830-appb-000091
分别为第二组细节点中的第b个细节点的坐标和角度。
Among them, (x b ,y b ) and
Figure PCTCN2022135830-appb-000091
are the coordinates and angles of the bth minutiae point in the second group of minutiae points, respectively.
计算特征向量
Figure PCTCN2022135830-appb-000092
Figure PCTCN2022135830-appb-000093
的差,得到一个三维的向量v0=Fl i-Gl j,对向量v0的每个元素均取绝对值,得到一个新的三维向量v=|v0|。三维向量v的三个元素分别是d,α,β。
Calculate eigenvectors
Figure PCTCN2022135830-appb-000092
and
Figure PCTCN2022135830-appb-000093
A three-dimensional vector v0=Fl i -Gl j is obtained, and the absolute value of each element of the vector v0 is obtained to obtain a new three-dimensional vector v=|v0|. The three elements of the three-dimensional vector v are d, α, β.
通过如下公式计算匹配对(a,b)对应的匹配确定性相似度矩阵:The matching certainty similarity matrix corresponding to the matching pair (a, b) is calculated by the following formula:
Figure PCTCN2022135830-appb-000094
Figure PCTCN2022135830-appb-000094
i=1,2,…,M,j=1,2,…,N,阈值{8,π/6,π/6}为设定的限定盒。i=1, 2, ..., M, j = 1, 2, ..., N, the threshold {8, π/6, π/6} is the set limit box.
相关技术的基于细节点的指纹匹配算法在统计刚性变化后能配对的那些匹配细节点对时,为了减少指纹图像的非线性形变的影响,通常认为在限定盒内的两个细节点即是一个匹配对。即相关技术在计算ml(i,j)时,直接在0.5*sl(i,j)之后加上一个固定项0.5,这种方法忽略了这两个细节点之间的距离差和角度差对匹配评价的影响。并且当限定盒存在两个或以上的可能与被匹配细节点相匹配的待匹配细节点时,如图12所示,不能选择出与被匹配细节点更好的匹配的待匹配细节点,即不能选择出更优的待匹配细节点,从而在后续步骤不能得到更优的匹配细节点对。In the minutiae-based fingerprint matching algorithm of the related technology, when the matching minutiae pairs that can be matched after the rigidity changes are counted, in order to reduce the influence of the nonlinear deformation of the fingerprint image, it is generally considered that two minutiae points in the limited box are one matching pair. That is, when the related technology calculates ml(i,j), a fixed item 0.5 is directly added after 0.5*sl(i,j). This method ignores the distance difference and angle difference between the two detail points. The impact of matching ratings. And when there are two or more minutiae points to be matched that may match the minutiae to be matched in the bounding box, as shown in FIG. A better minutiae point to be matched cannot be selected, so that a better matching minutiae point pair cannot be obtained in the subsequent steps.
与相关技术不同,本实施例中的方法不是在0.5*sl(i,j)之后加上一个固定项,而是加上一个动态数值,即(8-d)*cos(α) 2*cos(β) 2/16,该动态数值根据d,α,β的竖直动态变化,d代表两个细节点的距离差,α,β代表两个细节点的角度差,使得ml(i,j)融合了两个细节点的距离差和角度差信息,能够更好衡量两个细节点之间的相似性,最终提高指纹比对精度,降低了等错误率等评价指标。并且当限定盒内存在两个或以上的可能与被匹配细节点相匹配的待匹配细节点时,有助于选择出一个更优的匹配细节点对。 Different from related technologies, the method in this embodiment does not add a fixed item after 0.5*sl(i,j), but adds a dynamic value, namely (8-d)*cos(α) 2 *cos (β) 2 /16, the dynamic value changes according to the vertical dynamics of d, α, β, d represents the distance difference between two detail points, α, β represents the angle difference between two detail points, so that ml(i,j ) integrates the distance difference and angle difference information of two minutiae points, which can better measure the similarity between two minutiae points, ultimately improve the accuracy of fingerprint comparison, and reduce the evaluation indicators such as the equal error rate. And when there are two or more minutiae points to be matched that may match the minutiae points to be matched in the limited box, it is helpful to select a more optimal pair of matching minutiae points.
本实施例中,前述步骤S4:根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数,具体为如下步骤S41b。In this embodiment, the foregoing step S4: calculate the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each pair of minutiae points, specifically the following step S41b.
S41b:选取每个匹配确定性相似度矩阵的匹配细节点对并计算每个匹配确定性相似度矩阵的匹配分数;并根据所有匹配分数计算计算总匹配分数。S41b: Select the matching detail point pairs of each matching deterministic similarity matrix and calculate the matching score of each matching deterministic similarity matrix; and calculate the total matching score according to all matching scores.
仍旧以只获取一个匹配对(a,b)为例举例说明,匹配对(a,b)对应一个匹配确定性相似度矩阵,示例性的,匹配对(a,b)对应的匹配确定性相似度矩阵的匹配细节点对和匹配分数的一个具体计算方式为:Still taking only one matching pair (a, b) as an example, the matching pair (a, b) corresponds to a matching deterministic similarity matrix, for example, the matching deterministic similarity of the matching pair (a, b) A specific calculation method of matching detail point pairs and matching scores of the degree matrix is:
首先对于该匹配确定性相似度矩阵,若其第i行第j列的元素ml(i,j)不是其第i行中的最大值或者不是其第j列中的最大值,则将ml(i,j)置为0。First, for the matching deterministic similarity matrix, if the element ml(i,j) in the i-th row and j-th column is not the maximum value in the i-th row or not the maximum value in the j-th column, then the ml( i, j) are set to 0.
这样处理后,匹配确定性相似度矩阵中那些非0的元素即对应了一个个相应的匹配细节点对。After such processing, those non-zero elements in the matching deterministic similarity matrix correspond to corresponding matching detail point pairs.
然后,通过如下公式计算该匹配确定性相似度矩阵的匹配分数s:Then, the matching score s of the matching certainty similarity matrix is calculated by the following formula:
Figure PCTCN2022135830-appb-000095
Figure PCTCN2022135830-appb-000095
匹配分数s越高越代表参与比对的第一张指纹图像和第二张指纹图像越可能是同一个指纹的两张图像。The higher the matching score s, the more likely the first fingerprint image and the second fingerprint image participating in the comparison are two images of the same fingerprint.
类似的,当获取了多个匹配对时,每个匹配对均分别计算得到一个匹配分数。Similarly, when multiple matching pairs are obtained, each matching pair is calculated to obtain a matching score.
当只获取一个匹配对时,只计算得到一个匹配分数,则总匹配分数即为这一个本身。When only one matching pair is fetched, only one matching score is calculated, and the total matching score is this one itself.
当获取了多个匹配对时,例如5个匹配对,对于每一个匹配对都计算一个匹配分数,根据这些匹配分数的统计值计算总匹配分数,可以改善指纹比对结果,取得更低的等错误率。例如可以取这些匹配分数中的最高值作为总匹配分数,或者取些匹配分数中最高的两个值的平均值作为总匹配分数等。When multiple matching pairs are obtained, for example, 5 matching pairs, a matching score is calculated for each matching pair, and the total matching score is calculated according to the statistics of these matching scores, which can improve the fingerprint comparison results and achieve lower etc. Error rate. For example, the highest value among these matching scores may be taken as the total matching score, or the average value of the two highest values among some matching scores may be taken as the total matching score.
计算得到总匹配分数后,既可以根据总匹配分数得到指纹比对结果。After the total matching score is calculated, the fingerprint comparison result can be obtained according to the total matching score.
为清楚的说明本实施例的效果,进行了如下测试:构造一个都是500DPI的指纹测试集,如果按照现有技术的基于细节点的指纹匹配算法测试,其等错误率为5.5%,而本申请的指纹比对方法的等错误率为3.7%,与现有技术相比,等错误率降低了约32.7%,结果有了较大的改善。In order to clearly illustrate the effect of this embodiment, the following test has been carried out: construct a fingerprint test set that is all 500DPI, if it is tested according to the fingerprint matching algorithm based on the minutiae of the prior art, its equal error rate is 5.5%, while this The equal error rate of the applied fingerprint comparison method is 3.7%, which is about 32.7% lower than the prior art, and the result has been greatly improved.
综上所述,本申请实施例改善了匹配确定性相似度矩阵的计算方式,融合了距离差和角度差信息以及限定盒相关的信息用来计算匹配确定性相似度数值,能够更好衡量两个细节点之间的相似性,并且有助于选择更优的匹配细节点对。在测试集上的测试结果与相关技术相比有较大的改善,降低了等错误率等评价指标。To sum up, the embodiment of the present application improves the calculation method of the matching deterministic similarity matrix, and combines the distance difference and angle difference information and the information related to the bounding box to calculate the matching deterministic similarity value, which can better measure the two The similarity between minutiae points and helps to select a better matching minutiae point pair. Compared with related technologies, the test results on the test set have been greatly improved, and the evaluation indicators such as the equal error rate have been reduced.
应该理解的是,虽然如上所述的各实施例所涉及的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,这些步骤可以以其它的顺序执行。而且,如上所述的各实施例所涉及的流程图中的至少一部分步骤可以包括多个步骤或者多个阶段,这些步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些步骤或者阶段的执行顺序也不必然是依次进行,而是可以与其它步骤或者其它步骤中的步骤或者阶段的至少一部分轮流或者交替地执行。It should be understood that although the steps in the flow charts involved in the above embodiments are shown sequentially according to the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in the flow charts involved in the above-mentioned embodiments may include multiple steps or stages, and these steps or stages are not necessarily executed at the same time, but may be performed at different times For execution, the execution order of these steps or stages is not necessarily performed sequentially, but may be executed in turn or alternately with other steps or at least a part of steps or stages in other steps.
实施例4:Example 4:
本申请一实施例提供一种指纹比对装置,如图14所述,所述装置包括:An embodiment of the present application provides a fingerprint comparison device, as shown in Figure 14, the device includes:
数据准备模块1,用于获取第一张指纹图像的第一组细节点和第二张指纹图像的第二组细节点。The data preparation module 1 is used to obtain the first group of minutiae points of the first fingerprint image and the second group of minutiae points of the second fingerprint image.
获取模块2,用于获取第一组细节点和第二组细节点的匹配细节点对。The acquiring module 2 is configured to acquire matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points.
中间值计算模块3,用于针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值。Intermediate value calculation module 3, for each matching detail point pair, according to the distance and angle difference between two detail points of the matching detail point pair, and the neighborhood detail point information to calculate the value of the matching detail point pair The median value of the similarity.
匹配分数计算模块4,用于根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数。The matching score calculation module 4 is configured to calculate the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each matching pair of minutiae points.
实施例5:Example 5:
本申请另一实施例提供一种指纹比对装置,如图15所示,所述装置包括:Another embodiment of the present application provides a fingerprint comparison device, as shown in Figure 15, the device includes:
数据准备模块1a,用于获取第一张指纹图像的第一组细节点和第二张指纹图像的第二组细节点。The data preparation module 1a is used to obtain the first group of minutiae points of the first fingerprint image and the second group of minutiae points of the second fingerprint image.
数据获取模块2a,用于获取第一组细节点和第二组细节点的匹配细节点对。The data acquisition module 2a is configured to acquire matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points.
本实施例中,所述中间值获取模块3可以包括刚性变换模块3a和贡献数值计算模块4a。In this embodiment, the intermediate value acquisition module 3 may include a rigid transformation module 3a and a contribution value calculation module 4a.
刚性变换模块3a,用于选取一个匹配细节点对作为基准细节点对,并对第二组细节点中的所有细节点均做使得所述基准细节点对的两个细节点重合的刚性变换。The rigid transformation module 3a is configured to select a matching minutiae point pair as a reference minutiae point pair, and perform a rigid transformation on all minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincide.
贡献数值计算模块4a,用于对每一个匹配细节点对,根据所述匹配细节点对以及对应的邻域细节点对计算所述匹配细节点对的贡献数值。The contribution value calculation module 4a is configured to, for each matching minutiae point pair, calculate the contribution value of the matching minutiae point pair according to the matching minutiae point pair and the corresponding neighborhood minutiae point pair.
所述贡献数值即为实施例4中所述的相似度中间值。The contribution value is the median similarity value described in Embodiment 4.
其中,所述邻域细节点对为所述匹配细节点对设定邻域范围内的所有匹配细节点对。Wherein, the neighborhood minutiae point pair sets all the matching minutiae point pairs within the neighborhood range for the matching minutiae point pair.
匹配分数计算模块5a,用于根据所有匹配细节点对的贡献数值计算所述第一张指纹图像与所述第二张指纹图像之间的匹配分数。The matching score calculation module 5a is configured to calculate the matching score between the first fingerprint image and the second fingerprint image according to the contribution values of all matching minutiae point pairs.
本申请在计算配细节点对的贡献数值时,不仅根据匹配细节点对的两个细节点计算,还根据匹配细节点对的邻域内的邻域细节点对计算,充分利用匹配细节点对自身和周围一定范围内蕴含的有用信息,很好的评价两个指纹图像的相似程度,提高了指纹比对的精度。When calculating the contribution value of a matching minutiae point pair, this application not only calculates based on the two minutiae points of the matching minutiae point pair, but also calculates the neighborhood minutiae point pair within the neighborhood of the matching minutiae point pair, making full use of the matching minutiae point pair itself It can evaluate the similarity of two fingerprint images very well and improve the accuracy of fingerprint comparison.
作为本申请实施例的一种改进,所述贡献数值计算模块包括:As an improvement to the embodiment of the present application, the contribution numerical calculation module includes:
第一计算单元,用于根据所述匹配细节点对的两个细节点的距离和角度差计算所述匹配细节点对的第一贡献数值。The first calculation unit is configured to calculate the first contribution value of the matching minutiae point pair according to the distance and angle difference between two minutiae points of the matching minutiae point pair.
刚性变换单元,用于对所述匹配细节点对设定邻域范围内的每个邻域细节点对的第二组细节点均做使得所述匹配细节点对的两个细节点重合的刚性变换。A rigid transformation unit, configured to perform rigidity on the second group of minutiae points of each neighborhood minutiae point pair within the set neighborhood range of the matching minutiae point pair so that the two minutiae points of the matching minutiae point pair coincide transform.
第二计算单元,用于对每一个邻域细节点对,根据所述邻域细节点对的两个细节点的距离和角度差,以及对应的内角值计算每个邻域细节点对的第二贡献数值。The second calculation unit is used to calculate the first-th value of each neighborhood detail point pair according to the distance and angle difference between the two detail points of the neighborhood detail point pair and the corresponding interior angle value for each neighborhood detail point pair. 2. Contribution value.
其中,所述内角值为所述邻域细节点对的两个细节点与所述匹配细节点对形成的内角的角度值。Wherein, the internal angle value is an angle value of an internal angle formed by two minutiae points of the neighborhood minutiae point pair and the matching minutiae point pair.
第三计算单元,用于根据所述匹配细节点对的第一贡献数值和所有邻域细节点对的第二贡献数值计算所述匹配细节点对的贡献数值。The third calculation unit is configured to calculate the contribution value of the matching minutiae point pair according to the first contribution value of the matching minutiae point pair and the second contribution values of all neighborhood minutiae point pairs.
进一步的,可以通过如下公式计算所述匹配细节点对的第一贡献数值;Further, the first contribution value of the matching detail point pair can be calculated by the following formula;
sd=Z(d i11)*Z(Δθ i22) sd=Z(d i11 )*Z(Δθ i22 )
其中,sd为所述匹配细节点对的第一贡献数值,Z(,,)为sigmoid函数,d i和Δθ i分别为i个匹配细节点对的两个细节点的距离和角度差,i=1,2,…,N,N为匹配细节点对的个数,μ 1122为设定的参数; Wherein, sd is the first contribution value of the pair of matching minutiae points, Z(,,) is a sigmoid function, d i and Δθ i are respectively the distance and angle difference between two minutiae points of i matching minutiae point pairs, i =1,2,...,N, N is the number of matching minutiae point pairs, μ 1 , τ 1 , μ 2 , τ 2 are the set parameters;
通过如下公式计算每个邻域细节点对的第二贡献数值;The second contribution value of each neighborhood detail point pair is calculated by the following formula;
其中,sn j为第j个邻域细节点对的第二贡献数值,j=1,2,…,M,M为所述匹配细节点对设定邻域范围内的邻域细节点对的个数,sn j=Z(d j11)*Z(Δθ j22)*Z(α j33),d j和Δθ j分别为第j个邻域细节点对的两个细节点的距离和角度差,α j为第j个邻域细节点对的两个细节点与所述匹配细节点对形成的内角的角度值,μ 33为设定的参数; Among them, sn j is the second contribution value of the jth neighborhood detail point pair, j=1, 2,..., M, M is the neighborhood detail point pair within the neighborhood range of the matching detail point pair number, sn j = Z(d j11 )*Z(Δθ j22 )*Z(α j33 ), d j and Δθ j are respectively The distance and angle difference between the two minutiae points of the j neighborhood minutiae point pair, α j is the angle value of the interior angle formed by the two minutiae points of the jth neighborhood minutiae point pair and the matching minutiae point pair, μ 3 , τ 3 is the set parameter;
通过如下公式计算所述匹配细节点对的贡献数值;Calculate the contribution value of the matching detail point pair by the following formula;
Figure PCTCN2022135830-appb-000096
Figure PCTCN2022135830-appb-000096
其中,pairscpre i为第i个匹配细节点对的贡献数值,np和nq分别为所述匹配细节点对设定邻域范围内第一组细节点的个数和第二组细节点的个数; Wherein, pairscpre i is the contribution value of the ith matching minutiae point pair, np and nq are respectively the number of the first group of minutiae points and the number of the second group of minutiae points in the set neighborhood of the matching minutiae point ;
Figure PCTCN2022135830-appb-000097
Figure PCTCN2022135830-appb-000097
.
本申请可以通过如下公式计算所述第一张指纹图像与所述第二张指纹图像之间的匹配分数:The application can calculate the matching score between the first fingerprint image and the second fingerprint image through the following formula:
Figure PCTCN2022135830-appb-000098
Figure PCTCN2022135830-appb-000098
其中,s为所述第一张指纹图像与所述第二张指纹图像之间的匹配分数,N1和N2分别为第一组细节点的个数和第二组细节点的个数。Wherein, s is the matching score between the first fingerprint image and the second fingerprint image, N1 and N2 are the numbers of the first group of minutiae points and the number of the second group of minutiae points respectively.
前述的刚性变换模块包括:The aforementioned rigid transformation modules include:
重心计算单元,用于计算所有匹配细节点对的第一组细节点的重心。The center of gravity calculation unit is used to calculate the center of gravity of the first group of minutiae points of all matching minutiae point pairs.
基准细节点对选择单元,用于从所有匹配细节点对的第一组细节点中找出距离所述重心最近的一个第一组细节点,将找出的第一组细节点所属的匹配细节点对作为所述基准细节点对。The reference minutiae point pair selection unit is used to find out the first group of minutiae points closest to the center of gravity from the first group of minutiae points of all matching minutiae point pairs, and the matching minutiae to which the found first group of minutiae points belong point pair as the reference detail point pair.
第四计算单元,用于计算所述基准细节点对的两个细节点的角度差Δθ和坐标差Δx,Δy。The fourth calculation unit is used to calculate the angle difference Δθ and the coordinate difference Δx, Δy of the two minutiae points of the reference minutiae point pair.
Δθ=θ2-θ1Δθ=θ2-θ1
Figure PCTCN2022135830-appb-000099
Figure PCTCN2022135830-appb-000099
其中,(x2,y2,θ2)为所述基准细节点对的第一组细节点的坐标和方向角,(x1,y1,θ1)为所述基准细节点对的第二组细节点的坐标和方向角。Among them, (x2, y2, θ2) are the coordinates and direction angles of the first group of minutiae points of the reference minutiae point pair, and (x1, y1, θ1) are the coordinates of the second group of minutiae points of the reference minutiae point pair and orientation angle.
变换单元,用于根据所述基准细节点对的两个细节的角度差Δθ和坐标差Δx,Δy计算刚性变换后第二组细节点的坐标和方向角。The transformation unit is configured to calculate the coordinates and direction angles of the second group of minutiae after rigid transformation according to the angle difference Δθ and the coordinate difference Δx, Δy between the two minutiae of the reference minutiae point pair.
Figure PCTCN2022135830-appb-000100
Figure PCTCN2022135830-appb-000100
θ′=θ-Δθθ'=θ-Δθ
其中,(x,y,θ)为刚性变换前第二组细节点的坐标和方向角,(x′,y′,θ′)为刚性变换后第二组细节点的坐标和方向角。Among them, (x, y, θ) are the coordinates and orientation angles of the second group of minutiae points before rigid transformation, and (x′, y′, θ′) are the coordinates and orientation angles of the second group of minutiae points after rigid transformation.
本申请的装置还可以包括:The device of the present application may also include:
比对模块,用于根据所述第一张指纹图像与所述第二张指纹图像之间的匹配分数得到指纹比对结果。A comparison module, configured to obtain a fingerprint comparison result according to the matching score between the first fingerprint image and the second fingerprint image.
本申请实施例所提供的装置,其实现原理及产生的技术效果和前述方法实施例2相同,为简要描述,该装置实施例部分未提及之处,可参考前述方法实施例2中相应内容。所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,前述描述的装置和单元的具体工作过程,均可以参考上述方法实施例2中的对应过程,在此不再赘述。The implementation principle and technical effect of the device provided by the embodiment of the present application are the same as those of the aforementioned method embodiment 2. For a brief description, for the parts not mentioned in the device embodiment, please refer to the corresponding content in the aforementioned method embodiment 2 . Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the devices and units described above can refer to the corresponding process in the above method embodiment 2, which will not be repeated here.
实施例6:Embodiment 6:
本申请另一实施例提供一种指纹比对装置,如图16所示,所述装置包括:Another embodiment of the present application provides a fingerprint comparison device, as shown in Figure 16, the device includes:
数据准备模块1b,用于获取第一张指纹图像的第一组细节点和第二张指纹图像的第二组细节点。The data preparation module 1b is used to acquire the first group of minutiae points of the first fingerprint image and the second group of minutiae points of the second fingerprint image.
本实施例中,实施例4中的数据获取模块2可以包括2-近邻结构表示计算模块2b、局部相似度矩阵计算模块3b、匹配对确定模块4b。In this embodiment, the data acquisition module 2 in Embodiment 4 may include a 2-nearest neighbor structure representation calculation module 2b, a local similarity matrix calculation module 3b, and a matching pair determination module 4b.
2-近邻结构表示计算模块2b,用于计算第一组细节点中每个细节点的2-近邻结构表示和第二组细节点中每个细节点的2-近邻结构表示。The 2-nearest neighbor structure representation calculation module 2b is configured to calculate the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points.
局部相似度矩阵计算模块3b,用于根据第一组细节点中每个细节点的2-近邻结构表示和第二组细节点中每个细节点的2-近邻结构表示计算第一组细节点和第二组细节点的局部相似度矩阵。The local similarity matrix calculation module 3b is used to calculate the first group of minutiae points according to the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points and the local similarity matrix of the second set of minutiae points.
匹配对确定模块4b,用于按照从大到小的顺序从局部相似度矩阵中选取若干个元素,并获取选取的每个元素对应的两个细节点作为匹配对。The matching pair determination module 4b is configured to select several elements from the local similarity matrix in descending order, and obtain two minutiae points corresponding to each selected element as a matching pair.
本实施例中,实施例4中的中间值计算模块3可以包括匹配确定性相似度矩阵计算模块5b。In this embodiment, the intermediate value calculation module 3 in Embodiment 4 may include a matching deterministic similarity matrix calculation module 5b.
匹配确定性相似度矩阵计算模块5b,对每个匹配对,根据所述局部相似度矩阵和所述匹配对的两个细节点之间的距离差和角度差计算所述匹配对的匹配确定性相似度矩阵。Matching certainty similarity matrix calculation module 5b, for each matching pair, calculate the matching certainty of the matching pair according to the distance difference and angle difference between the local similarity matrix and the two minutiae points of the matching pair similarity matrix.
所述匹配确定性相似度矩阵即为实施例4中所述的相似度中间值。The matching deterministic similarity matrix is the median similarity value described in Embodiment 4.
匹配分数计算模块6b,用于选取每个匹配确定性相似度矩阵的匹配细节点对并计算每个匹配确定性相似度矩阵的匹配分数;并根据所有匹配分数计算计算总匹配分数。The matching score calculation module 6b is used to select the matching detail point pairs of each matching deterministic similarity matrix and calculate the matching score of each matching deterministic similarity matrix; and calculate the total matching score according to all matching scores.
其中,通过如下公式计算每个匹配对的匹配确定性相似度矩阵:Among them, the matching certainty similarity matrix of each matching pair is calculated by the following formula:
Figure PCTCN2022135830-appb-000101
Figure PCTCN2022135830-appb-000101
其中,匹配对包括第一组细节点中的第a个细节点和第二组细节点中的第b个细节点,ml(i,j)为匹配确定性相似度矩阵第i行第j列的元素,i=1,2,…,M,j=1,2,…,N,sl(i,j)为局部相似度矩阵第i行第j列的元素,d,α,β为三维向量v0的三个元素的绝对值,
Figure PCTCN2022135830-appb-000102
Figure PCTCN2022135830-appb-000103
为以第一组细节点中的第a个细节点为参照对第一组细节点中的第i个细节点进行极坐标运算得到的特征向量,
Figure PCTCN2022135830-appb-000104
为以第二组细节点中的第b个细节点为参照对第二组细节点中的第j个细节点进行极坐标运算得到的特征向量。
Among them, the matching pair includes the a-th minutiae point in the first group of minutiae points and the b-th minutiae point in the second group of minutiae points, ml(i, j) is the i-th row and j-th column of the matching certainty similarity matrix elements of i=1,2,...,M, j=1,2,...,N, sl(i,j) is the element of row i, column j of the local similarity matrix, d,α,β are three-dimensional the absolute value of the three elements of vector v0,
Figure PCTCN2022135830-appb-000102
Figure PCTCN2022135830-appb-000103
is the eigenvector obtained by performing the polar coordinate operation on the i-th minutiae point in the first group of minutiae points with reference to the a-th minutiae point in the first group of minutiae points,
Figure PCTCN2022135830-appb-000104
is a feature vector obtained by performing polar coordinate operation on the jth minutiae point in the second group of minutiae points with reference to the bth minutiae point in the second group of minutiae points.
本申请实施例改善了匹配确定性相似度矩阵的计算方式,融合了距离差和角度差信息以及限定盒相关的信息用来计算匹配确定性相似度数值,能够更好衡量两个细节点之间的相似性,并且有助于选择更优的匹配细节点对。在测试集上的测试结果与现有技术相比有较大的改善,降低了等错误率等评价指标。The embodiment of the present application improves the calculation method of the matching deterministic similarity matrix, and combines the distance difference and angle difference information and the information related to the bounding box to calculate the matching deterministic similarity value, which can better measure the relationship between two detail points similarity, and help to select better matching detail point pairs. Compared with the existing technology, the test results on the test set have been greatly improved, and the evaluation indicators such as the equal error rate have been reduced.
在其中一个示例中,通过如下公式计算第一组细节点中每个细节点的2-近邻结构表示:In one of the examples, the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae is calculated by the following formula:
Figure PCTCN2022135830-appb-000105
Figure PCTCN2022135830-appb-000105
其中,Fl i为第一组细节点中第i个细节点F i的2-近邻结构表示,p和q分别为与第i个细节点F i最近的两个细节点F p和F q的编号,
Figure PCTCN2022135830-appb-000106
t l、(x l,y l)和
Figure PCTCN2022135830-appb-000107
分别为第l个细节点F i的类型、坐标和角度,l取i,p,q;
Among them, Fl i is the 2-nearest neighbor structure representation of the i-th minutiae F i in the first group of minutiae points, p and q are the two minutiae points F p and F q closest to the i-th minutiae F i respectively serial number,
Figure PCTCN2022135830-appb-000106
t l , (x l ,y l ) and
Figure PCTCN2022135830-appb-000107
Respectively, the type, coordinates and angle of the lth detail point F i , l takes i, p, q;
Figure PCTCN2022135830-appb-000108
Figure PCTCN2022135830-appb-000108
Figure PCTCN2022135830-appb-000109
Figure PCTCN2022135830-appb-000109
Figure PCTCN2022135830-appb-000110
Figure PCTCN2022135830-appb-000110
Figure PCTCN2022135830-appb-000111
Figure PCTCN2022135830-appb-000111
Figure PCTCN2022135830-appb-000112
Figure PCTCN2022135830-appb-000112
Figure PCTCN2022135830-appb-000113
Figure PCTCN2022135830-appb-000113
n ip为第一组细节点中第i个细节点和第p个细节点连线上的脊线的条数,n iq为第一组细节点中第i个细节点和第q个细节点连线上的脊线的条数; n ip is the number of ridge lines on the line between the i-th detail point and the p-th detail point in the first group of detail points, and n iq is the i-th detail point and the q-th detail point in the first group of detail points The number of ridges on the connection;
dφ(t 1,t 2)为角度差函数,其定义为: dφ(t 1 ,t 2 ) is the angle difference function, which is defined as:
Figure PCTCN2022135830-appb-000114
Figure PCTCN2022135830-appb-000114
.
相应的,通过如下公式计算第二组细节点中每个细节点的2-近邻结构表示:Correspondingly, the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points is calculated by the following formula:
Figure PCTCN2022135830-appb-000115
Figure PCTCN2022135830-appb-000115
其中,Gl j为第二组细节点中第j个细节点G j的2-近邻结构表示,m和n分别为与第j个细节点G j最近的两个细节点G m和G n的编号,
Figure PCTCN2022135830-appb-000116
t h、(x h,y h)和
Figure PCTCN2022135830-appb-000117
分别为第h个细节点G h的类型、坐标和角度,h取j,m,n;
Among them, Gl j is the 2-nearest neighbor structure representation of the jth minutiae G j in the second group of minutiae points, m and n are the two minutiae points G m and G n closest to the jth minutiae G j respectively serial number,
Figure PCTCN2022135830-appb-000116
t h , (x h ,y h ) and
Figure PCTCN2022135830-appb-000117
Respectively, the type, coordinates and angle of the hth detail point G h , where h takes j, m, n;
Figure PCTCN2022135830-appb-000118
Figure PCTCN2022135830-appb-000118
Figure PCTCN2022135830-appb-000119
Figure PCTCN2022135830-appb-000119
Figure PCTCN2022135830-appb-000120
Figure PCTCN2022135830-appb-000120
Figure PCTCN2022135830-appb-000121
Figure PCTCN2022135830-appb-000121
Figure PCTCN2022135830-appb-000122
Figure PCTCN2022135830-appb-000122
Figure PCTCN2022135830-appb-000123
Figure PCTCN2022135830-appb-000123
n jm为第二组细节点中第j个细节点和第m个细节点连线上的脊线的条数,n jn为第二组细节点中第j个细节点和第n个细节点连线上的脊线的条数。 n jm is the number of ridge lines on the line between the jth minutiae point and the mth minutiae point in the second group of minutiae points, and n jn is the jth minutiae point and the nth minutiae point in the second group of minutiae points The number of ridges on the link.
示例性的,通过如下公式计算局部相似度矩阵:Exemplarily, the local similarity matrix is calculated by the following formula:
Figure PCTCN2022135830-appb-000124
Figure PCTCN2022135830-appb-000124
其中,A为加权系数向量W与向量V的点积;Among them, A is the dot product of the weighting coefficient vector W and the vector V;
Figure PCTCN2022135830-appb-000125
w d=1,w θ=0.3*180/π,
Figure PCTCN2022135830-appb-000126
w n=3,w t=3,V=|V0|,V0=Fl i-Gl j
Figure PCTCN2022135830-appb-000125
w d =1,w θ =0.3*180/π,
Figure PCTCN2022135830-appb-000126
w n =3, w t =3, V=|V0|, V0=Fl i -Gl j .
通过如下公式计算特征向量
Figure PCTCN2022135830-appb-000127
Figure PCTCN2022135830-appb-000128
Calculate the eigenvectors by the following formula
Figure PCTCN2022135830-appb-000127
and
Figure PCTCN2022135830-appb-000128
Figure PCTCN2022135830-appb-000129
Figure PCTCN2022135830-appb-000129
Figure PCTCN2022135830-appb-000130
Figure PCTCN2022135830-appb-000130
其中,(x a,y a)和
Figure PCTCN2022135830-appb-000131
分别为第一组细节点中的第a个细节点的坐标和角度,(x b,y b)和
Figure PCTCN2022135830-appb-000132
分别为第二组细节点中的第b个细节点的坐标和角度。
Among them, (x a ,y a ) and
Figure PCTCN2022135830-appb-000131
are respectively the coordinates and angles of the ath minutiae point in the first group of minutiae points, (x b , y b ) and
Figure PCTCN2022135830-appb-000132
are the coordinates and angles of the bth minutiae point in the second group of minutiae points, respectively.
作为本申请实施例的一种改进,匹配分数计算模块包括:As an improvement of the embodiment of the present application, the matching score calculation module includes:
匹配细节点对确定单元,用于对于每个匹配确定性相似度矩阵,若其第i行第j列的元素ml(i,j)不是其第i行中的最大值或者不是其第j列中的最大值,则将ml(i,j)置为0。The matching detail point pair determination unit is used for each matching deterministic similarity matrix, if the element ml(i, j) in the i-th row and j-th column is not the maximum value in its i-th row or not its j-th column The maximum value in , set ml(i,j) to 0.
匹配分数计算单元,用于通过如下公式计算每个匹配确定性相似度矩阵的匹配分数s:The matching score calculation unit is used to calculate the matching score s of each matching certainty similarity matrix by the following formula:
Figure PCTCN2022135830-appb-000133
Figure PCTCN2022135830-appb-000133
.
本实施例的指纹比对装置还可以包括:The fingerprint comparison device of the present embodiment may also include:
比对结果确定模块,用于根据总匹配分数得到指纹比对结果。The comparison result determination module is used to obtain the fingerprint comparison result according to the total matching score.
本实施例所提供的装置,其实现原理及产生的技术效果和前述方法实施例3相同,为简要描述,该装置实施例部分未提及之处,可参考前述方法实施例3中相应内容。所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,前述描述的装置和单元的具体工作过程,均可以参考上述方法实施例3中的对应过程,在此不再赘述。The implementation principle and technical effects of the device provided in this embodiment are the same as those of the aforementioned method embodiment 3. For a brief description, for the part not mentioned in the device embodiment, reference may be made to the corresponding content in the aforementioned method embodiment 3. Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the devices and units described above can refer to the corresponding process in the above method embodiment 3, which will not be repeated here.
上述装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中,也可以以软件形式存储于计算机设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。Each module in the above-mentioned device can be fully or partially realized by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, and can also be stored in the memory of the computer device in the form of software, so that the processor can invoke and execute the corresponding operations of the above-mentioned modules.
实施例7:Embodiment 7:
本申请提供的上述实施例1-3所述的方法可以通过计算机程序实现业务逻辑并记录在存储介质上,所述的存储介质可以被计算机读取并执行,实现本说明书实施例1-3所描述方案的效果。因此,本申请还提供用于指纹比对的计算机可读存储介质,包括用于存储处理器可执行指令的存储器,指令被处理器执行时实现包括实施例1-3的指纹比对方法的步骤。The methods described in the above-mentioned embodiments 1-3 provided by this application can implement business logic through computer programs and record them on storage media, and the storage media can be read and executed by computers to realize the methods described in embodiments 1-3 of this specification. Describe the effects of the program. Therefore, the present application also provides a computer-readable storage medium for fingerprint comparison, including a memory for storing processor-executable instructions. When the instructions are executed by the processor, the steps of the fingerprint comparison method of Embodiments 1-3 are realized. .
在一些实施例中,本申请在计算配细节点对的贡献数值时,不仅根据匹配细节点对的两个细节点计算,还根据匹配细节点对的邻域内的邻域细节点对计算,充分利用匹配细节点对自身和周围一定范围内蕴含的有用信息,很好的评价两个指纹图像的相似程度,提高了指纹比对的精度。In some embodiments, when the present application calculates the contribution value of a matching minutiae pair, it is not only calculated based on the two minutiae points of the matching minutiae point pair, but also calculated based on the neighborhood minutiae point pair within the neighborhood of the matching minutiae point pair, fully Utilizing the useful information contained in the matching minutiae point itself and within a certain range around it, the similarity of two fingerprint images is well evaluated, and the accuracy of fingerprint comparison is improved.
在一些实施例中,本申请改善了匹配确定性相似度矩阵的计算方式,融合了距离差和角度差信息以及限定盒相关的信息用来计算匹配确定性相似度数值,能够更好衡量两个细节点之间的相似性,并且有助于选择更优的匹配细节点对。在测试集上的测试结果与相关技术相比有较大的改善,降低了等错误率等评价指标。In some embodiments, the present application improves the calculation method of the matching deterministic similarity matrix, and combines the distance difference and angle difference information and the information related to the bounding box to calculate the matching deterministic similarity value, which can better measure the two The similarity between minutiae points helps to select better matching minutiae pairs. Compared with related technologies, the test results on the test set have been greatly improved, and the evaluation indicators such as the equal error rate have been reduced.
所述存储介质可以包括用于存储信息的物理装置,通常是将信息数字化后再以利用电、磁或者光学等方式的媒体加以存储。所述存储介质有可以包括:利用电能方式存储信息的装置如,各式存储器,如RAM、ROM等;利用磁能方式存储信息的装置如,硬盘、软盘、磁带、磁芯存储器、磁泡存储器、U盘;利用光学方式存储信息的装置如,CD或DVD。当然,还有其他方式的可读存储介质,例如量子存储器、石墨烯存储器等等。The storage medium may include a physical device for storing information, and information is usually digitized and then stored using an electrical, magnetic, or optical medium. Described storage medium can include: the device that utilizes electric energy mode to store information such as, various memory, as RAM, ROM etc.; USB stick; a device that stores information optically, such as a CD or DVD. Of course, there are other readable storage media, such as quantum memory, graphene memory and so on.
上述所述的存储介质根据方法实施例1-3的描述还可以包括其他的实施方式,本实施例的实现原理及产生的技 术效果和前述方法实施例1-3相同,具体可以参照相关方法实施例1-3的描述,在此不作一一赘述。The above-mentioned storage medium may also include other implementations according to the descriptions of method embodiments 1-3. The implementation principle and technical effects of this embodiment are the same as those of the aforementioned method embodiments 1-3. For details, refer to related methods for implementation. The descriptions of Examples 1-3 are not repeated here.
实施例8:Embodiment 8:
本申请还提供一种用于指纹比对的设备,所述的设备可以为单独的计算机,也可以包括使用了本说明书的一个或多个所述方法或一个或多个实施例装置的实际操作装置等。所述指纹比对的设备可以包括至少一个处理器以及存储计算机可执行指令的存储器,处理器执行所述指令时实现上述任意一个或者多个实施例1-3中所述指纹比对方法的步骤。The present application also provides a device for fingerprint comparison, which may be a separate computer, or may include the actual operation of using one or more of the methods described in this specification or one or more embodiments of the device device etc. The device for fingerprint comparison may include at least one processor and a memory storing computer-executable instructions. When the processor executes the instructions, the steps of the fingerprint comparison method described in any one or more of the above-mentioned embodiments 1-3 are implemented. .
本申请一些实施例中,在计算配细节点对的贡献数值时,不仅根据匹配细节点对的两个细节点计算,还根据匹配细节点对的邻域内的邻域细节点对计算,充分利用匹配细节点对自身和周围一定范围内蕴含的有用信息,很好的评价两个指纹图像的相似程度,提高了指纹比对的精度。In some embodiments of the present application, when calculating the contribution value of a matching minutiae pair, it is not only calculated based on the two minutiae points of the matching minutiae point pair, but also calculated based on the neighborhood minutiae point pair within the neighborhood of the matching minutiae point pair, making full use of The useful information contained in the matching minutiae within a certain range of itself and its surroundings can be used to evaluate the similarity of two fingerprint images and improve the accuracy of fingerprint comparison.
本申请一些实施例中,改善了匹配确定性相似度矩阵的计算方式,融合了距离差和角度差信息以及限定盒相关的信息用来计算匹配确定性相似度数值,能够更好衡量两个细节点之间的相似性,并且有助于选择更优的匹配细节点对。在测试集上的测试结果与现有技术相比有较大的改善,降低了等错误率等评价指标。In some embodiments of the present application, the calculation method of the matching deterministic similarity matrix is improved, and the distance difference and angle difference information and the information related to the limited box are fused to calculate the matching deterministic similarity value, which can better measure the two details The similarity between points, and helps to select a better pair of matching minutiae points. Compared with the existing technology, the test results on the test set have been greatly improved, and the evaluation indicators such as the equal error rate have been reduced.
上述所述的设备根据方法实施例1-3的描述还可以包括其他的实施方式,本实施例的实现原理及产生的技术效果和前述方法实施例1-3相同,具体可以参照相关方法实施例1-3的描述,在此不作一一赘述。The above-mentioned equipment can also include other implementations according to the descriptions of method embodiments 1-3. The implementation principle and technical effects of this embodiment are the same as those of the aforementioned method embodiments 1-3. For details, please refer to related method embodiments The descriptions of 1-3 will not be repeated here.
最后应说明的是:以上所述实施例,仅为本申请的具体实施方式,用以说明本申请的技术方案,而非对其限制,本申请的保护范围并不局限于此,尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,其依然可以对前述实施例所记载的技术方案进行修改或可轻易想到变化,或者对其中部分技术特征进行等同替换;而这些修改、变化或者替换,并不使相应技术方案的本质脱离本申请实施例技术方案的精神和范围。都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。Finally, it should be noted that: the above-described embodiments are only specific implementations of the application, used to illustrate the technical solutions of the application, rather than limiting it, and the scope of protection of the application is not limited thereto, although referring to the aforementioned The embodiment has described this application in detail, and those of ordinary skill in the art should understand that any person familiar with this technical field can still modify the technical solutions described in the foregoing embodiments within the technical scope disclosed in this application Changes can be easily imagined, or equivalent replacements can be made to some of the technical features; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application. All should be covered within the scope of protection of this application. Therefore, the protection scope of the present application should be determined by the protection scope of the claims.

Claims (21)

  1. 一种指纹比对方法,包括:A fingerprint comparison method, comprising:
    获取第一张指纹图像的第一组细节点和第二张指纹图像的第二组细节点;Obtain the first set of minutiae points of the first fingerprint image and the second set of minutiae points of the second fingerprint image;
    获取第一组细节点和第二组细节点的匹配细节点对;Obtain the matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points;
    针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值;以及For each matching minutiae point pair, calculate the median similarity value of the matching minutiae point pair according to the distance and angle difference between two minutiae points of the matching minutiae point pair and the neighborhood minutiae point information; and
    根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数。Calculate the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each matching pair of minutiae points.
  2. 根据权利要求1所述的指纹比对方法,其中,所述针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值;以及根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数,包括:The fingerprint comparison method according to claim 1, wherein, for each matching minutiae point pair, according to the distance and angle difference between two minutiae points of the matching minutiae point pair, and the neighborhood minutiae point information calculating the median similarity value of the pair of matching minutiae points; and calculating the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each minutiae point matching pair, including :
    选取一个匹配细节点对作为基准细节点对,并对第二组细节点中的所有细节点均做使得所述基准细节点对的两个细节点重合的刚性变换;Selecting a matching minutiae point pair as a reference minutiae point pair, and performing a rigid transformation on all minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincide;
    对每一个匹配细节点对,根据所述匹配细节点对以及对应的邻域细节点对计算所述匹配细节点对的贡献数值,其中,所述贡献数值为所述相似度中间值;For each matching minutiae point pair, calculate the contribution value of the matching minutiae point pair according to the matching minutiae point pair and the corresponding neighborhood minutiae point pair, wherein the contribution value is the median value of the similarity;
    其中,所述邻域细节点对为所述匹配细节点对设定邻域范围内的所有匹配细节点对;Wherein, the neighborhood minutiae point pair sets all matching minutiae point pairs within the neighborhood range for the matching minutiae point pair;
    根据所有匹配细节点对的贡献数值计算所述第一张指纹图像与所述第二张指纹图像之间的匹配分数。The matching score between the first fingerprint image and the second fingerprint image is calculated according to the contribution values of all matching minutiae point pairs.
  3. 根据权利要求2所述的指纹比对方法,其中,所述对每一个匹配细节点对,根据所述匹配细节点对以及对应的邻域细节点对计算所述匹配细节点对的贡献数值,包括:The fingerprint comparison method according to claim 2, wherein, for each matching minutiae point pair, the contribution value of the matching minutiae point pair is calculated according to the matching minutiae point pair and the corresponding neighborhood minutiae point pair, include:
    根据所述匹配细节点对的两个细节点的距离和角度差计算所述匹配细节点对的第一贡献数值;calculating the first contribution value of the matching minutiae point pair according to the distance and angle difference between two minutiae points of the matching minutiae point pair;
    对所述匹配细节点对设定邻域范围内的每个邻域细节点对的第二组细节点均做使得所述匹配细节点对的两个细节点重合的刚性变换;performing a rigid transformation on the second group of minutiae points of each neighborhood minutiae point pair within the set neighborhood range of the matching minutiae point pair so that the two minutiae points of the matching minutiae point pair coincide;
    对每一个邻域细节点对,根据所述邻域细节点对的两个细节点的距离和角度差,以及对应的内角值计算每个邻域细节点对的第二贡献数值;For each neighborhood minutiae point pair, calculate the second contribution value of each neighborhood minutiae point pair according to the distance and angle difference between the two minutiae points of the neighborhood minutiae point pair, and the corresponding interior angle value;
    其中,所述内角值为所述邻域细节点对的两个细节点与所述匹配细节点对形成的内角的角度值;Wherein, the inner angle value is an angle value of an inner angle formed by two minutiae points of the neighborhood minutiae point pair and the matching minutiae point pair;
    根据所述匹配细节点对的第一贡献数值和所有邻域细节点对的第二贡献数值计算所述匹配细节点对的贡献数值。The contribution value of the matching minutiae point pair is calculated according to the first contribution value of the matching minutiae point pair and the second contribution values of all neighborhood minutiae point pairs.
  4. 根据权利要求3所述的指纹比对方法,其中,通过如下公式计算所述匹配细节点对的第一贡献数值;The fingerprint comparison method according to claim 3, wherein the first contribution value of the matching minutiae point pair is calculated by the following formula;
    sd=Z(d i11)*Z(Δθ i22) sd=Z(d i11 )*Z(Δθ i22 )
    其中,sd为所述匹配细节点对的第一贡献数值,Z(,,)为sigmoid函数,d i和Δθ i分别为i个匹配细节点对的两个细节点的距离和角度差,i=1,2,…,N,N为匹配细节点对的个数,μ 1122为设定的参数; Wherein, sd is the first contribution value of the pair of matching minutiae points, Z(,,) is a sigmoid function, d i and Δθ i are respectively the distance and angle difference between two minutiae points of i matching minutiae point pairs, i =1,2,...,N, N is the number of matching minutiae point pairs, μ 1 , τ 1 , μ 2 , τ 2 are the set parameters;
    通过如下公式计算每个邻域细节点对的第二贡献数值;The second contribution value of each neighborhood detail point pair is calculated by the following formula;
    其中,sn j为第j个邻域细节点对的第二贡献数值,j=1,2,…,M,M为所述匹配细节点对设定邻域范围内的邻域细节点对的个数,sn j=Z(d j11)*Z(Δθ j22)*Z(α j33),d j和Δθ j分别为第j个邻域细节点对的两个细节点的距离和角度差,α j为第j个邻域细节点对的两个细节点与所述匹配细节点对形成的内角的角度值,μ 33为设定的参数; Among them, sn j is the second contribution value of the jth neighborhood detail point pair, j=1, 2,..., M, M is the neighborhood detail point pair within the neighborhood range of the matching detail point pair number, sn j = Z(d j11 )*Z(Δθ j22 )*Z(α j33 ), d j and Δθ j are respectively The distance and angle difference between the two minutiae points of the j neighborhood minutiae point pair, α j is the angle value of the interior angle formed by the two minutiae points of the jth neighborhood minutiae point pair and the matching minutiae point pair, μ 3 , τ 3 is the set parameter;
    通过如下公式计算所述匹配细节点对的贡献数值;Calculate the contribution value of the matching detail point pair by the following formula;
    Figure PCTCN2022135830-appb-100001
    Figure PCTCN2022135830-appb-100001
    其中,pairscore i为第i个匹配细节点对的贡献数值,np和nq分别为所述匹配细节点对设定邻域范围内第一组细节点的个数和第二组细节点的个数; Among them, pairscore i is the contribution value of the i-th matching minutiae point pair, np and nq are respectively the number of the first group of minutiae points and the number of the second group of minutiae points within the set neighborhood of the matching minutiae point ;
    Figure PCTCN2022135830-appb-100002
    Figure PCTCN2022135830-appb-100002
  5. 根据权利要求4所述的指纹比对方法,其中,通过如下公式计算所述第一张指纹图像与所述第二张指纹图像之间的匹配分数:The fingerprint comparison method according to claim 4, wherein the matching score between the first fingerprint image and the second fingerprint image is calculated by the following formula:
    Figure PCTCN2022135830-appb-100003
    Figure PCTCN2022135830-appb-100003
    其中,s为所述第一张指纹图像与所述第二张指纹图像之间的匹配分数,N1和N2分别为第一组细节点的个数和第二组细节点的个数。Wherein, s is the matching score between the first fingerprint image and the second fingerprint image, N1 and N2 are the numbers of the first group of minutiae points and the number of the second group of minutiae points respectively.
  6. 根据权利要求2所述的指纹比对方法,其中,所述选取一个匹配细节点对作为基准细节点对,包括:The fingerprint comparison method according to claim 2, wherein said selecting a matching minutiae point pair as a reference minutiae point pair comprises:
    计算所有匹配细节点对的第一组细节点的重心;Calculate the center of gravity of the first set of minutiae points of all matching minutiae point pairs;
    从所有匹配细节点对的第一组细节点中找出距离所述重心最近的一个第一组细节点,将找出的第一组细节点所属的匹配细节点对作为所述基准细节点对。Find a first group of minutiae points closest to the center of gravity from the first group of minutiae points of all matching minutiae point pairs, and use the matching minutiae point pair to which the found first group of minutiae points belong as the reference minutiae point pair .
  7. 根据权利要求2所述的指纹比对方法,其中,所述对第二组细节点中的所有细节点均做使得所述基准细节点对的两个细节点重合的刚性变换,包括:The method for comparing fingerprints according to claim 2, wherein said all minutiae points in the second group of minutiae points are subjected to a rigid transformation such that two minutiae points of said reference minutiae point pair coincide, comprising:
    计算所述基准细节点对的两个细节点的角度差Δθ和坐标差Δx,Δy;Calculate the angle difference Δθ and the coordinate difference Δx, Δy of the two minutiae points of the reference minutiae point pair;
    Δθ=θ2-θ1Δθ=θ2-θ1
    Figure PCTCN2022135830-appb-100004
    Figure PCTCN2022135830-appb-100004
    其中,(x2,y2,θ2)为所述基准细节点对的第一组细节点的坐标和方向角,(x1,y1,θ1)为所述基准细节点对的第二组细节点的坐标和方向角;Among them, (x2, y2, θ2) are the coordinates and direction angles of the first group of minutiae points of the reference minutiae point pair, and (x1, y1, θ1) are the coordinates of the second group of minutiae points of the reference minutiae point pair and orientation angle;
    根据所述基准细节点对的两个细节的角度差Δθ和坐标差Δx,Δy计算刚性变换后第二组细节点的坐标和方向角;Calculate the coordinates and orientation angles of the second group of minutiae points after the rigid transformation according to the angle difference Δθ and the coordinate difference Δx, Δy of the two details of the reference minutiae point pair;
    Figure PCTCN2022135830-appb-100005
    Figure PCTCN2022135830-appb-100005
    θ′=θ-Δθθ'=θ-Δθ
    其中,(x,y,θ)为刚性变换前第二组细节点的坐标和方向角,(x′,y′,θ′)为刚性变换后第二组细节点的坐标和方向角。Among them, (x, y, θ) are the coordinates and orientation angles of the second group of minutiae points before rigid transformation, and (x′, y′, θ′) are the coordinates and orientation angles of the second group of minutiae points after rigid transformation.
  8. 根据权利要求2-7任一所述的指纹比对方法,其中,所述方法还包括:The fingerprint comparison method according to any one of claims 2-7, wherein said method further comprises:
    根据所述第一张指纹图像与所述第二张指纹图像之间的匹配分数得到指纹比对结果。A fingerprint comparison result is obtained according to the matching score between the first fingerprint image and the second fingerprint image.
  9. 根据权利要求1所述的指纹比对方法,其中,所述获取第一组细节点和第二组细节点的匹配细节点对包括:The method for comparing fingerprints according to claim 1, wherein said obtaining the matching minutiae pairs of the first group of minutiae points and the second group of minutiae points comprises:
    计算所述第一组细节点中每个细节点的2-近邻结构表示和所述第二组细节点中每个细节点的2-近邻结构表示;calculating a 2-nearest neighbor structure representation of each minutiae in the first set of minutiae points and a 2-nearest neighbor structure representation of each minutiae point in the second set of minutiae points;
    根据所述第一组细节点中每个细节点的2-近邻结构表示和所述第二组细节点中每个细节点的2-近邻结构表示计算第一组细节点和第二组细节点的局部相似度矩阵;Calculate the first group of minutiae points and the second group of minutiae points according to the 2-nearest neighbor structure representation of each minutiae point in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points The local similarity matrix of ;
    按照从大到小的顺序从所述局部相似度矩阵中选取若干个元素,并获取选取的每个元素对应的两个细节点作为匹配对。Select several elements from the local similarity matrix in descending order, and obtain two minutiae points corresponding to each selected element as a matching pair.
  10. 根据权利要求9所述的指纹比对方法,其中,所述针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值;以及根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数,包括:The fingerprint comparison method according to claim 9, wherein, for each matching minutiae point pair, according to the distance and angle difference between two minutiae points of the matching minutiae point pair, and the neighborhood minutiae point information calculating the median similarity value of the pair of matching minutiae points; and calculating the matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each minutiae point matching pair, including :
    对每个匹配对,根据所述局部相似度矩阵和所述匹配对的两个细节点之间的距离差和角度差计算所述匹配对的匹配确定性相似度矩阵,其中,所述匹配确定性相似度矩阵为所述相似度中间值;以及For each matching pair, calculate the matching certainty similarity matrix of the matching pair according to the local similarity matrix and the distance difference and angle difference between two minutiae points of the matching pair, wherein the matching determination The sexual similarity matrix is the median value of the similarity; and
    选取每个匹配确定性相似度矩阵的匹配细节点对并计算每个匹配确定性相似度矩阵的匹配分数;并根据所有匹配分数计算计算总匹配分数。Select the matching detail point pairs of each matching deterministic similarity matrix and calculate the matching score of each matching deterministic similarity matrix; and calculate the total matching score according to all matching scores.
  11. 根据权利要求10所述的指纹比对方法,其中,通过如下公式计算每个匹配对的匹配确定性相似度矩阵:The method for comparing fingerprints according to claim 10, wherein, the matching certainty similarity matrix of each matching pair is calculated by the following formula:
    Figure PCTCN2022135830-appb-100006
    Figure PCTCN2022135830-appb-100006
    其中,所述匹配对包括第一组细节点中的第a个细节点和第二组细节点中的第b个细节点,ml(i,j)为所述匹配确定性相似度矩阵第i行第j列的元素,i=1,2,…,M,j=1,2,…,N,sl(i,j)为所述局部相似度矩阵第i行第j列的元素,d,α,β为三维向量v0的三个元素的绝对值,
    Figure PCTCN2022135830-appb-100007
    为以第一组细节点中的第a个细节点为参照对第一组细节点中的第i个细节点进行极坐标运算得到的特征向量,
    Figure PCTCN2022135830-appb-100008
    为以第二组细节点中的第b个细节点为参照对第二组细节点中的第j个细节点进行极坐标运算得到的特征向量。
    Wherein, the matching pair includes the a-th minutiae point in the first group of minutiae points and the b-th minutiae point in the second group of minutiae points, ml(i,j) is the i-th minutiae of the matching certainty similarity matrix The element in the jth column of the row, i=1, 2,..., M, j=1, 2,..., N, sl(i, j) is the element in the jth row of the local similarity matrix, d , α, β are the absolute values of the three elements of the three-dimensional vector v0,
    Figure PCTCN2022135830-appb-100007
    is the eigenvector obtained by performing the polar coordinate operation on the i-th minutiae point in the first group of minutiae points with reference to the a-th minutiae point in the first group of minutiae points,
    Figure PCTCN2022135830-appb-100008
    is a feature vector obtained by performing polar coordinate operation on the jth minutiae point in the second group of minutiae points with reference to the bth minutiae point in the second group of minutiae points.
  12. 根据权利要求11所述的指纹比对方法,其中,通过如下公式计算所述第一组细节点中每个细节点的2-近邻结构表示:The fingerprint comparison method according to claim 11, wherein the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae is calculated by the following formula:
    Figure PCTCN2022135830-appb-100009
    Figure PCTCN2022135830-appb-100009
    其中,Fl i为第一组细节点中第i个细节点F i的2-近邻结构表示,p和q分别为与第i个细节点F i最近的两个细节点F p和F q的编号,
    Figure PCTCN2022135830-appb-100010
    t l、(x l,y l)和
    Figure PCTCN2022135830-appb-100011
    分别为第l个细节点F i的类型、坐标和角度,l取i,p,q;
    Among them, Fl i is the 2-nearest neighbor structure representation of the i-th minutiae F i in the first group of minutiae points, p and q are the two minutiae points F p and F q closest to the i-th minutiae F i respectively serial number,
    Figure PCTCN2022135830-appb-100010
    t l , (x l ,y l ) and
    Figure PCTCN2022135830-appb-100011
    Respectively, the type, coordinates and angle of the lth detail point F i , l takes i, p, q;
    Figure PCTCN2022135830-appb-100012
    Figure PCTCN2022135830-appb-100012
    Figure PCTCN2022135830-appb-100013
    Figure PCTCN2022135830-appb-100013
    Figure PCTCN2022135830-appb-100014
    Figure PCTCN2022135830-appb-100014
    Figure PCTCN2022135830-appb-100015
    Figure PCTCN2022135830-appb-100015
    Figure PCTCN2022135830-appb-100016
    Figure PCTCN2022135830-appb-100016
    Figure PCTCN2022135830-appb-100017
    Figure PCTCN2022135830-appb-100017
    n ip为第一组细节点中第i个细节点和第p个细节点连线上的脊线的条数,n iq为第一组细节点中第i个细节点和第q个细节点连线上的脊线的条数; n ip is the number of ridge lines on the line between the i-th detail point and the p-th detail point in the first group of detail points, and n iq is the i-th detail point and the q-th detail point in the first group of detail points The number of ridges on the connection;
    dφ(t 1,t 2)为角度差函数,其定义为: dφ(t 1 ,t 2 ) is the angle difference function, which is defined as:
    Figure PCTCN2022135830-appb-100018
    Figure PCTCN2022135830-appb-100018
    通过如下公式计算所述第二组细节点中每个细节点的2-近邻结构表示:Calculate the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points by the following formula:
    Figure PCTCN2022135830-appb-100019
    Figure PCTCN2022135830-appb-100019
    其中,Gl j为第二组细节点中第j个细节点G j的2-近邻结构表示,m和n分别为与第j个细节点G j最近的两个细节点G m和G n的编号,
    Figure PCTCN2022135830-appb-100020
    t h、(x h,y h)和
    Figure PCTCN2022135830-appb-100021
    分别为第h个细节点G h的类型、坐标和角度,h取j,m,n;
    Among them, Gl j is the 2-nearest neighbor structure representation of the jth minutiae G j in the second group of minutiae points, m and n are the two minutiae points G m and G n closest to the jth minutiae G j respectively serial number,
    Figure PCTCN2022135830-appb-100020
    t h , (x h ,y h ) and
    Figure PCTCN2022135830-appb-100021
    Respectively, the type, coordinates and angle of the hth detail point G h , where h takes j, m, n;
    Figure PCTCN2022135830-appb-100022
    Figure PCTCN2022135830-appb-100022
    Figure PCTCN2022135830-appb-100023
    Figure PCTCN2022135830-appb-100023
    Figure PCTCN2022135830-appb-100024
    Figure PCTCN2022135830-appb-100024
    Figure PCTCN2022135830-appb-100025
    Figure PCTCN2022135830-appb-100025
    Figure PCTCN2022135830-appb-100026
    Figure PCTCN2022135830-appb-100026
    Figure PCTCN2022135830-appb-100027
    Figure PCTCN2022135830-appb-100027
    n jm为第二组细节点中第j个细节点和第m个细节点连线上的脊线的条数,n jn为第二组细节点中第j个细节点和第n个细节点连线上的脊线的条数。 n jm is the number of ridge lines on the line between the jth minutiae point and the mth minutiae point in the second group of minutiae points, and n jn is the jth minutiae point and the nth minutiae point in the second group of minutiae points The number of ridges on the link.
  13. 根据权利要求12所述的指纹比对方法,其中,通过如下公式计算所述局部相似度矩阵:The method for comparing fingerprints according to claim 12, wherein the local similarity matrix is calculated by the following formula:
    Figure PCTCN2022135830-appb-100028
    Figure PCTCN2022135830-appb-100028
    其中,A为加权系数向量W与向量V的点积;Among them, A is the dot product of the weighting coefficient vector W and the vector V;
    Figure PCTCN2022135830-appb-100029
    w d=1,w θ=0.3*180/π,
    Figure PCTCN2022135830-appb-100030
    w n=3,w t=3,V=|V0|,V0=Fl i-Gl j
    Figure PCTCN2022135830-appb-100029
    w d =1,w θ =0.3*180/π,
    Figure PCTCN2022135830-appb-100030
    w n =3, w t =3, V=|V0|, V0=Fl i -Gl j .
  14. 根据权利要求13所述的指纹比对方法,其中,通过如下公式计算特征向量
    Figure PCTCN2022135830-appb-100031
    Figure PCTCN2022135830-appb-100032
    The fingerprint comparison method according to claim 13, wherein, the feature vector is calculated by the following formula
    Figure PCTCN2022135830-appb-100031
    and
    Figure PCTCN2022135830-appb-100032
    Figure PCTCN2022135830-appb-100033
    Figure PCTCN2022135830-appb-100033
    Figure PCTCN2022135830-appb-100034
    Figure PCTCN2022135830-appb-100034
    其中,(x a,y a)和
    Figure PCTCN2022135830-appb-100035
    分别为第一组细节点中的第a个细节点的坐标和角度,(x b,y b)和
    Figure PCTCN2022135830-appb-100036
    分别为第二组细节点中的第b个细节点的坐标和角度。
    Among them, (x a ,y a ) and
    Figure PCTCN2022135830-appb-100035
    are respectively the coordinates and angles of the ath minutiae point in the first group of minutiae points, (x b , y b ) and
    Figure PCTCN2022135830-appb-100036
    are the coordinates and angles of the bth minutiae point in the second group of minutiae points, respectively.
  15. 根据权利要求9-14任一所述的指纹比对方法,其中,所述选取每个匹配确定性相似度矩阵的匹配细节点对并计算每个匹配确定性相似度矩阵的匹配分数,包括:The fingerprint comparison method according to any one of claims 9-14, wherein said selecting matching detail point pairs of each matching deterministic similarity matrix and calculating the matching score of each matching deterministic similarity matrix comprises:
    对于每个匹配确定性相似度矩阵,若其第i行第j列的元素ml(i,j)不是其第i行中的最大值或者不是其第j列中的最大值,则将ml(i,j)置为0;For each matching deterministic similarity matrix, if the element ml(i,j) in the i-th row and j-th column is not the maximum value in its i-th row or not the maximum value in its j-th column, then ml( i, j) is set to 0;
    通过如下公式计算每个匹配确定性相似度矩阵的匹配分数s:The matching score s of each matching deterministic similarity matrix is calculated by the following formula:
    Figure PCTCN2022135830-appb-100037
    Figure PCTCN2022135830-appb-100037
  16. 根据权利要求2所述的指纹比对方法,其中,所述方法还包括:The fingerprint comparison method according to claim 2, wherein said method further comprises:
    在根据所有匹配分数计算计算总匹配分数之后,根据所述总匹配分数得到指纹比对结果。After the total matching score is calculated according to all the matching scores, the fingerprint comparison result is obtained according to the total matching score.
  17. 一种指纹比对装置,所述装置包括:A fingerprint comparison device, said device comprising:
    数据准备模块,用于获取第一张指纹图像的第一组细节点和第二张指纹图像的第二组细节点;The data preparation module is used to obtain the first group of minutiae points of the first fingerprint image and the second group of minutiae points of the second fingerprint image;
    获取模块,用于获取第一组细节点和第二组细节点的匹配细节点对;An acquisition module, configured to acquire the matching minutiae point pairs of the first group of minutiae points and the second group of minutiae points;
    中间值计算模块,用于针对每一个匹配细节点对,根据所述匹配细节点对的两个细节点之间的距离和角度差、以及邻域细节点信息计算所述匹配细节点对的相似度中间值;An intermediate value calculation module, for each matching detail point pair, according to the distance and angle difference between two detail points of the matching detail point pair, and the neighborhood detail point information to calculate the similarity of the matching detail point pair degree intermediate value;
    匹配分数计算模块,用于根据每个所述细节点匹配对的相似度中间值,计算所述第一张指纹图像与所述第二张指纹图像的匹配分数。A matching score calculation module, configured to calculate a matching score between the first fingerprint image and the second fingerprint image according to the median similarity value of each matching pair of minutiae points.
  18. 根据权利要求17所述的指纹比对装置,其中,所述中间值计算模块包括刚性变换模块和贡献数值计算模块:The fingerprint comparison device according to claim 17, wherein the intermediate value calculation module includes a rigid transformation module and a contribution value calculation module:
    所述刚性变换模块,用于选取一个匹配细节点对作为基准细节点对,并对第二组细节点中的所有细节点均做使得所述基准细节点对的两个细节点重合的刚性变换;The rigid transformation module is configured to select a matching minutiae point pair as a reference minutiae point pair, and perform a rigid transformation on all minutiae points in the second group of minutiae points so that the two minutiae points of the reference minutiae point pair coincide ;
    所述贡献数值计算模块,用于对每一个匹配细节点对,根据所述匹配细节点对以及对应的邻域细节点对计算所述匹配细节点对的贡献数值;The contribution value calculation module is used to calculate the contribution value of the matching detail point pair according to the matching detail point pair and the corresponding neighborhood detail point pair for each matching detail point pair;
    其中,所述邻域细节点对为所述匹配细节点对设定邻域范围内的所有匹配细节点对;Wherein, the neighborhood minutiae point pair sets all matching minutiae point pairs within the neighborhood range for the matching minutiae point pair;
    所述匹配分数计算模块,根据所有匹配细节点对的贡献数值计算所述第一张指纹图像与所述第二张指纹图像之间的匹配分数。The matching score calculation module calculates the matching score between the first fingerprint image and the second fingerprint image according to the contribution values of all matching minutiae point pairs.
  19. 根据权利要求17所述的指纹比对装置,其中,所述获取模块包括2-近邻结构表示计算模块、局部相似度矩阵计算模块以及匹配对确定模块,所述中间值计算模块包括匹配确定性相似度矩阵计算模块:The fingerprint comparison device according to claim 17, wherein the acquisition module includes a 2-nearest neighbor structure representation calculation module, a local similarity matrix calculation module, and a matching pair determination module, and the intermediate value calculation module includes a matching deterministic similarity Degree matrix calculation module:
    所述2-近邻结构表示计算模块,用于计算所述第一组细节点中每个细节点的2-近邻结构表示和所述第二组细节点中每个细节点的2-近邻结构表示;The 2-nearest neighbor structure representation calculation module is used to calculate the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points ;
    所述局部相似度矩阵计算模块,用于根据所述第一组细节点中每个细节点的2-近邻结构表示和所述第二组细节点中每个细节点的2-近邻结构表示计算第一组细节点和第二组细节点的局部相似度矩阵;The local similarity matrix calculation module is used to calculate according to the 2-nearest neighbor structure representation of each minutiae in the first group of minutiae points and the 2-nearest neighbor structure representation of each minutiae point in the second group of minutiae points The local similarity matrix of the first group of minutiae points and the second group of minutiae points;
    所述匹配对确定模块,用于按照从大到小的顺序从所述局部相似度矩阵中选取若干个元素,并获取选取的每个元素对应的两个细节点作为匹配细节点对;The matching pair determination module is configured to select several elements from the local similarity matrix in descending order, and obtain two minutiae points corresponding to each selected element as a matching minutiae point pair;
    所述匹配确定性相似度矩阵计算模块,对每个匹配对,根据所述局部相似度矩阵和所述匹配对的两个细节点之间的距离差和角度差计算所述匹配对的匹配确定性相似度矩阵;The matching deterministic similarity matrix calculation module, for each matching pair, calculates the matching determination of the matching pair according to the distance difference and angle difference between the local similarity matrix and the two minutiae points of the matching pair sex similarity matrix;
    所述匹配分数计算模块,用于选取每个匹配确定性相似度矩阵的匹配细节点对并计算每个匹配确定性相似度矩阵的匹配分数;并根据所有匹配分数计算计算总匹配分数。The matching score calculation module is used to select the matching detail point pairs of each matching deterministic similarity matrix and calculate the matching score of each matching deterministic similarity matrix; and calculate the total matching score according to all matching scores.
  20. 一种用于指纹比对的计算机可读存储介质,其特征在于,包括用于存储处理器可执行指令的存储器,所述指令被所述处理器执行时实现包括权利要求1-16任一所述指纹比对方法的步骤。A computer-readable storage medium for fingerprint comparison, characterized in that it includes a memory for storing processor-executable instructions, and when the instructions are executed by the processor, it implements any of claims 1-16. Describe the steps of the fingerprint comparison method.
  21. 一种用于指纹比对的设备,其特征在于,包括至少一个处理器以及存储计算机可执行指令的存储器,所述处理器执行所述指令时实现权利要求1-16中任意一项所述指纹比对方法的步骤。A device for fingerprint comparison, characterized in that it includes at least one processor and a memory storing computer-executable instructions, and when the processor executes the instructions, the fingerprint described in any one of claims 1-16 is realized. Steps of the comparison method.
PCT/CN2022/135830 2021-12-27 2022-12-01 Fingerprint comparison method and apparatus, storage medium, and device WO2023124745A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202111612355.2 2021-12-27
CN202111612355.2A CN116363703A (en) 2021-12-27 2021-12-27 Fingerprint comparison method, device, storage medium and equipment
CN202210075001.7 2022-01-22
CN202210075001.7A CN116563896A (en) 2022-01-22 2022-01-22 Fingerprint comparison method, device, storage medium and equipment

Publications (1)

Publication Number Publication Date
WO2023124745A1 true WO2023124745A1 (en) 2023-07-06

Family

ID=86997585

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/135830 WO2023124745A1 (en) 2021-12-27 2022-12-01 Fingerprint comparison method and apparatus, storage medium, and device

Country Status (1)

Country Link
WO (1) WO2023124745A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751555A (en) * 2009-09-25 2010-06-23 中国科学院自动化研究所 Deformation fingerprint identification method and system
CN101777128A (en) * 2009-11-25 2010-07-14 中国科学院自动化研究所 Fingerprint minutiae matching method syncretized to global information and system thereof
CN102819754A (en) * 2012-07-27 2012-12-12 中国科学院自动化研究所 Fingerprint score fusion system and method based on Sigmoid expansion
CN104077560A (en) * 2014-01-13 2014-10-01 北京市公安局刑事侦查总队 Fingerprint comparison method
CN104995640A (en) * 2012-11-02 2015-10-21 维普公司 Fingerprint matching algorithm
US20170140193A1 (en) * 2015-11-16 2017-05-18 MorphoTrak, LLC Minutiae Grouping for Distorted Fingerprint Matching

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751555A (en) * 2009-09-25 2010-06-23 中国科学院自动化研究所 Deformation fingerprint identification method and system
CN101777128A (en) * 2009-11-25 2010-07-14 中国科学院自动化研究所 Fingerprint minutiae matching method syncretized to global information and system thereof
CN102819754A (en) * 2012-07-27 2012-12-12 中国科学院自动化研究所 Fingerprint score fusion system and method based on Sigmoid expansion
CN104995640A (en) * 2012-11-02 2015-10-21 维普公司 Fingerprint matching algorithm
CN104077560A (en) * 2014-01-13 2014-10-01 北京市公安局刑事侦查总队 Fingerprint comparison method
US20170140193A1 (en) * 2015-11-16 2017-05-18 MorphoTrak, LLC Minutiae Grouping for Distorted Fingerprint Matching

Similar Documents

Publication Publication Date Title
US10565433B2 (en) Age invariant face recognition using convolutional neural networks and set distances
US20230080031A1 (en) Face Recognition Method and Face Recognition Apparatus
Yang et al. Finger vein recognition based on (2D) 2 PCA and metric learning
Jaswal et al. Selection of optimized features for fusion of palm print and finger knuckle‐based person authentication
CN104573672B (en) A kind of discriminating kept based on neighborhood is embedded in face identification method
Ouarda et al. MLP Neural Network for face recognition based on Gabor Features and Dimensionality Reduction techniques
Omara et al. A novel approach for ear recognition: learning Mahalanobis distance features from deep CNNs
CN107220627A (en) Pose-varied face recognition method based on cooperation fuzzy mean discriminatory analysis
Zhou et al. Rotation and translation invariant palmprint recognition with biologically inspired transform
Shi Facial keypoints detection
Liao et al. Can a biologically-plausible hierarchy effectively replace face detection, alignment, and recognition pipelines?
Gona et al. Convolutional neural network with improved feature ranking for robust multi-modal biometric system
Safavipour et al. Deep Hybrid Multimodal Biometric Recognition System Based on Features‐Level Deep Fusion of Five Biometric Traits
Alrahawe et al. A Contactless Palm Veins Biometric System Based on Convolutional Neural Network
WO2023124745A1 (en) Fingerprint comparison method and apparatus, storage medium, and device
Mukherjee et al. Iris recognition using wavelet features and various distance based classification
Hasan et al. A study of gender classification techniques based on iris images: A deep survey and analysis
Boumbarov et al. Face and ECG based multi-modal biometric authentication
Bhatt et al. Covariates of face recognition
Safavipour et al. A hybrid approach for multimodal biometric recognition based on feature level fusion in reproducing kernel Hilbert space
Birajadar et al. A scattering wavelet network-based approach to fingerprint classification
Zhou et al. Facial expression recognition using frequency multiplication network with uniform rectangular features
George Development of efficient biometric recognition algorithms based on fingerprint and face
Ahmadian et al. A novel multi-modal biometric architecture for high-dimensional features
El-Tarhouni Finger Knuckle Print and Palmprint for efficient person recognition

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22914000

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE