Composite finger and palm print verification system
Technical Field
The invention belongs to the field of biological characteristic collection, and particularly relates to a composite fingerprint and palm print verification system.
Background
With the increasing diversification of functions of integrated circuits, devices that were either special products or were not available at all have become increasingly popular. Such as a palm print scanner, similar to a fingerprint scanner, is an example. In the past, palm print recognition systems that have been scarce or even inaudible in the traditional consumer product market have become increasingly popular among the average users concerned with access control and identification due to the advent of integrated circuit palm print scanners; the field of application of palm print recognition systems is no longer limited to governments and security personnel. These devices are used to ensure that only authorized users can access a computer system or database and that the size has been reduced to fit into a portable computer.
Under the background of increasingly mature networking development, the networking application of the palm print scanner is called. However, since the network transmission and the remote fingerprint scanner user are not guided by professional personnel, the quality of the collected image is poor and the noise is too high.
Disclosure of Invention
In order to improve the identifiability of on-line fingerprint acquisition, the invention provides a compound fingerprint and palm print verification system, which comprises: the system comprises a finger and palm print remote video information acquisition subsystem and a finger and palm print verification subsystem, wherein the finger and palm print remote video information acquisition subsystem is used for acquiring the fingerprint and palm print of a person to be identified based on a video frame mode, and the finger and palm print verification subsystem is used for verifying the identity of the person according to the fingerprint and palm print.
Further, the fingerprint and palm print remote video information acquisition subsystem comprises:
the first correction processing unit is used for carrying out first gray correction processing on the collected first frame palm image by using initial gray to obtain a finger image, and the palm image comprises a palm image and a finger image which respectively correspond to a left hand and a right hand;
the first intermediate image acquisition unit is used for acquiring a first intermediate image representing a fingerprint area corresponding to each finger by using the physiological characteristics of the finger lines;
the second correction processing unit is used for carrying out second gray scale correction processing on the collected second frame palm image with second gray scale to obtain a finger image, and the palm image comprises a palm image and a finger image which respectively correspond to a left hand and a right hand;
the second intermediate image acquisition unit is used for acquiring a second intermediate image representing a fingerprint area corresponding to each finger by using the physiological characteristics of the finger lines;
and the palm print image acquisition unit is used for carrying out noise reduction processing on the first intermediate image and the second intermediate image to obtain a noise-reduced palm print image.
Further, the first correction processing unit includes:
a first average gray-scale calculating unit for calculating the average value A of gray-scales of the left and right palm images based on the first frame imageGrey scale=(ALeft palm+ARight palm)/2;
A first finger specifying subunit operable to specify, in the palm image, an image of the shortest finger in the palm image as an image corresponding to a thumb, specify an image of the second shortest finger as an image corresponding to a little finger, specify an image close to the thumb as an image corresponding to an index finger, specify an image close to the little finger as an image corresponding to a ring finger, and specify the remaining finger-like images as images corresponding to the middle finger, based on the finger shape and length;
the first finger root part fork point determining subunit is used for determining that the position of the finger root part fork in the palm image is the finger root part fork point;
a first segmentation subunit, configured to perform the following processing on the left palm image: connecting all the finger root part fork points, taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the third finger and the finger root part fork point of the third finger and the little finger and the outline of the palm part close to the little finger in the palm part image as a first point, and taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as a second point; removing the left palm image from the left palm image according to the finger root part fork points, the first points and the second points of the left palm image to obtain a left finger image;
the second segmentation subunit is used for processing the right palm image as follows: connecting all the finger root part fork points, taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the ring finger and the finger root part fork point of the ring finger and the little finger and the outline of the palm part close to the little finger in the palm part image as third points, and taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as fourth points; removing the right hand palm image from the right hand palm image according to each finger root part fork point, the first point and the second point of the right hand palm image to obtain a right hand finger image;
the first gray average value calculating subunit is used for calculating the gray average values of the neighborhood pixels with the first point, the second point, the third point and the fourth point as centers and r as a radius respectively, and forming a matrix M of 1 × 4 by using the 4 gray average values;
the first finger gray scale calculation operator unit is used for taking the image of the tip in the left palm image as an image corresponding to each fingertip of the left hand, taking the image of the tip in the right palm image as an image corresponding to each fingertip of the right hand, calculating the gray scale mean value of a neighborhood taking the fingertip position in the image corresponding to each fingertip as the center and r as the radius, and forming a matrix N of 10 × 1 by using the 10 gray scale mean values;
a first matrix calculating subunit, configured to calculate an eigenvalue a' of the matrix obtained by N × M, that is, an eigenvector a;
a first coordinate system establishing subunit, configured to establish a rectangular plane coordinate system of the left-hand finger image with the first point as an origin, and the second point as a coordinate daAnd dbThe fourth point is taken as the original pointPoint establishing a plane rectangular coordinate system of the right-hand finger image, wherein the coordinate of the third point is d'aAnd d'b;
A first cross correction coefficient calculation subunit for calculating a cross correction coefficient α ═ A' × (1-A) for each pixel in the left and right finger imagesGrey scale×(1-x×ed’a/da)/(1-y×edb/d’b) And obtaining left-hand and right-hand finger images after gray correction, wherein x and y are horizontal and vertical coordinate values of each pixel in a left-hand and right-hand coordinate system respectively.
Further, the first intermediate image acquisition unit includes:
and aiming at a certain finger, looking up the thickest line according to the thickness degree of the line perpendicular to the extending direction of each finger along the direction from the fingertip to the joint of the finger and the palm, and taking the line as a boundary to obtain a region from the boundary to the corresponding fingertip as a first intermediate image corresponding to the finger.
Further, the second correction processing unit includes:
a background light gray scale adjusting unit for adjusting the background light gray scale of the collected palm image to AGrey scale/2;
A second average gray-scale calculating unit for calculating the average value A of gray-scales of the left and right palm images based on the second frame imageGrey scale 2=(ALeft palm 2+ARight palm 2) 2; wherein A isLeft palm 2、ARight palm 2Respectively, are: according to the gray values of the second frame image, the left hand palm image and the right hand palm image;
a second finger specifying subunit operable to specify, in the palm image, an image of the shortest finger in the palm image as an image corresponding to a thumb, specify an image of the second shortest finger as an image corresponding to a little finger, specify an image close to the thumb as an image corresponding to an index finger, specify an image close to the little finger as an image corresponding to a ring finger, and specify the remaining finger-like images as images corresponding to middle fingers, based on the finger shape and length;
the second finger root part fork point determining subunit is used for determining that the position of the finger root part fork in the palm part image is the finger root part fork point;
a third segmentation subunit, configured to perform the following processing on the left palm image: connecting all the finger root part fork points, taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the third finger and the finger root part fork point of the third finger and the little finger and the outline of the palm part close to the little finger in the palm part image as a first point, and taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as a second point; removing the left palm image from the left palm image according to the finger root part fork points, the first points and the second points of the left palm image to obtain a left finger image;
the fourth segmentation subunit is used for processing the right palm image as follows: connecting all the finger root part fork points, taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the ring finger and the finger root part fork point of the ring finger and the little finger and the outline of the palm part close to the little finger in the palm part image as third points, and taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as fourth points; removing the right hand palm image from the right hand palm image according to each finger root part fork point, the first point and the second point of the right hand palm image to obtain a right hand finger image;
the second gray level average value operator unit is used for respectively calculating the gray level average values of the neighborhood pixels with the first point, the second point, the third point and the fourth point as centers and R as radius, and forming a matrix M of 1 × 4 by using the 4 gray level average values;
the second finger gray scale calculation operator unit is used for taking the image of the tip in the left palm image as an image corresponding to each fingertip of the left hand, taking the image of the tip in the right palm image as an image corresponding to each fingertip of the right hand, calculating the gray scale mean value of a neighborhood taking the fingertip position in the image corresponding to each fingertip as the center and R as the radius, and forming a matrix N of 10 × 1 by using the 10 gray scale mean values;
the second matrix calculation subunit is used for calculating an eigenvalue A' of the matrix obtained by N × M, namely an eigenvector b;
a second coordinate system establishing subunit, configured to establish a rectangular plane coordinate system of the left-hand finger image with the second point as an origin, and the first point as a coordinate faAnd fbEstablishing a plane rectangular coordinate system of the right-hand finger image by taking the third point as an origin, wherein the coordinate of the fourth point is f'aAnd f'b;
A second cross correction coefficient calculation subunit for calculating a cross correction coefficient α ═ a "× (1-a) of each pixel in the left and right finger imagesGrey scale 2× (1-x × lg (f 'a/fa))/(1-y × lg (fb/f' b))) to obtain left-hand and right-hand finger images after gray scale correction, wherein x and y are respectively the abscissa and ordinate values of each pixel in the left-hand and right-hand coordinate systems.
Further, the second intermediate image acquisition unit includes:
and aiming at a certain finger, looking up the finest line according to the thickness degree of the lines vertical to the extending direction of each finger along the direction from the fingertip to the joint of the finger and the palm, and taking the line as a boundary to obtain a region from the boundary to the corresponding fingertip as a second intermediate image corresponding to the finger.
Further, the palm print image acquiring unit includes:
a first area calculation subunit for calculating a left-hand palm area B1 and a right-hand palm area B2 in the first frame, the palm-to-finger boundary being connected with reference to the finger root part cross-point of each hand;
the second area calculation subunit is used for calculating a left-hand palm area B '1 and a right-hand palm area B' 2 in the second frame, and the boundaries of the palms and the fingers refer to the finger root part fork point connecting lines of each hand;
a finger area calculating subunit, configured to accumulate, for fingers of the left hand and the right hand, the areas of the first intermediate image and the second intermediate image, respectively, so as to obtain an area sum C1 of the first intermediate image and an area sum C2 of the second intermediate image;
the reference matrix calculation subunit is used for calculating a matrix a × b to obtain a matrix E;
a palm area factor calculating subunit for calculating the palm area factors of the left hand and the right hand, respectively: p is a radical ofLeft palm=ln(r×(B1/(2×B’1))),pRight palm=ln(R×(B2/(2×B’2)));
An image noise filtering subunit, configured to filter the palm image, where a filtering factor β is:
and performing exponential filtering on the second intermediate image corresponding to each finger of the first frame palm image and the second frame palm image according to an image noise filter with a filtering factor of β, wherein the filtering parameter is the filtering factor β.
Furthermore, the value range of R is 0.02-0.1, and the value range of R is 0.08-0.3.
Further, R is 3 times R.
Further, the initial gray scale is RGB (255, 255, 255).
The technical scheme of the invention has the following advantages:
by actively changing the background gray level during online fingerprint acquisition, creatively using the gray level balance technology of fingers and palms of a left hand and a right hand, and by means of the similarity between the fingers and palms, the influence of frame jitter or network transmission signal-to-noise ratio on the quality of fingerprint acquisition images during online acquisition is reduced. Through tests, the recognition rate is improved by more than 40% compared with the prior on-line acquisition technology.
Drawings
Fig. 1 shows a block diagram of the components of the composite fingerprint and palm print verification system according to the present invention.
Fig. 2 shows a block diagram of the components of the finger-palm print remote video information acquisition subsystem according to the present invention.
Detailed Description
As shown in fig. 1, the composite fingerprint and palm print verification system of the present invention includes: the system comprises a finger and palm print remote video information acquisition subsystem and a finger and palm print verification subsystem, wherein the finger and palm print remote video information acquisition subsystem is used for acquiring the fingerprint and palm print of a person to be identified based on a video frame mode, and the finger and palm print verification subsystem is used for verifying the identity of the person according to the fingerprint and palm print.
Preferably, as shown in fig. 2, the fingerprint and palm print remote video information acquiring subsystem includes: the first correction processing unit is used for carrying out first gray correction processing on the collected first frame palm image by using initial gray to obtain a finger image, and the palm image comprises a palm image and a finger image which respectively correspond to a left hand and a right hand;
the first intermediate image acquisition unit is used for acquiring a first intermediate image representing a fingerprint area corresponding to each finger by using the physiological characteristics of the finger lines;
the second correction processing unit is used for carrying out second gray scale correction processing on the collected second frame palm image with second gray scale to obtain a finger image, and the palm image comprises a palm image and a finger image which respectively correspond to a left hand and a right hand;
the second intermediate image acquisition unit is used for acquiring a second intermediate image representing a fingerprint area corresponding to each finger by using the physiological characteristics of the finger lines;
and the palm print image acquisition unit is used for carrying out noise reduction processing on the first intermediate image and the second intermediate image to obtain a noise-reduced palm print image.
Preferably, the first correction processing unit includes:
a first average gray-scale calculating unit for calculating the average value A of gray-scales of the left and right palm images based on the first frame imageGrey scale=(ALeft palm+ARight palm)/2;
A first finger specifying subunit operable to specify, in the palm image, an image of the shortest finger in the palm image as an image corresponding to a thumb, specify an image of the second shortest finger as an image corresponding to a little finger, specify an image close to the thumb as an image corresponding to an index finger, specify an image close to the little finger as an image corresponding to a ring finger, and specify the remaining finger-like images as images corresponding to the middle finger, based on the finger shape and length;
the first finger root part fork point determining subunit is used for determining that the position of the finger root part fork in the palm image is the finger root part fork point;
a first segmentation subunit, configured to perform the following processing on the left palm image: connecting all the finger root part fork points, taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the third finger and the finger root part fork point of the third finger and the little finger and the outline of the palm part close to the little finger in the palm part image as a first point, and taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as a second point; removing the left palm image from the left palm image according to the finger root part fork points, the first points and the second points of the left palm image to obtain a left finger image;
the second segmentation subunit is used for processing the right palm image as follows: connecting all the finger root part fork points, taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the ring finger and the finger root part fork point of the ring finger and the little finger and the outline of the palm part close to the little finger in the palm part image as third points, and taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as fourth points; removing the right hand palm image from the right hand palm image according to each finger root part fork point, the first point and the second point of the right hand palm image to obtain a right hand finger image;
the first gray average value calculating subunit is used for calculating the gray average values of the neighborhood pixels with the first point, the second point, the third point and the fourth point as centers and r as a radius respectively, and forming a matrix M of 1 × 4 by using the 4 gray average values;
the first finger gray scale calculation operator unit is used for taking the image of the tip in the left palm image as an image corresponding to each fingertip of the left hand, taking the image of the tip in the right palm image as an image corresponding to each fingertip of the right hand, calculating the gray scale mean value of a neighborhood taking the fingertip position in the image corresponding to each fingertip as the center and r as the radius, and forming a matrix N of 10 × 1 by using the 10 gray scale mean values;
a first matrix calculating subunit, configured to calculate an eigenvalue a' of the matrix obtained by N × M, that is, an eigenvector a;
a first coordinate system establishing subunit, configured to establish a rectangular plane coordinate system of the left-hand finger image with the first point as an origin, and the second point as a coordinate daAnd dbEstablishing a plane rectangular coordinate system of the image of the right hand finger by taking the fourth point as an origin, wherein the coordinate of the third point is d'aAnd d'b;
A first cross correction coefficient calculation subunit for calculating a cross correction coefficient α ═ A' × (1-A) for each pixel in the left and right finger imagesGrey scale×(1-x×ed’a/da)/(1-y×edb/d’b) And obtaining left-hand and right-hand finger images after gray correction, wherein x and y are horizontal and vertical coordinate values of each pixel in a left-hand and right-hand coordinate system respectively.
Preferably, the first intermediate image acquisition unit includes:
and aiming at a certain finger, looking up the thickest line according to the thickness degree of the line perpendicular to the extending direction of each finger along the direction from the fingertip to the joint of the finger and the palm, and taking the line as a boundary to obtain a region from the boundary to the corresponding fingertip as a first intermediate image corresponding to the finger.
Preferably, the second correction processing unit includes:
a background light gray scale adjusting unit for adjusting the background light gray scale of the collected palm image to AGrey scale/2;
A second average gray-scale calculating unit for calculating the average value A of gray-scales of the left and right palm images based on the second frame imageGrey scale 2=(ALeft palm 2+ARight palm 2) 2; wherein A isLeft palm 2、ARight palm 2Respectively, are: according to the gray values of the second frame image, the left hand palm image and the right hand palm image;
a second finger specifying subunit operable to specify, in the palm image, an image of the shortest finger in the palm image as an image corresponding to a thumb, specify an image of the second shortest finger as an image corresponding to a little finger, specify an image close to the thumb as an image corresponding to an index finger, specify an image close to the little finger as an image corresponding to a ring finger, and specify the remaining finger-like images as images corresponding to middle fingers, based on the finger shape and length;
the second finger root part fork point determining subunit is used for determining that the position of the finger root part fork in the palm part image is the finger root part fork point;
a third segmentation subunit, configured to perform the following processing on the left palm image: connecting all the finger root part fork points, taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the third finger and the finger root part fork point of the third finger and the little finger and the outline of the palm part close to the little finger in the palm part image as a first point, and taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as a second point; removing the left palm image from the left palm image according to the finger root part fork points, the first points and the second points of the left palm image to obtain a left finger image;
the fourth segmentation subunit is used for processing the right palm image as follows: connecting all the finger root part fork points, taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the ring finger and the finger root part fork point of the ring finger and the little finger and the outline of the palm part close to the little finger in the palm part image as third points, and taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as fourth points; removing the right hand palm image from the right hand palm image according to each finger root part fork point, the first point and the second point of the right hand palm image to obtain a right hand finger image;
the second gray level average value operator unit is used for respectively calculating the gray level average values of the neighborhood pixels with the first point, the second point, the third point and the fourth point as centers and R as radius, and forming a matrix M of 1 × 4 by using the 4 gray level average values;
the second finger gray scale calculation operator unit is used for taking the image of the tip in the left palm image as an image corresponding to each fingertip of the left hand, taking the image of the tip in the right palm image as an image corresponding to each fingertip of the right hand, calculating the gray scale mean value of a neighborhood taking the fingertip position in the image corresponding to each fingertip as the center and R as the radius, and forming a matrix N of 10 × 1 by using the 10 gray scale mean values;
the second matrix calculation subunit is used for calculating an eigenvalue A' of the matrix obtained by N × M, namely an eigenvector b;
a second coordinate system establishing subunit, configured to establish a rectangular plane coordinate system of the left-hand finger image with the second point as an origin, and the first point as a coordinate faAnd fbEstablishing a plane rectangular coordinate system of the right-hand finger image by taking the third point as an origin, wherein the coordinate of the fourth point is f'aAnd f'b;
A second cross correction coefficient calculation subunit for calculating a cross correction coefficient α ═ a "× (1-a) of each pixel in the left and right finger imagesGrey scale 2× (1-x × lg (f 'a/fa))/(1-y × lg (fb/f' b))) to obtain left-hand and right-hand finger images after gray scale correction, wherein x and y are respectively the abscissa and ordinate values of each pixel in the left-hand and right-hand coordinate systems.
Preferably, the second intermediate image acquiring unit includes:
and aiming at a certain finger, looking up the finest line according to the thickness degree of the lines vertical to the extending direction of each finger along the direction from the fingertip to the joint of the finger and the palm, and taking the line as a boundary to obtain a region from the boundary to the corresponding fingertip as a second intermediate image corresponding to the finger.
Preferably, the palm print image acquiring unit includes:
a first area calculation subunit for calculating a left-hand palm area B1 and a right-hand palm area B2 in the first frame, the palm-to-finger boundary being connected with reference to the finger root part cross-point of each hand;
the second area calculation subunit is used for calculating a left-hand palm area B '1 and a right-hand palm area B' 2 in the second frame, and the boundaries of the palms and the fingers refer to the finger root part fork point connecting lines of each hand;
a finger area calculating subunit, configured to accumulate, for fingers of the left hand and the right hand, the areas of the first intermediate image and the second intermediate image, respectively, so as to obtain an area sum C1 of the first intermediate image and an area sum C2 of the second intermediate image;
the reference matrix calculation subunit is used for calculating a matrix a × b to obtain a matrix E;
a palm area factor calculating subunit for calculating the palm area factors of the left hand and the right hand, respectively: p is a radical ofLeft palm=ln(r×(B1/(2×B’1))),pRight palm=ln(R×(B2/(2×B’2)));
An image noise filtering subunit, configured to filter the palm image, where a filtering factor β is:
and performing exponential filtering on the second intermediate image corresponding to each finger of the first frame palm image and the second frame palm image according to an image noise filter with a filtering factor of β, wherein the filtering parameter is the filtering factor β.
Preferably, the value range of R is 0.02-0.1, and R is 0.08-0.3.
Preferably, R is 3 times R.
Preferably, the initial gray scale is RGB (255, 255, 255).
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.