Biological parameter identification system using finger veins
Technical Field
The invention belongs to the field of biological characteristic collection, and particularly relates to a biological parameter identification system using finger veins.
Background
With the increasing diversification of functions of integrated circuits, devices that were either special products or were not available at all have become increasingly popular. Such as a palm print scanner, similar to a fingerprint scanner, is an example. In the past, palm print recognition systems that have been scarce or even inaudible in the traditional consumer product market have become increasingly popular among the average users concerned with access control and identification due to the advent of integrated circuit palm print scanners; the field of application of palm print recognition systems is no longer limited to governments and security personnel. These devices are used to ensure that only authorized users can access a computer system or database and that the size has been reduced to fit into a portable computer.
Under the background of increasingly mature networking development, the networking application of the palm print scanner is called. However, since the network transmission and the remote fingerprint scanner user are not guided by professional personnel, the quality of the collected image is poor and the noise is too high.
Disclosure of Invention
In order to improve the identifiability of on-line fingerprint collection, the invention provides a biological parameter identification system using finger veins, which comprises: the system comprises a fingerprint remote video information acquisition subsystem and a parameter identification subsystem, wherein the fingerprint remote video information acquisition subsystem is used for acquiring a fingerprint to be identified based on a video frame mode, and the parameter identification subsystem is used for identifying the identity of a person according to the fingerprint.
Further, the fingerprint remote video information acquisition subsystem comprises:
the first correction processing unit is used for carrying out first gray correction processing on the collected first frame palm image by using initial gray to obtain a finger image, and the palm image comprises a palm image and a finger image which respectively correspond to a left hand and a right hand;
the first intermediate image acquisition unit is used for obtaining a first intermediate image representing a fingerprint area corresponding to each finger by using the physiological characteristics of the finger vein;
the second correction processing unit is used for carrying out second gray scale correction processing on the collected second frame palm image with second gray scale to obtain a finger image, and the palm image comprises a palm image and a finger image which respectively correspond to a left hand and a right hand;
the second intermediate image acquisition unit is used for acquiring second intermediate images representing fingerprint areas corresponding to the fingers by utilizing the physiological characteristics of the finger veins;
and the palm print image acquisition unit is used for carrying out noise reduction processing on the first intermediate image and the second intermediate image to obtain a noise-reduced palm print image.
Further, the first correction processing unit includes:
a first average gray-scale calculating unit for calculating the average value A of gray-scales of the left and right palm images based on the first frame imageGrey scale=(ALeft palm+ARight palm)/2;
A first finger specifying subunit operable to specify, in the palm image, an image of the shortest finger in the palm image as an image corresponding to a thumb, specify an image of the second shortest finger as an image corresponding to a little finger, specify an image close to the thumb as an image corresponding to an index finger, specify an image close to the little finger as an image corresponding to a ring finger, and specify the remaining finger-like images as images corresponding to the middle finger, based on the finger shape and length;
the first finger root part fork point determining subunit is used for determining that the position of the finger root part fork in the palm image is the finger root part fork point;
a first segmentation subunit, configured to perform the following processing on the left palm image: connecting all the finger root part fork points, taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the third finger and the finger root part fork point of the third finger and the little finger and the outline of the palm part close to the little finger in the palm part image as a first point, and taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as a second point; removing the left palm image from the left palm image according to the finger root part fork points, the first points and the second points of the left palm image to obtain a left finger image;
the second segmentation subunit is used for processing the right palm image as follows: connecting all the finger root part fork points, taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the ring finger and the finger root part fork point of the ring finger and the little finger and the outline of the palm part close to the little finger in the palm part image as third points, and taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as fourth points; removing the right hand palm image from the right hand palm image according to each finger root part fork point, the first point and the second point of the right hand palm image to obtain a right hand finger image;
the first gray average value calculating subunit is used for respectively calculating the gray average values of the neighborhood pixels with the first point, the second point, the third point and the fourth point as centers and r as a radius, and forming a 1 × 4 matrix M by using the 4 gray average values;
the first finger gray scale calculation operator unit is used for taking the image of the tip in the left palm image as the image corresponding to each fingertip of the left hand, taking the image of the tip in the right palm image as the image corresponding to each fingertip of the right hand, calculating the gray scale mean value of a neighborhood taking the fingertip position in the image corresponding to each fingertip as the center and r as the radius, and forming a matrix N of 10 multiplied by 1 by the 10 gray scale mean values;
a first matrix calculation subunit, configured to calculate an eigenvalue a' of the matrix obtained by nxm, that is, an eigenvector a;
a first coordinate system establishing subunit for establishing a left hand with the first point as an originA rectangular plane coordinate system of the finger image, and the coordinate of the second point is daAnd dbEstablishing a plane rectangular coordinate system of the image of the right hand finger by taking the fourth point as an origin, wherein the coordinate of the third point is d'aAnd d'b;
A first cross correction coefficient calculation subunit for calculating a cross correction coefficient α ═ a' × (1-a) for each pixel in the left and right finger imagesGrey scale×(1-x×ed’a/da)/(1-y×edb/d’b) And obtaining left-hand and right-hand finger images after gray correction, wherein x and y are horizontal and vertical coordinate values of each pixel in a left-hand and right-hand coordinate system respectively.
Further, the first intermediate image acquisition unit includes:
aiming at a certain finger, in the direction from the fingertip to the joint of the finger and the palm, according to the thickness degree of lines vertical to the extending direction of each finger, the coarsest line is searched, the line is taken as a boundary line, a region from the boundary line to the corresponding fingertip is obtained and is taken as a first intermediate image corresponding to the finger, and the gray level of a finger vein of the finger in which the finger is located is obtained and is taken as the gray level V matched with a second intermediate imageGrey scale 1。
Further, the second correction processing unit includes:
a background light gray scale adjusting unit for adjusting the background light gray scale of the collected palm image to AGrey scale/2;
A second average gray-scale calculating unit for calculating the average value A of gray-scales of the left and right palm images based on the second frame imageGrey scale 2=(ALeft palm 2+ARight palm 2)/2;
A second finger specifying subunit operable to specify, in the palm image, an image of the shortest finger in the palm image as an image corresponding to a thumb, specify an image of the second shortest finger as an image corresponding to a little finger, specify an image close to the thumb as an image corresponding to an index finger, specify an image close to the little finger as an image corresponding to a ring finger, and specify the remaining finger-like images as images corresponding to middle fingers, based on the finger shape and length;
the second finger root part fork point determining subunit is used for determining that the position of the finger root part fork in the palm part image is the finger root part fork point;
a third segmentation subunit, configured to perform the following processing on the left palm image: connecting all the finger root part fork points, taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the third finger and the finger root part fork point of the third finger and the little finger and the outline of the palm part close to the little finger in the palm part image as a first point, and taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as a second point; removing the left palm image from the left palm image according to the finger root part fork points, the first points and the second points of the left palm image to obtain a left finger image;
the fourth segmentation subunit is used for processing the right palm image as follows: connecting all the finger root part fork points, taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the ring finger and the finger root part fork point of the ring finger and the little finger and the outline of the palm part close to the little finger in the palm part image as third points, and taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as fourth points; removing the right hand palm image from the right hand palm image according to each finger root part fork point, the first point and the second point of the right hand palm image to obtain a right hand finger image;
the second gray level average value operator unit is used for respectively calculating the gray level average values of the neighborhood pixels with the first point, the second point, the third point and the fourth point as centers and R as radius, and forming a 1 multiplied by 4 matrix M by the 4 gray level average values;
the second finger gray scale calculation operator unit is used for taking the image of the tip in the left palm image as an image corresponding to each fingertip of the left hand, taking the image of the tip in the right palm image as an image corresponding to each fingertip of the right hand, calculating the gray scale mean value of a neighborhood taking the fingertip position in the image corresponding to each fingertip as the center and R as the radius, and forming a matrix N of 10 multiplied by 1 by the 10 gray scale mean values;
the second matrix calculation subunit is used for calculating an eigenvalue A' of the matrix obtained by N multiplied by M, namely an eigenvector b;
a second coordinate system establishing subunit, configured to establish a rectangular plane coordinate system of the left-hand finger image with the second point as an origin, and the first point as a coordinate faAnd fbEstablishing a plane rectangular coordinate system of the right-hand finger image by taking the third point as an origin, wherein the coordinate of the fourth point is f'aAnd f'b;
A second cross correction coefficient calculation subunit for calculating a cross correction coefficient α ═ a "× (1-a) for each pixel in the left and right finger imagesGrey scale 2X (1-x × lg (f 'a/fa))/(1-y × lg (fb/f' b))) to obtain the left-hand and right-hand finger images after the gray correction, wherein x and y are the horizontal and vertical coordinate values of each pixel in the coordinate systems of the left hand and the right hand respectively.
Further, the second intermediate image acquisition unit includes:
aiming at a certain finger, looking up the finest line according to the thickness degree of the lines vertical to the extending direction of each finger along the direction from the fingertip to the joint of the finger and the palm, taking the line as a boundary line, obtaining the region from the boundary line to the corresponding fingertip as a second intermediate image corresponding to the finger, and obtaining the gray level of the finger vein of the finger in which the finger is positioned as the gray level V matched with the second intermediate imageGrey scale 2。
Further, the palm print image acquiring unit includes:
a first area calculation subunit for calculating a left-hand palm area B1 and a right-hand palm area B2 in the first frame, the palm-to-finger boundary being connected with reference to the finger root part cross-point of each hand;
the second area calculation subunit is used for calculating a left-hand palm area B '1 and a right-hand palm area B' 2 in the second frame, and the boundaries of the palms and the fingers refer to the finger root part fork point connecting lines of each hand;
a finger area calculating subunit, configured to accumulate, for fingers of the left hand and the right hand, the areas of the first intermediate image and the second intermediate image, respectively, so as to obtain an area sum C1 of the first intermediate image and an area sum C2 of the second intermediate image;
a reference matrix calculation subunit, configured to calculate a matrix a × b to obtain a matrix E;
a palm area factor calculating subunit for calculating the palm area factors of the left hand and the right hand, respectively: p is a radical ofLeft palm=ln(r×(B1/(2×B’1))/VGrey scale 1),pRight palm=ln(R×(B2/(2×B’2))/VGrey scale 2);
The image noise filtering subunit is configured to filter the palm image, where a filtering factor β is:
and performing exponential filtering on the first frame palm image according to an image noise filter with a filtering factor beta, wherein the filtering parameter is the filtering factor beta.
Furthermore, the value range of R is 0.02-0.1, and the value range of R is 0.08-0.3.
Further, R is 3 times R.
Further, the initial gray scale is RGB (255, 255, 255).
The technical scheme of the invention has the following advantages:
by actively changing the background gray level during online fingerprint acquisition, creatively using the gray level balance technology of fingers and palms of a left hand and a right hand, and by means of the similarity between the fingers and palms, the influence of frame jitter or network transmission signal-to-noise ratio on the quality of fingerprint acquisition images during online acquisition is reduced. Through tests, the recognition rate is improved by more than 40% compared with the prior on-line acquisition technology.
Drawings
Fig. 1 shows a block diagram of the components of the security system according to the present invention.
Fig. 2 shows a block diagram of the components of a fingerprint remote video information acquisition subsystem according to the present invention.
Detailed Description
As shown in fig. 1, the biometric parameter recognition system using the finger vein according to the present invention includes: the system comprises a fingerprint remote video information acquisition subsystem and a parameter identification subsystem, wherein the fingerprint remote video information acquisition subsystem is used for acquiring a fingerprint to be identified based on a video frame mode, and the parameter identification subsystem is used for identifying the identity of a person according to the fingerprint.
Preferably, as shown in fig. 2, the fingerprint remote video information acquisition subsystem includes: the first correction processing unit is used for carrying out first gray correction processing on the collected first frame palm image by using initial gray to obtain a finger image, and the palm image comprises a palm image and a finger image which respectively correspond to a left hand and a right hand;
the first intermediate image acquisition unit is used for obtaining a first intermediate image representing a fingerprint area corresponding to each finger by using the physiological characteristics of the finger vein;
the second correction processing unit is used for carrying out second gray scale correction processing on the collected second frame palm image with second gray scale to obtain a finger image, and the palm image comprises a palm image and a finger image which respectively correspond to a left hand and a right hand;
the second intermediate image acquisition unit is used for acquiring second intermediate images representing fingerprint areas corresponding to the fingers by utilizing the physiological characteristics of the finger veins;
and the palm print image acquisition unit is used for carrying out noise reduction processing on the first intermediate image and the second intermediate image to obtain a noise-reduced palm print image.
Preferably, the first correction processing unit includes:
a first average gray-scale calculating unit for calculating the average value A of gray-scales of the left and right palm images based on the first frame imageGrey scale=(ALeft palm+ARight palm)/2;
A first finger specifying subunit operable to specify, in the palm image, an image of the shortest finger in the palm image as an image corresponding to a thumb, specify an image of the second shortest finger as an image corresponding to a little finger, specify an image close to the thumb as an image corresponding to an index finger, specify an image close to the little finger as an image corresponding to a ring finger, and specify the remaining finger-like images as images corresponding to the middle finger, based on the finger shape and length;
the first finger root part fork point determining subunit is used for determining that the position of the finger root part fork in the palm image is the finger root part fork point;
a first segmentation subunit, configured to perform the following processing on the left palm image: connecting all the finger root part fork points, taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the third finger and the finger root part fork point of the third finger and the little finger and the outline of the palm part close to the little finger in the palm part image as a first point, and taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as a second point; removing the left palm image from the left palm image according to the finger root part fork points, the first points and the second points of the left palm image to obtain a left finger image;
the second segmentation subunit is used for processing the right palm image as follows: connecting all the finger root part fork points, taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the ring finger and the finger root part fork point of the ring finger and the little finger and the outline of the palm part close to the little finger in the palm part image as third points, and taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as fourth points; removing the right hand palm image from the right hand palm image according to each finger root part fork point, the first point and the second point of the right hand palm image to obtain a right hand finger image;
the first gray average value calculating subunit is used for respectively calculating the gray average values of the neighborhood pixels with the first point, the second point, the third point and the fourth point as centers and r as a radius, and forming a 1 × 4 matrix M by using the 4 gray average values;
the first finger gray scale calculation operator unit is used for taking the image of the tip in the left palm image as the image corresponding to each fingertip of the left hand, taking the image of the tip in the right palm image as the image corresponding to each fingertip of the right hand, calculating the gray scale mean value of a neighborhood taking the fingertip position in the image corresponding to each fingertip as the center and r as the radius, and forming a matrix N of 10 multiplied by 1 by the 10 gray scale mean values;
a first matrix calculation subunit, configured to calculate an eigenvalue a' of the matrix obtained by nxm, that is, an eigenvector a;
a first coordinate system establishing subunit, configured to establish a rectangular plane coordinate system of the left-hand finger image with the first point as an origin, and the second point as a coordinate daAnd dbEstablishing a plane rectangular coordinate system of the image of the right hand finger by taking the fourth point as an origin, wherein the coordinate of the third point is d'aAnd d'b;
A first cross correction coefficient calculation subunit for calculating a cross correction coefficient α ═ a' × (1-a) for each pixel in the left and right finger imagesGrey scale×(1-x×ed’a/da)/(1-y×edb/d’b) And obtaining left-hand and right-hand finger images after gray correction, wherein x and y are horizontal and vertical coordinate values of each pixel in a left-hand and right-hand coordinate system respectively.
Preferably, the first intermediate image acquisition unit includes:
aiming at a certain finger, in the direction from the fingertip to the joint of the finger and the palm, according to the thickness degree of lines vertical to the extending direction of each finger, the coarsest line is searched, the line is taken as a boundary line, a region from the boundary line to the corresponding fingertip is obtained and is taken as a first intermediate image corresponding to the finger, and the gray level of a finger vein of the finger in which the finger is located is obtained and is taken as the gray level V matched with a second intermediate imageGrey scale 1。
Preferably, the second correction processing unit includes:
a background light gray scale adjusting unit for adjusting the background light gray scale of the collected palm image to AGrey scale/2;
A second average gray-scale calculating unit for calculating the average value A of gray-scales of the left and right palm images based on the second frame imageGrey scale 2=(ALeft palm 2+ARight palm 2)/2;
A second finger specifying subunit operable to specify, in the palm image, an image of the shortest finger in the palm image as an image corresponding to a thumb, specify an image of the second shortest finger as an image corresponding to a little finger, specify an image close to the thumb as an image corresponding to an index finger, specify an image close to the little finger as an image corresponding to a ring finger, and specify the remaining finger-like images as images corresponding to middle fingers, based on the finger shape and length;
the second finger root part fork point determining subunit is used for determining that the position of the finger root part fork in the palm part image is the finger root part fork point;
a third segmentation subunit, configured to perform the following processing on the left palm image: connecting all the finger root part fork points, taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the third finger and the finger root part fork point of the third finger and the little finger and the outline of the palm part close to the little finger in the palm part image as a first point, and taking the intersection point of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as a second point; removing the left palm image from the left palm image according to the finger root part fork points, the first points and the second points of the left palm image to obtain a left finger image;
the fourth segmentation subunit is used for processing the right palm image as follows: connecting all the finger root part fork points, taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the ring finger and the finger root part fork point of the ring finger and the little finger and the outline of the palm part close to the little finger in the palm part image as third points, and taking the intersection points of the extended lines of the connecting lines of the two fork points of the middle finger and the finger root part fork point of the index finger and the thumb and the outline of the palm part close to the thumb in the palm part image as fourth points; removing the right hand palm image from the right hand palm image according to each finger root part fork point, the first point and the second point of the right hand palm image to obtain a right hand finger image;
the second gray level average value operator unit is used for respectively calculating the gray level average values of the neighborhood pixels with the first point, the second point, the third point and the fourth point as centers and R as radius, and forming a 1 multiplied by 4 matrix M by the 4 gray level average values;
the second finger gray scale calculation operator unit is used for taking the image of the tip in the left palm image as an image corresponding to each fingertip of the left hand, taking the image of the tip in the right palm image as an image corresponding to each fingertip of the right hand, calculating the gray scale mean value of a neighborhood taking the fingertip position in the image corresponding to each fingertip as the center and R as the radius, and forming a matrix N of 10 multiplied by 1 by the 10 gray scale mean values;
the second matrix calculation subunit is used for calculating an eigenvalue A' of the matrix obtained by N multiplied by M, namely an eigenvector b;
a second coordinate system establishing subunit, configured to establish a rectangular plane coordinate system of the left-hand finger image with the second point as an origin, and the first point as a coordinate faAnd fbEstablishing a plane rectangular coordinate system of the right-hand finger image by taking the third point as an origin, wherein the coordinate of the fourth point is f'aAnd f'b;
A second cross correction coefficient calculation subunit for calculating a cross correction coefficient α ═ a "× (1-a) for each pixel in the left and right finger imagesGrey scale 2X (1-x × lg (f 'a/fa))/(1-y × lg (fb/f' b))) to obtain the left-hand and right-hand finger images after the gray correction, wherein x and y are the horizontal and vertical coordinate values of each pixel in the coordinate systems of the left hand and the right hand respectively.
Preferably, the second intermediate image acquiring unit includes:
for a certain finger, the direction from the tip of the finger to the joint of the finger and the palm is determined according to the extension direction of each fingerLooking up the thinnest line towards the thickness degree of the vertical line, taking the line as a boundary line, obtaining a region from the boundary line to the corresponding finger tip as a second intermediate image corresponding to the finger, and obtaining the gray level of the finger vein of the finger in which the finger is positioned as the gray level V matched with the second intermediate imageGrey scale 2。
Preferably, the palm print image acquiring unit includes:
a first area calculation subunit for calculating a left-hand palm area B1 and a right-hand palm area B2 in the first frame, the palm-to-finger boundary being connected with reference to the finger root part cross-point of each hand;
the second area calculation subunit is used for calculating a left-hand palm area B '1 and a right-hand palm area B' 2 in the second frame, and the boundaries of the palms and the fingers refer to the finger root part fork point connecting lines of each hand;
a finger area calculating subunit, configured to accumulate, for fingers of the left hand and the right hand, the areas of the first intermediate image and the second intermediate image, respectively, so as to obtain an area sum C1 of the first intermediate image and an area sum C2 of the second intermediate image;
a reference matrix calculation subunit, configured to calculate a matrix a × b to obtain a matrix E;
a palm area factor calculating subunit for calculating the palm area factors of the left hand and the right hand, respectively: p is a radical ofLeft palm=ln(r×(B1/(2×B’1))/VGrey scale 1),pRight palm=ln(R×(B2/(2×B’2))/VGrey scale 2);
The image noise filtering subunit is configured to filter the palm image, where a filtering factor β is:
and performing exponential filtering on the first frame palm image according to an image noise filter with a filtering factor beta, wherein the filtering parameter is the filtering factor beta.
Preferably, the value range of R is 0.02-0.1, and R is 0.08-0.3.
Preferably, R is 3 times R.
Preferably, the initial gray scale is RGB (255, 255, 255).
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.