Embodiment
The identity identifying method of a kind of palmmprint of the present invention and people's face fusion recognition is applied to a kind of comprising: the device of image collection module, palmmprint identification module and face recognition module.
The identity identifying method of a kind of palmmprint of the present invention and people's face fusion recognition; As shown in Figure 1; Comprise: image acquisition step, use same image collection module timesharing to obtain biometric image to be certified, said biometric image comprises: facial image and palmprint image; Identification step adopts the recognition of face instruction of presetting that said facial image to be certified is discerned, and/or adopts the palmmprint recognition instruction that presets that said image to be certified is discerned, and obtains face recognition result and palmmprint recognition result respectively; Merge determining step, judge according to face recognition result and palmmprint recognition result whether authentication is passed through.Through method of the present invention; The dual biometric authentication method that adopts the identification of recognition of face and palmmprint to combine; Not only satisfied the higher demand of authentication requirement level of security; And adopt noncontact palmmprint recognition technology and face recognition technology to combine, and adopt same image acquisition equipment just can realize the collection of two kinds of biometric images, practiced thrift cost.
Through specific embodiment content of the present invention is described in further detail below, but the present invention is not restricted to this.
Embodiment 1
The identity identifying method of a kind of palmmprint provided by the invention and people's face fusion recognition, as shown in Figure 2, comprising:
Step 201 is obtained facial image;
Step 202 is obtained palmprint image;
Step 203 is called the recognition of face instruction facial image that obtains is discerned, and obtains face recognition result;
Step 204 is called the palmmprint recognition instruction palmprint image that obtains is discerned, and obtains the palmmprint recognition result;
Step 205 judges according to the face recognition result and the palmmprint recognition result that obtain whether authentication is passed through.
In above-mentioned steps 201 and the step 202, adopt image acquiring device to obtain facial image and palmprint image respectively.In order to use same image acquiring device to obtain palmprint image and facial image, the present invention uses non-contacting image acquiring device, can get access to facial image easily, also can get access to the non-contacting palmprint image that is suitable for discerning simultaneously.
When obtaining palmprint image and facial image, can obtain facial image or palmprint image through sound or interface prompt user according to preset flow process.Such as, at first through the voice suggestion user with palm alignment image deriving means, after image acquiring device gets access to palmprint image, again through the voice suggestion user with people's face alignment image deriving means, so that image acquiring device obtains facial image.Certainly, the mode of prompting can also be the interface display information through identification authentication system, the perhaps mode that combines of voice suggestion and interface display information, and the present invention does not limit this.The order of above-mentioned steps 201 and step 202 can be changed arbitrarily, i.e. the present invention does not limit the order of obtaining facial image and palmprint image.When obtaining palmprint image and facial image, can only obtain a palmprint image or facial image at every turn, also can once obtain many palmprint images or facial image, confirm that according to the storage space of identification authentication system the present invention does not limit this.
Preferably; Said identification authentication system can not done in advance the order of taking facial image and palmprint image and be provided with; But judge automatically that according to the distinguishing characteristics of people's face and palmmprint the biometric image of current shooting is facial image or palmprint image, and call corresponding recognition instruction.Be user-friendly to, also can save the hardware resource for pointing out the user to be provided with of identification authentication system.Because palm has very big-difference with people's appearance ratio in shape, utilize their morphological feature just can well palm and people's face be distinguished.Piecemeal gradient statistic histogram can well be described the form and the marginal distribution of target, realizes simply, is widely used in object detection, and geometry and the optical deformation of image all had good robustness, is fit to very much the resemblance of description people's face and palm.Adopt the piecemeal gradient statistic histogram training svm classifier device of image in the present embodiment in advance; When identification; At first calculate the piecemeal gradient statistic histogram of the biometric image of taking, utilize the svm classifier device to judge that this image is facial image or palmprint image then.
In the above-mentioned steps 203, call the recognition of face instruction facial image that obtains is discerned, at first call the recognition of face instruction of presetting and from the said facial image that obtains, extract face characteristic to be identified.Can adopt Garbor wavelet character method and local binary pattern (LBP, local Binary Patterns) method, from the said facial image that obtains, extract lineup's face characteristic F
m, the face characteristic that extracts usually is the proper vector of one group of multidimensional.Then; With the identification of comparing of the face characteristic that extracts and all face characteristics in the subscriber identity information storehouse that prestores; The process of concrete comparison identification can for: adopt Euclidean distance or mahalanobis distance to represent the similarity of two people's face feature templates; The similarity score of everyone the face feature templates in the subscriber identity information storehouse of calculating the said people's face that extracts and prestoring; And keep the identify label of the face characteristic template of highest similarity score (similarity score is high more, and it is big more to represent that two stack features belong to same individual's possibility) and this highest similarity score correspondence.The identify label of said face characteristic template is the unique identification of the face characteristic template in the subscriber identity information storehouse that prestores, and each sign is represented an identity to be certified, and like a user, each sign can corresponding one or more groups face characteristic template.As first similarity score, the identify label of the face characteristic template that this highest similarity score is corresponding is as first identify label, and temporary transient the preservation with this highest similarity score.
In the above-mentioned steps 204, adopt the palmmprint recognition instruction preset that the said palmprint image that obtains is discerned, obtains the said palmprint image that obtains and the highest similarity score of the palm print characteristics template that prestores.Palm grain identification method can be divided into four big classifications basically: based on the method for structure, based on the method for statistics, based on the method for subspace with based on Methods for Coding.Based on Methods for Coding is to carry out Methods for Coding through the streakline direction of extracting palmprint image, has that discrimination height, characteristic are little, feature extraction and matching speed are fast, realize characteristics such as simple, thereby has obtained using the most widely.The present invention describes the identifying of palmmprint, but is not limited thereto method based on Methods for Coding palmprint image is identified as example.At first, adopt, obtain the identified region of the palmprint image of said collection, be i.e. the palm print characteristics zone like localization method based on contour feature point.So-called contour feature point also can be described as the palm key point, mainly refers to gap point and the finger tip summit of finger root, the most applications utilization be the nip point of forefinger and middle finger and the nip point of the third finger and little finger of toe.The characteristic that the relative position that this method is utilized the palm key point does not change with the change of palm direction, size, position can be confirmed the identified region of a relatively-stationary palmprint image effectively.Then, the identified region of palmprint image is divided into many sub-block, extracts the palmmprint textural characteristics of each sub-piece respectively, then the textural characteristics of each sub-piece is encoded, obtain the palmmprint textural characteristics of the identified region of palmprint image.At last; With the identification of comparing of the palmmprint textural characteristics that obtains and all palm print characteristics in the subscriber identity information storehouse that prestores; The process of concrete comparison identification can for: adopt Euclidean distance or mahalanobis distance to represent the similarity of two palm print characteristics templates; The similarity score of all the palm print characteristics templates in the subscriber identity information storehouse of calculating the said palmmprint that extracts and prestoring; And keep the identify label of the palm print characteristics template of highest similarity score (similarity score is high more, and it is big more to represent that two stack features belong to the possibility of same palm) and this highest similarity score correspondence.The identify label of said palm print characteristics template is the unique identification of the palm print characteristics template in the subscriber identity information storehouse that prestores, and each sign is represented an identity to be certified, and like a user, each sign can corresponding one or more groups palm print characteristics template.As second similarity score, the identify label of the palm print characteristics template that this highest similarity score is corresponding is as second identify label, and temporary transient the preservation with this highest similarity score.
The order of above-mentioned steps 203 and step 204 also can be changed arbitrarily, and the present invention does not do qualification to this.Preferably; Execution in step 203, step 202 were carried out afterwards execution in step 204 immediately immediately after step 201 was carried out; Can make the processing storage space identical with the processing of palmprint image of facial image, reach the effect of conserve memory resource with the identifying time-sharing multiplex with identifying.
In the above-mentioned steps 205, judge according to the face recognition result of step 203 acquisition and the palmmprint recognition result of step 204 acquisition whether authentication is passed through.First similarity score that obtains when said recognition of face is greater than presetting first threshold; And when said palmmprint is discerned second similarity score more than or equal to preset second threshold value; If said first identify label is identical with said second identify label, judge that then authentication passes through; Otherwise judge the authentication failure.Wherein, Said presetting first threshold is confirmed the recognition result that a large amount of facial images carries out recognition training according to the recognition of face instruction; The said second preset threshold value is confirmed the recognition result that a large amount of palmprint images carries out recognition training according to the palmmprint recognition instruction; When discerning similarity score, explain that the confidence level of recognition result is higher more than or equal to this threshold value.
According to the requirement of the strict degree of authentication, also can not judge similarity score, if said first identify label is identical with said second identify label, judge that then authentication passes through; Otherwise judge the authentication failure.
Through identity identifying method provided by the invention, adopt the dual living things feature recognition of recognition of face and palmmprint identification to carry out authentication, guaranteed the security of authentication; Simultaneously, the present invention adopts non-contacting palmmprint recognition technology, through an image acquiring device just can timesharing obtain palmprint image and facial image, practiced thrift the cost of ID authentication device.
Embodiment 2
In order to improve the efficient of authentication, the identity identifying method of a kind of palmmprint that another embodiment of the present invention provides and people's face fusion recognition, as shown in Figure 3, may further comprise the steps.
Step 301 is obtained facial image.This step is identical with the method and the course of work that the step 201 of embodiment 1 adopts.
Step 302 is called the recognition of face instruction facial image that obtains is discerned, and obtains first similarity score and first identify label.This step is identical with step 203 embodiment of embodiment 1, the concrete step 203 that realizes referring to embodiment 1.Can obtain the recognition result of facial image through this step, comprise: obtain first similarity score and first identify label.
Step 303 judges that whether first similarity score is greater than presetting first threshold.
When first similarity score during, explain that people's face to be certified is that in the user information database of presetting certain is opened the corresponding people's face of face characteristic template greater than presetting first threshold.Said presetting first threshold is more confirmed the recognition result of a large amount of people's faces according to the recognition of face instruction.When said first similarity score is less than or equal to presetting first threshold, this authentification failure.
Step 304 is obtained palmprint image.This step is identical with the method and the course of work that the step 202 of embodiment 1 adopts.
Step 305 is called the palmmprint recognition instruction palmprint image that obtains is discerned, and obtains second similarity score and second identify label.This step is identical with step 204 embodiment of embodiment 1, the concrete step 204 that realizes referring to embodiment 1.Can obtain the recognition result of palmprint image through this step, comprise: obtain second similarity score and second identify label.
Step 306 judges that whether second similarity score is greater than preset second threshold value.
When second similarity score during, explain that palmmprint to be certified is that in the user information database of presetting certain is opened the corresponding palmmprint of template greater than preset second threshold value.The said second preset threshold value is more confirmed the recognition result of a large amount of palmmprints according to the palmmprint recognition instruction.When said second similarity score is less than or equal to the second preset threshold value, this authentification failure.
Step 307 judges whether first identify label is identical with second identify label.
When second similarity score that first similarity score that obtains when recognition of face and palmmprint identification obtain all satisfies preset threshold value and requires, judge further whether recognition of face and palmmprint are discerned the identify label that obtains identical.When first identify label of recognition of face acquisition is identical with second identify label of palmmprint identification acquisition; Think that authentication passes through, the user's is the corresponding user of first identify label or second identify label in the preset user information database under people's face promptly to be identified and the palmprint image.Otherwise authentication is failed, and does not have user's to be certified people's face and/or palm print characteristics information in the promptly preset user information database.
In the present embodiment, the order of step 301 ~ 303 and step 304 ~ 306 can be changed, and promptly can gather facial image earlier, and facial image is discerned, and when the similarity score that obtains in recognition of face is higher than presetting first threshold, carries out palmmprint identification again; Can gather palmprint image earlier yet, palmprint image is discerned, when the similarity score that obtains in palmmprint identification is higher than the second preset threshold value, carry out recognition of face again, the present invention does not do qualification to this.
Embodiment 3
Require under the higher situation in efficient authentication; In the step 305 of the foregoing description 2 when the palmprint image that obtains is discerned, the identification of comparing of all palm print characteristics in the palmmprint textural characteristics that can not will obtain and the subscriber identity information storehouse that prestores.But, from preset identity information storehouse, extract all corresponding palm print characteristics templates of this first identify label according to first identify label that obtains in the step 302; Then, with the identification of comparing of the palmmprint textural characteristics that obtains and all corresponding palm print characteristics templates of this first identify label of extraction, obtain the highest similarity score, as second similarity score.In above-mentioned steps 306; Judge that whether second similarity score is greater than the second preset threshold value; When second similarity score during greater than preset second threshold value, think that authentication passes through, user to be certified is that ID is the user of first identify label in the preset user information database.Otherwise, this authentification failure.Needn't carry out the step 307 among the embodiment 2 again.
Equally, present embodiment promptly can be gathered facial image earlier, and facial image is discerned, and when the similarity score that obtains in recognition of face is higher than presetting first threshold, carries out palmmprint identification again; Can gather palmprint image earlier yet, palmprint image is discerned, when the similarity score that obtains in palmmprint identification is higher than the second preset threshold value, carry out recognition of face again, the present invention does not do qualification to this.
Embodiment 4
At first, the present invention provides the identification authentication system of a kind of palmmprint and people's face fusion recognition, and is as shown in Figure 1, and this device comprises: image collection module 10, main processing block 11 and memory module 12; Said main processing block 11 further comprises: control module 111, the face identification unit 113 that is connected with said control module respectively and palmmprint recognition unit 114, and said control module 111 is electrically connected with image collection module 10; Said face identification unit 113 is connected with memory module 12 respectively with palmmprint recognition unit 114.
Wherein, said image collection module 10 further comprises: camera lens 101 and imageing sensor 102, be used for instruction according to control module 111, and the biometric image before the taking lens comprises: facial image or palmprint image, and send to said control module.Said control module 111 is according to preset flow for authenticating ID, and promptly the recognition sequence of facial image and palmprint image is sent to take and instructed to image collection module 10, controls said image collection module 10 and takes facial image and palmprint image to be identified.Said image acquiring device can obtain the biometric image under the visible light environment.Preferably,, before the camera lens of said image acquiring device infra-red transmitting filter can also be set, around camera lens, infrared light filling lamp be set, be used to take the biometric image under the IR in order to adapt to the darker environment of light.
Control module 111 will send to face identification unit 113 from the biometric image that image acquiring device 10 receives according to the current identification process of said identification authentication system or palmmprint recognition unit 114 is discerned, and obtains recognition result.When control module 111 judges that according to preset flow for authenticating ID the current identification process of said identification authentication system is recognition of face, the biometric image that receives is sent to said face identification unit 113 discern; When control module 111 judges that according to preset flow for authenticating ID the current identification process of said identification authentication system is palmmprint identification, the biometric image that receives is sent to said palmmprint recognition unit 114 discern.
Said face identification unit 113 is called the recognition of face instruction of presetting and from the biometric image that receives, is extracted face characteristic to be identified; And calculate in said face characteristic to be identified and the memory module 12 similarity score of everyone the face feature templates in the stored user information storehouse in advance; With the highest similarity score as first similarity score; And the identify label of the face characteristic template that this highest similarity score is corresponding is as first identify label, and will comprise that the recognition result of said first similarity score and first identify label feeds back to control module 111.
Said palmmprint recognition unit 114 calls the noncontact palmmprint recognition instruction that presets and from the biometric image that receives, extracts palm print characteristics to be identified; And calculate in said palm print characteristics to be identified and the memory module 12 similarity score of all the palm print characteristics templates in the stored user information storehouse in advance; With the highest similarity score as second similarity score; And the identify label of the palm print characteristics template that this highest similarity score is corresponding is as second identify label, and will comprise that said second similarity score and second identify label feed back to control module 111.
Said control module 111 also is used for according to the recognition result of face identification unit 113 with palmmprint recognition unit 114 feedbacks, judges whether authentication is successful.Concrete judgment mode comprises following several kinds, and present embodiment is an example at first to carry out recognition of face.First kind: first similarity score in said recognition result is higher than presetting first threshold; And when said second similarity score is higher than the second preset threshold value; If said first identify label is identical with second identify label, judge that then authentication passes through; Otherwise, the authentication failure.Second kind: when first similarity score in determining face recognition result is higher than presetting first threshold; Proceed palmmprint identification; Second similarity score that obtains until palmmprint identification is higher than the corresponding second preset threshold value; And first identify label that recognition of face obtains, second identify label that identification obtains with palmmprint is identical, thinks that authentication is successful; Otherwise authentification failure determines one's identity.The third: when first similarity score that determines face recognition result is higher than corresponding presetting first threshold; Said control module 111 sends to palmmprint recognition unit 114 with said first identify label; Palmmprint recognition unit 114 is when carrying out follow-up palmmprint identification; The highest similarity score of only calculating the palm print characteristics template in the characteristic of the current palmprint image that the obtains memory module 12 corresponding with said first identify label is as second similarity score; When this second similarity score was higher than the second preset threshold value, the affirmation authentication was passed through, otherwise the authentication failure.The present invention does not limit the order of recognition of face and palmmprint identification, can also be to carry out palmmprint identification earlier, carries out recognition of face again.
Memory module 12 can be flash memory (FLASH), is used for storing in advance the identity information storehouse, comprises at least one palm print characteristics template and at least one face feature templates of at least one identify label in the said identity information storehouse.Each identify label can corresponding a plurality of palm print characteristics templates and face feature templates in the said identity information storehouse.Said memory module 12 can also be used to store the record of authentication.
Embodiment 5
Preferably, as shown in Figure 5, can also comprise like embodiment 4 described identification authentication systems: indicating module 13.Said indicating module 13 can be pronunciation device, like TTS speech chip and loudspeaker; Also can be display device, like LCDs; It also can be the combination of pronunciation device and display device.Said indicating module 13 is electrically connected with control module 111, the information that the steering order that is used for sending according to control module shows or broadcast indication user takes facial image and palmprint image.As passing through auditory tone cues user to be certified with palmmprint alignment image deriving means; Or facial image and the palmprint image taken through the interface display image acquiring device; Be convenient to the quality that user to be certified understands the biometric image that image acquiring device obtains; In time the adjustment attitude so that image acquiring device photographs better biometric image, helps improving the efficient of authentication.
Embodiment 6
Preferably; As shown in Figure 6; Like embodiment 4 described identification authentication systems; Wherein main processing block 11 can also comprise the judging unit 112 that is electrically connected with control module 111, and said judging unit 112 is used for judging automatically that according to the distinguishing characteristics of palmmprint and people's face the biometric image that image acquiring device gets access to is palmprint image or facial image.
Though invention has been described for top combination embodiment, to those skilled in the art, it is understandable that the foregoing description should not thought the protection domain that limits the present invention with this only for example purposes.Protection scope of the present invention is only limited by claim.Though in the above-mentioned explanation, for ease of understanding, the step of method has been adopted the succession description, should be pointed out that for the order of above-mentioned steps and do not do strict the restriction.In addition, realize that all or part of step in the foregoing description method is to instruct relevant hardware to accomplish through program, this program can be stored in the computer read/write memory medium, as: ROM/RAM, magnetic disc, CD etc.Also have, the apparatus structure shown in accompanying drawing or the embodiment only is to schematically show logical organization.The module that wherein shows as separating component maybe or possibly not be physically to separate, and the parts that show as module also possibly be possibly not be physical module perhaps.
In addition, in claims, term " comprises " does not get rid of other parts of existence or step.In addition, although in different claims, comprised each characteristic, these characteristics can be by advantageously combination, and each characteristic is included in the different claims and does not mean that these combination of features are infeasible and/or disadvantageous.In addition, single implication is not got rid of a plurality of.Therefore, the implication of " " etc. is not got rid of a plurality of.
In addition, those skilled in the art can make amendment, change or replace under the prerequisite that does not break away from spirit of the present invention it, and still, the various equivalent variations according to the present invention did still belong to the scope that the present invention is contained.