CN113435229A

CN113435229A - Face iris multi-mode recognition method and device, readable storage medium and equipment

Info

Publication number: CN113435229A
Application number: CN202010207142.0A
Authority: CN
Inventors: 彭程; 周军
Original assignee: Beijing Eyes Intelligent Technology Co ltd; Shenzhen Aiku Smart Technology Co ltd; Beijing Eyecool Technology Co Ltd
Current assignee: Beijing Eyes Intelligent Technology Co ltd; Shenzhen Aiku Smart Technology Co ltd; Beijing Eyecool Technology Co Ltd
Priority date: 2020-03-23
Filing date: 2020-03-23
Publication date: 2021-09-24

Abstract

The invention discloses a face iris multi-mode recognition method, a face iris multi-mode recognition device, a readable storage medium and equipment, and belongs to the field of biological recognition. Firstly, carrying out primary identification through a face image to obtain a primary user group; then, calculating a rotation angle by using a difference value between the position of human eyes in the image and a reference point, and realizing the simultaneous rotation of the iris lens and the human face lens by rotating the holder; and the holder rotates and simultaneously collects the face image and the iris image in real time, and secondary recognition is carried out by utilizing the face image and the iris image which are collected secondarily. And if the face image acquired for the second time is similar to the face image acquired for the first time, directly using the preliminarily determined user group to perform iris recognition. The invention can quickly and accurately complete the acquisition of the face information and the iris information of the user without the matching of the height, and can carry out high-precision identity recognition and living body detection.

Description

Face iris multi-mode recognition method and device, readable storage medium and equipment

Technical Field

The invention relates to the field of biological recognition, in particular to a face iris multi-mode recognition method, a face iris multi-mode recognition device, a computer readable storage medium and computer readable storage equipment.

Background

The biometric identification technology is closely combined with high-tech means such as optics, acoustics, biosensors and the principle of biometrics through a computer, and personal identity is identified by utilizing the inherent physiological characteristics (such as fingerprints, human faces, irises and the like) and behavior characteristics (such as handwriting, voice, gait and the like) of a human body.

The face recognition technology has become the most mainstream biometric technology at present, and the usability and the richness of data samples are incomparable with other biometric technologies. But has a slight lack of safety, such as: twins, prosthetic attacks, etc.

The iris, as an important identification feature, has the advantages of lifelong uniqueness, stability, collectability, non-invasiveness and the like, and is a necessary trend of identification research and application development. But the usability is worse than that of face recognition, and the data sample size is not too rich.

In addition, in the process of iris recognition, it is necessary to quickly and accurately capture iris information of a user, but each iris area is small (about 1cm in diameter) and the number of pixels captured for the iris area is large (about 20 pixels/mm). Therefore, the traditional iris acquisition equipment has the problems of small depth of field and high height fitting degree in the process of acquiring the iris.

Disclosure of Invention

In order to solve the technical problems, the invention provides a face iris multi-mode recognition method, a device, a readable storage medium and equipment.

The technical scheme provided by the invention is as follows:

in a first aspect, the present invention provides a face iris multi-modal recognition method, including:

acquiring images through a face lens and an iris lens which are simultaneously arranged on a holder to obtain a first face image and a first iris image;

comparing the first face image with a face template in a database to obtain a user group passing the comparison, and loading an iris template of the user group passing the comparison into a region to be compared from the database;

calculating the angle of the cradle head required to rotate according to the position coordinates of human eyes obtained by positioning on the first face image and/or the first iris image and preset reference coordinates, rotating the cradle head according to the angle of the cradle head required to rotate, and simultaneously carrying out image acquisition in real time through the face lens and the iris lens to obtain a second face image and a second iris image;

and recognizing by using a second face image and a second iris image, wherein:

comparing the second face image with the first face image;

if the comparison of the second face image and the first face image is passed, comparing the second iris image with an iris template in the area to be compared to obtain a comparison result;

if the comparison between the second face image and the first face image fails, the second face image and the second iris image are compared with a face template and an iris template in a database respectively to obtain a face comparison result and an iris comparison result, and the comparison result is obtained according to the face comparison result and the iris comparison result.

Further, if the second iris image does not pass the comparison with all the iris templates in the area to be compared, the second face image and the second iris image are compared with the face template and the iris template in the database respectively to obtain a face comparison result and an iris comparison result, and the comparison result is obtained according to the face comparison result and the iris comparison result.

Further, the angle that the cloud platform needs to rotate is calculated according to the eye position coordinate that obtains on first face image and/or the first iris image location and preset reference coordinate, the cloud platform rotates according to the angle that the cloud platform needs to rotate to carry out image acquisition in real time simultaneously through face camera lens and iris camera lens, obtain second face image and second iris image, include:

positioning the first face image to obtain a first eye position coordinate, and calculating a first angle of the holder to be rotated according to the first eye position coordinate and a preset reference coordinate;

rotating the holder according to the first angle, and detecting whether eyes appear on a first iris image acquired by an iris lens in real time in the rotating process of the holder;

after the eyes appear on a first iris image acquired in real time, positioning the first iris image to obtain a second eye position coordinate, and calculating a second angle of the holder to be rotated according to the second eye position coordinate and a preset reference coordinate;

and rotating the holder according to a second angle, and simultaneously carrying out image acquisition on the face lens and the iris lens in real time in the rotating process of the holder and after the rotation of the holder is finished to obtain a second face image and a second iris image.

Further, when the cloud platform is rotated according to the first angle, the front part of the first angle rotates at a first speed, the rear part rotates at a second speed, and whether eyes appear on a first iris image acquired by an iris lens in real time is detected in real time in the process that the rear part rotates at the second speed; rotating at a third speed when the cloud platform is rotated according to a second angle; the first speed > second speed > third speed.

Further, the first iris image is not displayed on the display device, and the second iris image is displayed on the display device.

Further, the recognizing by using the second face image and the second iris image previously includes:

and performing living body detection through the visible light face information, the near-infrared face information and the iris information in the second face image and the second iris image.

Further, the area to be compared is a memory or a cloud server.

In a second aspect, the present invention provides a face iris multi-modal recognition apparatus, including:

the acquisition module is used for acquiring images through a face lens and an iris lens which are simultaneously arranged on the holder to obtain a first face image and a first iris image;

the comparison module is used for comparing the first face image with a face template in a database to obtain a user group which passes the comparison, and loading an iris template of the user group which passes the comparison into a region to be compared from the database;

the rotating module is used for calculating an angle of the cradle head required to rotate according to a position coordinate of human eyes obtained by positioning on the first face image and/or the first iris image and a preset reference coordinate, rotating the cradle head according to the angle of the cradle head required to rotate, and simultaneously carrying out image acquisition in real time through the face lens and the iris lens to obtain a second face image and a second iris image;

the recognition module is used for recognizing by using a second face image and a second iris image, wherein:

comparing the second face image with the first face image;

Further, the rotation module includes:

the first calculation unit is used for positioning on the first face image to obtain a first eye position coordinate, and calculating to obtain a first angle of the holder to be rotated according to the first eye position coordinate and a preset reference coordinate;

the first rotating unit is used for rotating the holder according to the first angle and detecting whether eyes appear on a first iris image acquired by the iris lens in real time in the rotating process of the holder;

the second calculation unit is used for positioning on the first iris image to obtain a second human eye position coordinate after detecting that eyes appear on the first iris image acquired in real time, and calculating to obtain a second angle of the holder required to rotate according to the second human eye position coordinate and a preset reference coordinate;

and the second rotating unit is used for rotating the holder according to a second angle, and simultaneously carrying out image acquisition on the face lens and the iris lens in real time in the rotating process of the holder and after the rotation of the holder is finished so as to obtain a second face image and a second iris image.

Further, the apparatus further comprises:

and the living body detection module is used for carrying out living body detection through the visible light face information, the near infrared face information and the iris information in the second face image and the second iris image.

Further, the area to be compared is a memory or a cloud server.

In a third aspect, the present invention provides a computer-readable storage medium for multi-modal recognition of a face iris, comprising a memory for storing processor-executable instructions, which when executed by the processor, implement the steps of the face iris multi-modal recognition method comprising the first aspect.

In a fourth aspect, the present invention provides an apparatus for multimodal identification of human iris, including at least one processor and a memory storing computer executable instructions, where the processor implements the steps of the method for multimodal identification of human iris according to the first aspect when executing the instructions.

The invention has the following beneficial effects:

1. the invention can automatically adapt to users with different heights and distances by using a human eye positioning mode, and quickly, accurately and captively captures the face and iris information of the users without any coordination of the users.

2. The invention can simultaneously capture the colorful face image of the user and the clear near-infrared face region image (iris image) including human eyes, avoids the problem that the traditional face and iris need to be collected twice and the iris and face information can not be ensured to be the information of the same person, and improves the accuracy of identity recognition.

3. The invention can effectively stagger the time difference of lens rotation, realize the face comparison of a large database and the iris comparison of a small user group (small n database), and greatly improve the comparison efficiency.

Drawings

FIG. 1 is a flow chart of a face iris multi-modal recognition method of the present invention;

fig. 2 is a schematic diagram of the face iris multi-mode recognition device of the invention.

Detailed Description

In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings and specific embodiments. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.

Example 1:

the embodiment of the invention provides a face iris multi-mode recognition method, as shown in figure 1, the method comprises the following steps:

s100: the method comprises the steps of carrying out image acquisition through a face lens and an iris lens which are simultaneously installed on a holder to obtain a first face image and a first iris image.

The face iris multi-mode recognition method is suitable for equipment with two groups of imaging modules of a face lens and an iris lens, wherein the face lens and the iris lens are simultaneously arranged on a rotating holder and can rotate up and down and/or left and right, the field angle of the face lens is larger, and the field angle of the iris lens is smaller.

The invention is not limited to the specific structure of the pan/tilt head, and can be, for example, an electric two-dimensional pan/tilt head (capable of rotating up and down and left and right) controlled by a stepping motor, or a simple rotating shaft (capable of only rotating up and down or left and right), and the rotating shaft is controlled by the stepping motor.

The face lens and the iris lens can be simultaneously opened, simultaneously acquire the face image and the iris image in real time, and also can decide to open a certain lens after the conditions are met.

S200: and comparing the first face image with the face template in the database to obtain a user group passing the comparison, and loading the iris template of the user group passing the comparison into the area to be compared from the database.

S100, acquiring a first face image, then comparing the acquired first face image with face templates in a database (marked as a large N database) in real time, identifying and finding out a user group (marked as a small N database group) passing comparison from the large N database, and extracting iris templates corresponding to the small N database group to prepare the iris templates in a region to be compared.

If the comparison mode is that the local computer performs comparison, the area to be compared is the internal memory of the local computer, and the iris templates corresponding to the small n database crowd are read into the internal memory of the local computer to be compared. And if the comparison mode is remote comparison of the back-end cloud service, the to-be-compared area is a cloud server, and the iris templates corresponding to the small n database crowd are sent to the cloud server to be compared.

When the first face image is compared with the face template in the database, a comparison score is obtained, and if the comparison score is larger than a set threshold, the comparison is considered to be passed. The user group passing the comparison is a user determined preliminarily, and the target user has a relatively high probability in the user group. Therefore, the iris templates corresponding to the user group are loaded in advance, and the subsequent iris comparison of the users is carried out.

S300: and calculating the angle of the cradle head required to rotate according to the position coordinates of human eyes obtained by positioning on the first face image and/or the first iris image and preset reference coordinates, rotating the cradle head according to the angle of the cradle head required to rotate, and simultaneously carrying out image acquisition in real time through the face lens and the iris lens to obtain a second face image and a second iris image.

The eye position is positioned on the first face image and the first iris image through an eye positioning algorithm, so that the eye position coordinate is found, and the angle of the holder required to rotate is obtained according to the eye position coordinate and the preset reference coordinate.

The preset reference coordinate is predetermined, and an iris image which is complete and clear and has the human eye position in the middle of the picture can be acquired at the reference coordinate. After the position coordinates of human eyes are obtained through positioning, the angle of the stepping motor needing to rotate is converted according to the pixel difference between the position coordinates of the human eyes and the reference coordinates, a rotation instruction is sent to the motor, and the motor is ready to rotate.

Specifically, when the holder can rotate in two dimensions, a horizontal rotation angle and a longitudinal rotation angle are calculated according to pixel differences between a horizontal ordinate and a vertical ordinate of the human eye position respectively; when the pan-tilt can only rotate up and down or left and right in one dimension (because the invention is mostly suitable for users with different heights, the one-dimensional rotation is generally up and down rotation), the horizontal rotation angle or the longitudinal rotation angle is calculated according to the pixel difference between the horizontal coordinate or the vertical coordinate of the position of the human eye and the reference horizontal coordinate or the vertical coordinate.

In the step, the rotation angle can be calculated by using only the position coordinates of human eyes on the first face image, can also be calculated by using only the position coordinates of human eyes on the first iris image, and can also be used for both.

When the rotation angle is calculated through the coordinates of the positions of the human eyes on the first face image and the first iris image, the angle of view of the face lens is larger, and the angle of view of the iris lens is smaller, so that the human eyes can be detected more easily by the first face image than by the first iris image, but the resolution of the position of the human eyes of the first iris image is higher, and the position of the human eyes of the first iris image is more accurate. Based on this, the rotation angle may be preliminarily determined using the first face image, and then the rotation angle may be accurately determined using the first iris image.

After the angle of the cradle head required to rotate is obtained through calculation, the stepping motor rotates the cradle head according to the angle, and in the rotating process of the cradle head (generally, a period of time after the cradle head finishes rotating), image acquisition is simultaneously carried out in real time through the face lens and the iris lens which are installed on the cradle head, so that a second face image and a second iris image are obtained.

S400: and performing recognition by using the second face image and the second iris image.

The invention relates to a multi-mode recognition method of human face irises, which comprehensively judges through human face comparison and iris comparison and comprises the following specific processes:

firstly, the second face image is compared with the first face image, and a subsequent comparison process is determined according to a comparison result.

And if the second face image passes the comparison with the first face image, comparing the second iris image with the iris template in the area to be compared to obtain a comparison result.

When the second facial image is compared with the first facial image, a comparison score is obtained, and if the comparison score is greater than a certain threshold (for example, 90 scores), the comparison is passed, which indicates that the second facial image and the first facial image are very similar, that is, the second facial image and the first facial image are from the same person.

In S200, the first face image is compared with the face template in the database, a user group (small n database groups) is preliminarily screened out, and the iris template of the user group is loaded into the memory or sent to the cloud server.

Since the second face image and the first face image pass through the comparison, the comparison result is very similar to each other, so that the comparison result of the first face image (small N database crowd) can be directly used as the comparison result of the second face image without comparing the second face image with the face template in the large N database, and the comparison result can be obtained by directly comparing the second iris image with the iris template of the small N database crowd in the to-be-compared area.

Because first face image is compared with the face template in the database and can be gone on with the cloud platform rotation simultaneously, the camera lens pivoted time difference that effectively staggers, make full use of time reduces the camera lens and rotates the comparison time of finishing back second face image and iris image, and the comparison efficiency can be very high like this, and experience speed is very fast.

The comparison of the second face image and the first face image fails, which indicates that the second face image and the first face image are not similar to each other, and the second face image and the first face image are not from the same person. Therefore, the group of the small N databases obtained by comparing the first face image is not the comparison result of the second face image and cannot be used directly, and needs to be compared again in the large N database to obtain two comparison results, and the final comparison result is obtained according to the two comparison results by comprehensive consideration.

Firstly, carrying out primary identification through a face image to obtain a primary user group; then, calculating a rotation angle by using a difference value between the position of human eyes in the image and a reference point, and realizing the simultaneous rotation of the iris lens and the human face lens by rotating the holder; and the holder rotates and simultaneously collects the face image and the iris image in real time, and secondary recognition is carried out by utilizing the face image and the iris image which are collected secondarily. And if the face image acquired for the second time is similar to the face image acquired for the first time, directly using the preliminarily determined user group to perform iris recognition.

The invention has the following advantages:

And when the second iris image is compared with all iris templates in the area to be compared, if the second iris image does not pass the comparison with all iris templates in the area to be compared, comparing the second face image and the second iris image with face templates and iris templates in a database respectively to obtain a face comparison result and an iris comparison result, and obtaining the comparison result according to the face comparison result and the iris comparison result.

And the second iris image and all iris templates in the area to be compared do not pass comparison, which indicates that no matched user exists in the small N database, the comparison range needs to be expanded, and the comparison is returned to the large N database for comparison.

The aforementioned S300 includes:

s310: and positioning on the first face image to obtain a first eye position coordinate, and calculating according to the first eye position coordinate and a preset reference coordinate to obtain a first angle of the holder required to rotate.

Therefore, the invention firstly calculates the rotation angle of the holder preliminarily according to the eye coordinates on the first face image, namely the first angle.

S320: the holder is rotated according to the first angle, and whether eyes appear on a first iris image acquired by the iris lens in real time is detected in real time in the rotating process of the holder.

S330: and after the eyes appear on the first iris image acquired in real time, positioning the first iris image to obtain a second eye position coordinate, and calculating according to the second eye position coordinate and a preset reference coordinate to obtain a second angle of the holder required to rotate.

Although the angle of view of the iris lens is relatively small, the resolution is high, and therefore, if a human eye is found on the first iris image during the rotation, the rotation angle is corrected based on the first iris image to obtain the second angle.

S340: and rotating the holder according to the second angle, and simultaneously carrying out image acquisition on the face lens and the iris lens in real time in the rotating process of the holder and after the rotation of the holder is finished to obtain a second face image and a second iris image.

When the cloud platform is rotated according to the first angle, the front part of the first angle rotates at the first speed, the rear part rotates at the second speed, and in the process that the rear part rotates at the second speed, whether eyes appear on a first iris image acquired by an iris lens in real time is detected in real time; rotating at a third speed when the cloud platform is rotated according to a second angle; first speed > second speed > third speed.

One specific example is: the first 70% of the first angle rotates at a high speed, the second 30% of the first angle starts to decelerate, and the iris lens is used for starting to judge whether eyes appear frame by frame; in the rotating process, once the iris lens finds iris position information data, the iris coordinate pixel number is immediately obtained, the pixel number difference value of the iris coordinate and the reference coordinate is calculated for the second time, the rotating numerical value of the rotating stepping motor is given according to the pixel difference value, and then the holder rotates for the second time.

In the process of secondary rotation, the rotation speed at the moment is slower than that of the previous rotation, and is more stable, the image acquisition and quality judgment operation of the face and iris information can be started simultaneously, the biological characteristics of the acquired face and iris image information are extracted and loaded into the memory for comparison at any time.

The invention adopts a secondary positioning method, the face lens is quickly positioned for the first time, the iris lens is accurately positioned for the second time, and the adaptation of the height and the position of the user can be quickly and accurately realized.

The first iris image of the present invention is not displayed on the display device, and the second iris image is displayed on the display device.

Because the iris image of the iris lens eraser is black-and-white near-infrared data and the interactivity is not too good, when the iris is not detected (namely the first iris image), the first iris image is not displayed temporarily in the interactive picture of the display device. After the human eyes are positioned on the iris image, the actual interactive picture (namely the second iris image) of the iris is displayed, and the fact that the lens rotates to a proper position is indicated at the moment, so that the acquired iris image is proper, and the user can conveniently and visually know the condition of iris snapshot.

The invention can also utilize the second face image and the second iris image to carry out the living body detection, and the living body detection step is before the identification by using the second face image and the second iris image, and the living body detection method comprises the following steps:

s350: and performing living body detection through the visible light face information, the near-infrared face information and the iris information in the second face image and the second iris image.

In S350, the invention utilizes the face and iris information collected by the two lenses to carry out comprehensive living body detection and judgment, integrates the comprehensive living body judgment of the visible light face, the near-infrared face information and the iris information, and carries out the living body detection and judgment in multiple modes simultaneously, thereby effectively avoiding the possibility and risk of various false body attacks.

Example 2:

the embodiment of the invention provides a face iris multi-mode recognition device, as shown in fig. 2, the device comprises:

the acquisition module 10 is configured to acquire an image through a face lens and an iris lens that are simultaneously mounted on the pan-tilt to obtain a first face image and a first iris image.

And the comparison module 20 is configured to compare the first face image with a face template in the database to obtain a user group that passes the comparison, and load an iris template of the user group that passes the comparison into the to-be-compared area from the database.

And the rotating module 30 is used for calculating an angle of the cradle head required to rotate according to the eye position coordinates obtained by positioning on the first face image and/or the first iris image and preset reference coordinates, rotating the cradle head according to the angle of the cradle head required to rotate, and simultaneously performing image acquisition in real time through the face lens and the iris lens to obtain a second face image and a second iris image.

A recognition module 40, configured to perform recognition using the second face image and the second iris image, wherein:

comparing the second face image with the first face image;

if the comparison of the second face image and the first face image is passed, comparing the second iris image with the iris template in the area to be compared to obtain a comparison result;

The invention has the following advantages:

The aforementioned rotation module comprises:

the first rotating unit is used for rotating the holder according to a first angle and detecting whether eyes appear on a first iris image acquired by the iris lens in real time in the rotating process of the holder;

the second calculation unit is used for positioning the first iris image to obtain a second eye position coordinate after detecting that eyes appear on the first iris image acquired in real time, and calculating a second angle of the cradle head required to rotate according to the second eye position coordinate and a preset reference coordinate;

and the second rotating unit is used for rotating the holder according to a second angle, and simultaneously carrying out image acquisition on the face lens and the iris lens in real time in the rotating process of the holder and after the rotation of the holder is finished, so as to obtain a second face image and a second iris image.

The face iris multi-mode recognition device further comprises:

The area to be compared is a memory or a cloud server.

The device provided by the embodiment of the present invention has the same implementation principle and technical effect as the method embodiment 1, and for the sake of brief description, reference may be made to the corresponding content in the method embodiment 1 for the part where the embodiment of the device is not mentioned. It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the apparatus and the unit described above may all refer to the corresponding processes in the above method embodiment 1, and are not described herein again.

Example 3:

the method provided by this specification and described in the above embodiment 1 can implement the service logic through a computer program and record the service logic on a storage medium, and the storage medium can be read and executed by a computer, so as to achieve the effect of the solution described in embodiment 1 of this specification. Accordingly, the present invention also provides a computer readable storage medium for multi-modal recognition of a face iris, comprising a memory for storing processor executable instructions which, when executed by the processor, implement the steps comprising the face iris multi-modal recognition method of embodiment 1.

Firstly, carrying out primary identification through a face image to obtain a primary user group; then, calculating a rotation angle by using a difference value between the position of human eyes in the image and a reference point, and realizing the simultaneous rotation of the iris lens and the human face lens by rotating the holder; and the holder rotates and simultaneously collects the face image and the iris image in real time, and secondary recognition is carried out by utilizing the face image and the iris image which are collected secondarily. And if the face image acquired for the second time is similar to the face image acquired for the first time, directly using the preliminarily determined user group to perform iris recognition. The invention can quickly and accurately complete the acquisition of the face information and the iris information of the user without the matching of the height, and can carry out high-precision identity recognition and living body detection.

The storage medium may include a physical device for storing information, and typically, the information is digitized and then stored using an electrical, magnetic, or optical media. The storage medium may include: devices that store information using electrical energy, such as various types of memory, e.g., RAM, ROM, etc.; devices that store information using magnetic energy, such as hard disks, floppy disks, tapes, core memories, bubble memories, and usb disks; devices that store information optically, such as CDs or DVDs. Of course, there are other ways of storing media that can be read, such as quantum memory, graphene memory, and so forth.

The device described above may also include other implementations in accordance with the description of method embodiment 1. The specific implementation manner may refer to the description of the related method embodiment 1, and is not described in detail here.

Example 4:

the invention also provides a device for multi-modal facial iris recognition, which can be a single computer and can also comprise an actual operating device and the like using one or more methods or one or more embodiment devices of the specification. The device for multimodal identification of the face iris may comprise at least one processor and a memory storing computer executable instructions, wherein the processor executes the instructions to implement the steps of the multimodal identification method of the face iris in any one or more of the embodiments 1.

The above description of the device according to the method or apparatus embodiment may also include other implementation manners, and a specific implementation manner may refer to the description of related method embodiment 1, which is not described in detail herein.

It should be noted that, the above-mentioned apparatus or system in this specification may also include other implementation manners according to the description of the related method embodiment, and a specific implementation manner may refer to the description of the method embodiment, which is not described herein in detail. The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the hardware + program class, storage medium + program embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for the relevant points, refer to the partial description of the method embodiment.

The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a vehicle-mounted human-computer interaction device, a cellular telephone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

For convenience of description, the above devices are described as being divided into various modules by functions, and are described separately. Of course, when implementing one or more of the present description, the functions of each module may be implemented in one or more software and/or hardware, or a module implementing the same function may be implemented by a combination of multiple sub-modules or sub-units, etc. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may therefore be considered as a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method or apparatus that comprises the element.

As will be appreciated by one skilled in the art, one or more embodiments of the present description may be provided as a method, system, or computer program product. Accordingly, one or more embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, one or more embodiments of the present description may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

One or more embodiments of the present description may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. One or more embodiments of the present specification can also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment. In the description of the specification, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the specification. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the present invention in its spirit and scope. Are intended to be covered by the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Claims

1. A face iris multi-mode recognition method is characterized by comprising the following steps:

and recognizing by using a second face image and a second iris image, wherein:

comparing the second face image with the first face image;

2. The face iris multi-modal identification method according to claim 1, wherein if the second iris image does not pass the comparison with all iris templates in the area to be compared, the second face image and the second iris image are compared with the face template and the iris template in the database respectively to obtain a face comparison result and an iris comparison result, and the comparison result is obtained according to the face comparison result and the iris comparison result.

3. The multi-modal face iris recognition method according to claim 1, wherein the step of obtaining the angle of the cradle head required to rotate according to the position coordinates of human eyes obtained by positioning on the first face image and/or the first iris image and preset reference coordinates through calculation, rotating the cradle head according to the angle of the cradle head required to rotate, and simultaneously performing image acquisition in real time through the face lens and the iris lens to obtain a second face image and a second iris image comprises the steps of:

4. The multi-mode face iris recognition method according to claim 3, characterized in that when the cloud platform is rotated according to the first angle, the former part of the first angle rotates at the first speed, the latter part rotates at the second speed, and in the process of the latter part rotating at the second speed, whether eyes appear on the first iris image acquired by the iris lens in real time is detected in real time; rotating at a third speed when the cloud platform is rotated according to a second angle; the first speed > second speed > third speed.

5. The multi-modal facial iris recognition method of claim 4 wherein the first iris image is not displayed on a display device and the second iris image is displayed on a display device.

6. The multi-modal facial iris recognition method of any one of claims 1-5, wherein the recognition using the second facial image and the second iris image further comprises:

7. The face iris multi-modal identification method as claimed in claim 6, wherein the region to be compared is a memory or a cloud server.

8. A device for multi-modal iris recognition of a human face, the device comprising:

comparing the second face image with the first face image;

9. A computer-readable storage medium for multi-modal iris recognition of a human face, comprising a memory for storing processor-executable instructions which, when executed by the processor, implement steps comprising the multi-modal iris recognition method of a human face as claimed in any one of claims 1 to 7.

10. An apparatus for multi-modal iris recognition of a human face, comprising at least one processor and a memory storing computer executable instructions, the processor implementing the steps of the multi-modal iris recognition method of a human face as claimed in any one of claims 1 to 7 when executing the instructions.