KR20230049535A - User authentication apparatus and method using combination of iris authentication and face authentication - Google Patents

Abstract

Disclosed is a user authentication device using the combination of iris authentication and face authentication in the present invention. The user authentication device performs functions of: storing a registered iris image and a registered face image of each registered user; classifying the registered users into a primary authentication group when a recognition possibility score (P) calculated from each registered iris image is a reference score (Pref) or more, and into a secondary authentication group when the recognition possibility score (P) is less than the reference score (Pref); obtaining an iris image and a face image from an accessing user; comparing the obtained iris image with each of all of the stored registered iris images one by one to calculate iris similarity (A1); comparing the calculated iris similarity (A1) and an iris authentication reference value (Aref) to identify whether the calculated iris similarity (A1) is an iris authentication reference value (Aref) or greater; when the calculated iris similarity (A1) is less than the iris authentication reference value (Aref), comparing the face image obtained along with the failed iris image with each of registered face images contained in the secondary authentication group one by one to calculate face similarity (B2); and comparing the calculated face similarity (B2) with a face authentication reference value (Bref) to identify whether the calculated face similarity (B2) is a face authentication reference value (Bref) or greater. According to the present invention, it is possible to reduce processing load and time while maintaining security performance.

Description

User authentication device and method using both iris authentication and face authentication

The present invention relates to an apparatus for performing user authentication using iris authentication and face authentication together, and a method of performing user authentication using both iris authentication and face authentication.

Recently, a technology for authenticating a user by recognizing an iris pattern has been widely used. Moreover, a technology for recognizing and authenticating a user's face is also widely spread.

On the other hand, not only individually applying iris authentication and face authentication, but also a technology for authenticating a user by combining them is being developed.

For example, by combining the result of primary authentication, which authenticates the user through iris authentication, and the result of secondary authentication, which authenticates the user through face authentication, with each other, the user is registered when both authentications are successful. A method of authenticating as a user is implemented.

According to this AND combination method, since both iris authentication and face authentication are successful, authentication as a registered user can be provided, thereby providing strong security.

However, in the method of AND combination of the result of iris authentication and the result of face authentication, in the case of a registered user with a low iris authentication rate due to personal characteristics, and also in an environment where a part of the face may be misrecognized, the authentication process is repeated several times. Since it may fail, inconvenience may be provided to the user.

On the other hand, to solve this inconvenience, a method of OR combination of iris authentication and face authentication is being considered, and as such a method, Patent Publication No. 10-2018-0068097 (2018.06.21.) method) (hereinafter referred to as 'prior art') was developed.

The prior art includes inspecting quality information of an iris region of an image obtained from a user, attempting iris authentication if the quality information of the iris region is valid, and attempting face authentication if the quality information of the iris region is not valid. do.

However, this prior art has a problem that it can be directly switched to face authentication just because the iris score is lower than the threshold score, and if so, iris authentication can be ignored.

Also, in this prior art, only one registered user is set and authentication is processed using an iris or face. On the other hand, if this prior art is applied to a case where a plurality of registered users must be processed, the user's facial feature data must be compared with the registered facial feature data of all registered users, resulting in processing load and processing time. there is

An object of the present invention is to provide a user authentication apparatus and method capable of reducing processing load and processing time while maintaining security performance by processing user authentication by performing complementary OR combination of iris authentication and face authentication.

In order to achieve the above object, a user authentication apparatus using both iris authentication and face authentication according to an embodiment of the present invention includes: an iris photographing unit that captures an iris of a user and generates an iris image; a face photographing unit generating a face image by photographing the user's face; A storage unit for storing each registered iris image and registered face image of at least one registered user - 1 for the registered users when the recognizability score (P) calculated from each registered iris image is greater than or equal to the reference score (Pref) It is classified as a secondary authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group, but the recognizable score (P) is the iris area recognized from the captured iris image, It is determined based on at least one of the diversity of iris patterns and the degree of similarity calculated by comparing a plurality of iris images obtained from a corresponding user with each other -; and when an approach of a predetermined user is sensed, controlling the iris capture unit and the face capture unit to acquire an iris image and a face image from the approaching user, and displaying the acquired iris image and all registered iris images stored in the storage unit. The iris similarity (A1) is calculated by comparing one by one, and primary authentication is attempted to compare whether the calculated iris similarity (A1) is equal to or greater than the iris authentication reference value (Aref). If the primary authentication fails because it is less than the iris authentication criterion (Aref), the face image acquired together with the acquired iris image for which the primary authentication failed is compared with one of the registered face images belonging to the secondary authentication group. to calculate the face similarity (B2), and attempt secondary authentication to compare whether or not the calculated face similarity (B2) is greater than or equal to the face authentication reference value (Bref), and the iris similarity (A1) calculated in the primary authentication is An authentication control unit that determines that the approaching user is one of the registered users when the iris authentication standard value (Aref) or higher or when the face similarity (B2) calculated in the secondary authentication is higher than the face authentication standard value (Bref); include

Here, the authentication control unit adjusts the reference score (Pref) to change the registered user classified as the primary authentication group to the secondary authentication group, or to perform primary authentication for the registered user classified as the secondary authentication group. can be changed to a group.

Also, among the registered users, the number of persons classified as the secondary authentication group may be fixed to a specific number.

As a modified example of the above embodiment, storing each registered iris image and registered face image of at least one registered user - for the registered users, the recognizable score (P) calculated from each registered iris image is a reference score (Pref) or higher, it is classified as a primary authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group. Determined based on at least one of the iris area recognized from the image, the diversity of iris patterns, and the degree of similarity calculated by comparing a plurality of iris images obtained from the corresponding user with each other -; acquiring an iris image and a face image from the approaching user when an approach of a predetermined user is detected; A primary authentication step of comparing the obtained iris image with all of the stored registered iris images to calculate an iris similarity (A1), and comparing whether or not the calculated iris similarity (A1) is greater than or equal to an iris authentication reference value (Aref); When the first authentication fails because the calculated iris similarity A1 is less than the iris authentication reference value Aref, the face image acquired together with the acquired iris image for which the first authentication failed and the second authentication a secondary authentication step of comparing each of the registered face images belonging to the group to calculate a face similarity (B2), and comparing whether or not the calculated face similarity (B2) is greater than or equal to a face authentication reference value (Bref); and when the iris similarity (A1) calculated in the primary authentication is greater than or equal to the iris authentication reference value (Aref) or the face similarity (B2) calculated in the secondary authentication is greater than or equal to the face authentication reference value (Bref). There is provided a user authentication method using both iris authentication and face authentication including; an authentication decision step of determining that the user is one of the registered users.

An apparatus for authenticating a user using both iris authentication and face authentication according to another embodiment of the present invention includes an iris capture unit that captures an iris of a user and generates an iris image; a face photographing unit generating a face image by photographing the user's face; A storage unit for storing each registered iris image and registered face image of at least one registered user - 1 for the registered users when the recognizability score (P) calculated from each registered iris image is greater than or equal to the reference score (Pref) It is classified as a secondary authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group, but the recognizable score (P) is the iris area recognized from the captured iris image, It is determined based on at least one of the diversity of iris patterns and the degree of similarity calculated by comparing a plurality of iris images obtained from a corresponding user with each other -; and when an approach of a predetermined user is sensed, controlling the iris capture unit and the face capture unit to acquire an iris image and a face image from the approaching user, and displaying the acquired iris image and all registered iris images stored in the storage unit. The iris similarity (A1) is calculated by comparing one by one, and primary authentication is attempted to compare whether the calculated iris similarity (A1) is equal to or greater than the iris authentication reference value (Aref). If the primary authentication fails because it is less than the iris authentication criterion (Aref), the face image acquired together with the acquired iris image for which the primary authentication failed is compared with one of the registered face images belonging to the secondary authentication group. to calculate the face similarity (B2), and compare whether the sum (A1+B2) of the calculated iris similarity (A1) and the calculated face similarity (B2) of the failed iris image is greater than or equal to the sum authentication standard value (Bsum) When secondary authentication is attempted and the iris similarity (A1) calculated in the primary authentication is greater than or equal to the iris authentication standard value (Aref) or the sum (A1+B2) is greater than or equal to the sum authentication standard value (Bsum), the access and an authentication control unit that determines that one user is one of the registered users.

In addition, as a modified example of the above embodiment, the step of storing each registered iris image and registered face image of at least one registered user - for the registered users, the recognizability score (P) calculated from each registered iris image is a criterion If the score (Pref) is higher, it is classified as a primary authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group. Determined based on at least one of the iris area recognized from the iris image, the diversity of iris patterns, and the degree of similarity calculated by comparing a plurality of iris images obtained from the corresponding user with each other -; acquiring an iris image and a face image from the approaching user when an approach of a predetermined user is detected; A primary authentication step of comparing the obtained iris image with all of the stored registered iris images to calculate an iris similarity (A1), and comparing whether or not the calculated iris similarity (A1) is greater than or equal to an iris authentication reference value (Aref); When the first authentication fails because the calculated iris similarity A1 is less than the iris authentication reference value Aref, the face image acquired together with the acquired iris image for which the first authentication failed and the second authentication The face similarity (B2) is calculated by comparing each of the registered face images belonging to the group, and the sum (A1+B2) of the calculated iris similarity (A1) and the calculated face similarity (B2) of the failed iris image is A secondary authentication step of comparing whether or not the combined authentication standard value (Bsum) is higher; and when the iris similarity (A1) calculated in the primary authentication is equal to or greater than the iris authentication reference value (Aref) or when the sum (A1+B2) is equal to or greater than the combined authentication reference value (Bsum), the approaching user is designated as the registered user. There is provided a user authentication method that uses both iris authentication and face authentication including;

An apparatus for authenticating a user using both iris authentication and face authentication according to another embodiment of the present invention includes an iris capture unit that captures an iris of a user and generates an iris image; a face photographing unit generating a face image by photographing the user's face; A storage unit for storing each registered iris image and registered face image of at least one registered user - 1 for the registered users when the recognizability score (P) calculated from each registered iris image is greater than or equal to the reference score (Pref) It is classified as a secondary authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group, but the recognizable score (P) is the iris area recognized from the captured iris image, It is determined based on at least one of the diversity of iris patterns and the degree of similarity calculated by comparing a plurality of iris images obtained from a corresponding user with each other -; and when an approach of a predetermined user is sensed, controlling the iris capture unit and the face capture unit to obtain an iris image and a face image from the user, and one of the obtained iris image and the registered iris images of the primary authentication group. The iris similarity (A1) is calculated by comparing the iris similarity (A1), and primary authentication is attempted to compare whether the calculated iris similarity (A1) is equal to or greater than the iris authentication reference value (Aref), and if the calculated iris similarity (A1) is the iris If the primary authentication fails because it is less than the authentication criterion value (Aref), the face image acquired together with the acquired iris image for which the primary authentication failed is compared with one of the registered face images of the secondary authentication group. The face similarity (B2) is calculated, and secondary authentication is attempted to compare whether or not the calculated face similarity (B2) is greater than or equal to the face authentication reference value (Bref). and an authentication control unit that determines that the approaching user is one of the registered users when the authentication standard value (Aref) or higher or when the face similarity (B2) calculated in the secondary authentication is higher than the face authentication standard value (Bref). do.

In a modified example of the above embodiment, storing each registered iris image and registered face image of at least one registered user - for the registered users, the recognizable score P calculated from each registered iris image is a reference score ( Pref) or higher, it is classified as a primary authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group, but the recognizable score (P) is the captured iris image Determined based on at least one of the iris area recognized from, the diversity of iris patterns, and the degree of similarity calculated by comparing a plurality of iris images obtained from the corresponding user with each other -; acquiring an iris image and a face image from the user when an approach of a certain user is detected; First step of comparing the acquired iris image with one of the registered iris images of the first authentication group to calculate an iris similarity (A1), and comparing whether or not the calculated iris similarity (A1) is equal to or greater than the iris authentication reference value (Aref). authentication step; When the first authentication fails because the calculated iris similarity A1 is less than the iris authentication reference value Aref, the face image acquired together with the acquired iris image for which the first authentication failed and the second authentication group a secondary authentication step of comparing one of the registered face images to calculate a face similarity (B2) and comparing whether or not the calculated face similarity (B2) is greater than or equal to a face authentication reference value (Bref); and when the iris similarity (A1) calculated in the primary authentication is greater than or equal to the iris authentication reference value (Aref) or the face similarity (B2) calculated in the secondary authentication is greater than or equal to the face authentication reference value (Bref). There is provided a user authentication method using both iris authentication and face authentication including; an authentication decision step of determining that the user is one of the registered users.

According to the user authentication apparatus and method according to the present invention including the configuration as described above, processing load and processing time are reduced while maintaining security performance by processing user authentication by complementary OR combination of iris authentication and face authentication. savings can be made

In addition, even for a registered user with a low iris authentication rate, user authentication can be quickly processed while maintaining security performance.

1 is a block diagram showing a schematic configuration of a user authentication device according to an embodiment of the present invention.
2 is a flowchart illustrating a user authentication method according to another embodiment of the present invention.
3 is a flowchart illustrating a method of classifying registered users.
4 is a flowchart illustrating a user authentication method according to a modified example of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a preferred embodiment of a user authentication device and method using both iris authentication and face authentication according to the present invention will be described with reference to the accompanying drawings. For reference, since the terms referring to each component of the present invention are illustratively named in consideration of their functions, the technical contents of the present invention should not be predicted and limited by the terms themselves.

Moreover, since the various embodiments of the present invention to be described below are only intended to show the technical idea of the present invention by way of example, the protection scope of the present invention should be construed according to the appended claims. In addition, since those skilled in the art to which the present invention pertains will be able to design various modifications and variations without departing from the essential characteristics of the present invention, the scope of the present invention is within the scope equivalent to the present invention. It should be interpreted as encompassing all technical ideas that exist.

First, with reference to the block diagram of FIG. 1 , the configuration and operation of a user authentication device that uses both iris authentication and face authentication according to an embodiment of the present invention will be described. Referring to the drawings, the user authentication device of the present invention includes an iris capture unit 110, a face capture unit 120, a storage unit 130, and an authentication control unit 150.

The iris photographing unit 110 is disposed facing forward and includes a camera capable of generating an iris image by photographing the iris of an approaching user.

The face photographing unit 120 may be disposed in the vicinity of the iris photographing unit 110 toward the front, and includes another camera capable of generating a face image by photographing the face of a user approaching. In a modified example, the iris capture unit 110 and the face capture unit 120 may be simultaneously implemented by a single camera.

In general, since the face photographing distance is longer than the iris photographing distance, while the user moves to bring his or her face or eyes closer to the device, the face photographing unit 120 first photographs the face and then the iris photographing unit. (110) will take a picture of the iris.

The storage unit 130 may be a memory included in the user authentication device of the present invention, or may even be a remote storage means connected to the user authentication device through a wired or wireless network.

In the storage unit 130, as information to be used for iris authentication and face authentication, a registered iris image and a registered face pre-obtained from a user who has been authenticated with the user authentication device according to the present invention through a specific procedure, that is, a registered user. The video is saved together. In particular, in the present invention, in the storage unit 130, registered users are classified into one of a primary authentication group and a secondary authentication group and are managed.

In the present invention, an object of the present invention is to classify one or more registered users into two groups based on a recognizable score (P) calculated from an iris image. , iris image and face image) must be performed in the process of saving.

That is, when the recognizable score P of an iris image obtained from a predetermined registered user is equal to or greater than the predetermined reference score Pref, the registered user is classified as a primary authentication group. Meanwhile, when the recognizable score P of an iris image obtained from another registered user is less than the reference score Pref, the registered user is classified as a secondary authentication group.

Meanwhile, in a modified example of the present invention, the reference score (Pref) may be actively adjusted in order to adjust security performance or according to various requests of a system operator. By adjusting the reference score (Pref), not only registered users to be added later but also registered users whose classification has already been completed can be reclassified. Adjusting the reference score Pref determines whether the registered user will be authenticated with iris or face, and as a result, it is possible to adjust the accuracy or reliability of authentication and security strength.

Meanwhile, the recognizable score (P) in the present invention may be determined by the area of the iris seen in the iris image and the diversity of iris patterns of the user (ie, identification indicating whether they can be distinguished from other iris patterns). In addition, a recognizable score (P) may be calculated by obtaining a plurality of iris images from a corresponding user and comparing the obtained iris images with each other to calculate similarities in advance. When comparing iris images obtained from the same user, if the similarity score is calculated low, the recognizability score (P) may be considered low.

Alternatively, the previously determined recognizable score P may be adjusted according to the authentication success rate (or frequency) of several authentication procedures performed using the iris image of the corresponding registered user.

The authentication control unit 150 performs a user authentication procedure by controlling functions of each unit constituting the user authentication device according to the present invention.

That is, when the approach of a predetermined user attempting user authentication is detected through the iris capture unit 110 or the face capture unit 120 or by a separate proximity detection sensor, the iris capture unit 110 and the face capture unit 120 ) to obtain an iris image and a face image from the user. Subsequently, an iris authentication procedure in which the acquired iris image is compared with the registered iris image stored in the storage unit 130, that is, primary authentication is performed.

In the iris authentication procedure, one of all of the one or more registered iris images stored in the storage unit 130 (including both the registered iris images of the primary authentication group and the registered iris images of the secondary authentication group) is selected, and the selected registration is performed. It may include calculating the iris similarity A1 by comparing the iris image with the iris image obtained from the user attempting user authentication.

While calculating the iris similarity (A1) by selecting the registered iris images one by one, as soon as a value higher than the preset iris authentication reference value (Aref) is calculated, or after comparing all the registered iris images, the iris similarity (A1) is calculated When all of the iris similarities A1 calculated in A are found to be equal to or greater than the iris authentication reference value Aref, the approaching user is determined to be one of the registered users and authentication is successful.

Meanwhile, if the iris image obtained from the user approaching to attempt user authentication does not match any of the registered iris images stored in the first storage area 131, that is, the iris image from the approaching user If all of the iris similarities (A1) calculated by comparing the iris and all registered iris images one by one are less than the iris authentication reference value (Aref), the approaching user has difficulty recognizing using the iris, that is, the iris recognizable score (P) is regarded as a low-level user and switches to a face authentication procedure using a face image obtained from the approaching user, that is, secondary authentication.

Here, "match" may mean a case where the degree of similarity calculated by comparing two images is equal to or greater than a preset reference value, rather than a perfect match.

Secondary authentication includes comparing face images obtained from the approaching user with registered face images of registered users classified as secondary authentication groups. That is, one of the registered face images of registered users classified as a secondary authentication group is selected, the selected registered face image is compared with the face image obtained from the approaching user, and the face similarity (B2) is calculated. It includes comparing whether the face similarity (B2) is greater than or equal to the face authentication reference value (Bref).

If it is confirmed that the face similarity between the acquired face image and any one of the registered face images of the secondary authentication group is greater than or equal to the preset face authentication reference value (Bref) (or is found to match), the approaching user It is determined that the registered user is related to the currently selected registered face image. That is, the currently accessed user can be recognized as one of the registered users belonging to the secondary authentication group.

The authentication control unit 150 may output a signal or information indicating a corresponding authentication result to an external device or switch its own security function when the first authentication or the second authentication is successful.

In the present invention, registered users classified as the primary authentication group are highly likely to succeed in authentication through the iris authentication procedure, and registered users classified as the secondary authentication group are highly likely to succeed in authentication through the face authentication procedure.

Meanwhile, in the present invention, it has been described that when a user attempting user authentication approaches the user authentication device, the user authentication device captures and acquires an iris image and a face image simultaneously or together. However, it is also possible to implement a configuration in which only an iris image is first acquired, an iris authentication procedure is performed, and a face image is photographed and obtained at a time point when the iris authentication procedure fails and is converted to face authentication.

On the other hand, since it is generally known that the security performance of user authentication using an iris image is higher than that of user authentication using a face image, it is better to maintain the case of authenticating a user through iris authentication than the case of authenticating a user through face authentication. High security performance can be maintained.

To this end, in the present invention, it is preferable to manage the number of registered users classified into the primary authentication group higher than the number of registered users classified into the secondary authentication group.

In a modification of the present invention related to this, the number of registered users classified into the secondary authentication group may be fixed to a specific number. For example, the number of people classified as the primary authentication group is not limited, but the number of people classified as the secondary authentication group is preferably limited to a small number.

According to this, for a user who is currently attempting authentication, if authentication using iris fails, authentication using face will be switched. Since this succeeds, deterioration in security can be prevented as much as possible.

For example, after a malicious user illegally inputs an iris image, immediately switches to face authentication, steals the face of one of the registered users (eg, a registered user classified as the primary authentication group), and You can block trying to perform authentication.

Additionally, as described above, the number of persons classified into the secondary authentication group may be fixed in advance or the security may be controlled by actively adjusting the reference score (Pref).

According to the user authentication apparatus using both iris authentication and face authentication according to the present invention described above, registered users are classified into either a primary authentication group or a secondary authentication group, and in the primary authentication, the primary authentication group and the secondary authentication are used. The iris authentication procedure is performed using the registered iris images of all groups, and in the secondary authentication, the face authentication procedure is performed using only the registered face images belonging to the secondary authentication group, so that the currently accessed user is registered as belonging to the secondary authentication group. It determines only whether it is a user.

This is because, when the primary authentication fails, the user's face image is compared only with the registered face images of registered users in the preset limited number of secondary authentication groups, so the system load and time required for comparison processing for face authentication. this decreases

Next, referring to the flowchart of FIG. 2, a user authentication method using both iris authentication and face authentication according to another embodiment of the present invention will be described. Referring to the drawings, a user authentication method according to another embodiment of the present invention:

- Acquiring and storing an iris image (i.e., a registered iris image) and a face image (i.e., a registered face image) from a registered user who has been authenticated so as to be able to access the user authentication system through a specific procedure, If the recognizable score (P) calculated from the registered iris image is greater than or equal to the reference score (Pref), the registered user is classified as a primary authentication group, and if the recognizable score (P) is less than the reference score (Pref), classifying the registered users into secondary authentication groups;

- Subsequently, when approaching a predetermined user attempting user authentication with respect to the user authentication device is detected, acquiring an iris image and a face image from the approaching user (S11);

A primary authentication step of comparing the acquired iris image with all of the stored registered iris images to calculate an iris similarity (A1), and comparing whether or not the calculated iris similarity (A1) is equal to or greater than the iris authentication reference value (Aref) ( S12);

If the calculated iris similarity (A1) is less than the iris authentication reference value (Aref), that is, the obtained iris image matches any of the registered iris images of all registered users in the first authentication group and the second authentication group. If not ("authentication failure" in step S14), it is determined that the primary authentication has failed, and at the same time, the user is regarded as a user with a low success rate of iris authentication using an iris image, Secondary authentication of comparing the face image with one of the registered face images belonging to the secondary authentication group to calculate face similarity (B2), and comparing whether or not the calculated face similarity (B2) is greater than or equal to the face authentication reference value (Bref). Step (S16);

- When the iris similarity (A1) calculated in the primary authentication is equal to or greater than the iris authentication reference value (Aref) ("authentication success" in step S14) or the face similarity (B2) calculated in the secondary authentication is the face When the authentication criterion (Bref) or higher (ie, when the face image matches at least one of the registered face images belonging to the secondary authentication group) ("authentication success" in step S18), the approaching user is referred to as Authentication determination step of determining that the user is one of the registered users (S15);

- If the face image does not match any of the registered face images belonging to the secondary authentication group ('authentication failure' in S18), it is determined that the secondary authentication has failed, and finally user authentication has failed. It includes a step (S19) of determining to be.

Next, referring to the flow chart of FIG. 3, in performing the user authentication method according to the present invention, a method of classifying registered users into a primary authentication group and a secondary authentication group will be described. Referring to the drawings, a method of acquiring, classifying, and storing a registered iris image and a registered face image of a registered user, which are standards for performing a user authentication procedure through iris authentication and/or face authentication, will be described.

First, a registered user of the user authentication device of the present invention is confirmed through any specific procedure (eg, fingerprint, ID, password, etc.) (S1). Subsequent steps are assumed to be made by the verified registered user.

Subsequently, an iris image to be used as biometric information of a registered user is obtained, and a face image is acquired simultaneously or at an arbitrary point in time and stored in a storage unit (S2). A recognizability score (P) is calculated from the acquired iris image (S3).

The calculated recognizable score P is compared with a reference score Pref, which is preset and fixed or arbitrarily adjustable (S4). If the calculated recognizability score (P) is greater than the reference score (Pref), the user is classified as a primary authentication group as the recognition success rate through the iris is considered to be above normal (S5).

On the other hand, if the calculated recognizability score P is smaller than the reference score Pref, the user is considered to have a low success rate of iris recognition in the iris authentication procedure and is classified as a secondary authentication group (S6).

4 shows another modified example of the user authentication method according to the present invention. Here, the iris similarity (A1) calculated in the primary authentication is intended to be used in the secondary authentication as well.

The procedure up to the first authentication including steps S11 to S14 is the same as that of FIG. 2 . Then, in the second authentication, the face similarity (B2) is calculated by comparing the acquired face image with registered face images belonging to the second authentication group (S16).

Then, the iris similarity (A1) calculated in the first authentication (this iris similarity (A1) is the value determined as authentication failure in the first authentication) is summed with the face similarity (B2) calculated in the above step S16, (A1+B2), the summed value (A1+B2) is compared with the summed authentication standard value (Bsum) (S31).

Here, the summed iris similarity A1 may be the largest value among the plurality of iris similarities calculated in step S12. Similarly, the summed face similarity B2 may be the largest value among the plurality of face similarities calculated in step S16.

As a result of comparison, if the combined value (A1+B2) is greater than the sum authentication standard value (Bsum) ('authentication success' in step S32), it is determined that the currently accessed user is one of the registered users (S15 ).

In this way, in the secondary authentication, by utilizing not only the face similarity but also the iris similarity calculated in the primary authentication, security of authentication can be further improved.

Meanwhile, in another embodiment of the present invention, in the first authentication procedure, only the registered iris images of the first authentication group are compared, and in the second authentication procedure, only the registered face images of the second authentication group are compared. A user authentication device that implements the method and uses both iris authentication and face authentication is proposed.

In this embodiment, the classification of registered users into the first authentication group or the second authentication group is the same as in the previous embodiments.

When an approach of a predetermined user attempting user authentication is detected, the authentication control unit 150 performs an iris authentication procedure in which the iris image obtained from the approaching user is compared with registered iris images of registered users classified as a primary authentication group; That is, the first authentication is performed.

While calculating the iris similarity (A1) by selecting the registered iris images of the primary authentication group one by one, as soon as a value that is higher than the preset iris recognition reference value (Aref) is calculated, or compared with all registered iris images of the primary authentication group After calculating the iris similarities (A1) for each iris similarity (A1), all of the calculated values are inspected, and if a value equal to or higher than the iris authentication standard value (Aref) is found, the approaching user is determined to be a registered user of the primary authentication group. .

On the other hand, if the acquired iris image does not match any of the registered iris images of the primary authentication group, the approaching user has difficulty recognizing the iris, that is, the iris recognizable score (P ) is regarded as a low user, and switches to a face authentication procedure using a face image obtained from the approaching user, that is, secondary authentication. At this time, in the secondary authentication, the face similarity (B2) is calculated by comparing the face image obtained from the approaching user with the registered face images of the registered users classified into the secondary authentication group, and the calculated face similarity (B2) is It includes comparing whether or not the face recognition standard value (Bref) is higher.

If it is confirmed that the face similarity between the acquired face image and any one of the registered face images of the secondary authentication group is equal to or greater than the preset face authentication reference value (Bref), the approaching user is determined as a registered user of the secondary authentication group. do.

Claims (8)

an iris capture unit for capturing an iris of a user and generating an iris image;
a face photographing unit generating a face image by photographing the user's face;
A storage unit for storing each registered iris image and registered face image of at least one registered user - 1 for the registered users when the recognizability score (P) calculated from each registered iris image is greater than or equal to the reference score (Pref) It is classified as a secondary authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group, but the recognizable score (P) is the iris area recognized from the captured iris image, It is determined based on at least one of the diversity of iris patterns and the degree of similarity calculated by comparing a plurality of iris images obtained from a corresponding user with each other -; and
When an approach of a predetermined user is detected, the iris capture unit and the face capture unit are controlled to obtain an iris image and a face image from the approaching user, and one of the obtained iris image and all registered iris images stored in the storage unit. The iris similarity (A1) is calculated by comparing the iris similarity (A1), and primary authentication is attempted to compare whether the calculated iris similarity (A1) is equal to or greater than the iris authentication reference value (Aref), and if the calculated iris similarity (A1) is the iris If the primary authentication fails because it is less than the authentication criterion value (Aref), the face image acquired together with the acquired iris image for which the primary authentication failed is compared with one of the registered face images belonging to the secondary authentication group. The face similarity (B2) is calculated, and secondary authentication is attempted to compare whether or not the calculated face similarity (B2) is greater than or equal to the face authentication reference value (Bref). and an authentication control unit that determines that the approaching user is one of the registered users when the authentication standard value (Aref) or higher or when the face similarity (B2) calculated in the secondary authentication is higher than the face authentication standard value (Bref). A user authentication device that uses both iris authentication and face authentication. According to claim 1,
The authentication control unit,
By adjusting the reference score (Pref), the registered users classified as the primary authentication group are changed to the secondary authentication group, or the registered users classified as the secondary authentication group are changed to the primary authentication group. A user authentication device that uses both iris authentication and face authentication. According to claim 1,
The user authentication device using both iris authentication and face authentication, characterized in that the number of registered users classified into the secondary authentication group is fixed to a specific number.
Storing each registered iris image and registered face image of at least one registered user - For the registered users, when the recognizability score (P) calculated from each registered iris image is equal to or greater than the reference score (Pref), the first It is classified as an authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group, but the recognizable score (P) is the iris area recognized from the captured iris image, iris Determined based on at least one of the diversity of patterns and similarity calculated by comparing a plurality of iris images obtained from a corresponding user with each other -;
acquiring an iris image and a face image from the approaching user when an approach of a predetermined user is detected;
A primary authentication step of comparing the obtained iris image with all of the stored registered iris images to calculate an iris similarity (A1), and comparing whether or not the calculated iris similarity (A1) is greater than or equal to an iris authentication reference value (Aref);
When the first authentication fails because the calculated iris similarity A1 is less than the iris authentication reference value Aref, the face image acquired together with the acquired iris image for which the first authentication failed and the second authentication a secondary authentication step of comparing each of the registered face images belonging to the group to calculate a face similarity (B2), and comparing whether or not the calculated face similarity (B2) is greater than or equal to a face authentication reference value (Bref); and
The approaching user when the iris similarity (A1) calculated in the first authentication is equal to or greater than the iris authentication reference value (Aref) or when the face similarity (B2) calculated in the second authentication is equal to or greater than the face authentication reference value (Bref) A user authentication method that uses iris authentication and face authentication together, including; an authentication decision step of determining that is one of the registered users.
an iris capture unit for capturing an iris of a user and generating an iris image;
a face photographing unit generating a face image by photographing the user's face;
A storage unit for storing each registered iris image and registered face image of at least one registered user - 1 for the registered users when the recognizability score (P) calculated from each registered iris image is greater than or equal to the reference score (Pref) It is classified as a secondary authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group, but the recognizable score (P) is the iris area recognized from the captured iris image, It is determined based on at least one of the diversity of iris patterns and the degree of similarity calculated by comparing a plurality of iris images obtained from a corresponding user with each other -; and
When an approach of a predetermined user is detected, the iris capture unit and the face capture unit are controlled to obtain an iris image and a face image from the approaching user, and one of the obtained iris image and all registered iris images stored in the storage unit. The iris similarity (A1) is calculated by comparing the iris similarity (A1), and primary authentication is attempted to compare whether the calculated iris similarity (A1) is equal to or greater than the iris authentication reference value (Aref), and if the calculated iris similarity (A1) is the iris If the primary authentication fails because it is less than the authentication criterion value (Aref), the face image acquired together with the acquired iris image for which the primary authentication failed is compared with one of the registered face images belonging to the secondary authentication group. 2 that calculates the face similarity (B2) and compares whether the sum (A1+B2) of the calculated iris similarity (A1) and the calculated face similarity (B2) of the failed iris image is greater than or equal to the sum authentication standard value (Bsum) When secondary authentication is attempted and the iris similarity (A1) calculated in the primary authentication is greater than the iris authentication reference value (Aref) or the sum (A1 + B2) is greater than the sum authentication reference value (Bsum), the access An authentication control unit that determines that a user is one of the registered users; a user authentication device that uses iris authentication and face authentication together. Storing each registered iris image and registered face image of at least one registered user - For the registered users, when the recognizability score (P) calculated from each registered iris image is equal to or greater than the reference score (Pref), the first It is classified as an authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group, but the recognizable score (P) is the iris area recognized from the captured iris image, iris Determined based on at least one of the diversity of patterns and similarity calculated by comparing a plurality of iris images obtained from a corresponding user with each other -;
acquiring an iris image and a face image from the approaching user when an approach of a predetermined user is detected;
A primary authentication step of comparing the obtained iris image with all of the stored registered iris images to calculate an iris similarity (A1), and comparing whether or not the calculated iris similarity (A1) is greater than or equal to an iris authentication reference value (Aref);
When the first authentication fails because the calculated iris similarity A1 is less than the iris authentication reference value Aref, the face image acquired together with the acquired iris image for which the first authentication failed and the second authentication The face similarity (B2) is calculated by comparing each of the registered face images belonging to the group, and the sum (A1+B2) of the calculated iris similarity (A1) and the calculated face similarity (B2) of the failed iris image is A secondary authentication step of comparing whether or not the combined authentication standard value (Bsum) is higher; and
When the iris similarity (A1) calculated in the primary authentication is greater than or equal to the iris authentication standard value (Aref) or when the sum (A1+B2) is greater than or equal to the sum authentication standard value (Bsum), the approaching user is classified as the registered users. A user authentication method that uses both iris authentication and face authentication, including;
an iris capture unit for capturing an iris of a user and generating an iris image;
a face photographing unit generating a face image by photographing the user's face;
A storage unit for storing each registered iris image and registered face image of at least one registered user - 1 for the registered users when the recognizability score (P) calculated from each registered iris image is greater than or equal to the reference score (Pref) It is classified as a secondary authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group, but the recognizable score (P) is the iris area recognized from the captured iris image, It is determined based on at least one of the diversity of iris patterns and the degree of similarity calculated by comparing a plurality of iris images obtained from a corresponding user with each other -; and
When an approach of a predetermined user is sensed, the iris capture unit and the face capture unit are controlled to obtain an iris image and a face image from the user, and one of the obtained iris image and the registered iris images of the primary authentication group is displayed. The iris similarity (A1) is calculated by comparison, and primary authentication is attempted to compare whether the calculated iris similarity (A1) is equal to or greater than the iris authentication reference value (Aref), and if the calculated iris similarity (A1) is the iris authentication If the primary authentication fails because it is less than the reference value (Aref), the face image acquired together with the acquired iris image for which the primary authentication failed is compared with one of the registered face images of the secondary authentication group. The similarity (B2) is calculated, and secondary authentication is attempted to compare whether or not the calculated face similarity (B2) is greater than or equal to the face authentication reference value (Bref), and the iris similarity (A1) calculated in the primary authentication is the iris authentication. An authentication control unit that determines that the approaching user is one of the registered users when the threshold value (Aref) or higher or when the face similarity (B2) calculated in the secondary authentication is higher than the face authentication threshold (Bref); , A user authentication device that uses both iris authentication and face authentication. Storing each registered iris image and registered face image of at least one registered user - For the registered users, when the recognizability score (P) calculated from each registered iris image is equal to or greater than the reference score (Pref), the first It is classified as an authentication group, and if the recognizable score (P) is less than the reference score (Pref), it is classified as a secondary authentication group, but the recognizable score (P) is the iris area recognized from the captured iris image, iris Determined based on at least one of the diversity of patterns and similarity calculated by comparing a plurality of iris images obtained from a corresponding user with each other -;
acquiring an iris image and a face image from the user when an approach of a certain user is detected;
First step of comparing the acquired iris image with one of the registered iris images of the first authentication group to calculate an iris similarity (A1), and comparing whether or not the calculated iris similarity (A1) is equal to or greater than the iris authentication reference value (Aref). authentication step;
When the first authentication fails because the calculated iris similarity A1 is less than the iris authentication reference value Aref, the face image acquired together with the acquired iris image for which the first authentication failed and the second authentication group a secondary authentication step of comparing one of the registered face images to calculate a face similarity (B2) and comparing whether or not the calculated face similarity (B2) is greater than or equal to a face authentication reference value (Bref); and
The approaching user when the iris similarity (A1) calculated in the first authentication is equal to or greater than the iris authentication reference value (Aref) or when the face similarity (B2) calculated in the second authentication is equal to or greater than the face authentication reference value (Bref) A user authentication method that uses iris authentication and face authentication together, including; an authentication decision step of determining that is one of the registered users.

Images