JP4760049B2 - Face authentication device, face authentication method, electronic device incorporating the face authentication device, and recording medium recording the face authentication program - Google Patents

Description

  The present invention relates to a face authentication device that prevents spoofing, a face authentication method thereof, and an electronic device incorporating the face authentication device, and in particular, in face authentication that is one of biometrics authentication, a face that is prevented from being spoofed using a face photograph or the like. The present invention relates to a recognition device, a face authentication method thereof, and an electronic device incorporating the face authentication device.

  Conventionally, in a face authentication system that is one of biometric authentication, impersonation using a face photo or video has been a problem, and it has been necessary for the face authentication system to take measures against impersonation.

  In general, the face authentication system is a system that checks whether or not a user who wants to use a certain system has a use right and performs access control so that the user can use the system. Conventional access control is realized by, for example, a user's property, confidential information, biometrics, or the like alone or in combination. Specifically, there is a method using a physical key, a card or the like as access control by possession. As access control using secret information, there is a method using a personal identification number. Furthermore, as access control by biometrics, there are methods using fingerprints, irises, faces, and the like.

  In the conventional access control, if it is necessary to combine a plurality of methods, convenience is reduced accordingly. In order to increase security without impairing this convenience as much as possible, for example, there is a technique (conventional example 1) disclosed in Patent Document 1. This technology performs user authentication by combining information stored in an IC card or the like and a face image captured by a camera or the like. However, with this technology, when a user is authenticated by a combination of stored information such as an IC card and a face image, for example, the user himself / herself can be recognized by a simple recognition process of facial features between users with similar facial features. It was difficult to authenticate whether or not there was. Also, for example, it has been difficult to eliminate impersonation due to imitations such as photographs and dolls.

  As a conventional technique for solving this (conventional example 2), there is a technique disclosed in Patent Document 2, which is a method of eliminating impersonation by changing an illumination environment using an illumination device. This technique requires illumination means for changing and controlling the illumination environment, and it has been difficult to mount it on a small device (such as a mobile phone).

  Furthermore, there is a conventional technique (conventional example 3) in which personal authentication is performed with high accuracy and security is improved by using temporal changes in the face of the accessing user. This conventional example 3 is a technique disclosed in Patent Document 3, and this technique will be described with reference to FIGS.

  FIG. 8 is a block diagram showing the configuration of the access control system of Conventional Example 3. In the figure, this system includes, for example, a camera 4a as an imaging means, a storage unit 11, a face detection unit 12, a facial expression identification unit 13, a personal authentication unit 14, an access right determination unit 15, and an access control unit 16. And.

  The storage unit 11 recognizes to the user registration information (hereinafter referred to as registered face data) F regarding the facial features of the user, registration information regarding the change pattern of the facial expression of the user (hereinafter referred to as registered facial expression change pattern data) E, and the user. This is a storage medium in which personal registration data including registration information (hereinafter referred to as access right data) A relating to the access right is stored in advance. As a specific configuration of the storage unit 11, for example, a memory having a required capacity in which personal registration data for a plurality of users A, B, C,. In this case, each registration data stored in the memory is read by the personal authentication unit 14 and the access right determination unit 15. Further, for example, each user may have a portable storage medium such as a non-contact IC card in which personal registration data is stored. In this case, it is possible to read the personal registration data by bringing the non-contact IC card or the like close to a card reading unit provided on the system side.

  As the registered face data F, a face image acquired in advance for personal authentication may be used as it is as registered data. It is also possible to calculate a face feature amount based on a face image for personal authentication and use the calculation result as registration data. This facial feature value is a numerical value of the facial feature of the user who can discriminate between the person and the other person.

  The registered facial expression change pattern data E is obtained by preliminarily determining a temporal change pattern of facial expression data indicating a user's facial expression and registering it as personal authentication data. This facial expression data is obtained by quantifying the characteristics of the facial expression of the user who can discriminate between the person and others. Specifically, for example, only the face components (eyes, nose, mouth, eyebrows, etc.) are cut out from the face image to express the positional relationship with each other numerically, or the shape of the facial component and the mutual positional relationship, It represents the inclination etc. as a numerical value, and the characteristic of the facial expression is indicated by the numerical value.

  Further, the access right data A is information relating to the use authority given to the legitimate owner, and is information indicating a range in which use is permitted for the resources in the system. Specifically, for example, when used for access control in a door or the like, access right data is identification information about a room that is allowed to enter.

  The camera 4 a can mainly capture a face of a user who desires access, and outputs the acquired video to the face detection unit 3. The camera 4a may be switched between a plurality of cameras.

  The face detection unit 12 processes the video from the camera 4a as a continuous image, and executes a process of detecting a user's face from each image. When the user's face is detected, the face image Fi is cut out, and the face image Fi is sent to the facial expression identification unit 13 and the personal authentication unit 14, respectively. The facial expression identification unit 13 includes, for example, a facial expression data creation circuit and a facial expression data change determination circuit. The facial expression data creation circuit creates facial expression data based on the facial images Fin sent continuously from the face detection unit 12 and outputs the facial expression data. The facial expression data change determination circuit determines whether or not there is a temporal change in the facial expression data sent continuously, sequentially extracts facial expression data when it is determined that there is a temporal change, and the facial expression change pattern authentication unit of the personal authentication unit 14 To 52.

  The personal authentication unit 14 includes, for example, a face authentication unit 51 and a facial expression change pattern authentication unit 52 (FIG. 8). The face authentication unit 51 collates the face image Fin sent from the face detection unit 12 with the registered face data F stored in the storage unit 11. Based on the scale of the comparison result, authentication is performed as to whether or not the user's face captured by the camera 4a matches the user's face registered in the storage unit 11, and the authentication result is used as an access right determination unit. 15 is output.

  Specifically, in the face authentication process in the face authentication unit 51, a face image acquired in advance for personal authentication is registered as registered face data F as it is. In this case, first, enlargement / reduction processing is performed on the face image Fin from the face detection unit 12 to make it the same size as the registered face data F (a plurality of face images or one face image). Next, by comparing the face image Fin with the registered face data F and calculating the difference between them, the similarity between both face images is obtained. It is assumed that the similarity is higher as the difference is smaller. If the obtained similarity exceeds a preset threshold, it is determined that the face image Fin matches the registered face data F, and the user is authenticated.

  Further, when the face feature amount calculated based on the face image for personal authentication is registered as the registered face data F, first, the face of the face authentication unit 51 based on the face image Fin from the face detection unit 12 is registered. The face feature amount is calculated by the feature amount calculation circuit, and the face feature amount and the face feature amount indicated as the registered face data F are collated by the face feature amount collation circuit to obtain the similarity. Then, the face feature amount authentication circuit determines whether or not the obtained similarity exceeds a preset threshold, and if the similarity exceeds the threshold, the user is authenticated.

  The facial expression change pattern authentication unit 52 authenticates the facial expression change pattern by comparing the facial expression data string {Ein} sent from the facial expression identification unit 13 with the registered facial expression change pattern data E stored in the storage unit 11. The authentication result is output to the access right determination unit 15. The facial expression change pattern authentication process in the facial expression change pattern authentication unit 52 is performed by the facial expression data change pattern (hereinafter, referred to as the facial expression data string {Ein} from the facial expression identification unit 13 and the registered facial expression change pattern data E from the storage unit 11). The registered expression data string {E}) is collated with the change pattern of each expression data string. The collation result is output to the facial expression change pattern data determination circuit.

  In the facial expression change pattern data determination circuit, for example, in any of the following authentication conditions 1) to 4), facial expression change pattern authentication processing is performed. That is, the authentication condition is 1) when the facial expression data string {Ein} and the registered facial expression data string {E} are equivalent. 2) When the facial expression data string {Ein} includes the registered facial expression data string {E}. ) When facial expression data in the registered facial expression data sequence {E} exist in the same order in the facial expression data sequence {Ein}, 4) a set of registered facial expression data sequence {E} is a set of facial expression data sequence {Ein} Are included, each facial expression change pattern indicated by the facial expression data string {Ein} is authenticated.

  Whether the access right determination unit 15 permits the user's access based on each authentication result in the face authentication unit 51 and the facial expression change pattern authentication unit 52 and the access right data A stored in the storage unit 11. Determine whether or not. The determination result is output to the access control unit 16. In the determination processing in the access right determination unit 15, the access right from the storage unit 11 is obtained when the authentication result in the face authentication unit 51 is OK and the authentication result in the facial expression change pattern authentication unit 52 is also OK. The determination is made according to the use authority indicated in the data A. Then, a signal indicating the determination result is transmitted to the access control unit 16.

  The access control unit 16 permits the required access to the user who is authenticated as the right person and determined to have the right access right according to the determination result in the access right determination unit 15. In addition, access control is performed to deny access to other users.

  Next, FIG. 9 is a flowchart for explaining the operation of FIG. When access control by the access control system is started, a user who desires access is imaged by the camera 4a, and the video is sent to the face detection unit 12. In step S11, the face detection unit 12 determines whether or not a portion corresponding to the user's face has been detected in the images continuously sent from the camera 4a. In S12, the face image Fin is cut out and output to the face authentication unit 51 and the facial expression identification unit 13, respectively.

  Next, the face authentication unit 51 that receives the face image Fin from the face detection unit 12 first determines whether or not the face image Fin is input in step S13. If the face image Fin is input, the process proceeds to step S14. The input face image Fin and the registered face data F stored in the storage unit 11 are collated. At this time, when the storage unit 11 uses a memory, the registered face data F of a plurality of users A, B, C,... Stored in the memory is sequentially read by the face authentication unit 51, and A collation process with the face image Fin is executed. When the storage unit 11 is composed of a non-contact IC card, the non-contact IC card presented by the user imaged by the camera 4a is read. Then, the registered face data F included in the received personal registration data is sent to the face authentication unit 51, and collation processing with the face image Fin is executed. In step S15, it is determined whether or not the similarity indicating the collation result exceeds the threshold value, and the collation match is determined. If collation coincidence is determined, the process proceeds to step S16, where the authentication result in the face authentication unit 51 is obtained. A signal indicating right is output to the access right determination unit 15.

  In addition, the facial expression identification unit 13 that receives the facial image Fin from the facial detection unit 12 first determines whether or not the facial image Fin is input in step S17. If the face image Fin is input, the process proceeds to step S18, and expression data for the input face image Fin is generated by the expression data generation circuit. In step S19, the expression data change determination circuit determines whether or not there is a change in the created time-series expression data. If it is determined that there is a change, the process proceeds to step S20, and the expression data at that time is the expression data. It is output to the facial expression change pattern authentication unit 52 as a column {Ein}.

  The facial expression change pattern authentication unit 52 that receives the facial expression data string {Ein} from the facial expression identification unit 13 first determines whether or not the facial expression data string {Ein} is input in step S21. When the expression data string {Ein} is input, the process proceeds to step S22, where the input expression data string {Ein} and the registered expression data string {E} stored in the storage unit 1 are collated. In step S23, the verification result is subjected to the facial expression change pattern authentication process according to any of the authentication conditions (1) to (4) described above, and if the authentication condition is satisfied, the process proceeds to step S24. A signal indicating that the authentication result in the facial expression change pattern authentication unit 52 is right is output to the access right determination unit 15.

  In the access right determination unit 15 that receives the output signals from the face authentication unit 51 and the facial expression change pattern authentication unit 52, both the output signals from the face authentication unit 51 and the facial expression change pattern authentication unit 52 are authenticated in step S25. It is determined whether or not it indicates OK. If both authentication results are positive, the process proceeds to step S26, and the access right for the user is determined according to the access right data A stored in the storage unit 11. A signal indicating the determination result is output to the access control unit 16 in step S27. In step S28, the access control unit 16 performs access control for the user.

JP 2000-067188 JP 2003-178306 A JP 2003-233816 A

  However, in this prior art 3, since the registered face data F and the registered facial expression change pattern data E for face authentication stored in the storage unit are all image data, the amount of images to be stored is enormous. There is a problem. In addition, since the biometric discrimination is repeatedly performed for each image data authentication process, there is a problem that the processing time is significantly increased. For this reason, there is a problem in that the storage unit becomes large and it becomes difficult to mount it on a small device (such as a mobile phone). In addition, there is a problem that it takes time to read and write data from the storage unit, processing speed is slow, and processing time is required.

  The main object of the present invention is to reduce the amount of data to be stored, reduce the size of the device, enable mounting on a small device such as a mobile phone, and prevent impersonation, its face authentication method, and its An object of the present invention is to provide an electronic device and a program using a face authentication device.

The face authentication device according to the present invention compares the input moving image with a facial expression pattern that is intended by the authentication target person and registered in advance by the authentication target person , and is a combination of a plurality of different facial expressions. In this case, when the moving image is determined to be a living body, the living body determination processing unit determines that the moving image is a living body. A face authentication processing unit.

The face authentication method of the present invention compares an input moving image with a facial expression pattern that is intended by an authentication target person and is registered in advance by the authentication target person , and is a combination of a plurality of different facial expressions. In this case, it is determined that the moving image is a living body, and when it is determined that the moving image is a living body, face authentication processing of the person to be authenticated is performed on the moving image.

  As described above, according to the present invention, the face authentication apparatus extracts and compares feature points of moving images to determine whether the moving image of the person to be authenticated input from the camera is a biological face. As a result, the amount of data to be stored can be reduced, and the processing time can be shortened, so that the apparatus can be miniaturized and spoofing can be prevented.

Next, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram of an embodiment of the present invention. As shown in FIG. 1, in this embodiment, an input device 1 such as a keyboard, an output device 2 such as a display device, a face authentication device 3 that performs face authentication processing, and a moving image of a person to be authenticated (user) are displayed. And an input camera 4. In addition, the face authentication device 3 includes a control unit 31, a biometric discrimination processing unit 32 that determines whether or not it is a biometric face, and a face authentication processing unit 33 that authenticates the face of the person to be authenticated. ing.
The face authentication apparatus 3 according to the present embodiment is characterized in that the biometric discrimination processing unit 32 first discriminates whether or not the input moving image of the person to be authenticated is an (arbitrary) biometric face. Only when it is determined that the moving image is the face of a living body, the face authentication processing unit 33 authenticates whether or not it is the face of the person to be authenticated. The face authentication processing unit 33 is a face authentication process that has been used in the past, and stores and holds, as data, feature points that can be identified as the person to be authenticated. It compares and discriminates with the face image of and authenticates.
The control unit 31 also performs control processing of the camera 4, control processing of the biometric discrimination processing unit 32, control processing of the face recognition processing unit 33, input information control from the input device 1, and output information control to the output device 2. .

  The biometric discrimination processing unit 32 includes a biometric discrimination unit 41, a facial expression extraction unit 42, and a facial expression pattern condition generation unit 43. The moving image input from the camera 4 is input from the control unit 31 to the facial expression extraction unit 42 via the living body determination unit 41. The facial expression extraction unit 42 performs processing for extracting whether or not the input moving image is a living human face and how the face is moving. The facial expression pattern condition generation unit 43 generates a facial expression pattern (eg, eyebrows up / down, mouth open / close, etc.) required for a user who is an authentication target. The biometric discrimination unit 41 compares the facial movement obtained from the facial expression extraction unit 42 with the facial expression pattern requested of the person to be authenticated (user) obtained from the facial expression pattern condition generation unit 43, and the camera 4 To determine whether or not the moving image input from is a living body.

  In addition, the facial expression pattern condition generation unit 43 determines the facial expression image pattern required for the person to be authenticated and the facial expression movement (change) image pattern for each facial part randomly or in accordance with a predetermined rule. Select and combine image patterns. The generated face image pattern is a facial expression image pattern when the selected face portion is changed. The generated face image pattern is displayed on the output device 2 through the control unit 31. The display timing in this case may be triggered by a predetermined input, for example, pressing of the input device 1 or the like, and the imaging start timing (2 seconds before, 1 second before, start) is displayed on the output device 2. Also good. At the display timing, a moving image is captured from the camera 4, and the captured moving image is transferred to the facial expression extraction unit 42. The facial expression extracting unit 42 determines whether or not the face is a living human face by determining the presence or absence of a point (such as the shape of a facial part) that is a feature of the human face in the moving image. If it is determined that this is a living human face, the biometric discrimination unit 41 further generates a facial pattern required by the person to be authenticated generated by the facial expression pattern condition generation unit 43 and a moving image captured by the camera. The change in the face pattern, that is, the movement of the face obtained from the facial expression extraction unit 42 is compared. It is determined whether or not these face patterns match, and if they do not match within a predetermined time corresponding to the movement of the face, the face authentication processing unit 33 rejects authentication, and if they match, authentication is performed. do.

  When the image change amount of a point (part) that is a feature of a person's face is large, the biometric determination unit 41 determines that there is a possibility that the object shown in the camera 4 has been replaced, and rejects authentication. The matching of the face pattern change is performed by sequentially comparing the face pattern change required of the person to be authenticated and the face pattern change of the moving image captured by the camera. If all face patterns match, face authentication processing by the face authentication processing unit 33 is executed, and if authenticated, the authentication is successful.

  Next, the biometric discrimination unit 41 is shown in the configuration diagram of FIG. That is, in the first stage, the movement information of the feature points generated in the apparatus is acquired from the facial expression pattern condition generation unit 43. For example, “the eyebrows have moved” is movement information indicating how much the eyebrow feature points should be displaced. Next, in the second stage, facial feature point information is acquired from the facial expression extraction unit 42 for each frame of the moving image. Next, in the third stage, each information obtained in the first stage and the second stage is compared. Next, if there are a plurality of patterns in the fourth stage, the first to third stages are repeated. If the condition that the feature point is in the predetermined range is satisfied in the third stage and the fourth stage, it is determined to be a living body.

  The facial expression extraction unit 42 is shown in the configuration diagram of FIG. That is, in the first stage, facial feature points are assigned to moving images for each frame using image information such as shading. Next, in the second stage, it is evaluated whether or not the facial feature point information has a positional relationship that holds as a human face. Then, in the third stage, when the second stage is OK (consists as a human face), it is determined as a human face, and the feature point information is passed to the biometric determination unit 41.

  FIG. 3 is a flowchart for explaining the operation of FIG. The operation of this embodiment will be described in detail with reference to FIG. 3 and FIG. First, when the input device 1 is pressed, a moving image is captured from the camera 4. The image of the camera 4 is displayed on the output device 2 (step S1 in FIG. 3). At the same time, the facial expression pattern condition generation unit 43 generates a facial expression pattern required by the user. This generated facial expression pattern is randomly generated to avoid impersonation. The facial expression information is displayed on the output device 2 through the control unit 31 and informs the user to perform the corresponding facial expression (steps S2 and 3 in FIG. 3). The moving image captured from the camera 4 is transferred to the facial expression extraction unit 42.

  Here, the living body discriminating unit 41 discriminates whether or not there is a point that is a feature of a human face with respect to a target included in the moving image, and determines whether or not it is a living human face. In addition, by tracking the movement of the point, the movement of the face is extracted and the facial expression is discriminated. When the movement of this point is being followed, if the amount of movement fluctuation is large, the point may be missed without being followed. However, in this case, there is a possibility that the object shown in the camera 4 has been replaced. Therefore, it is determined as NG, and the processing flow ends as failure (steps S4 and S8 in FIG. 3).

  The biometric determination unit 41 compares the facial movement obtained from the facial expression extraction unit 42 with the facial expression requested by the user in the facial expression pattern condition generation unit 43 to determine whether they match. If they do not match within a certain period of time, it is determined as NG and the processing flow ends as a failure (steps S5 and S8 in FIG. 3).

  When a plurality of facial expression patterns are generated by the facial expression pattern condition generation unit 43, the generated facial expressions are compared in order. Steps S1 to S5 in FIG. 3 are repeated until the comparison of all facial expressions is completed (step S6 in FIG. 3). When all the facial expression patterns match, face authentication processing by the face authentication processing unit 33 is executed. If this authentication is NG, the processing flow ends as a failure. In the case of authentication OK, the processing flow ends as authentication success (steps S7, 8, 9 in FIG. 3). In this case, since it is performed using a face image that has passed the biometric discrimination process, it can be guaranteed that the face is a human face that is not impersonated.

  According to this face authentication process, it is possible to prevent impersonation using a face photo or video in face authentication. This is because, prior to the face authentication process, the biometric determination process is performed to determine that the face authentication target is not a face photograph or video. Furthermore, it can be easily mounted on a mold device such as a mobile phone. This is because the only input device required for processing is a camera, and since the camera is already mounted on a small device (such as a mobile phone), it can be realized only by using the hardware.

  Next, the operation of Example 1 of this embodiment will be described using a specific example. For example, consider a case where the facial expression pattern condition generation unit 43 generates two patterns “open mouth” and “raise eyebrows” as facial expression patterns. First, a moving image is captured from the camera 4 (step S1 in FIG. 3). At the same time, the facial expression pattern condition generation unit 43 generates a facial expression pattern requested by the user and displays it on the output device 2 through the control unit 31 (steps S2 and 3 in FIG. 3).

  In this embodiment, two patterns of “open mouth” and “raise eyebrows” are generated. First, the output device 2 is displayed so as to request the user to open a face “open mouth”. The moving image captured from the camera 4 is transferred to the facial expression extraction unit 42. Here, the presence or absence of a point that is a feature of a person's face is determined for the object included in the moving image, and it is determined whether or not the object is a person's face. In addition, by tracking the movement of the point, the movement of the face is extracted and the facial expression is discriminated.

  When the user to be authenticated opens his / her mouth, the moving image is transferred from the camera 4 to the facial expression extracting unit 42 and information indicating that the mouth is open is extracted. The result is passed to the living body discrimination unit 41. The biometric discrimination unit 41 compares with the condition passed from the facial expression pattern condition generation unit 43. In this case, since it is a condition that the mouth is opened, it is determined that they match as a result of the comparison, and the user performs the facial expression as requested, and it is determined that the pattern 1 has passed.

  Subsequently, display is performed on the output device 2 so as to request the user to raise the eyebrows. The moving image captured from the camera 4 is transferred to the facial expression extracting unit 42, and it is determined whether or not there is a point that is a feature of a human face with respect to a target included in the moving image. And the movement of the point is followed to extract how the face moves, and the facial expression is discriminated. When the authentication target user raises the eyebrows, the moving image is passed from the camera 4 to the facial expression extraction unit 42, and it is extracted that the eyebrows have changed from the normal position to the raised state, and the eyebrows are raised. Is passed to the biometric determination unit 41.

  The biometric determination unit 41 receives information from the facial expression pattern condition generation unit 43 that the condition is to raise the eyebrows. Therefore, if it is determined that the comparison results match, it is determined that the user is performing a facial expression as requested and the pattern 2 has also passed. As described above, the two patterns of “open mouth” and “raise eyebrows” set as conditions are passed, and the biometric discrimination is determined to be successful. As a result, it is determined that the target currently reflected in the camera is a living human face. As a result of this discrimination, the face authentication process is started, so that the face authentication process can be performed on a face image that is guaranteed to be a living body.

  Next, FIG. 4 is a block diagram of the second embodiment of the present invention, and FIG. 5 is a flowchart for explaining the operation thereof. Referring to FIG. 4, the present embodiment is different in that it has a user registered facial expression pattern database (DB) 44 instead of the facial expression pattern condition generation unit 43 in the embodiment shown in FIG. 1. The facial expression pattern to be used as the biological identification process is not generated by the device, but is registered in the user registered facial expression pattern DB 44 by the user according to his / her preference, so that the biological identification using the facial expression pattern intended by the user can be performed. It becomes possible, and user convenience can be improved.

  Next, the operation of this embodiment will be described in detail with reference to FIG. The operations of the input device 1, the output device 2, the control unit 31, the facial expression extraction unit 322, the face authentication processing unit 33, and the camera 4 shown in steps S 1, S 4, and S 6 to S 9 in FIG. Since the operation is the same as that of the embodiment shown in FIG. In the embodiment shown in FIG. 1, the facial expression pattern is generated by the facial expression pattern condition generation unit 43. In this embodiment, the device does not generate a facial expression pattern to be used as a biometric discrimination process, but allows the user to register the facial expression pattern intended by the user in the user registered facial expression pattern DB 44 (step in FIG. 5). B1). Then, the comparison with the user's facial expression is performed with the facial expression pattern registered in the user-registered facial expression pattern DB 44, so that the user can perform biometric discrimination using the intended facial expression pattern, and the user's usability is improved. Can be improved (step S2 in FIG. 5).

  Next, a specific example will be described. For example, let us consider a case where facial expression patterns such as “win right eye” and “win left eye” are registered in the user registered facial expression pattern DB 44.

  The operations of the input device 1, the output device 2, the control unit 31, the facial expression extraction unit 42, the face authentication processing unit 43, and the camera 4 shown in steps S 1, S 4 and S 6 to S 9 in FIG. Since the operation is the same as that of the configuration shown in FIG.

  In the process of FIG. 5, step S1a is present before step S1. In step S1a, facial expression patterns such as “right eye wink” and “left eye wink” are first registered. With this registration, the two patterns are registered in the user registered facial expression pattern DB 44. A user's facial expression is input in steps S1 and S4 of FIG. It is evaluated whether or not it matches with “do right eye wink” which is the pattern “1” of the facial expression pattern registered in advance (step S5a in FIG. 5). If they match, after performing steps S6, S1, and S4 of FIG. 5, it is compared with the pattern “2” “win left eye” to evaluate whether or not they match (step S5a of FIG. 5). If they match, it is determined that the biometric determination is successful, and the process proceeds to face authentication processing.

  Also in this embodiment, by registering in the user registered facial expression pattern DB 44, it is possible to perform biometric discrimination using the facial expression pattern intended by the user, as in the first embodiment, and improve user convenience. be able to.

  Next, FIG. 6 is a block diagram of a third embodiment of the present invention, and FIG. 7 is a flowchart for explaining the operation. Referring to FIG. 6, this embodiment does not include the facial expression pattern condition generation unit 43 of the embodiment shown in FIG. 1 or the user registered facial expression pattern DB 44 in the embodiment shown in FIG. 5. Further, instead of the biometric discrimination unit 41 and the facial expression extraction unit 42 in FIGS. 1 and 5, the biometric discrimination execution unit 45 and the face point extraction unit 46 are provided in FIG. 6. In FIG. 1 and FIG. 5, the biometric discrimination is performed by matching the facial expression of the user with the facial expression pattern. However, in the embodiment of FIG. 6, only the motion information of the facial point obtained by the facial point extraction unit 46 is used. Thus, the living body discrimination performing unit 45 performs the living body discrimination (step S6a in FIG. 7).

  In this embodiment, there is a possibility of impersonation by a moving image such as a video, but it is possible to prevent impersonation by a still image such as a photograph, and since the facial expression pattern comparison process is eliminated, the biometric discrimination process to the user side is eliminated. Consciousness can be reduced as much as possible, and usability is expected to improve.

  As a configuration of the present invention, it can be applied to an electronic apparatus incorporating the face authentication device of the present invention. That is, it is conceivable that the electronic device includes a home appliance or a mobile communication terminal having at least a camera and a display unit. The mobile communication terminal may include a mobile phone, a PHS, a PDA having a communication function, and a mobile personal computer.

It is a block diagram of the spoofing prevention face authentication apparatus explaining the 1st Embodiment of this invention. (A) and (b) are the functional block diagrams explaining the biometric discrimination | determination process part of FIG. It is a flowchart explaining the processing operation of FIG. It is a block diagram of the spoofing prevention face authentication apparatus explaining the 2nd Example of the present invention. It is a flowchart explaining the processing operation of FIG. It is a block diagram of the spoofing prevention face authentication apparatus explaining the 3rd Example of the present invention. It is a flowchart explaining the processing operation of FIG. It is a block diagram explaining the face authentication system of a prior art example. It is a flowchart explaining the processing operation of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Input device 2 Output device 3 Face authentication device 4, 4a Camera (part)
DESCRIPTION OF SYMBOLS 11 Memory | storage part 12 Face detection part 13 Expression identification part 14 Personal authentication part 15 Access right determination part 16 Access control part 31 Control part 32 Biometric discrimination process part 33 Face authentication process part 41 Biometric discrimination part 42 Face expression extraction part 43 Facial expression pattern 43 Condition generation unit 44 User registered facial expression pattern DB
45 Biometric discrimination execution unit 46 Face point extraction unit 51 Face authentication unit 52 Expression change pattern authentication unit

Claims (6)

A moving image is input, the authentication with contemplated by the subject is registered in advance by the authentication target person and comparing the expression pattern consisting of a combination of a plurality of different expressions, is the moving image when a match biometric A biometric determination processing unit that determines that
A face authentication processing unit that performs face authentication processing of the person to be authenticated for the moving image when the moving image is determined to be a living body by the biometric discrimination processing unit;
A face authentication apparatus comprising:   An electronic apparatus comprising the face authentication device according to claim 1 incorporated therein.   The electronic device according to claim 2, wherein the electronic device is a home electric product or a portable communication terminal including a camera unit and a display unit.   4. The electronic apparatus according to claim 3, wherein the mobile communication terminal is one of a mobile phone, a PHS, a PDA having a communication function, and a mobile personal computer. A moving image is input, the authentication with contemplated by the subject is registered in advance by the authentication target person and comparing the expression pattern consisting of a combination of a plurality of different expressions, is the moving image when a match biometric It is determined that
A face authentication method comprising: performing face authentication processing of an authentication target person on the moving image when it is determined that the moving image is a living body.   6. A recording medium on which a face authentication program for executing the face authentication method according to claim 5 is recorded.

Images