JP2009223651A - Face authentication apparatus, program, and portable terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent a timing to start a face authentication function from being known, and prevent other person from operating an authenticated portable terminal which is left behind. <P>SOLUTION: A face authentication apparatus for photographing a portrait by a camera 121 and authenticating a face includes: a memory 116 for storing face authentication image data which is photographed in advance by the camera; a timer 125 for setting a predetermined time for repeating the face authentication; and a face authentication control part 120A for repeating the following operations to prohibit the display of the portrait photographed by the camera when selecting a function to be secured, to start the timer so as to collate the photographed image in the face authentication obtained by photographing the portrait with the face authentication image data stored in the memory, to start the function to be secured when they are coincident, to re-collate the photographed image in the face authentication obtained by re-photographing the portrait by the camera with the face authentication image data stored in the memory when the fixed timer elapses in the timer, and to allow the start of the function to be secured to continue when they are coincident. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a face authentication apparatus that activates a camera to perform user face authentication. In particular, the present invention provides a face authentication device, method, program, and program that prevents the timing at which the face authentication function is activated from being made known and makes it impossible for another person to operate by leaving the portable terminal device after successful authentication. The present invention relates to a mobile terminal device.

  Many mobile terminal devices such as mobile phones, PHS (Personal Handyphone System), PDA (Personal Data Assistance, Personal Digital Assistants) are equipped with a camera, personal information and financial Many portable terminal devices that fulfill their roles are used.

However, the face authentication security of the mobile terminal device displays the face authentication procedure on the display to the user and notifies the user when the face authentication is activated, or once it passes the security, There was a problem with the ease of the security structure, such as being able to use it freely even if the user was changed to a third party.
In other words, recently, portable terminal devices are beginning to have more important functions for owners such as personal information and electronic money functions, and the importance of personal authentication of owners for security is increasing. .

However, in the currently installed face authentication function, the face authentication application of the mobile phone is started as a table task on the mobile terminal device, and the user authentication is performed. Since the timing at which the face authentication function is activated is well known, security is low in that it is easy to take countermeasures.
Further, the conventional authentication method has a problem in security after successful authentication because the portable terminal device can be left or operated by another person after successful authentication.

Conventional techniques related to such face authentication include those described in the following patent documents.
The owner of the mobile phone obtains the operator's image from the mobile phone through the network, and the key operator is photographed by the front camera installed on the mobile phone in order to check who is using the mobile phone. If the owner's image is registered and it is determined that the photographed image is not similar to the owner's image, the image is stored and the image data is stored from the mobile phone through the network. If the owner loses the mobile phone, you can easily check who is using the mobile phone and know if it has been stolen (for example, (See Patent Document 1), the timing at which the face authentication function is activated is not disclosed, and another person is left by leaving the portable terminal device after the authentication is successful. It does not make it impossible to operation.

  In addition, by using authentication of whether or not the person is a person, the mobile phone is provided with improved operability by eliminating the need to enter a personal identification number. In order to provide a method that can improve the security of the mobile phone, it detects that the usage status of the mobile phone with usage restriction function has changed and activates the authentication function of the current user of the mobile phone. However, the timing at which the face authentication function is activated is not made known, and it is impossible to operate another person by leaving the portable terminal device after authentication is successful. Absent.

  Furthermore, in order to provide a subject authentication device, a mobile phone, a subject authentication method, and a subject authentication program capable of improving the security reliability against impersonation and suppressing power consumption, a photographed image obtained by photographing a subject by a photographing means An authentication iterative process for repeatedly performing the authentication process even after the control unit of the subject authentication apparatus that performs the authentication process for authenticating the subject based on the authentication process is determined to be suitable by the authentication process, and the repetition of the authentication process. Repetitive stop instruction accepting process for accepting an iterative stop instruction to be stopped by input means, a true / false determination process for comparing the received repeat stop instruction with a pre-registered normal instruction, and determination of the true / false determination process When the result is true, there is a configuration in which the iterative stop process for stopping the authentication iterative process is executed (for example, a special feature). Reference 3), so the timing of the face authentication function is activated is not known, does not preclude the operation of another person due to standing of the mobile terminal device after successful authentication.

  Furthermore, to provide an electronic device that can identify a user and control the functions that can be used without being conscious of the user who operates the electronic device, without performing complicated operations such as inputting a personal identification number. The electronic device (mobile phone) includes an imaging unit provided in a part capable of photographing the user's face, a face recognition reference data storage unit that stores face recognition reference data used for the user's face recognition, A control information storage means for storing function control information used for controlling a plurality of functions; an operation detection means for detecting an operation of the electronic device; and a control means, wherein the control means detects an operation of the electronic device. In addition, the user's face of the electronic device is photographed, the user is identified based on the comparison result between the face image data and the face recognition reference data, and the user is identified based on the identification result and the function control information. Control available features Although there are some (for example, refer to Patent Document 4), the timing at which the face authentication function is activated is not made known, and it is impossible to operate another person by leaving the portable terminal device after authentication is successful. Absent.

Japanese Patent Laid-Open No. 2005-223834 JP 2005-244589 A JP 2006-259922 A JP 2007-067782 A

  Therefore, in view of the above problems, the present invention prevents the timing at which the face authentication function is activated from being made known, and makes it impossible to operate another person by leaving the mobile terminal device after successful authentication, An object is to provide a method, a program, and a portable terminal device.

  In order to solve the above problems, the present invention provides a face authentication apparatus that captures a self-portrait with a camera and performs face authentication, a memory that stores image data for face authentication previously captured by the camera, and repeatedly performs face authentication. A timer that is set for a certain period of time and a self-portrait image that is captured by the camera when a function that is subject to security is selected, the timer is started, and the self-portrait is captured by the camera. The face authentication image data stored in the memory is collated, and if it matches, the security target function is activated, and the self-portrait image is re-photographed by the camera when the timer expires for a fixed time. And face authentication image data stored in the memory are re-checked and matched, the face authentication is repeated until the security target function is continuously activated. Providing a face authentication apparatus characterized by comprising a control unit.

Further, the face authentication control unit prohibits display of a screen transition of the face authentication function when a face authentication engine that performs face authentication determination is activated.
Further, the face authentication control unit performs security if there is a mismatch at the time of initial verification and re-verification of the face authentication image data stored in the memory and the face authentication image data stored after the activation of the security target function. End the target function.

Further, the face authentication control unit ends the collation of the face authentication image data stored in the memory with the captured image at the time of face authentication when the security target function ends.
Further, the memory stores a moving image as face authentication image data previously captured by the camera, and the face authentication control unit includes the moving image stored in the memory and a moving image captured as a captured image during face authentication. And authenticate.

Furthermore, the predetermined time set in the timer can be arbitrarily set.
Furthermore, the present invention provides a face authentication method for capturing a self-portrait by a camera and performing face authentication, a step of storing face authentication image data previously captured by the camera, and a function when a function to be secured is selected. A function that is subject to security when the process of prohibiting the display of the captured self-portrait and starting the timer and the face authentication image captured by the camera and the stored face authentication image data are collated and match And when the face authentication image data re-photographed with the camera and the face authentication image data stored in the memory match and match when the timer has elapsed for a certain period of time after the function is started. There is provided a face authentication method comprising a step of repeating an operation of continuing activation of a function as a security target.

  Furthermore, the present invention provides a face authentication program for capturing a self-portrait with a camera and performing face authentication, a procedure for storing face authentication image data previously captured by the camera, and a function when a security target function is selected. Functions that are subject to security if the captured self-portrait is prohibited, the timer is started, and the face-authentication image captured by the camera is compared with the stored face authentication image data. When the face authentication image data stored in the memory and the face authentication image data re-photographed with the camera when the timer elapses for a certain period of time after the activation of the function and the face authentication image data stored in the memory match There is provided a face authentication program comprising a procedure of repeating an operation of continuing activation of a function that is a security target.

  Furthermore, the present invention provides a portable terminal device that captures a self-portrait with a camera and performs face authentication, a memory that stores image data for face authentication previously captured by the camera, and a fixed time for repeatedly performing face authentication. The timer and the display of the self-portrait taken by the camera when the security target function is selected are prohibited. The timer is started and the self-portrait taken by the camera is captured and stored in the memory. The face authentication image data is collated, and if it matches, the security target function is activated, and the self-portrait image is re-photographed by the camera when the timer expires for a predetermined time and stored in the memory. A face authentication control unit that repeats the operation of continuing the activation of the function to be the security target when the face authentication image data is re-matched and matched. To provide a mobile terminal apparatus characterized and.

  As described above, according to the present invention, the procedure for storing the face authentication image data photographed in advance by the camera and the display of the self-portrait photographed by the camera when the security target function is selected are prohibited. , Start the timer, check the face authentication image data captured with the camera and the stored face authentication image data, and activate the function that is subject to security if they match. The operation to continue the activation of the function subject to security when the face authentication image data stored in the memory and the face authentication image data stored in the memory are re-matched and matched when the self-portrait is re-photographed after a certain period of time has passed. Since it is repeated, the trouble of the screen transition of the face authentication function can be avoided, and the camera is started so that the user does not notice it. Authentication is performed each time the function is activated and data taken when a certain time elapses, and authentication is performed each time after the authentication is successful. The operation of the person can be made impossible, it becomes difficult for a third party to use, and it is possible to provide a highly accurate face authentication function.

  In addition, it is possible to provide a mobile terminal device with higher confidentiality by allowing the user to arbitrarily set the shooting interval for the security target function and camera face authentication.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a schematic configuration of a mobile terminal device according to the present invention. As shown in the figure, the mobile terminal device 111 is equipped with a CPU (Central Processing Unit) 112, and the CPU 112 is connected to each part in the mobile terminal device 111 via a bus 113.
Note that the mobile terminal device 111 has a multi-application function, and can start an application as a front task or a back task.

A ROM (Read Only Memory) 114 is connected to the bus 113, and the ROM 114 stores various control programs for executing the CPU 112 and fixed data such as various display data. A face authentication engine 115 for performing
Further, a RAM (Random Access Memory) 116 is connected to the bus 113, and the RAM 116 stores data temporarily required for the CPU 112 to execute the program. In the present invention, face authentication prepared in advance is stored. Stored are image data 117 and a face-authentication image 118 that is photographed each time face authentication is performed.

Further, a wireless unit 119 is connected to the bus 113, and the wireless unit 119 transmits and receives wireless radio waves.
Furthermore, a control unit 120 is connected to the bus 113, and the control unit 120 controls the entire portable terminal device 111 including voice processing, communication control, memory management, and the like, and has a face authentication control unit 120A in the present invention.

In order to ensure the security of the function of the mobile terminal device 111, the face authentication control unit 120A performs control that enables face authentication by starting the camera without being noticed by the user when starting the function that is the target of security. Do.
A camera module 121 and a display unit 122 are connected to the control unit 120, and the camera module 121 is located inside the mobile terminal device 111, and takes a self-portrait at normal times and is automatically activated by a back task at the time of face authentication. Shoot.

The display unit 122 is composed of an LCD, and displays functions such as functions and data during normal use.
Further, an input unit 123 is displayed on the bus 113, and the input unit 123 is a circuit that detects a key input from various keys 124.
Further, a timer 125 is connected to the bus 113, and the timer 125 is used for time measurement in the mobile terminal device 111. In particular, in the present invention, face authentication is performed at regular intervals. Used for measurement.

In the following, mimicry transition of the operation of the face authentication function when function A targeted for security is activated will be described.
FIG. 2 is a flowchart illustrating a series of control operation examples of the face authentication control unit 120A of the control unit 120 of the mobile terminal device in FIG. In step S201, the face authentication control unit 120A detects selection of the function A as a security target from the input unit 123.

Here, as the function A as a security target, for example, a display function of PIM (personal information management) data of the mobile terminal device 111 including a telephone directory, mail, and the like is a lock target. Items not related to PIM data, for example, music, movie playback, recording, recording, etc., which are not related to security, are not subject to locking.
Highly accurate security functions are possible by individually setting the functions to be targeted for security.

In step S202, before the function A is activated, the face authentication control unit 120A activates the face authentication engine 115 stored in the ROM 114 as a back task. First, the photographed image is displayed on the display unit 122 with respect to the camera module 121. Prohibit display.
In step S <b> 203, the face authentication control unit 120 </ b> A prohibits display of function transitions for performing user authentication on the screen when the face authentication engine 115 is activated.

In step S204, a face image used when collating face authentication data as a precondition for starting the face authentication function is captured in advance by the camera module 121, which is an inner camera in the portable terminal device 111, and is stored as face authentication image data 117 in the RAM 116. It is assumed that it is stored in
In the face authentication control unit 120 </ b> A, the face authentication camera module 121 is activated in a back task that is not visually visible to the user, and a face photograph of the user who is operating the mobile terminal device 111 is taken. At this time, information display such as finder display by the activated camera module 121 is not performed on the display unit 122 of the portable terminal device 111 for the user.

In step S205, the face authentication control unit 120A compares and collates the image of the face photograph taken by the user in step S204 with the face authentication engine 115 with the face authentication image data 117 that has been captured in advance.
In step S <b> 206, it is determined whether or not the user is matched by the matching determination in the user image collation. In the case of mismatch determination, the process proceeds to step S211.

In step S207, the face authentication control unit 120A determines whether the function A is activated in the case of a match determination. If activated, the process proceeds to step S209, and the activation is continued until the activation is completed.
In step S208, the face authentication control unit 120A activates the function A when it is not activated.

In step S209, the face authentication control unit 120A determines the end of the function A. If it is determined to end, the process ends.
In step S <b> 210, the face authentication control unit 120 </ b> A determines whether or not a predetermined time has elapsed from the activation of the function A using the timer 125 in the case of a determination that the operation has not been completed. If the predetermined time has elapsed, the process returns to step S204, the above process is repeated, and the user is continuously checked. That is, even if the face authentication is successful and the function A can be used, the face authentication is continuously performed again by photographing the face of the camera module 121 at regular intervals. In other words, even if authentication is successful once and the portable terminal device 111 is left unattended, another person cannot operate. This protects user privacy and increases safety even in operations after successful face authentication.

This fixed time can be arbitrarily set. Accordingly, it is possible to provide the mobile terminal device 111 with higher confidentiality.
The face authentication control unit 120A returns to step S207 if the predetermined time has not elapsed.
In step S211, the face authentication control unit 120A displays a notification to the user that “it cannot be activated because it is locked”, and the process ends. In this case, function A is not activated. Note that this display is possible because it is required for notification, not for shooting.

  Therefore, according to the present invention, it is possible to avoid the troublesome screen transition of the face authentication function, and to start the camera so that the user does not notice it. Since authentication verification is performed on the data shot for face authentication and the data shot when the function is activated when a certain period of time elapses, it is impossible to operate another person by leaving the mobile terminal device unattended after successful authentication. It is difficult for a third party to use, and it is possible to provide a highly accurate face authentication function.

  In addition, it is possible to provide the mobile terminal device 111 with higher confidentiality by allowing the user to arbitrarily set the shooting interval for the security target function and camera face authentication.

  When the camera module 121 of FIG. 1 can shoot a moving image, the user's moving image is registered in the face authentication image data 117 in advance, and the moving image is captured by the camera module 121, thereby moving the moving image. Authenticate the user. Examples of moving images include “pick the nose of the face with a hand”, “touch the ear of the face with a hand”, and “scratch the head three times”. Thereby, the user can be limited from various viewpoints, and the same actions and effects as described above can be obtained.

  In the above description, the face authentication function has been described by using the camera function in the mobile terminal device. However, the present invention is not limited to this, and includes a mobile phone, PHS, PDA, personal computer (PC), car, etc. The present invention can be applied to an apparatus having a function and a security function based on face authentication.

It is a block diagram which shows schematic structure of the portable terminal device which concerns on this invention. 2 is a flowchart illustrating a series of control operation examples of a face authentication control unit 120A of a control unit 120 of the mobile terminal device in FIG.

Explanation of symbols

111 ... portable terminal device 112 ... CPU
113 ... Bus 114 ... ROM
115 ... Face authentication engine 116 ... RAM
117 ... Image data for face authentication 118 ... Image 119 during face authentication ... Wireless unit 120 ... Control unit 120A ... Face authentication control unit 121 ... Camera module 122 ... Display unit 123 ... Input unit 124 ... Key

Claims (9)

In a face recognition device that takes a self-portrait with a camera and performs face authentication,
A memory for storing face authentication image data previously captured by the camera;
A timer that sets a certain time for repeated face recognition;
The display of the self-portrait taken by the camera when the security target function is selected is prohibited, the timer is started and the self-portrait taken by the camera is taken and the face authentication image stored in the memory When the data is collated, the function that is the subject of security is activated when they match, and the self-portrait image is re-photographed by the camera when the timer has elapsed for a certain time, and the face authentication image stored in the memory A face authentication device comprising: a face authentication control unit that repeats an operation of continuing activation of a function that is a security target when data is collated and matched. The face authentication apparatus according to claim 1, wherein the face authentication control unit prohibits display of a screen transition of a face authentication function when a face authentication engine that performs face authentication determination is activated. The face authentication control unit is subject to security if there is a mismatch at the time of initial verification or re-verification between the face authentication image data stored in the memory and the face authentication image data stored after activation of the security target function. The face authentication apparatus according to claim 1, wherein the function is terminated. 2. The face authentication control unit according to claim 1, wherein the face authentication control unit ends collation of the face authentication image data stored in the memory with the captured image at the time of face authentication when the security target function ends. Face recognition device. The memory stores a moving image as face authentication image data previously captured by the camera, and the face authentication control unit includes the moving image stored in the memory and the moving image captured by the camera as a captured image during face authentication. The face authentication apparatus according to claim 1, wherein authentication is performed. The face authentication apparatus according to claim 1, wherein a predetermined time set in the timer can be arbitrarily set. In the face authentication method, which takes a self-portrait with a camera and performs face authentication,
Storing face authentication image data previously captured by a camera;
Prohibiting the display of self-portraits taken by the camera when selecting a function subject to security, and starting a timer;
A step of collating the face authentication image data stored with the face authentication image data obtained by photographing the self-portrait with the camera and starting the function to be a security target when they match,
A function that is subject to security when the face authentication image data re-photographed by the camera and the face authentication image data stored in the memory are re-matched and matched when the timer expires after the function is activated And a step of repeating the operation of continuing the activation of the face authentication method. In a face recognition program that takes a self-portrait with a camera and performs face authentication,
A procedure for storing face authentication image data previously captured by a camera;
Prohibiting the display of self-portraits taken by the camera when selecting a security target function and starting a timer,
A procedure for collating the face authentication image data stored with the face authentication image captured by the camera and the face authentication image data stored, and activating the security target function if they match,
A function that is subject to security when the face authentication image data re-photographed by the camera and the face authentication image data stored in the memory are re-matched and matched when the timer expires after the function is activated And a procedure of repeating the operation of continuing the activation of the face authentication method. In a portable terminal device that captures a self-portrait with a camera and performs face authentication,
A memory for storing face authentication image data previously captured by the camera;
A timer that sets a certain time for repeated face recognition;
The display of the self-portrait taken by the camera when the security target function is selected is prohibited, the timer is started and the self-portrait taken by the camera is taken and the face authentication image stored in the memory When the data is collated, the function that is the subject of security is activated when they match, and the self-portrait image is re-photographed by the camera when the timer has elapsed for a certain time, and the face authentication image stored in the memory A portable terminal device comprising: a face authentication control unit that repeats an operation of continuing activation of a function that is a target of security when data is rechecked and matched.

Images