JP4957016B2 - Information processing apparatus, key lock releasing method, and program - Google Patents

Description

  The present invention relates to an information processing apparatus, and more particularly to an information processing apparatus having a key lock function.

  2. Description of the Related Art Conventionally, mobile phones have been equipped with a key lock function using a password in order to prevent unauthorized use by a third party that may occur in the event of loss or theft. In recent years, with the development of biometric authentication technology, those having a key lock function using biometric data such as fingerprint authentication and face authentication without using a password are increasing. For example, in Patent Document 1 below, an owner's face image is registered in advance in a mobile phone, the owner's face image is input at the time of use, and compared with pre-registered data. A technique of performing key lock release is disclosed.

JP 2000-184050 A JP 2004-259255 A

  However, in the conventional example described above, there is a problem in terms of security because a still image is used as an image used for authentication. In other words, in the case of authentication using still images, for example, in the case of fingerprint authentication, a third party other than the owner of the mobile phone obtains the user's fingerprint by some means and uses this fingerprint data to release the lock. There is a problem of being illegally used. Also, in the case of face authentication, there is a problem that a third party who takes a full-size face photo of the owner of the mobile phone can unlock it by letting the mobile phone take such a photo. there were. Furthermore, it is difficult to set in detail parameters (feature points) to be compared at the time of authentication in a still image, and there is still a problem in terms of security.

  On the other hand, an authentication system using a moving image is disclosed in Patent Document 2 described above. However, such moving image authentication is used for permitting entry / exit, and the usage method is different. In this method of use, since the authentication system is installed at the entrance of the room, the system can be used with a system having sufficient specifications for image processing. Therefore, the authentication process is complicated, and the mobile phone described above is used. It is difficult to use it for unlocking keys.

  Therefore, an object of the present invention is to improve the disadvantages of the above-described conventional example, and in particular, to improve the security of the key lock function in the information processing terminal. It is another object of the present invention to provide a system capable of reducing the authentication processing load.

Therefore, an information processing apparatus according to an aspect of the present invention is
An information processing apparatus having key lock means for restricting operations,
Reference moving image storage means for storing a moving image of the owner photographed in advance as a reference moving image;
A moving image capturing means for capturing a moving image of the owner at the time of requesting a key lock release and acquiring it as a moving image for authentication;
Authentication means for comparing and authenticating the reference moving image and the moving image for authentication;
A key lock release means for releasing the key lock state by the key lock means when authentication by the authentication means is successful;
It is characterized by having.

  According to the above invention, first, a reference moving image obtained by capturing an owner's action is stored in advance in the information processing apparatus. Then, when requesting the release of the key lock state, the operation of the owner is photographed and acquired as an authentication moving image. Then, the acquired authentication moving image is compared with a pre-stored reference moving image to authenticate whether or not they belong to the same person. Thereafter, if the authentication is successful, the key lock is released and normal operation is possible. In this way, since authentication is performed using moving images, the accuracy of user authentication is improved, and unauthorized use of an information processing device due to impersonation by a third party can be effectively prevented, thereby improving security. Can do.

  The authentication unit extracts feature information from the reference moving image and the authentication moving image, and performs authentication by comparing the feature information. At this time, the reference moving image is a moving image at the time of a predetermined operation, and the moving image photographing means requests the owner to perform an operation corresponding to the reference moving image, and acquires an authentication moving image. It is characterized by. Further, the authentication means is characterized in that authentication is performed by extracting feature information from each of at least two frames included in the reference moving image and the authentication moving image. Further, the authentication means is characterized in that authentication is performed by extracting feature information from each of two frames during a predetermined operation included in the reference moving image and the authentication moving image. The information processing apparatus is, for example, a mobile phone.

  Thus, authentication processing is facilitated by performing authentication in a predetermined operation. In particular, by performing authentication by comparing feature information in a specific frame in each moving image, further authentication processing can be facilitated, and the above-described processing is also performed by an information processing terminal having a low processing capability such as a mobile phone. In this way, high security authentication processing can be realized.

  Further, the feature information extracted by the authentication means is characterized in that it includes distance information along the imaging direction with respect to the predetermined part of the owner. Furthermore, it is characterized by comprising distance information acquisition means for acquiring distance information for a predetermined part of the owner at the time of shooting the reference moving image and the authentication moving image. Thereby, since the distance information with respect to the predetermined site | part etc. in the image | photographed owner can be used at the time of authentication, further highly accurate authentication is realizable.

Moreover, the program which is the other form of this invention is:
An information processing apparatus including a key lock unit that restricts operations and an image acquisition unit,
Reference moving image acquisition means for capturing a moving image of the owner using the image acquisition means and storing it in a storage device in advance as a reference moving image;
A moving image photographing means for photographing the owner's moving image using the image obtaining means at the time of request for releasing the key lock and obtaining the moving image for authentication;
Authentication means for comparing and authenticating the reference moving image and the moving image for authentication;
A key lock release means for releasing the key lock state by the key lock means when authentication by the authentication means is successful;
It is characterized by realizing.

Furthermore, the key lock releasing method according to another aspect of the present invention includes:
A method of releasing a key lock state in an information processing apparatus comprising a key lock means for restricting operations and an image acquisition means,
A reference moving image acquisition step of capturing a moving image of the owner using the image acquisition means and storing the moving image in advance as a reference moving image in a storage device;
A moving image shooting step of shooting a moving image of the owner using an image acquisition means at the time of requesting a key lock release and acquiring it as a moving image for authentication;
An authentication process for authenticating by comparing the reference moving image and the moving image for authentication;
A key lock releasing step for releasing the key lock state by the key lock means when the authentication step is successful;
It is characterized by having.

  The authentication step is characterized in that feature information is extracted from each of the reference moving image and the authentication moving image, and authentication is performed by comparing the feature information. The reference moving image acquisition step acquires a predetermined moving image as a reference moving image, and the moving image shooting step requests the owner to perform an operation corresponding to the reference moving image for authentication. It is characterized by that.

  Further, the authentication step is characterized in that authentication is performed by extracting feature information from at least two frames included in the reference moving image and the authentication moving image. In particular, the authentication process is characterized in that authentication is performed by extracting feature information from each of two frames during a predetermined operation included in the reference moving image and the authentication moving image.

  Even the invention of the program and method having the above-described configuration can achieve the above-described object of the present invention because it has the same operation as the information processing apparatus.

  Since the present invention is configured and functions as described above, according to this, authentication is performed using a moving image, and the key lock is released according to the authentication result. The present invention has an unprecedented excellent effect that it is possible to effectively prevent unauthorized use of the information processing apparatus due to impersonation by the three parties and to improve security.

  The present invention is characterized in that authentication is performed using a moving image in order to release the key lock state in the information processing apparatus. In the following embodiments, a mobile phone will be described as an example of the information processing apparatus. Note that mobile phones are not only phone books and addresses, but also contain personal information that can be used for bank transfers and card payments, and are easy to lose. Is extremely effective. However, the information processing apparatus is not limited to a mobile phone, and may be another information processing apparatus such as a PDA or a personal computer.

  A first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a block diagram showing the configuration of the mobile phone, and FIG. 2 is a functional block diagram showing the configuration of the control device. 3 to 4 are flowcharts showing the operation of the mobile phone.

[Constitution]
As shown in FIG. 1, the mobile phone according to the present embodiment particularly includes a camera unit 51 (image acquisition means) capable of shooting a moving image. As will be described later, the key of the mobile phone is obtained by moving face image authentication. Has the function of releasing the lock. In addition, similarly to the configuration of a general mobile phone, the button input unit 10, the control device 20, the transmission / reception unit 30, the wireless communication antenna 40, the display unit 50, the speaker 52, It has. Hereinafter, each configuration will be described in detail.

  The button input unit 10 has a numeric keypad for making a phone call, as well as a button for inputting a command for performing face authentication in the present invention, a button for enabling face authentication to be interrupted, A button for inputting a command for preliminarily storing face data to be compared at the time of authentication is provided. Note that these buttons do not have to be dedicated buttons for each function described above.

  The control device 20 includes a calculation device such as a CPU and a storage device such as a flash memory, and controls the operation of the mobile phone. As shown in FIG. 1, a state monitoring unit 21, an image processor 22, an image storage memory 23, a control unit 24, a mobile device lock function 25, and a communication control unit 26 are provided.

  The state monitoring unit 21 has a role of determining input of each button of the button input unit 10 and transmitting the state to the control unit 24. The control unit 24 has a role of controlling each unit described above. For example, a signal from the state monitoring unit 21 is transmitted to the display unit 50, the camera 51, and the speaker 52, and vice versa. Further, the image processor 22 is accessed to process the image captured by the camera unit 51, to display the data stored in the image storage memory 23 on the display unit 50 through the image processor 22, If the data stored in the storage memory 23 is a moving image, control is performed so that the sound portion is reproduced as sound from the speaker 52.

  And the process part for implement | achieving the function demonstrated below is implement | achieved by each structure of the control apparatus 20 mentioned above operating. That is, the control device 20 is configured to operate so as to release the key lock state that restricts the input from the button input unit 10 by the mobile device lock function 25 (key lock means). Specifically, as shown in FIG. 2, by incorporating a predetermined program into the control device 20, a reference moving image acquisition processing unit 2a, an unlock request reception processing unit 2b, an authentication moving image acquisition processing unit 2c, The parameter extraction processing unit 2d, the authentication processing unit 2e, the key lock release processing unit 2f, and the key lock processing unit 2g are constructed. The image storage memory 23 includes a reference moving image storage unit 2h and an authentication moving image storage unit 2i. Hereinafter, the processing units 2a to 2g and the storage units 2h and 2i will be described in detail.

  The reference moving image acquisition processing unit 2a (reference moving image acquisition means) captures a moving image of the owner in advance and stores it as a reference moving image. Specifically, a moving image during a predetermined operation of the owner of the mobile phone is taken from the camera unit 51, and the image is stored in advance as a reference moving image required at the time of authentication in order to release the mobile device lock function 25. The data is stored in the reference moving image storage unit 2h in the memory 23.

  When the button for starting the face authentication function (hereinafter referred to as the face authentication release function) for releasing the key lock of the mobile phone is pressed by the button input unit 10 from the button input unit 10, The state monitoring unit 21 senses and accepts that the button has been pressed, and the face authentication cancellation function is activated.

  The authentication moving image acquisition processing unit 2c (moving image capturing means) captures and acquires the owner's moving image as an authentication moving image when a key lock release request is made. Specifically, when the state monitoring unit 21 senses that the face authentication cancellation function has been activated, the state monitoring unit 21 transmits the state to the camera unit 51 through the control unit 24. The camera unit 51 that has obtained information from the control unit 24 is in a state of waiting for an authentication start button to be pressed from the button input unit 10 and can start face authentication at any time. In such a state, when the owner points the camera to photograph himself and presses the button started authentication from the input unit 10, the owner captures a moving image at the time of a predetermined operation of the owner as an authentication moving image. Acquired and stored in the authentication moving image storage unit 2 i in the image storage memory 23. Thus, the control unit 24 plays a role of a camera finder. Thereafter, face authentication is performed by the parameter extraction processing unit 2d and the authentication processing unit 2e (authentication unit).

  The parameter extraction processing unit 2d extracts feature information from the reference moving image stored in advance and the authentication moving image acquired at the time of the key lock release request. At this time, the feature information is extracted by an algorithm for extracting a specific point on the human body determined in advance by ergonomics. That is, a feature point extraction algorithm is incorporated in the control device 20 in advance. The authentication processing unit 2e performs authentication according to whether or not the extracted feature points match. That is, the image processor 22 compares the reference moving image stored in the image storage memory 23 with the authentication moving image acquired by the camera unit 51 to confirm whether or not they are the same person. An example of specific authentication processing will be described in detail when the operation is described.

  Then, when it is confirmed that the same person is obtained by the authentication, the key lock release processing unit 2f (key lock release means) releases the key lock state by the mobile device lock function 25, and the mobile phone can be normally used. To.

[Operation]
Next, the operation of the mobile phone configured as described above, that is, the operation when releasing the key lock state will be described with reference to FIGS. First, with reference to FIG. 3, the operation until the key lock function in the mobile phone is released will be described.

  First, although not shown, the owner takes a moving image of his / her predetermined action from the camera unit 51 with a mobile phone and stores it in the image storage memory 23 in advance as a reference moving image. (Reference moving image acquisition step). At this time, the operation is, for example, an operation of shifting from a state of facing the camera unit 51 to a state of facing sideways.

  Then, the mobile phone determines whether or not the mobile phone is locked from the standby state (step S1) (step S2). If the key lock state is assumed (Yes in step S2), the camera is activated when an operation for releasing the key lock is input from the button input unit 10 (step S3). At this time, it is determined whether or not the shooting mode of the camera is the face authentication mode (step S4). In the face authentication mode, by operating the button input unit 10, for example, by pressing the authentication start key (step S5), face authentication for releasing the key lock of the mobile phone is started ( Step S6). Then, the mobile phone captures a face image, acquires it as an authentication moving image, and stores it in the authentication moving image storage unit 2i (moving image capturing step). At this time, an instruction is issued from the mobile phone so as to capture a moving image having the same operation as when the reference moving image is captured, and an image of a predetermined operation can be acquired. The operation is, for example, an operation of shifting from a state of facing the camera unit 51 to a state of facing side as described above.

  Thereafter, whether or not the person who has moved to the captured authentication moving image by the authentication process (authentication process) is the same person as the person stored in advance in the image storage memory 23, that is, the reference moving image previously captured. Then, it is determined whether or not the authentication moving image acquired this time has the same parameter (feature information) (step S7). If it is confirmed that they have the same parameters and are the same person (Yes in step S7), the key lock state is released (step S8, key lock release step), and the mobile phone is normally usable. It becomes a state. On the other hand, if the parameters are not the same as those of the person stored in the image storage memory due to the authentication (No in step S7), the situation where the key lock is not released, that is, the state where the key is locked is continued (step S7). S9).

  Here, the authentication operation (steps S6 to S8) between the authentication moving image acquired at the time of request for releasing the key lock and the reference moving image stored in advance in the image storage memory 23 will be described in detail with reference to FIG. To do. In the face authentication process described below, feature information (parameters) is extracted from a predetermined frame in each moving image. This process is performed by matching with a template prepared in advance or a face incorporated in advance. Performed by authentication algorithm. That is, an algorithm and a template for extracting each part based on the human face form are preset and incorporated.

  First, from the start of authentication (step S11), in the face authentication system using the moving image shooting function of the mobile phone, a moving image of a person is shot, and a person who is authenticated from a predetermined frame in the moving image is shot forward. A rough check is made (step S12). Here, there are two eyes, a nose, a mouth, and an ear to some extent. The same confirmation is performed for the reference moving image.

  If it is confirmed that the image is taken forward, then the eye and eyebrow parameters are acquired (step S13). Specifically, the size, length, shape, and positional distance between the eyes and eyebrows are measured from the acquired forward-looking image or by measurement of infrared rays or the like at the time of image acquisition. In such a case, the above-mentioned distance information is acquired at the time of shooting the reference moving image acquired and stored in advance, and stored as a parameter together with the moving image.

  Next, parameter acquisition relating to the nose in a forward-facing state is performed (step S14). Measure the approximate shape and length of the nose and the distance from the nose bridge to the nose (the distance along the shooting direction). At this time, for example, the height of the nose may be measured by the presence or absence of focus using an autofocus function or the like, or may be measured from a stereo image. Next, position parameters from the nose to the ear in a forward-facing state are acquired (step S15). Get information on distance from nose to ear and cheek shape.

  Next, a mouth shape parameter is acquired (step S16). The photographer's mouth shape is measured as above.

  When the measurement results in the above-described steps S12 to S16 are good, that is, when the parameters of the reference moving image and the authentication moving image match, the forward shooting information parameter has no problem. The result is displayed (step S17), and a message stating “Since forward shooting is OK, transition to horizontal shooting” is displayed. Thereafter, the process shifts to landscape shooting (step S18). As a result, a predetermined operation is executed.

  Next, it is confirmed that the image is taken sideways (step S18). For example, it is performed by confirming that there is one eye. Then, the nose shape parameter in a predetermined frame in the horizontal state is acquired (step S19). At this time, the height and rough shape of the nose are measured. Next, position parameters from the nose to the ear in the sideways state are acquired (step S20). The above-described parameters in the moving image are acquired (step S21), and compared with the parameters in the reference moving image stored in the image storage memory 23, it is determined whether or not they match.

  Then, if all of the parameters match or are within the allowable error range, it is determined that they are the same person, and the key lock function of the mobile phone is released (step S22).

  As described above, in this embodiment, at least two or more frames included in the reference moving image stored in advance and in the authentication moving image acquired at the time of authentication, in the above example, the side from the front is displayed. Authentication using a moving image is performed by extracting parameters from an image facing forward and an image facing sideways. Accordingly, unauthorized authentication by a third party using a photograph or the like in the case of authentication using a still image can be effectively prevented, and the security level can be improved.

  Here, in the above, authentication is performed using distance information as a parameter. However, since it can be authenticated only when an image is acquired from a person existing in front of the camera, a photograph or the like is taken with the camera. Fraud authentication can be suppressed and higher security is provided. Furthermore, this also increases the parameters at the time of authentication, which can further enhance the security.

  Note that the moving image authentication algorithm is not limited to the above-described method. For example, a feature point movement trajectory or operation time during a preset operation may be used as a parameter for authentication, and the authentication method is arbitrary.

  INDUSTRIAL APPLICABILITY The present invention can be used when releasing a key lock of an information processing apparatus such as a mobile phone, and has industrial applicability.

It is a block diagram which shows the structure of a mobile telephone. It is a functional block diagram which shows the structure of the control apparatus of a mobile telephone. It is a flowchart which shows the key lock release operation | movement of a mobile telephone. It is a flowchart which shows the authentication operation | movement of a mobile telephone.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Button input part 20 Control apparatus 21 State monitoring part 22 Image processing processor 23 Image storage memory 24 Control part 25 Mobile device lock function 26 Communication control part 30 Transmission / reception part 40 Antenna 50 Display part 51 Camera part 52 Speaker 2a Reference moving image acquisition process Unit 2b lock release request reception processing unit 2c authentication moving image acquisition processing unit 2d parameter extraction processing unit 2e authentication processing unit 2f key lock release processing unit 2g key lock processing unit

Claims (9)

An information processing apparatus having key lock means for restricting operations,
A reference moving image storage means for storing a moving image at a predetermined operation time of a previously photographed owner as a reference moving image;
A moving image capturing means for capturing a moving image of the owner at the time of requesting a key lock release and acquiring it as a moving image for authentication;
Authentication means for comparing and authenticating the reference moving image and the authentication moving image;
A key lock release means for releasing a key lock state by the key lock means when authentication by the authentication means is successful;
Bei to give a,
The moving image capturing means obtains the authentication moving image by requesting the owner to perform an operation corresponding to the reference moving image;
The authentication means confirms that the owner is operating in two predetermined states from two frames at the time of a predetermined operation included in the authentication moving image, and the reference moving image And the feature information is extracted from each of the two frames at the time of a predetermined operation included in the authentication moving image, and authentication is performed by comparing the feature information.
An information processing apparatus characterized by that. An information processing apparatus having key lock means for restricting operations,
A reference moving image storage means for storing a moving image at a predetermined operation time of a previously photographed owner as a reference moving image;
A moving image capturing means for capturing a moving image of the owner at the time of requesting a key lock release and acquiring it as a moving image for authentication;
Authentication means for comparing and authenticating the reference moving image and the authentication moving image;
A key lock release means for releasing a key lock state by the key lock means when authentication by the authentication means is successful;
Bei to give a,
The moving image capturing means obtains the authentication moving image by requesting the owner to perform an operation corresponding to the reference moving image;
The authentication means confirms that the owner is in a forward-facing state and a lateral-facing state from two frames at a predetermined operation included in the authentication moving image, and in the reference moving image, and Extracting feature information from each of the two frames at the time of a predetermined operation included in the authentication moving image, comparing the feature information, and performing authentication;
An information processing apparatus characterized by that. Wherein the feature information extracted by the authentication means, the owner, including the distance information along the imaging direction for a given site, the information processing apparatus according to claim 1 or 2, wherein the. The information processing apparatus according to claim 3 , further comprising a distance information acquisition unit configured to acquire the distance information with respect to the predetermined part of the owner when the reference moving image and the authentication moving image are captured. According to claim 1, characterized in that a mobile telephone, 3 or 4 apparatus according. An information processing apparatus including a key lock unit that restricts operations and an image acquisition unit,
Reference moving image acquisition means for capturing a moving image during a predetermined operation of the owner using the image acquisition means and storing it in a storage device in advance as a reference moving image;
A moving image photographing means for photographing a moving image of the owner using the image obtaining means at the time of requesting a key lock release, and obtaining it as an authentication moving image;
Authentication means for comparing and authenticating the reference moving image and the authentication moving image;
A key lock release means for releasing a key lock state by the key lock means when authentication by the authentication means is successful;
Together to realize,
The moving image capturing means obtains the authentication moving image by requesting the owner to perform an operation corresponding to the reference moving image;
The authentication means confirms that the owner is operating in two predetermined states from two frames at the time of a predetermined operation included in the authentication moving image, and the reference moving image And the feature information is extracted from each of the two frames at the time of a predetermined operation included in the authentication moving image, and authentication is performed by comparing the feature information.
A program to make things happen . An information processing apparatus including a key lock unit that restricts operations and an image acquisition unit,
Reference moving image acquisition means for capturing a moving image during a predetermined operation of the owner using the image acquisition means and storing it in a storage device in advance as a reference moving image;
A moving image photographing means for photographing a moving image of the owner using the image obtaining means at the time of requesting a key lock release, and obtaining it as an authentication moving image;
Authentication means for comparing and authenticating the reference moving image and the authentication moving image;
A key lock release means for releasing a key lock state by the key lock means when authentication by the authentication means is successful;
Together to realize,
The moving image capturing means obtains the authentication moving image by requesting the owner to perform an operation corresponding to the reference moving image;
The authentication means confirms that the owner is in a forward-facing state and a lateral-facing state from two frames at a predetermined operation included in the authentication moving image, and in the reference moving image, and Extracting feature information from each of the two frames at the time of a predetermined operation included in the authentication moving image, comparing the feature information, and performing authentication;
A program to make things happen . A method of releasing a key lock state in an information processing apparatus comprising a key lock means for restricting operations and an image acquisition means,
A reference moving image acquisition step of capturing a moving image during a predetermined operation of the owner using the image acquisition means and storing the moving image in a storage device in advance as a reference moving image;
A moving image photographing step of photographing the owner's moving image using the image obtaining means at the time of requesting a key lock release and obtaining it as an authentication moving image;
An authentication step of comparing and authenticating the reference moving image and the authentication moving image;
A key lock releasing step for releasing the key lock state by the key lock means when the authentication is successful by the authentication step;
I have a,
The moving image capturing step requests the owner to perform an operation corresponding to the reference moving image to acquire the authentication moving image;
The authentication step confirms that the owner is operating in two predetermined states from two frames during a predetermined operation included in the authentication moving image, and the reference moving image And the feature information is extracted from each of the two frames at the time of a predetermined operation included in the authentication moving image, and authentication is performed by comparing the feature information.
A key lock release method characterized by the above. A method of releasing a key lock state in an information processing apparatus comprising a key lock means for restricting operations and an image acquisition means,
A reference moving image acquisition step of capturing a moving image during a predetermined operation of the owner using the image acquisition means and storing the moving image in a storage device in advance as a reference moving image;
A moving image photographing step of photographing the owner's moving image using the image obtaining means at the time of requesting a key lock release and obtaining it as an authentication moving image;
An authentication step of comparing and authenticating the reference moving image and the authentication moving image;
A key lock releasing step for releasing the key lock state by the key lock means when the authentication is successful by the authentication step;
I have a,
The moving image capturing step requests the owner to perform an operation corresponding to the reference moving image to acquire the authentication moving image;
The authentication step confirms that the owner is in a forward-facing state and a lateral-facing state from two frames at the time of a predetermined operation included in the authentication moving image, and in the reference moving image, and Extracting feature information from each of the two frames at the time of a predetermined operation included in the authentication moving image, comparing the feature information, and performing authentication;
A key lock release method characterized by the above.

Images