JP2015169977A - Personal authentication device, personal authentication method, personal authentication program, and automatic transaction system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a personal authentication device configured to reliably prevent illegal authentication of a third party, with a simple configuration.SOLUTION: A personal authentication device 1 includes: storage means 2 which stores in advance reference patten information including a reference lip shape change pattern indicating time-series change in lip shape of a user, corresponding to time-series change of words, in a reference password, and a reference face positional relation change pattern indicating time-series change in positional relation between the lips and a specific section of a face of the user; imaging means which images a face of the user who utters a voice password, and outputs it as a captured image; and authentication means 4 which generates voice pattern information including a voice lip shape change pattern for the voice password corresponding to the reference lip shape change pattern and a voice face positional relation change pattern for the voice password corresponding to the reference face positional relation change pattern, and compares the reference pattern information with the voice pattern information, to authenticate the user when they match each other.

Description

  The present invention relates to a personal authentication device, a personal authentication method, a personal authentication program, and an automatic transaction system that authenticate whether or not a user is a user.

  A device that authenticates whether the user is the user and provides a predetermined service, for example, an automatic transaction device, performs user authentication (person authentication) by determining whether the password entered by the user is correct. Is going. User authentication by entering a password is simple, but there is a high risk of unauthorized authentication due to skimming or theft of a cash card.

  Therefore, in recent years, an automatic transaction apparatus that employs biometric authentication (for example, fingerprint authentication, vein authentication, face authentication, etc.) is also increasing. Since the biometric authentication distinguishes the person based on the characteristics of the biometric, the risk of being stolen is low. However, even in the case of biometric authentication, the possibility is low, but theoretically, unauthorized authentication is possible by using a copy by collecting physical features. Also, devices for detecting fingerprints and vein status are generally expensive. That is, in the case of biometric authentication, there is another problem that the device cost increases.

  In Patent Document 1, a lip portion of a user who is uttering a predetermined word is photographed by a camera, a temporal change in the shape of the lips is extracted from the photographed image, and this temporal change and a pre-registered image pattern are disclosed. A technique for converting a word uttered by a user into a character by comparing with the above is described.

Japanese Patent Laying-Open No. 2007-087291 (Page No. 4-5, FIG. 1)

  Patent Document 1 converts words uttered by a user into characters based only on lip movement (lip shape change). However, when the password is known, if the voice of the lip is spoken exactly as it is, the word will be recognized even if it is a completely different person. There is a danger.

  The present invention has been made in order to solve the above-mentioned problems, and has a simple configuration and can prevent unauthorized authentication by a third party more reliably, a personal authentication device, a personal authentication method, a personal authentication program, and The purpose is to provide an automated trading system.

  The personal authentication device of the present invention includes a reference lip shape change pattern indicating a time-series change of a user's lip shape corresponding to a time-series change of a word in a reference password which is a password serving as a reference for authentication; Reference pattern information including a reference face positional relationship change pattern indicating a temporal change in positional relationship between the lips and a specific part of the user's face corresponding to a time-series change of words in a reference password, A storage means for storing in advance, a photographing means for photographing a user's face that speaks an utterance password that is a password for authenticating the person, and outputting as a photographed image; from the photographed image to the reference lip shape change pattern The utterance lip shape change pattern for the corresponding utterance password and the utterance password for the utterance password corresponding to the reference face positional relationship change pattern Generating a utterance pattern information including a face positional relationship change pattern, comparing the reference pattern information with the utterance pattern information, and matching the reference lip shape change pattern with the utterance lip shape change pattern and the reference Authentication means for authenticating that the user is the user when the face position change pattern matches the utterance face position change pattern.

  The personal authentication method of the present invention includes a reference lip shape change pattern indicating a time-series change of a user's lip shape corresponding to a time-series change of a word in a reference password which is a password serving as a reference for authentication; Reference pattern information including a reference face positional relationship change pattern indicating a temporal change in positional relationship between the lips and a specific part of the user's face corresponding to a time-series change of words in a reference password, About the utterance password corresponding to the reference lip shape change pattern from the photographed image, which is recorded in advance and photographed as a photographed user's face, which is a password for authenticating the user, Utterance lip shape change pattern and utterance face position change pattern for the utterance password corresponding to the reference face position change pattern , And the reference pattern information is compared with the utterance pattern information, the reference lip shape change pattern and the utterance lip shape change pattern match, and the reference face position change pattern and the When the utterance face position change pattern matches, the user is authenticated as the person himself / herself.

  The personal authentication control program of the present invention shows a time-series change in the shape of the user's lips corresponding to a time-series change of words in a reference password, which is a password serving as a reference for authentication, on the computer of the user authentication apparatus. A reference lip shape change pattern, and a reference face positional relationship change pattern indicating a time-series change of a positional relationship between the lips and a specific part of the user's face corresponding to a time-series change of words in the reference password; From the captured image, a storage process for storing reference pattern information in advance, a shooting process for capturing a face of a user who speaks an utterance password that is a password for authenticating the user, and outputting the captured image as a captured image , The utterance lip shape change pattern for the utterance password corresponding to the reference lip shape change pattern, and the reference face positional relationship change pattern Utterance pattern information including a corresponding utterance face positional change pattern for the corresponding utterance password, comparing the reference pattern information with the utterance pattern information, and changing the reference lip shape change pattern and the utterance lip shape change This is a program for executing an authentication process for authenticating that the user is the user when the pattern matches and the reference face position change pattern matches the utterance face position change pattern.

  The automatic transaction system of the present invention is an automatic transaction system including a user authentication server and an automatic teller machine, and the user authentication server is a time-series change of words in a reference password which is a password used as a reference for authentication. A reference lip shape change pattern indicating a time-series change in the shape of the user's lips, and a specific portion of the lips and the user's face corresponding to a time-series change in words in the reference password And a reference pattern information including a reference face positional relationship change pattern indicating a time-series change in the positional relationship of the first automatic storage device, the automatic teller machine received from the user authentication server. The second storage means for storing the reference pattern information and the face of the user who utters the utterance password, which is a password for authenticating the person, are photographed as a photographed image. A shooting means for outputting; a utterance face position for the utterance password corresponding to the utterance password corresponding to the reference lip shape change pattern; Generating a utterance pattern information including a relationship change pattern, comparing the reference pattern information with the utterance pattern information, and matching the reference lip shape change pattern with the utterance lip shape change pattern and the reference face position. Authentication means for authenticating that the user is the user when the change pattern matches the utterance face position change pattern.

  While having a simple configuration, unauthorized authentication by a third party can be prevented more reliably.

It is a block diagram which shows the structural example of the personal authentication apparatus which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structural example of the automatic transaction system which concerns on the 2nd Embodiment of this invention. It is a flowchart for demonstrating the operation example of the automatic teller machine shown by FIG. It is a figure which shows the data structural example of reference | standard pattern information. It is a figure for demonstrating a reference lip shape and a reference face positional relationship.

[First Embodiment]
FIG. 1 is a block diagram showing a configuration example of a personal authentication device 1 according to the first embodiment of the present invention.

  The personal authentication device 1 includes a storage unit 2, a photographing unit 3, and an authentication unit 4.

  The storage unit 2 stores reference pattern information 5 in advance. The reference pattern information 5 includes a reference lip shape change pattern indicating a time-series change in the shape of the user's lips corresponding to a time-series change of words in the reference password, which is a password used as an authentication reference, and a reference password And a reference face positional relationship change pattern indicating a time-series change in the positional relationship between the lips and a specific part of the user's face corresponding to the time-series change of the word.

  The photographing unit 3 photographs the face of the user who speaks the utterance password, which is a password for authenticating the person, and outputs the photographed image.

  The authentication unit 4 generates, from the captured image, a utterance lip shape change pattern for a utterance password corresponding to the reference lip shape change pattern, and a utterance face position relationship change pattern for an utterance password corresponding to the reference face position relationship change pattern. The included utterance pattern information 6 is generated. The authentication unit 4 compares the reference pattern information 5 and the utterance pattern information 6, and the reference lip shape change pattern and the utterance lip shape change pattern match, and the reference face position change pattern and the utterance face position change pattern match. In this case, the user is authenticated.

  According to the first embodiment described above, the identity authentication is determined in consideration of not only lip movement (lip shape change) but also a change in face positional relationship. If the password is known, the movement of the lips may be mistakenly identified as the user, even if it is a completely different person, if it is spoken as it is. However, since the positional relationship of the face is unique to the living body, the possibility of misidentifying others as the person is extremely low.

  Furthermore, in the first embodiment described above, the authentication target is a user's face image. That is, it can be a normal camera (for example, a surveillance camera or a digital camera) generally distributed in the photographing unit 3. Therefore, a special and expensive device such as a device for detecting a state such as a fingerprint or a vein is unnecessary.

  In summary, according to the first embodiment, unauthorized authentication by a third party can be more reliably prevented with a simple configuration.

Note that the personal authentication device according to the first embodiment can be widely applied to all devices that authenticate whether the user is the user and provide processing or services according to the authentication result.
[Second Embodiment]
FIG. 2 is a block diagram showing a configuration example of the automatic transaction system 10 according to the second embodiment of the present invention. As an embodiment of the present invention, a user authentication method used when a user withdraws cash from an automatic transaction apparatus will be described, and its configuration and operation will be described.

  The automatic transaction system 10 includes an automatic teller machine 12 and a user authentication server 14. The automatic teller machine 12 is connected to a user authentication server 14 via a network 16.

  The automatic teller machine 12 includes a storage unit 20, a photographing unit 22, an authentication unit 24, and a display unit 26.

  The storage unit 20 stores reference pattern information 40 (details will be described later) received from the user authentication server 14.

  The photographing unit 22 photographs the face of the user who speaks the password for authenticating the user and outputs the photographed image.

  The authentication unit 24 generates utterance pattern information 50 (details will be described later) from the captured image. The authenticating unit 24 compares the reference pattern information 40 and the utterance pattern information 50, and determines whether or not the user who uttered the password is present according to the comparison result.

  The display unit 26 displays predetermined information (for example, automatic transaction service initial screen, password utterance guidance, personal authentication result, etc.).

  The user authentication server 14 includes a storage unit 30 and a control unit 32.

  The storage unit 30 stores reference pattern information 40.

  Based on the request from the automatic teller machine 12, the control unit 32 reads the reference pattern 40 corresponding to the inserted cash card from the storage unit 30, and transmits the read reference pattern 40 to the automatic teller machine 12. .

  FIG. 3 is a flowchart for explaining an operation example of the automatic teller machine 12.

  The authentication unit 24 displays the automatic transaction service initial screen on the display unit 26 (step S1). The authentication unit 24 confirms whether or not the cash card is inserted by the user (step S2). When the insertion of the cash card is confirmed (Yes in step S2), the authentication unit 24 sends the authentication information (specifically, the reference pattern information corresponding to the inserted cash card) to the user authentication server 14. 40) is requested (step S3). When the insertion of the cash card is not confirmed (No determination in step S2), the authentication unit 24 executes the process of step S2 again.

  The control unit 32 of the user authentication server 14 that has received the authentication information request reads the reference pattern information 40 corresponding to the inserted cash card from the storage unit 30, and sends the read reference pattern information 40 to the automatic teller machine 12. Send.

  The authentication unit 24 receives the reference pattern information 40 from the user authentication server 14 (step S). The received reference pattern information 40 is stored in the storage unit 20.

  The authentication unit 24 displays password utterance guidance for prompting the user to start uttering the password on the display unit 26 (step S5).

  The user utters the password according to the password utterance guidance. The photographing unit 22 photographs the face of the user who is speaking the password (step S6). The captured image is output as a captured image.

  The authentication unit 24 generates utterance pattern information 50 from the photographed image (step S7). The authentication unit 24 compares the reference pattern information 40 and the utterance pattern information 50 (step S8).

  Here, the reference pattern information 40 and the utterance pattern information 50 will be described. FIG. 4 is a diagram illustrating a data configuration example of the reference pattern information 40. FIG. 5 is a diagram for explaining the relationship between the reference lip shape and the reference face position. In the following, an example in which two reference passwords serving as a reference are “1” and “2”.

  The reference pattern information 40 includes each word (“1”, “2”), characters (“I”, “Chi”, “Ni”) constituting each word, a reference lip shape for each character, and each character. Reference face positional relationship.

  For example, Sa in FIG. 4 indicates the shape of the lips (the shape of the region surrounded by the region Sa in FIG. 5) for the character “I” of the word “1”.

  In addition, Ra in FIG. 4 indicates the face positional relationship in the case of the character “I” of the word “1”. In this case, the face positional relationship is, for example, the distance (the distance indicated by the solid line Ra in FIG. 5) between the lips and a specific part of the user's face other than the lips (for example, the right eyebrow).

  In FIG. 4, Sb is the lip shape of the character “Chi”, and Sc is the lip shape of the character “Ni”. In FIG. 4, Rb is the distance between the lips and the right eyebrows of the character “Chi”, and Rc is the distance between the lips and the right eyebrows of the character “Ni”.

  The structure of the utterance pattern information 50 is the same as the reference pattern information 40. However, since the acquisition timing of the target captured image (that is, when the reference password is registered and when the utterance password is input) is different, the values are not necessarily the same. Furthermore, since the utterance pattern information 50 is an object to be authenticated, not a reference, the “reference” in the reference lip shape and the reference face positional relationship is unnecessary or is read as “speech”.

  It is to be noted that a known pattern matching (image matching) technique can be used for determining a match between the reference lip shape and the utterance lip shape. Further, the comparison between the reference face position and the utterance face position can be performed by simple numerical comparison (distance comparison or area comparison). In this case, it may be determined that the two match only when the difference is substantially “0”, or when the difference is within a predetermined difference range, it is determined that the two match. May be.

  The specific part is not limited to the eyebrows and may be another part (for example, eyes, nose, chin). Moreover, it is more preferable that the specific part is a part where the amount of movement differs for each character. Further, the distance is not limited to one and may be a plurality.

  Further, the face positional relationship is not limited to the distance between the lips and the specific part, for example, an area formed by the lips and a plurality of specific parts (for example, a triangular area formed by the lips, the left eye, and the right eye). It may be an area.

  Further, the face positional relationship may be both the distance between the lips and the specific part and the area of the region formed by the lips and the plurality of specific parts.

  Returning to the description of FIG. When the reference pattern information 40 and the utterance pattern information 50 match (Yes determination in step S9), the authentication unit 24 determines that the user who uttered the password is authenticated as the user, and determines the predetermined value for the user. The automatic transaction service is provided (step S10). On the other hand, if the reference pattern information 40 and the utterance pattern information 50 do not match (No determination in step S9), the authentication unit 24 determines that the user who uttered the password is not the user, and performs predetermined error processing ( Password re-input or service stop processing is executed (step S11).

  According to the second embodiment described above, the identity authentication is determined in consideration of not only the lip movement (lip shape change) but also the change in the facial positional relationship. If the password is known, the movement of the lips may be mistakenly identified as the user, even if it is a completely different person, if it is spoken as it is. However, since the positional relationship of the face is unique to the living body, the possibility of misidentifying others as the person is extremely low.

  Furthermore, in the second embodiment described above, the authentication target is a user's face image. That is, it can be a normal camera (for example, a surveillance camera or a digital camera) generally distributed in the photographing unit 22. Therefore, a special and expensive device such as a device for detecting a state such as a fingerprint or a vein is unnecessary.

  In summary, according to the second embodiment, unauthorized authentication by a third party can be more reliably prevented with a simple configuration.

  The password is not limited to numbers, and may be characters or symbols. The password may be a combination of words of different types. Further, the password may be determined at the user's will, or may be a group of words randomly generated by the usage authentication server 14, for example.

  A program for realizing all or part of the functions of the first and second embodiments described above is recorded on a computer-readable recording medium, and the program recorded on the recording medium is stored in a computer system. The processing of each unit may be performed by reading and executing.

  An example of a “computer system” is a CPU (Central Processing Unit), for example.

  The “computer-readable recording medium” is, for example, a non-transitory storage device. Examples of non-temporary storage devices include a magneto-optical disk, a ROM (Read Only Memory), a portable medium such as a nonvolatile semiconductor memory, and a hard disk built in a computer system. The “computer-readable recording medium” may be a temporary storage device. As an example of a temporary storage device, for example, a communication line in the case of transmitting a program via a network such as the Internet or a communication line such as a telephone line, or a volatile memory inside a computer system can be cited.

  Further, the program may be for realizing a part of the above-described functions, and may be capable of realizing the above-described functions in combination with a program already recorded in the computer system. .

  As mentioned above, although this invention was demonstrated using 1st and 2nd embodiment, the technical scope of this invention is not limited to description of said each embodiment. It is obvious to those skilled in the art that various modifications or improvements can be added to the above embodiments. Therefore, it is needless to say that embodiments with such changes or improvements are also included in the technical scope of the present invention. The numerical values and the names of the components used in the first and second embodiments described above are illustrative and can be changed as appropriate.

DESCRIPTION OF SYMBOLS 1 Personal authentication apparatus 2 Memory | storage part 3 Image | photographing part 4 Authentication part 5 Reference pattern information 6 Speech pattern information 10 Automatic transaction system 12 Automatic teller machine 14 User authentication server 16 Network 20 Memory | storage part 22 Image | photographing part 24 Authentication part 26 Display part 30 Storage unit 32 Control unit 40 Reference pattern information 50 Speaking pattern information

Claims (5)

A reference lip shape change pattern showing a time-series change of the shape of the user's lips corresponding to a time-series change of the word in the reference password, which is a password used as a reference for authentication, and a time-series of words in the reference password Storage means for storing in advance reference pattern information including a reference face positional relationship change pattern indicating a time-series change in positional relationship between the lips and a specific part of the user's face corresponding to a change;
Photographing means for photographing the face of the user who speaks the utterance password, which is a password for authenticating the person, and outputting the photographed image;
From the captured image, a utterance lip shape change pattern for the utterance password corresponding to the reference lip shape change pattern, and a utterance face position relationship change pattern for the utterance password corresponding to the reference face position relationship change pattern. Generating utterance pattern information, comparing the reference pattern information with the utterance pattern information, the reference lip shape change pattern and the utterance lip shape change pattern match, and the reference face position change pattern and the utterance face And a means for authenticating that the user is the person when the position change pattern matches.   The positional relationship with the specific part is at least one of a distance between the lips and a specific part of the user's face other than the lips, and an area of a region formed by the lips and the specific parts. The personal authentication apparatus according to claim 1, wherein: A reference lip shape change pattern showing a time-series change of the shape of the user's lips corresponding to a time-series change of the word in the reference password, which is a password used as a reference for authentication, and a time-series of words in the reference password Reference pattern information including a reference face positional relationship change pattern indicating a time-series change in positional relationship between the lips and a specific part of the user's face corresponding to a change is stored in advance,
Take a picture of the face of the user who speaks the utterance password, which is the password for authenticating the person, and output it as a shot image.
From the captured image, a utterance lip shape change pattern for the utterance password corresponding to the reference lip shape change pattern, and a utterance face position relationship change pattern for the utterance password corresponding to the reference face position relationship change pattern. Generate utterance pattern information including
Comparing the reference pattern information and the utterance pattern information;
When the reference lip shape change pattern matches the utterance lip shape change pattern, and the reference face position change pattern and the utterance face position change pattern match, the user is authenticated as the person. The person authentication method. In the computer of the personal authentication device,
A reference lip shape change pattern showing a time-series change of the shape of the user's lips corresponding to a time-series change of the word in the reference password, which is a password used as a reference for authentication, and a time-series of words in the reference password A storage process for storing in advance reference pattern information including a reference face positional relationship change pattern indicating a time-series change in positional relationship between the lips and a specific part of the user's face corresponding to a change;
Shooting process that captures the face of the user who speaks the utterance password, which is a password for authenticating the person, and outputs the photographed image,
From the captured image, a utterance lip shape change pattern for the utterance password corresponding to the reference lip shape change pattern, and a utterance face position relationship change pattern for the utterance password corresponding to the reference face position relationship change pattern. Generating utterance pattern information, comparing the reference pattern information with the utterance pattern information, the reference lip shape change pattern and the utterance lip shape change pattern match, and the reference face position change pattern and the utterance face A personal authentication control program for executing authentication processing for authenticating that the user is the user when the position change pattern matches. An automatic transaction system comprising a user authentication server and an automatic teller machine,
User authentication server
A reference lip shape change pattern showing a time-series change of the shape of the user's lips corresponding to a time-series change of the word in the reference password, which is a password used as a reference for authentication, and a time-series of words in the reference password First storage means for storing in advance reference pattern information including a reference face positional relationship change pattern indicating a time-series change in positional relationship between the lips and a specific part of the user's face corresponding to a change; Prepared,
The automatic teller machine is
Second storage means for storing the reference pattern information received from the user authentication server;
Photographing means for photographing the face of the user who speaks the utterance password, which is a password for authenticating the person, and outputting the photographed image;
From the captured image, a utterance lip shape change pattern for the utterance password corresponding to the reference lip shape change pattern, and a utterance face position relationship change pattern for the utterance password corresponding to the reference face position relationship change pattern. Generating utterance pattern information, comparing the reference pattern information with the utterance pattern information, the reference lip shape change pattern and the utterance lip shape change pattern match, and the reference face position change pattern and the utterance face An automatic transaction system comprising: authentication means for authenticating that the user is the person when the position change pattern matches.

Images