JP2020115361A - Authentication device, crime prevention system, and control method and program by authentication device - Google Patents

Abstract

To provide an authentication device that improves authentication accuracy and prevents spoofing due to forgery of biometric information.SOLUTION: An authentication device includes: imaging means that images an authentication object person; authentication means that detects an authentication start gesture by the authentication object person and authenticates, based on one or a plurality of pieces of biometric information included in one or more images acquired by the imaging means, the authentication object person; and control means that controls an operation of a notification device connected to an own device. The authentication means determines, when the authentication is successful, based on the image, whether or not a third party exists near the authentication object person, and the authentication means identifies, when a third person exists, a finger placed on a fingerprint scanner, while recognizing, when the third person does not exist, an instruction gesture. The control means executes control according to the recognized instruction gesture.SELECTED DRAWING: Figure 1

Description

The present invention relates to an authentication device, a crime prevention system, a control method by the authentication device, and a program.

In recent years, an authentication device has been developed that enhances security by authenticating biometrics such as faces, fingerprints, vein patterns, etc., such as unlocking doors or accessing information stored in a computer. Is used for.
For example, in Patent Document 1, a motion pattern corresponding to a predetermined part of a living body is detected by a sensor, and biometric information of a part corresponding to the detected motion pattern is compared with biometric information generated from the detected motion pattern. There is a description of a biometric authentication device that performs authentication by. Further, Patent Document 2 describes a biometric feature input device in which a fingerprint and a blood vessel are not in contact with each other.
The authentication method using the biometric feature is effective for the problems in the authentication using the password, the key, the security card, etc. (the theft, forgetting, loss, etc. of the password or the key).

Republished WO 2013/114806 JP, 2009-175810, A

However, the authentication method using biometrics also has new problems such as deterioration of authentication accuracy due to ambiguity peculiar to a living body and spoofing due to forgery of biometric information. Further, as another problem, there are the following problems. For example, in the case of fingerprint authentication, it is necessary to bring a finger into contact with the sensor, but there is a demand to perform authentication in a non-contact state in order to secure a clean feeling of the human body and simplify the operation. Also, when performing authentication with a finger vein pattern, there is often a problem with authentication accuracy due to misalignment, so it is often necessary to bring the finger into contact with the table, but when the finger comes into contact with the table, the veins in that part are compressed. There is also a problem that the vein pattern is changed and the authentication accuracy is lowered. Further, in the face authentication, it is easy to ensure non-contact property, but there is a problem that it is generally difficult to secure the authentication accuracy because there are few features that are easily digitized compared to fingerprints and blood vessels. Further, for example, when face authentication is used to permit passage of a door, if the authentication device constantly monitors the face, the person whose face image is registered will open the door only by passing in front of the door, Inconvenience occurs when there is a circumstance where you do not want to open. An authentication method that addresses a plurality of problems of such biometric authentication has not been provided so far.

Therefore, an object of the present invention is to provide an authentication device, a crime prevention system, a control method by the authentication device, and a program that can solve the above-mentioned problems.

The present invention is based on an image capturing unit that captures an image of a person to be authenticated, an authentication start gesture by the person to be authenticated, and one or more biological information included in one or more images acquired by the image capturing unit. The authentication means for authenticating the authentication target person, and the control means for controlling the operation of the notification device connected to the self-device, the authentication means, if the authentication is successful, the third party Whether or not the person to be authenticated is present is determined based on the image, and when the third party is present, the authentication means identifies the finger placed on the fingerprint scanner while the third person is present. When the three parties do not exist, the authentication unit is an authentication device that recognizes a pointing gesture, and the control unit executes control according to the recognized pointing gesture.

The present invention is also a crime prevention system that includes the above-described authentication device and a notification device, and the notification device makes a notification based on an instruction from the authentication device.

Further, the present invention detects an authentication start gesture by an authentication target person, authenticates the authentication target person based on one or a plurality of biometric information included in one or a plurality of images acquired by the imaging unit, and The operation of the notification device connected to the device is controlled, and if the authentication of the authentication target person is successful, it is determined based on the image whether or not a third party is present near the authentication target person. When the third party is present, the finger placed on the fingerprint scanner is identified, while when the third party is not present, the pointing gesture is recognized, and control according to the recognized pointing gesture is executed. It is a control method by the authentication device including the above.

Further, the present invention detects an authentication start gesture by an authentication target person, and based on one or more biometric information included in one or more images acquired by the imaging means, to authenticate the authentication target person. Controlling the operation of the notification device connected to the own device, and if the authentication of the authentication target person is successful, it is displayed in the image whether or not a third party exists near the authentication target person. On the other hand, if the third party is present, the finger placed on the fingerprint scanner is identified, and if the third party is not present, the pointing gesture is recognized and the pointing gesture is recognized according to the recognized pointing gesture. And a program for causing a computer to execute the control.

According to the authentication of the present invention, it is possible to improve the authentication accuracy and prevent impersonation due to forgery of biometric information while maintaining the convenience of contactless authentication.

It is a figure which shows the minimum structure of the authentication apparatus by 1st embodiment of this invention. It is a block diagram of the crime prevention system by a first embodiment of the present invention. FIG. 6A is a first diagram showing an example of a gesture in which the authentication device according to the first embodiment of the present invention instructs the start of authentication processing. It is a 1st figure which shows an example of the biometric information which the authentication device by 1st embodiment of this invention uses for authentication. FIG. 8 is a second diagram showing an example of biometric information used for authentication by the authentication device according to the first embodiment of the present invention. FIG. 11 is a third diagram showing an example of biometric information used by the authentication device according to the first embodiment of the present invention for authentication. FIG. 8 is a fourth diagram showing an example of biometric information used for authentication by the authentication device according to the first embodiment of the present invention. FIG. 16 is a fifth diagram showing an example of biometric information used for authentication by the authentication device according to the first embodiment of the present invention. FIG. 16 is a sixth diagram showing an example of biometric information used for authentication by the authentication device according to the first embodiment of the present invention. It is a figure which shows an example of the gesture of the biological body which the authentication device by 1st embodiment of this invention uses for authentication. It is a 1st figure which shows an example of the gesture of the biological body which instructs unlocking/locking of the door by 1st embodiment of this invention. It is a 2nd figure which shows an example of the gesture of the biological body which instructs unlocking/locking of the door by 1st embodiment of this invention. It is an example of an image when detecting that the authentication target person is in an emergency situation according to the first embodiment of the present invention. It is a flow chart which shows an example of attestation processing in a first embodiment of the present invention. It is a flow chart which shows an example of report processing in a first embodiment of the present invention. It is a block diagram of the crime prevention system by a second embodiment of the present invention. It is a flow chart which shows an example of attestation processing in a second embodiment of the present invention.

<First embodiment>
The authentication device according to the first embodiment of the present invention will be described below with reference to FIGS.
FIG. 1 is a diagram showing a minimum configuration of an authentication device according to a first embodiment of the present invention.
As shown in FIG. 1, the authentication device 100 includes at least an imaging unit 110 and an authentication unit 130.
The image capturing unit 110 captures an image of a person to be authenticated (hereinafter referred to as a target person).
The authentication unit 130 uses the living body based on one or more pieces of biometric information included in the image of the subject captured by the image capturing unit 110 and information indicated by the gesture of the living body included in the image captured by the image capturing unit 110. About certification. The biometric information is, for example, a face image, a vein pattern of each body part, an iris pattern, or the like. In addition, the information indicated by the living body gesture is, for example, a number or a character indicated by the finger of the subject.

FIG. 2 is a block diagram of the crime prevention system according to the first embodiment of the present invention.
The security system 1 in this figure includes an authentication device 100, a notification device 200, a storage device 210, a door 300, and an electric lock 310. The security system 1 authenticates whether the target person 10 who intends to pass through the door 300 has the right to pass through the door 300, and when the target person 10 passes the door 300, the target person 10 passes through the door 300. It is a system that allows you to do. Further, the crime prevention system 1 includes a reporting device 200 for reporting a surveillance staff member when a third person tries to pass through the door 300 when the target person 10 passes through the door 300. The storage device 210 also stores biometric information and the like used for authentication of the subject 10.

The authentication device 100 captures an image of the target person 10, performs authentication processing based on the captured image, and determines whether the target person 10 has the authority to pass through the door 300. Further, when the subject 10 has the authority to pass through the door 300, the authentication device 100 outputs an unlock signal to the electric lock 310 and controls the door 300 to be unlocked. Further, when the authentication device 100 detects that the target person 10 is attacked, the authentication device 100 operates the notification device 200 to make a notification. The authentication device 100 includes a near infrared camera 111, a near infrared light source 112, a near infrared light source 113, a pattern filter 114, a light source switch 115, a control unit 120, an authentication unit 130, and an alarm lamp 140. have.

The near-infrared camera 111 is a camera that images an object using the near-infrared light source 112 or the near-infrared light source 113 as a light source. The near-infrared light source 112 is a light source of near-infrared uniform light for obtaining images for face authentication, vein pattern authentication, and gesture recognition. When the near-infrared light source 112 is used as the light source, the near-infrared camera 111 captures a near-infrared image (referred to as an authentication image) of the target person 10. On the other hand, a pattern filter 114 is provided in front of the near infrared light source 113. The pattern filter 114 is a filter for allowing the light having the near infrared light source 113 as a light source to provide a special pattern light to a part such as a face or a hand. The pattern filter 114 is, for example, a random dot pattern, a striped filter, or the like. By irradiating each part of the body with the special pattern light that has passed through the pattern filter 114 and capturing an image, an image including information on the distance between the part and the near-infrared camera 111 is obtained. That is, when the near-infrared light source 113 is used as the light source, the near-infrared camera 111 captures an image (referred to as a distance image) including information indicating the distance to each part of the target person 10. The range image can be used for improving the recognition accuracy of a face or vein pattern and enhancing gesture recognition. The light source switch 115 switches the light source of the near infrared camera 111 to the near infrared light source 112 or the near infrared light source 113. The switching of the light source is controlled by the control unit 120. The imaging unit 110 in FIG. 1 includes a near infrared camera 111, a near infrared light source 112, a near infrared light source 113, a pattern filter 114, and a light source switch 115.

The control unit 120 controls unlocking/locking of the electric lock 310 based on the authentication result by the authentication unit 130. Further, the control unit 120 operates the notification device 200 based on the recognition result of the gesture of the target person 10 by the authentication unit 130. Further, the control unit 120 switches the near infrared light source 112 and the near infrared light source 113 via the light source switch 115, and instructs the near infrared camera 111 to perform imaging. Further, the control unit 120 outputs the image captured by the near infrared camera 111 to the authentication unit 130 and instructs the authentication unit 130 to perform the authentication process. The control unit 120 also turns on the alarm lamp 140 based on detection by a third party by the authentication unit 130.

The authentication unit 130 acquires the authentication image of the target person 10 captured by the near-infrared camera 111, and performs predetermined image processing/image recognition processing (hereinafter collectively referred to as image processing). For example, in the case of face authentication, the authentication unit 130 performs a process of extracting the face range and the face feature points from the authentication image in which the face of the target person 10 is captured. Alternatively, the authentication unit 130 recognizes the distance between the target person 10 and the near-infrared camera 111 based on the distance image of the target person 10. Then, the authentication unit 130 performs a process of correcting the size of the face image included in the authentication image so that the size of the face image can be matched with the face image of an authorized person registered in the storage device 210 in advance. Known techniques can be used for these image processes, and thus the specific contents of the image processes are not mentioned in this specification. After performing these image processes, the authentication unit 130 collates the face image of the subject 10 after the image processing with the face image registered in the storage device 210, and authenticates the subject 10. The authentication unit 130 may perform authentication using a plurality of pieces of biometric information out of other biometric information (face, vein pattern, iris pattern, etc.) obtained from the authentication image. The authentication unit 130 also recognizes the gesture of the target person 10 included in the authentication image by image processing. The gesture of the target person 10 is, for example, a gesture in which the target person 10 shakes the hand toward the near-infrared camera 111 from side to side and back and forth, and bends and stretches a finger. Then, the authentication unit 130 may perform the authentication by using the information indicated by the gesture of the target person 10 in addition to the authentication by the biometric information. The authentication unit 130 may also determine whether to unlock or lock the electric lock 310 based on the information indicated by the gesture of the target person 10. Specific examples of the authentication processing by the authentication unit 130 and the control of the electric lock 310 will be described later.

FIG. 3 is a first diagram showing an example of a gesture in which the authentication device according to the first embodiment of the present invention instructs the start of the authentication process.
FIG. 3 shows the subject 10 holding his/her hand near the face toward the near-infrared camera 111. The authentication unit 130 can acquire the authentication image illustrated in FIG. 3 and perform image processing to recognize, for example, a gesture in which the subject 10 holds one of the hands near the face. It is predetermined that when the gesture is recognized, an instruction to start the authentication process is given, and the authentication unit 130 determines to start the authentication process for the target person 10. When the authentication start is determined, the authentication unit 130 may perform face authentication processing using the authentication image of FIG. 3, for example.

FIG. 4 is a first diagram showing an example of biometric information used for authentication by the authentication device according to the first embodiment of the present invention. FIG. 4 shows an example of a throat vein pattern of the subject 10.

FIG. 5 is a second diagram showing an example of biometric information used for authentication by the authentication device according to the first embodiment of the present invention. FIG. 5 shows an example of the cheek vein pattern of the subject 10.

FIG. 6 is a third diagram showing an example of biometric information used for authentication by the authentication device according to the first embodiment of the present invention. FIG. 6 shows an example of a palm vein pattern of the subject 10.

FIG. 7 is a fourth diagram showing an example of biometric information used for authentication by the authentication device according to the first embodiment of the present invention. FIG. 7 shows an example of a vein pattern on the back of the hand of the target person 10.

FIG. 8 is a fifth diagram showing an example of biometric information used for authentication by the authentication device according to the first embodiment of the present invention. FIG. 8 shows an example of a vein pattern of the arm of the subject 10.

FIG. 9 is a sixth diagram showing an example of biometric information used for authentication by the authentication device according to the first embodiment of the present invention. FIG. 9 shows an example of the iris pattern of the target person 10. As shown in the example of FIG. 9, the resolution of recent cameras has become extremely high definition, and it is possible to cut out an iris pattern.

When the near-infrared light source 112 is used as the light source, the near-infrared camera 111 can capture an image including the vein pattern and the iris pattern illustrated in FIGS. 4 to 9. The near-infrared camera 111 captures an authentication image including at least one of the biometric information at the same time as the face image of the target person 10. As described above, the authentication unit 130 has a function of authenticating a face from the authentication image. The authentication unit 130 also extracts a vein pattern from the authentication image captured by the near-infrared camera 111 and compares the vein pattern with a vein pattern of an authorized person registered in the storage device 210 in advance, and the target person 10 It may have a function of performing the authentication process. The authentication unit 130 also extracts an iris pattern from the authentication image captured by the near-infrared camera 111 and compares the iris pattern with the iris pattern of an authorized person registered in the storage device 210 in advance, and the target person 10 It may have a function of performing the authentication process. The authentication unit 130 includes the subject's 10 face, throat vein pattern, cheek vein pattern, finger vein pattern, palm vein pattern, palm vein pattern, back vein pattern, arm vein pattern, and iris pattern. Among them, it is possible to perform authentication using a plurality of pieces of biometric information. For example, the authentication process may be performed using the face, one of the vein patterns, and the iris pattern. Alternatively, the authentication process may be performed using vein patterns of a plurality of sites. As a result, it is possible to improve the authentication accuracy as compared with the case where the authentication is performed only with the face. Further, upon authentication, the target person 10 may direct each part of the body toward the near-infrared camera 111 so that the face, the vein pattern of each part, and the iris pattern can be imaged, and the body is brought into contact with the sensors in the authentication process. Therefore, the subject 10 can maintain the cleanliness of the body. In addition, since a plurality of types of biometric information are used, it is more difficult than forging a single biometric information of, for example, a face or a vein. Therefore, it is effective as a countermeasure against impersonation by a third party. Furthermore, as illustrated in FIG. 9, when an authentication image is captured using near infrared light as a light source, authentication using an iris pattern is also possible. The authentication accuracy can be further improved by adding the authentication result of the iris pattern.

FIG. 10 is a diagram showing an example of a biometric gesture used for authentication by the authentication device according to the first embodiment of the present invention.
The near-infrared camera 111 that uses the near-infrared light source 112 as a light source can capture not only biological information but also a gesture of the finger of the target person 10. FIG. 10A is an example of a gesture in which the target person 10 expresses the number “2” by the number of fingers. FIG. 10B is an example of a gesture in which the target person 10 expresses the number “3” by the number of fingers. FIG. 10C is an example of a gesture in which the target person 10 expresses the number “4” by the number of fingers. As in these examples, when the target person 10 expresses a number by the gesture of the finger, the authentication unit 130 can recognize the number as the personal identification number in the authentication process. For example, when the target person 10 performs the finger gesture shown in FIGS. 10A to 10C in this order, the authentication unit 130 uses a known image from a plurality of authentication images obtained by capturing the situation. The personal identification number "234" is recognized by the processing technique. In addition, the authentication unit 130 compares the personal identification number “234” recognized from the authentication image captured by the near infrared camera 111 with the personal identification number registered in the storage device 210 in advance, and performs the authentication process of the target person 10. .. Also in the authentication by the personal identification number indicated by the finger gesture, the target person 10 may perform the finger gesture toward the near-infrared camera 111, and the non-contact with the authentication device is maintained to keep the body clean. be able to. Further, by using it in combination with an authentication process using biometric information such as face authentication, it is expected that the authentication accuracy is increased and the impersonation by a third party is prevented.

As illustrated in FIGS. 10A to 10C, the near-infrared camera 111 captures an image for authentication including a vein pattern of a finger or a palm at the same time as the gesture of the finger of the target person 10. be able to. The authentication unit 130 can use the authentication image to perform authentication processing that combines authentication using a vein pattern and authentication using a personal identification number. In this case, the target person 10 can perform the authentication based on the biometric information (vein pattern) and the password based on the finger gesture toward the near-infrared camera 111. Therefore, the target person 10 is troublesome. It is possible to improve security by performing two-factor authentication (or multi-factor authentication including other biometric information) that combines biometric information and information indicated by a biometric gesture, without feeling the effect.

The gesture performed by the target person 10 for authentication is not limited to the example in FIG. 10. The information indicated by the gesture of the target person 10 may be characters such as alphabets instead of numbers. Alternatively, the subject 10 may perform authentication by changing the shape of the fingers into a certain shape.

As described above, in the present embodiment, an authentication process using a plurality of types of biometric information, or a combination of authentication based on one or a plurality of types of biometric information and authentication based on information indicated by a biometric gesture is combined. By performing the authentication process described above, it is possible to improve the authentication accuracy and enhance the security. If this authentication process is successful, the control unit 120 may unlock the electric lock 310 and control so that the target person 10 can pass through the door 300, but the authentication unit 130 further controls the target person 10 to the door 300. The control unit 120 may be configured to recognize the pointing gesture and control the electric lock 310 based on the pointing gesture.

FIG. 11 is a first diagram showing an example of a living body gesture for instructing unlocking and locking of a door according to the first embodiment of the present invention.
The near-infrared camera 111 using the near-infrared light source 112 as a light source can capture the facial expression of the target person 10. FIG. 11 is an image of a facial expression of the subject 10 with one eye closed. The authentication unit 130 can recognize that the subject 10 has closed his right eye from the image illustrated in FIG. 11 by a known image processing technique. By predetermining unlocking/locking according to the closed eyes, for example, the electric lock 310 can be opened when the right eye is closed, and the electric lock 310 can be locked when the left eye is closed. In this way, the target person 10 can instruct the opening/locking timing of the door 300 by facial expression.

FIG. 12 is a second diagram showing an example of a living body gesture for instructing the unlocking and locking of the door according to the first embodiment of the present invention.
12A to 12C are diagrams showing gestures for instructing unlocking/locking of the door 300. FIG. 12A is a gesture that means the start of an instruction gesture. When the target person 10 laterally moves the hand from the position shown in FIG. 12A to the position shown in FIG. 12B, the authentication unit 130 makes the gesture from a series of authentication images and range images. recognize. When the authentication unit 130 recognizes the gesture in which the target person 10 moves his or her hand in the lateral direction, the authentication unit 130 determines that the gesture is a signal to unlock, and instructs the control unit 120 to unlock the electric lock 310. Further, when the target person 10 moves, for example, from the position of the hand of FIG. 12B to the position of the hand shown in FIG. 12C, the authentication unit 130 recognizes the gesture and, for example, It is determined that the gesture is a signal for locking. While the target person 10 makes a gesture, the control unit 120 controls the light source switch 115 to switch between the near-infrared light source 112 and the near-infrared light source 113, and the near-infrared camera 111 makes the authentication image of a series of gestures. And a distance image. In the case of a gesture of moving the hand closer or further away as in this example, the authentication unit 130 accurately determines the gesture of the target person 10 by the distance image captured by the near infrared camera 111 using the near infrared light source 113 as a light source. Can be recognized.

As described with reference to FIGS. 11 and 12, in the present embodiment, the target person 10 controls the electric lock 310 based on the instruction gesture for the operation of the door 300 by the target person 10, so that the target person 10 opens the door 300. The lock/lock timing can be determined. The crime prevention system 1 of the present embodiment further detects the presence of a third party sneaking up behind the target person 10 to warn the person himself or makes a report in an emergency when the person is attacked. be able to.

FIG. 13 is an example of an image when detecting that the authentication target person is in an emergency according to the first embodiment of the present invention.
FIG. 13 is a diagram showing a state in which the target person 10 has a surprised expression. The authentication unit 130 can recognize that the target person 10 has a surprised expression by detecting that the target person 10 opens his/her eyes or mouth using a known face recognition technique. The authentication unit 130 may determine that the subject is in an emergency when the subject 10 has a surprised expression or a feared expression, and the control unit 120 may control the notification device 200 to issue an emergency alert. .. In addition, for example, when it is detected that a third party has blocked his/her mouth, it may be controlled to notify an emergency call.

Further, although not shown, when a third party is hidden behind, the authentication unit 130 detects a vein pattern of a face or hand that is not registered in the storage device 210, and detects that the third party is behind. It is possible to detect. In that case, the control unit 120 can notify the presence of a suspicious person to the target person 10 by, for example, turning on an alarm lamp 140 installed beside the camera.
In addition, the biometric information of the suspicious individual is registered in the storage device 210 in advance, and the authentication unit 130 compares the biometric information included in the authentication image with the biometric information of the criminal to detect the presence of the criminal. Is also possible.
In addition, if there is a suspicious third party or if a third party threatens you to unlock it, use a pre-registered emergency gesture such as intentionally covering your face with your hand. It is possible to control such as locking the electric lock 310 and causing the notification device 200 to make a notification by a method unknown to a third party.

Note that it is also possible to help the crime prevention by recording in the storage device 210 the information notified through the notification device 200 in an emergency and the image showing the emergency situation captured by the near infrared camera 111.

Next, the processing flow of the authentication process, the unlocking/locking control of the electric lock 310, and the notification control when a third party is detected according to the present embodiment will be described.
FIG. 14 is a flowchart showing an example of the authentication processing according to the first embodiment of the present invention.
In the storage device 210, a gesture (for example, a gesture in which the person holds one hand beside his/her face) that is a condition for starting the authentication processing of the person shown in the authentication image, biometric information of the target person 10 used for authentication, It is assumed that the personal identification number used for authentication, the electric lock 310 of the target person 10, and the instruction gesture for the operation of the notification device 200 are recorded in advance.
First, the target person 10 stands in front of the near-infrared camera 111 and holds one hand beside his/her face. The near-infrared camera 111 images the target person 10 based on the image capturing instruction from the control unit 120. At this time, the control unit 120 uses the light source switch 115 to switch the light source of the near infrared camera 111 between the near infrared light source 112 and the near infrared light source 113. The near infrared camera 111 captures the authentication image and the distance image of the target person 10 (step S100). The control unit 120 acquires the authentication image and the distance image captured by the near infrared camera 111 and outputs them to the authentication unit 130. Also in the subsequent processing, the near-infrared camera 111 continues to output the image for authentication and the distance image to the control unit 120, for example, at predetermined time intervals.

Next, the authentication unit 130 executes image processing of the authentication image and the distance image based on the instruction of the control unit 120 (step S110). Next, the authentication unit 130 detects the authentication start gesture of the target person 10 by performing image processing on the authentication image (step S120). For example, the authentication unit 130 recognizes that the subject 10 holds one hand beside his/her face using the acquired authentication image and distance image. The authentication unit 130 determines to start the authentication of the target person 10 by this gesture.

Next, the authentication unit 130 executes an authentication process (step S130). At this time, the authentication unit 130 performs authentication by at least one biometric information and gesture by inputting a personal identification number by face authentication and finger gesture. Authentication processing is performed in combination with authentication. For example, the authentication unit 130 collates the face image of the target person 10 shown in the authentication image with a plurality of face images registered in the storage device 210, and the face image of the authorized person registered in the storage device 210 It is determined whether or not the face image of the target person 10 exists therein. Further, for example, the target person 10 holds one hand beside the face and then inputs the personal identification number by the gesture of the finger as illustrated in FIG. 10. The authentication unit 130 recognizes the personal identification number input by the subject 10 by performing image processing on the authentication image. The authentication unit 130 determines whether the recognized personal identification number and the personal identification number of the person who can be compared with the face image match. When the authentication by the face image and the authentication by the personal identification number are successful, the authentication unit 130 determines that the authentication is successful. If not, the authentication unit 130 determines that the authentication has failed. The authentication unit 130 outputs the authentication result to the control unit 120.

The method of authenticating the target person 10 is not limited to face identification and a personal identification number by gesture. For example, in addition to these, authentication may be performed by the vein pattern of the finger or palm of the target person 10 included in the authentication image captured when the target person 10 raises one hand or inputs the personal identification number. By increasing the types of biometric information, it is possible to improve authentication accuracy and enhance security. When a plurality of pieces of biometric information are used, even if the authentication by any one of them fails, the authentication may be determined to be successful if the authentication by another piece of biometric information succeeds. For example, when authentication is performed using the vein pattern of the face and fingers, the vein pattern of the palm, and the PIN, even if the authentication using the vein pattern of the finger fails, the authentication using the vein pattern of the face and palm and the PIN may succeed. If the authentication is successful, it is determined. For example, if a PIN is entered using the gesture of the finger and authentication is performed using the vein pattern of the finger in the image captured at that time, the vein pattern of the finger may not be properly captured depending on the angle at which the finger is captured and the bending condition of the finger. There is. Even in such a case, if it can be determined that the authentication is successful based on the other biometric information and the personal identification number, the door 300 can be passed without performing the authentication again, and thus the convenience of the target person 10 can be secured. In addition, if authentication is performed using multiple types of biometric information as in the above example, even when there is a situation such as an injury and wrapping a bag on a finger, the vein pattern of the face and palm is obtained. Can be authenticated by Even in that case, since authentication is performed using one or a plurality of biometric information and a personal identification number, sufficient security can be maintained. Further, in this authentication process, the target person 10 does not bring his or her finger into contact with the sensors, so that the target person 10 can easily perform authentication while maintaining a clean feeling.
It is also possible to use an iris pattern as the biometric information. Further, instead of inputting the personal identification number by the gesture, the gesture itself of the target person 10 (for example, the shape expressed by the hand or finger of the target person 10, the facial expression of the target person 10 blinking a predetermined number of times, etc.) ), the authentication process can be performed.
Further, the authentication unit 130 may perform authentication using a plurality of biometric information such as face authentication, throat and cheek vein pattern authentication, and iris pattern authentication, without performing gesture authentication.

Next, the control unit 120 controls unlocking/locking of the electric lock 310 based on the authentication result of the authentication unit 130. When the authentication fails (step S140; No), the control unit 120 notifies the authentication failure by, for example, blinking the alarm lamp 140 (step S150). Then, this processing flow ends. Alternatively, the authentication process may be retried a predetermined number of times. When the authentication is successful (step S140; Yes), the authentication unit 130 determines whether or not a third party exists near the target person 10 (step S160). Here, the third party means a person who is not authorized to pass through the door 300. The authentication unit 130 acquires the authentication image and the distance image captured by the near infrared camera 111 via the control unit 120. The authentication unit 130 performs image authentication on the authentication image and determines whether a person other than the target person 10 is included in the authentication image. For example, the authentication unit 130 cuts out a vein pattern and an iris pattern of each part such as the face or hand of a person other than the target person 10 from the authentication image. When the image including the biometric information can be cut out, the authentication unit 130 collates with the image of the corresponding biometric information registered in the storage device 210. At this time, the authentication unit 130 appropriately corrects the size of the face or vein pattern using the distance image. If the collation is successful, the authentication unit 130 determines that the person displayed in the authentication image is the person who has the authority to pass through the door 300. If the collation is not possible, the authentication unit 130 determines that the person in the authentication image is a third party who does not have the authority to pass through the door 300.

When it is determined that the third party exists (step S160; Yes), the authentication unit 130 instructs the control unit 120 to notify the subject 10 of a warning prompting caution. The control unit 120 turns on the alarm lamp 140 and gives a warning (step S190). For example, the target person 10 determines whether or not the person near him is a suspicious person by looking at the lighting display of the alarm lamp 140. For example, in the case of a person who intentionally allows the door 300 to pass through, such as when a customer is invited from the outside, the third party may pass through the door 300 together with the target person 10. In this case, the target person 10 makes an instruction gesture to unlock the electric lock 310. However, if an unintentional suspicious person is present near you, it is not appropriate to let the suspicious person pass by. In that case, the target person 10 makes an instruction gesture to lock the electric lock 310, and the authentication unit 130 detects the instruction gesture (step S200). For example, the target person 10 closes one eye. Then, the near-infrared camera 111 images the situation, and the authentication unit 130 recognizes the pointing gesture of the target person 10 from the authentication image captured by the near-infrared camera 111. The authentication unit 130 compares the recognized instruction gesture with a predetermined instruction gesture for instructing the unlocking or locking of the electric lock 310. The authentication unit 130 outputs an unlocking or locking instruction signal indicated by the detected instruction gesture to the control unit 120. Next, the control unit 120 unlocks or locks the electric lock 310 based on the acquired instruction signal. Further, the target person 10 may perform an instruction gesture instructing the notification device 200 to make an emergency call. When the authentication unit 130 recognizes the instruction gesture, the control unit 120 controls the notification device 200 to make an emergency call.

When it is determined that the third party does not exist (step S160; No), the control unit 120 notifies the subject 10 that the authentication has succeeded, for example, by blinking the alarm lamp 140. The target person 10 makes an instruction gesture to unlock the electric lock 310 by looking at this display, and the authentication unit 130 detects the instruction gesture (step S170). The authentication unit 130 outputs information indicating the detected instruction gesture to the control unit 120. The control unit 120 unlocks the electric lock 310 based on the acquired information (step S180). This allows the subject 10 to pass through the door 300.

FIG. 15 is a flowchart showing an example of the notification process in the first embodiment of the present invention.
A flow of processing when an emergency occurs in the target person 10 will be described with reference to FIG. In FIG. 14, for example, a case will be described as an example where the target person 10 is determined to be in an emergency situation instead of step S160. Since steps S100 to S140 are the same as those in FIG. 14, description thereof will be omitted. When the authentication is successful (step S140; Yes), the authentication unit 130 determines whether the target person 10 has an emergency (step S163). For example, when the subject 10 recognizes that the subject 10 has a surprised or feared expression by performing image processing on the authentication image, the authentication unit 130 determines that the subject 10 has an emergency. Alternatively, when the authentication unit 130 recognizes the situation in which the subject 10 is attacked from behind or the mouth is blocked, the authentication unit 130 determines that the subject 10 is in an emergency. In that case (step S163; Yes), the authentication unit 130 notifies the control unit 120 that the target person 10 should be notified. The control unit 120 causes the reporting device 200 to make an emergency call (step S213). Alternatively, the notification device 200 may emit a warning sound that repels a suspicious person. Thereby, even if the target person 10 is attacked, the situation can be promptly notified to the outside. At this time, the control unit 120 may lock the electric lock 310 in addition to causing the notification device 200 to make an emergency call. Further, the control unit 120 may record the authentication image when the target person 10 is attacked, the record information of the emergency call, and the like in the storage device 210.

When it is determined that the target person 10 has no emergency situation (step S163; No), the processing is the same as the processing after step S170 in FIG. It is also possible to further perform these processes in parallel with this process in step S160 of FIG.

Generally, biometric authentication has a risk of spoofing due to forgery of biometric information. For example, face authentication may be spoofed by a delicate mask such as silicone rubber to gain malicious access. For fingerprint authentication, a forgery method using clay or resin is known, and an example of forgery from a residual fingerprint left on a cup or the like has also been reported. In addition, vein pattern authentication may also be spoofed by imaging and copying with a near infrared camera. However, in the present embodiment, in addition to the authentication based on the biometric information, the authentication based on the personal identification number input by the gesture of the finger is performed. Therefore, even if the biometric information is forged, the security is not broken only by the forgery. Further, in the present embodiment, a plurality of biometric information can be obtained from one image captured by one near infrared camera 111. For example, when a face is imaged, a vein pattern of the throat or cheeks and an iris pattern may be obtained in addition to the face. Alternatively, when an authentication start gesture (holding one hand near the face) is performed, the face, vein patterns of fingers or palms, and iris pattern may be obtained at one time. In the present embodiment, by utilizing this, it is possible to efficiently perform authentication using a plurality of independent biometric information. If the authentication is performed using a plurality of pieces of biometric information, it is possible to further reduce the possibility of impersonation due to forgery of biometric information.

In the case of authentication using only one piece of biometric information, the biometric authentication may not be possible due to an injury or the like. In general, another authentication means is often prepared in preparation for such a case. For example, when a personal identification number is input by means of a numeric keypad as an alternative means, this authentication means loses contactlessness and ease of operation and requires a numeric keypad operation panel for inputting the personal identification number. In that case, there is a restriction such as a place for installing the operation panel. According to the present embodiment, since it is possible to use authentication by a plurality of biometric information and authentication by a gesture, even if one biometric information cannot be used, such a situation is assumed in advance and used for authentication. It is not necessary to prepare an additional device as long as it is configured so that it can be authenticated only by other biometric information or gesture that can be performed (can be cut out from the authentication image).

Further, the conventional authentication device does not have a function for a situation where a third party sneaking up from behind is pushed in at the moment of unlocking or is threatened to unlock. According to the present embodiment, it is possible to recognize an emergency situation as described above by image processing, display a warning, and issue a warning.

As described above, according to the present embodiment, it is possible to improve the accuracy of biometric authentication while maintaining the advantage of non-contact such as ensuring the cleanliness of face authentication by using other biometric characteristics of the face, and forge biometric characteristics It can make spoofing difficult. Further, by recognizing the gesture, the user can control the timing of unlocking and locking the door instead of the button while maintaining non-contact. In addition, a security function is provided by detecting the presence of a third party and alerting when the person does not notice it, and notifying the third party of the emergency call as necessary, or sounding a warning sound to repel him. Can be realized. Thereby, the target person 10 can be protected from crime. In addition, in the present embodiment, it is possible to perform authentication using a plurality of types of biometric information and gestures with only a single camera and the authentication unit 130.

<Second embodiment>
An example of the crime prevention system according to the second embodiment of the present invention will be described below with reference to FIGS. 16 to 17.
In addition to the functions of the first embodiment, the second embodiment has a function of detecting the fingerprint of the target person 10 and a function of performing fingerprint authentication.
FIG. 16 is a block diagram of the crime prevention system according to the first embodiment of the present invention.
Note that, of the configurations according to the second embodiment of the present invention, the same parts as the functional units and various devices constituting the crime prevention system according to the first embodiment of the present invention are designated by the same reference numerals, Description of each is omitted.

The security system 2 in this figure includes an authentication device 100, a notification device 200, a storage device 210, a door 300, and an electric lock 310. The authentication device 100 includes a near infrared camera 111, a near infrared light source 112, a near infrared light source 113, a pattern filter 114, a light source switch 115, a control unit 120, an authentication unit 130, and an alarm lamp 140. It has a fingerprint scanner 150 and an emergency switch 160.
The fingerprint scanner 150 detects the fingerprint of the target person 10 and outputs the detected fingerprint information to the control unit 120. The authentication unit 130 performs fingerprint authentication by comparing the fingerprint information with the fingerprint information registered in the storage device 210.
The emergency switch 160 is a hidden switch provided for an emergency. The emergency switch 160 is provided in an inconspicuous place, and when the target person 10 presses the emergency switch 160 in an emergency, the notification device 200 operates to notify the emergency call.

FIG. 17 is a flowchart showing an example of the authentication processing according to the second embodiment of the present invention.
Next, the flow of the authentication process of the second embodiment, unlocking/locking control of the electric lock 310, and notification processing when a third party is detected will be described with reference to FIG. Processing similar to that of the first embodiment will be briefly described.
First, the target person 10 stands in front of the near-infrared camera 111 and performs an authentication start gesture. The near-infrared camera 111 captures the authentication image and the distance image of the target person 10 (step S100).
Next, the authentication unit 130 executes image processing of the authentication image and the distance image (step S110). Next, the authentication unit 130 detects the authentication start gesture of the target person 10 by performing image processing on the authentication image (step S120). The authentication unit 130 determines to start the authentication of the target person 10 by this gesture. The target person 10 subsequently inputs a personal identification number by a gesture of a finger and directs the near-infrared camera 111 to image a vein pattern of a finger, a palm, an arm, or the like. The biometric information necessary for the authentication is predetermined, and the near-infrared camera 111 captures an authentication image including the biometric information necessary for the authentication process.

Next, the authentication unit 130 determines whether to detect a fingerprint (step S123). For example, the authentication unit 130 cuts out biometric information necessary for authentication from the authentication image. When all the biometric information necessary for authentication can be cut out, the authentication unit 130 determines that fingerprint detection is unnecessary. Further, when necessary biometric information cannot be cut out due to an injury or the like, the authentication unit 130 determines that fingerprint detection is necessary. When it is determined that the fingerprint detection is unnecessary (step 123; No), the process proceeds to step S131 described later. When it is determined that the fingerprint needs to be detected (step 123; Yes), the authentication unit 130 outputs a signal indicating that the fingerprint authentication is necessary to the control unit 120. The control unit 120 displays, for example, on a display unit included in the fingerprint scanner 150 (for example, turns on a lamp), and prompts the subject 10 to perform fingerprint authentication. The target person 10 places his/her finger on the fingerprint scanner 150, and the fingerprint scanner 150 acquires the fingerprint information of the target person 10 (step S125). The fingerprint scanner 150 outputs the acquired fingerprint information to the control unit 120. Next, the authentication unit 130 executes an authentication process (step S131). The authentication unit 130 acquires the authentication image and the target image captured by the near-infrared camera 111 from the control unit 120. The authentication unit 130 collates the image including the biometric information such as the cut-out face, the vein pattern of each part, and the iris pattern with the image including the corresponding biometric information registered in the storage device 210. When the fingerprint information is acquired in step S125, the authentication unit 130 acquires the fingerprint information from the control unit 120 and compares it with the fingerprint information registered in the storage device 210. The authentication unit 130 authenticates whether the target person 10 has the right to pass through the door 300 based on these collation results. For example, the authentication unit 130 determines that the authentication is successful when all of the verification by one or more biometric information, the verification by the fingerprint, and the verification by the personal identification number input by the gesture are successful. Alternatively, the authentication unit 130 may determine that the authentication has succeeded if one or more of the biometric information and the fingerprint are successfully collated, and if the collation by the personal identification number is successful. Alternatively, the authentication unit 130 may determine that the authentication has succeeded when one or more of the biometric information collation and the fingerprint collation have succeeded and the collation with the personal identification number has succeeded. As described above, in the present embodiment, by adding the fingerprint authentication as an option, it is possible to perform flexible authentication according to the change of the situation (for example, the situation in which the biometric information cannot be collected), and the security can be enhanced.

Next, the control unit 120 controls unlocking/locking of the electric lock 310 based on the authentication result of the authentication unit 130. When the authentication fails (step S140; No), the control unit 120 notifies the authentication failure by, for example, blinking the alarm lamp 140 (step S150). Then, this processing flow ends. When the authentication is successful (step S140; Yes), the authentication unit 130 determines whether or not a third party exists near the target person 10 (step S160). The authentication unit 130 performs image processing on the authentication image and determines whether a person other than the target person 10 is included in the authentication image.

When it is determined that the third party exists (step S160; Yes), the authentication unit 130 instructs the control unit 120 to notify the target person 10 of a warning. The control unit 120 turns on the alarm lamp 140 and displays a warning (step S190). In response to this warning display, the target person 10 gives an operation instruction to the electric lock 310 and the notification device 200 by using the fingerprint scanner 150. For example, the target person 10 previously stores in the storage device 210 fingerprint information of a finger that instructs unlocking of the electric lock 310 (for example, the index finger), a finger that instructs locking (for example, the middle finger), and a finger that makes an emergency call (for example, the ring finger). Register in advance. Then, the target person 10 places the index finger on the fingerprint scanner 150 when the third party is not a suspicious person. In addition, the target person 10 places the middle finger on the fingerprint scanner 150 when the person is unknown to the third party, and places the ring finger on the fingerprint scanner 150 when the person is obviously suspicious. The authentication unit 130 identifies the placed finger (step S203). Specifically, the authentication unit 130 compares the fingerprint information acquired by the fingerprint scanner 150 with the fingerprint information registered in advance for the target person 10, and recognizes the finger placed on the fingerprint scanner 150 by the target person 10. The authentication unit 130 outputs the operation content for the electric lock 310 or the notification device 200 corresponding to the recognized finger to the control unit 120. The control unit 120 controls the electric lock 310 and the notification device 200 based on the operation content indicated by the identified finger (step S215). For example, the control unit 120 unlocks/locks the electric lock 310 or makes an emergency call by the notification device 200 according to the operation content acquired from the authentication unit 130.
Further, in a situation where a robbery attack or the like is likely to break into the room, and the finger pointing gesture is not enough in time, the emergency switch 160 is strongly pressed and the control unit 120 activates the notification device 200 to perform an emergency. You may report the situation.

The process when it is determined that the third party does not exist (step S160; No) is the same as that in FIG.

According to this embodiment, in addition to the effects of the first embodiment, security can be improved by using the fingerprint scanner 150. In addition, when priority is given to ensuring contactless cleanliness and convenience, it is possible to use the fingerprint scanner 150 as an emergency and not normally use it. Further, by providing the emergency switch 160, an emergency call can be made more reliably in an emergency.

The crime prevention systems 1 and 2 of the first and second embodiments can be used, for example, for entry/exit management of a server room. It can also be applied to opening and closing.

The authentication device 100 described above has a computer inside. The process of each process of the authentication device 100 described above is stored in a computer-readable recording medium in the form of a program, and the above process is performed by the computer reading and executing the program. Here, the computer-readable recording medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Further, the computer program may be distributed to the computer via a communication line, and the computer that receives the distribution may execute the program.
Further, the program may be for realizing a part of the functions described above. Further, it may be a so-called difference file (difference program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

In addition, it is possible to appropriately replace the constituent elements in the above-described embodiments with known constituent elements without departing from the spirit of the present invention. Further, the technical scope of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the present invention. The target person 10 is an example of a living body.

The whole or part of the exemplary embodiments disclosed above can be described as, but not limited to, the following supplementary notes.

(Supplementary Note 1) An image capturing unit that captures an image of a living body to be authenticated,
Authentication of the living body is performed based on one or a plurality of living body information of the living body included in the image captured by the imaging unit and information indicated by the gesture of the living body included in the image captured by the imaging unit. The authentication department to do,
An authentication device having.

(Supplementary Note 2) The biological information is at least one of a face, a vein pattern, a fingerprint, and an iris pattern of the biological body,
The authentication unit performs authentication by matching biometric information included in the image captured by the image capturing unit with an image including biometric information corresponding to the biometric information captured in advance,
The authentication device according to attachment 1.

(Supplementary Note 3) The information indicated by the gesture of the living body included in the image is one or more numbers,
The authentication unit compares the one or more numbers with a predetermined number to perform authentication.
The authentication device according to appendix 1 or 2.

(Supplementary Note 4) The character has a shape shown by the gesture of the finger by the living body,
The authentication unit performs authentication by the one or more shapes.
The authentication device according to attachment 3.

(Supplementary note 5) A control unit that controls the operation of a device connected to the device itself.
Further equipped with,
When the result of the authentication by the authentication unit is successful, the authentication unit determines whether the device by the living body is based on at least one of the expression shown by the facial image of the living body and the information shown by the gesture of the living body. Recognizing the operation content to instruct, the control unit controls the device based on the operation content,
The authentication device according to any one of appendices 1 to 4.

(Supplementary Note 6) The device is a warning device for giving a warning to the living body to be authenticated,
When the authentication unit recognizes a living body that fails in authentication other than the living body to be authenticated during the authentication process,
The control unit controls to perform warning notification to the warning device,
The authentication device according to attachment 5.

(Supplementary Note 7) The device is a reporting device,
When the authentication unit recognizes a living body that fails in the authentication other than the living body to be authenticated,
The control unit controls the notification device to perform a notification operation based on the gesture of the living body,
The authentication device according to appendix 5 or appendix 6.

(Supplementary Note 8) The device is a reporting device,
When the authentication unit recognizes that an emergency has occurred in the living body to be authenticated,
The control unit controls the notification device to perform a notification operation,
The authentication device according to any one of appendices 5 to 7.

(Supplementary Note 9) The device is a reporting device,
The authentication unit recognizes, based on at least one of the expression indicated by the face image of the living body and the information indicated by the gesture of the living body, whether the information is information for instructing the notification device to perform a notification operation, and the control unit Controls the notification device to perform a notification operation based on the recognition of the authentication unit,
The authentication device according to any one of appendices 5 to 8.

(Supplementary Note 10) The device is a control device that controls unlocking/locking of a door through which the living body passes, and the authentication unit includes an expression represented by the facial image of the living body and information represented by the gesture of the living body. Based on at least one of the above, it is recognized whether the information is an instruction to unlock or lock the door, and the control unit controls the unlocking or locking of the door based on the recognition of the authentication unit. ,
The authentication device according to any one of appendices 5 to 9.

(Supplementary Note 11) The imaging unit captures a distance image including information on a distance to the living body in addition to the image of the living body,
The authentication unit performs image processing on an image captured by the imaging unit using the distance image,
The authentication device according to any one of appendices 1 to 10.

(Supplementary Note 12) A fingerprint detection unit that detects a fingerprint of a living body to be authenticated,
Further equipped with,
The authentication unit performs authentication using a fingerprint in addition to the biometric information and information indicated by the biometric gesture.
The authentication device according to any one of appendices 1 to 11.

(Supplementary Note 13) When the authentication unit recognizes the living body to be authenticated and a living body other than the living body, the authentication unit further requests authentication by the fingerprint detected by the fingerprint detection unit,
The authentication device according to attachment 12.

(Supplementary Note 14) The authentication unit specifies a part of the living body to be the authentication target corresponding to the fingerprint detected by the fingerprint detection unit,
The control unit controls the operation of the device connected to the own device by a predetermined control method in association with the site specified by the authentication unit,
The authentication device according to supplementary note 11 or supplementary note 12.

(Supplementary Note 15) An image capturing unit for capturing an image of a living body to be authenticated,
The face of the living body imaged by the imaging unit, the throat vein pattern of the living body, the cheek vein pattern of the living body, the finger vein pattern of the living body, the palm vein pattern of the living body, and the back of the hand. A vein pattern, an arm vein pattern, and an iris pattern of the living body, an authentication unit that performs authentication using a plurality of biological information,
An authentication device having.

(Supplementary Note 16) The image pickup unit includes one camera,
The authentication device according to any one of appendices 1 to 15.

(Supplementary note 17) The authentication device according to any one of supplementary notes 1 to 16,
A reporting device,
Have
The notification device makes a notification based on an instruction from the authentication device,
Security system.

(Supplementary Note 18) The notification device has an emergency button,
The notification device makes a notification when the emergency button is operated,
The security system according to attachment 17.

(Supplementary Note 19) An image of a living body to be authenticated is captured,
Performing authentication on the living body based on one or more biological information of the living body included in the captured image and information indicated by the gesture of the living body included in the captured image,
Authentication method.

(Supplementary note 20) The computer of the authentication device is
Means for acquiring an image of a living body to be authenticated,
Means for authenticating the living body based on one or more living body information of the living body included in the captured image and information indicated by the gesture of the living body included in the captured image,
Program to function as.

1, 2... Security system 100... Authentication device 111... Near infrared cameras 112, 113... Near infrared light source 114... Pattern filter 115... Light source switch 120... Control unit 130... Authentication unit 140... Warning lamp 150... Fingerprint scanner 160... Emergency switch 200... Notification device 210... Storage device 300... Door 310... Electric lock

Claims (10)

An image pickup means for picking up an image of the person to be authenticated,
An authentication unit that detects an authentication start gesture by the authentication target person, and authenticates the authentication target person based on one or more biometric information included in one or more images acquired by the imaging unit;
A control means for controlling the operation of the notification device connected to the own device,
The authentication means, when the authentication is successful, determines whether or not a third party exists near the person to be authenticated based on the image,
When the third party exists, the authentication means identifies the finger placed on the fingerprint scanner,
If the third party does not exist, the authentication unit recognizes the pointing gesture, and the control unit executes control according to the recognized pointing gesture. Further comprising alarm control means for controlling the operation of the alarm device connected to its own device,
When the authentication means determines that a third party exists near the person to be authenticated based on the image,
The authentication device according to claim 1, wherein the alarm control unit operates the alarm device. The one or more biometric information is at least one of the face of the authentication target person, a vein pattern, and an iris pattern,
The authentication device according to claim 1 or 2. An authentication device according to any one of claims 1 to 3,
A reporting device,
Have
The notification device makes a notification based on an instruction from the authentication device,
Security system. An authentication start gesture by the authentication target person is detected, and the authentication target person is authenticated based on one or a plurality of biometric information included in one or a plurality of images acquired by the imaging means,
Controls the operation of the reporting device connected to its own device,
If the authentication of the authentication target person is successful, it is determined whether or not a third party exists near the authentication target person based on the image,
When the third party is present, while identifying the finger placed on the fingerprint scanner,
If the third party does not exist, the pointing gesture is recognized, and control according to the recognized pointing gesture is executed.
A control method by an authentication device including the following. Controls the operation of the alarm device connected to its own device,
Based on the image, when it is determined that a third party exists near the person to be authenticated,
Operating the alarm device,
A control method by the authentication device according to claim 5. The one or more biometric information is at least one of the face of the authentication target person, a vein pattern, and an iris pattern,
A control method by the authentication device according to claim 5. Detecting an authentication start gesture by the authentication target person, based on one or more biometric information included in one or more images acquired by the imaging means, and performing authentication of the authentication target person,
Controlling the operation of the reporting device connected to the device itself,
When the authentication of the authentication target person is successful, it is determined whether a third party exists near the authentication target person based on the image,
When the third party is present, while identifying the finger placed on the fingerprint scanner,
When the third party does not exist, recognizing a pointing gesture, and performing control according to the recognized pointing gesture;
A program that causes a computer to execute. Controls the operation of the alarm device connected to its own device,
Based on the image, when it is determined that a third party exists near the person to be authenticated,
Operating the alarm device,
The program according to claim 8. The one or more biometric information is at least one of the face of the authentication target person, a vein pattern, and an iris pattern,
The program according to claim 8 or 9.

Images