JP7440772B2 - Authentication system - Google Patents

Description

The present invention relates to an authentication system using face authentication.

BACKGROUND ART Conventionally, as an authentication system using face authentication, for example, a face authentication gate device disclosed in Patent Document 1 below is known. This facial recognition gate device compares the facial image of the person to be authenticated obtained from the IC chip embedded in the passport with the facial image obtained by capturing the person holding the passport with a camera. Identity verification is performed based on the processing results. In particular, four face recognition cameras are installed at different heights to obtain facial images of the person to be recognized, and by expanding the imaging range of these four face recognition cameras, it is possible to It is now possible to capture not only a face image of a short person or a tall person, but also a face image of a person using a wheelchair.

Japanese Patent Application Publication No. 2018-109935

However, with the configuration of the facial recognition gate device as described above, depending on the user's body shape and the shape of the wheelchair in which the user sits, the user's face may be outside the imaging range, and the face image that can be authenticated may be Since it takes time for the image to be captured, the usability of the system may decrease. In particular, if the number of cameras for face authentication is increased in order to reduce the possibility that the user's face will be out of the imaging range, there is a problem that control becomes complicated and the cost of introducing the system increases.

Furthermore, if the imaging range is widened by using a plurality of cameras as described above, there is a problem in that it takes time to search the captured image for an area where the user's face is captured. Furthermore, while each camera has its own imaging range that is suitable for capturing facial recognition images, users cannot recognize which camera is suitable for capturing their own facial recognition images, so users may choose cameras that are not suitable for capturing facial recognition images. If an image that is difficult to use for face recognition is captured because the user turns his/her face toward the person, there is a problem in that the accuracy of face recognition decreases.

The present invention has been made to solve the above-mentioned problems, and its purpose is to provide a configuration that can perform authentication processing using a face image suitable for face authentication. .

In order to achieve the above object, the invention described in claim 1 of the claims is as follows:
a mobile terminal (10) carried by a user (M);
an information code (C) in which unique information that can identify the user is recorded;
an authentication device (20) that authenticates the user;
An authentication system (1) comprising:
The mobile terminal is
a terminal-side imaging unit (13) capable of capturing an image of the user's face;
a transmitting unit (16) capable of transmitting authentication information obtained from the imaging result of the terminal-side imaging unit to the authentication device;
Equipped with
The authentication device includes:
a device-side imaging unit (24) capable of capturing an image of the user's face;
a reading unit (23) capable of optically reading the unique information of the information code;
a receiving unit (27) capable of receiving the authentication information transmitted from the mobile terminal;
an authentication unit (21) that performs authentication processing using a facial image of the user based on the unique information read by the reading unit;
Equipped with
The authentication unit performs the authentication process based on the authentication information and the unique information when the unique information is read by the reading unit and the authentication information is received by the receiving unit. , performing the authentication process based on the information obtained from the imaging result of the device-side imaging unit and the unique information when the authentication information is not received by the receiving unit;
The information code may record selection information for selecting which of the received authentication information and information obtained from the imaging result of the device-side imaging unit is to be used in the authentication process. It is characterized by
Note that the reference numerals in parentheses above indicate correspondence with specific means described in the embodiments described later.

In the first aspect of the present invention, the authentication information obtained from the imaging result of the terminal-side imaging unit of the mobile terminal carried by the user is transmitted to the authentication device by the transmitting unit. In the authentication unit of the authentication device, when the unique information is read from the information code by the reading unit and the authentication information is received by the receiving unit, authentication processing is performed based on the authentication information and the above-mentioned unique information. If the receiving unit does not receive the authentication information, the authentication process is performed based on the information obtained from the imaging result of the device-side imaging unit and the unique information.

As a result, when the authentication device receives authentication information from a mobile terminal, it performs authentication processing using the user's facial image based on this authentication information and the unique information read from the information code. be exposed. The above authentication information is obtained by the user taking an image of his or her own face with a mobile device, so it is possible to capture a facial image suitable for facial recognition regardless of the user's body shape or the shape of the wheelchair in which the user is sitting. This is the information that can be obtained when doing so. Therefore, since the authentication process can be performed using a face image suitable for face authentication, it is possible to improve the authentication accuracy and shorten the authentication process time.

In the invention of claim 2, since the unique information includes facial feature points extracted from the user's facial image, the authentication device that performs authentication processing using the facial feature points can perform authentication processing for all uses to be authenticated. This eliminates the need to obtain facial feature points of a person in advance.

In the third aspect of the present invention, the authentication information includes a facial image captured by the terminal-side imaging unit and from which facial feature points of the user can be extracted. Further, the authentication device is provided with a device-side extraction unit that extracts facial feature points from a facial image included in the authentication information when the authentication information is received by the reception unit. Then, in the authentication unit, when the unique information is read by the reading unit and the authentication information is received by the receiving unit, the facial feature points extracted by the device-side extraction unit and the facial features included in the unique information are Authentication processing is performed based on the points.

In this way, since facial feature points are extracted by the extraction unit on the device side from the facial image received by the receiving unit, there is no need to perform facial feature point extraction processing on the mobile terminal. ability can be reduced.

In the invention of claim 4, the authentication device includes an instruction section that instructs the mobile terminal to stop transmitting the authentication information when the extraction section on the device side succeeds in extracting the facial feature points. provided. Then, the transmitting section continues to transmit the authentication information to the authentication device until receiving an instruction to stop transmission from the instructing section.

Thereby, even when images captured by the mobile terminal are continuously transmitted until the authentication at the authentication section is successful, the transmission can be stopped at an appropriate timing.

In the invention of claim 5, the mobile terminal is provided with a terminal-side extraction unit that extracts facial feature points from the user's face image captured by the terminal-side imaging unit, and the face extracted by the terminal-side extraction unit is The transmitter transmits the authentication information to the authentication device so as to include the feature points. Then, in the authentication section, when the unique information is read by the reading section and the authentication information is received by the receiving section, the facial feature points included in the authentication information and the facial feature points included in the unique information are determined. Authentication processing is performed based on the following.

In this way, by including facial feature points in the authentication information sent to the authentication device, the facial image itself is not sent to the authentication device, which reduces the time required for transmission and reception between the mobile terminal and the authentication device. Data communication amount can be reduced. In particular, since facial images from which facial feature points cannot be extracted are not sent to the authentication device, the amount of data communication can be reduced in this respect as well.

In the invention of claim 1 , the information code records selection information for selecting whether to use the received authentication information or information obtained from the imaging result of the device-side imaging unit in the authentication process. be done.

As a result, when the unique information is read by the reading unit, the authentication unit performs authentication processing using information obtained from the imaging result of the device-side imaging unit, or receives authentication information from the mobile terminal. It can be easily determined whether to wait and perform authentication processing using the authentication information. Therefore, for example, since the device-side imaging unit does not perform imaging processing while waiting to receive authentication information from the mobile terminal, unnecessary processing can be eliminated.

In the invention according to claim 6 , when the selection information for selecting to use the received authentication information is read by the reading unit together with the unique information, the authentication unit is configured to read the selection information by the receiving unit before a predetermined time elapses from the reading. If the authentication information is not received, the authentication process is canceled.

Thereby, even if the information code is read by mistake, the authentication process is stopped according to the predetermined time, so that unnecessary authentication processes can be stopped early.

In the seventh aspect of the present invention, when the authentication device is located within a range where the transmission unit can transmit, the terminal-side imaging unit starts the imaging process for obtaining authentication information. This prevents images taken in advance from a location away from the authentication device from being sent to the authentication device, thereby preventing fraudulent acts such as forged facial images being sent to the authentication device. .

According to an eighth aspect of the invention, the apparatus further includes an entrance/exit control device that locks and unlocks an electric lock provided on the door in response to an authentication result obtained by the authentication process. Thereby, it is possible to realize an entrance/exit management device that can improve authentication accuracy and shorten authentication processing time.

FIG. 1 is an explanatory diagram schematically explaining an authentication system according to a first embodiment. FIG. 2 is a block diagram schematically showing the electrical configuration of the mobile terminal in FIG. 1. FIG. FIG. 2 is an explanatory diagram illustrating a part of the location where facial feature points are extracted from captured facial image data. FIG. 4(A) is an explanatory diagram illustrating a state in which the information code is displayed on the screen of the display unit of the mobile terminal, and FIG. 4(B) is an explanatory diagram illustrating a state in which the captured image of the imaging unit is displayed on the screen on the display unit. FIG. FIG. 2 is a block diagram schematically showing the electrical configuration of the authentication device in FIG. 1. FIG. FIG. 2 is a block diagram schematically showing the electrical configuration of the server in FIG. 1. FIG. 2 is a flowchart illustrating the flow of authentication information transmission processing performed by a mobile terminal in the first embodiment. 2 is a flowchart illustrating the flow of authentication processing performed by the authentication device in the first embodiment. It is a sequence diagram explaining the flow of authentication when using the information code in which the first selection information is recorded in the first embodiment. It is a sequence diagram explaining the flow of authentication when using the information code in which second selection information is recorded. 12 is a flowchart illustrating the flow of authentication information transmission processing performed by a mobile terminal in the second embodiment. It is a flowchart illustrating the flow of authentication processing performed by an authentication device in a 2nd embodiment. It is a sequence diagram explaining the flow of authentication when using the information code in which the first selection information is recorded in the second embodiment.

[First embodiment]
DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of an authentication system according to the present invention will be described below with reference to the drawings.
The authentication system 1 shown in FIG. 1 includes an authentication device 20 that authenticates the user M using a mobile terminal 10 carried by the user M, and a server 30 that manages the authentication history of the authentication device 20. It is configured as a system. In this embodiment, the authentication system 1 is adopted as an access control system that performs access control regarding a specific room where entry and exit is restricted, and is used in an authentication device 20 installed at the entrance to the specific room. When the authentication of the user M is successful, the user is allowed to enter the specific room. Specifically, an unlocking signal corresponding to successful authentication is sent from the authentication device 20 to the locking/unlocking control device 3 that controls locking/unlocking of the electric lock provided on the door 2 of the entrance/exit. When the lock is unlocked, entry to the specific room is permitted. Therefore, the authentication device 20 is configured to further have a function as an entry/exit management device.

The mobile terminal 10 carried by the user M is a portable information processing terminal used at the time of authentication, and is constituted by a smartphone or the like on which an authentication application program (hereinafter also referred to as an authentication application), which will be described later, is installed. be able to. As shown in FIG. 2, this mobile terminal 10 includes a control unit 11 consisting of a CPU, etc., a storage unit 12 consisting of a semiconductor memory such as ROM and RAM, an imaging unit 13 configured as a camera, and display contents by the control unit 11. A touch panel type display unit 14 is controlled, an operation unit 15 outputs signals to the control unit 11 in response to touch operations and key operations on the touch panel, a communication unit 16 for communicating with external devices such as an authentication device 20, etc. There is.

When the authentication application is installed, a predetermined identification number such as an employee number and facial feature points of the user M are recorded in the storage unit 12 as unique information that can identify the user M. Information code C etc. are prepared and stored. Note that in this embodiment, a QR code (registered trademark) is adopted as the information code C. In addition, in this embodiment, items such as the size, shape, outline, and arrangement position of facial organs such as eyes, eyebrows, nose, ears, and mouth are adopted as facial feature points used for personal authentication. ing. Then, in accordance with a known facial feature point extraction process for extracting facial feature points, for example, for the facial image data D acquired as illustrated in FIG. Data such as "cut length" and "D2: large mouth" are calculated and extracted as facial feature points.

In the mobile terminal 10 configured in this way, the authentication information transmission process performed by the control unit 11 by starting the authentication application when entering the specific room is illustrated in FIG. 4(A). After displaying the information code C stored in the storage unit 12 on the display unit 14, the user M transmits the user's own facial image captured by the imaging unit 13 to the authentication device 20. do. Note that in this embodiment, when the user's own face image is captured by the imaging unit 13, the imaging result is displayed on the screen on the display unit 14, as illustrated in FIG. 4(B). Thereby, a facial image whose facial feature points are likely to be extracted can be transmitted to the authentication device 20. Note that the imaging unit 13 may correspond to an example of a “terminal-side imaging unit”.

Next, the authentication device 20 will be explained using FIGS. 1 and 5.
The authentication device 20 is configured as a device that authenticates the user M using the mobile terminal 10, and as shown in FIGS. 1 and 5, the authentication device 20 includes a control section 21, a storage section 22, a code reader 23, It includes an imaging section 24, a display section 25, an operation section 26, a communication section 27, and the like. Note that in FIG. 1, the display unit 25 and the like of the authentication device 20 are omitted for convenience.

The control unit 21 is mainly configured with a microcomputer, and performs overall control of the authentication device 20 and various calculations, and functions to execute authentication processing, etc., which will be described later. The storage unit 22 is made up of a known storage medium such as ROM, RAM, HDD, and non-volatile memory, and has application programs, predetermined databases, etc. for executing authentication processing made available to the control unit 21 in advance. Stored.

The code reader 23 is a known information code reading device capable of optically reading information codes such as the information code C, and is disposed on a wall near the door 2. The code reader 23 includes an imaging unit that images the information code, a decoding unit that performs decoding processing on the code image of the information code captured by the imaging unit, and is controlled by the control unit 21 to obtain the decoded result. is configured to be output to the control section 21.

The imaging unit 24 is a camera equipped with a light-receiving sensor (for example, a C-MOS area sensor, a CCD area sensor, etc.), and is arranged so that the imaging range is the face of the person holding the information code over the code reader 23. has been done. The imaging unit 24 is configured to be controlled by the control unit 21 and output captured image data to the control unit 21.

The display section 25 is constituted by a known liquid crystal display panel or the like, and the display contents are controlled by the control section 21. The operation unit 26 is configured to output an operation signal according to an input operation to the control unit 21, and the control unit 21 receives this operation signal and performs processing according to the input operation. There is. The communication unit 27 is configured as a communication interface for performing data communication by wired communication or wireless communication with external devices such as the mobile terminal 10, the lock/unlock control device 3, and the server 30. They are configured to cooperate to perform communication processing.

In the authentication device 20 configured as described above, when a predetermined identification number to be authenticated is read by the code reader 23 in the authentication process performed by the control unit 21, a message is sent from the mobile terminal 10 via the communication unit 27. A matching process using facial feature points obtained from the information received by the camera (hereinafter also referred to as first matching process), and a matching process using facial feature points extracted from the image captured by the imaging unit 24 (hereinafter referred to as second matching process). (also referred to as processing) is performed. In particular, in the first matching process of this embodiment, facial feature points extracted from the received captured image are used.

Selection information recorded in the information code together with the identification number and the like is used to select the first verification process and the second verification process. Specifically, when selection information for selecting the first verification process (hereinafter also referred to as first selection information) is read by the code reader 23, the first verification process is selected and the second verification process is selected. When the selection information (hereinafter also referred to as second selection information) is read by the code reader 23, the second verification process is selected. In this embodiment, the first selection information is recorded in the information code C stored in the mobile terminal 10, and the information code is an information code printed on a paper medium such as an employee ID card and includes a predetermined identification number to be authenticated. Second selection information is recorded in the other recorded information code. Note that the control unit 21 that performs authentication processing corresponds to an example of an “authentication unit,” the code reader 23 corresponds to an example of a “reading unit,” and the imaging unit 24 corresponds to an example of a “device-side imaging unit.” Correspondingly, the communication section 27 can correspond to an example of a "receiving section."

Next, the server 30 will be explained using FIG. 6.
The server 30 is configured as a computer that manages authentication history and the like in the authentication device 20, and is communicably connected to the authentication device 20 via a network N such as an in-house LAN. As shown in FIG. 6, this server 30 includes a control section 31 that centrally controls the entire server 30, a storage section 32 consisting of ROM, RAM, HDD, etc., a display section 33 consisting of a liquid crystal monitor, etc., a mouse, a mouse, etc. It includes an operation section 34 configured with a keyboard or the like, a communication section 35 configured as a LAN interface, etc.

The storage unit 32 stores an authentication history database in which authentication success information, authentication failure information, etc. received from the authentication device 20 are sequentially stored. By analyzing this authentication history database, it is possible to understand the authentication history including the entry history and the like regarding the room where the authentication device 20 is installed.

Next, in the authentication system 1 configured as described above, when the user M carrying the mobile terminal 10 enters the specific room, an authentication information transmission process is performed by the control unit 11 of the mobile terminal 10. and the authentication process performed by the control unit 21 of the authentication device 20 will be explained with reference to the drawings.

When the user M carrying the mobile terminal 10 enters the above-mentioned specific room, when the authentication information transmission process is started in the control unit 11 by starting the authentication application, the process proceeds to step S101 in FIG. The information code display process shown in FIG. 4 is performed, and the information code C stored in the storage unit 12 is displayed on the screen on the display unit 14 (see FIG. 4(A)).

When the information code C displayed on the screen is held over the code reader 23 of the authentication device 20 and an imaging instruction is received from the paired authentication device 20 as described later (Yes in S103), the imaging unit 13 The camera becomes ready to take an image (S105: see FIG. 4(B)), and the data of the image taken by the imaging unit 13 is transmitted as authentication information to the authentication device 20 via the communication unit 16 (S107). That is, when the authentication device 20 is located within the range where the communication unit 16 can transmit, the imaging unit 13 performs imaging processing. The process of transmitting the captured image is continued until a transmission stop instruction is received from the authentication device 20 as described later (No in S109), and when the transmission stop instruction is received from the authentication device 20 (S109 is Yes). ), this authentication information sending process ends. Note that the communication unit 16 may correspond to an example of a “transmission unit” that can transmit authentication information (captured image data) to the authentication device 20.

In the authentication device 20, when the control unit 21 starts the authentication process, the decoding process shown in step S201 in FIG. 8 is performed, and the information code held over the code reader 23 is decoded. Ru. Subsequently, in the determination process of step S203, it is determined whether or not the predetermined identification number to be authenticated has been decoded. The processing from step S201 is repeated.

Then, when the information code C is held over the code reader 23 and the predetermined identification number, facial feature points, etc. to be authenticated are read (Yes in S203), the first selection information is determined in the determination process of step S205. A determination is made as to whether or not it has been read. Here, as described above, since the first selection information is recorded in the information code C together with the identification number, etc., the determination in step S205 is Yes.

Subsequently, an imaging instruction process in step S207 is performed, and a process for transmitting the imaging instruction to the paired mobile terminal 10 is performed. When the data of the captured image is received from the mobile terminal 10 via the communication unit 27 in response to the transmission of this imaging instruction (S209), the facial feature point extraction process shown in step S211 is performed, and the face is extracted from the received captured image. Processing is performed to extract feature points. Then, the determination of No in the determination process of step S213 is repeated until facial feature points are extracted in this extraction process. Note that the control unit 21 that performs the facial feature point extraction process may correspond to an example of a "device-side extraction unit."

If the extraction process of facial feature points from the received captured image is successful (Yes in S213), a transmission stop instruction is sent to the mobile terminal 10 (S215). Data transmission is aborted. Note that the control unit 21 that issues a transmission stop instruction may correspond to an example of an “instruction unit”.

Next, a first matching process shown in step S217 is performed to match the facial feature points extracted from the received captured image as described above and the facial feature points read from the information code C. If it is determined that the authentication is successful based on the comparison result (Yes in S219), an unlocking signal is transmitted to the locking/unlocking control device 3 (S231). Thereby, the user M can open the unlocked door 2 and enter the specific room. On the other hand, if it is determined that the authentication has failed based on the verification result (No in S219), the unlocking signal is not sent to the locking/unlocking control device 3, and the locked state by the locking/unlocking control device 3 is maintained.

That is, as shown in FIG. 9, the user M displays the information code C in which the predetermined identification number to be authenticated and the first selection information are recorded on the screen of the mobile terminal 10 (F101), and selects the information code. When holding up C (F103), the authentication device 20 reads the information code C (F105), and if it is determined to be an authentication target (F107), pairing is performed between the authentication device 20 and the mobile terminal 10. (F109). The mobile terminal 10 that has received the imaging instruction during this pairing becomes ready for imaging (F111), and the captured image is transmitted to the authentication device 20 (F113). The authentication device 20 extracts facial feature points from the received captured image (F115), performs a first matching process using the extraction results (F117), and when it is determined that the authentication is successful (F119), unlocks. A signal is transmitted and the door 2 becomes unlocked (F121).

Next, the authentication process performed by the control unit 21 of the authentication device 20 when entering the specific room using another information code printed on the employee ID card etc. will be explained with reference to FIG. do.
When the above-mentioned other information code is held over the code reader 23 and the predetermined identification number, facial feature points, etc. to be authenticated are read (Yes in S203 of FIG. 8), in the determination process of step S205, the A determination is made as to whether or not the 1 selection information has been read. Here, as described above, since the second selection information is recorded in the other information code together with the identification number, etc., the determination in step S205 is No.

In this case, the image capturing unit 24 becomes ready to capture an image (S221), and processing for extracting facial feature points from the image captured by the image capturing unit 24 is performed (S223). If the extraction process of facial feature points from the captured image by the imaging unit 24 is successful (Yes in S225), a second matching process shown in step S227 is performed, and the facial feature points extracted from the captured image by the imaging unit 24 and Processing is performed to match the facial feature points read from the information code C. If it is determined that the authentication is successful based on the comparison result (Yes in S229), an unlocking signal is sent to the locking/unlocking control device 3 (S231), and the unlocked door 2 is opened. You will be able to enter a specific room.

That is, as shown in FIG. 10, when another user holds up another information code in which a predetermined identification number and second selection information to be authenticated are recorded (F201), the authentication device 20 When the information code C is read (F203) and it is determined that the object is to be authenticated (F205), the authentication device 20 becomes ready to take an image (F207). Then, when another user turns his/her face toward the imaging unit 24, facial feature points are extracted from the image captured by the imaging unit 24 (F209), and a second matching process is performed using the extraction results (F211). If it is determined that the authentication is successful (F213), an unlocking signal is transmitted and the door 2 becomes unlocked (F215).

As described above, in the authentication system 1 according to the present embodiment, an image captured by the imaging unit 13 of the mobile terminal 10 carried by the user M is transmitted to the authentication device 20 as authentication information. In the authentication process performed by the control unit 21 of the authentication device 20, when the predetermined identification number and facial feature points (unique information) to be authenticated are read from the information code by the code reader 23, the image capturing unit 13 captures an image. When the image is received, a first matching process (authentication process) is performed based on the facial feature points extracted from the captured image and the facial feature points read from the information code, and when the captured image is not received, the captured image is A second verification process (authentication process) is performed based on the facial feature points extracted from the image captured by the unit 24 and the facial feature points read from the information code.

As a result, when the authentication device 20 receives a captured image from the mobile terminal 10, the user's face is determined based on the facial feature points extracted from the captured image and the facial feature points read from the information code. Authentication processing using images is performed. The received captured image is obtained by the user M capturing his or her own face with the mobile terminal 10, so it is suitable for facial recognition regardless of the body shape of the user M or the shape of the wheelchair in which the user M is sitting. This information is obtained when a face image is captured. Therefore, since the authentication process can be performed using a face image suitable for face authentication, it is possible to improve the authentication accuracy and shorten the authentication process time. The authentication system 1 according to the present embodiment is adopted as an entrance/exit control system that performs entrance/exit management for a specific room where entry/exit is restricted, and the authentication device 20 functions as an entrance/exit control device. Further configured to provide. Thereby, it is possible to realize an entrance/exit management device that can improve authentication accuracy and shorten authentication processing time.

In particular, since the unique information recorded in the information code includes facial feature points extracted from the face image of user M, the authentication device 20 that performs authentication processing using facial feature points It is possible to eliminate the need to obtain the facial feature points of the user in advance.

In addition, the captured image transmitted from the mobile terminal 10 includes a facial image captured by the imaging unit 13 and from which the facial feature points of the user M can be extracted, and the authentication device 20 Facial feature points are extracted from the facial image. In this way, since facial feature points are extracted from the received facial image, there is no need for the mobile terminal 10 to perform facial feature point extraction processing, so that the processing capacity required of the mobile terminal 10 can be reduced.

Furthermore, in the authentication process performed by the control unit 21 of the authentication device 20, if facial feature points are successfully extracted (Yes in S213), a transmission stop instruction is issued to the mobile terminal 10 to stop sending the captured image. is performed (S215). Then, in the mobile terminal 10, the transmission of the captured image to the authentication device 20 via the communication unit 16 is continued until the transmission stop instruction is received (S107).

Thereby, even when images captured by the mobile terminal 10 are continuously transmitted until authentication by the authentication device 20 is successful, the transmission can be stopped at an appropriate timing.

In addition, the information code in which a predetermined identification number to be authenticated is recorded includes a first verification process (a process of verifying using information received from the mobile terminal 10) and a second verification process (a process of verifying using the information received from the mobile terminal 10) in the authentication process. Selection information for selecting which one to use is recorded.

As a result, in the authentication process, when a predetermined identification number to be authenticated is read by the code reader 23, an authentication process (second verification process) is performed using information obtained from the imaging result of the imaging unit 24. Alternatively, it can be easily determined whether to wait for reception of information (captured image) from the mobile terminal 10 and perform authentication processing (first verification processing) using the captured image. Therefore, for example, since the imaging unit 24 does not perform imaging processing while waiting for reception of a captured image from the mobile terminal 10, unnecessary processing can be eliminated.

In addition, in the mobile terminal 10, when an imaging instruction is received from the paired authentication device 20, that is, when the authentication device 20 is located within a range where the communication unit 16 can transmit, the imaging process is performed by the imaging unit 13. is started by. As a result, a captured image taken in advance at a location far from the authentication device 20 is not sent to the authentication device 20, thereby preventing fraudulent acts such as sending a forged face image to the authentication device 20. be able to.

In addition, in the above authentication process, when the first selection information is read (Yes in S205), if the captured image is not received via the communication unit 27 by the time a predetermined time elapses after this read, the authentication process is performed. can be canceled. Thereby, even if the information code C is read by mistake, the authentication process is stopped according to the predetermined time, so that unnecessary authentication processes can be stopped early.

[Second embodiment]
Next, an authentication system according to a second embodiment will be described with reference to the drawings.
The second embodiment mainly differs from the first embodiment etc. in that facial feature points extracted by the mobile terminal 10 are transmitted to the authentication device 20. Therefore, components that are substantially the same as those in the first embodiment are designated by the same reference numerals, and their descriptions will be omitted.

In the mobile terminal 10 according to the present embodiment, an extraction process is performed to extract facial feature points from the facial image of the user M captured by the imaging unit 13, and the successfully extracted facial feature points are sent to the authentication device 20. be done.

Hereinafter, in this embodiment, the authentication information transmission process performed by the control unit 11 of the mobile terminal 10 and the control unit 21 of the authentication device 20 when the user M carrying the mobile terminal 10 enters the above-mentioned specific room. The authentication process performed in the will be explained with reference to the drawings.

In the mobile terminal 10, when the control unit 11 starts the authentication information transmission process, the information code display process shown in step S101 in FIG. 11 is performed, and the information code is stored in the storage unit 12 as in the first embodiment Information code C is displayed on the display section 14.

When the information code C displayed on the screen is held over the code reader 23 of the authentication device 20, a facial feature point extraction instruction is received from the paired authentication device 20 as described later (Yes in S111). The imaging unit 13 becomes ready to take an image (S113). Then, in the facial feature point extraction process shown in step S115, a process for extracting facial feature points from the captured image of the imaging unit 13 is performed, and until the facial feature points are extracted in this extraction process, the determination in step S117 is made. The determination of No is repeated in the process. Note that the control unit 11 that performs the facial feature point extraction process may correspond to an example of a "terminal-side extraction unit."

Then, when the extraction process of facial feature points from the image captured by the imaging unit 13 is successful (Yes in S117), the extracted facial feature points are transmitted to the authentication device 20 via the communication unit 16 (S119). ), this authentication information sending process ends.

In the authentication device 20, when the control unit 21 starts the authentication process, the information code C held over the code reader 23 is decoded in the decoding process shown in step S201 in FIG. When the predetermined identification number and the first selection information are read (Yes in S203 and S205), in the facial feature point extraction instruction process shown in step S233, the facial feature point is sent to the paired mobile terminal 10. Processing is performed to send the extraction instruction.
When facial feature point data is received from the mobile terminal 10 via the communication unit 27 in response to the transmission of this facial feature point extraction instruction (S235), in the first matching process of step S217, as described above, Processing is performed to compare the received facial feature points with the facial feature points read from the information code C. If it is determined that the authentication is successful based on the comparison result (Yes in S219), an unlocking signal is transmitted to the locking/unlocking control device 3 (S231). Thereby, the user M can open the unlocked door 2 and enter the specific room.

That is, as shown in FIG. 13, the user M displays the information code C in which the predetermined identification number to be authenticated and the first selection information is recorded on the screen of the mobile terminal 10 (F101), and displays the information code. When holding up C (F103), the authentication device 20 reads the information code C (F105), and if it is determined to be an authentication target (F107), pairing is performed between the authentication device 20 and the mobile terminal 10. (F109). When the mobile terminal 10 that has received the facial feature point extraction instruction during this pairing becomes ready to capture images (F111), and facial feature points are extracted from the captured image (F123), the extracted facial features The point is sent to the authentication device 20 (F125). The authentication device 20 performs a first verification process using the received facial feature points (F117), and when it is determined that the authentication is successful (F119), an unlock signal is transmitted and the door 2 becomes unlocked. (F121).

As described above, in the authentication system 1 according to the present embodiment, facial feature points are extracted from the face image of the user M captured by the imaging unit 13 in the authentication information transmission process performed by the mobile terminal 10, The extracted facial feature points are transmitted to the authentication device 20 via the communication unit 16. Then, when the code reader 23 reads the predetermined identification number and facial feature points (unique information) to be authenticated from the information code, the authentication device 20 receives the facial feature points extracted by the mobile terminal 10. As a result, the first verification process (authentication process) is performed based on the facial feature points received in this way and the facial feature points read from the information code.

In this way, the facial feature points extracted by the mobile terminal 10 are transmitted to the authentication device 20, and the facial image itself is not transmitted to the authentication device 20. It is possible to reduce the amount of data communication required for transmission and reception between. In particular, since facial images from which facial feature points cannot be extracted are not transmitted to the authentication device 20, the amount of data communication can be reduced in this respect as well.

[Other embodiments]
Note that the present invention is not limited to the above-described embodiments and modifications, and may be embodied as follows, for example.
(1) The present invention is not limited to being adopted in an entry/exit control system that performs entry/exit management for a specific room where entry/exit is restricted based on the authentication result of the authentication device 20, but is also applicable to, for example, a payment system, etc. , it can also be adopted in other systems that utilize face recognition.

(2) Information code C records not only a predetermined identification number such as an employee number and facial feature points of user M as unique information that can identify the user, but also other authentication information. Information etc. that can be used may be recorded. Furthermore, the security of the facial feature points and the like may be improved by encrypting the information recorded in the information code C (predetermined identification number to be authenticated, facial feature points, etc.).

(3) On the premise that a database has been constructed in which the facial feature points of all users to be authenticated are associated with identification numbers, the facial feature points are not recorded in the information code C, and the authentication device 20 , the facial feature points associated with the identification number read from the information code may be acquired from the database.

(4) In the authentication process performed by the authentication device 20 in the first embodiment, the captured image received from the mobile terminal 10 is captured by using the imaging position information added to the captured image at which the image was captured. When the location information indicates outside a predetermined area set based on the installation location of the authentication device 20, the authentication process may be canceled. In addition, in the authentication processing performed by the authentication device 20, by using the imaging time at which the image was captured, which is added to the captured image, the imaging time of the captured image received from the mobile terminal 10 is a certain period of time longer than the reception time. If it is earlier than that, the authentication process may be canceled.

(5) The information code in which the predetermined identification number to be authenticated is recorded is not limited to recording either the first selection information or the second selection information; The identification number itself may function as selection information by selecting the first verification process or the second verification process according to the identification number without recording the information.

1...Authentication system 10...Mobile terminal 11...Control unit (terminal side extraction unit)
13...Imaging unit (terminal side imaging unit)
16...Communication section (transmission section)
20...Authentication device 21...Control unit (authentication unit, device side extraction unit, instruction unit)
23...Code reader (reading section)
24...Imaging section (apparatus-side imaging section)
27...Communication section (receiving section)
C...Information code M...User

Claims (8)

A mobile terminal carried by the user,
an information code in which unique information that can identify the user is recorded;
an authentication device that authenticates the user;
An authentication system comprising:
The mobile terminal is
a terminal-side imaging unit capable of capturing an image of the user's face;
a transmitting unit capable of transmitting authentication information obtained from the imaging result of the terminal-side imaging unit to the authentication device;
Equipped with
The authentication device includes:
a device-side imaging unit capable of capturing an image of the user's face;
a reading unit capable of optically reading the unique information of the information code;
a receiving unit capable of receiving the authentication information transmitted from the mobile terminal;
an authentication unit that performs authentication processing using a facial image of the user based on the unique information read by the reading unit;
Equipped with
The authentication unit performs the authentication process based on the authentication information and the unique information when the unique information is read by the reading unit and the authentication information is received by the receiving unit. , performing the authentication process based on the information obtained from the imaging result of the device-side imaging unit and the unique information when the authentication information is not received by the receiving unit;
The information code may record selection information for selecting which of the received authentication information and information obtained from the imaging result of the device-side imaging unit is to be used in the authentication process. An authentication system featuring: The authentication system according to claim 1, wherein the unique information includes facial feature points extracted from the facial image of the user. The authentication information includes a facial image captured by the terminal-side imaging unit and from which facial feature points of the user can be extracted;
The authentication device includes a device-side extraction unit that extracts facial feature points from a facial image included in the authentication information when the authentication information is received by the reception unit,
When the unique information is read by the reading unit and the authentication information is received by the receiving unit, the authentication unit extracts facial feature points extracted by the device-side extraction unit and the unique information. 3. The authentication system according to claim 2, wherein the authentication process is performed based on included facial feature points. The authentication device includes an instruction unit that instructs the mobile terminal to stop transmitting the authentication information when the device-side extraction unit successfully extracts the facial feature points,
4. The authentication system according to claim 3, wherein the transmitting section continues transmitting the authentication information to the authentication device until receiving the transmission stop instruction from the instruction section. The mobile terminal includes a terminal-side extraction unit that extracts facial feature points from the user's face image captured by the terminal-side imaging unit,
The transmitter transmits the authentication information to the authentication device so as to include the facial feature points extracted by the terminal-side extractor,
When the unique information is read by the reading unit and the authentication information is received by the receiving unit, the authentication unit includes facial feature points included in the authentication information and facial feature points included in the unique information. 3. The authentication system according to claim 2, wherein the authentication process is performed based on facial feature points. When the selection information selecting to use the received authentication information is read by the reading unit together with the unique information, the authentication unit is configured to cause the receiving unit to use the authentication information by the receiving unit before a predetermined time elapses from the reading. The authentication system according to any one of claims 1 to 5, wherein the authentication process is canceled if authentication information is not received.
The authentication system described in 6. 7. The terminal-side imaging unit starts imaging processing for obtaining the authentication information when the authentication device is located within a range where transmission can be performed by the transmitting unit. The authentication system described in any one of the items. The authentication system according to any one of claims 1 to 7, further comprising an entrance/exit control device that locks and unlocks an electric lock provided on a door in response to an authentication result obtained from the authentication process.

Images