JP5901824B1 - Face authentication system and face authentication program - Google Patents

Abstract

A system capable of updating face data stored in a database by a simple method. A control unit 270 of a communication terminal 110 captures an operator with an imaging unit 230 to acquire face data, and the face data and face authentication unit 260 stored in advance in the face data and authentication data storage unit 240. To determine whether the operator is normal or illegal. Then, when the face authentication unit 260 determines that the face authentication unit 260 is normal, the control unit 270 of the communication terminal 110 newly stores the face data acquired by the imaging unit 230 in the authentication data storage unit 240 as registrant face data. Then, the process of transmitting the face data determined to be normal by the face authentication unit 260 to the management apparatus as the registrant's face data is repeatedly performed at a predetermined timing. The face data sent to the management device is used to update the registrant face data stored in the registrant database of the management device. [Selection] Figure 2

Description

  The present invention relates to a face authentication system and a face authentication program for preventing unauthorized use of a communication terminal such as a smartphone, a mobile phone, and a personal computer using a face authentication technology.

  Conventionally, face authentication is known as one of personal authentication techniques. In a general face authentication system, the shape and arrangement position of a characteristic part such as a human pupil, nostril, eye head, corner of the eye, and mouth edge are measured and stored in advance as characteristic data. Then, during the authentication process, the subject's face is imaged by the camera, the feature data is measured, and compared with the feature data stored in advance, the authenticity / injustice of the authentication subject is determined.

  Further, as a technique for preventing unauthorized use of a communication terminal by using face authentication, for example, a technique described in Patent Document 1 below is known.

  In the technique disclosed in Patent Document 1, when a user operates a mobile terminal, the user's face is imaged using a camera built in the mobile terminal. Then, the feature data of the face image obtained by imaging is extracted by image processing or the like, and is compared with feature data stored in advance to determine whether the user is normal or illegal (for example, paragraph [0023] of Patent Document 1). ]reference).

  In addition, the portable terminal of Patent Document 1 displays the captured face image on its display screen when it is determined to be illegal in this face authentication process. Thus, when the possibility of unauthorized use is high, unauthorized use can be suppressed by displaying the face image of the user on the screen (see, for example, paragraph [0024] of Patent Document 1).

JP 2010-277504 A

  A company or the like may want to manage each employee's face photograph, feature data for face authentication, etc. in a database and manage them collectively. However, the human face changes with the passage of time according to factors such as age, and the feature data for face authentication may change accordingly. For this reason, in order to accurately manage employee face photographs and feature data, it is necessary to update these face photographs and feature data from time to time. Such an update operation is a very heavy burden especially when the number of employees is large.

  Moreover, in the above-mentioned patent document 1, in order to suppress unauthorized use, the face image of an unauthorized user is displayed. However, in such a method, when an unauthorized user discards or conceals the mobile terminal, the owner of the mobile terminal checks the facial image of the unauthorized user and Person cannot be identified.

  Therefore, a first object of the present invention is to provide a technique capable of updating a user's face photograph or face authentication feature data database by a simple method. A second object of the present invention is to provide a technique that can easily identify an unauthorized operator.

In order to solve this problem, a face authentication system according to the invention of claim 1 is a face authentication system including one or a plurality of communication terminals and a management device connected to the communication terminals. The communication terminal includes: an imaging unit that captures an operator to acquire face data; an authentication data storage unit that stores registrant's face data; and the face data newly acquired by the imaging unit and the authentication data storage unit. A face authentication unit that determines whether the operator is legitimate / unauthorized by face authentication processing using the stored registrant's face data, and a determination that the operator is legitimate / injustice by an authentication process other than face authentication. When it is determined that the non-face authentication unit and the non-face authentication unit are normal, the imaging unit acquires the operator's face data, and the face authentication unit performs the face authentication process using the face data. And non-face authentication unit When it is determined that the operator is unauthorized for a predetermined number of times, the imaging unit acquires the operator's face data and transmits the face data to the management device as the unauthorized operator's face data A control unit that performs the management, the management device receives the face data of the unauthorized operator received from the communication terminal, the face data stored in a registrant database that stores the registrant face data, and / or Alternatively, the unauthorized operator is specified by collating with face data acquired from a web page.

According to a second aspect of the present invention, in addition to the configuration of the first aspect, when the face authentication unit determines that the face authentication unit is illegal, the control unit stores the face data of the operator used for the authentication process. , and it performs the process of transmitting the said management device as an unauthorized operator of face data.

A face authentication system according to a third aspect of the invention is a face authentication system comprising one or a plurality of communication terminals and a management device that is connected to the communication terminals. The communication terminal images the operator. An image capturing unit for acquiring face data, an authentication data storage unit for storing registrant face data, face data newly acquired by the image capturing unit, and the face of the registrant stored in the authentication data storage unit And a face authentication unit for determining whether the operator is normal or illegal by face authentication processing using the data, and the face data of the operator used for the authentication processing when the face authentication unit determines that the operator is illegal And a control unit that performs processing to transmit to the management device as face data of an unauthorized operator, and the management device includes a registrant database that stores the registrant face data, and the communication terminal. The illegal manipulation received And a registrant verification unit that identifies the unauthorized operator by comparing the author's face data with the face data stored in the registrant database .

According to a fourth aspect of the present invention, in addition to the configuration according to the third aspect , the control unit of the communication terminal registers the face data acquired by the imaging unit when the face authentication unit determines that it is normal. A process of newly storing the user's face data in the authentication data storage unit and a process of transmitting the face data acquired by the imaging unit to the management apparatus as the registrant's face data are repeated at a predetermined timing. And the management device includes a management processing unit that updates the face data stored in the registrant database to the face data of the registrant newly received from the communication terminal.

A face authentication system according to a fifth aspect of the present invention is a face authentication system comprising one or a plurality of communication terminals and a management device that is communicatively connected to the communication terminal, wherein the communication terminal images the operator. An image capturing unit for acquiring face data, an authentication data storage unit for storing registrant face data, face data newly acquired by the image capturing unit, and the face of the registrant stored in the authentication data storage unit And a face authentication unit for determining whether the operator is normal or illegal by face authentication processing using the data, and the face data of the operator used for the authentication processing when the face authentication unit determines that the operator is illegal And a control unit that performs processing to transmit to the management device as unauthorized operator face data, and the management device receives the unauthorized operator face data received from the communication terminal from a web page. Acquired face data By matching comprises a web collating unit for identifying the unmoving positive operator, characterized in that.
According to a sixth aspect of the present invention, in addition to the configuration of the fifth aspect, the control unit of the communication terminal uses the face data acquired by the imaging unit when the face authentication unit determines that the face authentication unit is normal. A process of newly storing face data in the authentication data storage unit and a process of transmitting the face data acquired by the imaging unit to the management apparatus as face data of the registrant are repeatedly performed at a predetermined timing. The management device includes a registrant database that stores the registrant's face data, and a management process that updates the face data stored in the registrant database to the registrant's face data newly received from the communication terminal. And a section.

According to a seventh aspect of the present invention, a face authentication program causes a computer to function as a communication terminal of the face authentication system according to any one of the first to sixth aspects.

According to the invention of claim 1, prior to face authentication processing, non-face authentication processing that is authentication processing other than face authentication is performed, and when authentication is continuously rejected a predetermined number of times in the non-face authentication processing, Since the face data of the operator is acquired and transmitted to the management apparatus, the face data of the unauthorized operator can be acquired without causing the unauthorized operator to perform a face authentication operation.
Furthermore, according to the first aspect of the present invention, when an operator of any one of the communication terminals performs an unauthorized operation on another communication terminal, the unauthorized operator can be easily operated by the registrant verification process and / or the web verification process. Can be specified.

According to the invention of claim 2, since the face data determined to be authentic by the face authentication unit is transmitted to the management device as the operator's face data at a predetermined timing, the management device can store the registrant database. The face data of the registrant stored in can be easily updated.

According to the invention of claim 3, when an operator of any one of the communication terminals performs an unauthorized operation on another communication terminal, the unauthorized operator can be easily identified by the registrant verification process.

According to the invention of claim 4, since the face data determined to be authentic by the face authentication unit is transmitted to the management device as the operator's face data at a predetermined timing, the management device can store the registrant database. The face data of the registrant stored in can be easily updated.

According to the invention of claim 5, when an operator of any one of the communication terminals performs an unauthorized operation on another communication terminal, the unauthorized operator can be easily identified by the web verification process.
According to the sixth aspect of the present invention, the face data determined to be authentic by the face authenticating unit is transmitted to the management apparatus as the operator's face data at a predetermined timing. The face data of the registrant stored in can be easily updated.

According to the invention of claim 7 , the communication terminal of the face authentication system according to any one of claims 1 to 6 can be realized using a computer.

It is a conceptual diagram which shows the whole structure of the face authentication system which concerns on Embodiment 1 of this invention. 2 is a block diagram schematically showing a functional configuration of a communication terminal according to Embodiment 1. FIG. 3 is a block diagram schematically showing a functional configuration of a management device according to the first embodiment. FIG. 4 is a schematic flowchart showing an operation of the communication terminal according to the first embodiment. It is a conceptual diagram for demonstrating operation | movement of the communication terminal which concerns on the same Embodiment 1. FIG. It is a schematic flowchart which shows operation | movement of the management apparatus which concerns on the same Embodiment 1.

Embodiment 1 of the Invention
Embodiment 1 of the present invention will be described by taking as an example a case where the face authentication system of the present invention is constructed using a communication terminal that is distributed and used by an organization such as a company.

  FIG. 1 is a conceptual diagram showing the overall configuration of the face authentication system according to the first embodiment.

  As shown in FIG. 1, the face authentication system 100 according to the first embodiment includes one or more communication terminals 110 and a management device 120. The communication terminal 110 and the management apparatus 120 are communicatively connected via a communication network 130 such as the Internet.

  The communication terminal 110 is distributed and used by employees (hereinafter referred to as “operator”) by a company or the like. The communication terminal 110 may be, for example, a mobile communication terminal such as a smartphone, a tablet terminal, a mobile phone, or a laptop personal computer, or a stationary communication terminal such as a desktop computer. As will be described later, in the first embodiment, in order to use the communication terminal 110, the operator needs to undergo password authentication and face authentication. The communication terminal 110 sends the face data of the operator who has been authenticated by the face authentication process and the face data of the operator whose authentication has been rejected to the management apparatus 120 via the communication network 130. The configuration of the communication terminal 110 will be described later with reference to FIG.

  The management device 120 receives face data from each communication terminal 110. Then, the face data of the operator authenticated by the face authentication process is stored in a registrant database (not shown in FIG. 1). In addition, processing for specifying the operator is performed using the face data determined as “illegal” in the face authentication (described later). As the management device 120, for example, a server computer can be used. As the registrant database of the management device 120, a built-in database, an external database, or a database connected via a communication network 130 can be used. The configuration of the management device 120 will be described later with reference to FIG. The management device 120 is operated by a service provider of the face authentication system 100, for example. In the first embodiment, the case where the service provider provides services to a plurality of companies will be described as an example. However, it goes without saying that the present invention can also be applied to an in-house system constructed by a company or the like using a management computer or an employee communication terminal.

  FIG. 2 is a block diagram schematically showing a functional configuration of the communication terminal 110. As shown in FIG. 2, the communication terminal 110 includes a display unit 210, an operation unit 220, an imaging unit 230, an authentication data storage unit 240, a password authentication unit 250, a face authentication unit 260, and a control unit. 270 and a communication unit 280. Each of these units 210 to 280 can be constructed in software (for example, the authentication data storage unit 240, the password authentication unit 250, the face authentication unit 260, and the control unit 270). You may build in hardware.

  The display unit 210 is used for displaying an operation screen, a web page, or the like of the communication terminal 110. A liquid crystal display device or the like is used as the display unit 210.

  The operation unit 220 is used for an operator to operate the communication terminal 110. As the operation unit 220, for example, a touch screen of a touch display, an operation key of a mobile phone, a keyboard of a personal computer, or the like is used.

  The imaging unit 230 includes a digital camera (not shown) built in the communication terminal 110, for example. The imaging unit 230 acquires face data by imaging the operator using the digital camera. In the present invention, the “face data” may be an operator's face image (that is, a face photograph) itself, or face authentication feature data (pupil, nostril, eyes, eyes) obtained from the face image. , Data indicating the shape and arrangement position of a characteristic part such as a mouth end), or both a face image and characteristic data. In the first embodiment, a case where the face data is a face image will be described as an example.

  The authentication data storage unit 240 stores one or a plurality of (for example, five) registrant face data to be compared with the face data acquired by the imaging unit 230. As the authentication data storage unit 240, for example, a semiconductor memory or a hard disk can be used. In order to increase the reliability of the face authentication process (described later), it is desirable to store as much face data as possible in the authentication data storage unit 240. The face data stored in the authentication data storage unit 240 is replaced with a new one by the control unit 270 (described later).

  The password authenticating unit 250 corresponds to the “non-face authenticating unit” of the present invention, and authenticates the operator by matching / mismatching the password registered in advance and the password input by the operator at the start of the operation. The authentication method of the password authentication unit 250 may be a method of inputting a normal character / numerical string, a matrix authentication method, or another method. Further, instead of the password authentication unit 250, another authentication method (for example, a fingerprint authentication method) may be employed.

  The face authentication unit 260 uses the face data of the operator newly acquired by the imaging unit 230 during face authentication and one or more face data of the registrant stored in advance in the authentication data storage unit 240 to perform face authentication. Process. That is, the face authentication unit 260 acquires feature data from the operator's face data (here, a face image), and also acquires feature data from the registrant's face data. Then, these feature data are compared in order, and if there is a match with the operator's feature data in the registrant's feature data, the operator is determined to be “regular” and does not exist. In this case, the operator is determined to be “illegal”.

  When the face authentication unit 260 determines that the operator is “normal”, the control unit 270 newly stores the face data acquired by the imaging unit 230 in the authentication data storage unit 240 as registrant face data. Process. In addition, when the face authentication unit 260 determines that the operator is “regular”, the control unit 270 transmits the face data acquired by the imaging unit 230 to the management apparatus 120 as the registrant face data. Process. The storage process in the authentication data storage unit 240 and the transmission process to the management device 120 may be performed every time the operator is determined to be normal in the face authentication process, but every predetermined period (for example, every month). It may be performed every predetermined frequency (for example, every 10 authentication processes) or may be performed at another timing. In addition, the timing for performing the storing process in the authentication data storing unit 240 and the timing for performing the transmitting process to the management apparatus 120 may be the same or different.

  In addition, the control unit 270 determines that the password authentication unit 250 determines that the operator is “illegal” continuously for a predetermined number of times (for example, three times), or the face authentication unit 260 determines that the operator is “illegal”. In addition, a process of transmitting the operator's face data to the management device 120 as the unauthorized operator's face data is performed (described later).

  The communication unit 280 transmits face data to the management device 120 based on the control of the control unit 270.

  FIG. 3 is a block diagram schematically showing a functional configuration of the management apparatus 120. As illustrated in FIG. 3, the management device 120 includes a management processing unit 310, a registrant collation unit 320, a web collation unit 330, a registrant database 340, and a communication unit 350. Note that each of these units 310 to 350 can be constructed in software (for example, the management processing unit 310, the registrant collation unit 320, and the web collation unit 330). May be built.

  The management processing unit 310 receives registrant face data and unauthorized operator face data from the communication terminal 110 via the communication unit 350. When the registrant's face data is received, the management processing unit 310 updates the registrant's face data stored in the registrant database 340 with the face data received from the communication terminal 110. At this time, the old face data may be deleted or stored as old data as it is. On the other hand, when receiving the face data of the unauthorized operator, the management processing unit 310 sends the face data to the registrant collation unit 320 and the web collation unit 330 (described later).

  When the registrant verification unit 320 receives the face data of the unauthorized operator from the management processing unit 310, the registrant verification unit 320 sequentially compares the feature data of the face data with the feature data of each face data stored in the registrant database 340. (Hereinafter referred to as “registrant verification process”). If the feature data match, the registrant is determined to be an unauthorized operator.

  The web collation unit 330 performs processing (hereinafter referred to as web collation processing) for comparing the feature data of the face data related to the unauthorized operator with the feature data of the face image published on the web. In this web collation processing, for example, a face image published on the Internet is collected in a timely manner using a technique called web crawling, and the feature data of the collected face image is used as face data of an unauthorized operator. This can be done by comparing with the feature data according to.

  The registrant database 340 includes a storage device such as a hard disk, for example, and receives and stores the registrant face data from the management processing unit 310 as described above. The face data is preferably stored for each group (company, etc.) in association with information such as the name and department of the registrant. The example of FIG. 3 shows a case where face data of employees of six companies A, B,..., F are stored in the registrant database 340.

  The communication unit 350 performs processing for receiving face data from the communication terminal 110, processing for acquiring a face image published on the web, and the like.

  Next, the operation of the face authentication system 100 will be described.

  First, the operation of the communication terminal 110 will be described using the flowchart of FIG. 4 and the conceptual diagram of FIG.

  The control unit 270 (see FIG. 2) of the communication terminal 110 monitors the operation unit 220 when in a standby state.

  When the operator operates the operation unit 220 to input a password (see step S401), the control unit 270 causes the password authentication unit 250 to perform password authentication processing using the input password (see step S402). ). The password authentication unit 250 determines whether the password registered in advance matches or does not match the password input by the operator.

  If the registered password and the input password do not match (that is, “NG” in step S403), the control unit 270 counts the number n of the mismatches (see step S404). Then, the control unit 270 compares the number n of mismatches with a predetermined number N of allowed mismatches (here, “2”) (see step S405). If the number of mismatches n does not exceed the number N of allowed mismatches (that is, if “No” in step S405), the process returns to the password input waiting state (see step S401). At this time, it is desirable that the control unit 270 notifies the operator that the password is invalid by displaying the display unit 210, an error sound, or the like.

  On the other hand, if the number of mismatches n exceeds the number N of allowed mismatches in step S405 (that is, if “Yes” in step S405), the control unit 270 causes the imaging unit 230 to photograph the operator (steps) (step S405). (See S406). This imaging is executed without notifying the operator in advance that the image is to be captured, unlike a face authentication imaging process (see step S409) described later. However, it may be possible to notify the operator that the image has been shot by reproducing the shooting sound at the time of shooting. This is because notifying the operator that the image has been taken can be expected to prevent further unauthorized operations.

  The imaging unit 230 sends the face data acquired by this imaging to the control unit 270. Then, the control unit 270 sends the face data to the communication unit 280. The communication unit 280 transmits this face data to the management device 120 as the face data of the unauthorized operator (see step S407). In this embodiment, since the allowable number N of mismatches is set to “2”, the face data of the unauthorized operator when the registered password and the input password do not match three times in succession. Is transmitted to the management apparatus 120.

  After that, as error processing, the control unit 270 performs processing for resetting the number of mismatches n, processing for displaying that the photograph has been transmitted, on the display unit 210 (see step S408), and waiting for password input (step S408). Return to S401). Note that displaying the fact that a face photo has been taken and transmitted can be expected to prevent the operator from further unauthorized operation.

  On the other hand, in step S403, when the registered password matches the input password (that is, in the case of “OK” in step S403), the control unit 270 performs authentication face photographing processing (step S409). reference).

  In this shooting, first, the imaging unit 230 displays an image on the screen 510 of the display unit 210 while capturing an image as needed (see FIG. 5). Then, the operator is prompted to adjust the position of the communication terminal 110 so that the face falls within the dotted line 520. Thereafter, when the operator operates the operation unit 220 to perform photographing, the face photographing process is completed.

  When the face photographing process ends, the control unit 270 causes the face authentication unit 260 to perform the face authentication process (see step S410).

  In this face authentication process, the face authentication unit 260 first uses the face authentication feature data (pupil, nostril, eyes, corners of the eyes, mouth edge) from the face data (here, the face image) acquired by the imaging unit 230 in step S409. The data indicating the shape and arrangement position of the characteristic part such as the like) is extracted. Further, the face authentication unit 260 reads the first registrant face data (in this embodiment, the registrant's face image) from the authentication data storage unit 240, and extracts the feature data of the registrant face data. Then, these two feature data are compared, and if they match, the operator is determined to be “regular”.

  On the other hand, if these feature data do not match, the next registrant face data is read from the authentication data storage unit 240, the feature data is extracted, and is compared with the feature data of the face data acquired in step S409. Such comparison processing is repeated until the face data acquired in step S409 and the feature data match are found from the face data stored in the authentication data storage unit 240. If a match is found, the face authentication unit 260 determines that the operator is “regular”. On the other hand, if none of the authentication data storage unit 240 stores the face data acquired in step S409 and the feature data match, the face authentication unit 260 determines that the operator is “illegal”.

  The control unit 270 receives the authentication result from the face authentication unit 260. If the result of the face authentication is “regular” (in the case of “OK” in step S411), the control unit 270 performs a process of storing and transmitting the face data acquired in step S409 (see step S412).

  In this face data storage / transmission process, the face data stored in the authentication data storage unit 240 is repeatedly updated at a predetermined timing. For this purpose, the control unit 270 checks the date when new face data was added to the authentication data storage unit 240 last time. If a predetermined period (for example, one month) has passed since that date, the oldest face data stored in the authentication data storage unit 240 is deleted, and the face acquired in step S409 is deleted. Save new data. Further, the control unit 270 sends the new face data to the communication unit 280, and transmits the new face data to the management apparatus 120 as face data of the registrant (that is, a regular operator).

  At this time, instead of the new face data acquired in step S409, the face data deleted from the authentication data storage unit 240 may be transmitted to the management apparatus 120. Even when such face data is transmitted to the management apparatus 120 and used as update face data in the registrant database 340, the image capturing unit 230 captures an image during the face authentication process and the face authentication unit 260 determines that it is “regular”. Since the face data is used, the effect of the present invention can be obtained.

  Further, here, the registrant's face data is stored and transmitted periodically (every month), but may be performed at other timing (for example, every time the number of operations reaches a predetermined number).

  Furthermore, the timing for storing new face data in the authentication data storage unit 240 and the timing for transmitting face data to the management device 120 may be set individually. For example, the new face data storage in the authentication data storage unit 240 may be executed every month, and the process of transmitting the face data to the management apparatus 120 may be executed every three months.

  Thereafter, the control unit 270 ends the authentication process of the first embodiment and enters a state of accepting an operator's normal operation on the communication terminal 110.

  On the other hand, if the result of the face authentication is “invalid” in step S411 (if “NG” in step S411), the control unit 270 sends the face data captured in step S409 to the management apparatus 120. The communication unit 280 transmits this face data to the management device 120 as the face data of the unauthorized operator (see step S413).

  After that, as error processing, the control unit 270 performs processing for displaying a notification of redoing face authentication or displaying that a photograph has been transmitted on the display unit 210 (see step S414), and returns to the photographing processing of step S409. . By displaying the fact that the photograph of the face has been taken and transmitted, it is possible to expect an effect of suppressing further unauthorized operations by the operator. Here, when the result of the face authentication is “invalid”, the processing after step S409 is re-executed, but it is also possible to re-start from the password input (see step S401). Furthermore, when the number of times that the face authentication process is determined to be “illegal” reaches a predetermined number, or when the operation unit 220 has not been operated for a predetermined time after the error process (see step S414), the password is input ( It is also possible to return to step S401).

  Next, the operation of the management apparatus 120 will be described using the flowchart of FIG.

  The management processing unit 310 of the management device 120 monitors whether or not the communication unit 350 has received face data when in a standby state (see step S601).

  When the communication unit 350 receives face data, the management processing unit 310 determines whether the face data belongs to a registrant (regular operator) or an unauthorized operator (see step S602). As described above, the registrant face data is the face data transmitted in step S412 of FIG. The unauthorized operator's face data is the face data transmitted in steps S407 and S413 in FIG.

  If it is determined in step S602 that the face data is a registrant's face data, the management processing unit 310 updates the registrant's face data in the registrant database 340 using the face data. As described above, the face data is preferably stored in association with other personal information (name, company name, etc.) of the registrant (see step S603).

  On the other hand, if it is determined in step S 602 that the face data is an unauthorized operator, the management processing unit 310 sends the received face data to the registrant verification unit 320. The registrant verification unit 320 performs registrant verification processing using this face data (see step S604).

  In this registrant verification process, the registrant verification unit 320 first determines the shape and arrangement position of characteristic parts such as feature data (pupil, nostril, eyes, corners of the eyes, mouth edge) from the received face data (here, a face image). Etc.) is extracted. Furthermore, the registrant verification unit 320 reads the first registrant's face data (in this embodiment, the registrant's face image) from the registrant database 340, and extracts the feature data of this registrant face data. Then, these two feature data are compared. When these feature data match, the registrant verification unit 320 identifies the registrant as an unauthorized operator.

  On the other hand, if the received face data is the first registrant face data and the feature data does not match, the registrant collation unit 320 reads the face data of the next registrant from the registrant database 340 and extracts the feature data. Then, it is compared with the feature data of the received unauthorized operator's face data. Such a process is repeated until the received face data and the feature data match are found from the face data stored in the registrant database 340. Regardless of whether or not matching face data is found on the way, the registrant matching process may be performed for all of the face data stored in the registrant database 340.

  Note that in this registrant verification process, only registrant face data stored in the registrant database 340 may belong to the same company as the authorized user of the communication terminal 110 that has been illegally operated. Regardless of the company to which the user belongs, all registrant face data may be subject to verification. However, when all registrant face data is to be verified, it is desirable to obtain permission from the company or the like in advance.

  If a match is found, the registrant verification unit 320 identifies the identified registrant as an unauthorized operator, and sends the registrant's face data and other personal information to the management processing unit 310. On the other hand, if none of the registrant database 340 matches the received face data with the feature data, the face authentication unit 260 determines that the identification is impossible, and the management processing unit 310 Send to.

  When an unauthorized user is identified (“Yes” in step S605), the management processing unit 310 performs a notification process described later (see step S607).

  On the other hand, when an unauthorized user is not specified (“No” in step S605), the management processing unit 310 sends the received face data to the web verification unit 330. The web collation unit 330 performs web collation processing using the face data (see step S606).

  In this web collation process, the web collation unit 330 first extracts feature data from the received face data (here, a face image). Furthermore, the web collation unit 330 extracts feature data from the face images collected from the web. All websites may be used as websites for collecting face photographs, and for example, face photographs may be collected from an SNS (social networking service) site. On the SNS site, the profile is often disclosed together with the member's face photo, which is useful for identifying an unauthorized operator. Note that the web verification unit 330 desirably collects face images published on the Internet as appropriate using a technique called web crawl.

  Then, the web matching unit 330 sequentially compares the feature data acquired from the face image on the web with the feature data of the unauthorized operator (that is, the feature data of the face data acquired from the communication terminal 110). When feature data that matches that of the unauthorized operator is found, the web collating unit 330 identifies the face image on the web as the unauthorized operator's face image. Then, the web collation unit 330 sends the identified face image on the web to the management processing unit 310 together with accompanying information (for example, the URL of the web page that discloses the face image). On the other hand, when the feature data that matches that of the unauthorized operator is not found, the face authentication unit 260 determines that it cannot be specified and sends the fact to the management processing unit 310.

  Thereafter, the management processing unit 310 notifies an administrator of a company or the like to which the authorized user of the communication terminal 110 belongs that an unauthorized operation has occurred on the communication terminal 110 (see step S607).

  At this time, when the unauthorized user is specified by the registrant verification process, the face data and other personal information are also notified. When the unauthorized user is specified by the web collation process, the facial image on the web of the unauthorized user and the accompanying information (described above) are also notified.

  As described above, according to the first embodiment, part or all of the face data authenticated by the face authentication unit 260 is transmitted to the management device 120 as face data of the authorized operator at a predetermined timing. Therefore, an administrator of a company or the like can easily update the face data of employees or the like stored in the registrant database 340. Thereby, even when the appearance of the registrant (regular operator) changes with age or the like, face data close to the actual appearance can always be stored.

  Further, according to the first embodiment, the face data determined to be “illegal” is transmitted to the face authentication unit 260 to the management apparatus 120, so that the face data of the unauthorized operator can be acquired.

  Further, according to the first embodiment, the password authentication process is performed prior to the face authentication process, and the operation is performed when it is determined that the password authentication process is “illegal” continuously for a predetermined number of times (for example, three times). Since the user's face data is acquired and transmitted to the management device 120, the face data of the unauthorized operator can be acquired without causing the unauthorized operator to perform the face authentication operation.

  In addition, according to the first embodiment, the registrant collation process (that is, the process of collating the unauthorized operator's face data with other registrant face data stored in the registrant database 340) is performed. When an operator of one of the communication terminals 110 performs an unauthorized operation on another communication terminal 110, the unauthorized operator can be easily identified.

  Further, according to the first embodiment, the unauthorized operator can be identified by performing the web matching process (the process of matching the unauthorized operator's face data with the face image published on the web).

DESCRIPTION OF SYMBOLS 100 Face authentication system 110 Communication terminal 120 Management apparatus 130 Communication network 210 Display part 220 Operation part 230 Imaging part 240 Authentication data storage part 250 Password authentication part 260 Face authentication part 270 Control part 280 Communication part 310 Management process part 320 Registrant verification part 330 Web verification unit 340 Registrant database 350 Communication unit

Claims (7)

A face authentication system comprising one or a plurality of communication terminals and a management device that is communicatively connected to the communication terminals,
The communication terminal is
An imaging unit for imaging the operator and acquiring face data;
An authentication data storage unit for storing the registrant's face data;
A face authentication unit that determines whether the operator is normal or illegal by face authentication processing using face data newly acquired by the imaging unit and face data of the registrant stored in the authentication data storage unit;
A non-face authentication unit that determines whether the operator is normal or illegal by an authentication process other than face authentication;
When the non-face authentication unit determines that the image is authentic, the imaging unit acquires the operator's face data, uses the face data to cause the face authentication unit to perform the face authentication process, and When the face authentication unit determines that the operator is unauthorized for a predetermined number of times, the imaging unit acquires the operator's face data, and the management device stores the face data in the management device's face data. A control unit that performs processing to transmit as,
With
The management device includes the face data of the unauthorized operator received from the communication terminal, the face data acquired from the registrant database storing the registrant's face data and / or face data acquired from a web page, and Identifying the unauthorized operator by matching,
Face recognition system characterized by that. The control unit of the communication terminal newly stores the face data acquired by the imaging unit in the authentication data storage unit as the registrant face data when the face authentication unit determines that the face authentication unit is normal. The process of transmitting the face data acquired by the imaging unit to the management apparatus as the registrant's face data is repeatedly performed at a predetermined timing,
The management device
And the registrant database for storing face data of the registrant,
A management processing unit for updating the face data stored in the registrant database to the face data of the registrant newly received from the communication terminal;
The face authentication system according to claim 1, further comprising: A face authentication system comprising one or a plurality of communication terminals and a management device that is communicatively connected to the communication terminals,
The communication terminal is
An imaging unit for imaging the operator and acquiring face data;
An authentication data storage unit for storing the registrant's face data;
A face authentication unit that determines whether the operator is normal or illegal by face authentication processing using face data newly acquired by the imaging unit and face data of the registrant stored in the authentication data storage unit;
A controller that performs processing to transmit the face data of the operator used for the authentication processing to the management device as face data of the unauthorized operator when the face authentication unit determines that the face is unauthorized;
And comprising
The management device
A registrant database for storing the registrant's face data;
A registrant verification unit that identifies the unauthorized operator by comparing the unauthorized operator's face data received from the communication terminal with the face data stored in the registrant database;
A face authentication system comprising: The control unit of the communication terminal newly stores the face data acquired by the imaging unit in the authentication data storage unit as the registrant face data when the face authentication unit determines that the face authentication unit is normal. The process of transmitting the face data acquired by the imaging unit to the management apparatus as the registrant's face data is repeatedly performed at a predetermined timing,
The management apparatus includes a management processing unit that updates face data stored in the registrant database to face data of the registrant newly received from the communication terminal.
The face authentication system according to claim 3. A face authentication system comprising one or a plurality of communication terminals and a management device that is communicatively connected to the communication terminals,
The communication terminal is
An imaging unit for imaging the operator and acquiring face data;
An authentication data storage unit for storing the registrant's face data;
A face authentication unit that determines whether the operator is normal or illegal by face authentication processing using face data newly acquired by the imaging unit and face data of the registrant stored in the authentication data storage unit;
A controller that performs processing to transmit the face data of the operator used for the authentication processing to the management device as face data of the unauthorized operator when the face authentication unit determines that the face is unauthorized;
And comprising
The management device includes a web verification unit that identifies the unauthorized operator by comparing the unauthorized operator's face data received from the communication terminal with face data acquired from a web page.
Face recognition system characterized by that. The control unit of the communication terminal newly stores the face data acquired by the imaging unit in the authentication data storage unit as the registrant face data when the face authentication unit determines that the face authentication unit is normal. The process of transmitting the face data acquired by the imaging unit to the management apparatus as the registrant's face data is repeatedly performed at a predetermined timing,
The management device
A registrant database for storing the registrant's face data;
A management processing unit that updates the face data stored in the registrant database to the face data of the registrant newly received from the communication terminal.
The face authentication system according to claim 5.   A face authentication program for causing a computer to function as a communication terminal of the face authentication system according to claim 1.

Images