JP2019114277A - Information processing device, personal authentication system, control method thereof, personal authentication method, and program therefor - Google Patents

Abstract

To provide a mechanism which prepares multiple types of feature quantities differing in a direction of the face of the same person, etc. so that when face authentication of the same person is carried out many times in the day, it would not be affected by the direction of a user's face, etc.SOLUTION: First face authentication means determines whether or not a person of a newly photographed face image is same as the person of a registered face image in accordance with a first criterion with which it is possible to discriminate whether a first feature quantity of a registered face image and a second feature quantity of the newly photographed face image are similar. Furthermore, a face image that is not determined by the first face authentication means as being the same as the person of the registered face image is extracted from among a plurality of face images of the same person successively photographed within prescribed time as a face orientation is different. Then, it is determined whether or not the person of the newly photographed face image is the same as the person whose face image differs in the direction of the face is extracted in accordance with a second criterion consisting of the first feature quantity of the registered face image with a third feature quantity of the extracted face image added thereto.SELECTED DRAWING: Figure 6

Description

  The present invention relates to a telework management system.

  In recent years, with the background of development of broadband and information security technology, attention to business continuity and power saving measures at the time of disaster, etc., each company has become more interested in telework where users work at remote places such as homes . In introducing telework, there is a risk that confidential information may be leaked due to the access to an information processing terminal by a third party such as a family, and labor management is difficult because the situation is difficult for the manager to see.

  In the prior art, when the appearance of the user changes daily due to the presence or absence of glasses, etc., the determination criteria acquired from the reference face image for face recognition of the same person will be blurred, and the recognition rate of the same person will change daily In order to solve the problem such as, the similarity between the feature quantity of the reference face image registered earlier and the feature quantity of the face image newly captured by the camera is satisfied, and the similarity satisfies the tolerance (similar Event is detected using the feature amount of the previously registered reference face image. Conversely, if the similarity does not satisfy the tolerance (judged not to be similar), it is acquired from a face image captured anew by the camera in order to increase the recognition rate of the same person without being affected by the user's appearance A technique for detecting an event using a temporary feature amount is disclosed.

JP, 2015-103198, A

  The prior art is a technology in which the feature amount for face recognition of the same person is replaced by the appearance of the user of that day, and has the effect of increasing the recognition rate of the same person without being affected by the appearance of the user of that day.

  Teleworkers may turn in various directions during work. In order to detect an event accurately when facing any direction, it is necessary to detect an event using face images taken from various angles.

  As described above, in the case where the face recognition of the same person is repeated many times during the day, and the motion event is detected each time, the user's face direction etc. is not good at the timing when the motion event is to be detected. It is also necessary to assume cases where it is difficult to see the face), and it is possible to detect motion events without being affected by the user's face orientation etc. Multiple types of feature values with the same person but different face orientation etc. It is necessary to prepare.

  According to the present invention, when performing face recognition of the same person many times during the day, a plurality of types of feature amounts in which the same person has different face orientations and the like are not influenced by the face direction of the user or the like. The purpose is to provide a mechanism that can be prepared.

  According to the present invention, a face image to be newly photographed according to a first criterion which can determine whether the first feature amount of the face image registered and the second characteristic amount of the face image to be newly photographed are similar. The first face authentication means for determining whether or not the person in question is the same person as the person in the face image being registered, and a plurality of images continuously taken within a predetermined time so that the direction of the face is different The photographing means for photographing the face image of the same person and the same person as the person of the face image registered in the first face authentication means out of the plurality of face images of the same person taken The extraction means for extracting face images of the same person whose face orientations are different, and the third feature amount of the extracted face image is added to the first feature amount of the registered face image. According to the second standard, a person of a face image to be newly photographed is a face whose direction of the face is different The information processing apparatus characterized by comprising: a second face authentication means for determining whether or not the same person as the person image is extracted, the.

  According to the present invention, the first face authentication unit of the information processing apparatus can determine whether the first feature of the face image registered and the second feature of the face image to be newly captured are similar. A first face authentication step of judging whether the person of the face image to be newly photographed is the same person as the person of the registered face image according to the first standard; and the photographing means of the information processing apparatus However, the imaging process of imaging the face images of a plurality of identical persons continuously imaged within a predetermined time so that the face orientation is different, and the extraction process of the information processing apparatus is the same as the plurality of imaged Extraction step of extracting face images of the same person having different face orientations from the face image of the person, wherein the first face authentication means does not judge that the person is the same person as the face image registered And the second face authentication unit of the information processing apparatus is registered. A person whose face image to be photographed newly is a face image whose face direction is different according to a second criterion in which the third feature amount of the extracted face image is added to the first feature amount of the image And a second face authentication step of determining whether the person is the same person as in the above method.

  According to the present invention, according to a first standard that allows the information processing apparatus to determine whether a first feature of a registered face image and a second feature of a face image to be newly captured are similar. The first face authentication unit that determines whether the person of the face image to be newly photographed is the same person as the person of the face image that is registered is continuously within a predetermined time so that the direction of the face is different. Shooting means for shooting face images of a plurality of the same person taken and a person of the face image registered in the first face authentication means out of the plurality of face images of the same person taken Extraction means for extracting face images of the same person having different face orientations that are not judged to be the same person, and third feature of the extracted face image in the first feature amount of the registered face image According to a second criterion that adds an amount, a person of a face image to be newly photographed is the face The the second face authentication means, to the read program executable by an information processing apparatus, characterized in that to function to determine whether the same person as the person orientation different face image has been extracted.

  According to the present invention, when performing face recognition of the same person many times during the day, a plurality of types of feature amounts in which the same person has different face orientations and the like are used so as not to be affected by the face direction of the user. It is possible to provide a mechanism that can be prepared.

It is a system configuration figure showing an example of composition of a telework management system of the present invention. FIG. 2 is a block diagram showing a hardware configuration of an information processing apparatus applicable to the operation terminal 100, the audit terminal 110, and the management server 120 of the present invention. It is a flowchart which shows an example of a detection and recording process of an operation | movement event which the operation terminal 100 performs, using a telework management system in this invention, while a user is telework work. It is a flowchart which shows the sequence which registers the face image used as the reference | standard of face authentication in this invention. It is a flowchart which shows the sequence which image | photographs one face image used as the reference | standard of face authentication in this invention. It is a flowchart which shows the sequence which image | photographs multiple sheets of the face image used as the reference | standard of face authentication in this invention by a moving image. The transition of the operation screen which registers a face image in an operation terminal in this invention is shown. The transition of the operation screen which a user selects the face image registered into an operation terminal in this invention is shown. The example of the face image data registered into an operation terminal in this invention is shown.

  First, an outline of the present invention will be described.

  The telework management system of the present invention uses the face recognition technology to operate the teleworker's motion event ("seated", "away", etc. motion event, or "spoofing" or "smiling" by a third party other than the teleworker). This is a system that detects and records security incidents, and allows the administrator to view them.

When the teleworker starts work, he / she takes a photo of the teleworker's face, performs personal authentication using the photo of the face and the feature value of the face image that is originally certified to be the teleworker himself, and the teleworker himself A certain degree of possibility (authentication level) is calculated (hereinafter, the face image and its feature amount are put together and the feature amount is used, and the feature amount to be used for personal identification is taken as an authentication feature amount).
FIG. 1 will be described.
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a system configuration diagram showing an example of the configuration of the telework management system of the present invention.

  FIG. 1 shows a configuration in which one or more operation terminals 100, one or more audit terminals 110, one or more management servers 120 are connected via a local area network (LAN) 130 and a router 140, and the Internet 150. It has become.

The operation terminal 100 detects an operation event and a security incident of the teleworker to use, and transmits the trail to the management server 120. Also, the feature amount (face image and feature amount obtained from the face image) of the teleworker used for motion event detection is transmitted to the management server 120.
The audit terminal 110 performs the approval operation of the feature amount recorded in the management server 120 and the audit operation of the trail recorded in the management server 120.

The management server 120 records the trail received from the operation terminal 100, and processes the audit operation of the audit terminal 110 on the trail. Also, the feature amount received from the operation terminal 100 is recorded, and the approval operation of the audit terminal 110 for the feature amount is processed.
A face authentication system can be constructed using the operation terminal 100 and the management server 120 of the present invention, which will be described later.
FIG. 2 will be described.
The hardware configuration of the information processing apparatus applicable to the operation terminal 100, the audit terminal 110, and the management server 120 shown in FIG. 1 will be described below using FIG.
FIG. 2 is a block diagram showing a hardware configuration of an information processing apparatus applicable to the operation terminal 100, the audit terminal 110, and the management server 120 shown in FIG.

  In FIG. 2, reference numeral 201 denotes a CPU, which centrally controls devices and controllers connected to the system bus 204. Further, the ROM 203 or the external memory 212 is required to realize a BIOS (Basic Input / Output System) which is a control program of the CPU 201, an operating system program (hereinafter referred to as OS), and functions executed by each server or each PC. The various programs described later are stored.

  A RAM 203 functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 loads programs necessary for execution of processing from the ROM 203 or the external memory 212 to the RAM 202, and executes the loaded programs to realize various operations.

  An input controller 205 controls input from a keyboard (KB) 209, a camera device 210 (imaging apparatus), a pointing device such as a mouse (not shown), and the like. A video controller 206 controls display on a display such as a CRT display (CRT) 211 or the like. Although FIG. 2 describes the CRT 211, the display may be not only a CRT but also another display such as a liquid crystal display. These are used by the administrator as needed.

  A memory controller 207 is an external storage device (hard disk (HD)) for storing a boot program, various applications, font data, user files, editing files, various data, etc., a flexible disk (FD), or a PCMCIA card slot. It controls access to an external memory 212 such as a Compact Flash (registered trademark) memory connected via an adapter.

  A communication I / F controller 208 connects and communicates with an external device via a network (for example, the LAN 130 shown in FIG. 1), and executes communication control processing in the network. For example, communication using TCP / IP is possible.

  The CPU 201 enables display on the CRT 211 by executing, for example, outline font rasterization processing on a display information area in the RAM 202. Further, the CPU 201 enables user's instruction with a mouse cursor (not shown) on the CRT 211 or the like.

Various programs to be described later for realizing the present invention are stored in the external memory 212, and are executed by the CPU 201 by being loaded into the RAM 202 as necessary. Furthermore, definition files and various information tables used at the time of execution of the program are also stored in the external memory 212, and a detailed description of these will be described later.
FIG. 3 will be described.

Hereinafter, with reference to FIG. 3, processing in the resident application operating on the operation terminal 100 used by the teleworker in the telework management system of the present invention will be described.
The process shown in the flowchart of FIG. 3 is a process in which the CPU 201 of the operation terminal 100 reads and executes a predetermined control program.

  3, after registration of the face image serving as the reference of the face authentication in FIG. 4 is completed, the face of the individual is authenticated, and the web camera is used to telework the detection and recording of the operation event that has authenticated each individual. It is a sequence performed during work.

  In S401, when the user logs in to the operation terminal 100, the operation terminal 100 starts the resident application, and logs in to the management server 120 in the background using the account ID and password of the teleworker. The management server 120 compares the information with the teleworker information stored in the account storage unit 128, and permits the login if they match. The account ID and password are set by the user when the resident application is launched for the first time, and thereafter use the set values.

  In S402, every time an operation event of a teleworker occurs, the possibility that the user using the operation terminal 100 is a teleworker registered in the management server 120 is calculated, and depending on the result, the operation event is used in S403 detection. Acquire the feature value to be

  In step S402, the information processing apparatus uses the photographing unit 210 (WEB camera etc.) provided in the vicinity of the display unit of the information processing apparatus to move the face image of a person (teleworker) while the teleworker is working. Shoot with A fourth feature amount (feature amount obtained from face images facing in various directions) is acquired from a still image of each face image to be newly captured. The third feature amount is used to determine whether the person is the same person as the person in the face image already registered, using the third criterion of the face image registered in S813 as the first reference that can be determined. It is determined whether the person of the face image to be compared newly is the same person as the person of the face image already registered (the second face authentication means) according to the second criterion to which the feature amount of B is added.

  The second criterion is (a threshold value for determining that the fourth feature value of the image newly captured in S402 is similar based on the first feature value registered) + (the third value already registered) The threshold value is expanded based on the feature amount of (a threshold value determined to be similar to the fourth feature amount of the newly captured image).

  By satisfying the second standard, it will be recognized as the same person, and even in the case where face authentication needs to be continuously performed using the photographing means 210 (WEB camera etc.), the face direction is changed by chance. Even at the same timing, the same person can be recognized with high accuracy.

  In S403, an operation event (a labor operation event such as “seated” or “away”, or a security incident such as “spoofing” or “look-in”) is detected, and the trail is transmitted to the management server 120.

  In step S403, the information processing apparatus performs event information of an action taken by a person (teleworker) shooting with the shooting means (WEB camera) in front of the shooting means (WEB camera) with the action content of the person shot in real time. The image analysis is repeatedly performed for each movement of the photographed person (event detection means). Here, when the event detection means detects event information (seat, leave, impersonation, look-in), event information of a person who is determined to be the same person in the first face authentication means of S808 is also detected, and further, Event information of a person who is determined to be the same person by the second face authentication unit in S402 is also detected. As a result, even if the direction of the face is different, the recognition range of the same person is widened, the recognition rate of the same person is improved, and even if the direction of the face is different, the event information (seating, leaving, watching) ) Can be detected.

Further, in S403, the information processing apparatus images event details of a person photographed in real time, which is event information performed by a person photographing using the photographing unit (WEB camera) in front of the photographing unit (WEB camera) By analyzing, it records repeatedly for every operation | movement of the image | photographed person (event recording means). Here, when the event recording means records event information (seat, leave, impersonation, peeping-in), the event information of the person who is judged to be the same person in the first face authentication means of S808 is also recorded, and further Event information of a person who is determined to be the same person by the second face authentication means in S402 is also recorded. As a result, even if the direction of the face is different, the recognition range of the same person is widened, the recognition rate of the same person is improved, and even if the direction of the face is different, the event information (seating, leaving, watching) Can be recorded as that trail.
In S404, when the user logs out from the operation terminal 100, the operation terminal 100 logs out from the management server 120 in the background.
FIG. 4 will be described.

FIG. 4 is a sequence for registering a face image as a reference of face recognition as preparation before starting teleworking work. After registering the face image serving as the reference of face recognition in FIG. 4, the detection and recording of the motion event in FIG. 3 can be performed during the teleworking operation.
In step S601, the information processing apparatus creates a registration list A for registering a face image serving as a reference for face authentication.

In step S602, the information processing apparatus determines whether face authentication with a face image already in the registration list A is possible. In the case of face authentication (TRUE), the process proceeds to S604. If the face authentication is impossible (FALSE), the process advances to step S603.
In step S603, the information processing apparatus is a flowchart of a sequence of capturing one face image serving as a reference of face authentication. The details will be described with reference to FIG.
At S604, the information processing apparatus receives a photographing method.

  In S605, the information processing apparatus determines whether the received shooting method is a sequence for shooting one face image or a sequence for shooting a plurality of images. If it is determined that the sequence is to shoot one image, the process proceeds to step S603. If it is determined that the sequence is to shoot a plurality of images, the process proceeds to step S607.

In S606, the information processing apparatus determines whether the created registration list A is empty. If it is determined that it is empty (TRUE), the process proceeds to step S608. If it is determined that it is not empty (FALSE), the process proceeds to S607.
In step S607, the information processing apparatus is a flowchart of a sequence of capturing a plurality of face images serving as a reference of face authentication as a moving image. The details will be described with reference to FIG.

In step S608, the information processing apparatus determines whether the created registration list A is empty. If it is determined that it is empty (TRUE), the process proceeds to step S616. If it is determined that it is not empty (FALSE), the process proceeds to S609.
The steps S609 to S614 are not related to the present invention, and thus the description thereof is omitted.
FIG. 5 will be described.
FIG. 5 is a sequence for photographing one face image as a reference of face recognition in S603.

In step S701, the information processing apparatus determines whether cancellation is performed. In case of cancellation (TRUE), proceed to END. In the case of not being canceled (FALSE), the process proceeds to S702.
In step S702, the information processing apparatus receives a photographing timing when the user presses the photographing button 702 on the screen 700.

  In S703, the information processing apparatus captures a face image using the WEB camera 210 three seconds after the user presses it, and acquires one face image of the teleworker sitting in front of the operation terminal.

In S704, the information processing apparatus determines whether acquisition of one face image is successful. If acquisition of one face image is successful (TRUE), the process advances to step S706. If acquisition of one face image fails (FALSE), the process advances to step S705.
In S705, the information processing apparatus notifies the teleworker sitting in front of the operation terminal that acquisition of one face image has failed.

  In step S706, the information processing apparatus displays the face image 709 of the teleworker acquired one image, and receives the processing method (registration 710, re-shooting 711, selection of cancel 712) for the face image 709.

In step S 707, the information processing apparatus determines whether the registration 710 is performed. In the case of the registration 710 (TRUE), the process proceeds to S708. In the case of the re-shooting 711 and the cancellation 712 (FALSE), the process proceeds to S702.
The information processing apparatus additionally stores the face image 709 acquired in S <b> 708 in the registration list A in S <b> 708.
After that, the first face authentication means registers the first feature value acquired from the face image 709 additionally stored here by the user for use in authentication.
FIG. 6 will be described.
FIG. 6 is a sequence of shooting a plurality of face images serving as a reference for face authentication in step S607 as a moving image.

In step S801, the information processing apparatus determines whether cancellation is performed. In case of cancellation (TRUE), proceed to END. In the case of not being canceled (FALSE), the process proceeds to S802.
At S802, the information processing apparatus creates a registration list B of temporary classifiers.
In step S803, the information processing apparatus receives a moving image shooting time (for example, 5 seconds).

  In S804, the information processing apparatus uses the photographing unit 210 (WEB camera etc.) provided in the vicinity of the display unit of the information processing apparatus so that the face direction of the teleworker is different, for example, within 5 seconds. The face image of a plurality of the same person (teleworker) taken continuously in In addition, it is necessary to obtain the second feature amount from each face image of a plurality of photographed same persons (teleworkers), and it is necessary to be a still image.

  In addition, here, a moving image may be taken within a predetermined time (for example, about 5 seconds) so that the orientation of the face of the teleworker is different in the moving image (MOVIE) using the photographing means, and in the case of the moving image (MOVIE) It is possible to easily acquire still images of a plurality of the same persons (teleworkers) whose face orientations of the teleworkers are different without putting a load on the teleworkers.

In S805, the information processing apparatus determines whether or not there is each face image that has not been searched among the face images of a plurality of photographed same persons (teleworkers). If there is (TRUE), the process proceeds to S806. If not (FALSE), the process proceeds to step S807.
In S806, the information processing apparatus searches for one face image of the same person (teleworker) out of the face images of a plurality of the same persons (teleworkers) captured continuously.
The loop of S805 to S806 is a loop for searching and extracting all face images (still images) from the captured moving image.

  In S807, the information processing apparatus determines whether or not there are face images for which the same person has not been identified among the face images of a plurality of retrieved same persons (teleworkers). If there is (TRUE), the process proceeds to step S808. If not (FALSE), the process proceeds to step S811.

In S808, the information processing apparatus performs the first feature of the face image (feature obtained from the face image facing the front) already registered in S708 and the second of the face image to be newly captured in S804. The person of the face image to be newly photographed is a face image of the face image registered in advance according to the first criterion which can determine whether the feature amount (the feature amount acquired from the face image not facing the front) is similar. It is determined whether it is the same person as the person (first face authentication means).
The first criterion is (a threshold value for determining that the second feature amount of the image newly captured in S804 is similar based on the registered first feature amount).

  In the branch of the information processing apparatus in S809, when it is determined that the first face authentication unit is the same person as the person of the face image registered (TRUE), the face image is a temporary discriminator It is not saved additionally to the registration list. Conversely, if it is determined that the first face authentication unit is not the same person as the person of the face image already registered (FALSE), the process proceeds to S810, and the face image is added to the registration list of the temporary discriminator Is saved.

When the first reference is used among the face images of the same person (for example, about 20 sheets) taken in S804 in S810, the information processing apparatus is already registered in the first face authentication means in S808. The face of the same person who does not judge that it is the same person as the person in the face image (it is not recognized as the same person by the first standard because it is not the same person but is not facing the front) The number of images (for example, three or so) is extracted (extraction means).
That is, it is determined that the orientation of the face is changed too much and the feature obtained from the selected face image is not similar to the first feature.

Furthermore, here, the extraction unit extracts a plurality of (one or more) face images 811 to 813 of the same person whose face orientations are different (for example, upward, downward, rightward, and leftward). The extracted face images 811 to 813 of the same person are additionally stored in the registration list B of the temporary discriminator.
The face images 811 to 813 of the same person additionally stored in the registration list of the temporary discriminator are listed and displayed in the screen 809.

  In step S811, the information processing apparatus identifies and displays the face image 816 selected by the user, and receives a processing method (registration 818, re-shooting 819, and selecting one of cancels 820) for the face image 816.

In step S812, the information processing apparatus determines whether the registration 818 is performed. In the case of registration 818 (TRUE), the processing proceeds to step S813. In the case of re-shooting 819 and cancellation 820 (FALSE), the process proceeds to S801.
In step S813, the information processing apparatus additionally stores the selected face image 816 in the registration list A.

Here, the feature quantity acquired from the face image 816 manually selected by the user is the third feature quantity (a feature quantity acquired from a face image not facing the front, in order for the second face authentication means to use for authentication. And additionally registered as a feature that is not recognized as the same person in the first criterion.
FIG. 7 will be described.

  FIG. 7 shows the still image of the face in front with the WEB camera, which is displayed by the operation terminal 100 at the time of a sequence for photographing one face image to be the reference of face authentication in S603. Shows the transition of the operation screen.

A screen 700 is a screen for receiving a still image shooting instruction. When the shooting button 703 is pressed by the user, still image shooting is started after 3 seconds, and the still image is stored.
In the screen 707, the face image is registered in the registration list A in step S708 by pressing the registration button 710 in step S707.
FIG. 8 will be described.

  FIG. 8 shows the operation terminal 100 displaying a sequence of shooting a plurality of face images serving as a reference for face authentication in S607 as a moving image, shooting moving pictures of faces of users in various directions with the WEB camera 10 shows transition of an operation screen on which the user selects a face image to be registered in the operation terminal 100.

  A screen 800 is a screen for receiving an instruction to shoot a moving image. When the shooting button 803 is pressed by the user, moving image shooting is started and the moving image is stored. In this screen, a guidance message 801 is issued in the screen so that the user can face in various directions during moving image shooting and face images in various directions can be registered. The guidance message 801 shows a preferred example of guiding means for guiding the user to move the face in the direction different in the direction of the face while the photographing means captures an image in S804. The guide means may be voice guidance.

  A screen 805 is a screen displayed while the shooting button 803 is pressed by the user and shooting a moving image, for example, for 5 seconds. A moving image taken for 5 seconds is cut out as a still image frame by frame and used as a still image of a face image facing various directions. In addition, the remaining shooting time during movie shooting is “3 seconds remaining. Etc. is also displayed.

  A screen 809 displays a list of face images extracted in S810 without being identified as the teleworker himself in S808 and S809. Although the face images listed here are the face images of the teleworker himself, when it is judged whether or not he is the person based on (the direction of the face) of the face image registered at present, Not determined.

The screen 815 is for selecting the face image to be registered by the user in S812, and the face image selected in S813 is registered in the registration list A. When the registration button 818 is pressed after the face image 816 is selected, the selected face image is registered in the registration list A.
FIG. 9 will be described.
The face image information is information for identifying each face image stored for each face image.
Reference numeral 900 denotes a user ID, which is the name or ID of the teleworker.
Reference numeral 905 denotes shooting date and time information, which is the date and time when each face image was acquired.
Reference numeral 906 denotes face image data, which is a face feature that can identify each teleworker individual obtained from each face image.

  Furthermore, an executable program according to the present invention is a program that causes a computer to execute the processing of FIG. 3, FIG. 4, FIG. 5, and FIG. Note that the program in the present invention may be a program for each process of FIG. 3, FIG. 4, FIG. 5, and FIG.

  As described above, the recording medium recording the program for realizing the functions of the above-described embodiments is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing.

  In this case, the program itself read out from the recording medium realizes the novel function of the present invention, and the recording medium recording the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, non-volatile memory card, ROM, EEPROM, silicon A disk etc. can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiment are realized, but also an operating system (OS) or the like running on the computer is actually executed based on the instructions of the program. It goes without saying that the processing is partially or entirely performed, and the processing realizes the functions of the above-described embodiments.

  Furthermore, after the program read from the recording medium is written to the memory provided to the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is read based on the instruction of the program code. It goes without saying that the case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiment are realized by the processing.

  Further, the present invention may be applied to a system constituted by a plurality of devices or to an apparatus comprising a single device. It goes without saying that the present invention can also be applied to the case where it is achieved by supplying a program to a system or apparatus. In this case, by reading a recording medium storing a program for achieving the present invention into the system or apparatus, the system or apparatus can receive the effects of the present invention.

  Further, by downloading and reading out a program for achieving the present invention from a server on a network, a database or the like by a communication program, the system or apparatus can receive the effects of the present invention. In addition, the structure which combined each embodiment mentioned above and its modification is also contained in this invention altogether.

100 Operation terminal (information processing device)
110 Audit terminal 120 Management server

An object of the present invention is to provide a mechanism for additionally registering, as a reference image, an image received by a user from among images not similar to the registered reference image .

The present invention is an information processing apparatus for performing personal authentication using a registered reference image, and an acquisition unit for acquiring a plurality of images captured by a user as the reference image capable of the personal authentication, and the acquisition Screen display means for displaying an image determined to be not similar to the registered reference image among the plurality of images, and the registered reference image from among the displayed images Accepting means for accepting an image to be additionally registered as a reference image used for authentication of the same person by manual selection of the user, and an image manually selected by the user by the reception means for authentication of the same person along with the registered reference image And registration means for additionally registering as a reference image to be used .

In addition, a first acquisition unit that acquires an image of the face of the user, and a face of the user facing in a direction different from the direction of the face of the user of the image acquired by the first acquisition unit. A second acquisition unit for acquiring a plurality of photographed images, and whether or not the plurality of images acquired by the second acquisition unit are similar to the images acquired by the first acquisition unit The screen display means displays an image judged to be not similar to the image acquired by the first acquisition means from among the plurality of images acquired by the second acquisition means. It is characterized by

The present invention is a personal identification system that performs personal identification using a registered reference image, and an acquisition unit that acquires a plurality of images captured by a user as the reference image capable of the personal identification, and the acquisition Screen display means for displaying an image determined to be not similar to the registered reference image among the plurality of images, and the registered reference image from among the displayed images Accepting means for accepting an image to be additionally registered as a reference image used for authentication of the same person by manual selection of the user, and an image manually selected by the user by the reception means for authentication of the same person along with the registered reference image And registration means for additionally registering as a reference image to be used.

According to the present invention, it is possible to provide a mechanism for additionally registering, as a reference image, an image received by the user among images not similar to the registered reference image .

Claims (8)

According to a first criterion that makes it possible to determine whether the first feature value of the registered face image and the second feature value of the face image to be newly captured are similar, a person of the face image to be newly captured is A first face authentication unit that determines whether or not the registered person is the same person as the face image;
Shooting means for shooting face images of a plurality of the same person continuously shot within a predetermined time so that the direction of the face is different;
Among the plurality of photographed face images of the same person, the first face authentication means does not judge that it is the same person as the person of the face image registered, of the same person different in the direction of the face Extraction means for extracting a face image;
According to a second standard obtained by adding the third feature amount of the extracted face image to the first feature amount of the registered face image, the person of the face image to be newly photographed has a face orientation different from that of the face A second face authentication unit that determines whether or not the same person as the extracted person;
An information processing apparatus comprising:   2. The information processing apparatus according to claim 1, further comprising: guide means for guiding the user to move the face in the direction different from the direction of the face while the imaging means captures an image. Event detection means for repeatedly detecting, for each of the operations, event information which is an operation performed by the person to be imaged using the imaging means in front of the imaging means;
And further
3. The event detection method according to claim 1, wherein when the event detection unit detects the event information, event information of the person who has determined that the second face authentication unit is the same person is detected. Information processor as described. An event recording unit that repeatedly records, for each of the operations, event information which is an operation performed by the person to be photographed using the photographing unit in front of the photographing unit;
When the event recording unit records the event information, event information of the person who is determined to be the same person by the second face authentication unit is also recorded together. The information processing apparatus according to any one of 3. According to a first criterion which makes it possible to determine whether the registered face image is similar to the face image to be newly photographed, the person of the face image to be newly photographed is the same person as the person of the registered face image First face authentication means for judging whether or not there is;
Shooting means for shooting face images of a plurality of the same person continuously shot within a predetermined time so that the direction of the face is different;
Among the plurality of photographed face images of the same person, the first face authentication means does not judge that it is the same person as the person of the face image registered, of the same person different in the direction of the face Extraction means for extracting a face image;
Whether the person of the face image to be newly photographed is the same person as the person from which the face images having different face orientations are extracted according to a second criterion in which the extracted face image is added to the registered face image Second face authentication means for determining
An information processing apparatus comprising: According to a first criterion which makes it possible to determine whether the registered face image is similar to the face image to be newly photographed, the person of the face image to be newly photographed is the same person as the person of the registered face image First face authentication means for judging whether or not there is;
Shooting means for shooting face images of a plurality of the same person continuously shot within a predetermined time so that the direction of the face is different;
Among the plurality of photographed face images of the same person, the first face authentication means does not judge that it is the same person as the person of the face image registered, of the same person different in the direction of the face Extraction means for extracting a face image;
Whether the person of the face image to be newly photographed is the same person as the person from which the face images having different face orientations are extracted according to a second criterion in which the extracted face image is added to the registered face image Second face authentication means for determining
A face recognition system comprising: A first face authentication unit of an information processing apparatus is capable of determining whether a first feature value of a registered face image is similar to a second feature value of a face image to be newly captured. A first face authentication step of determining whether or not the person of the face image to be newly photographed is the same person as the person of the face image registered according to the criteria;
A photographing step of photographing the face images of a plurality of the same person continuously photographed within a predetermined time so that the photographing means of the information processing apparatus changes the face direction;
The extraction unit of the information processing apparatus does not determine that the first face authentication unit is the same person as the person of the face image registered from among the plurality of photographed face images of the same person. Extracting the face image of the same person different in the direction of the face;
A face to be newly photographed according to a second criterion in which a second face authentication unit of the information processing apparatus adds a third feature of the extracted face image to a first feature of the registered face image. A second face authentication step of determining whether or not the person in the image is the same person as the person whose face image having a different face orientation is extracted;
And controlling the information processing apparatus. An information processor,
According to a first criterion that makes it possible to determine whether the first feature value of the registered face image and the second feature value of the face image to be newly captured are similar, a person of the face image to be newly captured is A first face authentication unit that determines whether or not the registered person is the same person as the face image;
Shooting means for shooting face images of a plurality of the same person continuously shot within a predetermined time so that the direction of the face is different;
Among the plurality of photographed face images of the same person, the first face authentication means does not judge that it is the same person as the person of the face image registered, of the same person different in the direction of the face Extraction means for extracting a face image;
According to a second standard obtained by adding the third feature amount of the extracted face image to the first feature amount of the registered face image, the person of the face image to be newly photographed has a face orientation different from that of the face A second face authentication unit that determines whether or not the same person as the extracted person;
A program that can be read and executed by the information processing apparatus characterized in that the program functions.

Images