JP2022123030A - Information processing apparatus, method for controlling the same, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a telework management system that prepares a plurality of types of feature quantities of a same person different in a face direction so that face recognition of the same person is not affected by a direction of a user's face even when the face recognition of the same person is performed a number of times in a day.

SOLUTION: An information processing apparatus comprises first face recognition means that determines whether a person in a face image to be newly photographed is a same person in a registered face image according to a first reference with which similarity between a first feature quantity of the registered face image and a second feature quantity of the face image to be newly photographed can be discriminated, and the information processing apparatus consecutively photographs face images of the same person in a predetermined time so that the images have different face directions and extracts, from among the face images, face images of the same person not determined to be the same person as the person in the face image registered in the first face recognition means and having different face directions. The information processing apparatus determines if the person in the face image to be newly photographed is the same person as the person for whom the face images with different face directions are extracted according to a second reference obtained by adding a third feature quantity of the extracted face images to the first feature quantity of the registered face image.

SELECTED DRAWING: Figure 8

COPYRIGHT: (C)2022,JPO&INPIT

Description

The present invention relates to a telework management system.

In recent years, due to the development of broadband and information security technology, as well as attention to business continuity and power saving measures in the event of a disaster, companies are increasingly interested in telework, in which users work from home or other remote locations. . When introducing telework, it is difficult for managers to see what is going on, so there are problems such as the risk of confidential information being leaked due to access to information processing terminals by third parties such as family members, and the difficulty of labor management.

In the prior art, if the user's appearance changes daily, such as with or without glasses, the determination criteria acquired from the reference face image for face recognition of the same person will fluctuate, and the recognition rate of the same person will fluctuate daily. In order to solve this problem, the degree of similarity between the feature amount of the previously registered reference face image and the feature amount of the face image newly captured by the camera is checked, and the degree of similarity satisfies the allowable value (similarity). ), the event is detected using the feature amount of the previously registered reference face image. On the other hand, if the similarity does not satisfy the allowable value (it is determined that they are not similar), the face image is acquired from a new face image taken with a camera in order to increase the recognition rate of the same person without being affected by the user's appearance. A technique for detecting an event by using a temporary feature value is disclosed.

JP 2015-103198 A

The prior art is a technology that replaces the feature amount for face recognition of the same person according to the appearance of the user on that day, and has the effect of increasing the recognition rate of the same person without being affected by the appearance of the user on that day.

During work, teleworkers may face up, down, left, or right in various directions. In order to accurately detect an event regardless of the direction of the face, it is necessary to detect the event using face images captured from various angles.

In this way, in the case where the face recognition of the same person is performed many times during the day and an action event is detected each time, the direction of the user's face is not good at the timing when the action event is to be detected. It is necessary to assume the case where the face is difficult to see), and it is possible to detect motion events without being affected by the direction of the user's face. need to prepare.

According to the present invention, when face recognition of the same person is performed many times during the day, a plurality of types of feature amounts of the same person with different face orientations are used so that the orientation of the user's face is not affected. The purpose is to provide a mechanism that can be prepared.

According to the present invention, a face image to be newly shot according to a first criterion that can determine whether or not a first feature amount of a registered face image and a second feature amount of a newly shot face image are similar to each other. a first face authentication means for determining whether or not the person is the same person as the person in the registered face image; and a photographing means for photographing a face image of the same person, and the first face authentication means detects that the person is the same person as the registered face image from among the plurality of photographed face images of the same person. an extracting means for extracting face images of the same person with different face orientations, and a third feature quantity obtained by adding a third feature quantity of the extracted face image to the first feature quantity of the registered face image; a second face authentication means for determining whether or not the person in the face image to be newly photographed is the same person as the person from whom the face image with a different face orientation was extracted, according to the criteria of 2. An information processing device characterized by:

According to the present invention, the first face authentication means of the information processing device can determine whether or not the first feature amount of the registered face image and the second feature amount of the newly captured face image are similar. a first face authentication step for determining whether or not the person in the face image to be newly photographed is the same person as the person in the registered face image according to a first standard; However, a photographing step of photographing a plurality of face images of the same person consecutively photographed within a predetermined time so that the orientation of the face differs; an extracting step of extracting, from the face images of a person, a face image of the same person whose face orientation is different and which is not determined by the first face authentication means to be the same person as the person of the registered face image; Then, the second face authentication means of the information processing device performs new photographing according to a second standard obtained by adding the third feature quantity of the extracted face image to the first feature quantity of the registered face image. and a second face authentication step of determining whether or not the person in the face image is the same as the person from whom the face image with the different face orientation is extracted. control method.

According to the present invention, an information processing apparatus according to a first criterion capable of determining whether or not a first feature amount of a registered face image and a second feature amount of a newly captured face image are similar, a first face authentication means for determining whether or not a person in a face image to be newly photographed is the same person as a person in a registered face image; a photographing means for photographing a plurality of face images of the same person photographed by the first face authentication means; Extracting means for extracting face images of the same person with different face orientations, which are not determined to be the same person, and a third feature of the extracted face images as a first feature amount of the registered face images. a second face authentication means for determining whether or not the person in the face image to be newly photographed is the same person as the person from whom the face image with a different face orientation is extracted, according to a second criterion including a quantity; , a program that can be read and executed by the information processing apparatus.

According to the present invention, when face recognition of the same person is performed many times during the day, multiple types of feature amounts of the same person with different face orientations are used so that the orientation of the user's face is not affected. It is possible to provide a mechanism that can be prepared.

1 is a system configuration diagram showing an example of the configuration of a telework management system of the present invention; FIG. 3 is a block diagram showing the hardware configuration of an information processing device applicable to the operation terminal 100, inspection terminal 110, and management server 120 of the present invention; FIG. 10 is a flow chart showing an example of operation event detection and recording processing performed by the operation terminal 100 while a user is performing telework using the telework management system of the present invention. 4 is a flow chart showing a sequence for registering a face image that serves as a reference for face authentication in the present invention; 4 is a flow chart showing a sequence of photographing one face image that serves as a reference for face authentication in the present invention. 4 is a flow chart showing a sequence of photographing a plurality of moving images of face images to be used as a reference for face authentication in the present invention. 4A and 4B show transitions of operation screens for registering face images in the operation terminal in the present invention. 4 shows transition of operation screens for the user to select a face image to be registered in the operation terminal according to the present invention. 4 shows an example of face image data registered in the operating terminal in the present invention.

First, the outline of the present invention will be explained.

The telework management system of the present invention uses face recognition technology to detect motion events of teleworkers (motion events such as "sitting down" and "leaving", and "spoofing" and "peeping" by third parties other than teleworkers). A system that detects and records security incidents) and allows administrators to view them.

When a teleworker starts work, a photo of the teleworker's face is taken, and personal authentication is performed using the photo of the face and the feature value of the face image that is first guaranteed to be the teleworker. A degree of possibility (authentication level) is calculated (hereafter, a face image and its feature amount are collectively referred to as a feature amount, and the feature amount used for personal authentication is referred to as an authentication feature amount).
FIG. 1 will be explained.
BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a system configuration diagram showing an example of the configuration of the telework management system of the present invention.

FIG. 1 shows a configuration in which one or more operation terminals 100, one or more audit terminals 110, and one or more management servers 120 are connected via a local area network (LAN) 130, a router 140, and the Internet 150. It has become.

The operation terminal 100 detects operational events and security incidents of the teleworker to be used, and transmits the trail to the management server 120 . In addition, it transmits to the management server 120 the feature amount of the teleworker (the face image and the feature amount obtained therefrom) used for motion event detection.
The inspection terminal 110 performs an operation of approving the feature amount recorded in the management server 120 and an operation of auditing the trail recorded in the management server 120 .

The management server 120 records the trail received from the operation terminal 100 and processes audit operations of the audit terminal 110 for the trail. Also, the feature amount received from the operation terminal 100 is recorded, and the approval operation of the inspection terminal 110 for the feature amount is processed.
A face authentication system can be constructed using the operation terminal 100 and the management server 120 of the present invention, which will be described later.
FIG. 2 will be explained.
A hardware configuration of an information processing apparatus applicable to the operation terminal 100, the audit terminal 110, and the management server 120 shown in FIG. 1 will be described below with reference to FIG.
FIG. 2 is a block diagram showing the hardware configuration of an information processing device applicable to the operation terminal 100, audit terminal 110, and management server 120 shown in FIG.

In FIG. 2, reference numeral 201 denotes a CPU that controls devices and controllers connected to a system bus 204 in an integrated manner. The ROM 203 or the external memory 212 stores the BIOS (Basic Input/Output System), which is the control program for the CPU 201, an operating system program (hereinafter referred to as OS), and the functions executed by each server or each PC. Various programs, etc., which will be described later, are stored.

A RAM 203 functions as a main memory, a work area, and the like for the CPU 201 . The CPU 201 loads programs and the like necessary for executing processing from the ROM 203 or the external memory 212 to the RAM 202, and executes the loaded programs to realize various operations.

An input controller 205 controls input from a keyboard (KB) 209, a camera device 210 (imaging device), and a pointing device such as a mouse (not shown). A video controller 206 controls display on a display device such as a CRT display (CRT) 211 or the like. Although the CRT 211 is shown in FIG. 2, the display may be not only the CRT but also other display such as a liquid crystal display. These are for use by administrators as needed.

A memory controller 207 stores a boot program, various applications, font data, user files, edit files, various data, and the like in an external storage device (hard disk (HD)), a flexible disk (FD), or a PCMCIA card slot. It controls access to an external memory 212 such as Compact Flash (registered trademark) memory connected via an adapter.

A communication I/F controller 208 connects and communicates with an external device via a network (for example, the LAN 130 shown in FIG. 1), and executes communication control processing in the network. For example, communication using TCP/IP is possible.

It should be noted that the CPU 201 enables display on the CRT 211 by, for example, rasterizing an outline font to a display information area in the RAM 202 . The CPU 201 also allows the user to issue instructions with a mouse cursor (not shown) on the CRT 211 .

Various programs described later for realizing the present invention are recorded in the external memory 212 and are executed by the CPU 201 by being loaded into the RAM 202 as necessary. Furthermore, definition files and various information tables used when executing the above programs are also stored in the external memory 212, and detailed descriptions thereof will be given later.
FIG. 3 will be explained.

Hereinafter, with reference to FIG. 3, processing by a resident application that operates on the operation terminal 100 used by teleworkers in the telework management system of the present invention will be described.
The processing shown in the flowchart of FIG. 3 is processing in which the CPU 201 of the operation terminal 100 reads and executes a predetermined control program.

FIG. 3 shows that after registration of a face image that serves as a reference for face authentication in FIG. 4 is completed, an individual's face is authenticated, and a WEB camera is used to detect and record an action event that authenticates each individual. It is a sequence that is performed during work.

In S401, when the user logs into the operating terminal 100, the operating terminal 100 activates a resident application and logs into the management server 120 in the background using the teleworker's account ID and password. The management server 120 compares it with the teleworker information stored in the account storage unit 128, and permits login if the information matches. The account ID and password are set by the user when the resident application is started for the first time, and the set values are used thereafter.

In S402, each time an action event of a teleworker occurs, the possibility that the user using the operation terminal 100 is a teleworker registered in the management server 120 is calculated. Get the feature quantity that

In S402, the information processing apparatus captures the face image of the person (teleworker) as a moving image while the teleworker is working, using the photographing means 210 (such as a web camera) provided near the display unit of the information processing apparatus. to shoot. A fourth feature quantity (feature quantity obtained from face images facing various directions) is acquired from the still image of each face image newly captured. When judging whether a person is the same person as the person of the face image that has already been registered using the fourth feature amount, the distinguishable first criterion is the third character of the face image registered in S813. It is judged whether the person of the face image to be newly compared is the same person as the person of the already registered face image according to the second standard including the feature amount of (second face authentication means).

The second criterion is (threshold value for determining that the fourth feature amount of the image newly captured in S402 is similar to the registered first feature amount) + (registered third feature amount) (threshold value for judging that the fourth feature value of a newly captured image is similar) based on the feature value of .

By satisfying the second criterion, the person is recognized as the same person, and even in a case where it is necessary to continuously perform face authentication using the photographing means 210 (web camera, etc.), the direction of the face has changed by chance. The same person can be recognized with high accuracy even at the timing when the person was at the same time.

At S<b>403 , operation events (labor operation events such as “sitting” and “leaving” and security incidents such as “spoofing” and “peeping”) are detected, and the trace thereof is transmitted to the management server 120 .

In S<b>403 , the information processing apparatus captures event information, which is an action performed by a person (teleworker) in front of the photographing means (web camera) using the photographing means (web camera), and the details of the actions of the person photographed in real time. By analyzing the image, it is repeatedly detected for each motion of the photographed person (event detection means). Here, when the event detection means detects event information (sitting, leaving, spoofing, peeping), it also detects the event information of the person judged to be the same person by the first face authentication means in S808, and further The event information of the person judged to be the same person by the second face authentication means in S402 is also detected. As a result, even if the direction of the face is different, the range of recognition of the same person is widened, the recognition rate of the same person is improved, and even if the direction of the face is different, the event information (sitting, leaving, looking in) can be accurately recognized. ) can be detected.

In step S403, the information processing apparatus captures event information, which is an action performed in front of the photographing means (WEB camera) by the person photographed using the photographing means (WEB camera), as an image of the action details of the person photographed in real time. By analyzing, the motion of the photographed person is repeatedly recorded (event recording means). Here, when the event recording means records event information (sitting, leaving, spoofing, peeping), the event information of the person judged to be the same person by the first face authentication means in S808 is also recorded, The event information of the person judged to be the same person by the second face authentication means in S402 is also recorded. As a result, even if the direction of the face is different, the range of recognition of the same person is widened and the recognition rate of the same person is improved. ) can be recorded as the trail.
In S404, when the user logs out of the operation terminal 100, the operation terminal 100 logs out of the management server 120 in the background.
FIG. 4 will be explained.

FIG. 4 shows a sequence for registering a face image that serves as a reference for face authentication as a preparation before starting telework. After registering a face image that serves as a reference for face authentication in FIG. 4, detection and recording of action events in FIG. 3 can be performed during telework.
In S601, the information processing apparatus creates a registration list A for registering face images that serve as a reference for face authentication.

In S<b>602 , the information processing apparatus determines whether or not the face image already in the registration list A can be used for face authentication. If it is face authentication (TRUE), the process proceeds to S604. In the case of face authentication failure (FALSE), the process proceeds to S603.
10 is a flowchart of a sequence in which the information processing apparatus captures one face image that serves as a reference for face authentication in S603. Details thereof will be described with reference to FIG.
In S604, the information processing apparatus accepts the shooting method.

In S605, the information processing apparatus determines whether the accepted shooting method is a sequence of shooting one face image or a sequence of shooting a plurality of images. If it is determined that the sequence is for shooting one image, the process advances to step S603. If it is determined that the sequence is for shooting a plurality of images, the process advances to step S607.

In S606, the information processing apparatus determines whether the created registration list A is empty. If it is determined to be empty (TRUE), the process proceeds to S608. If it is determined that it is not empty (FALSE), the process proceeds to S607.
10 is a flowchart of a sequence in which the information processing apparatus in S607 captures a plurality of moving images of face images that are used as a reference for face authentication. Details thereof will be described with reference to FIG.

In S608, the information processing apparatus determines whether or not the created registration list A is empty. If it is determined to be empty (TRUE), the process proceeds to S616. If it is determined that it is not empty (FALSE), the process proceeds to S609.
Steps S609 to S614 are not related to the present invention, so description thereof will be omitted.
FIG. 5 will be explained.
FIG. 5 shows a sequence for capturing one face image that serves as a reference for face authentication in S603.

In S701, the information processing apparatus determines whether or not to cancel. In the case of cancellation (TRUE), proceed to END. If it is not canceled (FALSE), the process proceeds to S702.
In S<b>702 , the information processing apparatus accepts shooting timing when the user presses the shooting button 702 on the screen 700 .

In S703, the information processing apparatus captures a face image using the web camera 210 three seconds after the user presses the button, and acquires one face image of the teleworker sitting in front of the operation terminal.

In S704, the information processing apparatus determines whether or not one face image has been acquired successfully. If acquisition of one face image is successful (TRUE), the process proceeds to S706. If acquisition of one face image fails (FALSE), the process advances to S705.
In S705, the information processing apparatus notifies the teleworker sitting in front of the operation terminal that acquisition of one face image has failed.

In S706, the information processing apparatus displays the acquired face image 709 of the teleworker and accepts a processing method for the face image 709 (select one from registration 710, re-shooting 711, and cancel 712).

In S<b>707 , the information processing apparatus determines whether registration 710 is performed. In the case of registration 710 (TRUE), the process proceeds to S708. In the case of re-imaging 711 and cancellation 712 (FALSE), the process proceeds to S702.
In S<b>708 , the information processing apparatus additionally saves the acquired face image 709 in the registration list A. FIG.
After that, the first feature amount acquired from the face image 709 additionally saved by the user here is registered for use in authentication by the first face authentication means.
FIG. 6 will be explained.
FIG. 6 shows a sequence for photographing a plurality of moving images of face images that serve as a reference for face authentication in S607.

In S801, the information processing apparatus determines whether or not to cancel. In the case of cancellation (TRUE), proceed to END. If it is not canceled (FALSE), the process proceeds to S802.
In S802, the information processing apparatus creates a registration list B of temporary discriminators.
In S<b>803 , the information processing apparatus receives the shooting time of the moving image (for example, 5 seconds).

In S804, the information processing apparatus uses the photographing means 210 (such as a web camera) provided near the display unit of the information processing apparatus to change the direction of the face of the teleworker within a predetermined time (for example, about 5 seconds). A plurality of face images of the same person (teleworker) are taken continuously. In addition, it is necessary to acquire the second feature amount from each face image of the same person (teleworker) in a plurality of shots, and the face images must be still images.

Also, here, using the shooting means, a video within a predetermined time (for example, about 5 seconds) may be shot so that the direction of the teleworker's face is different in the video (MOVIE). , it is possible to easily acquire a plurality of still images of the same person (teleworker) with different face orientations without imposing a burden on the teleworker.

In S<b>805 , the information processing apparatus determines whether or not there is a face image that has not been searched among the plurality of photographed face images of the same person (teleworker). If there is (TRUE), the process proceeds to S806. If not (FALSE), the process proceeds to S807.
In S806, the information processing apparatus searches for one face image of the same person (teleworker) from a plurality of consecutively shot face images of the same person (teleworker).
A loop from S805 to S806 is a loop for searching and extracting all face images (still images) from the captured moving image.

In S<b>807 , the information processing apparatus determines whether or not there is a facial image for which it has not been determined whether it is the same person among the plurality of retrieved facial images of the same person (teleworker). If there is (TRUE), the process proceeds to S808. If not (FALSE), the process proceeds to S811.

In S808, the information processing apparatus combines the first feature amount of the face image already registered in S708 (the feature amount acquired from the face image facing the front) and the second feature amount of the face image to be newly captured in S804. According to a first standard that can determine whether or not the feature amount (feature amount obtained from a face image not facing the front) is similar, the person in the face image to be newly taken is compared with the face image that has already been registered. It is determined whether the person is the same as the person (first face authentication means).
The first criterion is (threshold for judging that the second feature amount of the image newly captured in S804 is similar to the registered first feature amount).

In the branching of the information processing apparatus in S809, if the first face authentication means determines that the person is the same as the person in the face image that has already been registered (TRUE), the face image is used by the temporary classifier. It is not added to the registration list and saved. Conversely, if the first face authentication means determines that the person is not the same person as the face image that has already been registered (FALSE), the process proceeds to S810, and the face image is added to the registration list of the temporary discriminator. Saved.

In S810, the information processing apparatus uses the first standard from among a plurality of (for example, about 20) facial images of the same person photographed in S804, and uses the first criteria to identify the facial images that have already been registered by the first face authentication means in S808. It is not determined that the person is the same person as the person in the face image that is present (the same person is not recognized as the same person according to the first criterion because the person is not facing the front), and the face of the same person whose face direction is different The number of images (for example, about 3) is extracted (extraction means).
In other words, it is determined that the feature amount acquired from the selected face image is not similar to the first feature amount because the orientation of the face has changed too much.

Furthermore, here, the extracting means extracts a plurality of (one or more) face images 811 to 813 of the same person with different face orientations (for example, upward, downward, rightward, leftward). The extracted face images 811 to 813 of the same person are additionally saved in the registration list B of the temporary discriminator.
The face images 811 to 813 of the same person added and saved in the registration list of the temporary discriminator are listed on the screen 809 .

In S811, the information processing apparatus identifies and displays the face image 816 selected by the user, and accepts a processing method for the face image 816 (select one of registration 818, re-capture 819, and cancel 820).

In S812, the information processing apparatus determines whether registration 818 is performed. In the case of registration 818 (TRUE), the process proceeds to S813. In the case of re-imaging 819 and cancellation 820 (FALSE), the process proceeds to S801.
In S813, the information processing apparatus additionally saves the selected face image 816 in the registration list A. FIG.

The feature quantity acquired from the face image 816 manually selected by the user here for use in authentication by the second face authentication means is the third feature quantity (feature quantity acquired from the face image not facing the front). and is not recognized as the same person under the first criterion).
FIG. 7 will be explained.

FIG. 7 shows a still image of a front face captured by a web camera and registered in the operation terminal 100 as a reference for face recognition. It shows the transition of the operation screen to be performed.

A screen 700 is a screen for receiving an instruction to shoot a still image. When the shooting button 703 is pressed by the user, still image shooting is started after three seconds, and the still image is stored.
On the screen of 707, by pressing the registration button 710 in S707, the face image is registered in the registration list A in S708.
FIG. 8 will be explained.

FIG. 8 shows a sequence of capturing a plurality of moving images of a face image that serves as a reference for face recognition in S607. It shows the transition of the operation screen for the user to select the face image to be registered in the operation terminal 100 .

A screen 800 is a screen for receiving an instruction to shoot a moving image. When the shooting button 803 is pressed by the user, movie shooting is started and the movie is stored. On this screen, a guide message 801 is displayed on the screen so that the user can look in various directions during moving image shooting and register face images in various directions. The guide message 801 is a preferred example of guide means for guiding the user to move his or her face in a different direction while the photographing means takes an image in S804. Note that the guidance means may be voice guidance.

A screen 805 is displayed while the user presses the shooting button 803 to shoot a moving image for, for example, five seconds. A moving image shot for 5 seconds is cut out into still images frame by frame, and used as still images of face images facing various directions. Also, during movie shooting, the remaining shooting time "Remaining 3 seconds. etc.” is also displayed.

A screen 809 displays a list of face images extracted in S810 without being identified as the teleworker in S808 and S809. The face images listed here are those of teleworkers themselves. Not discriminated.

A screen of 815 is for selecting a face image to be registered by the user in S812, and the face image selected in S813 is registered in the registration list A. FIG. The selected face image is registered in the registration list A by pressing the registration button 818 after the face image 816 is selected.
FIG. 9 will be explained.
The face image information is information for identifying each face image stored for each face image.
A user ID 900 is the name or ID of the teleworker.
Photographing date and time information 905 is the date and time when each face image was acquired.
Reference numeral 906 denotes face image data, which is a feature amount of a face that can be used to identify each individual teleworker acquired from each face image.

Also, the executable program in the present invention is a program that causes a computer to execute the processes shown in FIGS. The program in the present invention may be a program for each process in FIGS. 3, 4, 5, and 6. FIG.

As described above, a recording medium recording a program for realizing the functions of the above-described embodiments is supplied to a system or device, and the computer (or CPU or MPU) of the system or device reads the program stored in the recording medium. Needless to say, the object of the present invention can also be achieved by reading and executing.

In this case, the program itself read from the recording medium implements the novel functions of the present invention, and the recording medium recording the program constitutes the present invention.

Examples of recording media for supplying programs include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, silicon A disk or the like can be used.

Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but also based on the instructions of the program, the OS (operating system) and the like running on the computer are actually executed. Needless to say, a case where part or all of the processing is performed and the functions of the above-described embodiments are realized by the processing are included.

Furthermore, after the program read from the recording medium is written in the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board is read according to the instruction of the program code. It goes without saying that a case where a CPU or the like provided in a function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

Moreover, the present invention may be applied to a system composed of a plurality of devices or to an apparatus composed of a single device. Further, it goes without saying that the present invention can be applied to the case where it is achieved by supplying a program to a system or apparatus. In this case, by loading a recording medium storing a program for achieving the present invention into the system or device, the system or device can enjoy the effects of the present invention.

Furthermore, by downloading and reading out the program for achieving the present invention from a server, database, etc. on the network using a communication program, the system or device can enjoy the effects of the present invention. It should be noted that all configurations obtained by combining each of the above-described embodiments and modifications thereof are also included in the present invention.

100 operation terminal (information processing device)
110 Audit terminal 120 Management server

SUMMARY OF THE INVENTION It is an object of the present invention to provide a mechanism capable of efficiently registering a face image specifying a person from acquired face images of the person .

The present invention is an information processing apparatus for registering a face image specifying a person from acquired face images of the person, wherein the first face image acquired by a first photographing method is used as the face image specifying the person. and a second face image acquired by a second imaging method, based on the registered first face image, a face image that can identify a person corresponding to the first face image and receiving means for accepting an instruction as to whether to register the second face image as a face image for specifying the person when the person is not .

The present invention is an information processing apparatus for registering a face image specifying a person from acquired face images of the person, wherein the first face image acquired by a first photographing method is used as the face image specifying the person. and a registration means for registering the person as the second face image when the second face image acquired by the second imaging method is not similar to the registered first face image. an information processing apparatus comprising: reception means for receiving an instruction as to whether to register the face image as a specified face image .

According to the present invention, it is possible to provide a mechanism capable of efficiently registering a face image specifying a person from acquired face images of the person .

Claims (8)

The person in the face image to be newly taken is determined according to a first standard that can determine whether the first feature amount of the registered face image is similar to the second feature amount of the face image to be newly taken. a first face authentication means for determining whether the person is the same person as the person in the registered face image;
a photographing means for photographing a plurality of face images of the same person consecutively photographed within a predetermined period of time so that the faces are facing in different directions;
Among the plurality of photographed face images of the same person, the first face authentication means does not determine that the person is the same person as the person of the registered face image, and the same person whose face direction is different is not determined. an extraction means for extracting a face image;
According to a second standard obtained by adding the third feature amount of the extracted face image to the first feature amount of the registered face image, the person in the face image to be newly photographed has a different face orientation from the face image. a second face authentication means for determining whether or not the extracted person is the same person;
An information processing device comprising: 2. The information processing apparatus according to claim 1, further comprising guiding means for guiding the user to move the face in a direction in which the orientation of the face is different while the photographing means takes an image. event detection means for repeatedly detecting event information, which is an action performed in front of the photographing means by a person photographed using the photographing means, for each action;
further comprising
3. When the event detection means detects the event information, the event information of the person determined to be the same person by the second face authentication means is detected. The information processing device described. event recording means for repeatedly recording event information, which is an action performed in front of the photographing means by a person photographed using the photographing means, for each action;
10. The event recording means records the event information together with the event information of the person judged to be the same person by the second face authentication means. 4. The information processing device according to any one of 3. The person in the newly captured face image is determined to be the same person as the registered face image according to a first standard that can determine whether the registered face image and the newly captured face image are similar. a first face authentication means for determining whether or not there is
a photographing means for photographing a plurality of face images of the same person consecutively photographed within a predetermined period of time so that the faces are facing in different directions;
Among the plurality of photographed face images of the same person, the first face authentication means does not determine that the person is the same person as the person of the registered face image, and the same person whose face direction is different is not determined. an extraction means for extracting a face image;
According to a second criterion obtained by adding the extracted face image to the registered face image, whether or not the person of the face image to be newly photographed is the same person as the person from whom the face image with a different face orientation was extracted. a second face authentication means for determining whether
An information processing device comprising: The person in the newly captured face image is determined to be the same person as the registered face image according to a first standard that can determine whether the registered face image and the newly captured face image are similar. a first face authentication means for determining whether or not there is
a photographing means for photographing a plurality of face images of the same person consecutively photographed within a predetermined period of time so that the faces are facing in different directions;
Among the plurality of photographed face images of the same person, the first face authentication means does not determine that the person is the same person as the person of the registered face image, and the same person whose face direction is different is not determined. an extraction means for extracting a face image;
According to a second criterion obtained by adding the extracted face image to the registered face image, whether or not the person of the face image to be newly photographed is the same person as the person from whom the face image with a different face orientation was extracted. a second face authentication means for determining whether
A face authentication system comprising: A first face authentication means of an information processing apparatus is capable of determining whether a first feature amount of a registered face image and a second feature amount of a newly captured face image are similar to each other. a first face authentication step of determining whether or not the person in the face image to be newly photographed is the same person as the person in the registered face image, according to a standard;
a photographing step in which the photographing means of the information processing apparatus photographs a plurality of face images of the same person consecutively photographed within a predetermined period of time so that the faces are oriented differently;
The extracting means of the information processing device does not determine that the first face authentication means is the same person as the registered face image from among the plurality of photographed face images of the same person. an extraction step of extracting face images of the same person with different face orientations;
The second face authentication means of the information processing device, according to a second reference obtained by adding the third feature amount of the extracted face image to the first feature amount of the registered face image, the newly photographed face. a second face authentication step of determining whether or not the person in the image is the same person as the person from whom the face image with the different face direction is extracted;
A control method for an information processing device, comprising: information processing equipment,
The person in the face image to be newly taken is determined according to a first standard that can determine whether the first feature amount of the registered face image is similar to the second feature amount of the face image to be newly taken. a first face authentication means for determining whether the person is the same person as the person in the registered face image;
a photographing means for photographing a plurality of face images of the same person consecutively photographed within a predetermined period of time so that the faces are facing in different directions;
Among the plurality of photographed face images of the same person, the first face authentication means does not determine that the person is the same person as the person of the registered face image, and the same person whose face direction is different is not determined. an extraction means for extracting a face image;
According to a second standard obtained by adding the third feature amount of the extracted face image to the first feature amount of the registered face image, the person in the face image to be newly photographed has a different face orientation from the face image. a second face authentication means for determining whether or not the extracted person is the same person;
A program that can be read and executed by the information processing apparatus.

Images