JP6788205B2 - Information processing device, personal authentication system, its control method, personal authentication method, its program - Google Patents

Description

The present invention relates to a telework management system.

In recent years, with the development of broadband and information security technologies, as well as attention to business continuity and power saving measures in the event of a disaster, companies are becoming more interested in teleworking where users work in remote areas such as homes. .. When introducing telework, it is difficult for the administrator to see the situation, so there is a risk that confidential information will be leaked due to access to the information processing terminal by a third party such as a family member, and there is a problem that labor management is difficult.

In the prior art, if the user's appearance changes daily with or without glasses, the judgment criteria acquired from the reference face image for face recognition of the same person will be blurred, and the recognition rate of the same person will fluctuate daily. In order to solve the problem, look at the similarity between the feature amount of the previously registered reference face image and the feature amount of the face image newly taken with the camera, and the similarity satisfies the allowable value (similarity). If it is determined that it is), the event is detected using the feature amount of the previously registered reference face image. On the contrary, when the similarity does not meet the permissible value (determined that they are not similar), it is acquired from a face image newly taken by a camera in order to increase the recognition rate of the same person without being affected by the appearance of the user. A technique for detecting an event by using a temporary feature amount is disclosed.

JP-A-2015-103198

The prior art is a technique for replacing the feature amount for face recognition of the same person according to the appearance of the user on that day, and has the effect of increasing the recognition rate of the same person without being affected by the appearance of the user on that day.

Teleworkers can turn up, down, left, and right during work. In order to detect an event accurately in any direction, it is necessary to detect the event using face images taken from various angles.

In this way, in the case where the face of the same person is recognized many times during the day and the motion event is detected each time, the orientation of the user's face is not good at the timing when the motion event is to be detected (from the WEB camera). It is necessary to assume a case where it is difficult to see the face when looking at it), and multiple types of features that can detect motion events without being affected by the orientation of the user's face, etc. You need to prepare.

An object of the present invention is to provide a mechanism for additionally registering an image received by a user as a reference image from among images that are not similar to the registered reference image .

The present invention is an information processing apparatus that performs personal authentication using a registered reference image, and is a first acquisition means for acquiring an image of a user's face as a reference image capable of personal authentication. A second acquisition means for acquiring a plurality of images in which the user 's face is taken in a direction different from the direction of the user 's face in the image acquired by the first acquisition means, and the first acquisition means . It is determined whether or not the plurality of images acquired by the second acquisition means are similar to the images acquired by the first acquisition means, and it is not similar to the images acquired by the first acquisition means. Among the selection means for selecting the determined image from the plurality of images acquired by the second acquisition means and the plurality of images acquired by the second acquisition means selected by the selection means. Displays an image determined not to be similar to the image acquired by the first acquisition means, and among a plurality of images acquired by the second acquisition means that were not selected by the selection means. a screen display unit for the first from the image acquired by the acquisition unit is determined to be similar image is controlled so as not to display, from among the displayed the image in the first obtaining means A reception means that accepts an image that is additionally registered as a reference image used for authentication of the same person together with the acquired image by the user's manual selection, and an image that is manually selected by the user by the reception means is said to be the first for personal authentication. It is characterized by including a registration means for additionally registering as a reference image used for authentication of the same person together with the image acquired by the acquisition means of 1 .

The present invention is a control method of an information processing device that performs personal authentication using a registered reference image, and a first acquisition means of the information processing device is a user's face as a reference image capable of personal authentication. The first acquisition step of acquiring the captured image and the second acquisition means of the information processing apparatus are in a direction different from the orientation of the user's face in the image acquired in the first acquisition step. The second acquisition step of acquiring a plurality of images of the user 's face facing the user , and the plurality of images acquired by the selection means of the information processing apparatus in the second acquisition step are the first. It is determined whether or not the image is similar to the image acquired in the first acquisition step, and the image determined not to be similar to the image acquired in the first acquisition step is acquired in the second acquisition step. The selection step of selecting from the plurality of images selected, and the first of the plurality of images acquired by the screen display means of the information processing apparatus in the second acquisition step selected in the selection step. The image determined to be dissimilar to the image acquired in the acquisition step of is displayed, and among the plurality of images acquired in the second acquisition step that were not selected in the selection step, the first image is displayed . The screen display step of controlling not to display an image determined to be similar to the image acquired in the acquisition step, and the receiving means of the information processing apparatus are the first among the displayed images . The reception process of accepting an image additionally registered as a reference image used for authentication of the same person together with the image acquired in the acquisition step 1 by the user's manual selection, and the registration means of the information processing apparatus are manually selected by the user in the reception process. It is characterized by including a registration step of additionally registering the image as a reference image used for authentication of the same person together with the image acquired in the first acquisition step for personal authentication .

The present invention is a program that can be read and executed by an information processing device that performs personal authentication using a registered reference image, and the user's face is photographed using the information processing device as a reference image that enables personal authentication. A plurality of images in which the first acquisition means for acquiring the image and the user's face in the image acquired by the first acquisition means are oriented in a direction different from the orientation of the user 's face. determining a second acquisition means for acquiring, whether the second plurality of images obtained by the obtaining unit is similar to the image acquired by the first acquisition means, said first acquisition A selection means for selecting an image determined not to be similar to the image acquired by the means from a plurality of images acquired by the second acquisition means, and the second selection means selected by the selection means. Among the plurality of images acquired by the first acquisition means, the image determined to be not similar to the image acquired by the first acquisition means is displayed, and the second image that is not selected by the selection means is displayed . A screen display means for controlling not to display an image determined to be similar to the image acquired by the first acquisition means among a plurality of images acquired by the acquisition means, and the displayed display. From the images, a reception means that accepts an image additionally registered as a reference image used for authentication of the same person together with the image acquired by the first acquisition means by the user's manual selection, and a reception means that is manually selected by the user by the reception means. The image is made to function as a registration means for additionally registering the image as a reference image used for the authentication of the same person together with the image acquired by the first acquisition means for the personal authentication .

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a mechanism for additionally registering an image received by a user as a reference image from among images that are not similar to the registered reference image .

It is a system block diagram which shows an example of the structure of the telework management system of this invention. It is a block diagram which shows the hardware composition of the information processing apparatus applicable to the operation terminal 100, the audit terminal 110, and the management server 120 of this invention. It is a flowchart which shows an example of the detection and recording process of the operation event performed by the operation terminal 100 while the user is performing telework work by using the telework management system of this invention. It is a flowchart which shows the sequence which registers the face image which becomes the reference of face recognition in this invention. It is a flowchart which shows the sequence which takes one face image which is the reference of face recognition in this invention. It is a flowchart which shows the sequence of taking a plurality of images of a face image which is a reference of face recognition in this invention as a moving image. It shows the transition of the operation screen which registers a face image in an operation terminal in this invention. In the present invention, it shows the transition of the operation screen in which the user selects the face image to be registered in the operation terminal. An example of the face image data registered in the operation terminal in the present invention is shown.

First, the outline of the present invention will be described.

The telework management system of the present invention uses face recognition technology to perform motion events such as "seating" and "leaving", and "spoofing" and "peeping" by a third party other than the teleworker. It is a system that detects and records security incidents) so that the administrator can view them.

When the teleworker starts work, he takes a photo of the teleworker's face, performs personal authentication using the face photo and the feature amount of the face image that is first guaranteed to be the teleworker himself, and then the teleworker himself The degree of certain possibility (authentication level) is calculated (hereinafter, the face image and its feature amount are collectively referred to as the feature amount, and the feature amount used for personal authentication is referred to as the authentication feature amount).
FIG. 1 will be described.
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a system configuration diagram showing an example of the configuration of the telework management system of the present invention.

FIG. 1 shows a configuration in which one or more operation terminals 100, one or more audit terminals 110, or one or more management servers 120 are connected via a local area network (LAN) 130, a router 140, and the Internet 150. It has become.

The operation terminal 100 detects an operation event and a security incident of the teleworker to be used, and transmits the trail to the management server 120. In addition, the feature amount (face image and the feature amount acquired from the face image) of the teleworker used for detecting the operation event is transmitted to the management server 120.
The audit terminal 110 performs an approval operation for the feature amount recorded on the management server 120 and an audit operation on the trail recorded on the management server 120.

The management server 120 records the trail received from the operation terminal 100, and processes the audit operation of the audit terminal 110 on the trail. Further, the feature amount received from the operation terminal 100 is recorded, and the approval operation of the audit terminal 110 for the feature amount is processed.
A face recognition system can be constructed by using the operation terminal 100 and the management server 120 of the present invention, which will be described later.
FIG. 2 will be described.
Hereinafter, the hardware configuration of the information processing device applicable to the operation terminal 100, the audit terminal 110, and the management server 120 shown in FIG. 1 will be described with reference to FIG.
FIG. 2 is a block diagram showing a hardware configuration of an information processing device applicable to the operation terminal 100, the audit terminal 110, and the management server 120 shown in FIG.

In FIG. 2, 201 is a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 203 or the external memory 212 is necessary to realize a function executed by a BIOS (Basic Input / Output System) or an operating system program (hereinafter, OS) which is a control program of the CPU 201, and each server or each PC. Various programs described later are stored.

Reference numeral 203 denotes a RAM, which functions as a main memory, a work area, and the like of the CPU 201. The CPU 201 realizes various operations by loading a program or the like necessary for executing the process from the ROM 203 or the external memory 212 into the RAM 202 and executing the loaded program.

Further, 205 is an input controller, which controls input from a keyboard (KB) 209, a camera device 210 (imaging device), a pointing device such as a mouse (not shown), or the like. Reference numeral 206 denotes a video controller, which controls the display on a display such as a CRT display (CRT) 211. Although it is described as CRT211 in FIG. 2, the display may be not only the CRT but also another display such as a liquid crystal display. These are used by the administrator as needed.

Reference numeral 207 is a memory controller, which can be used as an external storage device (hard disk (HD)) for storing boot programs, various applications, font data, user files, edit files, various data, etc., a flexible disk (FD), or a PCMCIA card slot. Controls access to an external memory 212 such as a compact flash® memory connected via an adapter.

Reference numeral 208 denotes a communication I / F controller, which connects and communicates with an external device via a network (for example, LAN 130 shown in FIG. 1), and executes communication control processing on the network. For example, communication using TCP / IP is possible.

The CPU 201 can display the outline font on the CRT 211 by executing the outline font expansion (rasterization) process in the display information area in the RAM 202, for example. Further, the CPU 201 enables a user instruction with a mouse cursor or the like (not shown) on the CRT 211.

Various programs to be described later for realizing the present invention are recorded in the external memory 212, and are executed by the CPU 201 by being loaded into the RAM 202 as needed. Further, a definition file and various information tables used when executing the above program are also stored in the external memory 212, and detailed description of these will be described later.
FIG. 3 will be described.

Hereinafter, with reference to FIG. 3, processing in the resident application operating on the operation terminal 100 used by the teleworker in the telework management system of the present invention will be described.
The process shown in the flowchart of FIG. 3 is a process in which the CPU 201 of the operation terminal 100 reads out and executes a predetermined control program.

In FIG. 3, after the registration of the face image that is the reference of the face authentication in FIG. 4 is completed, the face of the individual is authenticated, and the WEB camera is used to telework the detection and recording of the operation event that authenticates each individual. This is a sequence performed during work.

In S401, when the user logs in to the operation terminal 100, the operation terminal 100 starts the resident application and logs in to the management server 120 in the background with the account ID and password of the teleworker. The management server 120 compares the information of the teleworker stored in the account storage unit 128, and if it matches, permits login. The account ID and password are set by the user when the resident application is started for the first time, and the set values are used thereafter.

In S402, every time a teleworker operation event occurs, the possibility that the user using the operation terminal 100 is a teleworker registered in the management server 120 is calculated, and depending on the result, it is used in the operation event detection of S403. Acquire the feature amount to be used.

In S402, the information processing device uses a photographing means 210 (WEB camera, etc.) provided near the display unit of the information processing device to move a moving image of a person (teleworker)'s face while the teleworker is working. Take a picture with. A fourth feature amount (feature amount acquired from face images facing in various directions) is acquired from a still image of each face image to be newly captured. When determining whether a person is the same person as the person in the face image already registered by using the fourth feature amount, the third of the face image registered in S813 is used as the first distinguishable criterion. According to the second criterion to which the feature amount of is added, it is determined whether the person of the face image to be newly compared is the same person as the person of the already registered face image (second face recognition means).

The second criterion is (a threshold value for determining that the fourth feature amount of the image newly taken by S402 is similar to the registered first feature amount based on the registered first feature amount) + (registered third feature amount). Based on the feature amount of, the threshold value is expanded to the threshold value for determining that the fourth feature amount of the newly captured image is similar).

By satisfying the second criterion, the same person will be recognized, and even in the case where it is necessary to continuously perform face recognition using the shooting means 210 (WEB camera, etc.), the direction of the face will change by chance. The same person can be recognized accurately even at the same timing.

The S403 detects an operation event (a labor operation event such as "seating" or "leaving a seat" or a security incident such as "spoofing" or "peeping") and transmits the trail to the management server 120.

In S403, the information processing device captures event information, which is an operation performed by a person (teleworker) who shoots using a shooting means (WEB camera) in front of the shooting means (WEB camera), in real time. By image analysis, it is repeatedly detected for each movement of the photographed person (event detection means). Here, when the event detection means detects event information (seating, leaving, spoofing, peeping), the event information of a person determined to be the same person by the first face recognition means of S808 is also detected, and further. The event information of the person determined to be the same person by the second face recognition means of S402 is also detected. As a result, even if the face orientation is different, the recognition range of the same person is widened, the recognition rate of the same person is improved, and even if the face orientation is different, the event information (seating, leaving, looking into) is properly performed. ) Can be detected.

Further, in S403, the information processing device captures event information, which is an operation performed by a person taking a picture using the shooting means (WEB camera) in front of the shooting means (WEB camera), and images the operation contents of the person shot in real time. By analyzing, each movement of the photographed person is repeatedly recorded (event recording means). Here, when the event recording means records the event information (seating, leaving, spoofing, looking into), the event information of the person determined to be the same person in the first face recognition means of S808 is also recorded, and further. The event information of the person determined to be the same person by the second face recognition means of S402 is also recorded. As a result, even if the face orientation is different, the recognition range of the same person is widened, the recognition rate of the same person is improved, and even if the face orientation is different, the event information (seating, leaving, looking into) is properly performed. ) Can be recorded as the trail.
In S404, when the user logs out from the operation terminal 100, the operation terminal 100 logs out from the management server 120 in the background.
FIG. 4 will be described.

FIG. 4 is a sequence for registering a face image as a reference for face recognition as a preparation before starting the telework work. After registering the face image that serves as the reference for face authentication in FIG. 4, the operation event in FIG. 3 can be detected and recorded during the teleworking operation.
In S601, the information processing apparatus creates a registration list A for registering a face image that serves as a reference for face authentication.

In S602, the information processing apparatus determines whether or not face authentication is possible with the face image already in the registration list A. In the case of face recognition (TRUE), the process proceeds to S604. In the case of FALSE where face recognition is not possible, the process proceeds to S603.
In S603, the information processing apparatus is a flowchart of a sequence of capturing one face image, which is a reference for face recognition. The details will be described with reference to FIG.
In S604, the information processing apparatus accepts the photographing method.

In S605, the information processing apparatus determines whether the received photographing method is a sequence of photographing one face image or a sequence of photographing a plurality of images. If it is determined that the sequence is for taking one image, the process proceeds to S603. If it is determined that the sequence is for taking a plurality of images, the process proceeds to S607.

In S606, the information processing apparatus determines whether or not the created registration list A is empty. If it is determined to be empty (TRUE), the process proceeds to S608. If it is determined that it is not empty (FALSE), the process proceeds to S607.
In S607, the information processing apparatus is a flowchart of a sequence in which a plurality of face images, which are a reference for face recognition, are captured as moving images. The details will be described with reference to FIG.

In S608, the information processing apparatus determines whether or not the created registration list A is empty. If it is determined that the sky is empty (TRUE), the process proceeds to S616. If it is determined that it is not empty (FALSE), the process proceeds to S609.
Since the steps S609 to S614 are not related to the present invention, description thereof will be omitted.
FIG. 5 will be described.
FIG. 5 is a sequence of capturing one face image, which is a reference for face authentication in S603.

In S701, the information processing apparatus determines whether or not to cancel. In case of cancellation (TRUE), proceed to END. If it is not canceled (FALSE), the process proceeds to S702.
In S702, the information processing device accepts the shooting timing when the user presses the shooting button 702 on the screen 700.

In S703, the information processing device takes a face image using the WEB camera 210 3 seconds after the user presses the button, and acquires one face image of the teleworker sitting in front of the operation terminal.

In S704, the information processing apparatus determines whether or not one face image has been successfully acquired. If the acquisition of one face image is successful (TRUE), the process proceeds to S706. In the case of failure to acquire one face image (FALSE), the process proceeds to S705.
In S705, the information processing device notifies the teleworker sitting in front of the operation terminal that the acquisition of one face image has failed.

In S706, the information processing apparatus displays the face image 709 of the teleworker acquired, and accepts the processing method for the face image 709 (select one of registration 710, re-shooting 711, and cancellation 712).

In S707, the information processing apparatus determines whether or not the registration is 710. In the case of registration 710 (TRUE), the process proceeds to S708. In the case of re-shooting 711 and cancellation 712 (FALSE), the process proceeds to S702.
The information processing apparatus additionally stores the face image 709 acquired in S708 in the registration list A.
After that, in order for the first face recognition means to be used in the authentication, the first feature amount acquired from the face image 709 additionally saved by the user is registered here.
FIG. 6 will be described.
FIG. 6 is a sequence of capturing a plurality of moving images of a face image, which is a reference for face authentication in S607.

In S801, the information processing apparatus determines whether or not to cancel. In case of cancellation (TRUE), proceed to END. If it is not canceled (FALSE), the process proceeds to S802.
In S802, the information processing device creates a registration list B of the temporary discriminator.
In S803, the information processing device accepts a moving image shooting time (for example, 5 seconds).

In S804, the information processing device uses a photographing means 210 (WEB camera or the like) provided near the display unit of the information processing device within a predetermined time (for example, about 5 seconds) so that the direction of the face of the teleworker is different. Take multiple facial images of the same person (teleworker) taken in succession. In addition, it is necessary to acquire the second feature amount from each face image of a plurality of the same person (teleworker) taken, and it is necessary to be a still image.

Further, here, a moving image (MOVIE) may be used to shoot a moving image within a predetermined time (for example, about 5 seconds) so that the direction of the face of the teleworker is different in the moving image (MOVIE). , It is possible to easily acquire a still image of a plurality of the same person (teleworker) having different face orientations of the teleworker without imposing a load on the teleworker.

In S805, the information processing apparatus determines whether or not there is a face image that has not been searched among the face images of the same person (teleworker) taken. If there is (TRUE), the process proceeds to S806. If not (FALSE), the process proceeds to S807.
In S806, the information processing apparatus searches for one face image of the same person (teleworker) from a plurality of face images of the same person (teleworker) taken continuously.
The loop of S805 to S806 is a loop of searching and cutting out all face images (still images) from the captured moving image.

In S807, the information processing apparatus determines whether or not there is a face image that has not been determined to be the same person among the face images of the plurality of the same person (teleworker) searched. If there is (TRUE), the process proceeds to S808. If not (FALSE), the process proceeds to S811.

In S808, the information processing apparatus uses the first feature amount of the face image already registered in S708 (feature amount acquired from the face image facing the front) and the second feature amount of the face image newly captured in S804. According to the first criterion that can determine whether the feature amount (feature amount obtained from the face image not facing the front) is similar, the person in the face image to be newly photographed is the face image already registered. It is determined whether the person is the same person as the person (first face recognition means).
The first criterion is (a threshold value for determining that the second feature amount of the image newly taken in S804 is similar based on the registered first feature amount).

In the branching of the information processing device in S809, when the first face recognition means determines that the person is the same person (TRUE) as the person in the face image already registered, the face image is determined by the provisional discriminator. It is not added to the registration list and saved. On the contrary, if it is determined in the first face recognition means that the person is not the same person (FALSE) as the person in the already registered face image, the process proceeds to S810 and the face image is added to the registration list of the temporary discriminator. It is saved.

The information processing device in S810 has already been registered in the first face recognition means of S808 by using the first criterion from a plurality of (for example, about 20) face images of the same person taken in S804. The faces of the same person with different face orientations are not judged to be the same person as the person in the face image (the same person, but not facing the front, so they are not recognized as the same person by the first criterion). How many images (for example, about 3) are extracted (extraction means).
That is, it is determined that the orientation of the face changes too much and the feature amount obtained from the selected face image is not similar to the first feature amount.

Further, here, the extraction means extracts a plurality of (one or more) face images of the same person having different face orientations (for example, upward, downward, rightward, leftward). The extracted face images of the same person 811 to 813 are additionally saved in the registration list B of the temporary discriminator.
The face images 81 to 813 of the same person additionally saved in the registration list of the temporary discriminator are listed in the screen 809.

In S811, the information processing apparatus identifies and displays the face image 816 selected by the user, and accepts a processing method for the face image 816 (select one of registration 818, re-shooting 819, and cancellation 820).

In S812, the information processing apparatus determines whether or not the registration is 818. In the case of registration 818 (TRUE), the process proceeds to S813. In the case of re-shooting 819 and cancellation 820 (FALSE), the process proceeds to S801.
In S813, the information processing apparatus additionally saves the selected face image 816 in the registration list A.

The feature amount acquired from the face image 816 manually selected by the user here for use by the second face recognition means in the authentication is the feature amount acquired from the third feature amount (feature amount acquired from the face image not facing the front). And is additionally registered as a feature amount that is not recognized as the same person by the first criterion).
FIG. 7 will be described.

FIG. 7 shows a still image of the front face taken by the WEB camera displayed by the operation terminal 100 at the time of a sequence of taking one face image as a reference for face recognition in S603, and registered in the operation terminal 100 as a reference for face recognition. It shows the transition of the operation screen to be performed.

The screen of 700 is a screen that accepts instructions for still image shooting. When the shooting button 703 is pressed by the user, still image shooting is started after 3 seconds, and the still image is stored.
On the screen of 707, when the registration button 710 is pressed in S707, the face image is registered in the registration list A in S708.
FIG. 8 will be described.

FIG. 8 shows a WEB camera that is displayed by the operation terminal 100 during a sequence of capturing a plurality of face images, which is a reference for face recognition in S607, as a reference for face recognition. It shows the transition of the operation screen in which the user selects the face image to be registered in the operation terminal 100.

The screen of 800 is a screen for receiving instructions for shooting a moving image. When the shooting button 803 is pressed by the user, moving image shooting is started and the moving image is stored. On this screen, a guidance message 801 is displayed on the screen so that the user can face various directions during video recording and register a face image facing the various directions. The guidance message 801 shows a preferable example of the guide means for guiding the user to move the face in different directions while the photographing means takes an image in S804. The guide means may be voice guidance.

The screen of 805 is a screen displayed while the shooting button 803 is pressed by the user and a moving image is shot for, for example, 5 seconds. The moving image shot for 5 seconds is cut out into a still image for each frame, and is used as a still image of a face image facing in various directions. Also, during movie shooting, the remaining shooting time is "3 seconds remaining. Etc. ”is also displayed.

The screen of 809 is a list of facial images extracted in S810 without being identified as the teleworker himself in S808 and S809. The face images listed here are the face images of the teleworker himself, but when it is determined whether or not he / she is the person himself / herself based on the currently registered face image (face orientation), the teleworker himself / herself is Not discriminated.

The screen of 815 selects the face image to be registered by the user in S812, and the face image selected in S813 is registered in the registration list A. By pressing the registration button 818 after the face image 816 is selected, the selected face image is registered in the registration list A.
FIG. 9 will be described.
The face image information is information for identifying each face image stored for each face image.
900 is a user ID, which is the name or ID of the teleworker.
905 is shooting date and time information, which is the date and time when each face image was acquired.
Reference numeral 906 is face image data, which is a facial feature amount that can identify each teleworker individual acquired from each face image.

Further, the executable program in the present invention is a program that causes a computer to execute the processes of FIGS. 3, 4, 5, and 6. The program in the present invention may be a program for each process of FIGS. 3, 4, 5, and 6.

As described above, the recording medium on which the program that realizes the functions of the above-described embodiment is recorded is supplied to the system or the device, and the computer (or CPU or MPU) of the system or the device stores the program in the recording medium. Needless to say, the object of the present invention can be achieved by reading and executing.

In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium on which the program is recorded constitutes the present invention.

Recording media for supplying programs include, for example, flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, DVD-ROMs, magnetic tapes, non-volatile memory cards, ROMs, EEPROMs, and silicon. A disc or the like can be used.

Further, by executing the program read by the computer, not only the function of the above-described embodiment is realized, but also the OS (operating system) or the like running on the computer is actually operated based on the instruction of the program. Needless to say, there are cases where a part or all of the processing is performed and the processing realizes the functions of the above-described embodiment.

Further, the program read from the recording medium is written to the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer, and then the function expansion board is based on the instruction of the program code. It goes without saying that there are cases where the CPU or the like provided in the function expansion unit performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiment.

Further, the present invention may be applied to a system composed of a plurality of devices or a device composed of one device. It goes without saying that the present invention can also be applied when it is achieved by supplying a program to a system or device. In this case, by reading the recording medium in which the program for achieving the present invention is stored into the system or device, the system or device can enjoy the effect of the present invention.

Further, by downloading and reading a program for achieving the present invention from a server, database, or the like on the network by a communication program, the system or device can enjoy the effect of the present invention. It should be noted that all the configurations in which the above-described embodiments and modifications thereof are combined are also included in the present invention.

100 Operation terminal (information processing device)
110 Audit terminal 120 Management server

Claims (6)

An information processing device that authenticates individuals using registered reference images.
The first acquisition means for acquiring an image of the user's face as a reference image capable of personal authentication, and
A second acquisition means for acquiring a plurality of images in which the user 's face is photographed in a direction different from the direction of the user 's face in the image acquired by the first acquisition means.
It is determined whether or not the plurality of images acquired by the second acquisition means are similar to the images acquired by the first acquisition means, and are similar to the images acquired by the first acquisition means. A selection means for selecting an image determined not to be present from a plurality of images acquired by the second acquisition means, and a selection means.
Among the plurality of images acquired by the second acquisition means selected by the selection means, an image determined to be not similar to the image acquired by the first acquisition means is displayed, and the selection is performed. Among the plurality of images acquired by the second acquisition means that are not selected by the means, the image that is determined to be similar to the image acquired by the first acquisition means is controlled not to be displayed. Screen display means and
A reception means for manually selecting an image to be additionally registered as a reference image used for authentication of the same person together with the image acquired by the first acquisition means from the displayed images.
A registration means for additionally registering an image manually selected by a user by the reception means as a reference image used for authentication of the same person together with an image acquired by the first acquisition means for personal authentication .
An information processing device characterized by being equipped with. It is a control method of an information processing device that authenticates an individual using a registered reference image.
The first acquisition means of the information processing apparatus includes a first acquisition step of acquiring an image of a user's face as a reference image capable of personal authentication.
Second acquisition unit of the information processing apparatus, the first acquisition step face of the user facing in different directions from the user's face orientation of the image acquired in the shooting a plurality of images The second acquisition process to acquire
The selection means of the information processing device determines whether or not the plurality of images acquired in the second acquisition step are similar to the images acquired in the first acquisition step, and the first acquisition step. A selection step of selecting an image determined not to be similar to the image acquired in step 1 from a plurality of images acquired in the second acquisition step.
The screen display means of the information processing apparatus is not similar to the image acquired in the first acquisition step among the plurality of images acquired in the second acquisition step selected in the selection step. The determined image is displayed, and it is determined that the image acquired in the first acquisition step is similar to the plurality of images acquired in the second acquisition step that were not selected in the selection step. The screen display process that controls not to display the displayed image ,
The reception means of the information processing device receives an image additionally registered as a reference image used for authentication of the same person together with the image acquired in the first acquisition step from the displayed images by manual selection by the user. Reception process and
The registration means of the information processing device adds an image manually selected by the user in the reception process as a reference image used for authentication of the same person together with the image acquired in the first acquisition process for personal authentication. Registration process to register and
A control method characterized by including. A program that can be read and executed by an information processing device that authenticates individuals using the registered reference image.
The information processing device
The first acquisition means for acquiring an image of the user's face as a reference image capable of personal authentication, and
A second acquisition means for acquiring a plurality of images in which the user 's face is photographed in a direction different from the direction of the user 's face in the image acquired by the first acquisition means.
It is determined whether or not the plurality of images acquired by the second acquisition means are similar to the images acquired by the first acquisition means, and are similar to the images acquired by the first acquisition means. A selection means for selecting an image determined not to be present from a plurality of images acquired by the second acquisition means, and a selection means.
Among the plurality of images acquired by the second acquisition means selected by the selection means, an image determined to be not similar to the image acquired by the first acquisition means is displayed, and the selection is performed. Among the plurality of images acquired by the second acquisition means that are not selected by the means, the image that is determined to be similar to the image acquired by the first acquisition means is controlled not to be displayed. Screen display means and
A reception means for manually selecting an image to be additionally registered as a reference image used for authentication of the same person together with the image acquired by the first acquisition means from the displayed images.
A registration means for additionally registering an image manually selected by a user by the reception means as a reference image used for authentication of the same person together with an image acquired by the first acquisition means for personal authentication .
A program to make it work. It is a personal authentication system that authenticates personally using the registered standard image.
The first acquisition means for acquiring an image of the user's face as a reference image capable of personal authentication, and
A second acquisition means for acquiring a plurality of images in which the user 's face is photographed in a direction different from the direction of the user 's face in the image acquired by the first acquisition means.
It is determined whether or not the plurality of images acquired by the second acquisition means are similar to the images acquired by the first acquisition means, and the images are similar to the images acquired by the first acquisition means. A selection means for selecting an image determined not to be present from a plurality of images acquired by the second acquisition means, and a selection means.
Among the plurality of images acquired by the second acquisition means selected by the selection means, an image determined to be not similar to the image acquired by the first acquisition means is displayed, and the selection is performed. Among the plurality of images acquired by the second acquisition means that are not selected by the means, the image that is determined to be similar to the image acquired by the first acquisition means is controlled not to be displayed. Screen display means and
A reception means for manually selecting an image to be additionally registered as a reference image used for authentication of the same person together with the image acquired by the first acquisition means from the displayed images.
A registration means for additionally registering an image manually selected by a user by the reception means as a reference image used for authentication of the same person together with an image acquired by the first acquisition means for personal authentication .
A personal authentication system characterized by being equipped with. It is a personal authentication method by a personal authentication system that authenticates personally using the registered standard image.
The first acquisition means of the personal authentication system includes a first acquisition step of acquiring an image of a user's face as a reference image capable of personal authentication.
The personal second acquisition unit of the authentication system, the first plurality of images in which the face of the user facing in different directions were taken from the user's face orientation of the images acquired by the acquisition step The second acquisition process to acquire
The personal authentication system of the selection means, determines whether a plurality of images acquired by the second acquisition step is similar to the image acquired by the first acquisition step, the first acquisition step A selection step of selecting an image determined not to be similar to the image acquired in step 1 from a plurality of images acquired in the second acquisition step.
The screen display means of the personal authentication system is not similar to the image acquired in the first acquisition step among the plurality of images acquired in the second acquisition step selected in the selection step. The determined image is displayed, and it is determined that the image acquired in the first acquisition step is similar to the plurality of images acquired in the second acquisition step that were not selected in the selection step. The screen display process that controls not to display the displayed image ,
The receiving means of the personal authentication system receives an image additionally registered as a reference image used for authentication of the same person together with the image acquired in the first acquisition step from the displayed images by manual selection by the user. Reception process and
The registration means of the personal authentication system adds an image manually selected by the user in the reception process as a reference image used for authentication of the same person together with the image acquired in the first acquisition step for personal authentication. Registration process to register and
A personal authentication method characterized by including. It is a program that can be read and executed by a personal authentication system that authenticates personally using the registered standard image.
The personal authentication system
The first acquisition means for acquiring an image of the user's face as a reference image capable of personal authentication, and
A second acquisition means for acquiring a plurality of images in which the user 's face is photographed in a direction different from the direction of the user 's face in the image acquired by the first acquisition means.
It is determined whether or not the plurality of images acquired by the second acquisition means are similar to the images acquired by the first acquisition means, and are similar to the images acquired by the first acquisition means. A selection means for selecting an image determined not to be present from a plurality of images acquired by the second acquisition means, and a selection means.
Among the plurality of images acquired by the second acquisition means selected by the selection means, an image determined to be not similar to the image acquired by the first acquisition means is displayed, and the selection is performed. Among the plurality of images acquired by the second acquisition means that are not selected by the means, the image that is determined to be similar to the image acquired by the first acquisition means is controlled not to be displayed. Screen display means and
A reception means for manually selecting an image to be additionally registered as a reference image used for authentication of the same person together with the image acquired by the first acquisition means from the displayed images.
A registration means for additionally registering an image manually selected by a user by the reception means as a reference image used for authentication of the same person together with an image acquired by the first acquisition means for personal authentication .
A program to make it work.

Images