JP7415510B2 - Registration permit device and registration permit program - Google Patents

Description

The present invention relates to a registration permission device and a registration permission program.

Patent Document 1 discloses an information processing device that distributes content for a person related to a user, and a determination unit that determines the relationship between the user and the person based on the user's activities on a network. and an acquisition unit that acquires content for the person according to a determination by the determination unit, and a distribution unit that distributes the content acquired by the acquisition unit to the user or the person. An information processing device is disclosed.

Patent Document 2 discloses a personal information acquisition unit that acquires, from the mobile terminal, personal information input by a service applicant for a service requiring identity verification on a mobile terminal, and a face image of the service applicant and the personal information. an identification card information acquisition unit that reads identification information including the above from the identification card; a first image acquisition unit that acquires a first photographed image of the face of the service applicant; the personal information; an identity verification section that automatically verifies the identity based on identification card information and the first photographed image; an additional information acquisition section that acquires additional information regarding the service applicant; and identity verification by the identity verification section. A terminal device is disclosed that includes a control unit that controls application processing for the service based on the result of the above and the additional information. In this terminal device, the additional information is information based on the number of times the service applicant is included in images taken during a predetermined period in the past by a camera that takes pictures of the space in which the device is installed, and the control unit , if the additional information indicates that the number of times the service applicant is included in the image is greater than or equal to a predetermined number of times, the application process for the service is continued; If this is the case, information indicating that a certain level of vigilance is required is added to the additional information, and the application process for the service is continued.

Japanese Patent Application Publication No. 2013-20325 Patent No. 6512272

When allowing the registration image to be registered in the profile only if the degree of similarity between the registration image to be registered in the profile of a service such as a matching service and the facial image used in the ID card is equal to or higher than a threshold Therefore, the images that can be registered are limited.

The present invention provides an image that can be registered, compared to a configuration in which registration of a registration image to a profile is permitted only when the degree of similarity between the registration image and the face image used in an identification card is equal to or higher than a threshold value. The purpose is to increase the degree of freedom of

A first aspect includes a processor, the processor acquires information on an image for registration in a profile of a service, acquires information on a first facial image used in an identification card, and cooperates with the service. information on one or more second facial images is acquired from the linked service in which the registration is performed, and if the degree of similarity between the registration image and the first facial image is greater than or equal to a first threshold, the registration image is registered in the profile. registration is permitted, and if the degree of similarity between the registration image and the first face image is less than the first threshold, the degree of similarity between the first face image and the second face image is equal to the second threshold. If this is the case, and the degree of similarity between the registration image and the second face image is equal to or higher than a third threshold, registration of the registration image to the profile is permitted.

In a second aspect, when the degree of similarity between the registration image and the first face image is less than the first threshold, the processor determines that when the degree of similarity between the first face image and the second face image is less than the first threshold, If the degree of similarity between the registration image and the second face image is less than two thresholds, or if the degree of similarity between the registration image and the second face image is less than a third threshold, registration of the registration image to the profile is prohibited.

In a third aspect, the processor determines that the degree of similarity between the first face image and the second face image is greater than or equal to a second threshold, and the degree of similarity between the registration image and the second face image is a third value. If the registration image is prohibited from being registered in the profile because it is less than a threshold, additional registration of a second facial image whose similarity with the first facial image is equal to or higher than a second threshold is prohibited. prompt.

In a fourth aspect, when the degree of similarity between the registration image and the first face image is less than the first threshold, the processor may configure the same second face image to be similar to the first face image. When the degree of similarity is at least a second threshold and the degree of similarity with the image for registration is at least a third threshold, registration of the image for registration in the profile is permitted.

In a fifth aspect, when the degree of similarity between the registration image and the first face image is less than the first threshold, the processor determines whether the second face image is similar to the first face image, which is different from the second face image. If the degree of similarity is at least a second threshold and the degree of similarity with the registration image is at least a third threshold, registration of the registration image in the profile is permitted if additional conditions are met.

In a sixth aspect, the additional condition is that the degree of similarity between the different second face images is equal to or higher than a fourth threshold.

In a seventh aspect, when permitting registration of a registration image to the profile, the processor prompts additional registration of another registration image to the profile.

In an eighth aspect, when permitting registration of the registration image to the profile because the degree of similarity between the registration image and the first face image is equal to or greater than the first threshold, the processor The user is prompted to additionally register a profile image as another registration image in the profile.

In a ninth aspect, when the degree of similarity between the registration image and the first face image is less than the first threshold, the processor When permitting registration of the registration image to the profile because the degree of similarity is equal to or higher than a second threshold and the degree of similarity between the registration image and the second face image is equal to or higher than a third threshold, The user is prompted to additionally register a front face image in the profile as the other registration image.

In the tenth aspect, the linked service is configured such that the computer acquires information on an image for registration in a service profile, acquires information on a first facial image used in an identification card, and cooperates with the service. information on one or more second facial images is obtained from the user, and if the degree of similarity between the registration image and the first facial image is greater than or equal to a first threshold, the registration image is permitted to be registered in the profile. , if the degree of similarity between the registration image and the first face image is less than the first threshold, the degree of similarity between the first face image and the second face image is greater than or equal to the second threshold, and , a registration permission program for executing a process of permitting registration of the registration image in the profile when the degree of similarity between the registration image and the second face image is equal to or higher than a third threshold value.

According to the configuration of the first aspect, compared to a configuration in which registration of the registration image to the profile is permitted only when the degree of similarity between the registration image and the facial image used in the identification card is equal to or higher than a threshold value. , the degree of freedom of images that can be registered can be increased.

According to the configuration of the second aspect, the degree of similarity between the first face image and the second face image is less than the second threshold, or the degree of similarity between the registration image and the second face image is less than the third threshold. In some cases, it is possible to increase the reliability that the registration image is the registrant's own image, compared to a configuration in which registration of the registration image to the profile is permitted.

According to the configuration of the third aspect, compared to a configuration that prompts registration of an arbitrary registration image to a profile, it is possible to save the registrant's effort in preparing a registration image.

According to the configuration of the fourth aspect, for a different second face image, when the degree of similarity with the first face image is equal to or greater than the second threshold, and the degree of similarity with the registration image is equal to or greater than the third threshold, Compared to a configuration that only allows registration of the registration image in the profile, it is possible to increase the reliability that the registration image is the registrant's own image.

According to the configuration of the fifth aspect, when the degree of similarity of the different second face image with the first face image is equal to or greater than the second threshold, and the degree of similarity with the registration image is equal to or greater than the third threshold; Furthermore, compared to a configuration in which registration of the registration image to the profile is permitted regardless of whether the additional conditions are met, it is possible to increase the reliability that the registration image is the registrant's own image.

According to the configuration of the sixth aspect, the registration image is more easily registered than the configuration in which registration of the registration image to the profile is permitted regardless of whether the condition that the degree of similarity between different second facial images is equal to or higher than the fourth threshold value is satisfied. It is possible to increase the reliability that the image is that of the registrant.

According to the configuration of the seventh aspect, it is possible to enrich the image information registered in the profile.

According to the configuration of the eighth aspect, it is possible to encourage additional registration of images from different angles to the profile.

According to the configuration of the ninth aspect, it is possible to encourage additional registration of images from different angles to the profile.

According to the configuration of the tenth aspect, compared to the configuration in which registration of the registration image to the profile is permitted only when the degree of similarity between the registration image and the face image used in the identification card is equal to or higher than the threshold value. , the degree of freedom of images that can be registered can be increased.

1 is a schematic diagram showing the configuration of an information processing system according to a first embodiment. FIG. 2 is a block diagram showing the hardware configuration of the server device according to the first embodiment. FIG. 2 is a block diagram showing an example of the functional configuration of the server device according to the first embodiment. 3 is a flowchart showing a part of the registration permission process executed by the server device according to the first embodiment. 12 is a flowchart showing another part of the registration permission process executed by the server device according to the first embodiment. FIG. 3 is a conceptual diagram showing a case where a face image captured from the front is used as a registration image according to the first embodiment. FIG. 3 is a conceptual diagram showing a case where a face image captured from the side of a face is used as a registration image according to the first embodiment. FIG. 3 is a conceptual diagram for explaining a process of creating a face image list from a posted image list according to the first embodiment. 3 is a conceptual diagram for explaining a process of determining that the degree of similarity of the face image with the highest degree of similarity to the certification face image among the face images in the face image list according to the first embodiment is equal to or higher than the second threshold; be. FIG. 6 is a conceptual diagram for explaining a process of determining that the degree of similarity of the face image with the highest degree of similarity to the registration image among the face images in the face image list according to the first embodiment is equal to or higher than a third threshold; . FIG. 2 is a block diagram illustrating an example of a functional configuration of a server device according to a second embodiment. It is a flowchart which shows the flow of a part of registration permission processing performed by the server device concerning a 2nd embodiment. 12 is a flowchart showing a part of the registration permission process executed by the server device according to the third embodiment. 12 is a flowchart showing a part of the registration permission process executed by the server device according to the fourth embodiment. 13 is a flowchart showing a part of the registration permission process executed by the server device according to the fifth embodiment. FIG. 12 is a conceptual diagram for explaining a process of creating a first face image list and a second face image list from a posted image list according to the fifth embodiment. Among the face images in the first face image list according to the fifth embodiment, when the degree of similarity of the face image with the highest degree of similarity to the certification face image is equal to or higher than the second threshold, the face image is selected as the first similar face image. FIG. 3 is a conceptual diagram for explaining the process of storing in a list. FIG. 12 is a conceptual diagram for explaining a process of deleting a face image stored in a first similarity list from a first face image list according to a fifth embodiment. Among the face images in the second face image list according to the fifth embodiment, when the similarity of the face image with the highest similarity to the registration image is equal to or higher than the third threshold, the face image is added to the second similarity list. FIG. FIG. 12 is a conceptual diagram for explaining a process of deleting a face image stored in a second similarity list from a second face image list according to a fifth embodiment. FIG. 12 is a conceptual diagram for explaining a process of further storing a face image from the first face image list to the first similarity list and deleting the face image according to the fifth embodiment. FIG. 12 is a conceptual diagram for explaining a process of further storing a face image from a second face image list to a second similarity list and deleting the face image according to the fifth embodiment. It is a flowchart which shows the flow of a part of registration permission processing performed by the server device concerning a 6th embodiment. FIG. 12 is a conceptual diagram for explaining a process of determining the degree of similarity between a face image in a first similarity list and a face image in a second similarity list according to a sixth embodiment.

An example of an embodiment according to the present invention will be described below based on the drawings.

《First embodiment》
(Information processing system 10)
First, the information processing system 10 according to this embodiment will be explained. FIG. 1 is a schematic diagram showing an information processing system 10 according to the present embodiment.

The information processing system 10 is a system that processes information, and includes a server device 50 and a plurality of devices 20, as shown in FIG. Specifically, the information processing system 10 is a system that allows a user to register a profile with the server device 50 via the device 20.

More specifically, the information processing system 10 provides an opportunity for other users to view the profile registered by the user on the server device 50 via the device 20, and for the users to get to know each other and communicate with each other. It is a system that obtains The user here means a person who uses the information processing system 10. Therefore, users include those who are registered with the information processing system 10 (server device 50) and those who are not registered.

The server device 50 and the plurality of devices 20 are connected to be able to communicate with each other via a wireless communication line 16 such as the Internet, for example. Note that although three devices 20A, 20B, and 20C are illustrated as the plurality of devices 20 in FIG. 1, there is no limit to the number of devices. Note that the devices 20A, 20B, and 20C are collectively referred to as the device 20.

(device 20)
Device 20 is a terminal used by a user. Specifically, the device 20 is an apparatus for a user to use the service provided by the server apparatus 50. More specifically, as the device 20, for example, a personal computer, a tablet computer, a smartphone, a mobile phone, etc. are used.

(Server device 50)
The server device 50 is an example of a registration permission device. As described above, this server device 50 is a device that provides a service that allows users to register their profiles via the device 20. Specifically, the server device 50 provides a service (a so-called matching service) that allows other users to view the profile registered by the user via the device 20 and provides an opportunity for the users to get to know each other and communicate with each other. This is a device that provides Hereinafter, the service provided by the server device 50 will be referred to as a "provided service."

The server device 50 has a medium (for example, a web page) that allows other users to view the profile registered by the user via the device 20, for example. The user can access the medium through the device 20.

FIG. 2 shows a block diagram showing the hardware configuration of the server device 50. The server device 50 has a function as a computer, and as shown in FIG. It has an interface 55, an input section 56, and a display section 57. Each part of the server device 50 is connected via a bus 59 so as to be able to communicate with each other.

The CPU 51 is a central processing unit that executes various programs including the registration permission program and controls each section. That is, the CPU 51 reads a program from the ROM 52 or the storage 54 and executes the program using the RAM 53 as a work area.

The ROM 52 stores various programs and data. The RAM 53 temporarily stores programs or data as a work area. The storage 54 is constituted by a storage unit such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores various programs including an operating system and various data.

The communication interface 55 is an interface for communicating with other equipment such as the device 20. The input unit 56 includes, for example, a pointing device such as a mouse and a keyboard, and is used to perform various inputs. The display unit 57 is, for example, a liquid crystal display, and displays various information. Note that a touch panel display may be used as the display unit 57. In this case, the display may function as the input section 56.

When executing the above program, the server device 50 uses the above hardware resources to realize various functions. The functional configuration realized by the server device 50 will be explained. FIG. 3 is a block diagram showing an example of the functional configuration of the server device 50. As shown in FIG.

As shown in FIG. 3, the server device 50 has an acquisition section 50A, a permission section 50B, and a prohibition section 50C as functional configurations. Each functional configuration is realized by the CPU 51 reading out and executing a registration permission program stored in the ROM 52 or the storage 54.

The acquisition unit 50A acquires application information regarding a registration application for the registration image 70 (see FIGS. 6 and 7) in the profile of the provided service. Specifically, application information about the user applying for registration of the registration image 70 to the server device 50 via the device 20 is acquired.

The acquisition unit 50A also acquires information on the image 70 for registration in the profile of the provided service (see FIGS. 6 and 7). Specifically, the acquisition unit 50A acquires information about the registration image 70 transmitted by the user to the server device 50 via the device 20.

The acquisition unit 50A also acquires information on the first facial image 71 (hereinafter referred to as the certification facial image 71 (see FIGS. 6 and 7)) used in the identification card. Specifically, the acquisition unit 50A acquires information on the certification face image 71 transmitted by the user to the server device 50 via the device 20.

Furthermore, the acquisition unit 50A acquires information on one or more second facial images 72 (see FIG. 8) from a cooperation service that is linked with the provided service. The linked service is a service that is linked with a provided service, and is a service in which facial images can be registered. Specifically, the linked service is a service that has been linked in advance with the provided service. More specifically, the linked service is, for example, a social networking service (hereinafter referred to as SNS) that is linked in advance with the provided service and in which images (photos) can be registered (posted). Therefore, the acquisition unit 50A acquires information on the second facial image 72 (hereinafter referred to as SNS facial image 72), for example, from the image of the photo posted on the SNS. Note that the linked service is not limited to a service that has been linked in advance with the provided service. The linked service may be, for example, a service that has been linked based on an application from a registrant.

The permission unit 50B permits registration of the registration image 70 to the profile when the degree of similarity between the registration image 70 and the certification face image 71 is equal to or higher than a first threshold. In other words, if the registration image 70 and the certification face image 71 are similar according to a predetermined standard, registration of the registration image 70 to the profile is permitted.

Note that the degree of similarity can be calculated as a numerical value using, for example, a known pattern matching method such as template matching.

In the present embodiment, the first threshold value is that the person shown in the registration image 70 and the person shown in the certification face image 71 are considered to be the same person when the degree of similarity is equal to or greater than the value. A value obtained in advance is applied as a possible value. Note that the first threshold is not limited to this, and may be set by the administrator of the server device 50, etc., depending on the accuracy required for registration in the profile of the provided service, the purpose of the provided service, etc. The first threshold value may be set in advance via the input unit 56 or the like.

Furthermore, if the degree of similarity between the registration image 70 and the certification face image 71 is less than a first threshold, the permission unit 50B determines that if the degree of similarity between the registration image 70 and the certification face image 71 is less than a first threshold, the similarity between the certification face image 71 and the SNS face image 72 is equal to or higher than a second threshold. , and when the degree of similarity between the registration image 70 and the SNS face image 72 is equal to or higher than the third threshold, registration of the registration image 70 to the profile is permitted. In other words, if the registration image 70 and the certification face image 71 are similar to the SNS face image 72 according to predetermined criteria, registration of the registration image 70 to the profile is permitted. Note that the SNS face image 72 whose similarity to the registration image 70 is determined and the SNS face image 72 whose similarity to the certification face image 71 is determined may be different images.

In the present embodiment, the second threshold value is that when the degree of similarity between the certification face image 71 and the SNS face image 72 is equal to or greater than the relevant value, the person appearing in the certification face image 71 and the SNS face image 72 are different from each other. A value obtained in advance is applied as a value that can be considered to be the same person as the person in question. In the present embodiment, the third threshold value is that when the degree of similarity between the registration image 70 and the SNS face image 72 is equal to or higher than the value, the person appearing in the registration image 70 and the SNS face image 72 are different from each other. A value obtained in advance is applied as a value that can be considered to be the same person as the person in question. Note that the second threshold value and the third threshold value are not limited to these, and for example, the management of the server device 50 may be set according to the accuracy required for registration in the profile of the provided service, the purpose of the provided service, etc. The second threshold value and the third threshold value may be set in advance by a person or the like via the input unit 56 or the like.

The prohibition unit 50C is configured such that when the degree of similarity between the registration image 70 and the face image for proof 71 is less than a first threshold, the degree of similarity between the face image for proof 71 and the SNS face image 72 is less than a second threshold. Alternatively, when the degree of similarity between the registration image 70 and the SNS face image 72 is less than the third threshold, registration of the registration image 70 to the profile is prohibited.

(Actions according to this embodiment)
Next, the operation of this embodiment will be explained. 4 and 5 are flowcharts showing the flow of registration permission processing executed by the server device 50.

This process is performed by the CPU 51 reading the registration permission program from the ROM 52 or storage 54 and executing it. This process is performed, for example, when a user applies for registration of the registration image 70.

As shown in FIG. 4, when this process is started, the CPU 51 first obtains information on the image 70 for registration in the profile of the provided service (see FIGS. 6 and 7) (step S102). FIG. 6 shows a case where a face image captured from the front of the user's face (hereinafter referred to as a front face image) is used as the registration image 70. FIG. 7 shows a case where a face image captured from the side of the user's face (hereinafter referred to as a side face image) is used as the registration image 70.

Next, the CPU 51 acquires information on the certification face image 71 (see FIGS. 6 and 7) used in the identification card (step S104). 6 and 7 show a case where a front face image of the user shown on an identification card issued by a public institution such as a driver's license or passport is used as the certification face image 71. . Note that the order in which the information on the certification face image 71 and the information on the registration image 70 are acquired is not limited to the order of this processing, and the information on the certification face image 71 may be acquired first.

Next, the CPU 51 determines whether the degree of similarity between the registration image 70 and the certification face image 71 is greater than or equal to the first threshold (step S106).

If the CPU 51 determines in step S106 that the degree of similarity between the registration image 70 and the certification face image 71 is greater than or equal to the first threshold (step S106: YES), the CPU 51 adds the registration image to the profile of the provided service. 70 is permitted to be registered (step S108), and this process ends. Note that the example shown in FIG. 6 shows a case where the first threshold value is 0.7 and the degree of similarity between the registration image 70 and the certification face image 71 is 0.9. In the example shown in FIG. 6, registration of the registration image 70 is permitted.

On the other hand, if the CPU 51 determines in step S106 that the degree of similarity between the registration image 70 and the certification face image 71 is less than the first threshold (step S106: NO), step S110 (see FIG. 5) Move to. Note that in the example shown in FIG. 7, the first threshold value is set to 0.7, and the degree of similarity between the registration image 70 and the certification face image 71 is set to 0.5. In the example shown in FIG. 7, the process moves to step S110.

As shown in FIG. 5, in step S110, the CPU 51 obtains facial image information from the posted image list 79 posted on the user's SNS, and creates a facial image list 80. Here, as shown in FIG. 8, the posted image list 79 includes, for example, images that include face images and images that do not include face images. Examples of images that do not include facial images include landscape images of landscapes, food images of food, and product images of products. Then, the CPU 51 recognizes faces from the images in the posted image list 79, stores the images in which the faces have been recognized as face images, and creates a face image list 80. Note that the face image to be saved may be a face image cut out from an image including a face image. Furthermore, a face image may be cut out from a video posted on SNS.

Next, the CPU 51 acquires information on the degree of similarity (hereinafter referred to as similarity A) of the face image with the highest degree of similarity to the certification face image 71 (hereinafter referred to as face image A) from the face image list 80 (step S112). Specifically, as shown in FIG. 9, the CPU 51 calculates the degree of similarity between each of the face images in the face image list 80 and the certification face image 71, and selects the one with the highest value among the degrees of similarity. Get similarity information.

Next, the CPU 51 determines whether the degree of similarity A obtained in step S112 is greater than or equal to the second threshold (step S114).

If the CPU 51 determines in step S114 that the degree of similarity A is greater than or equal to the second threshold (step S114: YES), the process proceeds to step S116. Note that the example shown in FIG. 9 shows a case where the second threshold value is 0.7 and the similarity degree A is 0.79. In the example shown in FIG. 9, the second threshold value is the same value as the first threshold value. In the example shown in FIG. 9, the process moves to step S116.

On the other hand, if the CPU 51 determines in step S114 that the degree of similarity A is less than the second threshold (step S114: NO), the CPU 51 prohibits registration of the registration image 70 (step S118), and Finish the process.

In step S116, the CPU 51 acquires information on the degree of similarity (hereinafter referred to as similarity B) between the registration image 70 and the face image with the highest degree of similarity (hereinafter referred to as face image B) from the face image list 80. As shown in FIG. 10, the CPU 51 calculates the degree of similarity between each of the face images in the face image list 80 and the registration image 70, and obtains information on the degree of similarity with the highest value among the degrees of similarity. do.

Next, the CPU 51 determines whether the similarity degree B obtained in step S116 is greater than or equal to a third threshold (step S120).

If the CPU 51 determines in step S120 that the degree of similarity B is equal to or higher than the third threshold (step S120: YES), the CPU 51 permits registration of the registration image 70 (step S122), and ends this process. do. Note that the example shown in FIG. 10 shows a case where the third threshold value is 0.7 and the similarity A is 0.81. In the example shown in FIG. 10, the third threshold has the same value as the second threshold and the first threshold. Furthermore, in the example shown in FIG. 10, registration of the registration image 70 is permitted.

On the other hand, if the CPU 51 determines in step S120 that the similarity B is less than the third threshold (step S120: NO), the CPU 51 prohibits registration of the registration image 70 (step S118), and Finish the process. Note that the registration image 70 whose registration is permitted in the registration permission process described above is finally registered in the profile of the provided service by the CPU 51.

As described above, in the present embodiment, when the degree of similarity between the registration image 70 and the certification face image 71 is less than the first threshold, the CPU 51 determines whether the similarity between the certification face image 71 and the SNS face image 72 is If the similarity between the registration image 70 and the SNS face image 72 is equal to or higher than the third threshold, registration of the registration image 70 to the profile is permitted. That is, in this embodiment, even if the degree of similarity between the registration image 70 and the certification face image 71 is less than the threshold, registration of the registration image 70 to the profile is permitted if certain conditions are met.

Here, in the configuration (hereinafter referred to as the first configuration) in which registration of the registration image 70 to the profile is permitted only when the degree of similarity between the registration image 70 and the certification face image 71 is equal to or greater than a threshold, the certification Only images whose degree of similarity to the personal face image 71 is equal to or higher than the threshold value can be registered.

For example, when using a facial image of an identification card issued by a public institution, such as a driver's license or a passport, as the certification facial image 71, the certification facial image 71 becomes a frontal facial image. Therefore, only a front face image or a face image close to a front face image is allowed to be registered as the registration image 70. facial images) cannot be used.

In contrast, in this embodiment, the degree of similarity between the certification face image 71 and the SNS face image 72 is equal to or higher than the second threshold, and the degree of similarity between the registration image 70 and the SNS face image 72 is equal to or higher than the third threshold. If the threshold value is exceeded, the registration image 70 is permitted to be registered in the profile, so the degree of freedom of images that can be registered is increased compared to the first configuration described above. That is, according to the configuration of this embodiment, it is possible to use, for example, a side face image or the like as the registration image 70.

Furthermore, in the present embodiment, when the degree of similarity between the registration image 70 and the verification face image 71 is less than the first threshold, the CPU 51 determines that when the degree of similarity between the registration image 70 and the verification face image 71 is less than the first threshold, If the degree of similarity between the registration image 70 and the SNS face image 72 is less than the third threshold, registration of the registration image 70 to the profile is prohibited.

Here, if the degree of similarity between the certification face image 71 and the SNS face image 72 is less than the second threshold, or if the degree of similarity between the registration image 70 and the SNS face image 72 is less than the third threshold, In the configuration (hereinafter referred to as the second configuration) that allows registration of the registration image 70 to a profile, registration may be permitted even if the registration image 70 is not an image of the registrant himself/herself.

In contrast, in the present embodiment, the degree of similarity between the certification face image 71 and the SNS face image 72 is less than the second threshold, or the degree of similarity between the registration image 70 and the SNS face image 72 is less than the second threshold. Since registration of the registration image 70 in the profile is prohibited when the threshold value is less than the threshold, the reliability that the registration image 70 is the registrant's own image is increased compared to the above-described second configuration.

(Modified example)
Note that in this embodiment, as described above, information on facial images is acquired from the posted image list 79 posted on SNS (step S110), and information on similarity A of facial image A is acquired (step S112). , it was determined whether or not the degree of similarity A was greater than or equal to the second threshold (step S114). In other words, in the present embodiment, information regarding the face image A is acquired before performing the similarity determination based on the face image A (step S114). Specifically, before performing the similarity judgment based on the face image A (step S114), and after determining that the degree of similarity between the registration image 70 and the certification face image 71 is less than the first threshold (step S114), Information regarding face image A was acquired in S106: NO. More specifically, information regarding the face image A was acquired immediately before performing the similarity judgment based on the face image A (step S114). Note that the information regarding the face image A is not limited to the case where the information regarding the face image A is acquired immediately before performing the similarity judgment based on the face image A (step S114). The configuration may be such that the information is acquired in advance before determining whether the information is the above (step S106).

Further, in this embodiment, the same value is used as the first threshold, the second threshold, and the third threshold, but the present invention is not limited to this. For example, different values may be used for the first threshold, the second threshold, and the third threshold. Specifically, the second threshold may be higher or lower than the first threshold. Moreover, the third threshold value may be a higher value than the first threshold value and the second threshold value, or may be a lower value.

Further, considering that an image other than a face image (for example, an image of a landscape or an animal) is used as the registration image 70, the following processing may be performed. For example, after step S102 in FIG. 4 and before step S106, a face image determination may be made as to whether the registration image 70 is a face image. That is, the face image determination may be performed between step S102 and step S104 or between step S104 and step S106.

In this case, for example, if it is determined that the registration image 70 is a face image as a result of performing the face image determination between step S102 and step S104, the process moves to step S104. Further, as a result of performing the facial image determination between step S104 and step S106, if it is determined that the registration image 70 is a facial image, the process moves to step S106.

Further, as a result of the facial image determination, if it is determined that the registration image 70 is not a facial image, the process proceeds to step S118 without making the determination in step S106, and the registration of the registration image 70 is prohibited (step S118), this process may be ended. In this case, images other than facial images are prevented from being registered as the registration image 70.

Further, as a result of the facial image determination, if it is determined that the registration image 70 is not a facial image, the registration image 70 does not perform the determination in step S106, and proceeds to step S108, where the registration image 70 is added to the profile of the provided service. Registration of the registration image 70 may be permitted (step S108), and this processing may be ended. In this case, an image other than a face image may be registered as the registration image 70, but at least a face image of another person other than the registrant is suppressed from being registered. In other words, it can be said that this process allows the registration of images other than facial images unless a facial image of a person other than the registrant is registered.

《Second embodiment》
Next, a second embodiment will be described. FIG. 11 is a block diagram showing an example of the functional configuration of the server device 50 according to the second embodiment. FIG. 12 is a flowchart showing a part of the registration permission process executed by the server device 50 according to the second embodiment. Note that the same parts as in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

In the second embodiment, as shown in FIG. 11, the server device 50 further includes a promotion section 50D as a functional configuration. Each functional configuration is realized by the CPU 51 reading out and executing a registration permission program stored in the ROM 52 or the storage 54.

The promotion unit 50D determines that the degree of similarity between the certification face image 71 and the SNS face image 72 is greater than or equal to the second threshold, and the degree of similarity between the registration image 70 and the SNS face image 72 is less than the third threshold. , when prohibiting the registration of the registration image 70 to the profile, prompts for additional registration of the SNS face image 72 whose degree of similarity with the certification face image 71 is equal to or higher than the second threshold value to the profile.

The operation according to the second embodiment will be explained below.

As shown in FIG. 12, in this embodiment, if the CPU 51 determines in step S120 that the similarity B is less than the third threshold (step S120: NO), the CPU 51 Registration is prohibited (step S224). Next, the CPU 51 prompts for additional registration of the face image 4 (face image A) shown in FIG. 9 in the profile. Specifically, the CPU 51 displays, for example, "Would you like to register face image 4 (face image A) to your profile?".

As described above, in this embodiment, the user is prompted to additionally register the face image 4 whose similarity with the certification face image 71 is equal to or higher than the second threshold value to the profile. In this way, since the registration image 70 prompts the registration of the face image 4 for which reliability has been recognized as the registrant's own image, the registration This saves the registrant's effort in preparing the image 70 for use.

《Third embodiment》
Next, a third embodiment will be described. FIG. 13 is a flowchart showing a part of the registration permission process executed by the server device 50 according to the third embodiment. Note that the same parts as in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

In the third embodiment, similarly to the second embodiment, the server device 50 further includes a promotion section 50D as a functional configuration (see FIG. 11). Each functional configuration is realized by the CPU 51 reading out and executing a registration permission program stored in the ROM 52 or the storage 54.

When permitting registration of the registration image 70 to the profile, the promotion unit 50D urges additional registration of other registration images 70 to the profile. Specifically, when permitting registration of the registration image 70 to the profile because the degree of similarity between the registration image 70 and the certification face image 71 is greater than or equal to the first threshold, the promotion unit 50D performs step (step S106: YES), the user is prompted to additionally register a side face image (an example of a profile image) as another registration image 70 in the profile.

The operation according to the third embodiment will be explained below.

As shown in FIG. 13, in this embodiment, when the CPU 51 determines in step S106 that the degree of similarity between the registration image 70 and the certification face image 71 is greater than or equal to the first threshold (step S106 : YES), the registration of the registration image 70 in the profile of the provided service is permitted (step S108).

Next, the CPU 51 prompts for additional registration of a side face image in the profile as another registration image 70 (step S302). Specifically, the CPU 51 displays, for example, "Would you like to register a profile image (face photo) to your profile?".

In this way, the image information registered in the profile is enriched by prompting the user to additionally register the facial image in the profile and by additionally registering the facial image in the profile.

As described above, in this embodiment, apart from the registration image 70 whose degree of similarity with the certification face image 71 is equal to or higher than the first threshold, additional registration of a side face image to the profile is prompted. Here, the registration image 70 whose similarity with the certification face image 71 is equal to or higher than the first threshold is considered to be a front face image or a face image close to a front face image, but in this embodiment, Since the user is prompted to additionally register a side face image to the profile, the user is prompted to additionally register an image from a different angle to the profile than the registration image 70 for which registration is permitted. As a result, the variety of images registered in the profile increases.

《Fourth embodiment》
Next, a fourth embodiment will be described. FIG. 14 is a flowchart showing a part of the registration permission process executed by the server device 50 according to the fourth embodiment. Note that the same parts as in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

In the fourth embodiment, similarly to the second and third embodiments, the server device 50 further includes a promotion section 50D as a functional configuration (see FIG. 11). Each functional configuration is realized by the CPU 51 reading out and executing a registration permission program stored in the ROM 52 or the storage 54.

When permitting registration of the registration image 70 to the profile, the promotion unit 50D urges additional registration of other registration images 70 to the profile. Specifically, when the degree of similarity between the registration image 70 and the certification face image 71 is less than the first threshold (step S106: NO), the promotion unit 50D selects the certification face image 71 and the SNS face. The degree of similarity with the image 72 is at least the second threshold (step S114: YES), and the degree of similarity between the registration image 70 and the SNS face image 72 is at least the third threshold (step S120: YES). When permitting registration of the registration image 70 to the profile, additional registration of a front face image to the profile as another registration image 70 is encouraged.

The operation according to the fourth embodiment will be explained below.

As shown in FIG. 14, in this embodiment, if the CPU 51 determines in step S120 that the similarity degree B is equal to or higher than the third threshold (step S120: YES), the CPU 51 registers the registration image 70. (Step S122).

Next, the CPU 51 prompts for additional registration of a front face image in the profile as another registration image 70 (step S402). Specifically, the CPU 51 displays, for example, "Would you like to register a front face image (face photo) to your profile?".

In this way, the image information registered in the profile is enriched by prompting the user to additionally register the facial image in the profile and by additionally registering the facial image in the profile.

As described above, in this embodiment, apart from the registration image 70 whose similarity with the certification face image 71 is less than the first threshold, the user is prompted to additionally register a front face image in the profile. Here, the registration image 70 whose similarity with the certification face image 71 is less than the first threshold is considered to be a side face image or a face image close to the side face image, but in this embodiment, Since the user is prompted to additionally register a frontal face image to the profile, additional registration of an image from a different angle than the registration image 70 for which registration is permitted is prompted to be additionally registered to the profile. As a result, the variety of images registered in the profile increases.

《Fifth embodiment》
Next, a fifth embodiment will be described. FIG. 15 is a flowchart showing a part of the registration permission process executed by the server device 50 according to the fifth embodiment. Note that the same parts as in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

As described above, in the first embodiment, the permission unit 50B determines whether the degree of similarity between the certification face image 71 and the SNS face image 72 is equal to or higher than the second threshold value for different SNS face images 72, and the registration image Registration of the registration image 70 to the profile is also permitted when the degree of similarity between the registration image 70 and the SNS face image 72 is equal to or higher than the third threshold.

On the other hand, in the fifth embodiment, the permission unit 50B determines that, for the same SNS face image 72, the degree of similarity with the certification face image 71 is equal to or higher than the second threshold, and the degree of similarity with the registration image 70 is If the degree is equal to or higher than the third threshold, registration of the registration image 70 to the profile is permitted.

The operation according to the fifth embodiment will be explained below.

In this embodiment, as shown in FIG. 4, if the CPU 51 determines in step S106 that the degree of similarity between the registration image 70 and the certification face image 71 is less than the first threshold (step S106 :NO), the process moves to step S510 (see FIG. 15) instead of step S110. For example, in the example shown in FIG. 7, the first threshold value is set to 0.7, and the degree of similarity between the registration image 70 and the certification face image 71 is set to 0.5. In the example shown in FIG. 7, the process moves to step S510.

As shown in FIG. 15, in step S510, the CPU 51 acquires facial image information from the posted image list 79 posted on the user's SNS, and creates a first facial image list 81 and a second facial image list 82. do.

Here, as shown in FIG. 16, the posted image list 79 includes, for example, facial images and images other than facial images. Examples of images other than face images include landscape images of landscapes, food images of food, and product images of products. Then, the CPU 51 recognizes faces from the images in the posted image list 79 and creates a first face image list 81 and a second face image list 82 from the images in which the faces have been recognized. The first face image list 81 and the second face image list 82 are lists containing the same face images. Note that the face image to be saved may be a face image cut out from an image including a face image. Furthermore, a face image may be cut out from a video posted on SNS.

Next, the CPU 51 acquires information on the degree of similarity (hereinafter referred to as similarity A) between the face image for certification 71 and the face image with the highest degree of similarity (hereinafter referred to as face image A) from the first face image list 81. (Step S512). Specifically, as shown in FIG. 17, the CPU 51 calculates the degree of similarity between each of the face images in the first face image list 81 and the certification face image 71, and selects the highest value among the degrees of similarity. obtains information with a high degree of similarity.

Next, the CPU 51 determines whether the similarity A obtained in step S510 is greater than or equal to the second threshold (step S514).

If the CPU 51 determines in step S514 that the degree of similarity A is greater than or equal to the second threshold (step S514: YES), the process proceeds to step S515. Note that the example shown in FIG. 17 shows a case where the second threshold value is 0.7 and the similarity degree A is 0.79. In the example shown in FIG. 17, the second threshold value is the same value as the first threshold value. In the example shown in FIG. 17, the process moves to step S515.

On the other hand, if the CPU 51 determines in step S514 that the similarity degree A is less than the second threshold (step S514: NO), the CPU 51 prohibits registration of the registration image 70 (step S518), and Finish the process.

In step S515, face image A is stored in the first similarity list 91, and face image A is deleted from the first face image list 81 (step S516). Note that in the example shown in FIG. 17, face image 4 as face image A is stored in the first similarity list 91. Furthermore, as shown in FIG. 18, face image 4 is deleted from first face image list 81.

Next, the CPU 51 acquires information on the degree of similarity (hereinafter referred to as similarity B) between the registration image 70 and the face image with the highest degree of similarity (hereinafter referred to as face image B) from the second face image list 82 ( Step S516). Specifically, as shown in FIG. 19, the CPU 51 calculates the degree of similarity between each of the face images in the second face image list 82 and the registration image 70, and selects the one with the highest value among the degrees of similarity. Obtain information with high similarity.

Next, the CPU 51 determines whether or not the similarity B obtained in step S516 is equal to or greater than a third threshold (step S520).

If the CPU 51 determines in step S520 that the degree of similarity B is equal to or greater than the third threshold (step S520: YES), the process proceeds to step S521. Note that the example shown in FIG. 19 shows a case where the third threshold value is 0.7 and the similarity A is 0.81. In the example shown in FIG. 19, the third threshold has the same value as the second threshold and the first threshold. In the example shown in FIG. 19, the process moves to step S521.

On the other hand, if the CPU 51 determines in step S520 that the similarity degree B is less than the third threshold (step S520: NO), the CPU 51 prohibits the registration of the registration image 70 (step S518), and Finish the process.

In step S521, face image B is stored in the second similarity list 92, and face image B is deleted from the second face image list 82 (step S521). Note that in the example shown in FIG. 19, face image 2 as face image B is stored in the second similarity list 92. Furthermore, as shown in FIG. 20, face image 2 is deleted from the second face image list 82.

Next, the CPU 51 determines whether the same face image exists in the first similarity list 91 and the second similarity list 92 (step S523).

If the CPU 51 determines in step S523 that the same face image exists in the first similarity list 91 and the second similarity list 92 (step S523: YES), the CPU 51 allows the registration of the registration image 70, and Finish the process.

On the other hand, if the CPU 51 determines in step S523 that the same face image does not exist in the first similarity list 91 and the second similarity list 92 (step S523: NO), the process returns to step S512.

In the example shown in FIGS. 17 and 18, after returning to step S512, through steps S514 to S516, as shown in FIG. 21, face image 2 having the next highest degree of similarity after face image 4 is The facial image 2 is stored in the similar list 91 and deleted from the first facial image list 81.

Further, through steps S520 and S522, as shown in FIG. 22, the face image 3 having the next highest degree of similarity to the face image 2 is stored in the second similarity list 92, and the face image 3 is replaced with the second face image. It is deleted from the list 82.

Since face image 2, which is the same face image, exists in the first similarity list 91 shown in FIG. 21 and the second similarity list 92 shown in FIG. 22 (step S523: YES), the registration image 70 registration is permitted, and this process ends.

As described above, in this embodiment, for the same SNS face image 72, the degree of similarity with the certification face image 71 is equal to or higher than the second threshold, and the degree of similarity with the registration image 70 is equal to or higher than the third threshold. In this case, registration of the registration image 70 to the profile is permitted.

Therefore, for a different SNS face image 72, only when the degree of similarity with the verification face image 71 is equal to or higher than the second threshold and the degree of similarity with the registration image 70 is equal to or higher than the third threshold, the profile can be changed. Compared to a configuration in which registration of the registration image 70 is permitted, the reliability that the registration image 70 is the registrant's own image is increased.

《Sixth embodiment》
Next, a sixth embodiment will be described. FIG. 23 is a flowchart showing a part of the registration permission process executed by the server device 50 according to the sixth embodiment. Note that the same parts as in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

As described above, in the first embodiment, the permission unit 50B determines whether the degree of similarity between the certification face image 71 and the SNS face image 72 is equal to or higher than the second threshold value for different SNS face images 72, and the registration image Registration of the registration image 70 to the profile is also permitted when the degree of similarity between the registration image 70 and the SNS face image 72 is equal to or higher than the third threshold.

On the other hand, in the sixth embodiment, the permission unit 50B determines that, for different SNS face images 72, the degree of similarity with the certification face image 71 is equal to or higher than the second threshold, and the degree of similarity with the registration image 70 is is greater than or equal to the third threshold, and if additional conditions are met, registration of the registration image 70 to the profile is permitted. Specifically, the additional condition is that the degree of similarity between different SNS face images 72 is equal to or higher than a fourth threshold.

The operation according to the sixth embodiment will be explained below. Note that the same parts as those in the fifth embodiment are given the same reference numerals, and the explanation will be omitted as appropriate.

In this embodiment, when the CPU 51 determines in step S523 that the same face image does not exist in the first similarity list 91 and the second similarity list 92 (step S523: NO), the process proceeds to step S602. . In other words, for the same SNS face image 72, the condition is that the degree of similarity with the certification face image 71 is equal to or higher than the second threshold, and the degree of similarity with the registration image 70 is equal to or higher than the third threshold. If not satisfied, the process moves to step S602. In other words, for a different SNS face image 72, if the degree of similarity with the certification face image 71 is greater than or equal to the second threshold, and the degree of similarity with the registration image 70 is greater than or equal to the third threshold, step The process moves to S602.

In step S602, it is determined whether the additional condition is satisfied. If it is determined in step S602 that the additional conditions are satisfied (step S602: YES), registration of the registration image 70 is permitted, and the process ends.

On the other hand, if the CPU 51 determines in step S602 that the additional condition is not satisfied (step S602: NO), the process returns to step S512.

In this embodiment, the additional conditions include an SNS face image 72 whose similarity with the certification face image 71 is at least a second threshold, and an SNS face image 72 whose similarity with the registration image 70 is at least a third threshold. The condition is that the degree of similarity between and is equal to or greater than the fourth threshold. Therefore, in this embodiment, in step S602, the SNS face image 72 whose similarity with the certification face image 71 is equal to or higher than the second threshold and the SNS face whose similarity with the registration image 70 is equal to or higher than the third threshold It is determined whether the degree of similarity between the image 72 and the image 72 is equal to or higher than a fourth threshold.

In the example shown in FIG. 24, the fourth threshold is set to 0.7, and the similarity between the face image 4 whose similarity to the certification face image 71 is equal to or higher than the second threshold and the registration image 70 is set to 0.7. A case is shown in which the degree of similarity with face image 2, which is equal to or higher than the third threshold value, is 0.75. In the example shown in FIG. 24, registration of the registration image 70 is permitted.

As described above, in the present embodiment, the CPU 51 determines that the degree of similarity with the certification face image 71 is equal to or higher than the second threshold value, and the degree of similarity with the registration image 70 is the third threshold value for different SNS face images 72. In the case where the threshold value or more is satisfied, registration of the registration image 70 in the profile is permitted if the additional conditions are satisfied.

Therefore, for a different SNS face image 72, if the degree of similarity with the certification face image 71 is equal to or higher than the second threshold, and the degree of similarity with the registration image 70 is equal to or higher than the third threshold, the additional condition is applied. Compared to a configuration in which registration of the registration image 70 to the profile is permitted regardless of success or failure, the reliability that the registration image 70 is the registrant's own image is increased.

In this embodiment, specifically, an SNS face image 72 whose similarity with the certification face image 71 is a second threshold or more, and an SNS face image whose similarity with the registration image 70 is a third threshold or more 72 is equal to or higher than the fourth threshold, registration of the registration image 70 to the profile is permitted.

For this reason, compared to a configuration in which registration of the registration image 70 to a profile is permitted regardless of whether the condition that the degree of similarity between different SNS face images 72 is equal to or higher than the fourth threshold is satisfied, the registration image 70 is registered with the registrant. The reliability that the image is of the person himself/herself is increased.

(Variation example of additional conditions)
In the present embodiment, the additional condition is that the degree of similarity between different SNS face images 72 is equal to or higher than the fourth threshold, but the additional condition is not limited to this. For example, the additional condition may be that at least one of the different SNS face images 72 is attached with an identifier (hereinafter referred to as a tag) indicating that it is the image of the registrant. Furthermore, for example, the condition may be that the tag is attached by a user other than the registrant (that is, another person).

Further, the additional condition may be a condition using meta information (for example, Exif (Exchangeable image file format)) attached to the registration image 70 and the SNS face image 72 (for example, face image 4 in FIG. 24). Specifically, for example, the additional condition may be that the information on the photographing equipment used for photographing, which is attached to the registration image 70 and the SNS face image 72, is the same. Further, for example, an additional condition may be that the photographing date and time information attached to the registration image 70 and the posting date and time information attached to the SNS face image 72 are the same or close within a predetermined range.

The additional conditions may be conditions other than those described above, as long as they increase the reliability that the SNS face image 72 is the registrant's own image.

The present invention is not limited to the embodiments described above, and various modifications, changes, and improvements can be made without departing from the spirit thereof. For example, each of the embodiments and modifications shown above may be configured by combining a plurality of them as appropriate.

Furthermore, in the above embodiments, the processor refers to a processor in a broad sense, and includes a general-purpose processor (for example, the aforementioned CPU), a dedicated processor (for example, GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA). : Field Programmable Gate Array, programmable logic device, etc.).

Further, the operation of the processor in the above embodiments may be performed not only by one processor, but also by a plurality of processors located at physically separate locations working together. Further, the order of each operation of the processor is not limited to the order described in the above embodiments, and may be changed as appropriate.

10 Information processing system 20 Device 50 Server device (an example of a registration permission device)
50A Acquisition section 50B Permission section 50C Prohibition section 50D Promotion section 51 CPU

Claims (10)

Equipped with a processor,
The processor includes:
Obtain image information for registration in the service profile,
Obtain the information of the first facial image used in the identification card,
obtaining information on one or more second facial images from a linked service that has been linked with the service;
If the degree of similarity between the registration image and the first face image is greater than or equal to a first threshold, permitting registration of the registration image to the profile;
If the degree of similarity between the registration image and the first face image is less than the first threshold, the degree of similarity between the first face image and the second face image is greater than or equal to a second threshold, and A registration permission device that permits registration of the registration image in the profile when the degree of similarity between the registration image and the second face image is equal to or higher than a third threshold. The processor includes:
When the degree of similarity between the registration image and the first face image is less than the first threshold, the degree of similarity between the first face image and the second face image is less than the second threshold, or The registration permission device according to claim 1, wherein registration of the registration image to the profile is prohibited when the degree of similarity between the registration image and the second facial image is less than a third threshold. The processor includes:
The degree of similarity between the first face image and the second face image is greater than or equal to the second threshold, and the degree of similarity between the registration image and the second face image is less than the third threshold, so that the profile 3. Registration permission according to claim 2, wherein when prohibiting the registration of an image for registration into the profile, the registration permission is prompted to additionally register a second facial image whose degree of similarity with the first facial image is equal to or higher than a second threshold value to the profile. Device. The processor includes:
When the degree of similarity between the registration image and the first face image is less than the first threshold, the degree of similarity between the same second face image and the first face image is equal to or higher than the second threshold; 4. The registration permission device according to claim 1, wherein the registration permission device permits registration of the registration image in the profile when the degree of similarity with the registration image is equal to or higher than a third threshold. The processor includes:
When the degree of similarity between the registration image and the first face image is less than the first threshold, the degree of similarity of the different second face image to the first face image is equal to or higher than the second threshold; In addition, if the degree of similarity with the registration image is equal to or higher than a third threshold, registration of the registration image in the profile is permitted if additional conditions are met. Registration permitted device as described in . The registration permission device according to claim 5, wherein the additional condition is that the degree of similarity between the different second facial images is equal to or higher than a fourth threshold. The processor includes:
The registration permission device according to any one of claims 1 to 6, wherein when permitting registration of a registration image to the profile, the registration permission device prompts additional registration of another registration image to the profile. The processor includes:
When permitting registration of the registration image to the profile because the degree of similarity between the registration image and the first face image is greater than or equal to the first threshold,
The registration permission device according to claim 7, wherein the registration permission device prompts additional registration of a profile image to the profile as the other registration image. The processor includes:
The degree of similarity between the registration image and the first face image is less than the first threshold, and the degree of similarity between the first face image and the second face image is greater than or equal to a second threshold; and when permitting registration of the registration image to the profile because the degree of similarity between the registration image and the second face image is equal to or higher than a third threshold;
The registration permission device according to claim 7, wherein the registration permission device prompts additional registration of a front face image to the profile as the other registration image. to the computer,
Obtain image information for registration in the service profile,
Obtain the information of the first facial image used in the identification card,
obtaining information on one or more second facial images from a linked service that has been linked with the service;
If the degree of similarity between the registration image and the first face image is greater than or equal to a first threshold, permitting registration of the registration image to the profile;
If the degree of similarity between the registration image and the first face image is less than the first threshold, the degree of similarity between the first face image and the second face image is greater than or equal to a second threshold, and A registration permission program for executing a process of permitting registration of the registration image in the profile when a degree of similarity between the registration image and the second face image is equal to or higher than a third threshold.