JP2020022045A - Program, information processing method, and information processing apparatus - Google Patents

Abstract

To provide a technology that can guarantee that an image submitted online at the time of identity verification is taken on the spot.SOLUTION: A program causes an information processing apparatus including a display unit to execute a step of displaying a moving image of a shooting area output to the display unit by a shooting device, a step of displaying a shooting guide instructing a method of shooting a face, which includes a position in the shooting area of the user's face, which is selected on the basis of a predetermined selection logic, in a shooting area displayed on the display unit, and a step of causing the shooting device to shoot the moving image of the shooting area.SELECTED DRAWING: Figure 9

Description

  The present disclosure relates to a program, an information processing method, and an information processing device.

  In recent years, a financial service using ICT called Fintech has been developed. Examples of the Fintech service include, for example, a service for automatically managing a household account and a book by automatically creating a household account book, a book, and the like, a service for asset management, a service for trading virtual currency, a QR code (registration) (Trademark) and the like.

  It is obligatory for a company that provides these services to confirm the identity of a person who wants to use the service in order to prevent fraudulent acts or the like from occurring. For example, Patent Literature 1 discloses a technology for facilitating identity verification of an applicant by displaying a plurality of identification cards on a screen in association with each other.

JP-A-2006-157439

  Currently, some services that handle the exchange of funds, such as payments, not only check the image of the ID card submitted by the user online, but also use means such as mailing the application document to the user's home As a result, strict identity verification is performed. However, in view of the future development of services, it is desirable to be able to complete identity verification online without relying on means such as mailing.

  When performing identity verification online, there is a possibility that unauthorized image data that has been processed or the like may be submitted. In order to prevent such impropriety, a mechanism is required that can ensure that the image data submitted online is not the reused image but the one taken on the spot (liveness). It is considered to be.

  However, Patent Literature 1 discloses a technique for facilitating identity verification of an applicant, but discloses a technique for ensuring that an image used for identity verification is taken on the spot. Not.

  An object of the present disclosure is to provide a technology capable of ensuring that an image submitted online at the time of identity verification is taken on the spot.

  A program according to an embodiment of the present disclosure includes, on an information processing apparatus having a display unit, a step of displaying a moving image of a shooting region output by the shooting device on the display unit; Displaying a shooting guide that instructs a shooting method of the face including the position of the user's face in the shooting area selected based on the selection logic, and causing the shooting apparatus to shoot a moving image of the shooting area, Is executed.

FIG. 1 illustrates a configuration of a communication system according to an aspect of the embodiment. FIG. 2 illustrates an example of a hardware configuration of the information processing apparatus according to the present disclosure. FIG. 3 is an example of a block diagram illustrating a functional configuration of the information processing apparatus according to the first embodiment. FIG. 4 is an example of a block diagram illustrating a functional configuration of the information processing apparatus according to the first embodiment. FIG. 5 illustrates an example of a sequence illustrating a process performed by the communication system 1 according to the first embodiment. FIG. 6 illustrates an example of a sequence illustrating a process performed by the communication system 1 according to the first embodiment. FIG. 7 shows an example of a photographing guide of an identification card displayed on a photographing screen of the information processing apparatus according to the first embodiment. FIG. 8 illustrates an example of a photographing guide of an identification card displayed on a photographing screen of the information processing apparatus according to the first embodiment. FIG. 9 illustrates an example of a face shooting guide displayed on a shooting screen of the information processing apparatus according to the second embodiment. FIG. 10 illustrates an example of a face shooting guide displayed on a shooting screen of the information processing apparatus according to the second embodiment. FIG. 11 illustrates an example of a shooting guide on the side of an identification card displayed on a shooting screen of the information processing apparatus according to the third embodiment. FIG. 12 shows an example of a photographing guide on the side of the identification card displayed on the photographing screen of the information processing apparatus according to the third embodiment. FIG. 13 is an example of a block diagram illustrating a functional configuration of an information processing apparatus according to the third embodiment. FIG. 14 shows an example of a processing sequence of the communication system according to the fourth embodiment. FIG. 15 shows an example of a processing sequence of the communication system according to the fifth embodiment.

<Legal compliance>
The disclosure set forth herein, if implemented, will be implemented in compliance with the laws of the countries where the disclosure is implemented. In addition, the disclosure described in this specification is implemented with all the changes, substitutions, variations, alterations, and modifications that can be made by those skilled in the art necessary to comply with the laws and regulations of each country.

  An embodiment for implementing the communication system 1 according to the present disclosure will be described with reference to the drawings.

<System configuration>
FIG. 1 illustrates a configuration of a communication system 1 according to an embodiment of the present disclosure. As disclosed in FIG. 1, in the communication system 1, the servers 110A and 110B are connected to the terminals 120A, 120B, and 120C via the network 130.

  In the present disclosure, when it is not necessary to distinguish between the server 110A and the server 110B, the server 110A and the server 110B may be expressed as the server 110, respectively.

  In the present disclosure, when it is not necessary to distinguish between the terminal 120A, the terminal 120B, and the terminal 120C, the terminal 120A, the terminal 120B, and the terminal 120C may be expressed as the terminal 120, respectively.

  In the present disclosure, when it is not necessary to distinguish between the server 110 and the terminal 120, the server 110 and the terminal 120 may be expressed as the information processing device 200, respectively. Note that the number of information processing devices 200 connected to the network 130 is not limited.

  The server 110 provides a predetermined service to the terminal 120 used by the user via the network 130. Examples of the predetermined service include, but are not limited to, a settlement service, an electronic commerce service, an SNS (Social Networking Service) represented by an instant messenger, a content providing service such as music, videos, and books, and a financial service. When the user uses a predetermined service via the terminal 120, the server 110 can provide the predetermined service to one or more terminals 120.

  If necessary, a terminal used by the user X is expressed as a terminal 120X, and user information in a predetermined service associated with the user X or the terminal 120X is expressed as user information X. The user information is information of a user associated with an account used by the user in a predetermined service. The user information is, by way of example and not limitation, a user's name, a user's icon image, a user's age, a user's gender, a user's address, and a user's hobby that are input by the user or given by a predetermined service. The information includes information associated with the user, such as the preference and the user identifier, and any one or a combination of these may be used.

  The network 130 has a role of connecting two or more information processing apparatuses 200. The network 130 refers to a communication network that provides a connection path so that data can be transmitted and received after the terminal 120 connects to the server 110.

  One or more portions of network 130 may be a wired or wireless network. The network 130 may be, for example and without limitation, an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), LAN (Wireless LAN: WLAN), wide area network (Wide Area Network: WAN), wireless WAN (Wireless WAN: WWAN), metropolitan area network (MAN), part of the Internet, public switched telephone network (Public) Switched Telephone Network: a part of PSTN, mobile phone network, ISDNs (Integrated Service Digital Networks), wireless LANs, LTE (Long Term Evolution), CDMA (Code Division Multiple Access), Bluetooth (Bluetooth (registered trademark)), satellite Communication etc., or It may include two or more combinations of these. Network 130 may include one or more networks 130.

  The information processing device 200 may be any information processing device that can implement the functions and / or methods described in the present disclosure.

  The information processing apparatus 200 includes, but is not limited to, a smartphone, a mobile phone (feature phone), a computer (for example, but not limited to, a desktop, a laptop, and a tablet), a server device, and a media computer platform (for example, but not limited to). , Cables, satellite set-top boxes, digital video recorders, etc.), handheld computer devices (eg, but not limited to, PDA (Personal Digital Assistant), e-mail clients, etc.), wearable terminals (eg, but not limited to, glasses-type devices, Clock devices, etc.), other types of computers, or communication platforms.

<Hardware (HW) configuration>
The HW configuration of the information processing device 200 included in the communication system 1 will be described with reference to FIG.

  The information processing device 200 includes a processor 201, a memory 202, a storage 203, an input / output interface (input / output I / F) 204, and a communication interface (communication I / F) 205. The components of the HW of the information processing device 200 are interconnected via a bus B, for example, but not limited to.

  The information processing device 200 realizes the functions and / or methods described in the present disclosure by cooperation of the processor 201, the memory 202, the storage 203, the input / output I / F 204, and the communication I / F 205. I do.

  The processor 201 executes a function and / or a method realized by a code or an instruction included in a program stored in the storage 203. The processor 201 includes, for example and without limitation, a central processing unit (CPU), an MPU (Micro Processing Unit), a GPU (Graphics s Processing Unit), a microprocessor (microprocessor), a processor core, and a multiprocessor. ASIC (Application-Specific Integrated Circuit), FPGA (Field Programmable Gate Array), etc., and logic circuits (hardware) formed on integrated circuits (IC (Integrated Circuit) chips, LSI (Large Scale Integration)), etc. Each processing disclosed in each embodiment may be realized by a dedicated circuit. Further, these circuits may be realized by one or a plurality of integrated circuits, and the plurality of processes described in each embodiment may be realized by one integrated circuit. Further, the LSI may be referred to as a VLSI, a super LSI, an ultra LSI, or the like, depending on the degree of integration.

  The memory 202 temporarily stores the program loaded from the storage 203 and provides a work area for the processor 201. The memory 202 also temporarily stores various data generated while the processor 201 is executing the program. The memory 202 includes, for example, without limitation, a random access memory (RAM) and a read only memory (ROM).

  The storage 203 stores a program. The storage 203 includes, for example, without limitation, a hard disk drive (HDD), a solid state drive (SSD), and a flash memory.

  The communication I / F 205 sends and receives various data via the network 130. The communication may be performed by wire or wireless, and any communication protocol may be used as long as mutual communication can be performed. The communication I / F 205 has a function of executing communication with another information processing device via the network 130. The communication I / F 205 transmits various data to another information processing device in accordance with an instruction from the processor 201. Further, the communication I / F 205 receives various data transmitted from another information processing apparatus and transmits the data to the processor 201.

  The input / output I / F 204 includes an input device that inputs various operations to the information processing device 200 and an output device that outputs a processing result processed by the information processing device 200. In the input / output I / F 204, an input device and an output device may be integrated, or may be separated into an input device and an output device.

  The input device is realized by any one of all types of devices capable of receiving input from a user and transmitting information related to the input to the processor 201, or a combination thereof. The input device includes, for example and without limitation, hardware keys such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera (operation input through an image), and a microphone (operation input by voice).

  The output device is realized by any one of all types of devices capable of outputting the processing result processed by the processor 201 or a combination thereof. When outputting the processing result as a video and / or a moving image, the output device may be any one of or all devices capable of displaying the display data according to the display data written in the frame buffer. It is realized by a combination. Examples of the output device include, but are not limited to, a touch panel, a touch display, a monitor (for example, but not limited to, a liquid crystal display, an OELD (Organic Electroluminescence Display)), a head mounted display (HDM), a projection mapping, and a hologram. And a device capable of displaying an image or text information in the air or the like (may be a vacuum), a speaker (audio output), a printer, and the like. Note that these output devices may be capable of displaying display data in 3D.

  The program according to each embodiment of the present disclosure may be provided in a state stored in a computer-readable storage medium. The storage medium is capable of storing the program on a “temporary tangible medium”. The programs include, by way of example and not limitation, software programs and computer programs.

  The storage medium is, where appropriate, one or more semiconductor-based or other integrated circuits (ICs), such as, but not limited to, a field programmable gate array (FPGA), an application specific IC (ASIC), etc. ), Hard disk drive (HDD), hybrid hard drive (HHD), optical disk, optical disk drive (ODD), magneto-optical disk, magneto-optical drive, floppy diskette, floppy disk drive (FDD), magnetic It may include tape, solid state drive (SSD), RAM drive, secure digital card or drive, any other suitable storage medium, or a suitable combination of two or more thereof. A storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate.

  Further, the program of the present disclosure may be provided to information processing device 200 via any transmission medium (such as a communication network or a broadcast wave) capable of transmitting the program.

  Further, each embodiment of the present disclosure can also be realized in the form of a data signal embedded in a carrier wave, in which a program is embodied by electronic transmission.

  The program according to the present disclosure includes, for example and without limitation, script languages such as ActionScript and Javascript (registered trademark), object-oriented programming languages such as Jactive-C and Java (registered trademark), and markup languages such as HTML5. Implemented using

  At least a part of the processing in the information processing device 200 may be realized by cloud computing including one or more computers.

  At least part of the processing in the information processing device 200 may be performed by another information processing device. In this case, at least a part of the processing of each functional unit realized by the processor 201 may be performed by another information processing device.

<Others>
Unless explicitly stated, the configuration of the determination in the embodiment of the present disclosure is not essential, and a predetermined process is performed when the determination condition is satisfied, or a predetermined process is performed when the determination condition is not satisfied. May be.

  In this disclosure, “or” has the inclusive, rather than exclusive, meaning unless otherwise stated or indicated by context. Thus, in this disclosure, "A or B" means "A, B, or both," unless stated otherwise or indicated by context. Further, unless otherwise indicated or indicated by context, "and" is intended to mean both joint and individual. Thus, as used herein, unless otherwise specified or indicated by context, "A and B" means "A and B together or separately (J and J)." Further, unless otherwise specified or indicated by context, “a,” “an,” or “the” shall mean “one or more.” Thus, as used herein, unless otherwise indicated or indicated by context, “an A” or “the A” means “one or more A”.

  The present disclosure encompasses all changes, substitutions, variations, alterations, and modifications that may occur to those skilled in the art, to the embodiments and / or examples of the present disclosure. Similarly, where appropriate, the appended claims cover all changes, substitutions, variations, alterations, and modifications that may occur to those skilled in the art for the embodiments and / or examples of the present disclosure. Include. Further, the present disclosure is intended to enable one of ordinary skill in the art to make one or more features of the embodiments and / or examples of the present disclosure and one or more of the other embodiments and / or examples of the present disclosure. And any combination with one or more features.

  Additionally, a device or system or a component of a device or system that is adapted, arranged, capable, configured, usable, operable, or operable to perform a particular function. Reference is made in the appended claims to the device, system, or component so adapted, arranged, capable, configured, enabled, enabled. As long as the device, system or component or its specific features are activated, turned on or unlocked, as long as the device, system or component is activated or operable.

<First embodiment>
In the first embodiment, when performing the user identification process using the image of the identification card (identification document) and the image of the user's face, the method of photographing the image of the identification card is designated on the spot. In this embodiment, it is ensured that the image uploaded online is taken on the spot (liveness).

  In the first embodiment, in a predetermined service provided by the server 110, online identity confirmation and liveness confirmation are performed at the timing of application for use of the service and the like. Use of this service is permitted. When receiving a service application or the like, the server 110 requests the user to submit an image of the user's ID card and an image of the user's face online. The user who has received the request uses the camera included in the terminal 120 to photograph the ID card and the face of the user. The terminal 120 transmits the photographed image to the server 110, and the server 110 analyzes the received image to confirm the identity and the liveness.

  At this time, the terminal 120 displays a photographing guide (hereinafter, referred to as an “identification photographing guide”) for instructing a method of photographing the ID on a screen for photographing the ID. The method of photographing the ID includes the position of the ID within the frame of the photographed image, the method of holding the ID, and the like. The photographing guide of the identification card is changed every time the user photographs the image of the identification card. Although a specific example of the photographing guide will be described later, the photographing guide may be defined to indicate the positional relationship between the identification card and a part of the user's body that holds the identification card.

  The server 110 confirms by image processing whether or not the image of the identification card submitted online is an image that has been photographed according to the designated photographing guide, so that the photographed image is photographed on the spot. It is determined whether or not the image is an image. If the image is taken according to the instructed photographing guide, it is ensured that the image is an image taken on the spot.

  The identification card used for the identity verification process may be any medium that can confirm the identity. Identification cards include, but are not limited to, driver's licenses, passports (passports), Basic Resident Register cards, My Number cards, health insurance card, etc., but are not limited to official certificates Absent.

  According to the first embodiment, the photographing guide of the identification card is changed every time the user photographs the image of the identification card. In other words, it becomes difficult for the user to perform an action of capturing an image to be submitted online beforehand and submit it later, or an action of processing and submitting an image captured in advance. That is, according to the first embodiment, an effect is obtained that it is possible to ensure that an image submitted online is shot on the spot (liveness). In addition, since the server 110 or the terminal 120 selects the photographing guide of the identification card instructed to the user, the randomness of the photographing guide instructed to the user can be ensured, and the identity confirmation and liveness confirmation can be performed. The effect is obtained that it is possible to increase the confirmation accuracy when performing the operation.

  Further, according to the first embodiment, since the image of the identification card and the image of the face are separate images, it is difficult to focus on both the identification card and the face in one image. Can be avoided.

<Functional Configuration of First Embodiment>
The functional configuration of the server 110 will be described with reference to FIG. The functional unit disclosed in FIG. 3 is realized by cooperation of the processor 201, the memory 202, the storage 203, the input / output I / F 204, and the communication I / F 205 included in the information processing apparatus 200.

  The server 110 includes an input / output unit 311, a communication unit 312, a storage unit 317, a selection unit 313, a shooting guide transmission unit 314, an image reception unit 315, an authentication unit 316, and a storage unit 317. The processor 201 reads out the program stored in the storage unit 317 by the input / output unit 311, the communication unit 312, the selection unit 313, the imaging guide transmission unit 314, the image reception unit 315, and the authentication unit 316. And executed. The storage unit 317 is realized using the memory 202 and / or the storage 203.

  The input / output unit 311 has a function of performing processing for receiving input of various data via the input / output I / F 204 and processing for outputting various data via the input / output I / F 204.

  The communication unit 312 has a function of receiving various data from the terminal 120 via the communication I / F 205 and transmitting various data to the terminal 120 using the communication I / F 205.

  The selection unit 313 has a function of selecting a shooting guide of an identification card to be displayed on the screen of the terminal 120 from a plurality of variations (patterns).

  The photographing guide transmitting unit 314 transmits information (hereinafter, referred to as “photographing guide instruction information”) for instructing the terminal 120 of a photographing guide of an identification card to be displayed on the screen of the terminal 120 selected by the selecting unit 313. It has a function of transmitting to the terminal 120.

  The image receiving unit 315 includes an image of the user's ID card, an image of the user's face, and attribute information of the user (name, address, and date of birth) input by the user on the screen of the terminal 120. And the like from the terminal 120.

  The authentication unit 316 has a function of confirming the identity and liveness of the user using the image of the user's ID card, the image of the user's face, and the attribute information of the user received by the image receiving unit 315. Have. In the following description, the identification of the user and the confirmation of the liveness may be collectively referred to as “identification”.

More specifically, the authentication unit 316
1. The position of the ID card and the holding method of the ID card specified in the ID card shooting guide, and the position and ID card of the ID card appearing in the image of the user ID card received by the image receiving unit 315. As a result of comparing with the retention method of
2. A result of comparing the image of the face portion included in the image of the user ID received by the image receiving unit 315 with the received image of the face of the user, and
3. Based on the result of comparing the attribute information of the user included in the image of the identification card of the user received by the image receiving unit 315 with the attribute information of the received user, the identity of the user and the liveness confirmation are performed.

  Note that the authentication unit 316 may obtain the results of the personal confirmation and the liveness confirmation performed by the administrator of the server 110, instead of performing the personal confirmation and the liveness confirmation of the user.

  The storage unit 317 stores a program executed by the server 110 according to the first embodiment.

  The functional configuration of the terminal 120 will be described with reference to FIG. The functional unit disclosed in FIG. 4 is realized by cooperation of a processor 201, a memory 202, a storage 203, an input / output I / F 204, and a communication I / F 205 included in the information processing apparatus 200.

  The terminal 120 includes an input unit 321, a communication unit 322, a display control unit 323, an imaging unit 324, an authentication unit 325, and a storage unit 326. The input unit 321, the communication unit 322, the display control unit 323, the imaging unit 324, and the authentication unit 325 are realized by the processor 201 reading and executing a program stored in the storage unit 326. . The storage unit 326 is realized using the memory 202 and / or the storage 203.

  The input unit 321 has a function of performing a process of receiving various inputs via the input / output I / F 204. For example, the input unit 321 receives an input of attribute information of a user via a touch panel or the like provided in the terminal 120.

  The communication unit 322 has a function of performing a process of receiving various data from the server 110 via the communication I / F 205 and a process of transmitting various data to the server 110 using the communication I / F 205. Further, the communication unit 322 has a function of receiving shooting guide instruction information from the server 110. Further, the communication unit 322 has a function of transmitting the image of the user's identification card, the image of the user's face, and the attribute information of the user received by the input unit 321 to the server 110, which are captured by the capturing unit 324. .

  The display control unit 323 displays an image (which may be referred to as an image of a shooting region or a shooting screen) indicating a shooting region output from a camera (photographing device) provided in the terminal 120, and issues a shooting guide instruction from the server 110. It has a function of displaying a photographing guide of the identification card designated by the information so as to overlap the image indicating the photographing area.

  Although described later in detail, in the first embodiment, the terminal 120 may select the photographing guide of the identification card to be displayed on the screen of the terminal 120, instead of the server 110 selecting the guide. . In this case, the display control unit 323 may select an imaging guide of the identification card from a plurality of variations (patterns) according to a predetermined selection logic.

  The image capturing unit 324 has a function of capturing an image of the user's ID card and an image of the user's face using a camera included in the terminal 120 in response to the operation of the user.

  The authentication unit 325 uses the photographing guide instruction information, the image of the user's ID card and the image of the user's face photographed by the photographing unit 324, and the user's attribute information input to the input unit 321. It has a function to confirm the identity and liveness of the user. Although described later in detail, the authentication unit 325 is a functional unit that is necessary when the terminal 120 performs the user identity confirmation process and the liveness confirmation process by itself. Therefore, when the terminal 120 does not perform the user identity confirmation processing and the liveness confirmation processing by itself, the authentication unit 325 is unnecessary.

  The storage unit 326 stores a program executed by the terminal 120 according to the first embodiment. Also, it temporarily stores the shooting guide instruction information received from the server 110.

<Operation Processing of First Embodiment>
With reference to FIG. 5, processing of the communication system 1 according to the first embodiment will be described. FIG. 5 illustrates an example of a sequence illustrating a process performed by the communication system 1 according to the first embodiment.

  Here, the image of the identification card to be photographed may be two types of an image of the personal photograph page of the identification card and an image of the side of the identification card. For example, it is possible to correspond to an identification card such as a passport in which a personal photograph is posted on a specific page. Further, the image of the identification card to be photographed may be two types of an image of the front surface of the identification card and an image of the side surface of the identification card. For example, it can correspond to an identification card in which information is described only on the surface. Further, the image of the identification card to be photographed may be three types of an image of the front surface of the identification card, an image of the back surface of the identification card, and an image of the side surface of the identification card. For example, an identification card such as a driver's license or a Basic Resident Register card in which information is written on both the front and back surfaces can be used.

  In the following description, it is assumed that there are three types of images of the ID card to be photographed: an image of the front surface of the ID card, an image of the back surface of the ID card, and an image of the side surface of the ID card. Similarly, the photographing guide for the ID card includes a photographing guide on the front side of the ID card, a photographing guide on the back side of the photographing guide for the ID card, and a photographing guide on the back side of the ID card.

  In step S100, the input unit 321 of the terminal 120 receives an input of user attribute information such as a user's name, address, and date of birth via a touch panel or the like included in the terminal 120. The input unit 321 may further receive an input of a user's physical characteristics (dominant hand, hand size, presence or absence of hand or finger loss, etc.).

  In step S101, the display control unit 323 of the terminal 120 requests the server 110 to transmit imaging guide instruction information. If the input of the physical characteristics of the user is received in step S100, the display control unit 323 also transmits the input physical characteristics of the user to the server 110.

  In step S102, the selection unit 313 of the server 110 selects a shooting guide of the identification card (front surface, back surface, side surface) to be instructed to the terminal 120 from a plurality of variations according to a predetermined selection logic. The selection unit 313 may, for example, randomly select, from a plurality of variations, a shooting guide of an identification card to be instructed to the terminal 120 from among a plurality of variations, or select the current environment information (date, time, weather, etc.). , The location information of the terminal 120, etc.). For example, a shooting guide for instructing the terminal 120 for each date (or each time, each weather, each region) is predetermined, and the selection unit 313 selects the current date (or the current time, the weather, the terminal 120). The imaging guide corresponding to (the area where there is) may be selected as the imaging guide to instruct the terminal 120.

  Further, the selection unit 313 may select an imaging guide of an identification card to be instructed to the terminal 120 based on the physical characteristics of the user received from the terminal 120. For example, a user with a small hand size may select a shooting guide instructing the terminal 120 from among shooting guides that use the palm. Alternatively, a shooting guide to instruct the terminal 120 may be selected from shooting guides that use the user's dominant hand.

  In step S103, the photographing guide transmitting unit 314 of the server 110 transmits, to the terminal 120, photographing guide instruction information for instructing the photographing guide of the identification card selected in the processing procedure of step S102.

  In step S104, the display control unit 323 of the terminal 120 displays the shooting guide on the front side of the identification card designated by the server 110 on the shooting screen displaying the output image of the camera. The user adjusts the position of the camera so that the surface of the identification card overlaps the imaging guide displayed on the imaging screen, and holds the identification card as instructed by the imaging guide. The image capturing unit 324 captures an image of the front surface of the identification card at the timing when the shutter button is pressed (or touched).

  In step S105, the display control unit 323 of the terminal 120 displays the shooting guide on the back of the identification card designated by the server 110 on the shooting screen displaying the output image of the camera. The user adjusts the position of the camera so that the back of the ID card overlaps the shooting guide displayed on the shooting screen, and holds the ID card as instructed by the shooting guide. The imaging unit 324 captures an image of the back of the identification card at the timing when the shutter button is pressed (or touched).

  In step S <b> 106, the display control unit 323 of the terminal 120 displays the shooting guide on the side of the identification card designated by the server 110 on the shooting screen displaying the output image of the camera. The user adjusts the position of the camera so that the side of the identification card overlaps the imaging guide displayed on the imaging screen, and holds the identification card as instructed by the imaging guide. The imaging unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S107, the imaging unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched).

  In step S108, the display control unit 323 of the terminal 120 displays the image of the front, back, and side surfaces of the captured ID card and the image of the user's face on the screen, and transmits each image to the server 110. Prompt the user for confirmation. At this time, the display control unit 323 arranges the photographed image and the photographing guide, or displays the photographed image so that the user can confirm whether the photographed image is photographed along the photographing guide. A shooting guide may be displayed on top of the shooting guide. If the user has permitted the transmission, the process proceeds to step S109, and if the user desires to take the image again, the image desired by the user is taken again.

  Note that the execution order of the processes from S104 to S107 is not limited to the above example, and may be executed in any order. Further, the process of S108 may be executed each time the processes of S104 to S107 are performed.

  The processing procedure of step S109 and step S110 indicates the processing procedure when the personal confirmation processing and the liveness confirmation processing are performed on the server 110 side. In step S109, the communication unit 322 transmits, to the server 110, the user attribute information input in the processing procedure of step S100, the front, back, and side images of the identification card, and the image of the user's face.

  In step S110, the authentication unit 325 of the server 110 uses the received user attribute information, the front, back, and side images of the identification card, and the image of the user's face to confirm the identity of the user and the liveness. Perform confirmation processing.

  First, the authentication unit 325 determines the position of the ID card and the method of holding the ID card in the ID card photographing guide instructed to the terminal 120, and the position and the ID card of the ID card appearing in the image of the ID card. It is confirmed that the photographed image is photographed along the photographing guide by comparing the method with the method of holding the book.

  For example, the authentication unit 325 identifies the position of the ID card on the entire screen by analyzing an image of the front surface (same on the back and side surfaces) of the ID card, and identifies the specified position and the ID card in the shooting guide. When the deviation from the position on the surface of the identification card is equal to or smaller than a predetermined threshold, the position of the image on the surface of the identification card may be determined to be along the imaging guide. Further, the authentication unit 325 analyzes the image of the front surface of the identification card to specify the shape of the hand holding the identification card shown in the image, and identifies the specified hand shape and the identification card in the shooting guide. If the deviation from the shape of the hand holding the document is equal to or less than a predetermined threshold, the method of holding the identification card in the image shot by the user may be determined to be along the shooting guide. Good.

  Next, the authentication unit 325 compares the image of the face portion included in the image of the identification card with the image of the face of the user, and confirms that each image satisfies a predetermined matching criterion. Confirm that the person shown in the ID card and the user are the same person. For example, the authentication unit 325 extracts the feature amount of the face shown in each image, and when the difference between the feature amounts is equal to or less than a predetermined value, the person and the user appearing in the identification card are the same person. May be determined.

  Next, the authentication unit 325 compares the attribute information of the user included in the image of the ID card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is Confirm that it matches the description of.

  For example, the authentication unit 325 reads a character string in the image of the identification card, and when the read character string matches the attribute information of the user input by the user, the attribute information input by the user is It may be determined that they match the items described in the book. As an example, the authentication unit 325 may determine whether or not the user's name, date of birth, address, and the like described in the identification card match the attribute information of the user input by the user. it can.

  The authentication unit 325 determines that “the image of the identification card is taken along the shooting guide”, “the person and the user shown in the identification card are the same person”, and “the user inputs That the attribute information matches the items described in the ID card ", the user is the service applicant and the image was taken on the spot. Is determined).

  On the other hand, when the authentication unit 325 cannot confirm any of these items, the authentication unit 325 may instruct the terminal 120 (user) to perform shooting again. The terminal 120 transmits the image of the identification card or the image of the face photographed again to the server 110, and the authentication unit 325 of the server 110 re-performs the personal identification and the liveness confirmation again using the newly received image. It may be.

  Alternatively, the authentication unit 325 may entrust an administrator of the server 110 with respect to an item that could not be confirmed.

  Note that if the authentication unit 325 cannot confirm any of the items, if the time from when the terminal 120 is instructed to retake the image to when the image is received again from the terminal 120 is equal to or more than a predetermined threshold, Instead of performing analysis by image processing, it may be determined that personal identification and liveness confirmation have failed, and subsequent processing (for example, processing such as a service start procedure) may be stopped. It is preferable that the transmitted image is visually checked by a person after the identity verification and the liveness confirmation are completed in step S110. It is preferable that the visual confirmation is performed irrespective of failure or success of the personal confirmation and the liveness confirmation.

  The processing procedure of steps S111 and S112 indicates the processing procedure when the personal identification processing and the liveness confirmation processing are performed on the terminal 120 side instead of the server 110. When the identity confirmation processing and the liveness confirmation processing are performed on the server 110 side, the processing procedures of steps S111 and S112 are omitted. When the identification processing is performed on the terminal 120 side, the processing procedures of steps S109 and S110 are as follows. Omitted.

  In step S111, the identity confirmation processing and liveness confirmation processing performed by the authentication unit 325 of the terminal 120 are the same as the identity confirmation processing and liveness confirmation processing performed by the authentication unit 316 of the server 110 in the processing procedure of step S110. Is omitted.

  In step S112, the communication unit 322 of the terminal 120 transmits to the server 110 the attribute information of the user input in the processing procedure of step S102 and the results of the identity verification and the liveness confirmation (either success or failure). Note that the communication unit 322 may not transmit the attribute information of the user to the server 110 when the identity confirmation and the liveness confirmation fail.

  As described above, in the processing procedure described with reference to FIG. 5, the display data for displaying the photographing guide of the ID card on the screen of the terminal 120 is associated with the identifier for uniquely identifying the data of the photographing guide. May be stored in the storage unit 326 in the terminal 120 in advance. In this case, the photographing guide transmitting unit 314 of the server 110 may transmit the identifier of the photographing guide to the terminal 120 as the photographing guide instruction information. Alternatively, display data for displaying the photographing guide of the ID card on the screen of the terminal 120 is stored in the storage unit 317 of the server 110, and the photographing guide transmitting unit 314 of the server 110 transmits the photographing guide as photographing guide instruction information. The display data of the guide itself may be transmitted to the terminal 120. Since the identifier has a smaller data size than the display data, the former method can reduce the amount of communication data in the server 110 and the terminal 120 as compared with the latter method. On the other hand, the latter method can update the display data in real time as compared with the former method.

  FIG. 6 illustrates an example of a sequence illustrating a process of the communication system 1 according to the embodiment. With reference to FIG. 6, an example of a sequence in a case where the terminal 120 itself determines a shooting guide of an identification card to be displayed on the screen of the terminal 120 will be described.

  The processing procedure in step S200 is the same as the processing procedure in step S100 in FIG. 5, and a description thereof will be omitted.

  In step S201, the display control unit 323 selects, from a plurality of variations, a shooting guide for an identification card (front surface) to be displayed on the shooting screen. The selection method may be the same as the method performed by the selection unit 313 of the server 110 described in step S102 of FIG. Subsequently, the display control unit 323 displays a shooting guide of the surface of the selected ID card on a shooting screen displaying an output image of the camera. The image capturing unit 324 captures an image of the front surface of the identification card at the timing when the shutter button is pressed (or touched).

  In step S202, the display control unit 323 selects, from a plurality of variations, a shooting guide for the identification card (back side) to be displayed on the shooting screen. The selection method may be the same as the method performed by the selection unit 313 of the server 110 described in step S102 of FIG. Subsequently, the display control unit 323 displays a shooting guide on the back side of the selected ID card on a shooting screen for displaying an output image of the camera. The imaging unit 324 captures an image of the back of the identification card at the timing when the shutter button is pressed (or touched).

  In step S203, the display control unit 323 selects, from a plurality of variations, a shooting guide for the identification card (side surface) to be displayed on the shooting screen. The selection method may be the same as the method performed by the selection unit 313 of the server 110 described in step S102 of FIG. Subsequently, the display control unit 323 displays a shooting guide on the side of the selected ID card on a shooting screen displaying an output image of the camera. The imaging unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S204, the imaging unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched).

  The processing procedure in step S205 is the same as the processing procedure in step S108 in FIG.

  Note that the execution order of the processes from S201 to S205 is not limited to the above example, and may be performed in any order. Further, the process of S205 may be executed each time the processes of S201 to S204 are performed.

  In step S206, the communication unit 322 transmits the user attribute information, the front surface, the back and side images of the identification card, the image of the user's face, and the shooting guide information input in the processing procedure of step S200. Send it to server 110. The shooting guide information includes information for specifying the shooting guide of the identification card (front, back, side) selected by the terminal 120.

  In step S207, the authentication unit 325 of the server 110 uses the received user attribute information, the front, back, and side images of the identification card, the image of the user's face, and the shooting guide information to identify the user. Confirmation and liveness confirmation processing are performed. The authentication unit 316 of the server 110 refers to the shooting guide information to recognize which shooting guide the user has taken according to the shooting guide. The other processing procedures are the same as step S110 in FIG.

  When the identity confirmation and the liveness confirmation processing are performed on the server 110 side, the processing procedures of steps S206 and S207 are omitted. When the identity confirmation and the liveness confirmation processing are performed on the terminal 120 side, steps S208 and S209 are performed. The processing procedure is omitted.

  The processing procedures of step S208 and step S209 are the same as the processing procedures of step S111 and step S112 in FIG. 5, respectively, and thus description thereof will be omitted.

<Display Mode of Photographing Guide of First Embodiment>
7 and 8 show an example of a photographing guide for an identification card displayed on the photographing screen of the terminal 120. FIG. FIGS. 7A and 7B show an example of a photographing guide in a case where the identification card is held between fingers. That is, the imaging guide may indicate the position where the user's finger and the identification card come into contact.

  In the example of FIG. 7A, the display control unit 323 includes, in the display area A100, an output image of the camera and an object J1-1 indicating a position where the surface of the identification card is to be arranged in the frame of the captured image. And an object J2-1 indicating a position having an identification card. The user holds his / her ID card at the upper and lower positions where the object J2-1 is displayed with the thumb and the index finger (or the middle finger) facing the camera, and the outline of the ID card coincides with the object J1-1. Touch the shooting button B1 in the overlapping state. When the photographing button B1 is touched, an output image of the camera shown in the display area A100 is recorded as a photographed image. Note that the photographing guide may or may not be recorded in the photographed image.

  In the example of FIG. 7B, the display control unit 323 displays an object J1-2 indicating a position where the back surface of the ID card is to be arranged and an object J2-1 indicating a position where the ID card is held. are doing.

  FIGS. 7C to 7E show an example of a photographing guide in a case where an identification card is placed on a palm and held. In the examples of FIGS. 7C to 7E, the display control unit 323 indicates a position where the surface of the identification card is to be arranged on the object J2-2 that indicates the position of the palm of the right hand. The object J1-1 is displayed in an overlapping manner. That is, the imaging guide may indicate the orientation of the user's hand and the position of the ID card in the hand.

  7A to 7E can be applied to both the photographing guide on the front side of the ID card and the photographing guide on the back side of the ID card.

  FIG. 8 shows an example of a photographing guide showing a method of photographing the side of the identification card. In the example of FIG. 8A, the display control unit 323 includes an object J1-3 indicating a position where the side of the identification card is to be arranged in the frame of the captured image, and an identification card above and below the object J1-3. The object J2-1 indicating the position where the document is held is displayed. In the example of FIG. 8B, the display control unit 323 displays an object J2-1 indicating a position having an identification card at the center of the object J1-3.

  In FIGS. 7 and 8, the position where the surface of the identification card is to be placed and the position where the identification card is held are merely examples, and are not limited to the positions shown in FIGS. 7 and 8.

<First Example of First Embodiment>
The photographing unit 324 of the terminal 120 determines the position of the ID card in the image output from the camera, the method of holding the ID card, and the position and ID card indicated by the ID card photographing guide. If the degree of coincidence with the holding method satisfies a predetermined criterion (if it matches with the predetermined criterion), an image of the identification card may be automatically taken. More specifically, the imaging unit 324 determines whether the degree of coincidence between the positional relationship between the identification card in the image capturing area of the image, the part of the user's body holding the identification card, and the positional relationship in the imaging guide is a predetermined value. When the criterion is satisfied, the image capturing section 324 may capture an image. The degree of coincidence may be calculated by any method. For example, the identification card and the outline of the position of the hand and the outline of the face in the image are extracted, and the outline of the area surrounded by these outlines is extracted. Of these, the proportion that fits within the frame of the shooting guide may be the degree of coincidence.

  Further, when the image of the identification card is automatically taken, the matching degree between the image output from the camera and the shooting guide does not satisfy the predetermined criterion even after the lapse of a predetermined time. In this case, the process of automatically taking a picture may be stopped and the mode may be switched to a manual shutter. Alternatively, the predetermined reference may be lowered stepwise with the passage of time. As a result, it is possible to reduce the trouble of the user operation, and it is possible to reduce a situation in which the photographing itself cannot be performed when the photographing is not automatically performed well.

<Second Example of First Embodiment>
The shooting guide of the identification card may define the shooting difficulty for each variation. For example, in the example of FIG. 7, FIG. 7 (e) in which the wrist needs to be on the upper side, FIG. 7 (d) in which the wrist needs to be on the left side, and FIG. It may be defined so that the shooting difficulty level decreases.

  The authentication unit 316 of the server 110 prompts the user to take an image again when the identity verification and the liveness confirmation fail. When prompting the user to take an image again, the terminal 120 (user) may be instructed to a shooting guide having a shooting difficulty lower than the shooting guide already presented to the user. Thereby, it is possible to reduce the possibility that a difficult pose or the like is instructed and shooting becomes difficult.

  Note that, in order to prevent the photographing difficulty of all photographed images (the front surface, the back surface, and the side surface of the identification card) from decreasing, the authentication unit 316 determines that the total photographing difficulty of each photographed image is a predetermined difficulty. The temperature may be controlled to be higher than or equal to the degree. For example, when the photographing difficulty level of the front side of the identification card is reduced, the user may be prompted to re-photograph the back side of the ID card with an image having a high photographing difficulty level. Accordingly, it is possible to suppress a situation where the photographing is performed using only a simple pose or the like, and the reliability of the personality confirmation and the liveness confirmation is reduced.

<Third Example of First Embodiment>
The display control unit 323 may receive a change of a shooting guide displayed on the shooting screen of the terminal 120 in response to an instruction from the user. An upper limit may be set for the number of change requests that can be accepted from the user.

<Fourth Example of First Embodiment>
The authentication unit 316 or the authentication unit 325 extracts the date of issuance of the identification card appearing in the image of the identification card, and when the issuance date and the date on which the face image was taken are open for a predetermined period or more. Alternatively, the identity verification and liveness confirmation processing may be stopped, and the terminal 120 (user) may be prompted to take a picture with another identification card. In the case where the server 110 performs the personal identification and liveness confirmation processing, the terminal 120 may extract the date of issue of the ID card appearing in the image of the ID card and transmit the date to the server 110. Good. As a result, it is possible to improve the success rate of the identity confirmation and the liveness confirmation processing.

<Fifth Example of First Embodiment>
The image capturing unit 324 captures an image according to the processing procedure of steps S104 to S107 and transmits the captured image to the server 110 according to the processing procedure of step S109, but is not limited thereto. For example, the image capturing unit 324 transmits to the server 110 all moving image data (streaming data) in which the user operates the screen of the terminal 120 to match the ID card with the image capturing guide or captures his / her own face. You may do so. The server 110 may perform identity verification and liveness confirmation using moving image data instead of still images.

<Second embodiment>
In the second embodiment, when performing the user identification process using the image of the identification card (identification document) and the image of the user's face, the user is instructed on the spot how to capture the image of the user's face. In this embodiment, it is ensured that the image uploaded online is taken on the spot (liveness). The second embodiment can be executed alone, or can be combined with the first embodiment. When combined with the first embodiment, the identity verification and the liveness confirmation are performed by determining whether both the method of photographing the image of the identification card and the method of photographing the image of the user's face comply with the designated photographing method. A determination is made.

  In the second embodiment, the terminal 120 displays information of a photographing guide (hereinafter, referred to as “face photographing guide”) for instructing a method of photographing a face on a screen for photographing the face of the user himself. The face photographing method includes a position of the face within the frame of the photographed image, a tilt of the face, a pose at the time of photographing, and the like. The face shooting guide is changed each time the user shoots a face image.

  The server 110 confirms whether or not the face image submitted online is an image taken in accordance with a designated shooting guide by image processing, and thereby, the taken image is an image taken on the spot. Is determined. If the image is taken according to the instructed photographing guide, it is ensured that the image is an image taken on the spot.

  According to the second embodiment, the face shooting guide is changed each time the user shoots a face image. In other words, it becomes difficult for the user to perform an action of capturing an image to be submitted online beforehand and submit it later, or an action of processing and submitting an image captured in advance. That is, according to the second embodiment, an effect is obtained that it is possible to ensure that an image submitted online is taken on the spot (liveness). In addition, since the server 110 or the terminal 120 selects the photographing guide of the face to be instructed to the user, the randomness of the photographing guide to be instructed to the user can be ensured, and the identity and liveness can be confirmed. The effect that it becomes possible to raise the confirmation accuracy of is obtained.

<Functional Configuration of Second Embodiment>
The difference between the functional configuration of the server 110 and the first embodiment will be described again with reference to FIG. Functional units not particularly mentioned may be the same as in the first embodiment.

  The selection unit 313 has a function of selecting a shooting guide to be displayed on the screen of the terminal 120 from a plurality of variations.

  The photographing guide transmitting unit 314 has a function of transmitting photographing guide instruction information for instructing the terminal 120 on a photographing guide of a face to be displayed on the screen of the terminal 120 selected by the selecting unit 313 to the terminal 120. When the second embodiment is combined with the first embodiment, the imaging guide instruction information includes an identification card imaging guide in addition to the face imaging guide.

  The authentication unit 316 has a function of confirming the identity and liveness of the user using the image of the user's ID card, the image of the user's face, and the attribute information of the user received by the image receiving unit 315. Have.

More specifically, the authentication unit 316
1. As a result of comparing the face shooting method instructed by the face shooting guide with the face shooting method in the user's face image received by the image receiving unit 315,
2. A result of comparing the image of the face portion included in the image of the user ID received by the image receiving unit 315 with the received image of the face of the user, and
3. Based on the result of comparing the attribute information of the user included in the image of the identification card of the user received by the image receiving unit 315 with the attribute information of the received user, the identity of the user and the liveness confirmation are performed.

  Again, the functional configuration of the terminal 120 will be described with reference to FIG. 4 in terms of differences from the first embodiment. Functional units not particularly mentioned may be the same as in the first embodiment.

  The display control unit 323 has a function of superimposing and displaying a shooting guide of the face specified by the shooting guide instruction information from the server 110 on a shooting screen displaying an image output from a camera (imaging device) provided in the terminal 120. .

  Although described later in detail, in the second embodiment, the terminal 120 may select the face imaging guide to be displayed on the screen of the terminal 120 instead of the server 110 itself. In this case, the display control unit 323 may select a face imaging guide from a plurality of variations according to a predetermined selection logic.

  The image capturing unit 324 has a function of capturing an image of the user's ID card and an image of the user's face using a camera included in the terminal 120 in response to the operation of the user.

  In addition, when the degree of coincidence between the image of the user's face in the image output from the camera and the position and inclination of the face indicated by the face imaging guide satisfies a predetermined criterion, A face image may be automatically taken.

<Operation Processing of Second Embodiment>
Referring again to FIG. 5, the processing of the communication system 1 according to the second embodiment will be described. The following description focuses on differences from the first embodiment. Processing procedures not particularly described may be the same as those in the first embodiment.

  In step S102, the selection unit 313 of the server 110 selects a face imaging guide from a plurality of variations. The selecting unit 313 may randomly select a shooting guide to be instructed to the terminal 120 from a plurality of variations, or may select a shooting guide based on current environment information (date, time, weather, position information of the terminal 120, and the like). May be selected. For example, a shooting guide for instructing the terminal 120 for each date (or each time, each weather, each region) is predetermined, and the selection unit 313 selects the current date (or the current time, the weather, the terminal 120). The imaging guide corresponding to (the area where there is) may be selected as the imaging guide to instruct the terminal 120.

  In step S103, the imaging guide transmitting unit 314 of the server 110 transmits, to the terminal 120, imaging guide instruction information for instructing the imaging of the face selected in the processing procedure of step S102.

  In step S104, the imaging unit 324 captures an image of the front surface of the identification card at the timing when the shutter button is pressed (or touched).

  In step S105, the imaging unit 324 captures an image of the back of the identification card at the timing when the shutter button is pressed (or touched).

  In step S106, the imaging unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S107, the display control unit 323 of the terminal 120 displays the face shooting guide specified by the server 110 on the shooting screen displaying the output image of the camera. The user adjusts the position of the camera and the tilt of the face so that the user's face overlaps the shooting guide displayed on the shooting screen. The imaging unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched).

  In step S108, the display control unit 323 of the terminal 120 displays the image of the front, back, and side surfaces of the captured ID card and the image of the user's face on the screen, and transmits each image to the server 110. Prompt the user for confirmation. At this time, the display control unit 323 arranges the photographed image and the photographing guide, or displays the photographed image so that the user can confirm whether the photographed image is photographed along the photographing guide. A shooting guide may be displayed on top of the shooting guide. If the user has permitted the transmission, the process proceeds to step S109, and if the user desires to take the image again, the image desired by the user is taken again.

  In step S110, the authentication unit 325 of the server 110 uses the received user attribute information, the front, back, and side images of the identification card, and the image of the user's face to confirm the identity of the user and the liveness. Perform confirmation processing.

  First, the authentication unit 325 compares the method of capturing a face in the capturing guide of the face instructed to the terminal 120 with the image of the user's face, so that the captured image is captured along the capturing guide. Check. For example, the authentication unit 325 specifies the position and inclination of the face on the entire screen by analyzing the image of the face, and determines whether a deviation between the specified position and inclination and the position and inclination of the face in the shooting guide is a predetermined threshold. In the following cases, the image of the user's face may be determined to be taken along the shooting guide.

  Next, the authentication unit 325 compares the image of the face portion included in the image of the identification card with the image of the face of the user, and confirms that each image satisfies a predetermined matching criterion. Confirm that the person shown in the ID card and the user are the same person. For example, the authentication unit 325 extracts the feature amount of the face shown in each image, and when the difference between the feature amounts is equal to or less than a predetermined value, the person and the user appearing in the identification card are the same person. May be determined.

  Next, the authentication unit 325 compares the attribute information of the user included in the image of the ID card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is Confirm that it matches the description of.

  For example, the authentication unit 325 reads a character string in the image of the identification card, and when the read character string matches the attribute information of the user input by the user, the attribute information input by the user is It may be determined that they match the items described in the book.

  The authentication unit 325 determines that “the face image is photographed along the photographing guide”, “the person and the user shown in the ID card are the same person”, and “the attribute input by the user”. If all items in "Information matches information on identification card" can be confirmed, the user is the service applicant and the image was taken on the spot (there is a live property). ) Is determined.

  As described above, in the processing procedure described with reference to FIG. 5, the display data for displaying the photographing guide of the face on the screen of the terminal 120 is associated with the identifier for uniquely identifying the data of the photographing guide. It may be stored in the storage unit 326 in the terminal 120. In this case, the photographing guide transmitting unit 314 of the server 110 may transmit the identifier of the photographing guide to the terminal 120 as the photographing guide instruction information. Alternatively, display data for displaying the face photographing guide on the screen of the terminal 120 is stored in the storage unit 317 of the server 110, and the photographing guide transmitting unit 314 of the server 110 transmits the photographing guide instruction information as the photographing guide instruction information. The display data itself may be transmitted to the terminal 120. Since the identifier has a smaller data size than the display data, the former method can reduce the amount of communication data in the server 110 and the terminal 120 as compared with the latter method. On the other hand, the latter method can update the display data in real time as compared with the former method.

  FIG. 6 illustrates an example of a sequence illustrating a process of the communication system 1 according to the embodiment. With reference to FIG. 6, a description will be given of an example of a sequence in a case where the terminal 120 itself determines a shooting guide for a face to be displayed on the screen of the terminal 120.

  In step S201, the imaging unit 324 captures an image of the front surface of the identification card at the timing when the shutter button is pressed (or touched).

  In step S202, the imaging unit 324 captures an image of the back of the identification card at the timing when the shutter button is pressed (or touched).

  In step S203, the imaging unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S204, the display control unit 323 of the terminal 120 selects a face shooting guide to be displayed on the shooting screen from a plurality of variations. The selection method may be the same as the method performed by the selection unit 313 of the server 110 described in step S102 of FIG. Subsequently, the image capturing unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched).

  The processing procedure in step S205 is the same as the processing procedure in step S108 in FIG.

  In step S206, the communication unit 322 transmits the user attribute information, the front surface, the back and side images of the identification card, the image of the user's face, and the shooting guide information input in the processing procedure of step S200. Send it to server 110. The shooting guide information includes information for specifying the face shooting guide selected by the terminal 120.

  In step S207, the authentication unit 325 of the server 110 uses the received user attribute information, the front, back, and side images of the identification card, the image of the user's face, and the shooting guide information to identify the user. Confirmation and liveness confirmation processing are performed. The authentication unit 316 of the server 110 refers to the shooting guide information to recognize which shooting guide the user has taken according to the shooting guide. The other processing procedures are the same as step S110 in FIG.

<Display Mode of Photographing Guide of Second Embodiment>
FIG. 9 and FIG. 10 show an example of a face shooting guide displayed on the shooting screen of the terminal 120. In the display area A100, an output image of the camera and an object J3-1 instructing the position and inclination of the face in the frame of the captured image are displayed. The example of FIG. 9A shows that the image should be taken without tilting the face, and the example of FIG. 9B and FIG. 9C shows that the image should be shot with the face tilted. I have. FIG. 9D shows an example of an object J3-2 for instructing that a face be photographed while posing. The object J3-2 indicates that the palm should be photographed diagonally below the face in addition to the position where the face should be arranged and the inclination of the face.

  In the example of FIG. 10, the display control unit 323 provides an object for instructing the face photographing guide the position of the face and the inclination of the face in the frame of the photographed image, and the position of the side surface of the identification card in the frame of the photographed image. And an object for instructing a holding method. In the example of FIG. 10, the liveness is confirmed using at least the face image and the side image of the identification card. Since the side of the identification card has a small area, the burden on the user can be reduced by instructing that the side of the identification card be photographed together with the face, and the image transmitted from the terminal 120 to the server 110 can be reduced. Can reduce the amount of communication data. In the example of FIG. 10A, an object J3-1 that indicates the position and inclination of the face in the frame of the captured image and an object J1- that specifies the position of the side surface of the ID card in the frame of the captured image. 3 and an object J2-1 instructing a holding method are displayed. In the example of FIG. 10B, the object J3-1 in which the face is inclined is displayed.

<First Example of Second Embodiment>
The authentication unit 316 or the authentication unit 325 has a large angle difference between the vertical axis of the face and the vertical axis of the screen (photographing screen) of the terminal 120 when the tilt of the face is instructed in the facial photographing guide. In such a case, the criterion for determining whether or not the face shooting method instructed by the face shooting guide matches the face shooting method in the received user's face image is changed so as to be loose. It may be. For example, in the case where the face is not tilted, it is assumed that it is determined that the face image has been shot along the face shooting guide if the matching rate of the feature amount is 90% or more. In this case, the authentication unit 316 determines that the face image has been shot along the face shooting guide, for example, when the face inclination is 30 degrees and the feature value matching rate is 70% or more. As described above, the criterion may be set looser as the angle difference increases. This makes it possible to improve the success rate of the personal identification and the liveness confirmation processing when the face is tilted. <Second example of the second embodiment>
The face shooting guide may define the shooting difficulty for each variation.

  The authentication unit 316 of the server 110 prompts the user to take an image again when the identity verification and the liveness confirmation fail. When prompting the user to take an image again, the terminal 120 (user) may be instructed to a shooting guide having a shooting difficulty lower than the shooting guide already presented to the user. Thereby, it is possible to reduce the possibility that a difficult pose or the like is instructed and shooting becomes difficult.

  Note that, in order to prevent the shooting difficulty of the shot image of the face from being lowered, the authentication unit 316 controls the sum of the shooting difficulty of each shot image to be equal to or more than a predetermined difficulty. Is also good. For example, when the photographing difficulty level of the front surface of the identification card is reduced, a process of prompting the user to re-photograph a face image with an image having a high photographing difficulty level may be performed. Accordingly, it is possible to suppress a situation where the photographing is performed using only a simple pose or the like, and the reliability of the personality confirmation and the liveness confirmation is reduced.

<Third embodiment>
The third embodiment is an embodiment in which the position of the photographing guide and the inclination of the photographing guide are changed in the photographing screen with respect to the photographing guide indicating the photographing position on the side of the identification card. Other points that are not particularly mentioned may be the same as in the first embodiment.

  According to the third embodiment, the imaging guide on the side of the identification card is changed each time the user captures an image of the side of the identification card. That is, it is difficult for the user to take an image to be submitted online at the time of identity confirmation and liveness confirmation in advance and submit it at a later date, or to perform an act of processing and submitting an image taken in advance and submitting it. become. That is, according to the third embodiment, it is possible to ensure that the image of the side of the identification card submitted online at the time of identity verification and liveness confirmation is taken on the spot (liveness). The effect that it becomes possible is obtained. Further, since it is not necessary to prepare a plurality of variations of the shooting guide in advance as a shooting guide on the side of the identification card instructed to the user, the server 110 and the terminal 120 store data relating to the plurality of variations of the shooting guide. The effect that the memory area to be saved can be reduced is obtained.

<Functional Configuration of Third Embodiment>
The difference between the functional configuration of the server 110 and the first embodiment will be described again with reference to FIG. Functional units not particularly mentioned may be the same as in the first embodiment.

  The image receiving unit 315 further receives, from the terminal 120, an image of the side of the user's ID card and information indicating the position and inclination of a shooting guide that indicates the shooting position of the side of the ID card on the screen of the terminal 120. I do.

  The authentication unit 316 receives the image of the user's ID card, the image of the user's face, the attribute information of the user, and the position of the shooting guide that instructs the shooting position on the side of the ID card, received by the image receiving unit 315. It has a function of performing user identity confirmation and liveness confirmation processing using the information indicating the inclination and the information indicating the inclination.

  More specifically, the authentication unit 316 performs image capturing of the side surface of the identification card on the photographing screen of the terminal 120 with respect to the comparison processing of the image of the side surface of the identification card in the personal identification and the liveness confirmation processing in the first embodiment. Based on the comparison result between the position and inclination of the guide and the photographing position (position and inclination) of the image of the side of the identification card which is shown in the image of the side of the identification card of the user, the identity of the user and liveness can be confirmed. Make a confirmation.

  Again, the functional configuration of the terminal 120 will be described with reference to FIG. 4 in terms of differences from the first embodiment. Functional units not particularly mentioned may be the same as in the first embodiment.

  The display control unit 323 has a function of determining a position and a tilt when displaying the shooting guide on the side of the identification card according to a predetermined logic, and displaying the shooting guide on the shooting screen according to the determined position and tilt.

  In addition, the display control unit 323 rotates the shooting guide for instructing the shooting position of the side surface of the identification card along the surface of the shooting screen around an axis in the vertical direction with respect to the shooting screen. By stopping the rotation when performed, the position and inclination of the shooting guide on the shooting screen may be determined. In addition, the imaging guide for instructing the imaging position on the side of the identification card may or may not include the imaging guide for instructing the method of holding the side of the identification card.

<Display Mode of Photographing Guide of Third Embodiment>
FIG. 11 is a diagram illustrating an example of a shooting guide on the side of an identification card displayed on a shooting screen of the terminal 120 according to the third embodiment. In the photographing guide on the side of the identification card shown in FIG. 11, the rectangular photographing guide rotates about the axis X like a roulette (FIGS. 11A and 11B), and after a predetermined time elapses, Alternatively, it stops in response to a user operation (for example, touching the STOP icon in FIG. 11B) (FIG. 11C). The user takes a picture by matching the side of the identification card with the stopped photography guide. Note that, in FIG. 11, the position, the rotation speed, and the rotation direction of the rotation axis X are an example, and are not limited thereto. The method of moving the shooting guide on the side of the identification card is not limited to rotation. For example, the photographing guide may move forward, backward, left and right in the photographing screen. Alternatively, the rotation axis X may move forward, backward, left and right in the shooting screen while the shooting guide rotates. Further, the position in the photographing screen at which the photographing guide of the side surface is displayed is not limited to the position in FIG. 11, and may be determined at random, for example.

  After the photographing guide stops, the communication unit 322 of the terminal 120 transmits information indicating the position (and / or angle) at which the photographing guide has stopped to the server 110. For example, in the processing procedure of step S109 in FIG. 5, the communication unit 322 transmits, to the server 110, information indicating the position at which the guide indicating the shooting position on the side of the ID card has stopped together with the shot image. You may.

  FIG. 12 is a diagram illustrating an example of a shooting guide on the side of the identification card displayed on the shooting screen of the terminal 120 according to the third embodiment. As shown in FIG. 12A, the shooting guide on the side of the identification card may include a method for holding the identification card. The display control unit 323 may display the shooting guide indicating the method of holding the side of the ID card after the shooting guide stops, or when the shooting guide on the side of the ID card is rotating. May be displayed continuously.

  In addition, as shown in FIG. 12B, the photographing guide on the side of the ID card can also show the front or back of the ID card together with the side of the ID card within a range where the side of the ID card can be checked. Alternatively, the object J1-4 for instructing that the ID card be tilted and taken may be used. The display control unit 323 may randomly select an angle at which the identification card is inclined. Specifically, the display control unit 323 randomly selects an angle at which the rotation axis X is inclined with respect to the shooting screen within a predetermined angle range (for example, 10 to 45 degrees), and sets the rotation axis X to the predetermined angle. The tilted object J1-4 may be displayed. By making the front and back of the ID card appear together with the side of the ID card, fraudulent acts such as photographing the side with something other than the ID card, such as a credit card, can be suppressed.

  Further, the shooting guide on the side of the identification card may not be a rectangular shooting guide. For example, as shown in FIG. 12C, the object may be an object that instructs to shoot an image with the side of the identification card aligned with the position where the book is missing in the bookshelf. In FIG. 12C, the display control unit 323 may move the position where the book is missing at predetermined time intervals (for example, at one-second intervals) and stop at the position where the user touches the screen. Good. Further, the photographing guide on the side of the identification card may be an object for instructing to align the side of the identification card with the hands of a clock as shown in FIG. Also, as shown in FIG. 12 (e), the shooting guide on the side of the identification card has a part of the character missing, and is an object that indicates that the character is completed by fitting the side of the identification card. There may be.

<Operation Processing of Third Embodiment>
The processing of the communication system 1 according to the third embodiment will be described again with reference to FIGS. The following description focuses on differences from the first embodiment. Processing procedures not particularly described may be the same as those in the first embodiment.

  When photographing the side of the identification card in the processing procedure of step S106 of FIG. 5 or step S203 of FIG. 6, the photographing unit 324 of the terminal 120 identifies the identification card in the image output from the camera of the terminal 120. If the degree of coincidence between the shooting position on the side of the card and the shooting position on the side of the ID card indicated in the ID card shooting guide satisfies a predetermined standard, the image on the side of the ID card is automatically taken. It may be. The degree of coincidence may be calculated by any method. For example, the photographing unit 324 extracts the outline of the side surface of the identification card shown in the image, and selects an area surrounded by the extracted outline. The proportion that fits within the frame of the shooting guide may be used as the matching degree.

  In addition, when the side of the identification card is automatically photographed, the photographing unit 324 transmits information indicating that the photographing is automatically performed to the server 110 in the processing procedure of step S109 in FIG. 5 or step S206 in FIG. It may be. The information may be information explicitly indicating that the image was automatically taken, or by not transmitting the image of the side of the identification card from the terminal 120 to the server 110 to imply that the image was taken automatically. It may be shown.

  When the server 110 receives from the terminal 120 the information indicating that the side of the identification card has been automatically photographed, the server 110 performs the processing procedure of step S110 in FIG. 5 or step S207 in FIG. The confirmation and liveness confirmation processing may not be performed. Specifically, the authentication unit 316 compares the information indicating the photographing position of the side of the identification card with the photographing position of the image of the side of the identification card shown in the image of the side of the user's ID. The user identity confirmation and liveness confirmation may be performed without performing the confirmation. Similarly, when the terminal 120 performs the identity verification and the liveness confirmation by itself in the step S111 in FIG. 5 or the step S208 in FIG. 6, the side of the identification card is also excluded from the identification and the liveness confirmation processing. You may do so.

<Fourth embodiment>
In the fourth embodiment, when the user identity confirmation and the liveness confirmation process are performed using the image of the ID card and the image of the user's face, the photographing guide is used as in the first to third embodiments. Instead of confirming the liveness depending on whether or not the image was taken along, the position information at the time of photographing added to the image of the ID card and the image of the face is compared with the current position of the terminal 120, and the photographing is performed. This is an embodiment in which the liveness is confirmed by confirming that the position information at the time and the current position of the terminal 120 are included in a predetermined range. The image of the identification card and the image of the face of the user may be collectively referred to as an “identification image” (the same applies to other embodiments). Other points that are not particularly mentioned may be the same as the first to third embodiments. In addition, you may make it combine 4th Embodiment with 1st Embodiment, 2nd Embodiment, and / or 3rd Embodiment. That is, in addition to the comparison of the position information, the liveness may be confirmed by confirming that the photographed image conforms to the photographing guide.

  According to the fourth embodiment, the liveness is checked by checking whether the position information at the time of shooting and the position information of the terminal 120 are within a predetermined range. This allows the user to take an image to be submitted online at the time of identity verification and liveness confirmation beforehand and submit it later, or perform an operation of processing and submitting an image taken in advance and submitting it. It becomes difficult. That is, according to the fourth embodiment, it is possible to ensure that the image of the side of the identification card submitted online at the time of identity verification and liveness confirmation is taken on the spot (liveness). The effect that it becomes possible is obtained. Further, compared to the first and third embodiments, there is no need to store a photographing guide of an identification card, so that the memory area of the server 110 and the terminal 120 can be reduced. can get.

<Functional Configuration of Fourth Embodiment>
The functional configuration of the server 110 will be described again with reference to FIG. When the fourth embodiment is not combined with the first embodiment, the second embodiment, and / or the third embodiment, the selection unit 313 and the imaging guide transmission unit 314 in FIG. 3 are unnecessary.

  The image receiving unit 315 inputs the position information of the terminal 120, the image of the user's ID card to which the position information at the time of shooting has been added, the image of the user's face to which the position information at the time of shooting has been added, and input by the user. And a function of receiving the attribute information of the user from the terminal 120.

  When the location information of the terminal 120 and the location information given to the image of the user's ID card are within a predetermined range, the authentication unit 316 determines that the user's ID card is at least one of the identification of the user. It has a function to approve as a department. The authentication unit 316 also compares the position information of the terminal 120, the position information given to the image of the user's ID card with the position information given to the image of the user's face, The comparison result between the image of the face portion included in the image of the certificate and the image of the face of the received user, and the attribute information of the user included in the image of the received ID card and the attribute of the received user It has a function of confirming the identity of the user and confirming the liveness based on the result of comparison with the information.

  The differences between the functional configuration of the terminal 120 and the first embodiment will be described with reference to FIG. The terminal 120 according to the fourth embodiment further includes a position information measuring unit 327 in addition to the configuration described in the first embodiment. The display control unit 323, the imaging unit 324, the authentication unit 325, and the position information measurement unit 327 are realized by the processor 201 reading and executing a program stored in the storage unit 326.

  Hereinafter, the functional configuration of the terminal 120 according to the present embodiment will be described in detail. Note that the input unit 321 is the same as in the first embodiment, and a description thereof will be omitted.

  The communication unit 322 has a function of performing a process of receiving various data from the server 110 via the communication I / F 205 and a process of transmitting various data to the server 110 using the communication I / F 205. The communication unit 322 further includes an image of the user's ID card to which the position information at the time of shooting is added by the imaging unit 324, an image of the user's face to which the position information at the time of shooting is added, The function of transmitting the user attribute information received by the unit 321 to the server 110 is provided.

  The display control unit 323 has a function of displaying an image output from a camera (imaging device) included in the terminal 120 on an imaging screen.

  The image capturing unit 324 has a function of capturing an image of the user's ID card and an image of the user's face using a camera included in the terminal 120 in response to the operation of the user. Further, the photographing unit 324 has a function of adding position information indicating a position at the time of photographing to the photographed image of the ID card of the user and the image of the face of the user.

  The authentication unit 325 uses the image of the user's ID card and the image of the user's face photographed by the photographing unit 324, the attribute information of the user input to the input unit 321 and the position information of the terminal 120, It has a function of performing user identity confirmation processing and liveness confirmation processing. Note that, as in the first to third embodiments, when the terminal 120 does not perform the identity confirmation processing and the liveness confirmation processing by itself, the terminal 120 may not include the authentication unit 325.

  The position information measuring unit 327 has a function of measuring position information of the current position of the terminal 120. The position information measurement unit 327 measures the latitude and longitude of the terminal 120 as the position information of the current position of the terminal 120 using, for example, but not limited to, a GPS (Global Positioning System). The measurement of the position information of terminal 120 by position information measuring section 327 is not limited to GPS, and any method may be used. By way of example and not limitation, the position information measurement unit 327 may measure the position information of the terminal 120 using a wireless LAN such as Wi-Fi. In addition, the position information measuring unit 327 may use a communication method such as IMES (Indoor Messaging System), RFID (Radio Frequency Identifier), or BLE (Bluetooth Low Energy) as an example, but not limited to, and may use the position information of the terminal 120. May be measured. The position information measurement unit 327 may measure the position information of the terminal 120 using a mobile communication system such as LTE or CDMA without limitation.

<Operation Processing of Fourth Embodiment>
The processing of the communication system 1 according to the fourth embodiment will be described with reference to FIG. FIG. 14 illustrates an example of a processing sequence of the communication system 1 according to the fourth embodiment.

  In step S300, position information measuring section 327 of terminal 120 starts measuring the current position of terminal 120.

  The processing procedure in step S301 is the same as the processing procedure in step S100 in FIG. 5, and a description thereof will be omitted.

  In step S302, the image capturing unit 324 captures an image of the front surface of the identification card at the timing when the shutter button is pressed (or touched), and the captured image includes position information indicating the position of the terminal 120 at the time of capturing. Is added.

  In step S303, the image capturing unit 324 captures an image of the back of the identification card at the timing when the shutter button is pressed (or touched), and includes, in the captured image, position information indicating the position of the terminal 120 at the time of capturing. Is added.

  In step S304, the image capturing unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched), and includes, in the captured image, position information indicating the position of the terminal 120 at the time of capturing. Is added.

  In step S305, the photographing unit 324 photographs the image of the user's face at the timing when the shutter button is pressed (or touched), and adds position information indicating the photographed position of the terminal 120 to the photographed image. I do.

  In step S306, the display control unit 323 of the terminal 120 displays the image of the front, back, and side surfaces of the captured ID card and the image of the user's face, and may transmit each image to the server 110. Prompts the user to confirm. If the user has permitted the transmission, the process proceeds to step S307. If the user desires to take the image again, the image desired by the user is taken again.

  In step S307, position information measuring section 327 of terminal 120 ends the measurement of the current position of terminal 120.

  In step S308, the communication unit 322 stores the user attribute information, the front, back, and side images of the identification card, the image of the user's face, and the current position of the terminal 120 input in the processing procedure of step S301. The position information shown is transmitted to the server 110.

  In step S310, authentication unit 325 of server 110 receives the received user attribute information, the front, back, and side images of the identification card, the image of the user's face, and the position information indicating the current position of terminal 120. To perform user identity confirmation processing and liveness confirmation processing.

  At this time, the authentication unit 325 determines the position information indicating the current position of the terminal 120, the position information given to each of the front, back, and side images of the user's ID card, and the position information given to the user's face image. It is confirmed that the position information is included in a predetermined range.

  Next, the authentication unit 325 compares the image of the face portion included in the image of the identification card with the image of the face of the user, and confirms that the comparison result satisfies a predetermined matching criterion. Confirm that the person shown in the certificate and the user are the same person. The specific processing procedure is the same as that of the first embodiment, and a description thereof will be omitted.

  Next, the authentication unit 325 compares the attribute information of the user included in the image of the ID card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is Confirm that it matches the description of. The specific processing procedure is the same as that of the first embodiment, and a description thereof will be omitted.

  The authentication unit 325 includes “position information indicating the current position of the terminal 120, position information assigned to each of the front, back, and side images of the user's ID card, and position assigned to the image of the user's face. "The information is included within a predetermined range", "the image of the face portion included in the image of the user's ID card and the image of the user's face satisfy a predetermined matching criterion", If the user attribute information included in the image of the user's ID card matches the attribute information of the received user ", all of the items can be confirmed. ), And that the image was taken on the spot (has liveness).

  On the other hand, the processing procedure performed by the authentication unit 325 when any of the items cannot be confirmed is the same as that of the first, second, or third embodiment, and a description thereof will be omitted.

  The processing procedures of step S310 and step S311 show the processing procedures when the personal identification processing and the liveness confirmation processing are performed on the terminal 120 side instead of the server 110. When the personal identification processing and the liveness confirmation processing are performed on the server 110 side, the processing procedures of steps S310 and S311 are omitted, and when the personal identification processing is performed on the terminal 120 side, the processing procedures of steps S308 and S309 are Omitted.

  In step S310, the identity confirmation processing and liveness confirmation processing performed by the authentication unit 325 of the terminal 120 are the same as the identity confirmation processing and liveness confirmation processing performed by the authentication unit 316 of the server 110 in the processing procedure of step S309. Is omitted.

  The processing procedure in step S311 is the same as the processing procedure in step S112 in FIG. 5, and a description thereof will be omitted.

<First Example of Fourth Embodiment>
Note that, in the fourth embodiment, in addition to comparing the position information given to the image with the position information of the terminal 120, the live time is compared with the shooting time given to the image and the current time. The sex may be confirmed.

  For example, the photographing unit 324 of the terminal 120 adds the photographing time in addition to the positional information to the photographed front, back, and side images of the user's ID card and the image of the user's face. To the server 110, the front, back and side images of the user's identification card to which the location information and the time of shooting were added, and the image of the user's face to which the location information and the time of shooting were added. . The image receiving unit 315 of the server 110 receives the image of the user's ID card to which the position information and the time of shooting are added, and the image of the user's face to which the position information and the time of shooting are added. become.

  Further, in addition to comparing the location information, the authentication unit 316 of the server 110 may determine the current time (or the time when the image of the identification card is received from the terminal 120, and may be the same in other embodiments) and the user's identification. Based on the result of comparison between the time given to the image of the book and the time given to the image of the user's face, the user's identity and liveness are confirmed. Specifically, the authentication unit 316 determines the current time, the time given to each of the front, back, and side images of the user's ID card and the time given to the image of the user's face by a predetermined value. If it is within the range, it may be determined that the liveness has been confirmed. The term “within the predetermined range” may be, for example, within 3 minutes, 5 minutes, or the like, without limitation.

  The first embodiment described above can also be applied when the authentication unit 325 of the terminal 120 performs identity verification and liveness confirmation.

<Fifth embodiment>
In the fifth embodiment, when the user identification and the liveness confirmation processing are performed using the image of the identification card and the image of the user's face, the fifth embodiment follows the shooting guide as in the first to third embodiments. Instead of checking the liveness depending on whether or not the image was taken, the time information at the time of shooting added to the image of the identification card and the image of the face is compared with the current time, and the time at the time of shooting is compared with the time at the time of shooting. This is an embodiment in which liveness is confirmed by confirming that the current time report is included in a predetermined range. Other points that are not particularly described may be the same as the first embodiment or the third embodiment. Note that the fifth embodiment may be combined with the first embodiment and / or the third embodiment. That is, in addition to the comparison of the position information, the liveness may be confirmed by confirming that the photographed image conforms to the photographing guide. Further, the fifth embodiment and the fourth embodiment can be combined.

  According to the fifth embodiment, the liveness is confirmed by confirming whether the time information at the time of shooting and the current time are within a predetermined range. This allows the user to take an image to be submitted online at the time of identity verification and liveness confirmation beforehand and submit it later, or perform an operation of processing and submitting an image taken in advance and submitting it. It becomes difficult. That is, according to the fifth embodiment, it is possible to ensure that the image of the side of the identification card submitted online at the time of identity verification and liveness confirmation is taken on the spot (liveness). The effect that it becomes possible is obtained. Further, compared to the first and third embodiments, there is no need to store a photographing guide of an identification card, so that the memory area of the server 110 and the terminal 120 can be reduced. can get.

<Functional Configuration of Fifth Embodiment>
The functional configuration of the server 110 will be described with reference to FIG. When the fifth embodiment is not combined with the first embodiment and / or the third embodiment, the selecting unit 313 and the photographing guide transmitting unit 314 in FIG. 3 are unnecessary.

  The image receiving unit 315 includes an image of the user's ID card to which the time information at the time of shooting is added, an image of the face of the user to which the time information at the time of shooting is added, and the attribute information of the user input by the user. From the terminal 120.

  When the current time and the time information given to the image of the user's ID card are within a predetermined range, the authentication unit 316 uses the image of the ID card as at least a part of the authentication of the user. Has a function to approve. The authentication unit 316 also compares the current time, the time information given to the image of the user's ID card with the time information given to the image of the user's face, The comparison result between the image of the face portion included in the image and the received image of the face of the user, and the attribute information of the user included in the image of the received ID card and the attribute information of the received user It has a function of confirming the identity of the user and confirming the liveness based on the comparison result.

  The functional configuration of the terminal 120 will be described with reference to FIG. In the fifth embodiment, the position information measuring section 327 is unnecessary. Other points that are not particularly mentioned may be the same as those of the fourth embodiment.

  The communication unit 322 includes an image of the user's ID card to which the time information at the time of shooting is added by the imaging unit 324, an image of the face of the user to which the time information at the time of shooting is added, and an input unit 321. And a function of transmitting to the server 110 the attribute information of the user accepted in step (1).

  The image capturing unit 324 has a function of capturing an image of the user's ID card and an image of the user's face using a camera included in the terminal 120 in response to the operation of the user. Further, the photographing unit 324 has a function of adding time information at the time of photographing to the photographed image of the user's ID card and the photographed image of the user's face.

<Operation Processing of Fifth Embodiment>
The processing of the communication system 1 according to the fifth embodiment will be described with reference to FIG. FIG. 15 illustrates an example of a processing sequence of the communication system 1 according to the fifth embodiment.

  The processing procedure in step S400 is the same as the processing procedure in step S100 in FIG. 5, and a description thereof will be omitted.

  In step S401, the image capturing unit 324 captures an image of the front surface of the identification card at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of capturing to the captured image. I do.

  In step S402, the photographing unit 324 photographs an image on the back of the identification card at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of photographing to the photographed image. I do.

  In step S403, the image capturing unit 324 captures an image of the side of the ID card at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of capturing to the captured image. I do.

  In step S404, the image capturing unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of capturing to the captured image.

  The processing procedure in step S405 is the same as the processing procedure in step S306 in FIG.

  In step S406, the communication unit 322 transmits to the server 110 the user attribute information input in the processing procedure in step S400, the front, back, and side images of the identification card, and the image of the user's face.

  In step S407, the authentication unit 325 of the server 110 checks the identity of the user using the received attribute information of the user, the front, back, and side images of the identification card, the image of the user's face, and the current time. Perform processing and liveness confirmation processing.

  First, the authentication unit 325 determines that the time information given to each of the front, back, and side images of the user's ID card and the time information given to the user's face image are within a predetermined range from the current time. Make sure it is included in

  Next, the authentication unit 325 compares the image of the face portion included in the image of the identification card with the image of the face of the user, and confirms that the comparison result satisfies a predetermined matching criterion. Confirm that the person shown in the certificate and the user are the same person.

  Next, the authentication unit 325 compares the attribute information of the user included in the image of the ID card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is Confirm that it matches the description of.

  The authentication unit 325 determines that the time information given to each of the front, back, and side images of the user's ID card and the time information given to the user's face image are within a predetermined range from the current time. "And that the image of the face portion included in the image of the user's ID and the image of the user's face satisfy a predetermined matching criterion" and "the image of the user's ID That the attribute information of the user included in the URL matches the attribute information of the received user ", the user is the service applicant (the identity has been confirmed) and the image Is determined to have been taken on the spot (having liveness).

  On the other hand, the processing procedure performed by the authentication unit 325 when any of the items cannot be confirmed is the same as that in the first embodiment or the third embodiment, and thus the description is omitted.

  When the personal identification processing and the liveness confirmation processing are performed on the server 110 side, the processing procedures of steps S408 and S409 are omitted. When the personal identification processing is performed on the terminal 120 side, the processing procedures of steps S406 and S407 are as follows. Omitted.

  In step S408, the identity confirmation processing and liveness confirmation processing performed by the authentication unit 325 of the terminal 120 are the same as the identity confirmation processing and liveness confirmation processing performed by the authentication unit 316 of the server 110 in the processing procedure of step S407. Is omitted.

  The processing procedure in step S409 is the same as the processing procedure in step S112 in FIG. 5, and a description thereof will be omitted.

<First Example of Fifth Embodiment>
In the fifth embodiment, in addition to comparing the time information given to the image with the current time, the position information given to the image is compared with the position information indicating the current position of the terminal 120. Then, the liveness may be confirmed.

  For example, the photographing unit 324 of the terminal 120 adds position information at the time of photographing to the image of the front, back, and side surfaces of the photographed user's ID card and the image of the user's face, in addition to the time information. Is the position information indicating the current position of the terminal 120, the front, back, and side images of the user's identification card to which the position information and the time of shooting are added, and the position information and the time of shooting are added. The image of the user's face is transmitted to the server 110. The image receiving unit 315 of the server 110 receives the image of the user's ID card to which the position information and the time of shooting were added, and the image of the user's face to which the position information and the time of shooting were added. become.

  In addition, in addition to comparing the time information, the authentication unit 316 of the server 110 determines the position information of the terminal 120, the position information given to the image of the user's ID card, and the position given to the image of the user's face. Based on the result of the comparison with the information, the user's identity and liveness are confirmed. Specifically, the authentication unit 316 determines the position information of the terminal 120, the position information given to each of the front, back, and side images of the user's ID card, and the position given to the image of the user's face. When the information is within a predetermined range, it may be determined that the liveness has been confirmed. The term “within the predetermined range” may be, for example, without limitation, within 5 m or 10 m.

  The first embodiment described above can also be applied when the authentication unit 325 of the terminal 120 performs identity verification and liveness confirmation.

  Reference Signs List 1 communication system, 110 server, 120 terminal, 130 network, 200 information processing device, 201 processor, 202 memory, 203 storage, 204 input / output I / F, 205 communication I / F, 311 input / output unit, 312 communication unit, 313 Selection unit, 314 imaging guide transmission unit, 315 image reception unit, 316 authentication unit, 317 storage unit, 321 input unit, 322 communication unit, 323 display control unit, 324 imaging unit, 325 authentication unit, 326 storage unit, 327 positional information Measuring unit

Claims (9)

In an information processing device having a display unit,
Displaying a moving image of a shooting region output by a shooting device on the display unit;
A step of displaying a photographing guide for instructing a method of photographing a face including a position of the user's face in the photographing area, which is selected based on a predetermined selection, in the photographing area displayed on the display unit;
Causing the photographing device to photograph a moving image of the photographing region. The face photographing method further includes the inclination of the face,
The program according to claim 1. The face photographing guide further includes the position of the side of the personal identification document,
The program according to claim 1. An information processing method executed by a second information processing device communicating with the first information processing device,
Transmitting, to the first information processing apparatus, information of a photographing guide that instructs a method of photographing a face including a position of the face in a photographing area, which is selected based on a predetermined selection;
Receiving a moving image of a user's face captured by the first information processing device from the first information processing device;
Performing a liveness check on a moving image of the user's face based on a comparison result between a method of capturing a face indicated by the shooting guide and a method of capturing a face of the received moving image of the user's face; And an information processing method. The face shooting method further includes a face inclination,
The step of performing the liveness check is as follows: As for the inclination of the face specified by the face shooting guide, the larger the angle difference between the vertical axis of the face and the vertical axis of the shooting screen is, the larger the face shooting guide is. In order to determine whether or not the face shooting method indicated in the, and the face shooting method in the received moving image of the face of the user is the same, change the determination criteria to loosen,
The information processing method according to claim 4. An information processing method executed by an information processing apparatus having a display unit,
Displaying a moving image of a shooting region output by a shooting device on the display unit;
Displaying a shooting guide instructing a shooting method of a face including a position of a face in the shooting area of the user, which is selected based on a predetermined selection, in the shooting area displayed on the display unit;
Causing the photographing device to photograph a moving image of the photographing region. A display unit for displaying a moving image of a photographing area output by a photographing device, the photographing of a face including a position of the user's face in the photographing area selected based on a predetermined selection logic. A display section for displaying a shooting guide for instructing a method,
Causing the photographing device to photograph a moving image of the photographing area. An information processing device that operates as a second information processing device that communicates with the first information processing device,
A transmission unit configured to transmit, to the first information processing apparatus, information of a shooting guide for instructing a face shooting method including a face position in a shooting area based on a predetermined selection logic;
A receiving unit that receives, from the first information processing device, a moving image of a user's face captured by the first information processing device;
An authentication unit for confirming liveness of a moving image of the user's face based on a comparison result between a method of capturing a face specified by the shooting guide and a method of capturing a face of the received moving image of the user's face And an information processing apparatus having: A second information processing device communicating with the first information processing device;
Transmitting, to the first information processing apparatus, information of a photographing guide instructing a method of photographing a face including a position of the face in a photographing area, which is selected based on a predetermined selection logic;
Receiving a moving image of a user's face captured by the first information processing device from the first information processing device;
Performing a liveness check on a moving image of the user's face based on a comparison result between a method of capturing a face indicated by the shooting guide and a method of capturing a face of the received moving image of the user's face; , Make the program run.