JP6481073B1 - Program, information processing method, information processing apparatus - Google Patents

Abstract

The present invention provides a technique capable of ensuring that an image submitted online at the time of identification is taken on the spot.
An information processing apparatus having a display unit displays a moving image of a shooting area output from the shooting apparatus on the display unit, and indicates a position and inclination in the shooting area determined based on predetermined logic. According to the information, a program is provided for executing a step of displaying a shooting guide indicating a shooting method of the side of the identification document on a moving image of the shooting region and a step of causing the shooting device to take a moving image of the shooting region. .
[Selection] Figure 11

Description

  The present disclosure relates to a program, an information processing method, and an information processing apparatus.

  In recent years, a financial service called Fintech using ICT has been developed. Examples of Fintech services include, for example, a service for managing household and corporate assets by automatically creating a household account book and book, a service for asset management, a service for virtual currency transactions, a QR code (registration) Trademarks) and other services that provide settlement means.

  Businesses that provide these services are obliged to verify the identity of those who wish to use the services in order to prevent unauthorized conduct. For example, Patent Document 1 discloses a technique for facilitating identification of an applicant by displaying a plurality of identification cards in association with each other on a screen.

Japanese Patent Laid-Open No. 2006-157439

  At present, some services that handle the exchange of funds, such as payments, not only check the image of the ID document submitted online by the user, but also use means such as mailing the application documents to the user's home. In this way, the identity verification is strictly performed. However, considering future service development, it is desirable to be able to complete identity verification online without relying on mail or other means.

  When the identity verification is performed online, there is a possibility that invalid image data that has been processed or the like is submitted. In order to prevent such injustices, it is necessary to have a mechanism to ensure that the image data submitted online is not an image that has been reused but was taken on the spot (liveness). It is considered to be.

  However, Patent Document 1 discloses a technique for facilitating the identity verification of the applicant, but describes a technique for ensuring that an image used for identity verification is taken on the spot. Not.

  An object of the present disclosure is to provide a technique capable of ensuring that an image submitted online at the time of identity verification is taken on the spot.

  The program according to an embodiment of the present disclosure includes a step of displaying, on an information processing apparatus having a display unit, a moving image of a shooting region output from the shooting device on the display unit, and the shooting determined based on predetermined logic In accordance with the information indicating the position and inclination in the area, the position and inclination for displaying the shooting guide indicating the shooting method of the side of the identification document are determined, and the shooting guide is converted into a moving image of the shooting area according to the determined position and inclination. A step of displaying, and a step of causing the photographing apparatus to photograph a moving image of the photographing region.

FIG. 1 illustrates a configuration of a communication system according to an aspect of an embodiment. FIG. 2 illustrates an example of a hardware configuration of the information processing apparatus according to the present disclosure. FIG. 3 is a block diagram illustrating an example of a functional configuration of the information processing apparatus according to the first embodiment. FIG. 4 shows an example of a block diagram showing a functional configuration of the information processing apparatus according to the first embodiment. FIG. 5 shows an example of a sequence indicating processing performed by the communication system 1 according to the first embodiment. FIG. 6 shows an example of a sequence indicating processing performed by the communication system 1 according to the first embodiment. FIG. 7 shows an example of a photographing guide for identification cards displayed on the photographing screen of the information processing apparatus according to the first embodiment. FIG. 8 shows an example of a photographing guide for identification cards displayed on the photographing screen of the information processing apparatus according to the first embodiment. FIG. 9 shows an example of a face photographing guide displayed on the photographing screen of the information processing apparatus according to the second embodiment. FIG. 10 shows an example of a face shooting guide displayed on the shooting screen of the information processing apparatus according to the second embodiment. FIG. 11 shows an example of a shooting guide on the side of the identification card displayed on the shooting screen of the information processing apparatus according to the third embodiment. FIG. 12 shows an example of a shooting guide on the side of the identification card displayed on the shooting screen of the information processing apparatus according to the third embodiment. FIG. 13 shows an example of a block diagram showing a functional configuration of the information processing apparatus according to the third embodiment. FIG. 14 shows an exemplary processing sequence of the communication system according to the fourth embodiment. FIG. 15 shows an exemplary processing sequence of the communication system according to the fifth embodiment.

<Legal Compliance>
When implemented, the disclosure set forth herein is implemented in compliance with the laws and regulations of each country in which the disclosure is implemented. In addition, the disclosure described in the present specification is carried out with all changes, substitutions, changes, alterations and modifications necessary for a person skilled in the art to comply with the laws and regulations of each country.

  The form for implementing the communication system 1 which concerns on this indication is demonstrated with reference to drawings.

<System configuration>
FIG. 1 shows a configuration of a communication system 1 according to an embodiment of the present disclosure. As disclosed in FIG. 1, in the communication system 1, a server 110 </ b> A and a server 110 </ b> B are connected to a terminal 120 </ b> A, a terminal 120 </ b> B, and a terminal 120 </ b> C via a network 130.

  In the present disclosure, when there is no need to distinguish between the server 110A and the server 110B, the server 110A and the server 110B may be expressed as the server 110, respectively.

  In the present disclosure, when it is not necessary to distinguish the terminal 120A, the terminal 120B, and the terminal 120C, the terminal 120A, the terminal 120B, and the terminal 120C may be expressed as the terminal 120, respectively.

  In the present disclosure, when there is no need to distinguish between the server 110 and the terminal 120, the server 110 and the terminal 120 may be expressed as the information processing apparatus 200, respectively. Note that the number of information processing apparatuses 200 connected to the network 130 is not limited.

  The server 110 provides a predetermined service to the terminal 120 used by the user via the network 130. Examples of the predetermined service include, but are not limited to, a settlement service, an electronic commerce service, an SNS (Social Networking Service) represented by an instant messenger, a content providing service such as a music / video / book, a financial service, and the like. When the user uses a predetermined service via the terminal 120, the server 110 can provide the predetermined service to one or more terminals 120.

  As necessary, a terminal used by the user X is expressed as a terminal 120X, and user information in a predetermined service associated with the user X or the terminal 120X is expressed as user information X. Note that the user information is user information associated with an account used by the user in a predetermined service. By way of example and not limitation, the user information is input by the user or given by a predetermined service. The user name, the user icon image, the user age, the user gender, the user address, the user hobby It includes information associated with the user, such as preferences, user identifiers, etc., and any one or a combination of these may be used.

  The network 130 plays a role of connecting two or more information processing apparatuses 200. The network 130 refers to a communication network that provides a connection path so that data can be transmitted and received after the terminal 120 is connected to the server 110.

  One or more portions of the network 130 may be a wired network or a wireless network. Examples of the network 130 include, but are not limited to, an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), and wireless. LAN (Wireless LAN: WLAN), wide area network (WAN), wireless WAN (Wireless WAN: WWAN), metropolitan area network (Metropolitan Area Network: MAN), part of the Internet, public switched telephone network (Public Part of Switched Telephone Network (PSTN), mobile phone network, ISDNs (Integrated Service Digital Networks), wireless LANs, LTE (Long Term Evolution), CDMA (Code Division Multiple Access), Bluetooth (Bluetooth (registered trademark)), satellite Communication, or It may include two or more combinations of these. The network 130 can include one or more networks 130.

  The information processing apparatus 200 may be any information processing apparatus as long as it can implement the functions and / or methods described in the present disclosure.

  The information processing apparatus 200 includes, for example and not limitation, a smartphone, a mobile phone (feature phone), a computer (for example, but not limited to a desktop, a laptop, a tablet, etc.), a server device, and a media computer platform (for example, not for limitation). , Cables, satellite set-top boxes, digital video recorders, etc.), handheld computer devices (such as, but not limited to, PDA (Personal Digital Assistant), email clients), wearable terminals (such as, but not limited to, glasses-type devices, Clock-type devices), other types of computers, or communication platforms.

<Hardware (HW) configuration>
The HW configuration of the information processing apparatus 200 included in the communication system 1 will be described with reference to FIG.

  The information processing apparatus 200 includes a processor 201, a memory 202, a storage 203, an input / output interface (input / output I / F) 204, and a communication interface (communication I / F) 205. The components of the HW of the information processing apparatus 200 are connected to each other via a bus B as an example and not limitation.

  The information processing apparatus 200 implements the functions and / or methods described in the present disclosure in cooperation with the processor 201, the memory 202, the storage 203, the input / output I / F 204, and the communication I / F 205. To do.

  The processor 201 executes functions and / or methods realized by codes or instructions included in programs stored in the storage 203. The processor 201 includes, but is not limited to, a central processing unit (CPU), an MPU (micro processing unit), a GPU (graphics processing unit), a microprocessor, a processor core, and a multiprocessor. Logic circuits (hardware) formed in integrated circuits (IC (Integrated Circuit) chip, LSI (Large Scale Integration)), etc., including ASIC (Application-Specific Integrated Circuit), FPGA (Field Programmable Gate Array), etc. Each process disclosed in each embodiment may be realized by a dedicated circuit. These circuits may be realized by one or a plurality of integrated circuits, and a plurality of processes shown in the embodiments may be realized by a single integrated circuit. An LSI may also be referred to as a VLSI, super LSI, ultra LSI, or the like depending on the degree of integration.

  The memory 202 temporarily stores the program loaded from the storage 203 and provides a work area to the processor 201. The memory 202 also temporarily stores various data generated while the processor 201 is executing the program. The memory 202 includes, for example and without limitation, a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.

  The storage 203 stores a program. The storage 203 includes, without limitation, an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, and the like.

  A communication I / F 205 transmits and receives various data via the network 130. The communication may be executed either by wire or wireless, and any communication protocol may be used as long as mutual communication can be executed. The communication I / F 205 has a function of executing communication with other information processing apparatuses via the network 130. The communication I / F 205 transmits various data to other information processing apparatuses in accordance with instructions from the processor 201. Further, the communication I / F 205 receives various data transmitted from other information processing apparatuses and transmits the data to the processor 201.

  The input / output I / F 204 includes an input device that inputs various operations to the information processing device 200 and an output device that outputs a processing result processed by the information processing device 200. In the input / output I / F 204, the input device and the output device may be integrated, or the input device and the output device may be separated.

  The input device is realized by any one or a combination of all types of devices that can receive an input from a user and transmit information related to the input to the processor 201. Examples of the input device include, but are not limited to, hardware keys such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera (operation input through an image), and a microphone (operation input by voice).

  The output device is realized by any one of all types of devices that can output the processing result processed by the processor 201, or a combination thereof. When outputting the processing result as a video and / or moving image, the output device can select any one of all types of devices that can display the display data according to the display data written in the frame buffer, or the Realized by combination. Examples of output devices include, but are not limited to, a touch panel, a touch display, a monitor (for example, a liquid crystal display, an OELD (Organic Electroluminescence Display), etc.), a head mounted display (HDM), projection mapping, and a hologram. A device capable of displaying images, text information, etc. in the air (which may be vacuum), a speaker (sound output), a printer, and the like. Note that these output devices may be capable of displaying display data in 3D.

  The program according to each embodiment of the present disclosure may be provided in a state of being stored in a computer-readable storage medium. The storage medium can store the program in “a tangible medium that is not temporary”. Programs include, without limitation, software programs and computer programs.

  The storage medium may be one or more semiconductor-based or other integrated circuits (ICs) where appropriate, such as, but not limited to, field programmable gate arrays (FPGAs), application specific ICs (ASICs), etc. ), Hard disk drive (HDD), hybrid hard drive (HHD), optical disk, optical disk drive (ODD), magneto-optical disk, magneto-optical drive, floppy diskette, floppy disk drive (FDD), magnetic It may include tape, solid state drive (SSD), RAM drive, secure digital card or drive, any other suitable storage medium, or any suitable combination of two or more thereof. The storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate.

  Moreover, the program of this indication may be provided to the information processing apparatus 200 via arbitrary transmission media (a communication network, a broadcast wave, etc.) which can transmit the said program.

  Also, each embodiment of the present disclosure may be realized in the form of a data signal embedded in a carrier wave in which a program is embodied by electronic transmission.

  Note that the program of the present disclosure is not limited and includes, for example, script languages such as ActionScript and JavaScript (registered trademark), object-oriented programming languages such as Objective-C and Java (registered trademark), and markup languages such as HTML5. Implemented using.

  At least a part of the processing in the information processing apparatus 200 may be realized by cloud computing including one or more computers.

  It is good also as a structure which performs at least one part of the process in the information processing apparatus 200 by another information processing apparatus. In this case, at least a part of the processing of each functional unit realized by the processor 201 may be performed by another information processing apparatus.

<Others>
Unless explicitly stated, the configuration of determination in the embodiment of the present disclosure is not essential, and predetermined processing is performed when the determination condition is satisfied, or predetermined processing is performed when the determination condition is not satisfied. May be.

  In this disclosure, unless stated otherwise or indicated by context, “or” has an inclusive rather than an exclusive meaning. Thus, in this disclosure, unless stated otherwise or indicated by context, “A or B” means “A, B, or both”. Further, unless stated otherwise or indicated by context, “and” means both joint and individual. Thus, unless stated otherwise or indicated by context, “A and B” herein means “A and B together or individually (A and B, jointly or generally)”. Further, unless otherwise specified or indicated by context, “a”, “an”, or “the” shall mean “one or more”. Thus, herein, “an A” or “the A” means “one or more A” unless stated otherwise or indicated by context.

  The present disclosure includes all changes, substitutions, variations, modifications, and modifications that can be made by those skilled in the art to the embodiments and / or examples of the present disclosure. Similarly, where appropriate, the appended claims cover all modifications, substitutions, variations, alterations, and modifications that may be made by those skilled in the art to the embodiments and / or examples of the disclosure. Include. Further, the disclosure may include one or more features of the embodiments and / or examples in the present disclosure and one of the other embodiments and / or examples in the disclosure that may be made by those skilled in the art. Includes any combination with one or more features.

  In addition, a device or system or a device or system component that is adapted, arranged, capable, configured, usable, operable, or operable to perform a particular function References in the appended claims to are made, devices, systems, or components so adapted, arranged, capable, configured, enabled, operable. As long as the device, system, component or its particular function is activated, turned on, or unlocked, the device, system, component is encompassed.

<First Embodiment>
In the first embodiment, when a user identification process is performed using an image of an identification card (identity verification document) and an image of a user's face, an instruction is given on the spot for an image of the identification card image. In this embodiment, it is ensured that images uploaded online are taken on the spot (liveness).

  In the first embodiment, the predetermined service provided by the server 110 performs online identity verification and liveness confirmation at the time of application for use of the service, etc., and when the identity is authenticated, the predetermined service is provided. Use of this service is permitted. When the server 110 receives a service application or the like, the server 110 requests the user to submit an image obtained by photographing the user's identification card and an image obtained by photographing the user's face online. The user who has received the request uses the camera provided in the terminal 120 to photograph the identification card and his / her face. The terminal 120 transmits the captured image to the server 110, and the server 110 analyzes the received image to confirm the identity and liveness.

  At this time, terminal 120 displays a photographing guide (hereinafter referred to as “photographing guide for identification card”) for instructing a method for photographing the identification card on a screen for photographing the identification card. The photographing method of the identification card includes the position of the identification card within the frame of the photographed image and the holding method of the identification card. The photographing guide for the identification card is changed every time the user shoots an image of the identification card. Although a specific example of the imaging guide will be described later, the imaging guide may be defined as indicating the positional relationship between the identification card and a part holding the identification card in the user's body.

  The server 110 confirms, by image processing, whether or not the image of the identification document submitted online is an image photographed according to the designated photographing guide, and the photographed image is photographed on the spot. It is discriminated whether or not it is an image. In the case of an image shot according to the instructed shooting guide, it is ensured that the image is an image shot on the spot.

  The identity card used for the identity verification process may be any medium that can confirm the identity. Identification cards include, but are not limited to, drivers' licenses, passports (passports), Basic Resident Register cards, My Number cards, health insurance insured cards, etc., but are not limited to official certificates. Absent.

  According to the first embodiment, the photographing guide for the identification card is changed every time the user photographs the image of the identification card. That is, it is difficult for the user to take an action of taking an image to be submitted online in advance and submitting it later, or an action of processing and submitting an image taken in advance. That is, according to the first embodiment, there is an effect that it is possible to ensure that the image submitted online is taken on the spot (liveness). In addition, since the server 110 or the terminal 120 selects the photographing guide for the identification card instructed to the user, the randomness of the photographing guide instructed to the user can be ensured, and identity verification and liveness confirmation can be performed. The effect that it becomes possible to raise the confirmation precision at the time of performing is acquired.

  In addition, according to the first embodiment, since the image of the identification card and the image of the face are separate images, it is difficult to focus on both the identification card and the face in one image. It becomes possible to avoid the problem of becoming.

<Functional Configuration of First Embodiment>
A functional configuration of the server 110 will be described with reference to FIG. The functional unit disclosed in FIG. 3 is realized by cooperation of the processor 201, the memory 202, the storage 203, the input / output I / F 204, and the communication I / F 205 included in the information processing apparatus 200.

  The server 110 includes an input / output unit 311, a communication unit 312, a storage unit 317 selection unit 313, an imaging guide transmission unit 314, an image reception unit 315, an authentication unit 316, and a storage unit 317. The input / output unit 311, the communication unit 312, the selection unit 313, the imaging guide transmission unit 314, the image reception unit 315, and the authentication unit 316 read the program stored in the storage unit 317 by the processor 201. It is realized by executing. The storage unit 317 is realized using the memory 202 and / or the storage 203.

  The input / output unit 311 has a function of performing processing for receiving input of various data through the input / output I / F 204 and processing for outputting various data through the input / output I / F 204.

  The communication unit 312 has a function of performing processing for receiving various data from the terminal 120 via the communication I / F 205 and processing for transmitting various data to the terminal 120 using the communication I / F 205.

  The selection unit 313 has a function of selecting a photographing guide for the identification card to be displayed on the screen of the terminal 120 from a plurality of variations (patterns).

  The imaging guide transmission unit 314 indicates information (hereinafter referred to as “imaging guide instruction information”) that instructs the terminal 120 to provide an imaging guide for an identification card to be displayed on the screen of the terminal 120 selected by the selection unit 313. It has a function of transmitting to the terminal 120.

  The image receiving unit 315 captures the image of the user's ID, the image of the user's face, and user attribute information (name, address, year of birth) input by the user on the terminal 120 screen. Month and date) from the terminal 120.

  The authentication unit 316 has a function of performing user identity verification and liveness confirmation using the user identification image, the user face image, and the user attribute information received by the image reception unit 315. Have. In the following description, user identification and liveness confirmation may be collectively referred to as “person authentication”.

More specifically, the authentication unit 316
1. The position of the identification card instructed by the photographing guide for the identification card and the method of holding the identification card, and the position and identification card of the identification card in the image of the user identification card received by the image receiving unit 315 As a result of comparison with the retention method of
2. A result of comparing the image of the face part included in the image of the user ID received by the image receiving unit 315 with the image of the face of the received user; and
3. Based on the result of comparing the user attribute information included in the image of the user identification received by the image receiving unit 315 with the received user attribute information, the user identity confirmation and liveness confirmation are performed.

  Note that the authentication unit 316 may acquire the result of the identity verification and liveness confirmation performed by the administrator of the server 110 instead of performing the user identity verification and liveness confirmation.

  The storage unit 317 stores a program executed by the server 110 according to the first embodiment.

  A functional configuration of the terminal 120 will be described with reference to FIG. 4 is realized by the cooperation of the processor 201, the memory 202, the storage 203, the input / output I / F 204, and the communication I / F 205 included in the information processing apparatus 200.

  The terminal 120 includes an input unit 321, a communication unit 322, a display control unit 323, a photographing unit 324, an authentication unit 325, and a storage unit 326. The input unit 321, the communication unit 322, the display control unit 323, the imaging unit 324, and the authentication unit 325 are realized by the processor 201 reading and executing a program stored in the storage unit 326. . The storage unit 326 is realized using the memory 202 and / or the storage 203.

  The input unit 321 has a function of performing processing for receiving various inputs via the input / output I / F 204. For example, the input unit 321 receives input of user attribute information or the like via a touch panel or the like included in the terminal 120.

  The communication unit 322 has a function of performing processing for receiving various data from the server 110 via the communication I / F 205 and processing for transmitting various data to the server 110 using the communication I / F 205. The communication unit 322 has a function of receiving shooting guide instruction information from the server 110. In addition, the communication unit 322 has a function of transmitting to the server 110 the image of the user's ID, the image of the user's face, and the user attribute information received by the input unit 321 taken by the photographing unit 324. .

  The display control unit 323 displays an image indicating an imaging area (may be referred to as an imaging area image or an imaging screen) output from a camera (imaging device) included in the terminal 120 and also instructs the imaging guide from the server 110. It has a function of displaying a photographing guide of an identification card instructed by information superimposed on an image showing the photographing region.

  Although specifically described later, in the first embodiment, the terminal 120 may select the photographing guide for the identification card to be displayed on the screen of the terminal 120 instead of the server 110 selecting it. . In this case, the display control unit 323 may select the photographing guide for the identification card from a plurality of variations (patterns) according to a predetermined selection logic.

  The imaging unit 324 has a function of capturing an image of the user's identification card and an image of the user's face using a camera included in the terminal 120 in response to a user operation.

  The authentication unit 325 uses the shooting guide instruction information, the user identification image and the user face image captured by the shooting unit 324, and the user attribute information input to the input unit 321, Has the function of confirming the identity and liveness of Although specifically described later, the authentication unit 325 is a functional unit that is necessary when the terminal 120 performs the user identity verification process and the liveness confirmation process. Therefore, when the terminal 120 does not perform the user identity verification process and the liveness confirmation process by itself, the authentication unit 325 is unnecessary.

  The storage unit 326 stores a program executed by the terminal 120 according to the first embodiment. In addition, the imaging guide instruction information received from the server 110 is temporarily stored.

<Operation Process of First Embodiment>
Processing of the communication system 1 according to the first embodiment will be described with reference to FIG. FIG. 5 shows an example of a sequence indicating processing performed by the communication system 1 according to the first embodiment.

  Here, the image of the ID card to be photographed may be two types, that is, an image of the identity photo page of the ID card and an image of the side of the ID card. For example, it is possible to correspond to an identification card such as a passport in which a personal photo is posted on a specific page. Further, the image of the ID card to be photographed may be two types, that is, the image on the front side of the ID card and the image on the side of the ID card. For example, it is possible to correspond to an identification card in which information is described only on the surface. Further, the image of the ID card to be photographed may be three types: an image on the front side of the ID card, an image on the back side of the ID card, and an image on the side surface of the ID card. For example, it is possible to correspond to an identification card in which information is written on both the front and back surfaces, such as a driver's license and a basic resident register card.

  In the following description, it is assumed that there are three types of images of the ID card to be photographed: an image on the front side of the ID card, an image on the back side of the ID card, and an image on the side surface of the ID card. Similarly, the photographing guide for the identification card includes a photographing guide for the front side of the identification card, a photographing guide for the back side of the photographing guide for the identification card, and a photographing guide for the back side of the identification card.

  In step S100, the input unit 321 of the terminal 120 receives input of user attribute information such as the user's name, address, date of birth, and the like via a touch panel and the like provided in the terminal 120. Note that the input unit 321 may further receive input of the user's physical characteristics (handedness, hand size, presence or absence of hand or finger, etc.).

  In step S <b> 101, the display control unit 323 of the terminal 120 requests the server 110 to transmit shooting guide instruction information. In addition, when the input of a user's physical characteristic is received in step S100, the display control part 323 also transmits the input user's physical characteristic to the server 110.

  In step S102, the selection unit 313 of the server 110 selects a photographing guide for the identification card (front surface, back surface, side surface) instructing the terminal 120 from a plurality of variations according to a predetermined selection logic. As an example and not limitation, the selection unit 313 may randomly select a photographing guide for the ID card to be instructed to the terminal 120 from a plurality of variations, or the current environment information (date, time, weather) Or the position information of the terminal 120). For example, a shooting guide for instructing the terminal 120 for each date (or every time, every weather, every region) is predetermined, and the selection unit 313 displays the current date (or current time, weather, terminal 120). The shooting guide corresponding to the area where the camera is located may be selected as a shooting guide for instructing the terminal 120.

  Further, the selection unit 313 may select a photographing guide for an identification card instructed to the terminal 120 based on the physical characteristics of the user received from the terminal 120. For example, if the user has a small hand size, a shooting guide instructed by the terminal 120 may be selected from shooting guides using the palm. Or you may make it select the imaging | photography guide instruct | indicated to the terminal 120 from the imaging | photography guides using a user's dominant hand.

  In step S103, the imaging guide transmission unit 314 of the server 110 transmits imaging guide instruction information for instructing the imaging guide of the identification card selected in the processing procedure of step S102 to the terminal 120.

  In step S104, the display control unit 323 of the terminal 120 displays the photographing guide on the surface of the identification card instructed from the server 110 on the photographing screen for displaying the output image of the camera. The user adjusts the position of the camera so that the surface of the identification card overlaps the shooting guide displayed on the shooting screen, and holds the identification card as instructed by the shooting guide. The imaging unit 324 captures an image of the surface of the identification card at the timing when the shutter button is pressed (or touched).

  In step S <b> 105, the display control unit 323 of the terminal 120 displays the shooting guide on the back side of the identification card instructed from the server 110 on the shooting screen that displays the output image of the camera. The user adjusts the position of the camera so that the back of the identification card overlaps the shooting guide displayed on the shooting screen, and holds the identification card as instructed by the shooting guide. The imaging unit 324 captures an image on the back side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S <b> 106, the display control unit 323 of the terminal 120 displays the shooting guide on the side of the identification card instructed from the server 110 so as to overlap the shooting screen that displays the output image of the camera. The user adjusts the position of the camera so that the side of the identification card overlaps the shooting guide displayed on the shooting screen, and holds the identification card as instructed by the shooting guide. The imaging unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S107, the imaging unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched).

  In step S <b> 108, the display control unit 323 of the terminal 120 displays the front, back, and side images of the photographed identification card and the user's face image on the screen, and transmits each image to the server 110. Prompt the user for confirmation. At this time, the display control unit 323 displays the captured image and the shooting guide side by side, or allows the user to check whether the captured image is captured along the shooting guide. You may make it display a photography guide on top. If the user permits transmission, the process proceeds to step S109. If the user wants to shoot again, the image desired by the user is taken again.

  Note that the execution order of the processes from S104 to S107 is not limited to the above example, and may be executed in any order. Further, the process of S108 may be executed each time the processes of S104 to S107 are performed.

  The processing procedures of step S109 and step S110 are processing procedures when the identity verification process and the liveness confirmation process are performed on the server 110 side. In step S <b> 109, the communication unit 322 transmits the user attribute information input in the processing procedure of step S <b> 100, the front, back, and side images of the identification card and the user's face image to the server 110.

  In step S110, the authentication unit 325 of the server 110 uses the received user attribute information, the front, back, and side images of the identification card, and the user face image, and the user identity processing and liveness. Perform the confirmation process.

  First, the authentication unit 325 determines the position of the identification card in the photographing guide for the identification card instructed to the terminal 120 and the method for holding the identification card, and the position and identification of the identification card in the image of the identification card. By comparing with a document holding method, it is confirmed that the photographed image is photographed along the photographing guide.

  For example, the authentication unit 325 identifies the position of the identification card on the entire screen by analyzing the image on the front surface (the back surface and the side surface of the identification card), and the identified position and the identification card in the shooting guide. The position of the image on the surface of the identification card may be determined to be in line with the photographing guide when the deviation from the surface position is equal to or less than a predetermined threshold. Further, the authentication unit 325 identifies the shape of the hand holding the identification card in the image by analyzing the image on the surface of the identification card, and identifies the identified hand shape and the identification card in the photographing guide. When the deviation from the shape of the hand holding the letter is equal to or less than a predetermined threshold, it is determined that the method for holding the identification card in the image taken by the user is in accordance with the shooting guide. Good.

  Next, the authentication unit 325 compares the image of the face part included in the image of the identification card with the image of the user's face, and confirms that each image satisfies a predetermined matching criterion, Confirm that the person on the ID and the user are the same person. For example, the authentication unit 325 extracts the facial feature amount shown in each image, and when the difference between the feature amounts is equal to or less than a predetermined value, the person shown in the identification card and the user are the same person You may make it determine with it.

  Next, the authentication unit 325 compares the attribute information of the user included in the image of the identification card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is the identification card. Confirm that it matches the description of.

  For example, the authentication unit 325 reads a character string shown in the image of the identification card, and when the read character string matches the attribute information of the user input by the user, the attribute information input by the user is You may make it determine with it being in agreement with the description matter of a book. As an example, the authentication unit 325 determines whether or not the user's name, date of birth, address, and the like described in the identification card match the attribute information of these users input by the user. it can.

  The authentication unit 325 inputs “the image of the identification card is taken along the shooting guide”, “the person on the identification card and the user are the same person”, “the user inputs If all the items that "the attribute information matches the items on the identification card" are confirmed, the user is the service applicant and the image was taken on the spot (liveness Is determined).

  On the other hand, if any of these items cannot be confirmed, the authentication unit 325 may instruct the terminal 120 (user) to redo the shooting. The terminal 120 transmits the photographed ID image or face image again to the server 110, and the authentication unit 325 of the server 110 performs the identity verification and liveness confirmation again using the newly received image. It may be.

  Alternatively, the authentication unit 325 may leave the determination to the administrator of the server 110 for items that could not be confirmed.

  Note that if the authentication unit 325 cannot confirm any of the items, and the time from when the terminal 120 is instructed to perform re-shooting until the image is received again from the terminal 120 is greater than or equal to a predetermined threshold, Without performing analysis by image processing, it may be determined that identity verification and liveness confirmation have failed, and subsequent processing (for example, processing such as a service start procedure) may be stopped. Note that it is preferable that the transmitted image is visually confirmed by a person after the identity verification and liveness confirmation are completed in step S110. The visual confirmation is preferably performed regardless of the failure or success of the identity confirmation and liveness confirmation.

  The processing procedure of step S111 and step S112 has shown the processing procedure in the case of implementing identity verification processing and liveness confirmation processing not on the server 110 but on the terminal 120 side. When the identity verification process and the liveness confirmation process are performed on the server 110 side, the processing procedures of step S111 and step S112 are omitted, and when the identity verification process is performed on the terminal 120 side, the processing procedures of step S109 and step S110 are Omitted.

  The identity verification process and liveness confirmation process performed by the authentication unit 325 of the terminal 120 in step S111 are the same as the identity verification process and liveness confirmation process performed by the authentication unit 316 of the server 110 in the processing procedure of step S110. Is omitted.

  In step S <b> 112, the communication unit 322 of the terminal 120 transmits the user attribute information input in the processing procedure of step S <b> 102 and the result of identity verification and liveness confirmation (either success or failure) to the server 110. Note that the communication unit 322 may not transmit the user attribute information to the server 110 when the identity verification and liveness confirmation fail.

  As described above, in the processing procedure described with reference to FIG. 5, the display data for displaying the photographing guide of the identification card on the screen of the terminal 120 is associated with the identifier for uniquely identifying the photographing guide data. Alternatively, it may be stored in the storage unit 326 in the terminal 120 in advance. In this case, the imaging guide transmission unit 314 of the server 110 may transmit an imaging guide identifier to the terminal 120 as the imaging guide instruction information. Alternatively, display data for displaying the photographing guide of the identification card on the screen of the terminal 120 is stored in the storage unit 317 of the server 110, and the photographing guide transmission unit 314 of the server 110 captures the photographing as the photographing guide instruction information. The guide display data itself may be transmitted to the terminal 120. Since the identifier has a data size smaller than that of the display data, the former method can reduce the amount of communication data in the server 110 and the terminal 120 as compared with the latter method. On the other hand, the latter method can update display data in real time as compared with the former method.

  FIG. 6 shows an example of a sequence showing processing of the communication system 1 according to the embodiment. With reference to FIG. 6, an example of a sequence when the terminal 120 decides on its own a photographing guide for the identification card to be displayed on the screen of the terminal 120 will be described.

  The processing procedure in step S200 is the same as the processing procedure in step S100 in FIG.

  In step S <b> 201, the display control unit 323 selects a photographing guide for the identification card (front surface) to be displayed on the photographing screen from a plurality of variations. The selection method may be the same as the method performed by the selection unit 313 of the server 110 described in step S102 of FIG. Subsequently, the display control unit 323 displays the shooting guide on the surface of the selected identification card superimposed on the shooting screen displaying the output image of the camera. The imaging unit 324 captures an image of the surface of the identification card at the timing when the shutter button is pressed (or touched).

  In step S202, the display control unit 323 selects, from among a plurality of variations, a shooting guide for the identification card (back side) to be displayed on the shooting screen. The selection method may be the same as the method performed by the selection unit 313 of the server 110 described in step S102 of FIG. Subsequently, the display control unit 323 displays the shooting guide on the back side of the selected identification card on the shooting screen that displays the output image of the camera. The imaging unit 324 captures an image on the back side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S <b> 203, the display control unit 323 selects a photographing guide for the identification card (side surface) to be displayed on the photographing screen from a plurality of variations. The selection method may be the same as the method performed by the selection unit 313 of the server 110 described in step S102 of FIG. Subsequently, the display control unit 323 displays the shooting guide on the side of the selected identification card so as to overlap the shooting screen displaying the output image of the camera. The imaging unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S204, the imaging unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched).

  The processing procedure in step S205 is the same as the processing procedure in step S108 in FIG.

  Note that the execution order of the processes from S201 to S205 is not limited to the above example, and may be executed in any order. Further, the process of S205 may be executed each time the processes of S201 to S204 are performed.

  In step S206, the communication unit 322 receives the user attribute information input in the processing procedure of step S200, the front and back and side images of the identification card, the user's face image, and the shooting guide information. Send to server 110. The shooting guide information includes information for specifying the shooting guide of the identification card (front surface, back surface, side surface) selected by the terminal 120.

  In step S207, the authentication unit 325 of the server 110 uses the received user attribute information, the front, back, and side images of the identification card, the user's face image, and the photographing guide information. Confirmation and liveness confirmation processing are performed. The authentication unit 316 of the server 110 recognizes which shooting guide the user has taken according to the shooting guide information. The other processing procedures are the same as step S110 in FIG.

  When the identity verification and liveness confirmation processing is performed on the server 110 side, the processing procedures of step S206 and step S207 are omitted, and when the identity verification and liveness confirmation processing are performed on the terminal 120 side, the processing of steps S208 and S209 is performed. The processing procedure is omitted.

  The processing procedures of step S208 and step S209 are the same as the processing procedures of step S111 and step S112 of FIG.

<Display Mode of Shooting Guide of First Embodiment>
7 and 8 show an example of a photographing guide for identification cards displayed on the photographing screen of the terminal 120. FIG. FIG. 7A and FIG. 7B show an example of a photographing guide when the identification card is held so as to be sandwiched between fingers. That is, the photographing guide may indicate a position where the user's finger and the identification card come into contact.

  In the example of FIG. 7A, the display control unit 323 includes an output image of the camera and an object J1-1 that indicates the position where the surface of the identification card is to be placed within the frame of the captured image in the display area A100. , The object J2-1 indicating the position having the identification card is displayed. The user points his / her identification card at the top and bottom positions where the object J2-1 is displayed with the thumb and index finger (or middle finger) while facing the camera, and the outline of the identification card is the object J1-1. Touch the shooting button B1 in the overlapped state. When the photographing button B1 is touched, the output image of the camera shown in the display area A100 is recorded as a photographed image. Note that a shooting guide may or may not be recorded in the captured image.

  In the example of FIG. 7B, the display control unit 323 displays an object J1-2 that indicates the position where the back side of the identification card is to be placed, and an object J2-1 that indicates the position where the identification card is held. doing.

  FIGS. 7C to 7E show an example of a photographing guide when the identification card is placed on the palm and held. In the example of FIGS. 7C to 7E, the display control unit 323 instructs the position where the surface of the identification card should be placed on the object J2-2 that specifies the position of the palm of the right hand. The object J1-1 is displayed in an overlapping manner. That is, the photographing guide may indicate the orientation of the user's hand and the position of the identification card in the hand.

  7A to 7E can be applied to both the photographing guide on the front surface of the identification card and the photographing guide on the back surface of the identification card.

  FIG. 8 shows an example of a photographing guide showing a method of photographing the side face of the identification card. In the example of FIG. 8A, the display control unit 323 identifies the object J1-3 that indicates the position where the side of the identification card is to be placed within the frame of the photographed image, and the identification card above and below the object J1-3. An object J2-1 that indicates the position where the book is held is displayed. In the example of FIG. 8B, the display control unit 323 displays the object J2-1 that indicates the position having the identification card at the center of the object J1-3.

  7 and 8, the position where the surface of the identification card is to be arranged and the position where the identification card is held are examples, and are not limited to the positions shown in FIGS. 7 and 8.

<First Example of First Embodiment>
The photographing unit 324 of the terminal 120 includes the position of the identification card and the holding method of the identification card in the image output from the camera, and the position and identification card of the identification card indicated by the shooting guide for the identification card. When the degree of coincidence with the holding method satisfies a predetermined criterion (when it coincides with the predetermined criterion), an image of the identification card may be automatically taken. More specifically, the imaging unit 324 has a predetermined degree of coincidence between the positional relationship between the identification card in the imaging region of the image and the part holding the identification card in the user's body and the positional relationship in the imaging guide. When the standard is satisfied, the image capturing unit 324 may capture an image. The degree of coincidence may be calculated by any method. For example, the identification card, the hand position outline and the face outline in the image are extracted, and the region surrounded by these outlines is extracted. Of these, the degree of coincidence may be the ratio that fits within the frame of the shooting guide.

  In addition, in the case where the image of the identification card is automatically captured, the image capturing unit 324 does not satisfy the predetermined standard even if the degree of coincidence between the image output from the camera and the image capturing guide has passed a predetermined time. In this case, the automatic photographing process may be stopped and the manual shutter may be switched. Alternatively, the predetermined reference may be lowered step by step with time. As a result, it is possible to reduce the time and effort of user operations, and to reduce the situation in which shooting itself cannot be performed when shooting is not performed automatically.

<Second Example of First Embodiment>
In the photographing guide for the identification card, the photographing difficulty level may be defined for each variation. For example, in the example of FIG. 7, the wrist needs to be up FIG. 7 (e), the wrist needs to be on the left side, FIG. 7 (d), and the wrist should be down, FIG. It may be defined such that the shooting difficulty level decreases.

  The authentication unit 316 of the server 110 prompts the user to take an image again when the identity verification and liveness confirmation fail. When prompting the user to take an image again, the terminal 120 (user) may be instructed with a shooting guide having a lower shooting difficulty level than the shooting guide already presented to the user. As a result, a difficult pose or the like is instructed, and it is possible to reduce the possibility that shooting is difficult.

  Note that the authentication unit 316 determines that the total of the shooting difficulty levels of the respective captured images is a predetermined difficulty level in order to prevent a reduction in the shooting difficulty level of all the captured images (front, back, and side surfaces of the identification card). You may make it control so that it may become more than degree. For example, when the photographing difficulty level is lowered for the front surface of the identification card, processing such as prompting the user to recapture the back surface of the identification card with an image having a high photographing difficulty level may be performed. As a result, it is possible to suppress that the photographing is performed using only a simple pose and the reliability of the identity confirmation and the liveness confirmation is lowered.

<Third example of the first embodiment>
The display control unit 323 may accept a change in the shooting guide displayed on the shooting screen of the terminal 120 in response to an instruction from the user. An upper limit may be set for the number of change requests that can be accepted from the user.

<Fourth example of the first embodiment>
When the authentication unit 316 or the authentication unit 325 extracts the date of issue of the identification card shown in the image of the ID card and the date of issue and the date when the face image was taken are open for a predetermined period or longer The terminal 120 (user) may be prompted to stop the identity verification and liveness confirmation processing and take a picture with another identification card. Note that when the identity verification and liveness confirmation processing is performed on the server 110 side, the terminal 120 may extract the issue date of the identification certificate shown in the image of the identification certificate and transmit it to the server 110. Good. This makes it possible to improve the success rate of identity verification and liveness confirmation processing.

<Fifth example of the first embodiment>
The image capturing unit 324 captures an image according to the processing procedure of steps S104 to S107, and transmits the captured image to the server 110 according to the processing procedure of step S109. However, the present invention is not limited to this. For example, the shooting unit 324 transmits to the server 110 all moving image data (streaming data) that the user operates the screen of the terminal 120 to match the identification card with the shooting guide or to capture his / her face. You may do it. The server 110 may perform identity verification and liveness confirmation using moving image data instead of still images.

Second Embodiment
In the second embodiment, when a user identification process is performed using an image of an identification card (identity verification document) and a user face image, a method for capturing a user face image is instructed on the spot. In this embodiment, it is ensured that images uploaded online are taken on the spot (liveness). The second embodiment can be executed alone or in combination with the first embodiment. When combined with the first embodiment, the identity verification and the liveness confirmation depend on whether both the method of capturing the image of the identification card and the method of capturing the image of the user's face are in accordance with the specified capturing method. A determination is made.

  In the second embodiment, the terminal 120 displays information on a shooting guide (hereinafter referred to as “face shooting guide”) for instructing a method of shooting a face on a screen for shooting a face of the user himself / herself. The face photographing method includes the position of the face within the frame of the photographed image, the tilt angle of the face, and the pose at the time of photographing. The face shooting guide is changed every time the user takes a face image.

  The server 110 confirms, by image processing, whether the face image submitted online is an image photographed according to the designated photographing guide, so that the photographed image is photographed on the spot. It is determined whether or not. In the case of an image shot according to the instructed shooting guide, it is ensured that the image is an image shot on the spot.

  According to the second embodiment, the face photographing guide is changed each time the user photographs a face image. That is, it is difficult for the user to take an action of taking an image to be submitted online in advance and submitting it later, or an action of processing and submitting an image taken in advance. That is, according to the second embodiment, there is an effect that it is possible to ensure that images submitted online are taken on the spot (liveness). In addition, since the server 110 or the terminal 120 selects the face photographing guide instructed to the user, the randomness of the photographing guide instructed to the user can be ensured, and when performing identity verification and liveness confirmation The effect that it becomes possible to improve the confirmation accuracy of is obtained.

<Functional Configuration of Second Embodiment>
Again, differences in the functional configuration of the server 110 from the first embodiment will be described with reference to FIG. Functional units not specifically mentioned may be the same as those in the first embodiment.

  The selection unit 313 has a function of selecting a photographing guide to be displayed on the screen of the terminal 120 from a plurality of variations.

  The photographing guide transmission unit 314 has a function of transmitting to the terminal 120 photographing guide instruction information that instructs the terminal 120 about a photographing guide for the face to be displayed on the screen of the terminal 120 selected by the selection unit 313. When the second embodiment is combined with the first embodiment, the photographing guide instruction information includes a photographing guide for an identification card in addition to a photographing guide for a face.

  The authentication unit 316 has a function of performing user identity verification and liveness confirmation using the user identification image, the user face image, and the user attribute information received by the image reception unit 315. Have.

More specifically, the authentication unit 316
1. As a result of comparing the face photographing method specified by the face photographing guide with the face photographing method in the user's face image received by the image receiving unit 315,
2. A result of comparing the image of the face part included in the image of the user ID received by the image receiving unit 315 with the image of the face of the received user; and
3. Based on the result of comparing the user attribute information included in the image of the user identification received by the image receiving unit 315 with the received user attribute information, the user identity confirmation and liveness confirmation are performed.

  Again, a difference between the functional configuration of the terminal 120 and the first embodiment will be described with reference to FIG. Functional units not specifically mentioned may be the same as those in the first embodiment.

  The display control unit 323 has a function of displaying the face photographing guide instructed by the photographing guide instruction information from the server 110 on the photographing screen displaying the image output from the camera (photographing device) included in the terminal 120. .

  Although specifically described later, in the second embodiment, the terminal 120 may select the face photographing guide displayed on the screen of the terminal 120 instead of the server 110 selecting it. In this case, the display control unit 323 may select the face photographing guide from a plurality of variations according to a predetermined selection logic.

  The imaging unit 324 has a function of capturing an image of the user's identification card and an image of the user's face using a camera included in the terminal 120 in response to a user operation.

  Further, when the degree of coincidence between the user's face image shown in the image output from the camera and the face position and the face inclination indicated by the face photographing guide satisfies a predetermined criterion, A face image may be automatically taken.

<Operation Process of Second Embodiment>
Again, with reference to FIG. 5, the process of the communication system 1 which concerns on 2nd Embodiment is demonstrated. In the following description, only differences from the first embodiment will be described. Processing procedures not specifically described may be the same as those in the first embodiment.

  In step S102, the selection unit 313 of the server 110 selects a photographing guide for the face from a plurality of variations. The selection unit 313 may randomly select a photographing guide to be instructed to the terminal 120 from among a plurality of variations, or may be based on current environment information (date, time, weather, position information of the terminal 120, etc.). May be selected. For example, a shooting guide for instructing the terminal 120 for each date (or every time, every weather, every region) is predetermined, and the selection unit 313 displays the current date (or current time, weather, terminal 120). The shooting guide corresponding to the area where the camera is located may be selected as a shooting guide for instructing the terminal 120.

  In step S <b> 103, the imaging guide transmission unit 314 of the server 110 transmits imaging guide instruction information for instructing the imaging guide for the face selected in the processing procedure of step S <b> 102 to the terminal 120.

  In step S104, the imaging unit 324 captures an image of the front side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S105, the imaging unit 324 captures an image on the back side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S106, the imaging unit 324 captures an image of the side face of the identification card at the timing when the shutter button is pressed (or touched).

  In step S <b> 107, the display control unit 323 of the terminal 120 displays the face photographing guide instructed from the server 110 on the photographing screen displaying the output image of the camera. The user adjusts the position of the camera and the tilt of the face so that his / her face overlaps the shooting guide displayed on the shooting screen. The imaging unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched).

  In step S <b> 108, the display control unit 323 of the terminal 120 displays the front, back, and side images of the photographed identification card and the user's face image on the screen, and transmits each image to the server 110. Prompt the user for confirmation. At this time, the display control unit 323 displays the captured image and the shooting guide side by side, or allows the user to check whether the captured image is captured along the shooting guide. You may make it display a photography guide on top. If the user permits transmission, the process proceeds to step S109. If the user wants to shoot again, the image desired by the user is taken again.

  In step S110, the authentication unit 325 of the server 110 uses the received user attribute information, the front, back, and side images of the identification card, and the user face image, and the user identity processing and liveness. Perform the confirmation process.

  First, the authentication unit 325 compares the face photographing method in the face photographing guide instructed to the terminal 120 with the user's face image, so that the photographed image is photographed along the photographing guide. Confirm. For example, the authentication unit 325 analyzes the face image to identify the position and inclination of the face on the entire screen, and the deviation between the specified position and inclination and the position and inclination of the face in the shooting guide is a predetermined threshold value. In the following cases, it may be determined that the image of the user's face is taken along the shooting guide.

  Next, the authentication unit 325 compares the image of the face part included in the image of the identification card with the image of the user's face, and confirms that each image satisfies a predetermined matching criterion, Confirm that the person on the ID and the user are the same person. For example, the authentication unit 325 extracts the facial feature amount shown in each image, and when the difference between the feature amounts is equal to or less than a predetermined value, the person shown in the identification card and the user are the same person You may make it determine with it.

  Next, the authentication unit 325 compares the attribute information of the user included in the image of the identification card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is the identification card. Confirm that it matches the description of.

  For example, the authentication unit 325 reads a character string shown in the image of the identification card, and when the read character string matches the attribute information of the user input by the user, the attribute information input by the user is You may make it determine with it being in agreement with the description matter of a book.

  The authentication unit 325 determines that “the face image is taken along the shooting guide”, “the person on the identification card and the user are the same person”, “the attribute input by the user” When all items of "Information matches the description on the ID card" can be confirmed, the user is the service applicant himself and the image was taken on the spot (there is liveness) ).

  As described above, in the processing procedure described with reference to FIG. 5, display data for displaying the photographing guide for the face on the screen of the terminal 120 is associated with an identifier for uniquely identifying the photographing guide data in advance. You may store in the memory | storage part 326 in the terminal 120. FIG. In this case, the imaging guide transmission unit 314 of the server 110 may transmit an imaging guide identifier to the terminal 120 as the imaging guide instruction information. Alternatively, display data for displaying a face photographing guide on the screen of the terminal 120 is stored in the storage unit 317 of the server 110, and the photographing guide transmission unit 314 of the server 110 uses the photographing guide instruction information as photographing guide instruction information. The display data itself may be transmitted to the terminal 120. Since the identifier has a data size smaller than that of the display data, the former method can reduce the amount of communication data in the server 110 and the terminal 120 as compared with the latter method. On the other hand, the latter method can update display data in real time as compared with the former method.

  FIG. 6 shows an example of a sequence showing processing of the communication system 1 according to the embodiment. With reference to FIG. 6, an example of a sequence in a case where the terminal 120 determines the face photographing guide to be displayed on the screen of the terminal 120 will be described.

  In step S201, the imaging unit 324 captures an image of the front side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S202, the imaging unit 324 captures an image on the back side of the identification card at the timing when the shutter button is pressed (or touched).

  In step S203, the imaging unit 324 captures an image of the side face of the identification card at the timing when the shutter button is pressed (or touched).

  In step S204, the display control unit 323 of the terminal 120 selects a face photographing guide to be displayed on the photographing screen from a plurality of variations. The selection method may be the same as the method performed by the selection unit 313 of the server 110 described in step S102 of FIG. Subsequently, the imaging unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched).

  The processing procedure in step S205 is the same as the processing procedure in step S108 in FIG.

  In step S206, the communication unit 322 receives the user attribute information input in the processing procedure of step S200, the front and back and side images of the identification card, the user's face image, and the shooting guide information. Send to server 110. The shooting guide information includes information for specifying the shooting guide for the face selected by the terminal 120.

  In step S207, the authentication unit 325 of the server 110 uses the received user attribute information, the front, back, and side images of the identification card, the user's face image, and the photographing guide information. Confirmation and liveness confirmation processing are performed. The authentication unit 316 of the server 110 recognizes which shooting guide the user has taken according to the shooting guide information. The other processing procedures are the same as step S110 in FIG.

<Display Mode of Shooting Guide of Second Embodiment>
9 and 10 show an example of a face photographing guide displayed on the photographing screen of the terminal 120. FIG. In the display area A100, an output image of the camera and an object J3-1 that indicates the position of the face and the tilt of the face within the frame of the photographed image are displayed. The example of FIG. 9A shows that the image should be taken without tilting the face, and the examples of FIGS. 9B and 9C show that the photo should be taken with the face tilted. Yes. FIG. 9D shows an example of an object J3-2 that instructs to shoot a face while taking a pose. The object J3-2 indicates that the palm should be copied obliquely below the face in addition to the position where the face is to be placed and the inclination of the face.

  In the example of FIG. 10, the display control unit 323 instructs the face photographing guide to indicate the position of the face and the tilt of the face within the frame of the photographed image, and the position of the side face of the identification card within the frame of the photographed image. Both objects indicating the holding method are displayed. In the example of FIG. 10, the liveness confirmation is performed using at least the face image and the side image of the identification card. Since the side face of the identification card has a small area, it is possible to reduce the burden on the user by instructing the face and the side face of the identification card to be photographed together, and to transmit images from the terminal 120 to the server 110. By reducing the number of communication data, the amount of communication data can be reduced. In the example of FIG. 10A, an object J3-1 that indicates the position of the face and the tilt of the face within the frame of the photographed image, and an object J1 that indicates the position of the side of the identification card within the frame of the photographed image. 3 and an object J2-1 instructing the holding method are displayed. In the example of FIG. 10B, the object J3-1 with the face tilted is displayed.

<First Example of Second Embodiment>
The authentication unit 316 or the authentication unit 325 has a large angle difference between the vertical axis of the face and the vertical axis of the screen of the terminal 120 (imaging screen) when the face tilt is instructed in the face shooting guide. The determination criteria for determining whether or not the face photographing method specified by the face photographing guide and the face photographing method in the received user face image are the same are changed. It may be. For example, when there is no inclination of the face, it is assumed that the face image is determined to be taken along the face photographing guide if the matching rate of the feature amount is 90% or more. In this case, for example, when the inclination of the face is 30 degrees, the authentication unit 316 determines that the face image is taken along the face photographing guide if the matching rate of the feature amount is 70% or more. As described above, the criterion may be loosened as the angle difference increases. This makes it possible to improve the success rate of identity verification and liveness confirmation processing when there is a tilt of the face. <Second Example of Second Embodiment>
In the face shooting guide, a shooting difficulty level may be defined for each variation.

  The authentication unit 316 of the server 110 prompts the user to take an image again when the identity verification and liveness confirmation fail. When prompting the user to take an image again, the terminal 120 (user) may be instructed with a shooting guide having a lower shooting difficulty level than the shooting guide already presented to the user. As a result, a difficult pose or the like is instructed, and it is possible to reduce the possibility that shooting is difficult.

  Note that, in order to prevent the shooting difficulty level of the captured image of the face from being lowered, the authentication unit 316 performs control so that the total shooting difficulty level of each captured image is equal to or higher than a predetermined difficulty level. Also good. For example, when the shooting difficulty level is lowered for the surface of the identification card, processing such as prompting the user to retake a face image with an image with a high shooting difficulty level may be performed. As a result, it is possible to suppress that the photographing is performed using only a simple pose and the reliability of the identity confirmation and the liveness confirmation is lowered.

<Third Embodiment>
The third embodiment is an embodiment in which the position of the photographing guide and the inclination of the photographing guide are changed in the photographing screen for the photographing guide indicating the photographing position on the side of the identification card. Other points that are not particularly mentioned may be the same as those in the first embodiment.

  According to the third embodiment, the shooting guide for the side face of the identification card is changed each time the user takes an image of the side face of the identification card. In other words, it is difficult for the user to take an action such as taking an image to be submitted online at the time of identity verification and liveness confirmation in advance and submitting it later, or processing and submitting an image taken in advance. become. That is, according to the third embodiment, it is possible to ensure that the side image of the ID card submitted online at the time of identity verification and liveness confirmation was taken on the spot (liveness). The effect that it becomes possible is obtained. Further, since it is not necessary to prepare a plurality of variations of shooting guides in advance as a shooting guide for the side of the identification card to be instructed to the user, the server 110 and the terminal 120 store data relating to the shooting guides of the plurality of variations. It is possible to reduce the memory area to be saved.

<Functional Configuration of Third Embodiment>
Again, differences in the functional configuration of the server 110 from the first embodiment will be described with reference to FIG. Functional units not specifically mentioned may be the same as those in the first embodiment.

  The image receiving unit 315 further receives from the terminal 120 an image of the side face of the user identification card and information indicating the position and inclination of the shooting guide that indicates the shooting position of the side face of the identification card on the screen of the terminal 120. To do.

  The authentication unit 316 receives the image of the user's identification card, the image of the user's face, the user's attribute information, and the position of the shooting guide that indicates the shooting position of the side of the identification card received by the image receiving unit 315. And a function for performing user identity verification and liveness confirmation processing using information indicating inclination.

  More specifically, the authentication unit 316 captures the side face of the identification card on the shooting screen of the terminal 120 for the comparison process of the image of the side face of the identification card in the identity verification and liveness confirmation processes in the first embodiment. Based on the comparison result between the position and inclination of the guide and the shooting position (position and inclination) of the side image of the identification card shown in the side image of the user identification card, the identity of the user and the liveness Check.

  Again, a difference between the functional configuration of the terminal 120 and the first embodiment will be described with reference to FIG. Functional units not specifically mentioned may be the same as those in the first embodiment.

  The display control unit 323 has a function of determining the position and inclination when displaying the photographing guide on the side of the identification card according to a predetermined logic and displaying the photographing guide on the photographing screen according to the determined position and inclination.

  The display control unit 323 rotates a shooting guide for instructing the shooting position on the side surface of the identification card along the plane of the shooting screen about an axis perpendicular to the shooting screen. If the rotation is performed, the rotation and rotation may be stopped to determine the position and inclination of the shooting guide on the shooting screen. Further, the photographing guide for instructing the photographing position on the side surface of the identification card may or may not include a photographing guide for instructing a method for holding the side surface of the identification card.

<Display Mode of Shooting Guide of Third Embodiment>
FIG. 11 is a diagram illustrating an example of a shooting guide on the side of the identification card displayed on the shooting screen of the terminal 120 according to the third embodiment. The photographing guide on the side of the identification card shown in FIG. 11 rotates around the axis X like a roulette (FIGS. 11A and 11B), and after a predetermined time has elapsed, Alternatively, it stops in response to a user operation (for example, touching the STOP icon in FIG. 11B, etc.) (FIG. 11C). The user shoots with the side of the identification card aligned with the stopped shooting guide. In addition, in FIG. 11, the position of the rotating shaft X, a rotational speed, and a rotation direction are examples, and are not limited to this. The method of moving the photographing guide on the side of the identification card is not limited to rotation. For example, the shooting guide may be moved back and forth and right and left in the shooting screen. Alternatively, the rotation axis X may move back and forth and right and left in the shooting screen while the shooting guide rotates. Further, the position in the shooting screen where the side shooting guide is displayed is not limited to the position shown in FIG. 11, and may be determined at random, for example.

  After the photographing guide is stopped, the communication unit 322 of the terminal 120 transmits information indicating the position (and / or angle) at which the photographing guide is stopped to the server 110. For example, in the processing procedure of step S109 in FIG. 5, the communication unit 322 transmits information indicating the position where the guide indicating the shooting position on the side of the identification card is stopped to the server 110 together with the shot image. May be.

  FIG. 12 is a diagram illustrating an example of a shooting guide on the side of the identification card displayed on the shooting screen of the terminal 120 according to the third embodiment. As shown in FIG. 12A, the photographing guide on the side of the identification card may include a method for holding the identification card. The display control unit 323 may display a shooting guide indicating how to hold the side of the identification card after the shooting guide stops, or when the shooting guide on the side of the identification card is rotating. It may be displayed continuously.

  Also, as shown in FIG. 12 (b), the photographing guide for the side face of the identification card can capture the front or back side of the identification card together with the side face of the identification card as long as the side face of the identification card can be confirmed. Alternatively, the object J1-4 may be used to instruct that the ID card should be photographed with an inclination. The display control unit 323 may randomly select an angle for tilting the identification card. Specifically, the display control unit 323 randomly selects an angle at which the rotation axis X is tilted with respect to the imaging screen within a predetermined angle range (for example, 10 to 45 degrees), and the rotation axis X is set to the predetermined angle. The tilted object J1-4 may be displayed. By making the front and back surfaces of the identification card appear along with the side surface of the identification card, it is possible to suppress illegal acts such as photographing the side surface with something other than the identification card such as a credit card.

  Further, the shooting guide on the side of the identification card may not be a rectangular shooting guide. For example, as shown in FIG. 12C, the object may be an object instructing to shoot with the side face of the identification card aligned with the position where the book is missing in the bookshelf. In FIG. 12C, the display control unit 323 moves the position where the book is missing at a predetermined time interval (for example, at intervals of 1 second) and stops the position at which the user touches the screen. Good. Further, as shown in FIG. 12D, the photographing guide for the side surface of the identification card may be an object that instructs to align the side surface of the identification card with the hands of the clock. Further, as shown in FIG. 12E, the photographing guide for the side face of the identification card is an object that indicates that a part of the character is missing and that the character is completed by fitting the side face of the identification card. There may be.

<Operation Process of Third Embodiment>
Again, with reference to FIG.5 and FIG.6, the process of the communication system 1 which concerns on 3rd Embodiment is demonstrated. In the following description, only differences from the first embodiment will be described. Processing procedures not specifically described may be the same as those in the first embodiment.

  The photographing unit 324 of the terminal 120, when photographing the side of the identification card in the processing procedure of step S106 in FIG. 5 or step S203 in FIG. 6, identifies the identity shown in the image output from the camera included in the terminal 120. If the degree of coincidence between the shooting position on the side of the certificate and the shooting position on the side of the identification card indicated in the shooting guide for the identification card meets the specified criteria, the image on the side of the identification card will be automatically shot. It may be. The degree of coincidence may be calculated by any method. For example, the photographing unit 324 extracts the side outline of the identification card shown in the image, and among the areas surrounded by the extracted outline. The degree of coincidence may be the ratio that fits within the frame of the shooting guide.

  In addition, when the photographing unit 324 automatically captures the side face of the identification card, the information indicating that the capturing is automatically performed is transmitted to the server 110 in the processing procedure of step S109 in FIG. 5 or step S206 in FIG. It may be. The information may be information that explicitly indicates that the image has been automatically captured, or implicitly indicates that the image has been automatically captured by not transmitting the image on the side of the identification card from the terminal 120 to the server 110. It may be shown.

  When the server 110 receives information indicating that the side of the identification card has been automatically captured from the terminal 120, the server 110 performs the processing procedure of step S110 in FIG. 5 or step S207 in FIG. The confirmation and liveness confirmation processing may be excluded. Specifically, the authentication unit 316 compares the information indicating the shooting position of the side surface of the identification card with the shooting position of the side image of the identification card that is reflected in the side image of the user identification card. You may make it perform a user's identity confirmation and liveness confirmation, without performing. Similarly, when the terminal 120 performs identity verification and liveness confirmation in step S111 in FIG. 5 or step S208 in FIG. 6, the aspect of the identification card is not subject to identity verification and liveness confirmation processing. You may do it.

<Fourth embodiment>
In the fourth embodiment, when the identity verification and liveness confirmation processing is performed using the image of the identification card and the image of the user's face, the shooting guide is used as in the first to third embodiments. Instead of checking liveness depending on whether or not the image was taken along, the position information at the time of shooting added to the image of the identification card and the image of the face is compared with the current position of the terminal 120, and shooting is performed. In this embodiment, the liveness is confirmed by confirming that the position information of the time and the current position of the terminal 120 are included in a predetermined range. The image of the identification card and the image of the user's face may be collectively referred to as “identity confirmation image” (the same applies to other embodiments). Other points that are not particularly mentioned may be the same as those in the first to third embodiments. In addition, you may make it combine 4th Embodiment with 1st Embodiment, 2nd Embodiment, and / or 3rd Embodiment. That is, in addition to the comparison of the position information, the liveness may be confirmed by confirming that the photographed image is along the photographing guide.

  According to the fourth embodiment, the liveness is confirmed by confirming whether or not the position information at the time of shooting and the position information of the terminal 120 are within a predetermined range. As a result, the user may take an act of taking an image to be submitted online at the time of identity verification and liveness confirmation and submitting it later, or an act of processing and submitting an image taken in advance. It becomes difficult. That is, according to the fourth embodiment, it is possible to ensure that the side image of the ID card submitted online at the time of identity verification and liveness confirmation was taken on the spot (liveness). The effect that it becomes possible is obtained. Further, as compared with the first embodiment and the third embodiment, it is not necessary to store the photographing guide for the identification card, so that the memory area of the server 110 and the terminal 120 can be reduced. can get.

<Functional Configuration of Fourth Embodiment>
The functional configuration of the server 110 will be described again with reference to FIG. When the fourth embodiment is not combined with the first embodiment, the second embodiment, and / or the third embodiment, the selection unit 313 and the imaging guide transmission unit 314 in FIG. 3 are not necessary.

  The image receiving unit 315 inputs the position information of the terminal 120, the image of the user's identification card to which the position information at the time of shooting is added, the image of the user's face to which the position information at the time of shooting is added, and the user input The received user attribute information is received from the terminal 120.

  When the position information of the terminal 120 and the position information given to the image of the user identification certificate are within a predetermined range, the authentication unit 316 obtains the user identification certificate for at least one of the user identification confirmation. It has a function to approve as a department. Further, the authentication unit 316 compares the positional information of the terminal 120, the positional information given to the image of the user's identification card, and the positional information given to the image of the user's face, and the received user's identity. Comparison result between the face image included in the certificate image and the received user face image, the user attribute information included in the received user identification image, and the received user attribute Based on the comparison result with the information, it has a function of confirming the identity of the user and the liveness confirmation.

  A difference between the functional configuration of the terminal 120 and the first embodiment will be described with reference to FIG. The terminal 120 according to the fourth embodiment further includes a position information measurement unit 327 in addition to the configuration described in the first embodiment. The display control unit 323, the imaging unit 324, the authentication unit 325, and the position information measurement unit 327 are realized by the processor 201 reading and executing a program stored in the storage unit 326.

  The functional configuration of the terminal 120 according to the present embodiment will be described in detail below. Note that the input unit 321 is the same as that in the first embodiment, and a description thereof will be omitted.

  The communication unit 322 has a function of performing processing for receiving various data from the server 110 via the communication I / F 205 and processing for transmitting various data to the server 110 using the communication I / F 205. In addition, the communication unit 322 inputs an image of the user's identification image added with the position information at the time of shooting, an image of the user's face added with the position information at the time of shooting, which was shot by the shooting unit 324. It has a function of transmitting the user attribute information received by the unit 321 to the server 110.

  The display control unit 323 has a function of displaying an image output from a camera (photographing device) included in the terminal 120 on the photographing screen.

  The imaging unit 324 has a function of capturing an image of the user's identification card and an image of the user's face using a camera included in the terminal 120 in response to a user operation. The photographing unit 324 has a function of adding position information indicating the position at the time of photographing to the photographed user identification image and the user's face image.

  The authentication unit 325 uses the user identification image and user face image captured by the imaging unit 324, the user attribute information input to the input unit 321, and the location information of the terminal 120. It has a function of performing user identity verification processing and liveness confirmation processing. As in the first to third embodiments, when the terminal 120 does not perform the personal identification process and the liveness confirmation process, the terminal 120 may not include the authentication unit 325.

  The position information measuring unit 327 has a function of measuring position information of the current position of the terminal 120. The position information measurement unit 327 measures the latitude and longitude of the terminal 120 as the position information of the current position of the terminal 120 by using GPS (Global Positioning System) as an example and not limitation. In addition, the measurement of the position information of the terminal 120 by the position information measurement unit 327 is not limited to GPS, and any method may be used. As an example and not limitation, the location information measurement unit 327 may measure the location information of the terminal 120 using a wireless LAN such as Wi-Fi. In addition, the position information measurement unit 327 uses, for example and without limitation, a communication method such as IMES (Indoor Messaging System), RFID (Radio Frequency Identifier), BLE (Bluetooth Low Energy), and the like to detect the position information of the terminal 120. May be measured. In addition, the position information measuring unit 327 may measure the position information of the terminal 120 by using a mobile communication system such as LTE or CDMA, for example, without limitation.

<Operation Process of Fourth Embodiment>
Processing of the communication system 1 according to the fourth embodiment will be described with reference to FIG. FIG. 14 shows an exemplary processing sequence of the communication system 1 according to the fourth embodiment.

  In step S300, the position information measurement unit 327 of the terminal 120 starts measuring the current position of the terminal 120.

  The processing procedure in step S301 is the same as the processing procedure in step S100 in FIG.

  In step S302, the image capturing unit 324 captures an image of the front side of the identification card at the timing when the shutter button is pressed (or touched), and position information indicating the position of the terminal 120 at the time of capturing is displayed on the captured image. Is added.

  In step S303, the image capturing unit 324 captures an image on the back side of the identification card at the timing when the shutter button is pressed (or touched), and the position information indicating the position when the terminal 120 is captured is displayed in the captured image. Is added.

  In step S304, the imaging unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched), and the positional information indicating the position of the terminal 120 at the time of shooting in the captured image. Is added.

  In step S305, the image capturing unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched), and adds position information indicating the position of the terminal 120 at the time of capturing to the captured image. To do.

  In step S306, the display control unit 323 of the terminal 120 may display the front, back, and side images of the photographed identification card and the user's face image, and transmit each image to the server 110. Prompt the user for confirmation. If the user permits transmission, the process proceeds to step S307. If the user wants to take another image, the image desired by the user is taken again.

  In step S307, the position information measurement unit 327 of the terminal 120 ends the measurement of the current position of the terminal 120.

  In step S <b> 308, the communication unit 322 displays the user attribute information input in the processing procedure of step S <b> 301, the front, back and side images of the identification card, the user's face image, and the current position of the terminal 120. The position information shown is transmitted to the server 110.

  In step S <b> 310, the authentication unit 325 of the server 110 receives the received user attribute information, the front, back, and side images of the identification card, the user's face image, and position information indicating the current position of the terminal 120. Is used to perform user identity verification processing and liveness verification processing.

  At this time, the authentication unit 325 is added to the position information indicating the current position of the terminal 120, the position information given to each of the front, back, and side images of the user ID and the image of the user's face. The position information is included within a predetermined range.

  Next, the authentication unit 325 compares the face image included in the image of the identification card with the image of the user's face, and confirms that the comparison result satisfies a predetermined coincidence determination criterion. Confirm that the person in the certificate and the user are the same person. Since the specific processing procedure is the same as that of the first embodiment, description thereof is omitted.

  Next, the authentication unit 325 compares the attribute information of the user included in the image of the identification card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is the identification card. Confirm that it matches the description of. Since the specific processing procedure is the same as that of the first embodiment, description thereof is omitted.

  The authentication unit 325 “position information indicating the current position of the terminal 120, position information given to each of the front, back and side images of the user's identification card, and a position given to the user's face image. Information is included within a predetermined range "," the face image included in the user identification image and the user face image satisfy a predetermined matching criterion ", and" When all the items “User attribute information included in the image of the user ID and the received user attribute information match” are confirmed, the user can confirm the identity of the service applicant. And the image is taken on the spot (has liveness).

  On the other hand, the processing procedure performed by the authentication unit 325 when any item cannot be confirmed is the same as that in the first embodiment, the second embodiment, or the third embodiment, and thus the description thereof is omitted.

  The processing procedures of step S310 and step S311 indicate processing procedures when the identity verification processing and liveness confirmation processing are performed not on the server 110 but on the terminal 120 side. When the identity verification process and the liveness confirmation process are performed on the server 110 side, the processing procedures of step S310 and step S311 are omitted, and when the identity verification process is performed on the terminal 120 side, the processing procedures of step S308 and step S309 are Omitted.

  The identity verification processing and liveness confirmation processing performed by the authentication unit 325 of the terminal 120 in step S310 are the same as the identity verification processing and liveness confirmation processing performed by the authentication unit 316 of the server 110 in the processing procedure of step S309. Is omitted.

  The processing procedure of step S311 is the same as the processing procedure of step S112 in FIG.

<First Example of Fourth Embodiment>
In the fourth embodiment, in addition to comparing the position information given to the image with the position information of the terminal 120, the shooting time given to the image is compared with the current time to You may make it perform sex confirmation.

  For example, the photographing unit 324 of the terminal 120 adds the time of photographing in addition to the position information to the front, back, and side images of the photographed user ID and the face image of the user, and the communication unit 322 Then, the front, back and side images of the user identification card to which the position information and the shooting time are added, and the user face image to which the position information and the shooting time are added are transmitted to the server 110. . The image receiving unit 315 of the server 110 receives the image of the user's identification card to which the position information and the shooting time are added, and the image of the user's face to which the position information and the shooting time are added. become.

  In addition to comparing the location information, the authentication unit 316 of the server 110 may check the current time (or the time when the image of the identification card is received from the terminal 120, or the other examples) and the user identification. Based on the comparison result between the time given to the image of the book and the time given to the face image of the user, the user's identity confirmation and liveness confirmation are performed. Specifically, the authentication unit 316 determines whether the current time, the time given to each of the front, back, and side images of the user's identification card and the time given to the user's face image are predetermined. If it is within the range, it may be determined that the liveness has been confirmed. “Within a predetermined range” may be within 3 minutes, within 5 minutes, or the like, for example, without limitation.

  The first embodiment described above can also be applied when the authentication unit 325 of the terminal 120 performs identity verification and liveness confirmation.

<Fifth Embodiment>
In the fifth embodiment, when the identity verification process and the liveness confirmation process are performed using the image of the identification card and the image of the user's face, the imaging guide is used as in the first to third embodiments. Instead of checking the liveness depending on whether or not the image was taken, the time information at the time of photographing added to the image of the identification card and the face image is compared with the current time, In this embodiment, the liveness is confirmed by confirming that the current time report is included within a predetermined range. Other points that are not particularly mentioned may be the same as those in the first embodiment or the third embodiment. In addition, you may make it combine 5th Embodiment with 1st Embodiment and / or 3rd Embodiment. That is, in addition to the comparison of the position information, the liveness may be confirmed by confirming that the photographed image is along the photographing guide. It is also possible to combine the fifth embodiment and the fourth embodiment.

  According to the fifth embodiment, the liveness is confirmed by confirming whether the time information at the time of shooting and the current time are within a predetermined range. As a result, the user may take an act of taking an image to be submitted online at the time of identity verification and liveness confirmation and submitting it later, or an act of processing and submitting an image taken in advance. It becomes difficult. That is, according to the fifth embodiment, it is possible to ensure that the side image of the ID card submitted online at the time of identity verification and liveness confirmation is taken on the spot (liveness). The effect that it becomes possible is obtained. Further, as compared with the first embodiment and the third embodiment, it is not necessary to store the photographing guide for the identification card, so that the memory area of the server 110 and the terminal 120 can be reduced. can get.

<Functional Configuration of Fifth Embodiment>
A functional configuration of the server 110 will be described with reference to FIG. Note that when the fifth embodiment is not combined with the first embodiment and / or the third embodiment, the selection unit 313 and the imaging guide transmission unit 314 in FIG. 3 are unnecessary.

  The image receiving unit 315 includes an image of the user's identification card to which time information at the time of shooting is added, an image of the user's face to which time information at the time of shooting is added, and user attribute information input by the user. Is received from the terminal 120.

  When the current time and the time information given to the image of the user's identity certificate are within a predetermined range, the authentication unit 316 uses the image of the identity certificate as at least a part of the user authentication. Has the function to approve. Further, the authentication unit 316 compares the current time, the time information given to the image of the user's identification card, and the time information given to the image of the user's face, the received user's identification card The comparison result between the face part image included in the image and the received user face image, the user attribute information included in the received user identification image, and the received user attribute information Based on the comparison result, it has a function of confirming the identity of the user and confirming the liveness.

  A functional configuration of the terminal 120 will be described with reference to FIG. In the fifth embodiment, the position information measurement unit 327 is not necessary. Other points that are not particularly mentioned may be the same as those in the fourth embodiment.

  The communication unit 322 captures an image of the user's identification image added with time information at the time of shooting, an image of the user's face added with time information at the time of shooting, and an input unit 321. The server has a function of transmitting the attribute information of the user received at step S110 to the server 110.

  The imaging unit 324 has a function of capturing an image of the user's identification card and an image of the user's face using a camera included in the terminal 120 in response to a user operation. The photographing unit 324 has a function of adding time information at the time of photographing to the photographed user identification image and the user's face image.

<Operation Process of Fifth Embodiment>
Processing of the communication system 1 according to the fifth embodiment will be described with reference to FIG. FIG. 15 shows an exemplary processing sequence of the communication system 1 according to the fifth embodiment.

  The processing procedure of step S400 is the same as the processing procedure of step S100 in FIG.

  In step S401, the imaging unit 324 captures an image of the front side of the identification card at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of shooting to the captured image. To do.

  In step S402, the imaging unit 324 captures an image on the back side of the identification card at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of capturing to the captured image. To do.

  In step S403, the imaging unit 324 captures an image of the side face of the identification card at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of shooting to the captured image. To do.

  In step S404, the imaging unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of capturing to the captured image.

  The processing procedure of step S405 is the same as the processing procedure of step S306 in FIG.

  In step S <b> 406, the communication unit 322 transmits the user attribute information input in the processing procedure of step S <b> 400, the front, back and side images of the identification card, and the user's face image to the server 110.

  In step S407, the authentication unit 325 of the server 110 uses the received user attribute information, the front, back, and side images of the identification card, the user's face image, and the current time to verify the user's identity. Processing and liveness confirmation processing are performed.

  First, the authentication unit 325 determines that the time information given to each of the front, back, and side images of the user's identification card and the time information given to the user's face image are within a predetermined range from the current time. Confirm that it is included.

  Next, the authentication unit 325 compares the face image included in the image of the identification card with the image of the user's face, and confirms that the comparison result satisfies a predetermined coincidence determination criterion. Confirm that the person in the certificate and the user are the same person.

  Next, the authentication unit 325 compares the attribute information of the user included in the image of the identification card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is the identification card. Confirm that it matches the description of.

  The authentication unit 325 indicates that “the time information given to each of the front, back and side images of the user identification card and the time information given to the user face image are within a predetermined range from the current time. "The image of the face of the user and the image of the face of the user satisfying a predetermined match criterion" and "the image of the user ID" If all the items that "the user attribute information included in" and the received user attribute information match "can be confirmed, the user is the service applicant (identity has been confirmed) and the image Is taken on the spot (has liveness).

  On the other hand, the processing procedure performed by the authentication unit 325 when any item cannot be confirmed is the same as that in the first embodiment or the third embodiment, and thus the description thereof is omitted.

  When the identity verification process and the liveness confirmation process are performed on the server 110 side, the processing procedures of Step S408 and Step S409 are omitted, and when the identity verification process is performed on the terminal 120 side, the processing procedures of Step S406 and Step S407 are as follows. Omitted.

  The identity verification process and liveness confirmation process performed by the authentication unit 325 of the terminal 120 in step S408 are the same as the identity verification process and liveness confirmation process performed by the authentication unit 316 of the server 110 in the processing procedure of step S407. Is omitted.

  The processing procedure in step S409 is the same as the processing procedure in step S112 in FIG.

<First Example of Fifth Embodiment>
In the fifth embodiment, in addition to comparing the time information given to the image with the current time, the position information given to the image is compared with the position information indicating the current position of the terminal 120. Then, the liveness may be confirmed.

  For example, the photographing unit 324 of the terminal 120 adds position information at the time of photographing to the front, back, and side images of the photographed user identification image and the image of the user's face in addition to the time information, and the communication unit 322. Are the position information indicating the current position of the terminal 120, the images of the front, back and side surfaces of the user identification card to which the position information and shooting time are added, and the position information and shooting time are added. The user's face image is transmitted to the server 110. The image receiving unit 315 of the server 110 receives the image of the user identification card to which the position information and the shooting time are added, and the image of the user's face to which the position information and the shooting time are added. become.

  In addition to the comparison of time information, the authentication unit 316 of the server 110 also includes the position information of the terminal 120, the position information given to the image of the user identification card, and the position given to the image of the user's face. Based on the comparison result with the information, the user's identity confirmation and liveness confirmation are performed. Specifically, the authentication unit 316 includes the position information of the terminal 120, the position information given to each of the front, back, and side images of the user ID, and the position given to the user's face image. If the information is within a predetermined range, it may be determined that the liveness has been confirmed. “Within the predetermined range” is not limited and may be within 5 m or within 10 m, for example.

  The first embodiment described above can also be applied when the authentication unit 325 of the terminal 120 performs identity verification and liveness confirmation.

1 Communication system, 110 server, 120 terminal, 130 network, 200 information processing device, 201 processor, 202 memory, 203 storage, 204 input / output I / F, 205 communication I / F, 311 input / output unit, 312 communication unit, 313 Selection unit, 314 Shooting guide transmission unit, 315 Image reception unit, 316 authentication unit, 317 storage unit, 321 input unit, 322 communication unit, 323 display control unit, 324 shooting unit, 325 authentication unit, 326 storage unit, 327 position information Measurement unit

Claims (11)

In the first information processing apparatus having the display unit,
Displaying a moving image of an imaging region output by the imaging device on the display unit;
According to the information indicating the position and the inclination when displaying shooting guide indicating a photographing method aspects of the document, which is determined based on a predetermined logic in said imaging area, and displays the shooting guide to the moving image of the imaging region Steps,
Causing the photographing device to photograph a moving image of the photographing region;
Comparison comparing information indicating a position when the shooting guide determined based on the predetermined logic is displayed in the shooting area with a position of a side surface of the document in the moving image on the second information processing apparatus Based on the result, in order to perform liveness confirmation on the moving image, information indicating a position when the imaging guide determined based on the predetermined logic is displayed in the imaging area is captured. Transmitting a moving image of the side of the document to the second information processing apparatus;
A program that executes The step of displaying the shooting guide on the moving image of the shooting area rotates the shooting guide about an axis perpendicular to the shooting area along a screen surface on which the shooting area is displayed. , By stopping the rotation when a predetermined operation is performed, determine the position and inclination when displaying the shooting guide;
The program according to claim 1. The imaging guide further includes a front Kisho such, the imaging guide showing the positional relationship between the site holding the person 該書 rocks in the body of the user,
The program according to claim 1 or 2. The step of photographing includes
Side of the front Kisho rocks in the area to be photographed, when matched by the imaging guide with a predetermined reference, to shoot automatically a moving image of the imaging area,
The program according to any one of claims 1 to 3. The step of imaging transmits the sides of the front Kisho such information indicating that the captured automatically, to another information processing apparatus,
The program as described in any one of Claims 1 thru | or 4. An information processing method executed by a second information processing apparatus communicating with the first information processing apparatus,
Information indicating the position for displaying the photographed guide indicating a photographing method aspects of the determined writing such on the basis of a predetermined logic, and the moving image of the side surface of the captured written acids in the first information processing apparatus Receiving from the first information processing apparatus;
Information indicating the position for displaying the received the imaging guide, based on the compared result of comparison between the position of the side surface of the put that writing such a moving image of the side surface of the front Kisho such that the received pre-Symbol comprising a step of performing live confirmation of moving image side of the book such, the information processing method. The step of performing the live confirmation, when the information indicating the shooting side of the front Kisho such automatically received from the first information processing apparatus, showing the position for displaying the received said shooting guide and information, without performing a comparison between the position of the side surface of put that writing such a moving image of the side surface of before Kisho class received, caught live of the confirmation of the moving image of the side surface of before Kisho class Suppose,
The information processing method according to claim 6. An information processing method performed by a first information processing apparatus having a display unit,
Displaying a moving image of an imaging region output by the imaging device on the display unit;
According to the information indicating the position and the inclination when displaying shooting guide indicating a photographing method aspects of the document, which is determined based on a predetermined logic in said imaging area, and displays the shooting guide the moving image of the imaging area Steps,
Causing the photographing device to photograph a moving image of the photographing region;
Comparison comparing information indicating a position when the shooting guide determined based on the predetermined logic is displayed in the shooting area with a position of a side surface of the document in the moving image on the second information processing apparatus Based on the result, in order to perform liveness confirmation on the moving image, information indicating a position when the imaging guide determined based on the predetermined logic is displayed in the imaging area is captured. Transmitting a moving image of the side of the document to the second information processing apparatus;
An information processing method including: A display unit for displaying a moving image of a shooting area output by the shooting apparatus, the position when displaying a shooting guide indicating a shooting method of the side of a document determined based on a predetermined logic in the shooting area, and according to the information indicating the slope, and a display unit for displaying the photographed guide moving image of the imaging area,
A photographing unit that causes the photographing device to photograph a moving image of the photographing region;
Comparison that compares information indicating the position when displaying the photographing guide determined based on the predetermined logic in the photographing region with the position of the side surface of the document in the moving image on another information processing apparatus Based on the result, in order to perform liveness confirmation on the moving image, information indicating a position when the imaging guide determined based on the predetermined logic is displayed in the imaging area is captured. A transmission unit that transmits a moving image of the side of the document to the other information processing device;
An information processing apparatus. An information processing apparatus that operates as a second information processing apparatus that communicates with the first information processing apparatus,
Information indicating the position and the inclination when displaying shooting guide indicating a photographing method aspects of the determined writing such on the basis of a predetermined logic, the moving image of the side surface of the captured written acids in the first information processing apparatus Receiving from the first information processing apparatus;
Information indicating the position for displaying the received the imaging guide, based on a comparison result obtained by comparing the position of the side surface of the put that writing such a moving image of the side surface of the front Kisho such that the received pre-Symbol comprising a step of performing live confirmation of moving image side of the book such, the information processing apparatus. In the second information processing apparatus that communicates with the first information processing apparatus,
Information indicating the position for displaying the photographed guide indicating a photographing method aspects of writing such based on a predetermined logic, and a moving image of the side surface of the captured written acids in the first information processing apparatus, wherein Receiving from the first information processing apparatus;
Information indicating the position for displaying the received the imaging guide, based on a comparison result obtained by comparing the position of the side surface of the put that writing such a moving image of the side surface of the front Kisho such that the received pre-Symbol performing a live confirmation of moving image side of the book such, thereby executing the program.

Images