JP2020021459A - Program, information processing method, and information processing device - Google Patents

Abstract

To provide a technique capable of ensuring that a photo image submitted online at the time of identity verification was captured on the spot.SOLUTION: An information processing method implemented by a second information processing device in communication with a first information processing device includes: a reception step of receiving location information of the first information processing device and an identify verification image of a user with location information at the time the image was captured from the first information processing device; and an authentication step of approving the identify verification image to be used at least as part of identify verification of the user when the location information of the first information processing device and the location information attached to the identity verification image of the user are within a predetermined range.SELECTED DRAWING: Figure 14

Description

  The present disclosure relates to a program, an information processing method, and an information processing device.

In recent years, a financial service using ICT called Fintech has been developed. F
Examples of the intech service include, for example, a service for automatically managing a household account and a book by automatically creating a household account book, a book, etc., a service for asset management, a service for trading virtual currency, a QR code (registration) (Trademark) and the like.

It is obligatory for a company that provides these services to confirm the identity of a person who wants to use the service in order to prevent fraudulent acts or the like from occurring. For example, Patent Literature 1 discloses a technology for facilitating identity verification of an applicant by displaying a plurality of identification cards on a screen in association with each other.

JP-A-2006-157439

Currently, some services that handle the exchange of funds, such as payments, not only check the image of the ID card submitted by the user online, but also use means such as mailing the application document to the user's home As a result, strict identity verification is performed. However, in view of the future development of services, it is desirable to be able to complete identity verification online without relying on means such as mailing.

When performing identity verification online, there is a possibility that unauthorized image data that has been processed or the like may be submitted. In order to prevent such impropriety, a mechanism is required that can ensure that the image data submitted online is not the reused image but the one taken on the spot (liveness). It is considered to be.

However, Patent Literature 1 discloses a technique for facilitating identity verification of an applicant, but discloses a technique for ensuring that an image used for identity verification is taken on the spot. Not.

An object of the present disclosure is to provide a technology capable of ensuring that an image submitted online at the time of identity verification is taken on the spot.

An information processing method according to an embodiment of the present disclosure is an information processing method executed by a second information processing device that communicates with a first information processing device, the information processing method comprising: A receiving step of receiving, from the first information processing apparatus, a personal identification image of the user to which the information is added, a position information of the first information processing apparatus, and a position information given to the user identification image in a predetermined range. The authentication step of approving the identity verification image as at least a part of the identity authentication of the user.

FIG. 1 illustrates a configuration of a communication system according to an aspect of the embodiment. FIG. 2 illustrates an example of a hardware configuration of the information processing apparatus according to the present disclosure. FIG. 3 is an example of a block diagram illustrating a functional configuration of the information processing apparatus according to the first embodiment. FIG. 4 is an example of a block diagram illustrating a functional configuration of the information processing apparatus according to the first embodiment. FIG. 5 illustrates an example of a sequence illustrating a process performed by the communication system 1 according to the first embodiment. FIG. 6 illustrates an example of a sequence illustrating a process performed by the communication system 1 according to the first embodiment. FIG. 7 shows an example of a photographing guide of an identification card displayed on a photographing screen of the information processing apparatus according to the first embodiment. FIG. 8 illustrates an example of a photographing guide of an identification card displayed on a photographing screen of the information processing apparatus according to the first embodiment. FIG. 9 illustrates an example of a face shooting guide displayed on a shooting screen of the information processing apparatus according to the second embodiment. FIG. 10 illustrates an example of a face shooting guide displayed on a shooting screen of the information processing apparatus according to the second embodiment. FIG. 11 illustrates an example of a shooting guide on the side of an identification card displayed on a shooting screen of the information processing apparatus according to the third embodiment. FIG. 12 shows an example of a photographing guide on the side of the identification card displayed on the photographing screen of the information processing apparatus according to the third embodiment. FIG. 13 is an example of a block diagram illustrating a functional configuration of an information processing apparatus according to the third embodiment. FIG. 14 shows an example of a processing sequence of the communication system according to the fourth embodiment. FIG. 15 shows an example of a processing sequence of the communication system according to the fifth embodiment.

<Legal compliance>
The disclosure set forth herein, if implemented, will be implemented in compliance with the laws of the countries where the disclosure is implemented. In addition, the disclosure described in this specification is implemented with all the changes, substitutions, variations, alterations, and modifications that can be made by those skilled in the art necessary to comply with the laws and regulations of each country.

An embodiment for implementing the communication system 1 according to the present disclosure will be described with reference to the drawings.

<System configuration>
FIG. 1 illustrates a configuration of a communication system 1 according to an embodiment of the present disclosure. As disclosed in FIG. 1, in the communication system 1, the server 110A, the server 110
B is connected to terminal 120A, terminal 120B, and terminal 120C.

In the present disclosure, when it is not necessary to distinguish between the server 110A and the server 110B, the server 110A and the server 110B may be expressed as the server 110, respectively.

In the present disclosure, when it is not necessary to distinguish between the terminal 120A, the terminal 120B, and the terminal 120C, the terminal 120A, the terminal 120B, and the terminal 120C are respectively
20 may be expressed.

In the present disclosure, when it is not necessary to distinguish between the server 110 and the terminal 120, the server 110 and the terminal 120 may be expressed as the information processing device 200, respectively. Note that the number of information processing devices 200 connected to the network 130 is not limited.

The server 110 provides a predetermined service to the terminal 120 used by the user via the network 130. The predetermined service includes, but is not limited to, a settlement service, an e-commerce service, and an SNS (Social Networking Service) represented by an instant messenger.
), Content providing services such as music, videos and books, and financial services. When a user uses a predetermined service via the terminal 120, the server 110 communicates with one or more terminals 12.
0 can be provided with a predetermined service.

If necessary, a terminal used by the user X is expressed as a terminal 120X, and user information in a predetermined service associated with the user X or the terminal 120X is expressed as user information X. The user information is information of a user associated with an account used by the user in a predetermined service. The user information is, by way of example and not limitation, a user's name, a user's icon image, a user's age, a user's gender, a user's address, and a user's hobby that are input by the user or given by a predetermined service. The information includes information associated with the user, such as the preference and the user identifier, and any one or a combination of these may be used.

The network 130 has a role of connecting two or more information processing apparatuses 200. The network 130 refers to a communication network that provides a connection path so that data can be transmitted and received after the terminal 120 connects to the server 110.

One or more portions of network 130 may be a wired or wireless network. Network 130 may include, but is not limited to, an Ad Hoc Network, an intranet, an extranet, a virtual private network,
Network (Virtual Private Network: VPN), Local Area Network (Local Area Network: LAN), Wireless LAN (Wireless LAN: WLAN), Wide Area Network (Wide Area Network: WAN), Wireless WAN (Wireless WAN: WW)
AN), part of the Metropolitan Area Network (MAN), part of the Internet, part of the Public Switched Telephone Network (PSTN),
Mobile phone networks, ISDNs (Integrated Service Digital Networks), wireless LANs, L
It may include Long Term Evolution (TE), Code Division Multiple Access (CDMA), Bluetooth (registered trademark), satellite communication, or the like, or a combination of two or more of these. Network 130 may include one or more networks 130.

The information processing device 200 may be any information processing device that can implement the functions and / or methods described in the present disclosure.

The information processing apparatus 200 includes, but is not limited to, a smartphone, a mobile phone (feature phone), a computer (for example, but not limited to, a desktop, a laptop, and a tablet), a server device, and a media computer platform (for example, but not limited to). , Cables, satellite set-top boxes, digital video recorders, etc.), handheld computing devices (for example but not limited to, PDA (Personal Digital Assistant),
Includes wearable terminals (such as, but not limited to, glasses-type devices, watch-type devices, etc.), other types of computers, or communication platforms.

<Hardware (HW) configuration>
The HW configuration of the information processing device 200 included in the communication system 1 will be described with reference to FIG.

The information processing device 200 includes a processor 201, a memory 202, a storage 203,
An input / output interface (input / output I / F) 204 and a communication interface (communication I / F) 2
05. Each component of the HW of the information processing device 200 is not limited to
Connected to each other.

The information processing device 200 includes a processor 201, a memory 202, a storage 203,
The functions and / or methods described in the present disclosure are implemented by cooperation of the input / output I / F 204 and the communication I / F 205.

The processor 201 executes a function and / or a method realized by a code or an instruction included in a program stored in the storage 203. The processor 201
By way of example and not limitation, central processing units (CPU), MPUs (Micro Processing Units), G
PU (Graphics Processing Unit), microprocessor (microprocessor), processor core (processor core), multiprocessor (multiprocessor), ASIC (Applic
ation-Specific Integrated Circuit), FPGA (Field Programmable Gate Array), etc., integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integrat)
ion)), etc., each processing disclosed in each embodiment may be realized by a logic circuit (hardware) or a dedicated circuit. Further, these circuits may be realized by one or a plurality of integrated circuits, and the plurality of processes described in each embodiment may be realized by one integrated circuit. Further, the LSI may be referred to as a VLSI, a super LSI, an ultra LSI, or the like, depending on the degree of integration.

The memory 202 temporarily stores the program loaded from the storage 203 and provides a work area for the processor 201. The memory 202 also temporarily stores various data generated while the processor 201 is executing the program. The memory 202 is, for example, without limitation, a random access memory (RAM) and a read only memory (ROM).
Including.

The storage 203 stores a program. The storage 203 includes, for example, without limitation, a hard disk drive (HDD), a solid state drive (SSD), and a flash memory.

The communication I / F 205 sends and receives various data via the network 130. The communication may be performed by wire or wireless, and any communication protocol may be used as long as mutual communication can be performed. The communication I / F 205 has a function of executing communication with another information processing device via the network 130. The communication I / F 205 transmits various data to another information processing device in accordance with an instruction from the processor 201. The communication I / F 205 receives various data transmitted from another information processing apparatus,
Transmit to 1.

The input / output I / F 204 includes an input device that inputs various operations to the information processing device 200 and an output device that outputs a processing result processed by the information processing device 200. Input / output I /
In F204, the input device and the output device may be integrated, or the input device and the output device may be separated.

The input device receives an input from a user, and outputs information related to the input to the processor 201.
Or any combination of all types of devices that can be transmitted to
The input device includes, for example and without limitation, hardware keys such as a touch panel, a touch display, and a keyboard, a pointing device such as a mouse, a camera (operation input through an image), and a microphone (operation input by voice).

The output device is realized by any one of all types of devices capable of outputting the processing result processed by the processor 201 or a combination thereof. An image of the processing result,
When outputting as a moving image, the output device is realized by any one or a combination of all types of devices capable of displaying the display data according to the display data written in the frame buffer. Examples of the output device include, but are not limited to, a touch panel, a touch display, and a monitor (for example, but not limited to, a liquid crystal display, an OE).
LD (Organic Electroluminescence Display), head mounted display (
HDM (Head Mounted Display), projection mapping, hologram, a device capable of displaying images and text information in air or the like (may be vacuum), a speaker (audio output), a printer, and the like. Note that these output devices may be capable of displaying display data in 3D.

The program according to each embodiment of the present disclosure may be provided in a state stored in a computer-readable storage medium. The storage medium is capable of storing the program on a “temporary tangible medium”. The programs include, by way of example and not limitation, software programs and computer programs.

The storage medium is, where appropriate, one or more semiconductor-based or other integrated circuits (ICs).
(For example, but not limited to, a field programmable gate array (FPGA),
Application specific integrated circuit (ASIC), hard disk drive (HDD), hybrid hard drive (HHD), optical disk, optical disk drive (ODD), magneto-optical disk, magneto-optical drive, floppy diskette, floppy disk Disk drive (FDD), magnetic tape, solid state drive (SSD), RAM drive, secure
It may include a digital card or drive, any other suitable storage medium, or a suitable combination of two or more thereof. A storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate.

Further, the program of the present disclosure may be provided to information processing device 200 via any transmission medium (such as a communication network or a broadcast wave) capable of transmitting the program.

Further, each embodiment of the present disclosure can also be realized in the form of a data signal embedded in a carrier wave, in which a program is embodied by electronic transmission.

Note that the program of the present disclosure is not limited to ActionScript, Ja
script languages such as vaScript (registered trademark), Jective-C, Java (
(Registered trademark) or a markup language such as HTML5.

At least a part of the processing in the information processing device 200 may be realized by cloud computing including one or more computers.

At least part of the processing in the information processing device 200 may be performed by another information processing device. In this case, at least a part of the processing of each functional unit realized by the processor 201 may be performed by another information processing device.

<Others>
Unless explicitly stated, the configuration of the determination in the embodiment of the present disclosure is not essential, and a predetermined process is performed when the determination condition is satisfied, or a predetermined process is performed when the determination condition is not satisfied. May be.

In this disclosure, “or” has the inclusive, rather than exclusive, meaning unless otherwise stated or indicated by context. Thus, in this disclosure, "A or B" means "A, B, or both," unless stated otherwise or indicated by context. Further, unless otherwise indicated or indicated by context, "and" is intended to mean both joint and individual. Thus, as used herein, unless otherwise specified or indicated by context, “A and B” means “A and B together or separately (A and B, jointly or s).
everyly). Further, unless otherwise specified or indicated by context, “a,” “an,” or “the” shall mean “one or more.” Thus, as used herein, unless otherwise indicated or indicated by context, “an A” or “the A” means “one or more A”.

The present disclosure encompasses all changes, substitutions, variations, alterations, and modifications that may occur to those skilled in the art, to the embodiments and / or examples of the present disclosure. Similarly, where appropriate, the appended claims cover all changes, substitutions, variations, alterations, and modifications that may occur to those skilled in the art for the embodiments and / or examples of the present disclosure. Include. Further, the present disclosure describes one or more features of the embodiments and / or examples in the present disclosure, which can be made by those skilled in the art,
It includes any combination with one or more features of other embodiments and / or examples in the present disclosure.

Additionally, a device or system or a component of a device or system that is adapted, arranged, capable, configured, usable, operable, or operable to perform a particular function. Reference is made in the appended claims to the device, system, or component so adapted, arranged, capable, configured, enabled, enabled. As long as the device, system or component or its specific features are activated, turned on or unlocked, as long as the device, system or component is activated or operable.

<First embodiment>
In the first embodiment, when performing the user identification process using the image of the identification card (identification document) and the image of the user's face, the method of photographing the image of the identification card is designated on the spot. In this embodiment, it is ensured that the image uploaded online is taken on the spot (liveness).

In the first embodiment, in a predetermined service provided by the server 110, online identity confirmation and liveness confirmation are performed at the timing of application for use of the service and the like. Use of this service is permitted. When receiving a service application or the like, the server 110 requests the user to submit an image of the user's ID card and an image of the user's face online. The user who has received the request uses the camera included in the terminal 120 to photograph the ID card and the face of the user. The terminal 120 transmits the photographed image to the server 110, and the server 110 analyzes the received image to confirm the identity and the liveness.

At this time, the terminal 120 displays a photographing guide (hereinafter, referred to as an “identification photographing guide”) for instructing a method of photographing the ID on a screen for photographing the ID. The method of photographing the ID includes the position of the ID within the frame of the photographed image, the method of holding the ID, and the like. The photographing guide of the identification card is changed every time the user photographs the image of the identification card. Although a specific example of the photographing guide will be described later, the photographing guide may be defined to indicate the positional relationship between the identification card and a part of the user's body that holds the identification card.

The server 110 confirms by image processing whether or not the image of the identification card submitted online is an image that has been photographed according to the designated photographing guide, so that the photographed image is photographed on the spot. It is determined whether or not the image is an image. If the image is taken according to the instructed photographing guide, it is ensured that the image is an image taken on the spot.

The identification card used for the identity verification process may be any medium that can confirm the identity. Identification cards include, but are not limited to, driver's licenses, passports (passports), Basic Resident Register cards, My Number cards, health insurance card, etc., but are not limited to official certificates Absent.

According to the first embodiment, the photographing guide of the identification card is changed every time the user photographs the image of the identification card. In other words, it becomes difficult for the user to perform an action of capturing an image to be submitted online beforehand and submit it later, or an action of processing and submitting an image captured in advance. That is, according to the first embodiment, an effect is obtained that it is possible to ensure that an image submitted online is shot on the spot (liveness). In addition, the server 11 selects the photographing guide of the identification card instructing the user.
0 or by the terminal 120, it is possible to secure the randomness of the shooting guide instructing the user, and it is possible to obtain the effect of increasing the confirmation accuracy when confirming the identity and liveness. Can be

Further, according to the first embodiment, since the image of the identification card and the image of the face are separate images, it is difficult to focus on both the identification card and the face in one image. Can be avoided.

<Functional Configuration of First Embodiment>
The functional configuration of the server 110 will be described with reference to FIG. 3 includes a processor 201 included in the information processing apparatus 200, a memory 202, a storage 203, and an input / output
/ F 204 and communication I / F 205 in cooperation.

The server 110 includes an input / output unit 311, a communication unit 312, a storage unit 317, a selection unit 313,
It has a photographing guide transmitting unit 314, an image receiving unit 315, an authentication unit 316, and a storage unit 317. The processor 201 reads out the program stored in the storage unit 317 by the input / output unit 311, the communication unit 312, the selection unit 313, the imaging guide transmission unit 314, the image reception unit 315, and the authentication unit 316. And executed. The storage unit 317 stores the memory 2
02 and / or the storage 203.

An input / output unit 311 for receiving input of various data via the input / output I / F 204;
Further, it has a function of performing a process of outputting various data via the input / output I / F 204.

The communication unit 312 has a function of receiving various data from the terminal 120 via the communication I / F 205 and transmitting various data to the terminal 120 using the communication I / F 205.

The selection unit 313 has a function of selecting a shooting guide of an identification card to be displayed on the screen of the terminal 120 from a plurality of variations (patterns).

The photographing guide transmitting unit 314 transmits information (hereinafter, referred to as “photographing guide instruction information”) for instructing the terminal 120 of a photographing guide of an identification card to be displayed on the screen of the terminal 120 selected by the selecting unit 313. It has a function of transmitting to the terminal 120.

The image receiving unit 315 includes an image of the user's ID card, an image of the user's face, and attribute information of the user (name,
Address, date of birth, etc.) from the terminal 120.

The authentication unit 316 has a function of confirming the identity and liveness of the user using the image of the user's ID card, the image of the user's face, and the attribute information of the user received by the image receiving unit 315. Have. In the following description, the identification of the user and the confirmation of the liveness may be collectively referred to as “identification”.

More specifically, the authentication unit 316
1. The location of the ID card indicated in the ID card shooting guide and the method of holding the ID card,
As a result of comparing the position of the ID card shown in the image of the ID card of the user received by the image receiving unit 315 and the holding method of the ID card,
2. An image of a face portion included in the image of the ID card of the user received by the image receiving unit 315,
A result of comparison with the received user's face image, and
3. Based on the result of comparing the attribute information of the user included in the image of the identification card of the user received by the image receiving unit 315 with the attribute information of the received user, the identity of the user and the liveness confirmation are performed.

Note that the authentication unit 316 may obtain the results of the personal confirmation and the liveness confirmation performed by the administrator of the server 110, instead of performing the personal confirmation and the liveness confirmation of the user.

The storage unit 317 stores a program executed by the server 110 according to the first embodiment.

The functional configuration of the terminal 120 will be described with reference to FIG. 4 includes a processor 201 included in the information processing apparatus 200, a memory 202, a storage 203, an input / output I / O
This is realized by cooperation between F204 and communication I / F205.

The terminal 120 includes an input unit 321, a communication unit 322, a display control unit 323, and a photographing unit 324.
, An authentication unit 325, and a storage unit 326. The processor 201 includes the input unit 321, the communication unit 322, the display control unit 323, the photographing unit 324, and the authentication unit 325.
6 is realized by reading and executing the program stored in the program 6. The storage unit 326 is realized using the memory 202 and / or the storage 203.

The input unit 321 has a function of performing a process of receiving various inputs via the input / output I / F 204. For example, the input unit 321 receives an input of attribute information of a user via a touch panel or the like provided in the terminal 120.

The communication unit 322 has a function of performing a process of receiving various data from the server 110 via the communication I / F 205 and a process of transmitting various data to the server 110 using the communication I / F 205. Further, the communication unit 322 has a function of receiving shooting guide instruction information from the server 110. Further, the communication unit 322 has a function of transmitting the image of the user's identification card, the image of the user's face, and the attribute information of the user received by the input unit 321 to the server 110, which are captured by the capturing unit 324. .

The display control unit 323 displays an image (which may be referred to as an image of a shooting region or a shooting screen) indicating a shooting region output from a camera (photographing device) provided in the terminal 120, and issues a shooting guide instruction from the server 110. It has a function of displaying a photographing guide of the identification card designated by the information so as to overlap the image indicating the photographing area.

Although described later in detail, in the first embodiment, the terminal 120 may select the photographing guide of the identification card to be displayed on the screen of the terminal 120, instead of the server 110 selecting the guide. . In this case, the display control unit 323 may select an imaging guide of the identification card from a plurality of variations (patterns) according to a predetermined selection logic.

The image capturing unit 324 has a function of capturing an image of the user's ID card and an image of the user's face using a camera included in the terminal 120 in response to the operation of the user.

The authentication unit 325 uses the photographing guide instruction information, the image of the user's ID card and the image of the user's face photographed by the photographing unit 324, and the user's attribute information input to the input unit 321. It has a function to confirm the identity and liveness of the user. Although described later in detail, the authentication unit 325 is a functional unit that is necessary when the terminal 120 performs the user identity confirmation process and the liveness confirmation process by itself. Therefore, when the terminal 120 does not perform the user identity confirmation processing and the liveness confirmation processing by itself, the authentication unit 325 is unnecessary.

The storage unit 326 stores a program executed by the terminal 120 according to the first embodiment.
Also, it temporarily stores the shooting guide instruction information received from the server 110.

<Operation Processing of First Embodiment>
With reference to FIG. 5, processing of the communication system 1 according to the first embodiment will be described. FIG.
4 shows an example of a sequence illustrating a process performed by the communication system 1 according to the first embodiment.

Here, the image of the identification card to be photographed may be two types of an image of the personal photograph page of the identification card and an image of the side of the identification card. For example, it is possible to correspond to an identification card such as a passport in which a personal photograph is posted on a specific page. Further, the image of the identification card to be photographed may be two types of an image of the front surface of the identification card and an image of the side surface of the identification card. For example, it can correspond to an identification card in which information is described only on the surface. Further, the image of the identification card to be photographed may be three types of an image of the front surface of the identification card, an image of the back surface of the identification card, and an image of the side surface of the identification card. For example, an identification card such as a driver's license or a Basic Resident Register card in which information is written on both the front and back surfaces can be used.

In the following description, it is assumed that there are three types of images of the ID card to be photographed: an image of the front surface of the ID card, an image of the back surface of the ID card, and an image of the side surface of the ID card. Similarly, the photographing guide for the ID card includes a photographing guide on the front side of the ID card, a photographing guide on the back side of the photographing guide for the ID card, and a photographing guide on the back side of the ID card.

In step S100, the input unit 321 of the terminal 120 receives an input of user attribute information such as a user's name, address, and date of birth via a touch panel or the like included in the terminal 120.
The input unit 321 may further receive an input of a user's physical characteristics (dominant hand, hand size, presence or absence of hand or finger loss, etc.).

In step S101, the display control unit 323 of the terminal 120 requests the server 110 to transmit imaging guide instruction information. When the input of the physical characteristics of the user is received in step S100, the display control unit 323 also transmits the input physical characteristics of the user to the server 11.
Send to 0.

In step S102, the selection unit 313 of the server 110 selects a shooting guide of the identification card (front surface, back surface, side surface) to be instructed to the terminal 120 from a plurality of variations according to a predetermined selection logic. The selection unit 313 may, for example, randomly select, from a plurality of variations, a shooting guide of an identification card to be instructed to the terminal 120 from among a plurality of variations, or select the current environment information (date, time, weather, etc.). , The location information of the terminal 120, etc.). For example, a shooting guide to instruct the terminal 120 for each date (or for each time, each weather, each area) is predetermined, and the selection unit 313 selects the current date (
Alternatively, a shooting guide corresponding to the current time, weather,
May be selected as a photographing guide to instruct.

Further, the selection unit 313 may select an imaging guide of an identification card to be instructed to the terminal 120 based on the physical characteristics of the user received from the terminal 120. For example, a user with a small hand size may select a shooting guide instructing the terminal 120 from among shooting guides that use the palm. Alternatively, a shooting guide to instruct the terminal 120 may be selected from shooting guides that use the user's dominant hand.

In step S103, the photographing guide transmitting unit 314 of the server 110 transmits the photographing guide instruction information for instructing the photographing guide of the identification card selected in the processing procedure of step S102 to the terminal 1
20.

In step S104, the display control unit 323 of the terminal 120 displays the shooting guide on the front side of the identification card designated by the server 110 on the shooting screen displaying the output image of the camera. The user adjusts the position of the camera so that the surface of the identification card overlaps the imaging guide displayed on the imaging screen, and holds the identification card as instructed by the imaging guide. The image capturing unit 324 captures an image of the front surface of the identification card at the timing when the shutter button is pressed (or touched).

In step S105, the display control unit 323 of the terminal 120 displays the shooting guide on the back of the identification card designated by the server 110 on the shooting screen displaying the output image of the camera. The user adjusts the position of the camera so that the back of the ID card overlaps the shooting guide displayed on the shooting screen, and holds the ID card as instructed by the shooting guide. The imaging unit 324 captures an image of the back of the identification card at the timing when the shutter button is pressed (or touched).

In step S <b> 106, the display control unit 323 of the terminal 120 displays the shooting guide on the side of the identification card designated by the server 110 on the shooting screen displaying the output image of the camera. The user adjusts the position of the camera so that the side of the identification card overlaps the imaging guide displayed on the imaging screen, and holds the identification card as instructed by the imaging guide. The imaging unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched).

In step S107, the imaging unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched).

In step S108, the display control unit 323 of the terminal 120 displays the image of the front, back, and side surfaces of the captured ID card and the image of the user's face on the screen, and transmits each image to the server 110. Prompt the user for confirmation. At this time, the display control unit 323 arranges the photographed image and the photographing guide, or displays the photographed image so that the user can confirm whether the photographed image is photographed along the photographing guide. A shooting guide may be displayed on top of the shooting guide. If the user has permitted the transmission, the process proceeds to step S109, and if the user desires to take the image again, the image desired by the user is taken again.

Note that the execution order of the processes from S104 to S107 is not limited to the above example, and may be executed in any order. Further, the process of S108 may be executed each time the processes of S104 to S107 are performed.

The processing procedure of step S109 and step S110 indicates the processing procedure when the personal confirmation processing and the liveness confirmation processing are performed on the server 110 side. In step S109, the communication unit 322 transmits, to the server 110, the user attribute information input in the processing procedure of step S100, the front, back, and side images of the identification card, and the image of the user's face.

In step S110, the authentication unit 325 of the server 110 transmits the received user attribute information and
The identity verification processing and the liveness confirmation processing of the user are performed by using the front, back, and side images of the identification card and the image of the user's face.

First, the authentication unit 325 determines the position of the ID card in the ID card photographing guide designated by the terminal 120 and the method of holding the ID card, and the position and ID card of the ID card appearing in the image of the ID card. It is confirmed that the photographed image is photographed along the photographing guide by comparing the method with the method of holding the book.

For example, the authentication unit 325 identifies the position of the ID card on the entire screen by analyzing an image of the front surface (same on the back and side surfaces) of the ID card, and identifies the specified position and the ID card in the shooting guide. When the deviation from the position on the surface of the identification card is equal to or smaller than a predetermined threshold, the position of the image on the surface of the identification card may be determined to be along the imaging guide. Authentication unit 3
25 analyzes the image of the surface of the identification card to specify the shape of the hand holding the identification card shown in the image, and holds the specified hand shape and the identification card in the shooting guide. When the deviation from the shape of the hand is equal to or smaller than a predetermined threshold, the method of holding the identification card in the image photographed by the user may be determined to be along the photographing guide.

Next, the authentication unit 325 compares the image of the face portion included in the image of the identification card with the image of the face of the user, and confirms that each image satisfies a predetermined matching criterion. Confirm that the person shown in the ID card and the user are the same person. For example, the authentication unit 32
5 extracts the feature amount of the face shown in each image, and when the difference between the feature amounts is equal to or less than a predetermined value, determines that the person shown in the identification card and the user are the same person You may make it.

Next, the authentication unit 325 compares the attribute information of the user included in the image of the ID card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is Confirm that it matches the description of.

For example, the authentication unit 325 reads a character string in the image of the identification card, and when the read character string matches the attribute information of the user input by the user, the attribute information input by the user is It may be determined that they match the items described in the book. As an example, the authentication unit 325 may determine whether or not the user's name, date of birth, address, and the like described in the identification card match the attribute information of the user input by the user. it can.

The authentication unit 325 determines that “the image of the ID card is taken along the shooting guide”
If the person and the user shown in the ID card are the same person, and all the items that "the attribute information entered by the user matches the entry on the ID card" are confirmed, It is determined that the user is the service applicant and that the image was taken on the spot (has liveness).

On the other hand, the authentication unit 325 may instruct the terminal 120 (user) to redo shooting if any of these items cannot be confirmed. Terminal 12
0 transmits the image of the identification card or the image of the face photographed again to the server 110,
The authentication unit 325 of the tenth may perform the identity confirmation and the liveness confirmation again using the newly received image.

Alternatively, the authentication unit 325 may entrust an administrator of the server 110 with respect to an item that could not be confirmed.

Note that if the authentication unit 325 cannot confirm any of the items, if the time from when the terminal 120 is instructed to retake the image to when the image is received again from the terminal 120 is equal to or more than a predetermined threshold, Instead of performing analysis by image processing, it may be determined that personal identification and liveness confirmation have failed, and subsequent processing (for example, processing such as a service start procedure) may be stopped. It is preferable that the transmitted image is visually checked by a person after the identity verification and the liveness confirmation are completed in step S110. It is preferable that the visual confirmation is performed irrespective of failure or success of the personal confirmation and the liveness confirmation.

The processing procedure of steps S111 and S112 indicates the processing procedure when the personal identification processing and the liveness confirmation processing are performed on the terminal 120 side instead of the server 110. When the identity confirmation process and the liveness confirmation process are performed on the server 110 side, the processing procedures of steps S111 and S112 are omitted, and when the identity confirmation process is performed on the terminal 120 side,
The processing procedure of steps S109 and S110 is omitted.

In step S111, the identity confirmation processing and liveness confirmation processing performed by the authentication unit 325 of the terminal 120 are the same as the identity confirmation processing and liveness confirmation processing performed by the authentication unit 316 of the server 110 in the processing procedure of step S110. Is omitted.

In step S112, the communication unit 322 of the terminal 120 transmits to the server 110 the attribute information of the user input in the processing procedure of step S102 and the results of the identity verification and the liveness confirmation (either success or failure). Note that the communication unit 322 may not transmit the attribute information of the user to the server 110 when the identity confirmation and the liveness confirmation fail.

As described above, in the processing procedure described with reference to FIG.
May be stored in the storage unit 326 in the terminal 120 in advance in association with the display data to be displayed on the screen of the terminal 120 in association with the identifier for uniquely identifying the data of the imaging guide. In this case, the photographing guide transmitting unit 314 of the server 110 may transmit the identifier of the photographing guide to the terminal 120 as the photographing guide instruction information. Alternatively, display data for displaying the photographing guide of the ID card on the screen of the terminal 120 is stored in the storage unit 317 of the server 110, and the photographing guide transmitting unit 314 of the server 110 transmits the photographing guide as photographing guide instruction information. The display data of the guide itself may be transmitted to the terminal 120. Since the identifier has a smaller data size than the display data, the former method is different from the latter method in the server 1.
10 and the terminal 120 can reduce the amount of communication data. On the other hand, the latter method can update the display data in real time as compared with the former method.

FIG. 6 illustrates an example of a sequence illustrating a process of the communication system 1 according to the embodiment. With reference to FIG. 6, an example of a sequence in a case where the terminal 120 itself determines a shooting guide of an identification card to be displayed on the screen of the terminal 120 will be described.

The processing procedure in step S200 is the same as the processing procedure in step S100 in FIG. 5, and a description thereof will be omitted.

In step S201, the display control unit 323 selects, from a plurality of variations, a shooting guide for an identification card (front surface) to be displayed on the shooting screen. The selection method is the same as step S in FIG.
The method may be the same as the method performed by the selection unit 313 of the server 110 described in 102. Subsequently, the display control unit 323 displays a shooting guide of the surface of the selected ID card on a shooting screen displaying an output image of the camera. When the shutter button is pressed (or touched) in the photographing unit 324,
At the specified timing, an image of the front surface of the identification card is taken.

In step S202, the display control unit 323 selects, from a plurality of variations, a shooting guide for the identification card (back side) to be displayed on the shooting screen. The selection method is the same as step S in FIG.
The method may be the same as the method performed by the selection unit 313 of the server 110 described in 102. Subsequently, the display control unit 323 displays a shooting guide on the back side of the selected ID card on a shooting screen for displaying an output image of the camera. When the shutter button is pressed (or touched) in the photographing unit 324,
At the specified timing, an image of the back of the identification card is taken.

In step S203, the display control unit 323 selects a shooting guide of the identification card (side surface) to be displayed on the shooting screen from a plurality of variations. The selection method is the same as step S in FIG.
The method may be the same as the method performed by the selection unit 313 of the server 110 described in 102. Subsequently, the display control unit 323 displays a shooting guide on the side of the selected ID card on a shooting screen displaying an output image of the camera. The photographing unit 324 presses (or touches) the shutter button.
At the specified timing, an image of the side of the identification card is taken.

In step S204, the imaging unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched).

The processing procedure in step S205 is the same as the processing procedure in step S108 in FIG.

Note that the execution order of the processes from S201 to S205 is not limited to the above example, and may be performed in any order. Further, the process of S205 may be executed each time the processes of S201 to S204 are performed.

In step S206, the communication unit 322 transmits the user attribute information, the front surface, the back and side images of the identification card, the image of the user's face, and the shooting guide information input in the processing procedure of step S200. Send it to server 110. The shooting guide information includes information for specifying the shooting guide of the identification card (front, back, side) selected by the terminal 120.

In step S207, the authentication unit 325 of the server 110 checks the received attribute information of the user with
The identification of the user and the liveness confirmation process are performed using the front, back, and side images of the identification card, the image of the user's face, and the shooting guide information. The authentication unit 316 of the server 110 refers to the shooting guide information to recognize which shooting guide the user has taken according to the shooting guide. The other processing procedures are the same as step S110 in FIG.

When the identity confirmation and liveness confirmation processing are performed on the server 110 side, the processing procedures of steps S206 and S207 are omitted, and the identity confirmation and liveness confirmation processing are performed by the terminal 120.
When the processing is performed on the side, the processing procedures of steps S208 and S209 are omitted.

The processing procedures of step S208 and step S209 correspond to step S1 of FIG.
The description is omitted because it is the same as the processing procedure of Step 11 and Step S112.

<Display Mode of Photographing Guide of First Embodiment>
7 and 8 show an example of a photographing guide for an identification card displayed on the photographing screen of the terminal 120. FIG. FIGS. 7A and 7B show an example of a photographing guide in a case where the identification card is held between fingers. That is, the imaging guide may indicate the position where the user's finger and the identification card come into contact.

In the example of FIG. 7A, the display control unit 323 includes, in the display area A100, an output image of the camera and an object J1-1 indicating a position where the surface of the identification card is to be arranged in the frame of the captured image. And an object J2-1 indicating a position having an identification card. The user holds his / her ID card at the upper and lower positions where the object J2-1 is displayed with the thumb and the index finger (or the middle finger) facing the camera, and the outline of the ID card is set to the object J1-1. Touch the shooting button B1 in the overlapping state. When the photographing button B1 is touched, an output image of the camera shown in the display area A100 is recorded as a photographed image.
Note that the photographing guide may or may not be recorded in the photographed image.

In the example of FIG. 7B, the display control unit 323 displays an object J1-2 indicating a position where the back surface of the ID card is to be arranged and an object J2-1 indicating a position where the ID card is held. are doing.

FIGS. 7C to 7E show an example of a photographing guide in a case where an identification card is placed on a palm and held. In the examples of FIGS. 7C to 7E, the display control unit 323 indicates a position where the surface of the identification card is to be arranged on the object J2-2 that indicates the position of the palm of the right hand. The object J1-1 is displayed in an overlapping manner. In other words, the shooting guide
It may indicate the orientation of the user's hand and the position of the identification card in the hand.

7A to 7E can be applied to both the photographing guide on the front side of the ID card and the photographing guide on the back side of the ID card.

FIG. 8 shows an example of a photographing guide showing a method of photographing the side of the identification card. FIG.
In the example of ()), the display control unit 323 includes an object J1-3 indicating the position where the side of the identification card is to be arranged in the frame of the captured image, and positions having the identification card above and below the object J1-3. Is displayed. In the example of FIG. 8B, the display control unit 323 displays an object J2-1 indicating a position having an identification card at the center of the object J1-3.

In FIGS. 7 and 8, the position where the surface of the identification card is to be placed and the position where the identification card is held are merely examples, and are not limited to the positions shown in FIGS. 7 and 8.

<First Example of First Embodiment>
The photographing unit 324 of the terminal 120 determines the position of the ID card in the image output from the camera, the method of holding the ID card, and the position and ID card indicated by the ID card photographing guide. If the degree of coincidence with the holding method satisfies a predetermined criterion (if it matches with the predetermined criterion), an image of the identification card may be automatically taken. More specifically, the imaging unit 324 determines whether the degree of coincidence between the positional relationship between the identification card in the image capturing area of the image, the part of the user's body holding the identification card, and the positional relationship in the imaging guide is a predetermined value. When the criterion is satisfied, the image capturing section 324 may capture an image. The degree of coincidence may be calculated by any method. For example, the identification card and the outline of the position of the hand and the outline of the face in the image are extracted, and the outline of the area surrounded by these outlines is extracted. Of these, the proportion that fits within the frame of the shooting guide may be the degree of coincidence.

Further, when the image of the identification card is automatically taken, the matching degree between the image output from the camera and the shooting guide does not satisfy the predetermined criterion even after the lapse of a predetermined time. In this case, the process of automatically taking a picture may be stopped and the mode may be switched to a manual shutter. Alternatively, the predetermined reference may be lowered stepwise with the passage of time. As a result, it is possible to reduce the trouble of the user operation, and it is possible to reduce a situation in which the photographing itself cannot be performed when the photographing is not automatically performed well.

<Second Example of First Embodiment>
The shooting guide of the identification card may define the shooting difficulty for each variation. For example, in the example of FIG. 7, FIG. 7 (e) in which the wrist needs to be on the upper side, FIG. 7 (d) in which the wrist needs to be on the left side, and FIG. It may be defined so that the shooting difficulty level decreases.

The authentication unit 316 of the server 110 prompts the user to take an image again when the identity verification and the liveness confirmation fail. When prompting the user to take an image again, the terminal 120 (user) may be instructed to a shooting guide having a shooting difficulty lower than the shooting guide already presented to the user. Thereby, it is possible to reduce the possibility that a difficult pose or the like is instructed and shooting becomes difficult.

Note that, in order to prevent the shooting difficulty of all the shot images (the front surface, the back surface, and the side surface of the identification card) from decreasing, the authentication unit 316 determines that the sum of the shooting difficulty of each shot image is a predetermined difficulty. The temperature may be controlled to be higher than or equal to the degree. For example, when the photographing difficulty level of the front side of the identification card is reduced, the user may be prompted to re-take an image with a high photographing difficulty level on the back side of the ID card. Accordingly, it is possible to suppress a situation in which shooting is performed using only a simple pose or the like, and the reliability of personality confirmation and liveness confirmation is reduced.

<Third Example of First Embodiment>
The display control unit 323 may receive a change of a shooting guide displayed on the shooting screen of the terminal 120 in response to an instruction from the user. An upper limit may be set for the number of change requests that can be accepted from the user.

<Fourth Example of First Embodiment>
The authentication unit 316 or the authentication unit 325 extracts the date of issuance of the identification card appearing in the image of the identification card, and when the issuance date and the date on which the face image was taken are open for a predetermined period or more. The terminal 120 (cancel the identity verification and liveness confirmation processing, and take a picture with another ID card.
(User). In the case where the server 110 performs the personal identification and liveness confirmation processing, the terminal 120 may extract the date of issue of the ID card appearing in the image of the ID card and transmit the date to the server 110. Good. As a result, it is possible to improve the success rate of the identity confirmation and the liveness confirmation processing.

<Fifth Example of First Embodiment>
The image capturing unit 324 captures an image in the processing procedure of steps S104 to S107,
Although the taken image is transmitted to the server 110 in the processing procedure of step S109, the present invention is not limited to this. For example, the image capturing unit 324 displays all moving image data (i.e., how the user operates the screen of the terminal 120 to match the ID card with the image capturing guide or capture the face of the user.
The data may be transmitted to the server 110 as streaming data). Server 110
For example, the identification and liveness confirmation may be performed using moving image data instead of a still image.

<Second embodiment>
In the second embodiment, when performing the user identification process using the image of the identification card (identification document) and the image of the user's face, the user is instructed on the spot how to capture the image of the user's face. In this embodiment, it is ensured that the image uploaded online is taken on the spot (liveness). The second embodiment can be executed alone, or can be combined with the first embodiment. When combined with the first embodiment, the identity verification and the liveness confirmation are performed by determining whether both the method of photographing the image of the identification card and the method of photographing the image of the user's face comply with the designated photographing method. A determination is made.

In the second embodiment, the terminal 120 displays information of a photographing guide (hereinafter, referred to as “face photographing guide”) for instructing a method of photographing a face on a screen for photographing the face of the user himself. The face photographing method includes a position of the face within the frame of the photographed image, a tilt of the face, a pose at the time of photographing, and the like. The face shooting guide is changed each time the user shoots a face image.

The server 110 confirms by image processing whether or not the face image submitted online is an image taken in accordance with a designated shooting guide, and thereby, the taken image is an image taken on the spot. Is determined. When the image is an image captured according to the instructed imaging guide, it is ensured that the image is an image captured on the spot.

According to the second embodiment, the face shooting guide is changed each time the user shoots a face image. In other words, it becomes difficult for the user to perform an action of capturing an image to be submitted online beforehand and submit it later, or an action of processing and submitting an image captured in advance. That is, according to the second embodiment, an effect is obtained that it is possible to ensure that an image submitted online is taken on the spot (liveness). In addition, since the server 110 or the terminal 120 selects the photographing guide of the face to be instructed to the user, the randomness of the photographing guide to be instructed to the user can be ensured, and the identity and liveness can be confirmed. The effect that it becomes possible to raise the confirmation accuracy of is obtained.

<Functional Configuration of Second Embodiment>
The difference between the functional configuration of the server 110 and the first embodiment will be described again with reference to FIG. Functional units not particularly mentioned may be the same as in the first embodiment.

The selection unit 313 has a function of selecting a shooting guide to be displayed on the screen of the terminal 120 from a plurality of variations.

The photographing guide transmitting unit 314 has a function of transmitting photographing guide instruction information for instructing the terminal 120 on a photographing guide of a face to be displayed on the screen of the terminal 120 selected by the selecting unit 313 to the terminal 120. When the second embodiment is combined with the first embodiment, the imaging guide instruction information includes an identification card imaging guide in addition to the face imaging guide.

The authentication unit 316 has a function of confirming the identity and liveness of the user using the image of the user's ID card, the image of the user's face, and the attribute information of the user received by the image receiving unit 315. Have.

More specifically, the authentication unit 316
1. As a result of comparing the face shooting method instructed by the face shooting guide with the face shooting method in the user's face image received by the image receiving unit 315,
2. An image of a face portion included in the image of the ID card of the user received by the image receiving unit 315,
A result of comparison with the received user's face image, and
3. Based on the result of comparing the attribute information of the user included in the image of the identification card of the user received by the image receiving unit 315 with the attribute information of the received user, the identity of the user and the liveness confirmation are performed.

Again, the functional configuration of the terminal 120 will be described with reference to FIG. 4 in terms of differences from the first embodiment. Functional units not particularly mentioned may be the same as in the first embodiment.

The display control unit 323 has a function of superimposing and displaying a shooting guide of the face specified by the shooting guide instruction information from the server 110 on a shooting screen displaying an image output from a camera (imaging device) provided in the terminal 120. .

Although described later in detail, in the second embodiment, the terminal 120 may select the face imaging guide to be displayed on the screen of the terminal 120 instead of the server 110 itself. In this case, the display control unit 323 may select a face imaging guide from a plurality of variations according to a predetermined selection logic.

The image capturing unit 324 has a function of capturing an image of the user's ID card and an image of the user's face using a camera included in the terminal 120 in response to the operation of the user.

The photographing unit 324 further includes an image of the user's face in the image output from the camera,
When the degree of coincidence between the face position and the face inclination indicated by the face shooting guide satisfies a predetermined criterion, the face image may be automatically shot.

<Operation Processing of Second Embodiment>
Referring again to FIG. 5, the processing of the communication system 1 according to the second embodiment will be described. The following description focuses on differences from the first embodiment. Processing procedures not particularly described may be the same as those in the first embodiment.

In step S102, the selection unit 313 of the server 110 selects a face imaging guide from a plurality of variations. The selecting unit 313 may randomly select a shooting guide to be instructed to the terminal 120 from a plurality of variations, or may select a shooting guide based on current environment information (date, time, weather, position information of the terminal 120, and the like). May be selected. For example, a shooting guide for instructing the terminal 120 for each date (or each time, each weather, each region) is predetermined, and the selection unit 313 selects the current date (or the current time, the weather, the terminal 120). The imaging guide corresponding to (the area where there is) may be selected as the imaging guide to instruct the terminal 120.

In step S103, the imaging guide transmitting unit 314 of the server 110 transmits, to the terminal 120, imaging guide instruction information for instructing the imaging of the face selected in the processing procedure of step S102.

In step S104, the imaging unit 324 captures an image of the front surface of the identification card at the timing when the shutter button is pressed (or touched).

In step S105, the imaging unit 324 captures an image of the back of the identification card at the timing when the shutter button is pressed (or touched).

In step S106, the imaging unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched).

In step S107, the display control unit 323 of the terminal 120 displays the face shooting guide specified by the server 110 on the shooting screen displaying the output image of the camera. The user
The position of the camera and the inclination of the face are adjusted so that the user's face overlaps the shooting guide displayed on the shooting screen. The imaging unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched).

In step S108, the display control unit 323 of the terminal 120 displays the image of the front, back, and side surfaces of the captured ID card and the image of the user's face on the screen, and transmits each image to the server 110. Prompt the user for confirmation. At this time, the display control unit 323 arranges the photographed image and the photographing guide, or displays the photographed image so that the user can confirm whether the photographed image is photographed along the photographing guide. A shooting guide may be displayed on top of the shooting guide. If the user has permitted the transmission, the process proceeds to step S109, and if the user desires to take the image again, the image desired by the user is taken again.

In step S110, the authentication unit 325 of the server 110 transmits the received user attribute information and
The identity verification processing and the liveness confirmation processing of the user are performed by using the front, back, and side images of the identification card and the image of the user's face.

First, the authentication unit 325 compares the method of capturing a face in the capturing guide of the face instructed to the terminal 120 with the image of the user's face, so that the captured image is captured along the capturing guide. Check. For example, the authentication unit 325 specifies the position and inclination of the face on the entire screen by analyzing the image of the face, and determines whether a deviation between the specified position and inclination and the position and inclination of the face in the shooting guide is a predetermined threshold. In the following cases, the image of the user's face may be determined to be taken along the shooting guide.

Next, the authentication unit 325 compares the image of the face portion included in the image of the identification card with the image of the face of the user, and confirms that each image satisfies a predetermined matching criterion. Confirm that the person shown in the ID card and the user are the same person. For example, the authentication unit 32
5 extracts the feature amount of the face shown in each image, and when the difference between the feature amounts is equal to or less than a predetermined value, determines that the person shown in the identification card and the user are the same person You may make it.

Next, the authentication unit 325 compares the attribute information of the user included in the image of the ID card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is Confirm that it matches the description of.

For example, the authentication unit 325 reads a character string in the image of the identification card, and when the read character string matches the attribute information of the user input by the user, the attribute information input by the user is It may be determined that they match the items described in the book.

The authentication unit 325 determines that “the face image is photographed along the photographing guide”, “the person and the user shown in the ID card are the same person”, and “the attribute input by the user”. If all items in "Information matches information on identification card" can be confirmed, the user is the service applicant and the image was taken on the spot (there is a live property). )
Is determined.

As described above, in the processing procedure described with reference to FIG. 5, the display data for displaying the photographing guide of the face on the screen of the terminal 120 is associated with the identifier for uniquely identifying the data of the photographing guide. It may be stored in the storage unit 326 in the terminal 120. In this case, the photographing guide transmitting unit 314 of the server 110 may transmit the identifier of the photographing guide to the terminal 120 as the photographing guide instruction information. Alternatively, display data for displaying a face imaging guide on the screen of the terminal 120 is stored in the storage unit 317 of the server 110, and the server 11
The imaging guide transmitting unit 314 of 0 may transmit the display data of the imaging guide itself to the terminal 120 as the imaging guide instruction information. Since the identifier has a smaller data size than the display data, the former method is different from the latter method in the server 110 and the terminal 12.
0 can reduce the amount of communication data. On the other hand, the latter method can update the display data in real time as compared with the former method.

FIG. 6 illustrates an example of a sequence illustrating a process of the communication system 1 according to the embodiment. With reference to FIG. 6, a description will be given of an example of a sequence in a case where the terminal 120 itself determines a shooting guide for a face to be displayed on the screen of the terminal 120.

In step S201, the imaging unit 324 captures an image of the front surface of the identification card at the timing when the shutter button is pressed (or touched).

In step S202, the imaging unit 324 captures an image of the back of the identification card at the timing when the shutter button is pressed (or touched).

In step S203, the imaging unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched).

In step S204, the display control unit 323 of the terminal 120 selects a face shooting guide to be displayed on the shooting screen from a plurality of variations. The selection method is the same as step S10 in FIG.
2 may be the same as the method performed by the selection unit 313 of the server 110. Next, the photographing unit 3
Numeral 24 captures an image of the user's face when the shutter button is pressed (or touched).

The processing procedure in step S205 is the same as the processing procedure in step S108 in FIG.

In step S206, the communication unit 322 transmits the user attribute information, the front surface, the back and side images of the identification card, the image of the user's face, and the shooting guide information input in the processing procedure of step S200. Send it to server 110. The shooting guide information includes information for specifying the face shooting guide selected by the terminal 120.

In step S207, the authentication unit 325 of the server 110 checks the received attribute information of the user with
The identification of the user and the liveness confirmation process are performed using the front, back, and side images of the identification card, the image of the user's face, and the shooting guide information. The authentication unit 316 of the server 110 refers to the shooting guide information to recognize which shooting guide the user has taken according to the shooting guide. The other processing procedures are the same as step S110 in FIG.

<Display Mode of Photographing Guide of Second Embodiment>
FIG. 9 and FIG. 10 show an example of a face shooting guide displayed on the shooting screen of the terminal 120.
In the display area A100, an output image of the camera and an object J3-1 instructing the position and inclination of the face in the frame of the captured image are displayed. The example of FIG. 9A shows that the image should be taken without tilting the face, and the example of FIG. 9B and FIG. 9C shows that the image should be shot with the face tilted. I have. FIG. 9D shows an example of an object J3-2 for instructing that a face be photographed while posing. The object J3-2 indicates that the palm should be photographed diagonally below the face in addition to the position where the face should be arranged and the inclination of the face.

In the example of FIG. 10, the display control unit 323 provides an object for instructing the face photographing guide the position of the face and the inclination of the face in the frame of the photographed image, and the position of the side surface of the identification card in the frame of the photographed image. And an object for instructing a holding method. In the example of FIG. 10, the liveness is confirmed using at least the face image and the side image of the identification card.
Since the side of the identification card has a small area, it is possible to reduce the burden on the user by instructing to photograph the side of the identification card together with the face, and to reduce the burden on the user from the terminal 120 to the server 1.
By reducing the number of images transmitted to 10, it is possible to reduce the amount of communication data. FIG. 10 (
In the example of a), an object J indicating the position and inclination of the face within the frame of the captured image
3-1 and an object J1 indicating the position of the side of the identification card in the frame of the captured image
-3 and an object J2-1 instructing a holding method are displayed. In the example of FIG. 10B, the object J3-1 in which the face is inclined is displayed.

<First Example of Second Embodiment>
The authentication unit 316 or the authentication unit 325 has a large angle difference between the vertical axis of the face and the vertical axis of the screen (photographing screen) of the terminal 120 when the tilt of the face is instructed in the facial photographing guide. In such a case, the criterion for determining whether or not the face shooting method instructed by the face shooting guide matches the face shooting method in the received user's face image is changed so as to be loose. It may be. For example, when there is no face inclination, if the matching rate of the feature amount is 90% or more,
It is assumed that it is determined that the face image has been shot along the face shooting guide. in this case,
The authentication unit 316 determines that, for example, when the face inclination is 30 degrees and the feature amount matching rate is 70% or more, the face image is shot along the face shooting guide. Alternatively, the criterion may be loosened as the angle difference increases. This makes it possible to improve the success rate of the personal identification and the liveness confirmation processing when the face is tilted. <Second example of the second embodiment>
The face shooting guide may define the shooting difficulty for each variation.

The authentication unit 316 of the server 110 prompts the user to take an image again when the identity verification and the liveness confirmation fail. When prompting the user to take an image again, the terminal 120 (user) may be instructed to a shooting guide having a shooting difficulty lower than the shooting guide already presented to the user. Thereby, it is possible to reduce the possibility that a difficult pose or the like is instructed and shooting becomes difficult.

In addition, in order to prevent the difficulty level of capturing the captured image of the face from decreasing, the authentication unit 31 is used.
6 may be controlled such that the sum of the shooting difficulty levels of the respective shot images is equal to or higher than a predetermined difficulty level. For example, when the photographing difficulty level of the front surface of the identification card is reduced, a process of prompting the user to re-photograph a face image with an image having a high photographing difficulty level may be performed. Accordingly, it is possible to suppress a situation in which shooting is performed using only a simple pose or the like, and the reliability of personality confirmation and liveness confirmation is reduced.

<Third embodiment>
The third embodiment is an embodiment in which the position of the photographing guide and the inclination of the photographing guide are changed in the photographing screen with respect to the photographing guide indicating the photographing position on the side of the identification card. Other points that are not particularly mentioned may be the same as in the first embodiment.

According to the third embodiment, the imaging guide on the side of the identification card is changed each time the user captures an image of the side of the identification card. In other words, the user may take an image to be submitted online at the time of identity verification and liveness confirmation in advance and submit it at a later date,
It becomes difficult to perform an action of processing and submitting an image taken in advance. That is, according to the third embodiment, it is possible to ensure that the image of the side of the identification card submitted online at the time of identity verification and liveness confirmation is taken on the spot (liveness). The effect that it becomes possible is obtained. Further, since it is not necessary to prepare a plurality of variations of the shooting guide in advance as a shooting guide on the side of the identification card instructed to the user, the server 110 and the terminal 120 store data relating to the plurality of variations of the shooting guide. The effect that the memory area to be saved can be reduced is obtained.

<Functional Configuration of Third Embodiment>
The difference between the functional configuration of the server 110 and the first embodiment will be described again with reference to FIG. Functional units not particularly mentioned may be the same as in the first embodiment.

The image receiving unit 315 further outputs an image of the side of the user's ID card and information indicating the position and inclination of a shooting guide that indicates the shooting position of the side of the ID card on the screen of the terminal 120.
Received from terminal 120.

The authentication unit 316 receives the image of the user's ID card, the image of the user's face, the attribute information of the user, and the position of the shooting guide that indicates the shooting position on the side of the ID card, received by the image receiving unit 315. And a function of performing user identity confirmation and liveness confirmation processing using the information indicating the inclination and the information indicating the inclination.

More specifically, the authentication unit 316 performs image capturing of the side surface of the identification card on the photographing screen of the terminal 120 with respect to the comparison processing of the image of the side surface of the identification card in the personal identification and the liveness confirmation processing in the first embodiment. Based on the comparison result between the position and inclination of the guide and the photographing position (position and inclination) of the image of the side of the identification card which is shown in the image of the side of the identification card of the user, the identity of the user and liveness can be confirmed. Make a confirmation.

Referring again to FIG. 4, a description will be given of a functional configuration of the terminal 120, which is different from the first embodiment. Functional units not particularly mentioned may be the same as in the first embodiment.

The display control unit 323 has a function of determining a position and a tilt when displaying the shooting guide on the side of the identification card according to a predetermined logic, and displaying the shooting guide on the shooting screen according to the determined position and tilt.

In addition, the display control unit 323 rotates the shooting guide for instructing the shooting position of the side surface of the identification card along the surface of the shooting screen around an axis in the vertical direction with respect to the shooting screen. By stopping the rotation when performed, the position and inclination of the shooting guide on the shooting screen may be determined. In addition, the shooting guide that instructs the shooting position on the side of the ID card,
An imaging guide for instructing how to hold the side of the identification card may or may not be included.

<Display Mode of Photographing Guide of Third Embodiment>
FIG. 11 is a diagram illustrating an example of a shooting guide on the side of an identification card displayed on a shooting screen of the terminal 120 according to the third embodiment. In the photographing guide on the side of the identification card shown in FIG. 11, a rectangular photographing guide rotates about an axis X like a roulette wheel (FIGS. 11A and 11B).
), After a lapse of a predetermined time, or in response to a user operation (for example, touching the STOP icon in FIG. 11B) (FIG. 11C). The user takes a picture by matching the side of the identification card with the stopped photography guide. Note that, in FIG. 11, the position, the rotation speed, and the rotation direction of the rotation axis X are an example, and are not limited thereto. The method of moving the shooting guide on the side of the identification card is not limited to rotation. For example, the photographing guide may move forward, backward, left and right in the photographing screen. Alternatively, the rotation axis X may move forward, backward, left and right in the shooting screen while the shooting guide rotates. Further, the position in the photographing screen at which the photographing guide of the side surface is displayed is not limited to the position in FIG. 11, and may be determined at random, for example.

After the photographing guide stops, the communication unit 322 of the terminal 120 determines the position where the photographing guide has stopped (
And / or an angle). For example, the communication unit 322 is configured as shown in FIG.
In the processing procedure of step S109, information indicating the position where the guide indicating the photographing position on the side surface of the ID card has stopped may be transmitted to the server 110 together with the photographed image.

FIG. 12 is a diagram illustrating an example of a shooting guide on the side of the identification card displayed on the shooting screen of the terminal 120 according to the third embodiment. As shown in FIG. 12A, the shooting guide on the side of the identification card may include a method for holding the identification card. The display control unit 323 may display the shooting guide indicating the method of holding the side of the ID card after the shooting guide stops, or when the shooting guide on the side of the ID card is rotating. May be displayed continuously.

In addition, as shown in FIG. 12B, the photographing guide on the side of the ID card can also show the front or back of the ID card together with the side of the ID card within a range where the side of the ID card can be checked. Alternatively, the object J1-4 for instructing that the ID card be tilted and taken may be used.
The display control unit 323 may randomly select an angle at which the identification card is inclined. Specifically, the display control unit 323 randomly selects an angle at which the rotation axis X is inclined with respect to the shooting screen within a predetermined angle range (for example, 10 to 45 degrees), and sets the rotation axis X to the predetermined angle. The tilted object J1-4 may be displayed. By making the front and back of the ID card appear together with the side of the ID card, fraudulent acts such as photographing the side with something other than the ID card, such as a credit card, can be suppressed.

Further, the shooting guide on the side of the identification card may not be a rectangular shooting guide. For example, as shown in FIG. 12C, the object may be an object that instructs to shoot an image with the side of the identification card aligned with the position where the book is missing in the bookshelf. In FIG. 12C, the display control unit 323 may move the position where the book is missing at predetermined time intervals (for example, at one-second intervals) and stop at the position where the user touches the screen. Good. Further, the photographing guide on the side of the identification card may be an object for instructing to align the side of the identification card with the hands of a clock as shown in FIG. Also, the shooting guide on the side of the ID card,
As shown in FIG. 12 (e), a part of the character may be omitted, and the object may be an object instructing completion of the character by fitting the side of the identification card.

<Operation Processing of Third Embodiment>
The processing of the communication system 1 according to the third embodiment will be described again with reference to FIGS. The following description focuses on differences from the first embodiment. Processing procedures not particularly described may be the same as those in the first embodiment.

When photographing the side of the identification card in the processing procedure of step S106 of FIG. 5 or step S203 of FIG. 6, the photographing unit 324 of the terminal 120 identifies the identification card in the image output from the camera of the terminal 120. If the degree of coincidence between the shooting position on the side of the card and the shooting position on the side of the ID card indicated in the ID card shooting guide satisfies a predetermined standard, the image on the side of the ID card is automatically taken. It may be. The degree of coincidence may be calculated by any method. For example, the photographing unit 324 extracts the outline of the side surface of the identification card shown in the image, and selects an area surrounded by the extracted outline. The proportion that fits within the frame of the shooting guide may be used as the matching degree.

In addition, when the side of the identification card is automatically photographed, the photographing unit 324 performs step S1 in FIG.
09 or the processing procedure of step S206 in FIG. 6, information indicating that the image has been automatically captured may be transmitted to the server 110. The information may be information explicitly indicating that the image was automatically taken, or by not transmitting the image of the side of the identification card from the terminal 120 to the server 110 to imply that the image was taken automatically. It may be shown.

When the server 110 receives from the terminal 120 the information indicating that the side of the identification card has been automatically photographed, the server 110 performs the processing procedure of step S110 in FIG. 5 or step S207 in FIG. The confirmation and liveness confirmation processing may not be performed. Specifically, the authentication unit 316 compares the information indicating the photographing position of the side of the identification card with the photographing position of the image of the side of the identification card shown in the image of the side of the user's ID. The user identity confirmation and liveness confirmation may be performed without performing the confirmation. Step S in FIG.
Similarly, in the case where the terminal 120 performs the personal identification and the liveness confirmation by itself or in step S208 of FIG. 6, the side of the identification card may be excluded from the target of the personal identification and the liveness confirmation processing.

<Fourth embodiment>
In the fourth embodiment, when the user identity confirmation and the liveness confirmation process are performed using the image of the ID card and the image of the user's face, the photographing guide is used as in the first to third embodiments. Instead of confirming the liveness depending on whether or not the image was taken along, the position information at the time of photographing added to the image of the ID card and the image of the face is compared with the current position of the terminal 120, and the photographing is performed. This is an embodiment in which the liveness is confirmed by confirming that the position information at the time and the current position of the terminal 120 are included in a predetermined range. The image of the identification card and the image of the face of the user may be collectively referred to as an “identification image” (the same applies to other embodiments). Other points that are not particularly mentioned may be the same as the first to third embodiments. Note that the fourth embodiment is
You may make it combine with 1st Embodiment, 2nd Embodiment, and / or 3rd Embodiment.
That is, in addition to the comparison of the position information, the liveness may be confirmed by confirming that the photographed image conforms to the photographing guide.

According to the fourth embodiment, the liveness is checked by checking whether the position information at the time of shooting and the position information of the terminal 120 are within a predetermined range. This allows the user to take an image to be submitted online at the time of identity verification and liveness confirmation beforehand and submit it later, or perform an operation of processing and submitting an image taken in advance and submitting it. It becomes difficult. That is, according to the fourth embodiment, it is possible to ensure that the image of the side of the identification card submitted online at the time of identity verification and liveness confirmation is taken on the spot (liveness). The effect that it becomes possible is obtained. Further, compared to the first and third embodiments, there is no need to store a photographing guide of an identification card, so that the memory area of the server 110 and the terminal 120 can be reduced. can get.

<Functional Configuration of Fourth Embodiment>
The functional configuration of the server 110 will be described again with reference to FIG. When the fourth embodiment is not combined with the first embodiment, the second embodiment, and / or the third embodiment, the selection unit 313 and the imaging guide transmission unit 314 in FIG. 3 are unnecessary.

The image receiving unit 315 inputs the position information of the terminal 120, the image of the user's ID card to which the position information at the time of shooting has been added, the image of the user's face to which the position information at the time of shooting has been added, and input by the user. And a function of receiving the attribute information of the user from the terminal 120.

When the location information of the terminal 120 and the location information given to the image of the user's ID card are within a predetermined range, the authentication unit 316 determines that the user's ID card is at least one of the identification of the user. It has a function to approve as a department. The authentication unit 316 also compares the position information of the terminal 120, the position information given to the image of the user's ID card with the position information given to the image of the user's face, The comparison result between the image of the face portion included in the image of the certificate and the image of the face of the received user, and the attribute information of the user included in the image of the received ID card and the attribute of the received user It has a function of confirming the identity of the user and confirming the liveness based on the result of comparison with the information.

The differences between the functional configuration of the terminal 120 and the first embodiment will be described with reference to FIG.
The terminal 120 according to the fourth embodiment further includes a position information measuring unit 327 in addition to the configuration described in the first embodiment. The display control unit 323, the imaging unit 324, the authentication unit 325, and the position information measurement unit 327 are realized by the processor 201 reading and executing a program stored in the storage unit 326.

Hereinafter, the functional configuration of the terminal 120 according to the present embodiment will be described in detail. Note that the input unit 321 is the same as in the first embodiment, and a description thereof will be omitted.

The communication unit 322 has a function of performing a process of receiving various data from the server 110 via the communication I / F 205 and a process of transmitting various data to the server 110 using the communication I / F 205. The communication unit 322 further includes an image of the user's ID card to which the position information at the time of shooting is added by the imaging unit 324, an image of the user's face to which the position information at the time of shooting is added, The function of transmitting the user attribute information received by the unit 321 to the server 110 is provided.

The display control unit 323 has a function of displaying an image output from a camera (imaging device) included in the terminal 120 on an imaging screen.

The image capturing unit 324 has a function of capturing an image of the user's ID card and an image of the user's face using a camera included in the terminal 120 in response to the operation of the user. Also, the photographing unit 3
Reference numeral 24 has a function of adding position information indicating a position at the time of shooting to the image of the user's ID card and the image of the user's face that have been shot.

The authentication unit 325 uses the image of the user's ID card and the image of the user's face photographed by the photographing unit 324, the attribute information of the user input to the input unit 321 and the position information of the terminal 120, It has a function of performing user identity confirmation processing and liveness confirmation processing. Note that, as in the first to third embodiments, when the terminal 120 does not perform the identity confirmation processing and the liveness confirmation processing by itself, the terminal 120 may not include the authentication unit 325.

The position information measuring unit 327 has a function of measuring position information of the current position of the terminal 120.
The position information measuring unit 327 may be a GPS (Global Position), for example, but not limited to.
using the terminal 1 as the location information of the current location of the terminal 120 using the
Measure 20 latitudes and longitudes. The measurement of the position information of terminal 120 by position information measuring section 327 is not limited to GPS, and any method may be used. By way of example and not limitation, the position information measurement unit 327 may measure the position information of the terminal 120 using a wireless LAN such as Wi-Fi. In addition, the position information measuring unit 327 may include,
MES (Indoor Messaging System) and RFID (Radio
Frequency Identifier), BLE (Bluetooth Low)
Energy) may be used to measure the position information of the terminal 120. The position information measurement unit 327 may measure the position information of the terminal 120 using a mobile communication system such as LTE or CDMA without limitation.

<Operation Processing of Fourth Embodiment>
The processing of the communication system 1 according to the fourth embodiment will be described with reference to FIG. FIG.
Shows an example of a processing sequence of the communication system 1 according to the fourth embodiment.

In step S300, position information measuring section 327 of terminal 120 starts measuring the current position of terminal 120.

The processing procedure in step S301 is the same as the processing procedure in step S100 in FIG. 5, and a description thereof will be omitted.

In step S302, the image capturing unit 324 captures an image of the front surface of the identification card at the timing when the shutter button is pressed (or touched), and the captured image includes position information indicating the position of the terminal 120 at the time of capturing. Is added.

In step S303, the image capturing unit 324 captures an image of the back of the identification card at the timing when the shutter button is pressed (or touched), and includes, in the captured image, position information indicating the position of the terminal 120 at the time of capturing. Is added.

In step S304, the image capturing unit 324 captures an image of the side of the identification card at the timing when the shutter button is pressed (or touched), and includes, in the captured image, position information indicating the position of the terminal 120 at the time of capturing. Is added.

In step S305, the photographing unit 324 photographs the image of the user's face at the timing when the shutter button is pressed (or touched), and adds position information indicating the photographed position of the terminal 120 to the photographed image. I do.

In step S306, the display control unit 323 of the terminal 120 displays the image of the front, back, and side surfaces of the captured ID card and the image of the user's face, and may transmit each image to the server 110. Prompts the user to confirm. If the user has permitted the transmission, the process proceeds to step S307. If the user desires to take the image again, the image desired by the user is taken again.

In step S307, the position information measuring unit 327 of the terminal 120 ends the measurement of the current position of the terminal 120.

In step S308, the communication unit 322 stores the user attribute information, the front, back, and side images of the identification card, the image of the user's face, and the current position of the terminal 120 input in the processing procedure of step S301. The position information shown is transmitted to the server 110.

In step S310, the authentication unit 325 of the server 110 checks the received attribute information of the user with
The identity verification process and the liveness confirmation process of the user are performed using the front, back, and side images of the identification card, the image of the user's face, and position information indicating the current position of the terminal 120.

At this time, the authentication unit 325 determines the position information indicating the current position of the terminal 120, the position information assigned to each of the front, back, and side images of the user's identification card, and the position information assigned to the image of the user's face. It is confirmed that the position information is included in a predetermined range.

Next, the authentication unit 325 compares the image of the face portion included in the image of the identification card with the image of the face of the user, and confirms that the comparison result satisfies a predetermined matching criterion. Confirm that the person shown in the certificate and the user are the same person. The specific processing procedure is the same as that of the first embodiment, and a description thereof will be omitted.

Next, the authentication unit 325 compares the attribute information of the user included in the image of the ID card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is Confirm that it matches the description of. The specific processing procedure is the same as that of the first embodiment, and a description thereof will be omitted.

The authentication unit 325 includes “position information indicating the current position of the terminal 120, position information assigned to each of the front, back, and side images of the user's ID card, and position assigned to the image of the user's face. "The information is included within a predetermined range", "the image of the face portion included in the image of the user's ID card and the image of the user's face satisfy a predetermined matching criterion", If the user attribute information included in the image of the user's ID card matches the attribute information of the received user ", all of the items can be confirmed. ), And that the image was taken on the spot (has liveness).

On the other hand, the processing procedure performed by the authentication unit 325 when any of the items cannot be confirmed is the same as that of the first, second, or third embodiment, and a description thereof will be omitted.

The processing procedures of step S310 and step S311 show the processing procedures when the personal identification processing and the liveness confirmation processing are performed on the terminal 120 side instead of the server 110. When the identity confirmation process and the liveness confirmation process are performed on the server 110 side, the processing procedures of steps S310 and S311 are omitted, and when the identity confirmation process is performed on the terminal 120 side,
The processing procedure of step S308 and step S309 is omitted.

In step S310, the identity confirmation processing and liveness confirmation processing performed by the authentication unit 325 of the terminal 120 are the same as the identity confirmation processing and liveness confirmation processing performed by the authentication unit 316 of the server 110 in the processing procedure of step S309. Is omitted.

The processing procedure in step S311 is the same as the processing procedure in step S112 in FIG. 5, and a description thereof will be omitted.

<First Example of Fourth Embodiment>
In the fourth embodiment, in addition to comparing the position information given to the image with the position information of the terminal 120, by comparing the shooting time given to the image with the current time,
The liveness may be checked.

For example, the photographing unit 324 of the terminal 120 adds the photographing time in addition to the position information to the photographed front, back, and side images of the user's ID card and the image of the user's face.
2. The server 110 stores the front, back, and side images of the user's identification card to which the position information and the time of shooting are added, and the image of the user's face to which the position information and the time of shooting are added. Send. The image receiving unit 315 of the server 110 receives the image of the user's ID card to which the position information and the time of shooting are added, and the image of the user's face to which the position information and the time of shooting are added. become.

Further, in addition to comparing the location information, the authentication unit 316 of the server 110 may determine the current time (or the time when the image of the identification card is received from the terminal 120, and may be the same in other embodiments) and the user's identification. Based on the result of comparison between the time given to the image of the book and the time given to the image of the user's face, the user's identity and liveness are confirmed. Specifically, the authentication unit 316 determines the current time, the time given to each of the front, back, and side images of the user's ID card and the time given to the image of the user's face by a predetermined value. If it is within the range, it may be determined that the liveness has been confirmed. The term “within the predetermined range” may be, for example, within 3 minutes, 5 minutes, or the like, without limitation.

The first embodiment described above can also be applied when the authentication unit 325 of the terminal 120 performs identity verification and liveness confirmation.

<Fifth embodiment>
In the fifth embodiment, when the user identification and the liveness confirmation processing are performed using the image of the identification card and the image of the user's face, the fifth embodiment follows the shooting guide as in the first to third embodiments. Instead of checking the liveness depending on whether or not the image was taken, the time information at the time of shooting added to the image of the identification card and the image of the face is compared with the current time, and the time at the time of shooting is compared with the time at the time of shooting. This is an embodiment in which liveness is confirmed by confirming that the current time report is included in a predetermined range. Other points that are not particularly described may be the same as the first embodiment or the third embodiment. Note that the fifth embodiment may be combined with the first embodiment and / or the third embodiment. That is, in addition to the comparison of the position information, the liveness may be confirmed by confirming that the photographed image conforms to the photographing guide. Further, the fifth embodiment and the fourth embodiment can be combined.

According to the fifth embodiment, the liveness is confirmed by confirming whether the time information at the time of shooting and the current time are within a predetermined range. This allows the user to take an image to be submitted online at the time of identity verification and liveness confirmation beforehand and submit it later, or perform an operation of processing and submitting an image taken in advance and submitting it. It becomes difficult. That is, according to the fifth embodiment, it is possible to ensure that the image of the side of the identification card submitted online at the time of identity verification and liveness confirmation is taken on the spot (liveness). The effect that it becomes possible is obtained. Further, compared to the first and third embodiments, there is no need to store a photographing guide of an identification card, so that the memory area of the server 110 and the terminal 120 can be reduced. can get.

<Functional Configuration of Fifth Embodiment>
The functional configuration of the server 110 will be described with reference to FIG. When the fifth embodiment is not combined with the first embodiment and / or the third embodiment, the selecting unit 313 and the photographing guide transmitting unit 314 in FIG. 3 are unnecessary.

The image receiving unit 315 includes an image of the user's ID card to which the time information at the time of shooting is added, an image of the face of the user to which the time information at the time of shooting is added, and the attribute information of the user input by the user. From the terminal 120.

When the current time and the time information given to the image of the user's ID card are within a predetermined range, the authentication unit 316 uses the image of the ID card as at least a part of the authentication of the user. Has a function to approve. The authentication unit 316 also compares the current time, the time information given to the image of the user's ID card with the time information given to the image of the user's face, The comparison result between the image of the face portion included in the image and the received image of the face of the user, and the attribute information of the user included in the image of the received ID card and the attribute information of the received user It has a function of confirming the identity of the user and confirming the liveness based on the comparison result.

The functional configuration of the terminal 120 will be described with reference to FIG. In the fifth embodiment, the position information measuring section 327 is unnecessary. Other points that are not particularly mentioned may be the same as those of the fourth embodiment.

The communication unit 322 includes an image of the user's ID card to which the time information at the time of shooting is added by the imaging unit 324, an image of the face of the user to which the time information at the time of shooting is added, and an input unit 321.
And a function of transmitting to the server 110 the attribute information of the user accepted in step (1).

The image capturing unit 324 has a function of capturing an image of the user's ID card and an image of the user's face using a camera included in the terminal 120 in response to the operation of the user. Also, the photographing unit 3
Reference numeral 24 has a function of adding time information at the time of image capturing to the image of the user's ID card and the image of the user's face.

<Operation Processing of Fifth Embodiment>
The processing of the communication system 1 according to the fifth embodiment will be described with reference to FIG. FIG.
Shows an example of a processing sequence of the communication system 1 according to the fifth embodiment.

The processing procedure in step S400 is the same as the processing procedure in step S100 in FIG. 5, and a description thereof will be omitted.

In step S401, the image capturing unit 324 captures an image of the front surface of the identification card at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of capturing to the captured image. I do.

In step S402, the photographing unit 324 photographs an image on the back of the identification card at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of photographing to the photographed image. I do.

In step S403, the image capturing unit 324 captures an image of the side of the ID card at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of capturing to the captured image. I do.

In step S404, the image capturing unit 324 captures an image of the user's face at the timing when the shutter button is pressed (or touched), and adds position information indicating time information at the time of capturing to the captured image.

The processing procedure in step S405 is the same as the processing procedure in step S306 in FIG.

In step S406, the communication unit 322 transmits to the server 110 the user attribute information input in the processing procedure in step S400, the front, back, and side images of the identification card, and the image of the user's face.

In step S407, the authentication unit 325 of the server 110 sets the received user attribute information and
The identity verification process and the liveness confirmation process of the user are performed using the front, back, and side images of the identification card, the image of the user's face, and the current time.

First, the authentication unit 325 determines that the time information given to each of the front, back, and side images of the user's identification card and the time information given to the image of the user's face are within a predetermined range from the current time. Make sure it is included in

Next, the authentication unit 325 compares the image of the face portion included in the image of the identification card with the image of the face of the user, and confirms that the comparison result satisfies a predetermined matching criterion. Confirm that the person shown in the certificate and the user are the same person.

Next, the authentication unit 325 compares the attribute information of the user included in the image of the ID card with the attribute information of the user input to the terminal 120 by the user, so that the attribute information input by the user is Confirm that it matches the description of.

The authentication unit 325 determines that the time information given to each of the front, back, and side images of the user's ID card and the time information given to the user's face image are within a predetermined range from the current time. "And that the image of the face portion included in the image of the user's ID and the image of the user's face satisfy a predetermined matching criterion" and "the image of the user's ID That the attribute information of the user included in the file matches the attribute information of the received user ", the user is the service applicant (identity can be confirmed), and the image Is determined to have been taken on the spot (having liveness).

On the other hand, the processing procedure performed by the authentication unit 325 when any of the items cannot be confirmed is the same as that in the first embodiment or the third embodiment, and thus the description is omitted.

When the identity confirmation process and the liveness confirmation process are performed on the server 110 side, step S40
8 and step S409 are omitted, and when the personal identification processing is performed on the terminal 120 side, the steps S406 and S407 are omitted.

In step S408, the identity confirmation processing and liveness confirmation processing performed by the authentication unit 325 of the terminal 120 are the same as the identity confirmation processing and liveness confirmation processing performed by the authentication unit 316 of the server 110 in the processing procedure of step S407. Is omitted.

The processing procedure in step S409 is the same as the processing procedure in step S112 in FIG. 5, and a description thereof will be omitted.

<First Example of Fifth Embodiment>
In the fifth embodiment, in addition to comparing the time information given to the image with the current time, the position information given to the image is compared with the position information indicating the current position of the terminal 120. Then, the liveness may be confirmed.

For example, the photographing unit 324 of the terminal 120 adds position information at the time of photographing to the image of the front, back, and side surfaces of the photographed user's ID card and the image of the user's face, in addition to the time information. Is the position information indicating the current position of the terminal 120, the front, back, and side images of the user's identification card to which the position information and the time of shooting are added, and the position information and the time of shooting are added. The image of the user's face is transmitted to the server 110. Image receiving unit 31 of server 110
5 receives the image of the user's ID card to which the position information and the time at the time of shooting are added, and the image of the face of the user to which the position information and the time at the time of shooting are added.

In addition, in addition to comparing the time information, the authentication unit 316 of the server 110 determines the position information of the terminal 120, the position information given to the image of the user's ID card, and the position given to the image of the user's face. Based on the comparison result with the information, the user identity and liveness are confirmed. Specifically, the authentication unit 316 determines the position information of the terminal 120, the position information given to each of the front, back, and side images of the user's identification card, and the position given to the image of the user's face. When the information is within a predetermined range, it may be determined that the liveness has been confirmed. The term “within the predetermined range” may be, for example, without limitation, within 5 m or 10 m.

The first embodiment described above can also be applied when the authentication unit 325 of the terminal 120 performs identity verification and liveness confirmation.

1 communication system, 110 server, 120 terminal, 130 network, 200
Information processing apparatus, 201 processor, 202 memory, 203 storage, 204 input / output I / F, 205 communication I / F, 311 input / output section, 312 communication section, 313 selection section, 314 shooting guide transmission section, 315 image reception section, 316 authentication unit, 317 storage unit,
321 input unit, 322 communication unit, 323 display control unit, 324 imaging unit, 325 authentication unit, 326 storage unit, 327 position information measurement unit

Claims (10)

An information processing method executed by a second information processing device communicating with the first information processing device,
A receiving step of receiving, from the first information processing apparatus, a position identification information of the first information processing apparatus and a user identification image to which the position information at the time of shooting is added;
When the position information of the first information processing device and the position information given to the user identification image of the user are within a predetermined range, the identification image is approved as at least a part of the authentication of the user. And an authentication step. The identification image includes a moving image of a user identification document,
The receiving step further includes:
Receiving the attribute information of the user input by the user from the first information processing apparatus,
The authentication step further includes:
The method further includes the step of performing personal authentication of the user based on a comparison result between the received attribute information of the user and the received attribute information of the user included in the moving image of the received identification document of the user,
The information processing method according to claim 1. The identity verification image includes a moving image including a user's face,
The authentication step further includes:
The method further includes the step of performing personal authentication of the user based on a comparison result between the received moving image of the face included in the moving image of the user's identity verification document and the received moving image of the user's face,
The information processing method according to claim 2. The receiving step receives a moving image of the user identification document to which the time at the time of shooting is further added, and a moving image of the face of the user to which the time at the time of shooting is further added,
The authentication step, further, when the current time, the time given to the moving image of the user identification document, and the time given to the moving image of the user's face are within a predetermined range,
Authenticate the user,
The information processing method according to claim 3. In the first information processing device,
In response to the operation of the user, photographing a personal identification image of the user, a photographing step of adding position information indicating the position at the time of photographing to the photographed personal identification image of the user,
An obtaining step of obtaining position information of the first information processing apparatus;
A transmitting step of transmitting, to the second information processing apparatus, the acquired position information of the first information processing apparatus and a moving image of the user's identity verification document to which the positional information at the time of shooting has been added;
A program that executes The photographing step further adds the time of photographing to the photographed user's identity confirmation image,
The transmitting step further transmits an identification image of the user to which the time at the time of shooting is added to the second information processing apparatus.
The program according to claim 5. An information processing device that operates as a second information processing device that communicates with the first information processing device,
A receiving unit that receives, from the first information processing apparatus, a position identification information of the first information processing apparatus and a user identification image to which the position information at the time of shooting is added;
When the position information of the first information processing device and the position information given to the user identification image of the user are within a predetermined range, the identification image is approved as at least a part of the authentication of the user. An information processing apparatus comprising: an authentication unit that performs authentication. A second information processing device communicating with the first information processing device;
A receiving step of receiving, from the first information processing apparatus, a position identification information of the first information processing apparatus and a user identification image to which the position information at the time of shooting is added;
When the position information of the first information processing device and the position information given to the user identification image of the user are within a predetermined range, the identification image is approved as at least a part of the authentication of the user. Authentication step, and a program for executing the authentication step. An information processing device,
In response to the operation of the user, photographing a user identification image of the user, a photographing unit that adds position information indicating the position at the time of photographing to the photographed user identification image,
An acquisition unit that acquires position information of the information processing device;
An information processing apparatus comprising: a transmission unit configured to transmit, to another information processing apparatus, the acquired position information of the information processing apparatus and a moving image of the user identification document to which the position information at the time of shooting is added. An information processing method executed by a first information processing apparatus,
In response to the operation of the user, photographing a personal identification image of the user, a photographing step of adding position information indicating the position at the time of photographing to the photographed personal identification image of the user,
An obtaining step of obtaining position information of the first information processing apparatus;
A transmitting step of transmitting, to the second information processing apparatus, the acquired position information of the first information processing apparatus and a moving image of the user identification document to which the position information at the time of shooting has been added. Method.

Images