JP7193570B2 - Terminal device, method and program - Google Patents

Description

The present disclosure relates to a terminal device, method, and program capable of determining the authenticity of a plastic card.

According to the Act on Prevention of Transfer of Criminal Proceeds, which was revised in November 2018, completing identity verification online (so-called eKYC (electronic Know Your Computer)) is now permitted. In eKYC, the image of the identity verification document with a photo (for example, driver's license, my number card, etc.) must be able to confirm the "thickness and other characteristics" of the identity verification document. "Thickness and other characteristics" is for confirming the authenticity (that is, whether or not the identity verification document is genuine) from the features such as the external shape of the identity verification document. For example, in order to confirm the thickness of the identity verification document, an image of the identity verification document photographed at an oblique angle is used.

In Patent Document 1, in order to improve the accuracy of determining the thickness of a personal identification document, a moving image of the personal identification document changing direction is acquired, the thickness is analyzed, and the thickness meets a predetermined condition. Techniques for determining whether or not the conditions are satisfied are disclosed.

Japanese Patent Application Laid-Open No. 2020-201693

However, the above-described method requires the user to take an image so that the thickness of the personal identification document can be confirmed, which is a burden for the user who is unfamiliar with operating the terminal device.

The present disclosure has been made in view of such problems, and aims to provide a terminal device, method, and program for determining the authenticity of a plastic card that can reduce the user's work load. and

According to one embodiment, a terminal device for judging the authenticity of a plastic card includes acquisition means for acquiring image data of a photographed image of the plastic card photographed with a flash; determining means for determining the authenticity of the plastic card, wherein the authenticity means whether or not the captured image is a captured image of the genuine plastic card.

Further, according to one embodiment, a method for determining the authenticity of a plastic card includes an obtaining step of obtaining image data of a photographed image of the plastic card in which the plastic card is photographed with a flash; a determining step of determining the authenticity of the plastic card based on, wherein the authenticity means that the captured image is an image of the genuine plastic card .

Advantageous Effects of Invention According to the present disclosure, it is possible to provide a terminal device, a method, and a program for determining the authenticity of a plastic card that can reduce the user's workload.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure explaining the outline|summary of the authenticity determination system which concerns on one Embodiment. 2A and 2B are a rear view and a front view of a terminal device according to an embodiment; FIG. It is a figure explaining the authenticity determination process which concerns on one embodiment. It is a figure which shows the example of the captured image which concerns on one Embodiment. It is a figure which shows the hardware structural example of the terminal device which concerns on one Embodiment. It is a figure which shows the functional structural example of the terminal device which concerns on one Embodiment. 6 is a flowchart of authenticity determination processing according to one embodiment. 4 is a flowchart showing details of authenticity determination processing according to an embodiment.

Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals are given to the same elements throughout the specification and the attached drawings, and duplicate descriptions are omitted.

(system overview)
FIG. 1 is a diagram illustrating an outline of an authenticity determination system according to one embodiment.

In the authenticity determination system, a user first uses a terminal device 101 to photograph a plastic card 102, which is an original copy of a personal identification document with a photograph (for example, a driver's license, My Number card, etc.). At that time, the terminal device 101 operates in a flash mode in which a flash emits light when photographing, and performs flash photographing of the plastic card 102 . Note that the terminal device 101 may also perform photography without a flash, and acquire a captured image with a flash and a captured image without a flash. Also, if the terminal device 101 is not set to the flash mode at the time of shooting, the application running on the terminal device 101 may automatically set the flash mode. A user's face photograph or the like is printed on the plastic card 102, and the plastic card 102 is made of a material that reflects strong light such as a flash of a camera. In the following, the personal identification document with a photograph is also simply referred to as the personal identification document.

Next, the terminal device 101 performs authenticity determination processing for the plastic card 102 using the image data of the captured image taken with the flash. Authenticity means whether or not the captured image is a captured image of a genuine plastic card. Details of the authenticity determination process will be described later.

Next, the terminal device 101 transmits the image data of the captured image taken with the flash and the authenticity determination result to a predetermined server 103 (that is, a server managed by a company using eKYC) via the network 104 . The predetermined server 103 does not limit the transmission destination, and may be a server managed by a company that has a cooperative relationship with the user company. The terminal device 101 includes a small antenna and a communication module (not shown), accesses the network 104 by wireless communication, and can transmit and receive data. Wireless communication may be performed via a LAN (Local Area Network), or may be performed via a mobile phone line such as 3G, 4G (LTE), or 5G (NR). Network 104 may be, for example, the Internet. It should be noted that the terminal device 101 does not have to transmit the determination result of authenticity to the predetermined server 103, and may simply display the determination result of authenticity on the display device to notify the user. The user may repeatedly photograph the plastic card 102 until the judgment result is OK (that is, until it is judged that the photographed image is of a genuine plastic card 102).

FIG. 2 shows (a) a rear view and (b) a front view of the terminal device 101 according to one embodiment. As shown in FIG. 2A, the terminal device 101 has a rear camera 201 that is an imaging device and an LED light 202 that is a light emitting device that can operate as a flash. The terminal device 101 also has a speaker 211, a display 212, and operation buttons 213, as shown in FIG. 2(b). The terminal device 101 may also include a front camera, a microphone, a volume button, a connector, etc. (not shown). Although FIG. 2 shows the terminal device 101 as a smart phone or a tablet terminal, the terminal device 101 is not limited to this, and may be another device such as a notebook PC (Personal Computer).

FIG. 3 is a diagram illustrating authenticity determination processing according to an embodiment. 3A shows an example of a captured image 301 acquired by the terminal device 101, and FIG. 3B shows a schematic diagram 303 of the captured image 301. FIG. The authenticity determination processing includes blown-out area determination processing and square determination processing, as described below.

(Brightness area determination processing)
A photographed image 301 in FIG. 3A is an image obtained by photographing a driver's license as a personal identification document with a flash. As illustrated, a captured image 301 has an overexposed area 302 due to the flash. Brightness is 255 (maximum value), gradation is lost, and the area is displayed white. Overexposure tends to occur when shooting with a flash or the like that irradiates strong light. A schematic diagram 303 in FIG. 3B shows an overexposed area 304 .

Specifically, the terminal device 101 acquires the brightness of each pixel from the image data of the captured image 301, and determines whether there is a blown-out area 302 where the brightness value is equal to or greater than a predetermined value (for example, the maximum value). Judge whether. Here, the terminal device 101 may determine whether or not the overexposed area 302 of a predetermined size (area) exists.

(Square determination process)
The terminal device 101 also determines whether or not the square 305 of the driver's license image included in the captured image can be confirmed, as shown in the schematic diagram 303 of FIG. 3B. Specifically, it is determined whether or not the brightness of the image obtained from the image data of the captured image, excluding the overexposed area, is within a predetermined range. For the determination, for example, the average value of the brightness of the pixels in the area excluding the overexposed area may be used. If the brightness of the image, excluding overexposed areas, is too bright or too dark, the captured image is not in a state in which the square (i.e., outline) of the identity verification document can be seen, and the plastic card that is the original of the identity verification document is photographed. It is determined that the image is not a

In this way, the terminal device 101 detects that the captured image has a blown-out area and that the brightness of the image excluding the blown-out area is within a predetermined range. It is determined that the image is a photographed image of a card. A captured image that can be determined in this way is treated as one in which the “thickness and other characteristics” in eKYC have been confirmed.

The terminal device 101 transmits the above-described authenticity determination result and image data to a predetermined server for the user company. After transmitting the authenticity determination result and the image data to the predetermined server, the terminal device 101 deletes them from the storage device of the terminal device 101 so that they do not remain in the terminal device 101 . Especially, since the image data includes the user's personal information, the leakage of the personal information is prevented by deleting the image data from the storage device. It should be noted that the terminal device 101 does not have to transmit the determination result of authenticity to the predetermined server 103, and may simply display the determination result of authenticity on the display device to notify the user. The user may repeatedly photograph the plastic card 102 until the judgment result is OK (that is, until it is judged that the photographed image is of a genuine plastic card 102).

(Specific example of captured image)
FIG. 4 shows an example of a captured image according to one embodiment. FIG. 4(a) shows an example of an image of a plastic card that is the original of a driver's license (that is, a real one), and FIG. 4(b) shows an image of a driver's license printed on paper. An example (that is, camouflage) is shown, and FIG. 4(c) shows an example (that is, camouflage) of a photographed image of a driver's license displayed on a monitor.

As shown in FIG. 4A, an image of a plastic card, which is the original of a driver's license, has whiteout areas and squares can be seen. be judged.

As shown in FIG. 4(b), the image of a driver's license printed on paper does not have a blown-out area, so it is determined that the image is a camouflaged image of a genuine (plastic card) driver's license. be.

As shown in Fig. 4(c), the image of the driver's license displayed on the monitor has a whiteout area, but the brightness of the image excluding the whiteout area is dark, and the square of the driver's license is confirmed. Therefore, it is determined that the image is a camouflaged image of the real thing (plastic card).

(Hardware configuration of terminal device)
FIG. 5 shows a hardware configuration example of a terminal device according to an embodiment. The terminal device 101 includes a processor 501 , a memory 502 , an input device 503 , a display device 504 , an imaging device 505 , a light emitting device 506 and a communication interface (I/F) 507 .

The processor 501 is a CPU (Central Processing Unit), controls each component connected via the bus 508, and processes data. The processor 501 also reads and executes programs stored in the memory 502, thereby executing various processes according to the present embodiment.

The memory 502 may include storage devices such as ROM (Read Only Memory), RAM (Random Access Memory), HDD (Hard Disk Drive), and SDD (Solid State Drive), and executes various processes according to the present embodiment. Stores programs and data for In this embodiment, the memory 502 can store image data of captured images, authenticity determination results, and the like.

The input device 503 can be buttons and switches provided on the terminal device 101, a touch panel display that also serves as the display device 504, or the like. The user can operate the terminal device 101 using the input device 503, and can take flash photography of the personal identification document.

The display device 504 can be a liquid crystal display or an organic EL (Electro Luminescence) display.

The imaging device 505 is a camera including a lens and an image sensor, generates a captured image as image data, and stores it in the memory 502 .

The light emitting device 506 includes an LED (Light Emitting Diode) light and the like, and operates in conjunction with the imaging device 505 to emit light and enable flash photography. A shooting mode in which the terminal device 101 performs flash shooting is also referred to as a flash mode. It can also be used as a simple light.

A communication interface (I/F) 507 is an interface for connecting to a network such as a wireless LAN or a mobile phone line to transmit and receive data, and enables communication with other terminal devices and servers. The communication I/F 507 may include a small antenna and communication module (not shown).

Note that the hardware configuration of the terminal device 101 is not limited to the configuration described above, and may include other elements.

(Functional configuration of terminal device)
FIG. 6 shows a functional configuration example of a terminal device according to one embodiment. The terminal device 101 includes an imaging unit 601 , an acquisition unit 602 , a determination unit 603 , a transmission unit 604 , a deletion unit 605 and a setting unit 606 . Each functional unit is implemented by the processor 501 of the terminal device 101 reading and executing a program stored in the memory 502 . For example, each functional unit may be implemented as a function of a software application installed in the terminal device 101. FIG.

The imaging unit 601 captures an image of the identity verification document using the imaging device 505 and stores the generated image data in the memory 502 . The imaging unit 601 operates in the flash mode of the terminal device 101 and performs flash photography using the light emitting device 506 . At this time, shooting without a flash may also be performed continuously. The flash mode is an operation mode provided in the terminal device 101, and means an operation mode in which a flash is emitted when the imaging unit 601 performs imaging.

The acquisition unit 602 acquires the image data of the captured image stored in the memory 502 .
The determination unit 603 uses the acquired image data to perform authenticity determination processing of the personal identification document (that is, the plastic card). Specifically, as the authenticity determination process, the whiteout area determination process and the square determination process described above are performed.

The transmission unit 604 transmits the image data 611 of the captured image and the authenticity determination result 612 to the predetermined server 103 .

A deletion unit 605 deletes the image data of the captured image and the authenticity determination result stored in the memory 502 .

The setting unit 606 automatically sets the terminal device 101 to the flash mode when the terminal device 101 is operating according to the software application for personal identification according to the present embodiment. By doing so, even if the user takes a picture of the personal identification document without setting the flash photography, flash photography can be automatically performed, so that active operations by the user can be reduced.

Note that the functional configuration of the terminal device 101 is not limited to the configuration described above, and may include other functions.

(Authenticity determination processing)
FIG. 7 shows a flowchart of an authenticity determination process according to one embodiment. Each step of the flowchart is executed by the processor 501 of the terminal device 101 reading and executing the program stored in the memory 502 . In the following description, the symbol "S" means step. The same applies to the flowchart of FIG. 8, which will be described later.

First, in S701, the imaging unit 601 of the terminal device 101 takes flash photography of a plastic card, which is the original of the personal identification document. Image data of the captured image is stored in the memory 502 .

Next, in S<b>702 , the acquisition unit 602 of the terminal device 101 acquires the image data of the captured image stored in the memory 502 . When image data of a plurality of captured images are stored in the memory 502, the user may select image data to be acquired via the input device 503. FIG.

Next, in S703, the determination unit 603 of the terminal device 101 performs authenticity determination processing of the personal identification document using the acquired image data.

FIG. 8 is a flowchart illustrating details of authenticity determination processing according to one embodiment.

First, in S801, the determination unit 603 acquires the brightness of each pixel of the image data. Brightness is generally represented by a value between 0 and 255, with higher values indicating brighter. Pixels with the maximum lightness value of 255 are displayed in white, and the gradation of the image in the area formed by these pixels is lost. This is called whiteout.

Next, in S802, the determination unit 603 determines whether or not there is an area (that is, an overexposed area) whose lightness is equal to or greater than a predetermined value (for example, maximum value). Here, the determination unit 603 may determine whether or not a blown-out area of a predetermined size (area) exists in the captured image. If there is a whiteout area, proceed to S804; otherwise, proceed to S803. In S803, the result of determination of authenticity is stored as False in the memory 502, and the determination process ends.

In S804, the determination unit 603 determines whether the brightness of areas other than the whiteout area is within a predetermined range based on the brightness acquired in S801. If it is within the predetermined range, it is determined that the square of the personal identification document included in the captured image can be confirmed. If it is within the predetermined range, proceed to S805; otherwise, proceed to S803. In S803, the result of determination of authenticity is stored as False in the memory 502, and the determination process ends.

In S805, the determination unit 603 stores the determination result of authenticity as True in the memory 502, and ends the process. That is, the personal identification document included in the captured image is determined to be genuine (plastic card).

Returning to FIG. 7 , in S<b>704 , the transmission unit 604 of the terminal device 101 transmits the image data of the captured image and the authenticity determination result to the predetermined server 103 . It should be noted that the terminal device 101 does not have to transmit the determination result of authenticity to the predetermined server 103, and may simply display the determination result of authenticity on the display device to notify the user. The user may repeatedly photograph the plastic card 102 until the judgment result is OK (that is, until it is judged that the photographed image is of a genuine plastic card 102).

Next, in S<b>705 , the deletion unit 605 of the terminal device 101 deletes the image data of the captured image and the determination result from the memory 502 . In particular, since the personal identification document contains personal information, the image data is deleted so as not to leak the personal information from the terminal device 101 .

As described above, according to the embodiments of the present disclosure, it is possible to determine the authenticity of a plastic card, which is the original of a personal identification document, using a flash image. Therefore, according to the embodiments of the present disclosure, it is possible to provide a terminal device, a method, and a program for determining the authenticity of a plastic card that can reduce the user's workload.

In addition, in the conventional method of checking the thickness of a plastic card, if the resolution of the camera of the terminal device is low and the thickness cannot be measured from the captured image, it is necessary for the person in charge to visually check the thickness. As a result, administrative costs for the work of the person in charge were incurred, and real-time identity verification was also difficult. According to the embodiment of the present disclosure, since the influence of the resolution of the captured image is small, it is possible to reduce the clerical cost due to the work of the person in charge and to enable real-time personal identification. In addition, although the above-described embodiment describes an application to eKYC as an example, the embodiment of the present disclosure is not limited to this.

101 terminal device 103 server 601 imaging unit 602 acquisition unit 603 determination unit 604 transmission unit 605 deletion unit 606 setting unit 611 image data 612 determination result

Claims (7)

A terminal device for determining the authenticity of a plastic card,
an acquisition means for acquiring image data of an image of the plastic card photographed with a flash;
Determining means for determining the authenticity of the plastic card based on the brightness of the captured image, wherein the authenticity means whether the captured image is an image of the genuine plastic card. determination means;
with
The determination means determines whether or not a blown-out area exists in the captured image, and whether or not the brightness of an area other than the blown-out area is within a predetermined range, and the presence of the blown-out area; A terminal device , wherein the plastic card is determined to be genuine when the brightness of the other area is within a predetermined range . 2. The terminal device according to claim 1 , wherein the whiteout area is an area of a predetermined size. 3. The terminal device according to claim 1, further comprising setting means for automatically setting a flash mode for performing flash photography. 4. The terminal device according to any one of claims 1 to 3 , wherein the plastic card is an original of an identification document. 5. The terminal device according to any one of claims 1 to 4 , further comprising deletion means for deleting the acquired image data and the authenticity determination result from a storage device. A method for determining the authenticity of a plastic card, said method being executed by a terminal device,
an acquiring step of acquiring image data of an image of the plastic card photographed with a flash;
a determining step of determining the authenticity of the plastic card based on the brightness of the captured image, wherein the authenticity means that the captured image is a captured image of the genuine plastic card; a step;
including
The determining step includes a step of determining whether or not a blown-out area exists in the captured image, and a step of determining whether or not brightness of areas other than the blown-out area is within a predetermined range. A method , wherein the plastic card is determined to be genuine when there is a jump area and the brightness of the other area is within a predetermined range . A program for causing a terminal device to execute the method according to claim 6 .

Images