JP2018207294A - Device for verifying image information - Google Patents

Abstract

To provide a method capable of verifying authenticity of an attribute information such as a face photograph, a two-dimensional code, and/or a name only by reading a picture image appeared on the display with a digital ID card (picture image) displayable onto a display of a smart phone.SOLUTION: A method extracts characteristic values of low volume of data from a face photograph (the characteristic values including, for example, "positions of characteristic points of a face such as eyes, nose, and oral ends" and "a picture image only of eyes that is characteristic features of the face"), the characteristic values enabling the face photograph to be identified uniquely, embeds the characteristic values into a two-dimensional code as data for authenticity verification, thereby enables the two-dimensional code to be displayed, and enables the authenticity verification of a digital ID card (picture image).SELECTED DRAWING: Figure 1

Description

  The present invention relates to verification of image information and authentication technology based thereon.

  In general, ID cards are issued by printing attribute information such as a photo or name on a card such as an IC card or a plastic card. Recently, mobile devices such as smartphones have become popular. There is a request to use a mobile device that is always carried instead of the ID card.

  When the ID card is implemented on a mobile device, the attribute information such as face photo and name is digitized, and when the ID is proved, the data is displayed on the display of the mobile device and presented visually. A method of verifying the validity, a method of sending the data to a device to be verified through communication, and a method of mechanically verifying the validity of the identification data at the device to be verified can be considered. However, in the latter case, the mobile device often stores a variety of data in addition to the ID data, and inadvertently sends unnecessary data to the verification device. Is also possible. Therefore, there is a demand for a mechanism that can provide identification just by displaying an image of an identification card on a display as shown in the former.

  However, unlike conventional card-like ID card printing, it is easy to replace a face photo with another face photo in the case of digitized ID data. Even if displayed, it is difficult to detect the reprinted trace.

  Therefore, the face photo and the image of the two-dimensional code in which the data of the face photo are embedded are used as an identification card. When verifying the identity, the face photo is restored from the two-dimensional code and compared with the original face photo. A technique for making a determination has been proposed (Patent Document 1).

JP 2005-141626 A

  However, in the prior art, since the face photograph data itself is embedded in the two-dimensional code, there is a problem that the two-dimensional code becomes large. Usually, even face photo data that is large enough to be used as an ID card has a data amount of several kilobytes to several tens of kilobytes. Even if the data is compressed, the face photo data is embedded in the two-dimensional code. If the reader is able to recognize the resolution, depending on the amount of facial photo data, the 2D code will be up to about half of the A4 size, for example, and the 2D code cannot be displayed on the smartphone display. was there.

  Conversely, if you try to embed face photo data in a two-dimensional code that is large enough to be displayed on a smartphone display, it is necessary to reduce the amount of face photo data. There is a problem that it is difficult to confirm the correctness of a face photograph from a rough image.

  In order to solve the above-mentioned problems, we apply the technology used in biometric authentication, and feature values that can uniquely identify a face photo from face photo data (such as “facial feature point positions such as eyes, nose, mouth edge”) and “face And the like, and the feature values are embedded in the two-dimensional code.

  Then, when a face photograph and a two-dimensional code are displayed on the smartphone's display as the same screen and the image (which can be used as an ID card) is verified, it is displayed on the display with a photographing device such as a digital camera, WEB camera or scanner. The read image is read, the electronic signature is verified from the two-dimensional code in the displayed image, and it is determined whether the two-dimensional code is valid.

  In yet another invention, a camera subject is authenticated from a face image taken by an external camera or the like and a face photograph verified as valid.

  The feature of the present invention is that it is possible to verify the validity of an image (which can be used as an identification card) with a smaller amount of data compared to embedding facial photograph data in a two-dimensional code.

It is a figure which shows the system configuration example of this Embodiment 1. FIG. It is a figure which shows the hardware structural example of the issuing apparatus in this Embodiment 1 and 2, a verification apparatus, and a smart phone. It is a sequence diagram which shows the issuing process procedure of the digital ID in this Embodiment 1 and 2. It is a sequence diagram which shows the verification processing procedure of the digital identification in this Embodiment 1. FIG. It is the figure which displayed the verification result in the verification apparatus in this Embodiment 1. FIG. It is a figure (difference with FIG. 1) which shows the system configuration example of this Embodiment 2. It is a sequence diagram which shows the verification processing procedure of the digital identity certificate in this Embodiment 2, and the authentication processing procedure of the holder of a digital identity certificate. It is the figure which displayed the authentication result in the verification apparatus in this Embodiment 2 (difference with FIG. 5).

--- System configuration ---
Embodiment 1 of the present invention will be described below in detail with reference to the drawings.

  FIG. 1 is a diagram illustrating an example of the overall configuration of a digital identification system 1 according to the first embodiment. This figure also shows an example of the functional configuration of each computer constituting the digital identification system 1 together with the overall configuration. In the digital ID system 1 shown in FIG. 1, the issuing device 10 issues a digital ID (image data) 301 for the smartphone 30, and the verification device 20 displays the digital ID 301 displayed on the display of the smartphone 30. This is a system for reading the image of the image and determining the authenticity of the digital identification card 301 presented from the image.

  As shown in FIG. 1, the issuing device 10 manages a signature key SK104 for generating an electronic signature and a common key K105 for the verification device 20, and extracts a feature value from face photograph data. Encryption processing function 103 for data encryption and digital signature generation processing, two-dimensional code generation function 102 for generating a two-dimensional code, face photograph data 302, attribute information 303 such as name, and two-dimensional code 304 It can be constituted by an identification card molding function 101 for molding a digital identification card (image data) 301. The verification device 20 is connected to the image capturing device 21, and the verification device 20 manages a verification key PK 204 for verifying the electronic signature and a common key K 205 for the issuing device 10 and is displayed on the display of the smartphone 30. A data reading function 201 for reading the image of the digital identification card 301, a two-dimensional code reading function 202 for extracting the two-dimensional code portion 304 from the read image and decoding the two-dimensional code, and data decoding and electronic signature A cryptographic processing function 203 for performing verification processing, a character recognition function 206 for recognizing characters of attribute information 303 such as a name from the read image of the digital ID 301, a feature value embedded in a two-dimensional code, and the The face photo image 302 included in the image of the read digital ID card 301 is compared and verified. A matching function 207, or perform screen display in accordance with the verification results, it consists verification result processing function 208 or perform the switching instruction of the gate of the entering and leaving management. In addition, the smartphone 30 has a function of installing and storing the corresponding digital ID (image data) 301 obtained through a network or media delivery and displaying the digital ID 301 on a display as necessary.

  The issuing device 10, the verification device 20, and the smartphone 30 having such a function can be realized by a general information processing device 40 as illustrated in FIG. For example, the feature value extraction function 106, the cryptographic processing function 103, the two-dimensional code generation function 102, the identification card forming function 101 of the issuing device 10, the data reading function 201, the two-dimensional code reading function 202 of the verification device 20, and the cryptographic processing The function 203, the character recognition function 206, the matching function 207, and the verification result processing function 208 can be realized as a computer program executed by a CPU 405 such as a CPU (CENTRAL PROCESSING UNIT). For example, such a computer program can be stored and held in advance in a storage device 404 such as a hard disk, or can be distributed from a network and developed on the memory 403 for use.

  In addition, an instruction from a user who uses the digital identification system 1 is input by an input device 401 such as a keyboard, a mouse, or a touch panel that accepts input, and a processing result based on the instruction is displayed on a liquid crystal display device, It is output from an output device 402 such as an organic EL (ELECTRO LUMINESCENCE) display.

  These devices such as the issuing device 10, the verification device 20, and the smartphone 30 can be configured on the information processing device 40 connected by an internal communication line 406 (hereinafter referred to as a bus) such as a bus.

The image capturing device 21 connected to the verification device 20 is realized by a device such as a digital camera, a WEB camera, or a scanner.
--- Processing procedure example ---
Hereinafter, the procedure in the first embodiment will be described with reference to the drawings. Various operations described below are realized by programs that are read out from a memory or the like and executed by each device constituting the digital identification system 1.

  FIG. 3 is a sequence diagram illustrating a procedure for issuing the digital identification certificate 301 in the present embodiment.

  The face image data 302 of the person who is the holder of the digital identification certificate 301 is input to the issuing device 10, and the issuing device 10 can uniquely identify the face photo from the face photo data 302 by the feature value extraction function 106. Feature values ("face feature point positions of eyes, nose, mouth edge, etc." and "image cut out of only the eyes") having a relatively small amount of data are extracted (step S101). Then, the issuing device 10 encrypts the feature value using the common key K105 with the verification device 20 by using the cryptographic processing function 103 (step S102). Further, the attribute information 303 such as the name of the person who becomes the holder of the digital identification certificate 301 is input to the issuing device 10, and the issuing device 10 concatenates the attribute information 303 with the encrypted feature value (step S103). . Next, the issuing device 10 calculates an electronic signature value for the data obtained by concatenating the encrypted feature value and the attribute information 303 with the signature key SK104 of the issuing device 10, and data obtained by concatenating the encrypted feature value and the attribute information 303. (Step S104). Then, the two-dimensional code generation function 102 generates a two-dimensional code 304 by inputting the connected encrypted feature value, attribute information 303 and electronic signature data. That is, the concatenated data is two-dimensionally encoded (step S105). Then, the issuing device 10 arranges and forms the face photograph data 302, the attribute information 303, and the two-dimensional code 304 so as to be simultaneously displayed on the display of the smartphone by the identification card forming function 101 (step S106), and digital identification A document (image data) 301 is externally output (step S107).

  The smartphone 30 acquires the digital ID (image data) 301 via a network or media delivery (step S108), and stores the digital ID (image data) 301 in the storage device 404 of the smartphone 30 (step S108). S109).

  FIG. 4 is a sequence diagram showing a digital identification verification process procedure according to the first embodiment.

  The smartphone 30 displays the digital ID (image data) 301 stored in step S109 on the display of the smartphone 30 and presents it to the image capturing device 21 (step S200).

  The image capturing device 21 captures an image displayed on the display of the smartphone 30 (step S201), and the verification apparatus 20 acquires a screen image captured by the image capturing device 21 from the image capturing device 21 (step S202). The verification device 20 reads the two-dimensional code from the screen image acquired in step S202 by using the two-dimensional code reading function 202, and decodes the two-dimensional code (step S203). The decoded data is composed of encrypted feature values, attribute information, and electronic signature values, and the electronic signature is verified from these data using the encryption processing function 203 (step S204). If the signature verification fails, as shown in the upper left diagram of FIG. 5, for example, as shown in the upper left diagram of FIG. A message is displayed (step S205).

  If the signature verification is successful, the character relating to the attribute information 303 is recognized from the screen image acquired in step S202 using the character recognition function 206, and compared with the attribute information decoded in step S203 (step S206). If the two pieces of information do not match, for example, as shown in the upper right diagram of FIG. 5, there is an error in the attribute information 303 portion of the digital identification certificate 301 on the display of the verification device 20 and the attribute information is misrepresented. And correct attribute information is displayed (step S207).

  If the attribute information matches, the encryption processing function 203 decrypts the encrypted feature value decoded in step S203 with the common key K205 (step S208), and the decrypted feature value and the face image of the screen image acquired in step S202. The part is compared and verified using the matching function 207, and it is verified whether or not the feature value is data extracted from the face photograph (step S209). The matching function 207 represents the correlation between the face photograph and the feature value as a numerical value. When the matching rate between the face photograph and the feature value is equal to or less than the threshold value, for example, as shown in the lower left diagram of FIG. Display that the face photo 302 of the digital ID card 301 is illegal and that the face photo has been forged (step S210).

  When the matching rate between the face photograph and the feature value is equal to or greater than the threshold value, the authentic result processing indicates that the digital ID 301 is correct on the display of the verification device 20 as shown in the lower right diagram of FIG. It is displayed (step S210).

  Embodiment 2 of the present invention will be described below in detail with reference to the drawings. The second embodiment is implemented in addition to the first embodiment.

  FIG. 6 is a diagram (difference from FIG. 1) illustrating an example of the overall configuration of the digital identification system 2 in the second embodiment. In the second embodiment, the verification device 20 is also connected to the person photographing device 22, and the face photograph 302 and the images / images photographed by the person photographing device 22 are used via the face authentication function 209 used in biometric authentication. This is a system for verifying whether or not the person who presented the digital identification card 301 is the correct holder. The person photographing device 22 connected to the verification device is realized by a device such as a digital camera or a WEB camera.

  In the second embodiment, a digital identification certificate 301 is issued as in the first embodiment.

  FIG. 7 is a sequence diagram illustrating a digital identification certificate verification processing procedure and a digital identification certificate holder authentication processing procedure according to the second embodiment. The processes up to step S210 are the same as those in the first embodiment.

  The person photographing device 22 photographs the person who presented the digital identification card 301 (step S301), and the verification apparatus 20 acquires the person image photographed in step S301 from the person photographing device 22 (step S302). Then, the verification apparatus 20 compares and verifies the face photo data determined to be authentic in step S209 and the human image data acquired in step S301 using the face authentication function 209, and the person who presented the digital identification card 301 is correct. It is verified whether or not it is a holder (step S303). The face authentication function 209 expresses the correlation between the face photograph and the person image as a numerical value, and when the matching rate between the face photograph and the person image is equal to or less than a threshold value, for example, as shown in the upper diagram of FIG. Is displayed on the display of that the face photo 302 of the digital ID card 301 does not match the face of the person who presented the digital ID card 301 (step S304).

  When the matching rate between the face photograph and the person image is equal to or higher than the threshold value, as the authentic result processing, for example, as shown in the lower diagram of FIG. 8, the digital ID 301 is authentic and the digital ID 301 is displayed on the display of the verification device 20. It is displayed that the face of the presented person matches (step S305).

DESCRIPTION OF SYMBOLS 1 Digital ID system 2 Digital ID system 10 Issuing device 20 Verification device 21 Image photographing device 22 Human photographing device 30 Smartphone 40 Information processing device 101 Identification card forming function 102 Two-dimensional code generation function 103 Encryption processing function 104 Signature Key SK
105 Common key K
106 Feature value extraction function 201 Data reading function 202 Two-dimensional code reading function 203 Cryptographic processing function 204 Verification key PK
205 Common key K
206 Character Recognition Function 207 Matching Function 208 Verification Result Processing Function 209 Face Authentication Function 301 Digital Identification Card 302 Face Photo 303 Attribute Information 304 Two-dimensional Code 401 Input Device 402 Output Device 403 Memory 404 Storage Device 405 CPU (CENTRAL PROCESSING UNIT)
406 bus

Claims (10)

An extraction unit that reads an image and extracts an identifier image and a face image from the image;
An identifier image verification unit for verifying the identifier image from the electronic signature included in the identifier image;
An image verification unit that compares the first feature value information extracted from the face image and the second feature value information included in the identifier image to verify the authenticity of the image information;
An image information verification apparatus comprising: In the image information verification apparatus according to claim 1,
The extraction unit further extracts an attribute information image related to the face image from the image,
The image verification unit further compares the attribute information included in the identifier image with the extracted attribute information image to verify the authenticity of the image information. In the image information verification apparatus according to claim 2,
The image information verification apparatus according to claim 1, wherein the first feature value and the second feature value are information relating to a feature point position of a face. In the image information verification apparatus according to claim 3,
Furthermore, the image information verification apparatus characterized by including the display part which displays the result of the said verification. An authentication system comprising the image information verification device according to claim 4 and a photographing device,
The image information verification device further includes an authentication unit that compares a photographed image photographed by the photographing device with the face image and authenticates a subject photographed by the photographing device. Authentication system. In the authentication system according to claim 5,
The authentication unit is characterized in that the photographed image and the face image are compared using a feature value. In the authentication system according to claim 6,
The authentication system further comprises a gate for performing processing according to the result of authentication of the target. In the authentication system according to claim 7,
The authentication system, wherein the identifier image is created by encrypting the second feature value with a public key. An image reading step for reading an image;
An extraction step of extracting an identifier image and a face image from the image;
An identifier image verification step for verifying the identifier image from the electronic signature included in the identifier image;
An image verification step of comparing the first feature value information extracted from the face image and the second feature value information included in the identifier image to verify the authenticity of the image information;
An image information verification method comprising: An image reading step for reading an image;
An extraction step of extracting an identifier image and a face image from the image;
An identifier image verification step for verifying the identifier image from the electronic signature included in the identifier image;
An image verification step of comparing the first feature value information extracted from the face image and the second feature value information included in the identifier image to verify the authenticity of the image information;
An authentication step of comparing a photographed image photographed by a photographing device with the face image and authenticating a subject photographed by the photographing device;
An authentication method comprising:

Images