JP6711994B1 - ID card and manufacturing method thereof, ID card issuing device and system, and face authentication device and system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable face authentication of a user by using an ID card for user identification, and to use at most each registered user without using a server for storing authentication data. Provided is an ID card issuing device or the like that can suppress an increase in time required for face authentication of a user. The ID card issuing device is an ID card issuing device used for issuing an ID card for user identification by processing an IC card having a communication function with the outside and a memory. Feature data representing information about a plurality of feature points extracted from the image containing the face of the user is generated based on image data representing the image containing the face of the user, and the feature data and the user are identified. A data processing unit that creates an identification data file containing information and a write control unit that generates a write command for storing the identification data file in the memory of the IC card. [Selection diagram] Figure 1

Description

The present invention relates to an ID card used for identifying a user in entrance/exit management in a facility or settlement in a financial institution, and a method for manufacturing the ID card. The present invention also relates to an ID card issuing device and an ID card issuing system used for issuing an ID card. Furthermore, the present invention relates to a face authentication device used for performing face authentication of a user using an ID card, a face authentication system, and the like.

For example, in entry/exit management at facilities and payments at financial institutions, an ID card was used to allow only pre-registered people to enter and exit, or to allow only pre-registered people to operate terminals. The identity is being verified. However, when the identification information is read from the ID card or the user is prompted to enter the personal identification number, the identity verification becomes insufficient, and there is a high possibility that fraud will occur due to so-called impersonation.

Therefore, fingerprint authentication or vein authentication is also used for personal identification. In that case, for example, it is conceivable to connect the server to an authentication device equipped with a fingerprint sensor or a vein sensor via a network and store the authentication data of all users in the server in advance. However, the size of the structure becomes larger and the price becomes higher. In addition, fingerprint authentication and vein authentication are possible even in the state of intoxication and unconsciousness, so there is a problem in expressing the intention of the person if the characteristics of the fingerprint or vein are the same as those registered. ..

As a related technique, in Patent Document 1, there is a time and attendance management system that saves the time at the time of an embossing operation by a user's embossing operation. A work attendance system capable of suppressing the time is disclosed. This attendance management system includes a collation data holding unit that holds face image information and personal information of a plurality of users as collation data in advance, a camera for photographing the face of an engraver, and image information photographed by this camera. The collating means for collating the collation data held in the collation data holding means and the collation data held in the collation data holding means can be selected and operated by the hacker if the collation data is not judged to be correct by the collating means. When the user selection means displayed in the state and the verification means determine that the verification is correct, or when the user selection means performs a selection operation, it is possible to emboss, and the engraved timekeeping data is determined to be correct. And an engraving registration means for registering as engraving data together with the collation data or the collation data selected by the user selecting means.

Further, Patent Document 2 discloses an employment management device that is capable of preventing impersonation operations by a person other than the person himself/herself by using a simple and inexpensive structure. This employment management device is provided with a worker information input section for reading card information unique to a worker from an ID card unique to the worker when a stamping operation is performed by the worker, and reads the ID card. An engraving operation section is provided with an engraving operation section for inputting card information that constitutes embossing information according to the engraving operation together with the engraving time when the card information is read, and a recording section for recording the engraving information. There is.

Here, the recording unit records face detection necessity information indicating whether or not the face image of the worker is required to be detected during the embossing operation, as the worker information capable of identifying the worker corresponding to the unique card information. doing. When the face detection necessity information indicates that the worker who performed the embossing operation needs to detect the face, the employment management device captures an image at the time of embossing of the worker who performed the embossing operation in the embossing operation unit, and When the embossing information is recorded in the recording unit through the face image detection processing and the face detection necessity information indicates that detection is not necessary, the embossing information is taken without performing the image embossing image and the face image detection processing. Is recorded in the recording section.

JP, 2006-48326, A (paragraph 0006-0012, Drawing 1, Drawing 3). JP, 2018-195345, A (paragraph 0010-0011, Drawing 1-Drawing 3).

According to Japanese Patent Application Laid-Open No. 2004-284, the matching unit determines that the matching is correct when the matching score obtained by matching the image information captured by the camera with the matching data held in the matching data holding unit is equal to or more than a threshold value. Since the embossing is permitted, it is possible to prevent the improper embossing by another person. If it is not determined that the collation is correct, a plurality of collation data are displayed and the stamper is allowed to select the data, and the selected collation data is also registered as the stamp data. It can be carried out.

However, the face matching in Patent Document 1 identifies an individual from the facial features in a face image captured by a camera, and identifies one user among the users registered in the matching data holding unit ( Paragraph 0023). Since detailed face image information is required to perform such collation, the amount of collation data becomes large, which requires time for collation, and it is also complicated to identify the person when collation fails. Further, since it is necessary to store the face image information of all the users and the personal information in advance in the collation data holding means, the correspondence relationship between the face image information and the personal information may be confused.

On the other hand, in Patent Document 2, when the face detection necessity information indicates that the worker who performed the embossing operation needs to be detected, the embossed image of the worker is captured and recorded by the face image detection process. Therefore, when another person who performs the engraving operation by impersonation improperly performs the engraving, the image at the time of engraving of the other person is recorded. However, since face recognition is not performed at the time of stamping by a worker, the manager of the employment management device must then check the recorded stamping time image to find an illegal stamp (paragraph 0014). ).

Therefore, in view of the above points, a first object of the present invention is to enable face authentication of users by using an ID card for user identification, and to store authentication data of all users in advance. An object of the present invention is to provide an ID card that can suppress an increase in the time required for face authentication of each user even if the number of registered users is large, without using a server for storing the information.

A second object of the present invention is to prevent a mistake in the correspondence relationship between face image information and identification information when storing face image information and identification information of a plurality of users to be registered. Is. Further, a third object of the present invention is to perform such an ID card manufacturing method, an ID card issuing device and system used for issuing an ID card, and perform face authentication of a user using the ID card. It is to provide a face authentication device and system used for this purpose.

In order to solve at least one of the above problems, an ID card according to a first aspect of the present invention is an ID card for user identification including an IC chip , and (a) an image including a user's face. It is data including feature data representing information on a plurality of feature points extracted from the user identification information and the user identification information, and is encrypted by using a unique ID code assigned to the IC chip as an encryption key. A memory for storing an identification data file containing the data; and (b) a communication unit for transmitting the identification data file to the outside by communicating with the outside by a contact method or a non-contact method. Here, a card image including an image of the user's face or identification information may be printed on the surface of the ID card.

An ID card manufacturing method according to a second aspect of the present invention is a method of manufacturing an ID card for user identification by processing an IC card including an IC chip and having a function of communicating with the outside and a memory. Then, based on the image data representing the image including the face of the user, the feature data representing the information about the plurality of feature points extracted from the image including the face of the user is generated, and is added to the IC chip. Step (a) of encrypting data including the characteristic data and the identification information of the user by using a unique ID code as an encryption key, and creating an identification data file including the encrypted data; Storing the file in the memory of the IC card (b).

An ID card issuing device according to a third aspect of the present invention is used for issuing an ID card for user identification by processing an IC card including an IC chip and having a function of communicating with the outside and a memory. An ID card issuing device according to claim 1, wherein feature data representing information about a plurality of feature points extracted from the image including the face of the user is generated based on image data representing the image including the face of the user, Data processing for encrypting data including the characteristic data and the identification information of the user by using a unique ID code assigned to the IC chip as an encryption key, and creating an identification data file including the encrypted data And a write control unit that generates a write command for storing the identification data file in the memory of the IC card.

A face authentication device according to a fourth aspect of the present invention is a face authentication device used for performing face authentication of a user by using an ID card including an IC chip, and an ID card presented by the user. Based on an output signal of the communication unit and a communication unit that communicates between each other in a contact method or a non-contact method, the ID card is detected, and the ID card is extracted from an image including a registered user's face. An identification data file including characteristic data representing information on a plurality of generated characteristic points and the registered identification information of the user , and a unique ID code given to the IC chip, and the ID code is encrypted. A data reading unit that decrypts data including the characteristic data and the identification information of the user by using as a key, and an image taken when presenting the ID card when the ID card is detected by the data reading unit. An image data capturing unit that captures image data representing an image including the captured user's face, and is extracted from the captured image containing the user's face based on the image data captured by the image data capturing unit. By comparing the characteristic data generated by the characteristic data generation processing unit that generates characteristic data representing information on a plurality of characteristic points with the characteristic data of the identification data file, matching between the two is performed. A matching determination processing unit that generates a score indicating a degree and determines whether the photographed user matches the registered user based on the score.

According to the present invention, feature data representing information about a plurality of feature points extracted from an image including a face of a user is used as face image information, so that the amount of data is significantly reduced and the face image information is ID. It can be stored in the memory of the card. As a result, it is possible to use the ID card for user identification to authenticate the user's face, and to use the registered usage without using the server for pre-storing the authentication data of all users. Even if the number of users is large, it is possible to suppress an increase in the time required for face authentication of each user.

Further, by storing the feature data and the identification information in the memory of the ID card in association with each other from the time of creating the identification data file, when the face image information and the identification information of a plurality of users to be registered are stored, It is possible to prevent the mistaken correspondence between the face image information and the identification information. In addition, by using the unique ID code assigned to the IC chip as an encryption key to encrypt the characteristic data and the user identification information, it is possible to prevent the ID card from being copied (illegal copy). Further, according to the present invention, it is possible to provide an ID card issuing system for issuing the above ID card and a face authentication system for performing face authentication of a user using the above ID card.

The block diagram which shows the structural example of the ID card issuing system which concerns on one Embodiment of this invention. The schematic diagram which shows the structural example of the ID card which concerns on one Embodiment of this invention. FIG. 3 is a block diagram showing a configuration example of an IC chip used in the ID card shown in FIG. 2. 3 is a flowchart showing an ID card manufacturing method according to an embodiment of the present invention. The block diagram showing the example of composition of the face recognition system concerning one embodiment of the present invention.

Embodiments of the present invention will be described below in detail with reference to the drawings. In addition, the same components are denoted by the same reference numerals, and duplicate description will be omitted.
<ID card issuing system>
First, an ID card issuing system for issuing an ID card for user identification will be described. FIG. 1 is a block diagram showing a configuration example of an ID card issuing system according to an embodiment of the present invention. As shown in FIG. 1, this ID card issuing system includes an ID card issuing device 10, a photographing device 21, a scanner 22, and an output device 30.

The ID card issuing device 10 includes, for example, a display 11, an operating unit 12, an interface 13, a CPU (central processing unit) 14, a memory 15, and a recording unit 16, and has a communication function with the outside and It is used to process an IC card having a memory and issue an ID card for user identification. The interface 13 to the recording unit 16 are connected to each other via a bus line.

The display 11 is composed of, for example, an LCD display, and displays an operation screen, an image of the face of the user, and the like. The operation unit 12 includes, for example, a keyboard and a mouse, and is used to input various commands and data to the ID card issuing device 10. The interface 13 is connected to the display 11, the operation unit 12, the photographing device 21, the scanner 22, and the output device 30, and transmits various commands and data between these devices and the CPU 14. The interface 13 may be connected to a host system such as a personnel system or a school system via a network such as the Internet.

The CPU 14 performs various calculations and data processing in accordance with software recorded in the recording unit 16 (including image processing software that generates characteristic data based on image data). The memory 15 is composed of, for example, a RAM (random access memory) or the like, and temporarily stores various data supplied from the interface 13, data generated or processed by the CPU 14, and the like.

The recording unit 16 records various data used for image processing and the like in addition to the above software. As the recording medium in the recording unit 16, a built-in hard disk, an external hard disk, a flexible disk, MO, MT, ROM (read only memory), CD-ROM, DVD-ROM, or the like can be used. Here, the CPU 14 and the software recorded in the recording unit 16 configure the data processing unit 141, the write control unit 142, and the print control unit 143 as functional blocks.

The photographing device 21 is composed of, for example, a photographing box or a digital camera, and photographs the face of the user to generate image data VD1 representing an image including the face of the user. The scanner 22 also captures the image of the photo mount and generates image data VD2 representing the image of the photo mount.

On the photo mount, for example, the name of the organization to which the user belongs and the background pattern are printed. Alternatively, the image data VD2 created in advance using software may be registered in the database in the recording unit 16 or the like of the ID card issuing device 10. In that case, the scanner 22 can be omitted.

The output device 30 includes, for example, a reader/writer unit 31 and a printer unit 32. The reader/writer unit 31 includes a communication circuit that communicates with the IC card according to a predetermined protocol. The reader/writer unit 31 communicates with the IC card by a contact method or a non-contact method according to a write command output from the ID card issuing device 10, and is extracted from the image including the face of the user. An identification data file including characteristic data representing information on a plurality of characteristic points and user identification information is stored in the memory of the IC card.

The printer unit 32 prints a card image including an image of the face and/or identification information of the user on the front surface of the IC card according to the print command output from the ID card issuing device 10. The reader/writer unit 31 and the printer unit 32 may be built in one housing or may be built in separate housings.

<Operation of ID card issuing system>
Next, an operation example of the ID card issuing system shown in FIG. 1 will be described. The operator in charge of issuing the ID card operates the operation unit 12 of the ID card issuing device 10 to input the identification information of the user to the ID card issuing device 10. Alternatively, a file of identification information registered in the database in the recording unit 16 or the like in advance may be read when the operator designates it. Alternatively, the identification information may be printed on the photo mount and captured by the scanner 22.

The operator photographs the face of the user with the photographing device 21, and the photographing device 21 generates image data VD1 representing an image including the face of the user. Further, when the operator captures the image of the photo mount using the scanner 22, the scanner 22 generates the image data VD2 representing the image of the photo mount. The image data VD1 and/or VD2 may be temporarily stored in a memory such as an SD card.

The data processing unit 141 of the ID card issuing device 10 reads out the image data VD1 and VD2 from the memories such as the photographing device 21 and the scanner 22 or the SD card via the interface 13, and stores the image data VD1 and VD2 in the memory 15. The data processing unit 141 may give a file name including the identification information of the user to the image data file storing the image data VD1 or VD2.

Then, the data processing unit 141 generates feature data representing information on a plurality of feature points extracted from the image including the user's face, based on the image data VD1 representing the image including the user's face, and An identification data file containing data and user identification information is created. The identification information (identification code) of the user corresponds to, for example, the user's ID code, employee number, member number, name, and/or department to which the user belongs.

The data processing unit 141 may generate unique data by combining the characteristic data and the identification information of the user and create an identification data file that stores the unique data. It is desirable to create an identification data file with a file name that contains the information. In that case, the user's identification information can be acquired simply by referring to the file name.

Further, the data processing unit 141 preferably adds a new extension (for example, "blk") different from the extension ("jpg", "gif", etc.) of the image data file to the identification data file. In that case, the file name of the identification data file includes an extension different from the extension of the image data file in addition to the identification information of the user, so that it can be easily distinguished from the image data file. ..

Below, an example of the image processing for generating the feature data based on the image data VD1 representing the image including the face of the user will be described. First, the data processing unit 141 roughly detects the position and area of a human face in an image represented by the image data VD1 (hereinafter, also referred to as “input image”).

Next, the data processing unit 141 performs face recognition processing on the image data VD1 based on the learning data recorded in advance in the recording unit 16 to thereby obtain a plurality of human face parts in the input image (for example, face parts). Contour points, eyes, cheeks, and lips) are extracted, and the coordinates of these feature points are obtained.

For this face recognition processing, the recording unit 16 uses, for example, a standard human face or a model of the model, to record a subject located at a standard distance from the camera 21 along a predetermined optical axis. Image data representing an image obtained by shooting in advance, coordinates of a plurality of feature points set in the image, and a code specifying a portion where the feature points are located are recorded in advance as learning data. There is.

In this face recognition processing, an image of a target face is divided into a shape and a texture, and by dimensionally compressing them by principal component analysis, a change in the shape of the target and a change in the texture are expressed with a small number of parameters. It becomes possible. Thereby, the shape and texture information can be expressed by low-dimensional parameters. In addition, parameters are used for global variation of where, in what size, and in what orientation the object is in the image.

For example, the data processing unit 141 locally and widely changes the model of the face in the learning data according to the parameters to generate an image to be compared, compares the generated image with the input image, and outputs the error. Find the parameter that minimizes. The obtained parameters are used as feature data representing information on a plurality of feature points extracted from the image including the user's face. Thereby, the data amount of the characteristic data (binary data) can be reduced to 240 bytes or less (preferably 120 bytes to 240 bytes).

As described above, the feature data used in the present embodiment does not represent the image itself, but the information such as the shape and texture regarding the plurality of feature points extracted from the image based on the learning data. The original image cannot be reproduced based on the data. In addition, even if the feature data is not enough to find a specific user from the large number of registered users, the photographed user can be identified as the registered user identified by the ID card. It has a sufficient amount of information to determine whether or not they match.

Further, the data processing unit 141 may perform scramble processing on the data of the created identification data file using a dedicated tool. In the present application, the scramble process is to perform a conversion or calculation on data in a fixed procedure or change the order of arrangement to make a random state different from the original state without damaging the content of the data. Say. For example, instead of storing the data of the identification data file sequentially in the memory of the IC card, divide it into a plurality of smaller chunks (lumps of data), and arrange these chunks in a predetermined order that looks as if they were random. It may be stored in the memory of the card.

A face authentication system or the like that reads the scrambled data needs to decode the read data by performing a conversion process opposite to the scramble process. In this way, if the data of the identification data file is scrambled, the identification data file can be externalized by hacking on the ID card issuing system or the issued ID card or by wiretapping from the signal transmission path such as the network. Even if it leaks, the contents of the data can be protected.

As a preferable example of the scramble process, it is desirable that the data processing unit 141 encrypts the data of the identification data file using a secret encryption key. A face authentication system or the like that reads encrypted data needs to decrypt the data using the same encryption key that was used for encryption.

For example, in order to prevent duplication (illegal copy) of the ID card, a unique ID code given to the IC chip used for manufacturing the ID card may be used as an encryption key. In that case, the unique ID code given to the IC chip is stored in a storage area such as a memory separate from the memory in which the identification data file is stored.

When reading the encrypted data from the IC chip, the face authentication system or the like also reads the unique ID code given to the IC chip and uses the ID code as an encryption key to decrypt the data. On the other hand, if the identification data file stored in the memory of the IC chip is illegally copied to the memory of another IC chip, the ID code read from the other IC chip is not the correct encryption key and is therefore encrypted. You cannot decrypt the data.

In addition, the data processing unit 141, based on the image data VD1 representing the image including the face of the user, the image data VD2 representing the image of the photo mount, and/or the identification information of the user, Alternatively, card image data representing a card image including an image of identification information may be generated. For example, the data processing unit 141 combines the image of the photo mount represented by the image data VD2 with the image obtained by enlarging a part of the image represented by the image data VD1 and the image of the identification information to use the image. Card image data representing a card image including an image of a person's face and identification information is generated.

The write control unit 142 generates a write command for storing the identification data file created by the data processing unit 141 in the memory of the IC card. The print control unit 143 also generates a print command for printing the card image on the front surface of the IC card based on the card image data generated by the data processing unit 141.

In the output device 30, the reader/writer unit 31 stores the identification data file in the memory (nonvolatile memory) of the IC card according to the write command output from the write control unit 142 via the interface 13. Further, the reader/writer unit 31 may read the identification data file from the non-volatile memory of the IC card and verify it.

For example, when the capacity of the nonvolatile memory of the IC card is 1 kbyte, the data amount of the characteristic data in the identification data file is about 240 bytes, the file name of the identification data file is 10 bytes or less, and the nonvolatileness of the IC card is The capacity of the user area in the memory can be about 750 bytes.

As a non-contact type IC card conforming to the short-distance wireless communication standard, Type A (Mifare), Type B, FeliCa ( registered trademark ), and the like are applicable. Therefore, it is desirable that the non-contact type reader/writer unit 31 be compatible with two or more of them. An experiment was performed using a Mifare card with a non-volatile memory capacity of 1 kbyte. It took 362 ms to write 240 bytes (equivalent to 5 sectors) of characteristic data, and 357 ms to read the characteristic data. Needed.

The printer unit 32 has, for example, a color printing function, and prints a card image on the front surface of an IC card according to a print command output from the print control unit 143 via the interface 13. As a result, a card image including the image of the user's face and identification information is printed on the front surface of the IC card. Further, the output device 30 may press the IC card to make unevenness.

<ID card>
Next, an ID card issued by the ID card issuing system shown in FIG. 1 will be described. FIG. 2 is a schematic diagram showing a configuration example of an ID card according to an embodiment of the present invention. 2A shows a contact-type ID card, and FIG. 2B shows a non-contact-type ID card. Although not shown in FIG. 2, a card image including an image of the user's face and/or identification information is printed on the front surface (front surface) of the ID card.

As shown in FIG. 2A, the contact type ID card includes, for example, an insulating material such as PVC (polyvinyl chloride), ABS (acrylonitrile-butadiene-styrene resin), or PET (polyethylene terephthalate). An IC module 42 including an IC chip (semiconductor integrated circuit device) is mounted on a base material 41 and configured.

The IC module 42 has a plurality of module terminals that come into contact with a plurality of reader/writer terminals of the output device 30 (FIG. 1), and directly contacts the reader/writer terminals of the output device 30 to perform communication. Since such a contact type ID card is capable of reliable communication, it is desirable to be used in fields such as credit cards and cash cards that require robust security such as payment and authentication.

As shown in FIG. 2B, a non-contact type ID card has an IC chip 52 and a coil that functions as an antenna in a base material 51 containing an insulating material such as PVC, ABS, or PET. And 53 are built in. When the ID card is placed over the magnetic field generated by the reader/writer unit 31 (FIG. 1) of the output device 30, a power supply voltage is supplied to the IC chip 52 by the coil 53, and the IC chip 52 and the reader/writer unit 31 wirelessly communicate with each other. Exchange data with. It is desirable that such a non-contact type ID card is used in fields where more convenience is required, such as entry/exit control and railway ticket gates.

FIG. 3 is a block diagram showing a configuration example of an IC chip used in the ID card shown in FIG. As shown in FIG. 3, the IC chip 60 includes, for example, a CPU 61, a communication unit 62, a ROM 63, a RAM 64, and a non-volatile memory 65. The CPU 61 to the non-volatile memory 65 are connected to each other via a bus line.

The CPU 61 performs various calculations and data processing according to software (OS, application software, etc.) stored in the ROM 63. The communication unit 62 includes a communication circuit that communicates with the external output device 30 and the face authentication device 80 according to a predetermined protocol, and communicates with the outside by a contact method or a non-contact method. The RAM 64 temporarily stores various data supplied from the outside, data generated or processed by the CPU 61, and the like.

The non-volatile memory 65 is composed of, for example, a flash memory or the like, and stores the identification data file supplied from the output device 30 to the IC chip 60. The identification data file includes feature data representing information on a plurality of feature points extracted from an image including the face of the user and identification information of the user. For example, the identification data file stores characteristic data and has a file name including user identification information. The data of the identification data file may be scrambled.

In addition, the non-volatile memory 65 may store data (program, instance, and/or various information) regarding the application installed in the ID card. For example, the ID card may be an application that realizes a cash card function, a predetermined number of credit payment applications, or a user may change the priority order between credit payment applications or change the availability. The setting application etc. is installed.

The communication unit 62 communicates with the output device 30 by a contact method or a non-contact method, and when receiving the write command of the identification data file from the output device 30, transfers the command to the CPU 61. The CPU 61 writes the identification data file supplied from the output device 30 via the communication unit 62 in the non-volatile memory 65 in accordance with the write command.

Further, the communication unit 62 communicates with the face authentication device 80 by a contact method or a non-contact method, and when receiving the read command of the identification data file from the face authentication device 80, transfers it to the CPU 61. The CPU 61 reads the identification data file from the non-volatile memory 65 and supplies it to the communication unit 62 according to the read command. The communication unit 62 transmits the identification data file to the face authentication device 80 by communicating with the face authentication device 80 by a contact method or a non-contact method.

<ID card manufacturing method>
Next, a method of manufacturing an ID card for user identification by processing an IC card having a function of communicating with the outside and a memory by using the ID card issuing system shown in FIG. 1 will be described.

FIG. 4 is a flowchart showing an ID card manufacturing method according to an embodiment of the present invention. The ID card manufacturing method according to the present invention does not have to include all the steps described below, and some of them may be omitted.

In step S1 of FIG. 4, the operator in charge of issuing the ID card operates the operation unit 12 of the ID card issuing device 10 shown in FIG. 1 to input the identification information of the user to the ID card issuing device 10. .. Alternatively, a file of identification information registered in the database in the recording unit 16 or the like in advance may be read when the operator designates it.

In step S2, the operator photographs the face of the user with the photographing device 21, and the photographing device 21 generates image data VD1 representing an image including the face of the user. The processes in steps S1 and S2 may be sequentially executed for a plurality of users.

In step S3, the operator captures the image of the photo mount using the scanner 22, so that the scanner 22 generates the image data VD2 representing the image of the photo mount. On the photo mount, for example, the name of the organization to which the user belongs and the background pattern are printed.

Then, in step S4, the operator operates the operation unit 12 while looking at the display 11, so that the data processing unit 141 takes in the image data VD1 from the photographing device 21 and the image data VD2 from the scanner 22, The data VD1 and VD2 are stored in the memory 15.

In step S5, the data processing unit 141 generates feature data representing information on a plurality of feature points extracted from the image containing the user's face, based on the image data VD1 representing the image containing the user's face. , An identification data file including characteristic data and user identification information is created. For example, the identification data file stores characteristic data and has a file name including the identification information of the user.

Further, the data processing unit 141 may perform scramble processing on the data of the created identification data file. As a preferable example of the scramble process, it is desirable that the data processing unit 141 encrypts the data of the identification data file using a secret encryption key. For example, in order to prevent illegal copying of the ID card, a unique ID code given to the IC chip used for manufacturing the ID card may be used as an encryption key.

In step S6, the data processing unit 141 generates a card image including the image of the user's face and/or the identification information based on the image data VD1 representing the image including the user's face and/or the identification information of the user. The card image data to represent is generated.

In step S7, the write controller 142 generates a write command for storing the identification data file created by the data processor 141 in the memory of the IC card, and the interface 13 outputs the write command to the output device 30. .. The reader/writer unit 31 of the output device 30 stores the identification data file in the memory of the IC card by communicating with the IC card by a contact method or a non-contact method according to the write command.

In step S8, the print control unit 143 generates a print command for printing the card image on the front surface of the IC card based on the card image data generated by the data processing unit 141, and the interface 13 outputs the print command. Output to the output device 30. The printer unit 32 of the output device 30 prints the card image on the front surface of the IC card according to the print command. Thereby, the card image including the image of the user's face and/or the identification information is printed on the surface of the IC card, and the ID card is completed.

<Face recognition system>
Next, a face authentication system used for entrance/exit management at a facility such as a company will be described as an example of a face authentication system for performing face authentication of a user using the ID card as described above. In this face authentication system, a pre-registered user has the dedicated ID card according to the present embodiment, and face authentication is performed for personal identification when entering or leaving the facility.

FIG. 5 is a block diagram showing a configuration example of the face authentication system according to the embodiment of the present invention. As shown in FIG. 5, this face authentication system includes a photographing device 70, a face authentication device 80, and may further include an electronic lock opening/closing device 90 and the like.

The image capturing device 70 is composed of, for example, a live camera such as a web camera, captures a face of a user who presents an ID card, and generates image data VD3 representing an image including the face of the user. Further, the camera 70 has an interface such as a USB capable of real-time image transfer, and the image data VD3 obtained by shooting a user's face is supplied to the face authentication device 80 via the interface. To be done.

The face authentication device 80 includes, for example, a communication unit 81, a data reading unit 82, an image capture (image data capturing unit) 83, a time counting unit 84, a CPU 85, a memory 86, and a recording unit 87. , It is used to perform face recognition of a user by using an ID card having a communication function with the outside and a memory. The CPU 85 to the recording unit 87 are connected to each other via a bus line.

The communication unit 81 includes a communication circuit that communicates with the ID card according to a predetermined protocol, and communicates with the ID card presented by the user by a contact method or a non-contact method. For example, the communication unit 81 corresponding to the contact type ID card has a plurality of reader/writer terminals that come into contact with a plurality of module terminals of the ID card, and directly contacts the module terminals of the ID card to perform communication. .. Further, the communication unit 81 corresponding to the non-contact type ID card generates a magnetic field for supplying a power supply voltage to the ID card, and exchanges data with the ID card by wireless communication.

The data reading unit 82 detects the ID card based on the output signal of the communication unit 81 and reads the identification data file from the ID card. The identification data file includes feature data representing information on a plurality of feature points extracted from an image including the registered user's face and identification information of the registered user. For example, the identification data file stores the characteristic data and has a file name including the identification information of the registered user.

Here, when the data of the identification data file is scrambled, the data reading unit 82 performs a conversion process opposite to the scramble process on the read data to obtain the data of the identification data file. Decrypt. For example, when the data of the identification data file is encrypted, the data reading unit 82 decrypts the data of the identification data file using the same encryption key used for the encryption.

When the ID card is detected by the data reading unit 82, the image capture 83 takes in the image data VD3 representing the image including the face of the user captured when presenting the ID card from the camera 70. As a result, image data representing an image when the user's face approaches the camera 70 can be acquired.

For example, the image capture 83 is suitable for generating image data of a plurality of frames by starting capturing image data when the ID card is detected by the data reading unit 82 and generating characteristic data from those frames. You may select the image data of a frame.

The clock unit 84 includes, for example, an oscillator and a counter, and the counter increments the count value in synchronization with a clock signal generated by the oscillator, thereby generating clock data representing the measurement time and supplying the clock data to the CPU 85.

The CPU 85 performs various calculations and data processing according to software recorded in the recording unit 87 (including image processing software that generates characteristic data based on image data). The memory 86 is composed of, for example, a RAM (random access memory), etc., and is an identification data file supplied from the data reading unit 82, image data supplied from the image capture 83, and characteristic data generated or processed by the CPU 85. Etc. are temporarily stored.

The recording unit 87 records various data used for image processing and the like in addition to the above software. As a recording medium in the recording unit 87, a built-in hard disk, an external hard disk, a flexible disk, MO, MT, ROM, CD-ROM, DVD-ROM, or the like can be used. Here, the CPU 85 and the software recorded in the recording unit 87 configure the feature data generation processing unit 851 and the matching determination processing unit 852 as functional blocks.

Further, the identification information of all the registered users may be recorded in the recording unit 87 in advance. In that case, the CPU 85 may start the following process only when the identification information of the identification data file read by the data reading unit 82 matches the identification information recorded in the recording unit 87.

The characteristic data generation processing unit 851 performs image processing on the basis of the image data captured by the image capture 83, thereby extracting a plurality of characteristic points extracted from the image including the face of the user captured by the camera 70. Generate feature data representing information about. This image processing may be the same as the image processing performed by the data processing unit 141 of the ID card issuing device 10 shown in FIG.

The matching determination processing unit 852 compares the characteristic data generated by the characteristic data generation processing unit 851 with the characteristic data of the identification data file to generate a score indicating the degree of matching between the two, and based on the generated score. It is determined whether or not the user photographed by the photographing device 70 matches the registered user specified by the ID card.

For example, the matching determination processing unit 852 compares the generated score with a threshold, and when the score is equal to or higher than the threshold or the score is higher than the threshold, the user photographed by the photographing device 70 is registered. It is determined that the registered user matches the registered user, and in other cases, it is determined that the user photographed by the camera 70 does not match the registered user. At this time, when it is determined that one user does not match, the matching determination processing unit 852 may repeat the determination a predetermined number of times while lowering the threshold value for the same user.

For example, the matching determination processing unit 852 sets the threshold value to 90% and performs the first determination when the score when the same feature data is compared is 100%, and the first determination does not match. If it is determined that the threshold value is lowered to 80%, the second determination is performed, and if it is determined that the two do not match in the second determination, the threshold value is reduced to 70% and the final third determination is performed. To do. Note that the user may re-capture the image data VD3 by the image capture 83 by presenting the ID card again to the data reading unit 82 when it is finally determined that they do not match.

Furthermore, when the matching determination processing unit 852 determines that the user photographed by the camera 70 matches the registered user identified by the ID card, the matching determination processing unit 852 outputs the time measurement data indicating the time when the ID card is detected. It may be recorded in the recording unit 87 in association with the identification information of the user. As a result, the timekeeping data can be used for attendance management.

Further, the matching determination processing unit 852 is provided at the entrance/exit gate or door of the facility when it is determined that the user photographed by the photographing device 70 matches the registered user specified by the ID card. The electronic lock opening/closing device 90 may be controlled to open the electronic lock. After the user has passed through the entrance/exit gate or door, the matching determination processing unit 852 controls the electronic lock opening/closing device 90 to close the electronic lock again.

According to the present embodiment, by using the feature data representing the information about a plurality of feature points extracted from the image including the face of the user as the face image information, the data amount is significantly reduced and the face image information is displayed. It becomes possible to store in the memory of the ID card. As a result, it is possible to use the ID card for user identification to authenticate the user's face, and to use the registered usage without using the server for pre-storing the authentication data of all users. Even if the number of users is large, it is possible to suppress an increase in the time required for face authentication of each user.

Further, by storing the feature data and the identification information in the memory of the ID card in association with each other from the time of creating the identification data file, when the face image information and the identification information of a plurality of users to be registered are stored, It is possible to prevent the mistaken correspondence between the face image information and the identification information.

In the above embodiment, the case where the face authentication system is used for entrance/exit management and attendance management in a facility has been described, but the present invention is not limited to this embodiment, and settlement in a financial institution or a computer Security management of terminals such as copy machines and copiers, attendance management at meetings, etc., purchase management of meal tickets at cafeterias, issue certificates such as student ID, enrollment certificate, commuter pass certificate, etc. It may be used for information management or the like. Thus, many modifications can be made within the technical idea of the present invention by a person having ordinary skill in the art.

INDUSTRIAL APPLICABILITY The present invention is used in an ID card used for identifying a user in entrance/exit management in a facility or settlement in a financial institution, a manufacturing method thereof, an ID card issuing device and system, and a face authentication device and system. It is possible.

DESCRIPTION OF SYMBOLS 10... ID card issuing device, 11... Display, 12... Operation part, 13... Interface, 14... CPU, 141... Data processing part, 142... Write control part, 143... Print control part, 15... Memory, 16... Recording part , 21... Imaging device, 22... Scanner, 30... Output device, 31... Reader/writer unit, 32... Printer unit, 41... Base material, 42... IC module, 51... Base material, 52... IC chip, 53... Coil , 60... IC chip, 61... CPU, 62... Communication unit, 63... ROM, 64... RAM, 65... Non-volatile memory, 70... Camera, 80... Face authentication device, 81... Communication unit, 82... Data reading unit , 83... Image capture, 84... Timing unit, 85... CPU, 851... Feature data generation processing unit, 852... Matching determination processing unit, 86... Memory, 87... Recording unit, 90... Electronic lock opening/closing device

Claims (11)

An ID card issuing device used for issuing an ID card for user identification by processing an IC card including an IC chip and having a communication function with the outside and a memory,
Feature data representing information about a plurality of feature points extracted from the image containing the user's face is generated on the basis of image data representing the image containing the user's face, and the unique feature data assigned to the IC chip is generated . A data processing unit that encrypts data including the characteristic data and the identification information of the user by using an ID code as an encryption key, and creates an identification data file including the encrypted data;
A write control unit that generates a write command for storing the identification data file in the memory of the IC card;
An ID card issuing device. The ID card issuing device according to claim 1, wherein the data processing unit scrambles the data including the characteristic data and the identification information of the user by the encryption . The data processing unit generates card image data representing a card image including the image of the face of the user and the image of the identification information based on the image data representing the image including the face of the user and the identification information of the user. Then
The ID card issuing device according to claim 1, further comprising a print control unit that generates a print command for printing the card image on the front surface of the IC card based on the card image data. An ID card issuing device according to claim 3,
A camera that captures the user's face and generates image data,
By communicating with the IC card by a contact method or a non-contact method according to the write command, the identification data file is stored in the memory of the IC card, and the card image is displayed according to the print command. An output machine that prints on the surface of the IC card,
ID card issuance system. An ID card for user identification including an IC chip ,
(A) Data including characteristic data representing information on a plurality of characteristic points extracted from an image including the face of the user and identification information of the user, and a unique ID code assigned to the IC chip A memory for storing an identification data file containing the data encrypted by using as an encryption key ,
(B) a communication unit that transmits the identification data file to the outside by communicating with the outside by a contact method or a non-contact method,
ID card equipped with. The ID card according to claim 5, wherein the identification data file stores the characteristic data and has a file name including identification information of the user. A method of manufacturing an ID card for user identification by processing an IC card including an IC chip and having a function of communicating with the outside and a memory,
Feature data representing information about a plurality of feature points extracted from the image containing the user's face is generated on the basis of image data representing the image containing the user's face, and the unique feature data assigned to the IC chip is generated . A step of encrypting data including the characteristic data and the identification information of the user by using an ID code as an encryption key, and creating an identification data file including the encrypted data ;
Storing the identification data file in the memory of the IC card (b),
An ID card manufacturing method comprising: Generating card image data representing a card image including the image of the user's face and the identification information based on image data representing the image of the user's face and the identification information of the user; ,
Printing the card image on the surface of the IC card based on the card image data (d);
The ID card manufacturing method according to claim 7, further comprising: A face authentication device used for performing face authentication of a user using an ID card including an IC chip ,
A communication unit that communicates with an ID card presented by the user by a contact method or a non-contact method,
Based on the output signal of the communication unit, the ID card is detected, and the feature data representing information about a plurality of feature points extracted from the image including the registered user's face is registered as the feature data. And an identification data file including the identification information of the user , and a unique ID code given to the IC chip, and the characteristic data and the identification information of the user are read by using the ID code as an encryption key. A data reading unit for decoding the data including ,
An image data capturing unit that captures image data representing an image including the face of the user captured when presenting the ID card when the ID card is detected by the data reading unit;
A feature data generation processing unit that generates, based on the image data captured by the image data capturing unit, feature data representing information regarding a plurality of feature points extracted from the image including the photographed user's face;
By comparing the characteristic data generated by the characteristic data generation processing unit with the characteristic data of the identification data file, a score representing the degree of matching between the two is generated, and based on the score, the photographed user A matching determination processing unit that determines whether or not the registered user matches.
Face recognition device. When the matching determination processing unit determines that the photographed user matches the registered user, it associates timekeeping data indicating the time when the ID card is detected with the identification information of the user. The face authentication device according to claim 9, which is recorded in a recording unit. A face authentication device according to claim 9 or 10,
A camera that captures the face of the user presenting the ID card and generates image data;
Face recognition system equipped with.

Images