JP6992376B2 - Biometric device - Google Patents

Description

The present invention relates to a payment method using biometric authentication.

In recent years, electronic commerce is rapidly becoming widespread (see Patent Document 1). The user charges the IC (Integrated Circuit) card with electronic money by paying a large amount of cash (pre-charge), and then holds the IC card over the payment terminal. The payment terminal subtracts electronic money from the IC card as consideration for the product. The user can purchase the product only with the IC card within the charged amount.

Japanese Patent No. 4631705.

However, in the above-mentioned fee collection method, when the electronic money charged in the IC card is exhausted, it is necessary to recharge it. The user will be restricted in purchasing activities by the charge amount of the IC card.

In addition, if the IC card is stolen, there is a risk that the electronic money will be illegally consumed by another person. Generally, by limiting the amount that can be charged to a small amount, the amount of damage when the IC card is stolen is suppressed. However, if the amount that can be charged is suppressed too much, charging is required frequently, so that the above-mentioned problems are likely to become apparent.

The present invention is an invention completed based on the above-mentioned problem recognition, and a main object thereof is to achieve both safety and convenience of electronic money payment in the purchase of goods and services.

The biometric authentication device according to an aspect of the present invention includes an ID acquisition unit for acquiring a user's first ID, a biometric information acquisition unit for acquiring a user's second biometric information, and a user's first ID and first. By referring to the first biometric information table associated with the biometric information of the above in advance, and collating the acquired second biometric information with the first biometric information associated with the acquired first ID. , An authentication unit that authenticates the user, a payment request unit that requests an external payment device to settle the charges for the product purchased by the user when it is determined to be conforming, and a payment that receives a payment approval / disapproval notification from the payment device. It includes a receiving unit and a purchase permission unit that permits the purchase of goods when payment is permitted by the payment device.
The term "commodity" as used herein includes not only physical commodities but also services such as medical treatment and transportation (intangible commodities), and may be "commodities whose utility can be obtained by paying a price".

The biometric authentication device in another aspect of the present invention includes first and second authentication devices.
The first authentication device is connected to the second authentication device via a communication line.
The first authentication device includes an ID acquisition unit that acquires the user's first ID, a biometric information acquisition unit that acquires the user's second biometric information, and the user's first ID and the first biometric information. The user is authenticated by referring to the first biometric information table associated with the above in advance and collating the acquired second biometric information with the first biometric information associated with the acquired first ID. When the authentication unit determines that the product is compatible, the third ID associated with the first ID is transmitted to the second authentication device, and payment is requested to settle the fee for the product purchased by the user. Includes a request unit, a payment receiving unit that receives a first payment approval / disapproval notification from a second authentication device, and a purchase permission unit that permits the purchase of goods when payment is permitted by the second authentication device. ..
The second authentication device is connected to the payment device and the first authentication device via a communication line.
The second authentication device specifies a request receiving unit for receiving a payment request including a third ID from the first authentication device and an account number associated with the third ID, and settles the price of the product. Includes a payment request unit that requests the payment device to make a payment, and a payment notification unit that sends a first payment permission notification to the first authentication device when the second payment permission notification is received from the payment device.

The biometric authentication device according to another aspect of the present invention is connected to a payment terminal having a biometric authentication function via a communication network.
This device has an ID acquisition unit that acquires the first ID from the user, a biometric information transmission unit that transmits the first biometric information associated with the first ID in advance to the payment terminal, and biometric authentication from the payment terminal. The authentication result receiving unit that receives the result, the payment requesting unit that requests the external payment device to settle the fee of the product purchased by the user when it is determined to be conforming by the authentication, and the payment acceptance / rejection notification from the payment device are received. It includes a payment receiving unit and a purchase permission unit that permits the purchase of goods when payment is permitted by the payment device.

The biometric authentication device in another aspect of the present invention includes first and second authentication devices.
The first authentication device is connected to the second authentication device via a communication line.
The first authentication device includes an ID acquisition unit that acquires the user's first ID, a biometric information transmission unit that transmits the first biometric information associated with the first ID in advance to the payment terminal, and a payment terminal. A product purchased by a user by transmitting an authentication result receiving unit that receives the result of biometric authentication and a third ID associated with the first ID in advance to a second authentication device when it is determined to be conforming by the authentication. When payment is permitted by the payment request unit that requests the payment of the charge, the payment receiving unit that receives the first payment availability notification from the second authentication device, and the second authentication device, the purchase of the product is permitted. Including the purchase permission department.
The second authentication device is connected to the payment device and the first authentication device via a communication line.
The second authentication device specifies a request receiving unit for receiving a payment request including a third ID from the first authentication device and an account number associated with the third ID, and settles the price of the product. Includes a payment request unit that requests the payment device to make a payment, and a payment notification unit that sends a first payment permission notification to the first authentication device when the second payment permission notification is received from the payment device.

According to the present invention, when the consideration for goods and services is collected by electronic money, it becomes easy to achieve both safety and convenience.

It is a hardware configuration diagram of an electronic payment system. It is a functional block diagram of the biometric authentication apparatus in 1st Embodiment. It is a data structure diagram of the second biological information table. It is a data structure diagram of a charge table. It is a data structure diagram of an account table. It is a sequence diagram which shows the settlement processing process in 1st Embodiment. It is a functional block diagram of the biometric authentication apparatus in 2nd Embodiment. It is a sequence diagram which shows the settlement processing process in 2nd Embodiment.

Hereinafter, embodiments of the present invention will be described separately in two embodiments, a first embodiment and a second embodiment. Hereinafter, the term "the present embodiment" is used in the sense that "the first embodiment" and "the second embodiment" are not particularly distinguished.

[First Embodiment]
FIG. 1 is a hardware configuration diagram of the electronic payment system 100.
In the electronic payment system 100, a plurality of stores 108a, 108b ... 108n (hereinafter, collectively referred to as "store 108" when collectively referred to or not particularly distinguished) and a plurality of mobile phones are used for the biometric authentication device 102. The terminals 104a, 104b, ... 104n (hereinafter, collectively referred to as "portable terminal 104" when collectively referred to or not particularly distinguished) are connected via the Internet 106. The biometric authentication device 102 is also connected to the payment device 114 and the biometric information storage unit 160 (external database). The payment device 114 is a server operated by a credit card company or a bank.

Although details will be described later, in the electronic payment system 100, a user is identified by two types of user IDs, a CID (first ID) and a PID (third ID). When registering as a user in the electronic payment system 100, a CID and a PID are issued. At the time of user registration, the user also registers his / her own biometric information. The biometric information storage unit 160 stores a biometric information table (hereinafter referred to as "first biometric information table") that associates the CID (first ID) with the biometric information. In the first biometric information table, biometric information of all users registered as users in the electronic payment system 100 is registered.
Hereinafter, the user registered in the electronic payment system 100 is also referred to as a "registered user". Further, the biometric information registered in the first biometric information table or the second biometric information table described later is called "registered biometric information (first biometric information)". The biometric information in this embodiment is assumed to be a user's facial image. Therefore, the registered biometric information is also appropriately referred to as a "registered face image". In addition to facial images (face feature information), biological information may be information that represents human physical and behavioral features such as fingerprints, irises, veins, voice prints, handwriting, palm shapes, and DNA (genetic information). ..

The mobile terminal 104 in this embodiment assumes a smartphone. The mobile terminal 104 may be a tablet terminal or a laptop PC. The mobile terminal 104 and the Internet 106 are wirelessly connected, but may be connected by wire.

The store 108 is assumed to be a retail store, a hospital, a restaurant, an amusement park, or the like. In the store 108, a plurality of payment terminals 110a to 110f (hereinafter, collectively referred to as "payment terminal 110" when collectively referred to or not particularly distinguished) and a relay device 112 are connected by a dedicated line. The payment terminal 110 is a POS (Point Of Sale) terminal that accepts electronic payment by credit card. The relay device 112 is a device that relays information transmission / reception between one or more payment terminals 110 and the biometric authentication device 102. The relay device 112 and the Internet 106 are connected by wire, but may be wirelessly connected.

A store entry detection device 116 is further connected to the relay device 112. At the time of user registration, a CID (first ID) is recorded in the mobile terminal 104 owned by the user. When the user enters the store 108, the user holds the mobile terminal 104 over the store entry detection device 116, and the store entry detection device 116 detects the CID from the mobile terminal 104. The store entry detection device 116 may automatically detect the CID from the visitor's mobile terminal 104 by a wireless connection means such as Wi-Fi. The relay device 112 notifies the first authentication device 118 of the detected CID together with the store ID. The first authentication device 118 can recognize a user (visitor) who is visiting the store 108 by the store entry detection device 116. The details of the processing associated with the store entry detection will be described later.

The biometric authentication device 102 includes a first authentication device 118 and a second authentication device 120.
The first authentication device 118 downloads the registered biometric information of the visitor from the biometric information storage unit 160, and then executes the biometric authentication of the visitor by the method described later. The second authentication device 120 setstles the purchase price of the product with the payment device 114. The details of downloading the registered biometric information from the biometric information storage unit 160 will also be described later.

When registering a user in the electronic payment system 100, the user needs to contract a credit card with the payment device 114 in advance and register an account number or a credit card number in the second authentication device 120. The second authentication device 120 associates the PID (third ID) with the account number for each user and lists them (described later).

In summary, when registering a user in the biometric authentication device 102 (electronic payment system 100), the user registers an account number or a credit card number in the second authentication device 120 via a mobile terminal 104 or the like. The second authentication device 120 issues the PID and the CID in association with each other, and the mobile terminal 104 registers only the CID. The PID and CID issued by the second authentication device 120 are registered in the first authentication device 118. On the other hand, the second authentication device 120 issues a PID, but does not register the PID itself. As a result, the CID (first ID) is registered in the mobile terminal 104, the CID (first ID) and the PID (third ID) are registered in the first authentication device 118 in association with each other, and the second authentication device 118 is registered. In the authentication device 120, the PID and the account number and the like are registered in association with each other.

At the time of user registration, the user further captures a face image with the mobile terminal 104 and transmits the face image together with the CID to the first authentication device 118. The first authentication device 118 transmits the CID and the face image (biological information) to the biometric information storage unit 160. In the first biometric information table of the biometric information storage unit 160, the CID and the face image (registered biometric information) are registered in association with each other. The biometric authentication function of the electronic payment system 100 is exhibited on the premise of the above user registration. The registration of the biometric information (face image) may be performed by the first authentication device 118, the store entry detection device 116, or another dedicated terminal (not shown) provided in the store 108. The user may register or re-register the face image (described later) by inputting the CID into the dedicated terminal or the like at the time of entering the store and taking a face image with the dedicated terminal.

The user holds the mobile terminal 104 over the store entry detection device 116 when visiting the store. At this time, the store entry detection device 116 reads the CID from the mobile terminal 104 by using a known short-range communication technology such as NFC standard (Near Field Communication). The store entry detection device 116 transmits the CID to the first authentication device 118. The first authentication device 118 downloads the registered biometric information corresponding to the CID, in other words, the registered face image (first biometric information) of the visitor from the biometric information storage unit 160. The first authentication device 118 always holds a biometric information table (hereinafter referred to as "second biometric information table") which is a list of registered biometric information (face images) of visitors for each store 108.

The registered biometric information (face image) of all registered users is recorded in the first biometric information table of the biometric information storage unit 160 in association with the CID. In the second biometric information table held by the first authentication device 118, the registered biometric information (face image) of the visitor is registered in association with the CID and PID. The second biometric information table is updated each time a user enters or leaves the store.

The payment terminal 110 includes a camera and captures a user's face image (second biological information) at the time of product purchase. The payment terminal 110 transmits the captured face image to the first authentication device 118 via the relay device 112 together with the product ID (hereinafter, also referred to as “GID”) which is an ID for identifying the product.

The first authentication device 118 collates the received face image (second biometric information) with the registered face image (first biometric information) in the second biometric information table, and executes face authentication. If the registered face image that matches the received face image, in other words, the similarity is equal to or higher than the threshold value, exists in the second biometric information table (visitor's face image list), the authentication is successful and the second authentication device. 120 requests the payment device 114 to settle the charge.

In the present embodiment, payment is executed by the post-pay method at the time of product purchase. The user does not need to precharge the IC card with a large amount of money in advance. Settlement is executed only for the purchased amount within the range of the balance of the bank account. In addition, even if the credit card is stolen, face recognition will not succeed unless the original owner of the credit card is used, so security can be ensured.

FIG. 2 is a functional block diagram of the biometric authentication device 102 according to the first embodiment.
As described above, the biometric authentication device 102 includes a first authentication device 118 and a second authentication device 120. Each component of the first authentication device 118 and the second authentication device 120 includes a CPU (Central Processing Unit), a computing unit such as various coprocessors, a storage device such as a memory and a storage, and a wired or wireless communication line connecting them. It is realized by the hardware including it and the software stored in the storage device and supplying the processing instruction to the arithmetic unit. A computer program may be composed of a device driver, an operating system, various application programs located on the upper layer thereof, and a library that provides common functions to these programs. Each block described below shows a block for each function, not a configuration for each hardware.
The same applies to the second embodiment.

(1st authentication device 118)
The first authentication device 118 includes a communication unit 122, a data processing unit 124, and a data storage unit 126.
The communication unit 122 is in charge of communication processing with the mobile terminal 104, the store 108, and the biometric information storage unit 160 via the Internet 106. Further, the communication unit 122 performs communication processing with the second authentication device 120 via a dedicated line (Internet 106 when the operating entity of the first authentication device 118 and the second authentication device 120 are different). The data storage unit 126 stores various data such as a second biometric information table. The data processing unit 124 executes various processes based on the data acquired by the communication unit 122 and the data stored in the data storage unit 126. The data processing unit 124 also functions as an interface between the communication unit 122 and the data storage unit 126.

The data processing unit 124 includes an authentication unit 142 and a store entrance management unit 144. The store entry management unit 144 manages who is in which store by the method described later. The authentication unit 142 executes face authentication.

The communication unit 122 includes a biometric information table communication unit 128, an ID acquisition unit 130, a registration notification unit 132, a biometric information acquisition unit 134, a payment request unit 136, a payment reception unit 138, and a purchase permission unit 140.
The store entry detection device 116 acquires a CID from the mobile terminal 104 when the user enters the store 108. The ID acquisition unit 130 acquires the CID and the store ID from the store entry detection device 116 via the relay device 112. Even when the user leaves the store, the store entry detection device 116 detects the CID from the mobile terminal 104. As a result, the store entry management unit 144 can grasp who is in which store at any time. After detecting the user's CID by the store entry detection device 116, the biometric information table communication unit 128 acquires the registered face image (registered biometric information) of the visitor corresponding to the CID from the biometric information storage unit 160. Further, at the time of user registration, the biometric information table communication unit 128 registers the face image in the first biometric information table of the biometric information storage unit 160 in association with the CID. The store entry management unit 144 updates the second biometric information table of the data storage unit 126 every time it detects entry and exit.

The biological information acquisition unit 134 receives the user's face image taken by the payment terminal 110 at the time of purchasing the product. The authentication unit 142 executes face authentication by determining whether or not a registered face image matching the user's face image exists in the second biometric information table. When the face authentication is successful, the payment request unit 136 requests the second authentication device 120 to settle the charge. The settlement receiving unit 138 receives a settlement acceptance / rejection notification (first settlement acceptance / rejection notification) from the second authentication device 120. When the payment of the charge is completed in the payment device 114, the purchase permission unit 140 permits the purchase of the product in the payment terminal 110.

(Second authentication device 120)
The second authentication device 120 includes a communication unit 146, a data processing unit 148, and a data storage unit 150.
The communication unit 146 performs communication processing with the payment device 114 and the first authentication device 118 via a dedicated line (the Internet 106 when the operating entity is different from the first authentication device 118 and the payment device 114). The data storage unit 150 stores various data. The data processing unit 148 executes various processes based on the data acquired by the communication unit 146 and the data stored in the data storage unit 150. The data processing unit 148 also functions as an interface between the communication unit 146 and the data storage unit 150. The data storage unit 150 stores various information such as product charges and account numbers (details will be described later).

The communication unit 146 includes a request receiving unit 152, a payment request unit 154, and a payment notification unit 156.
The request receiving unit 152 receives a charge settlement request from the settlement request unit 136 of the first authentication device 118. The settlement request unit 154 transmits a charge settlement request to the settlement device 114. The payment notification unit 156 receives information indicating whether payment is possible from the payment device 114, and transmits a payment permission notification (first payment permission notification) to the payment reception unit 138 of the first authentication device 118.

FIG. 3 is a data structure diagram of the second biological information table 158.
The biological information storage unit 160 stores a first biological information table (not shown). In the first biometric information table, the CID and the face image (registered biometric information) are associated with each registered user. The second biometric information table 158 is stored in the data storage unit 126 of the first authentication device 118. In the second biometric information table 158, a CID (first ID), a PID (third ID), and a facial image (first biometric information) are associated with each other. The face image is identified by a biometric information ID (hereinafter, also referred to as "BID"). The second biometric information table 158 is obtained by extracting only the registered face image (registered biometric information) of the visitor from the first biometric information table.

At the time of user registration, the data processing unit 124 associates the CID with the face image and registers it in the first biometric information table (biological information storage unit 160). Also, the CID and PID are recorded in association with each other. In FIG. 3, a user with CID = C01 and PID = P03 (hereinafter referred to as “user (C01, P03)”) has registered a face image (B01). The user (C01, P03) inputs the CID (C01) to the store entry detection device 116 at the time of entering the store. The biometric information table communication unit 128 acquires the registered face image (registered biometric information) of the user (C01) from the biometric information storage unit 160 in preparation for product purchase, and associates the second biometric information table 158 with the CID and PID. And record.

The user (C01) causes the camera of the payment terminal 110 to take a picture of his / her face at the time of purchasing the product. The authentication unit 142 determines whether or not a face image matching the acquired face image (second biometric information) is registered in the second biometric information table 158 by a known image authentication technique.

As described above, the user (store resident) who has entered the store 108 is managed by the store entry management unit 144 at any time. When the user (C01, P03) enters the store 108a, the store entry management unit 144 registers the player (C01, P03) in the visitor list (not shown) of the store 108a. Further, the biometric information table communication unit 128 extracts face information (B01) corresponding to the user (C01) from a huge amount of face information registered in the first biometric information table (biological information storage unit 160). It is registered in the second biometric information table 158 as a collation candidate. By extracting the registered face information of the visitor as a collation candidate in the second biometric information table 158, the face authentication process at the time of product purchase can be promptly executed.

For example, when there are 100,000 registered users, face images of 100,000 people are registered in the first biometric information table (biological information storage unit 160). It may take an enormous amount of processing time to compare the face images acquired at the time of product purchase with the registered face images of 100,000 people one by one. On the other hand, if the number of visitors is 10, if the second biometric information table 158 including only the facial images of these 10 people is created in advance, the comparison target of the facial images can be limited to 10 people at the time of product purchase. By narrowing down the matching candidates at the time of store visit detection, the processing cost of the face image can be reasonably reduced.

A plurality of registered face images may be associated with one CID. For example, it is assumed that 10 face images of the user (C01, P01) are registered. The authentication unit 142 calculates the degree of similarity between the face image obtained when the user (C01, P01) purchases the product and each of these 10 registered face images. The authentication unit 142 may authenticate the user on the condition that the similarity is equal to or higher than a predetermined threshold value for all 10 registered face images, or for a predetermined number or more, for example, 5 or more registered face images. The user may be authenticated on condition that the similarity is equal to or higher than the threshold value. The authentication unit 142 may authenticate the user on the condition that the similarity of any of the 10 registered face images is equal to or higher than the threshold value, or the average value of the similarity for each of the 10 registered face images. It may be a condition that the median value, the minimum value, the maximum value, etc. are equal to or more than the threshold value.

The similarity threshold may be variable depending on the purchase price of the product. The authentication unit 142 sets the threshold value of similarity to 90% when the purchase price of the product is 1,000 yen or less, and sets the threshold value to 92% when the purchase price is 1,000 yen or more and less than 10,000 yen, and 10,000 yen or more. At this time, the threshold value may be set to 95%. According to such a control method, the larger the purchase price, the higher the security.

Similarly, the number of registered face images that should be equal to or greater than the threshold value may be variable according to the purchase price of the product. The authentication unit 142 authenticates the user if there is one or more registered face images whose similarity is equal to or higher than the threshold when the purchase price of the product is 1,000 yen or less, and the similarity is equal to 1,000 yen or more and less than 10,000 yen. The condition for user authentication is that there are 3 or more registered face images for which is equal to or greater than the threshold value, and the condition for user authentication is that there are 8 or more registered face images for which the similarity is equal to or greater than the threshold value for 10,000 yen or more. May be. Even with such a control method, the larger the purchase price, the stricter the authentication can be performed.

The human face changes with age. Therefore, it is necessary to maintain the freshness of the registered face information for stable face recognition. The registration notification unit 132 notifies the user's mobile terminal 104 to re-register the face information when a predetermined valid period has elapsed since the user registered the face information (hereinafter referred to as "re-registration instruction"). Call) is sent. The validity period may be variable depending on the age of the user. Since children have large facial changes as they grow up, the effective period should be set short. The registration notification unit 132 sets a valid period of half a year for users under the age of 10. For adults, the effective period may be set longer because the face changes slowly over time. The registration notification unit 132 sets the validity period to 2 years for users aged 20 and over. The user who received the re-registration instruction re-registers the face information at the store 108. The biometric information table communication unit 128 updates the face image of the first biometric information table at the time of re-registration.

When the store entry is detected by the store entry detection device 116, the registration notification unit 132 may send a re-registration instruction to the new store entrant if the valid period has elapsed. That is, the elapse of the valid period and the detection of entering the store may be set as the transmission conditions of the re-registration instruction. The store entry detection device 116 may include a camera. When the user receives the re-registration instruction at the time of entering the store, the user inputs a face image with the camera of the store entry detection device 116. The first authentication device 118 re-registers the face image in the first biometric information table by associating the face image taken at this time with the CID. If the face image is re-registered when the product is purchased, the customer turnover rate may deteriorate. In addition, forcing the process of re-registration at the product purchase stage may impair user convenience. It is desirable to re-register the face image at a timing different from the timing of purchasing the product, in other words, at a timing that does not cause inconvenience to the person or other customers.

FIG. 4 is a data structure diagram of the charge table 170.
The charge table 170 is stored in the data storage unit 126 of the first authentication device 118. The charge table 170 registers the charge for each product. The charge table 170 is set by the operator of the biometric authentication device 102 at the time of new registration of the product. In the charge table 170, the GID and the charge are associated with each other on a one-to-one basis. At the time of product purchase, the payment terminal 110 transmits the GID as well as the face information to the first authentication device 118. When the authentication unit 142 succeeds in face recognition, the payment request unit 136 identifies the price of the product with reference to the charge table 170, and requests the second authentication device 120 to settle the charge.

FIG. 5 is a data structure diagram of the account table 162.
The account table 162 is stored in the data storage unit 150 of the second authentication device 120. The account table 162 associates the PID with the account number or credit card number. The account number of the account table 162 is registered based on the declaration from the player when the user is registered in the electronic payment system 100.

When the face authentication is successful in the first authentication device 118, the payment request unit 136 transmits the PID and the purchase amount and requests the second authentication device 120 to make a payment. The settlement requesting unit 154 refers to the account table 162, designates an account number or a credit card number corresponding to the PID, and requests the settlement device 114 to settle the fee.

FIG. 6 is a sequence diagram showing a settlement processing process according to the first embodiment.
The process shown in FIG. 6 is executed when the registered user purchases the product. Here, it is assumed that the user inputs a CID at the time of entering the store, and the biometric information table communication unit 128 acquires the registered face image of this user from the biometric information storage unit 160 and has updated the second biometric information table 158. When purchasing a product, the user images a face image (biological information) according to an instruction from the payment terminal 110 (S12).

The payment terminal 110 transmits input information including a GID for identifying a product and a face image to the relay device 112 (S14), and the relay device 112 transmits this input information to the first authentication device 118 (S16). The authentication unit 142 of the first authentication device 118 refers to the second biometric information table 158 and executes face authentication (S18). As a result of the authentication, the matching face image was not registered in the second biometric information table 158, more specifically, the face image having the similarity equal to or higher than the threshold value was not registered in the second biometric information table 158. Occasionally (hereinafter referred to as "failure"), the purchase permission unit 140 of the first authentication device 118 does not permit the purchase of the product. Here, as a result of the authentication, it is assumed that the face image is suitable (hereinafter referred to as "success"), and the following description will be given.

After the authentication is completed, the payment request unit 136 calculates the purchase price with reference to the charge table 170, and transmits the payment request including the PID and the purchase amount to the second authentication device 120 (S20). The request receiving unit 152 of the second authentication device 120 receives the payment request, the payment request unit 154 specifies the account number with reference to the account table 162, and the payment request for specifying the account number and the purchase amount is sent to the payment device 114. (S22).

The settlement device 114 executes a settlement process when the balance of the designated bank account is equal to or greater than the purchase amount (S24). The settlement notification unit 156 transmits a settlement acceptance / rejection notification (second settlement acceptance / rejection notification) to the second authentication device 120 (S26). The payment notification unit 156 of the second authentication device 120 receives the payment acceptance / rejection notification, and transmits the payment acceptance / rejection notification (first settlement acceptance / rejection notification) to the first authentication device 118 (S28).

The purchase permission unit 140 of the first authentication device 118 transmits a permission notification to the relay device 112 (S32) if the withdrawal of the purchase amount from the account balance is completed (S30). The relay device 112 forwards the permission notification to the corresponding payment terminal 110 (S34). If the withdrawal fails, the purchase permission unit 140 does not permit the purchase of the product. The payment terminal 110 completes the product purchase process on condition that the permission notification is received (S36).
As described above, when the face recognition is successful and the purchase amount can be deducted from the account, the payment terminal 110 permits the purchase of the product.

[Second Embodiment]
In the first embodiment, it has been described that face authentication (biometric authentication) is performed by the first authentication device 118. In the second embodiment, the payment terminal 110 has a face authentication (biometric authentication) function, and the payment terminal 110 executes face authentication. The hardware configuration of the electronic payment system 100 in the second embodiment is the same as the hardware configuration of the electronic payment system 100 in the first embodiment.

FIG. 7 is a functional block diagram of the biometric authentication device 102 according to the second embodiment.
In FIG. 7, the role of the same coded functional block in FIG. 2 is similar to that described in relation to FIG. A biometric information transmitting unit 164 and an authentication result receiving unit 166 are added to the communication unit 122 of the first authentication device 118 of the second embodiment.

The biometric information transmission unit 164 transmits a registered face image (second biometric information table 158) to the payment terminal 110 via the relay device 112. The authentication result receiving unit 166 receives the face authentication result from the payment terminal 110.

FIG. 8 is a sequence diagram showing a settlement processing process according to the second embodiment.
The payment terminal 110 acquires a user's face image when purchasing a product (S12). Here, it is assumed that the user's CID has been acquired before the product is purchased, and the second biometric information table 158 is also updated. The payment terminal 110 transmits input information including the GID of the product to the relay device 112 (S14), and the relay device 112 transmits this input information to the first authentication device 118 (S16). The biometric information transmission unit 164 transmits the second biometric information table 158 to the payment terminal 110 via the relay device 112 (S38, S40).

The payment terminal 110 collates the transferred second biometric information table 158 with the face image acquired in S12, and executes face authentication (S44). When the authentication fails, the payment terminal 110 does not allow the purchase of the product. Here, the following description will be given assuming that the authentication has been successful.

The payment terminal 110 transmits the authentication result (authentication success) to the first authentication device 118 (S44, S46) via the relay device 112, and the authentication result receiving unit 166 receives the authentication result. The subsequent processing process is the same as that after S20 in FIG.

The electronic payment system 100 has been described above based on the embodiment.
According to this embodiment, it is not necessary to charge the IC card with a large amount of cash in advance for electronic money payment. The user can purchase the product at the payment terminal 110 without interruption for charging. There is no need for "prepayment" called charging, and there is also the advantage that the financial burden on the user is reduced. The electronic money payment also includes a credit card payment.

By taking a face image and executing face authentication, unauthorized use due to the theft of the mobile terminal 104 (CID) is suppressed. It is considered that acquiring biometric information such as a face image on the payment terminal 110 greatly contributes to crime deterrence without actually performing face recognition.

In the first authentication device 118, the CID and the PID are associated with each other. On the other hand, the CID is registered in the mobile terminal 104 and the data storage unit 150, but the PID is not registered. The second authentication device 120 identifies the account number based on the PID. In other words, biometric authentication is executed based on the CID, and the balance is confirmed based on the PID. Since the second authentication device 120 has a PID but does not have a CID, the CID does not leak from the second authentication device 120. On the other hand, since the biometric information storage unit 160 and the mobile terminal 104 do not have the PID, the PID does not leak from the biometric information storage unit 160 or the like. Security is enhanced by performing two confirmation processes using two IDs, CID and PID.

The operational burden of the biometric authentication device 102 is also reduced. In the case of the method of charging the IC card, the charge amount (balance) recorded on the IC card is a "deposit", so the operator is obliged to strictly manage this. In the present embodiment, since the settlement is executed for each purchase of the product or the settlement is executed by short-term credit, there is an advantage that the operator is freed from the burden associated with the deposit management.

When the user enters the store 108, the store entry detection device 116 detects the CID from the mobile terminal 104. Further, even when the user leaves the store 108, the store entry detection device 116 detects the CID from the mobile terminal 104. With the store entry detection device 116, the first authentication device 118 can grasp the visitor. The store entry detection device 116 may detect the CID from the mobile terminal 104 by means of wireless communication such as Wi-Fi without making the user aware of it.

Next, the user selects a product to be purchased and causes the payment terminal 110 to take a face image. If a face image that matches the user's face image, or more strictly, has a similarity with the user's face image equal to or higher than the threshold value, is registered in the second biometric information table 158, electronic payment by credit card or the like is automatically performed. In other words, it is executed without forcing the user to perform additional work such as inputting a password and signing. The user does not need to bring a wallet or an IC card, but can complete the shopping simply by bringing a mobile terminal 104 or the like in which the CID is registered.

When the user's entry is detected, the first authentication device 118 updates the second biometric information table 158 in preparation for face recognition at the time of purchase. A face image of only a visitor is registered in the second biometric information table 158. Therefore, the number of face images registered in the second biometric information table 158 is much smaller than that in the first biometric information table. Since only the registered face image of the visitor registered in the second biometric information table 158 is the collation target, face authentication can be executed at high speed. In other words, since it is possible to secure a long collation time for each time, it becomes easy to perform highly accurate face recognition.

It is assumed that the unauthorized user P1 steals the mobile terminal 104 of the legitimate user P2 and then visits the store 108. In this case, since the CID of the regular user P2 is detected by the store entry detection device 116, the first authentication device 118 recognizes the regular user P2 as a visitor and downloads the registered face image of the regular user P2. Therefore, the face authentication of the unauthorized user P1 fails. Even if the CID is stolen by the fraudulent user P1, no fraudulent expenditure will be made from the bank account of the legitimate user P2.

Conventionally, when using a credit card, the person is often authenticated by a personal identification number or a signature. In this embodiment, a face image is used instead of a personal identification number or a signature. Face images have the advantages of higher identification and less input burden than passwords and the like. In addition, since the registered face images that are candidates for collation are narrowed down to those of visitors, there is an advantage that the processing time required for face authentication can be reduced.

The present invention is not limited to the above-described embodiment or modification, and the components can be modified and embodied within a range that does not deviate from the gist. Various inventions may be formed by appropriately combining a plurality of components disclosed in the above-described embodiments and modifications. In addition, some components may be deleted from all the components shown in the above embodiments and modifications.

Although the electronic payment system 100 has been described as being composed of the mobile terminal 104, the biometric authentication device 102, the relay device 112, the payment terminal 110, and the store entry detection device 116, some of the functions of the biometric authentication device 102 are the payment terminal 110 and the payment terminal 110. It may be realized by the relay device 112, or a part of the functions of the payment terminal 110 and the relay device 112 may be assigned to the biometric authentication device 102. Further, a third device other than the biometric authentication device 102, the payment terminal 110, and the relay device 112 may play a part of the functions of these devices.

The aggregate of the functions of the payment terminal 110, the relay device 112, and the biometric authentication device 102 described with reference to FIGS. 2 and 7 can be grasped as one "information processing device" in the broad sense. How to allocate the plurality of functions necessary for realizing the present invention to one or more hardware is determined in consideration of the processing capacity of each hardware, the specifications required for the electronic payment system 100, and the like. It may be decided.

Similarly, the first authentication device 118 and the second authentication device 120 may be integrally formed, or a part of the function of the first authentication device 118 may be configured as a part of the second authentication device 120. However, a part of the function of the second authentication device 120 may be configured as a part of the first authentication device 118, and the third device is a part of the function of the first authentication device 118 and the second authentication device 120. You may carry.

The payment terminal 110 may be a vending machine or a railroad ticket vending machine. The payment terminal 110 may be formed as a reception terminal of a hospital.

In the present embodiment, it has been described that the first authentication device 118 updates the second biometric information table 158 when the store entry detection device 116 detects the visit of the user. The second biological information table 158 is not limited to the site of the store 108, and may be targeted at a user who has entered a predetermined area in the store 108. For example, when the user enters within a predetermined range from the payment terminal 110, the store entry detection device 116 may detect the user's CID. The payment terminal 110 and the store entry detection device 116 may be formed as an integrated device. In addition, when the user enters the parking lot attached to the store 108, the store entry detection device 116 may detect the CID. In this case, the vehicle number may be used as the CID.

When targeting hospitals and hotels, the user may enter a CID when making a medical appointment via the Internet 106. The first authentication device 118 may prepare the second biometric information table 158 for the prospective visitor by downloading the biometric information corresponding to the CID from the biometric information storage unit 160 at the time of reservation. In any case, the acquisition of the CID and the update of the second biometric information table 158 may be executed before the actual purchasing action (face authentication). In other words, after the first step of acquiring the CID and updating the second biometric information table 158, the second step of executing face recognition may be executed.

When the face authentication fails, the authentication unit 142 may authenticate the user with additional authentication information (second ID) other than the face information. The additional authentication information may be a password or may be a type of biometric information different from the face image (first biometric information) such as a fingerprint or an iris. The first authentication device 118 prepares an ID table in which the CID and the additional authentication information are associated with each other. The first authentication device 118 compares the additional authentication information acquired from the user with the additional authentication information registered in the ID table, and permits the purchase of the product if the verification is successful (hereinafter, referred to as "additional authentication"). Further, when the authentication by the additional authentication information is successful, the face image obtained at this time may be newly registered in the first biometric information table. For example, suppose that a user (C01) fails in face recognition but succeeds in additional authentication. At this time, the biometric information acquisition unit 134 may newly register the face image acquired from the user (C01) as the face image of the user (C01).

A plurality of face images may be associated with one CID. For example, when the similarity between the face image F1 acquired from the user (C01) and the registered face image F2 is equal to or higher than the threshold value, the authentication unit 142 may also associate the face image F1 with C01. According to such a control method, the latest face image can be associated with the CID every time the face authentication is successful at the time of purchasing the product, so that the latest face image of the user can be easily retained as the registered face image.

The authentication unit 142 may change the authentication level according to the degree of similarity. For example, when the similarity of the face image is equal to or higher than the threshold value T1, the authentication unit 142 permits the purchase of the product, and when the similarity of the facial image is equal to or higher than the threshold value T2 and less than the threshold value T1, the authentication unit 142 permits the product to be additionally authenticated. You may allow the purchase. On the other hand, when the similarity of the facial images is less than the threshold value T2, the authentication unit 142 may not permit the purchase of the product. In addition to the degree of similarity, when the purchase price of the product is equal to or greater than the predetermined amount, the purchase of the product may be permitted on condition of not only face recognition but also additional authentication. Security may be prioritized when purchasing high-priced products, and processing efficiency may be prioritized when purchasing fixed-price products such as daily necessities.

When acquiring the face image, the user may be required to have a predetermined facial expression. For example, face recognition may be executed on condition that the face image is a winking face image or a tongue sticking out face image. Alternatively, face recognition may not be executed when such a predetermined facial expression is made. By setting not only the CID and the face image but also the facial expression as the authentication condition, the security level in the electronic payment system 100 can be easily improved. In addition to facial expressions, wearing items such as wearing a hat and poses such as putting the index finger on the nose may be used as authentication conditions.

According to the electronic payment system 100 in the present embodiment, the user can shop with a so-called "face pass" without having a wallet. The biometric authentication method shown in this embodiment can be widely applied when purchasing products and services. It is often troublesome to even buy coupon tickets, such as coupon tickets for attractions in amusement parks. According to the biometric authentication method shown in the present embodiment, if the CID is input when the amusement park is entered, the availability can be determined only by performing face authentication at the attraction.

When the payment terminal 110 detects the face images of a plurality of people during face authentication, the payment terminal 110 may let the payment target person be selected. For example, suppose that a user (C01) and a user (C02) visit a store and two people purchase a product. At this time, it is assumed that the payment terminal 110 acquires the face images of the two users, and the first authentication device 118 authenticates the faces of both of them. When the user (C01) pays, the user (C01) touches his / her own image among the images of the two people displayed on the touch panel screen of the payment terminal 110. At this time, the biometric authentication device 102 may execute the payment process for the account of the user (C01).

Face recognition is also effective for products that minors cannot purchase, such as alcohol and cigarettes. Currently, users can purchase alcohol and the like by self-declaring that they are over 20 years old. However, it is rare to make a strict age confirmation as to whether the person is actually over 20 years old, and the age confirmation by presenting an ID card significantly impairs the convenience of the user. The authentication unit 142 may calculate the estimated age from the face image by a known image recognition technique. Then, the user may be requested to strictly confirm the age only when the estimated age is less than 20 years old. In fact, most people can tell if they are minors just by looking at their faces. Therefore, for most users, it is possible to confirm the age of the user without requiring an explicit age confirmation. Only for users who are considered to be minors due to their baby-faced face, age confirmation with a driver's license or the like may be a purchase condition.

In the present embodiment, it has been described that the first biometric information table in which the biometric information of all registered users is registered and the second biometric information table 158 in which only the biometric information of the visitor is registered are used properly. It is not essential to use the second biometric information table 158, and the biometric authentication device 102 may perform face authentication by directly referring to the first biometric information table. For example, when the number of registered users is small and the face authentication can be executed at sufficiently high speed, the first authentication device 118 may execute the face authentication based on the first biometric information table.

In the present embodiment, as long as the user's bank account balance is equal to or greater than the purchase amount, the user can purchase the product. As a modification, a "withdrawal limit" may be set in the second authentication device 120.

The user's face changes with age. For example, children may change their faces as they grow up, and users may change their hairstyles. Therefore, it is desirable that the face image (first biometric information) associated with the first biometric information table be updated as appropriate. When the user's face image (second biometric information) is acquired, the authentication unit 142 collates the acquired face image with the registered face image. If the conformance rate is the first threshold value, for example, 80% or more, it is regarded as authentication success, and if it is less than 80%, it is regarded as authentication failure.

Here, if the matching rate is a second threshold value larger than the first threshold value, for example, 90% or more, the registered face image is not updated. On the other hand, when the conformance rate is equal to or higher than the first threshold value and lower than the second threshold value, for example, 80% or more and less than 90%, the authentication unit 142 registers the newly acquired face image as the face image for the next authentication. do. According to such a control method, it is possible to appropriately maintain the face image (first biometric information) for authentication while capturing a slight change in the face of the user. The newly registered face image may be used to update the face image registered in the past, or a new face image may be additionally registered while maintaining the face image registered in the past.

At the time of authentication in the payment terminal 110, there is a possibility that the face of a user other than the user who is trying to purchase the product is reflected in the camera of the payment terminal 110 and the face authentication is executed by the face of another person. Therefore, in face recognition, the user may clearly instruct the execution. For example, the authentication unit 142 may execute face authentication by pressing a predetermined determination button after the user has taken a face on the camera. The gesture instruction unit (not shown) of the payment terminal 110 displays on the screen or voice a gesture that is a preset face authentication start condition, such as "Please close your eyes" or "Please stare" to the user. You may instruct.

The CID may be registered in a mobile product other than the mobile terminal 104. For example, the CID may be registered in a readable state on a credit card, a mobile strap, a wristband, or the like. The CID may be registered in a wristband or the like as a two-dimensional code such as a QR code (registered trademark). The user may have the store entry detection device 116 read the CID by holding the wristband over the store entry detection device 116.

100 electronic payment system, 102 biometric authentication device, 104 mobile terminal, 106 internet, 108 stores, 110 payment terminal, 112 relay device, 114 payment device, 116 store entry detection device, 118 first authentication device, 120 second authentication device, 122 Communication unit, 124 Data processing unit, 126 Data storage unit, 128 Biometric information table communication unit, 130 ID acquisition unit, 132 Registration notification unit, 134 Biometric information acquisition unit, 136 Payment request unit, 138 Payment reception unit, 140 Purchase permission Department, 142 Authentication Department, 144 Entrance Management Department, 146 Communication Department, 148 Data Processing Department, 150 Data Storage Department, 152 Request Receiving Department, 154 Payment Request Department, 156 Payment Notification Department, 158 Second Biometric Information Table, 160 Biological Body Information storage unit, 162 account table, 164 biometric information transmission unit, 166 authentication result receiver unit, 170 charge table

Claims (10)

Equipped with first and second authentication devices,
The first authentication device is
Connected to the second authentication device via a communication line,
An ID acquisition unit that acquires the user's first ID,
The biometric information acquisition unit that acquires the second biometric information of the user,
With reference to the first biometric information table in which the user's first ID and the first biometric information are associated in advance, the first biometric information associated with the acquired first ID and the acquired biometric information are described. The authentication unit that authenticates the user by collating the second biometric information,
When it is determined to be conforming by authentication, a payment request unit that transmits a third ID associated with the first ID in advance to the second authentication device and requests payment of the price of the product purchased by the user. When,
A payment receiving unit that receives a first payment availability notification from the second authentication device, and a payment receiving unit.
Includes a purchase permission unit that permits the purchase of the product when payment is permitted by the second authentication device.
The second authentication device is
It is connected to the payment device and the first authentication device via a communication line,
A request receiving unit that receives a payment request including the third ID from the first authentication device, and a request receiving unit.
A payment request unit that requests the payment device to settle the charges for the product , with the user corresponding to the third ID as the payer .
A biometric authentication device including a payment notification unit that transmits the first payment permission notification to the first authentication device when the second payment permission notification is received from the payment device. The biometric information is a facial image,
The authentication unit uses the facial image when the user makes a predetermined facial expression or a facial expression other than the predetermined facial expression as the second biometric information, and performs authentication based on the first biometric information and the second biometric information. The biometric authentication device according to claim 1, wherein the biometric authentication device is performed. The claim is characterized in that the authentication unit authenticates the user when any of the plurality of first biometric information associated with the acquired first ID in advance matches the second biometric information. Item 2. The biometric authentication device according to Item 1 or 2 . The ID acquisition unit acquires the first ID of the user before the user designates the product to be purchased.
When the first ID is acquired, the authentication unit registers the first biometric information previously associated with the first ID in the first biometric information table in the second biometric information table.
The biometric information acquisition unit acquires the second biometric information when the user purchases the product.
The claim is characterized in that the authentication unit authenticates the user by collating the acquired second biometric information with the first biometric information registered in the second biometric information table. The biometric authentication device according to any one of 1 to 3 . When the authentication based on the first biometric information and the second biometric information fails, the ID acquisition unit further acquires the second ID of the user.
The authentication unit refers to an ID table in which the first ID and the second ID are associated in advance, and is the acquired combination of the first ID and the second ID registered in the ID table? The biometric authentication device according to any one of claims 1 to 4 , wherein the user is authenticated by determining whether or not the user is used. When the authentication unit succeeds in authentication based on the first ID and the second ID, the acquired second biometric information is used as new first biometric information corresponding to the first ID. The biometric authentication device according to claim 5, wherein the biometric authentication device is registered in the first biometric information table. When the authentication unit succeeds in authentication based on the first biometric information and the second biometric information, the authentication unit uses the second biometric information as a new first biometric information corresponding to the first ID. The biometric authentication device according to any one of claims 1 to 6, wherein the biometric authentication device is registered in a first biometric information table. When the authentication unit matches two or more of the first biometric information and the acquired second biometric information among the plurality of first biometric information associated with the acquired first ID in advance. The biometric authentication device according to any one of claims 1 to 7 , wherein the user is authenticated. Further, a registration notification unit for instructing the user to re-register the first biometric information when a predetermined valid period has elapsed since the first biometric information was registered in the first biometric information table. The biometric authentication device according to any one of claims 1 to 8, wherein the biometric authentication device is provided. Equipped with first and second authentication devices,
The first authentication device is
Connected to the second authentication device via a communication line,
An ID acquisition unit that acquires the user's first ID,
A biometric information transmission unit that transmits the first biometric information associated with the first ID to the payment terminal in advance.
An authentication result receiving unit that receives the biometric authentication result from the payment terminal,
When it is determined to be conforming by authentication, a payment request unit that transmits a third ID associated with the first ID in advance to the second authentication device and requests payment of the price of the product purchased by the user. When,
A payment receiving unit that receives a first payment availability notification from the second authentication device, and a payment receiving unit.
Includes a purchase permission unit that permits the purchase of the product when payment is permitted by the second authentication device.
The second authentication device is
It is connected to the payment device and the first authentication device via a communication line,
A request receiving unit that receives a payment request including the third ID from the first authentication device, and a request receiving unit.
A payment request unit that requests the payment device to settle the charges for the product , with the user corresponding to the third ID as the payer .
A biometric authentication device including a payment notification unit that transmits the first payment permission notification to the first authentication device when the second payment permission notification is received from the payment device.

Images