KR102363313B1 - Method for performing payment through identification using facial image and system implementing the same - Google Patents

Abstract

Disclosed is a method in which an identity authentication system performs identity authentication based on a face image and utilizes an identity authentication result. According to an embodiment of the present invention, the method of performing self-authentication and using a self-authentication result of the self-authentication system includes the steps of: detecting a user's face image through an image detection unit; extracting first vector data of the detected face image; transmitting the extracted first vector data to a user terminal; and performing identity authentication by receiving whether first vector data and second vector data registered in the user terminal match from the user terminal.

Description

A method for performing payment through identity authentication using a facial image and a system for performing the same

Various embodiments of the present invention relate to a technology for performing user authentication using a face image and performing payment using a user authentication result.

With the development of technology, a self-authentication function using biometric information is being used in various fields.

Most fundamentally, fingerprint recognition is actively used in fields such as user authentication on terminals such as smartphones and user authentication in door opening and closing systems.

However, in a situation where personal hygiene is emphasized due to infectious diseases such as Corona, there is a risk that fingerprint recognition devices in public places come into contact with multiple people's fingers. It was a necessary situation.

Even when authentication is performed through a face image, it has been mainly used for purposes such as opening and closing a door in the past.

Therefore, through devices provided in various stores, public institutions, public transportation, etc., identification is performed and payment is made using the identification result, and additionally, facial images are checked to check access records, movement records, etc. It was necessary to develop a device capable of simultaneously taking and recording body temperature.

In addition, it was important to manage the face image, which is personal information, in a form that is not stored in the server as much as possible when using the user authentication using the face image.

Korean Patent No. 10-2034040

Various embodiments of the present invention are to implement a system for conveniently performing a payment through a face image.

Various embodiments of the present invention are to enhance the security of the face image, which is personal information, in the payment process.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

According to one of the various embodiments of the present invention for solving the above-described problem, detecting the user's face image through the image detection unit; extracting first vector data of the detected face image; transmitting the extracted first vector data to a user terminal; Performing self-authentication of a self-certification system and utilizing the result of self-authentication, comprising the step of receiving from the user terminal whether the first vector data and the second vector data registered in the user terminal match and performing self-authentication A method may be disclosed.

The method for performing user authentication and using the identity authentication result of the identity authentication system may include: performing a payment request to a payment server based on user information for which the identity authentication has been performed; and receiving a payment result corresponding to the payment request from the payment server.

The transmitting of the extracted first vector data to the user terminal may include transmitting the first vector data to a user terminal located within a predetermined distance from a location where the image detection unit is installed.

The step of transmitting the first vector data to the user terminal located within a certain distance from the location where the image detection unit is installed may include: the user terminal located within a certain distance from the location where the image detection unit is installed through the display unit of the identity authentication system. displaying a list of user information; and receiving selection information on at least one of the displayed user information lists through the user authentication system, and transmitting the first vector data to a user terminal corresponding to the selected user information.

The extracting of the first vector data of the detected facial image may include transmitting the detected facial image to a management server and controlling the extraction of the first vector data from the facial image on the management server to be performed.

A method for performing self-authentication and using a self-authentication result of a self-authentication system includes: measuring a user's body temperature through the image detection unit; and recording the time at which the image detection unit detects the user's face image.

The management server may include a function of calculating a point in time when the body temperature of a specific user changes into an abnormal category through the change in body temperature of a specific user.

Transmitting the extracted first vector data to the user terminal may further include recognizing the user terminal through a phone number or a personal identification number (PIN).

Communication between the identity authentication system and the user terminal may be performed using at least one method of ultra wideband (UWB), near field communication (NFC), Bluetooth, ultrasound, MAT, or beacon.

In the method of performing user authentication and utilizing a result of identity authentication of the identity authentication system, the payment request may be a payment request using a payment method previously specified through the user terminal.

In the method of performing identity authentication and using the identity authentication result of the identity authentication system, the payment request may be a payment request using a payment method preset to correspond to the feature value through the feature value of the first vector data.

A method of performing self-authentication and using a self-authentication result of a self-authentication system includes: detecting an image of a user's other body part, not the user's face image, through the image detection unit; and extracting a feature value of the detected body part image, wherein the payment request may be a payment request using a payment method previously designated to correspond to the feature value through the feature value of the detected body part image. .

The self-authentication system may be mounted in an unmanned vending device or an article delivery device, and based on the results of identity authentication and payment, the product is provided by the unmanned vending device or the article delivery device, or the unmanned vending device or the article is delivered The switchgear of the appliance may be operated.

The user terminal may request additional authentication from the user when the first vector data and the second vector data match, and transmit the identity authentication information to the identity authentication system only when the additional authentication is completed.

The face image may be deleted from the identity authentication system after extraction of the first vector data through the face image is completed.

The method of performing self-authentication and using the self-authentication result of the self-authentication system includes: transmitting the extracted first vector to a management server; and receiving, from the management server, whether the first vector data and the second vector data registered in the management server match. It may be characterized in that it is performed based on whether the vector data received from the management server matches.

According to another one of various embodiments of the present invention for solving the above-described problems, an image detection unit for detecting a user's face image; a vector data extraction unit for extracting first vector data of the detected face image; a vector data transmitter for transmitting the extracted first vector data to the user terminal; and an authentication result receiver configured to receive from the user terminal whether the first vector data and the second vector data registered in the user terminal match and perform identity authentication.

According to the embodiment of the present invention, the comparison of vector data is performed by the face recognition algorithm on the user terminal, so that the original face image is not stored in the server, so that a form of identity authentication with a low risk of personal information leakage is possible.

In addition, according to an embodiment of the present invention, user's convenience can be maximized because user authentication and payment can be performed through facial recognition without carrying a user terminal.

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a schematic diagram of an entire environment in which an identity authentication system according to an embodiment of the present invention operates.
2 is a block diagram schematically showing the configuration of an identity authentication system according to an embodiment of the present invention.
3 is a flowchart illustrating a method of providing a payment service through facial authentication to a user by the identity authentication system according to an embodiment of the present invention.
4 is a flowchart illustrating a process in which the identity authentication system generates an electronic access list based on the user's body temperature and access time information according to an embodiment of the present invention.
5 is a flowchart for explaining a process of providing purchased goods through identity authentication when the identity authentication system according to an embodiment of the present invention is mounted in an article delivery device for delivery.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components. Like reference numerals refer to like elements throughout, and "and/or" includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various elements, these elements are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first component mentioned below may be the second component within the spirit of the present invention.

In the entire specification, when a part "includes" a certain element, this means that other elements may be further included, rather than excluding other elements, unless otherwise stated. In addition, terms such as "...unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software. .

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a schematic diagram of an entire environment in which an identity authentication system 100 according to an embodiment of the present invention operates.

Referring to FIG. 1 , the identity authentication system 100 may operate through interaction with the user terminal 200 , the management server 300 , and the external server 400 .

The identity authentication system 100 may be installed in various places such as a store selling goods, public transportation, and public institutions, and accordingly, a plurality of identity authentication systems 100 may be installed and utilized in a plurality of places.

The self-authentication system 100 may acquire data necessary for the operation by performing communication with the management server 300 to be described later, but the facial image itself obtained through photographing is transmitted to the management server 300 or the user terminal 200 . It is also possible to improve the security level of the facial image, which is important personal information, by storing it in the identity authentication system 100 without transmitting it or deleting it after using it.

The identity authentication system 100 may extract the first vector data through the facial image, and this first vector data is extracted based on the facial image registered by the user in the user terminal 200 and is displayed on the user terminal 200 . It can be distinguished from the second vector data stored in .

The extraction of the first vector data through the face image may be made within the identity authentication system 100 itself installed in a limited area such as a store, public transportation, or a public institution, but the identity authentication system 100 manages the face image by the management server ( When transmitted to 300), the management server 300 may extract the first vector data based on the corresponding face image.

The identity authentication system 100 receives the result when the user terminal 200 receives the first vector data and performs identity authentication through it, and performs payment for a specific product or service when identity authentication is completed. can

According to an embodiment of the present invention, the identity authentication system 100 measures the user's body temperature in addition to performing identity authentication through the face image and payment for goods or services according to the result. You can create and manage an electronic access list of places.

The user terminal 200 may be configured as a terminal controlled by a user (consumer) who wants to receive payment-related services provided by the identity authentication system 100 .

The user terminal 200 is controlled by the user, and it is possible to access the identity authentication system 100 and the management server 300 through a web browser or computer software or application installed on the user terminal 200 . The user terminal 200 may send and receive various data with the identity authentication system 100 and the management server 300, and based on the data received from the system and the server, the screen (display unit) of the user terminal 200 ) to determine what to display.

The user terminal 200 is a mobile phone, a smart phone, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet PC, etc. all kinds of handheld-based that can be connected to a web server through a network. It may include a wireless communication device, and among digital devices equipped with memory means and equipped with a microprocessor, such as personal computers (eg, desktop computers, notebook computers, etc.), workstations, PDA's, web pads, etc. It could be one.

The user terminal 200 may capture and obtain a facial image of the user through a camera unit, etc., extract second vector data from the acquired facial image, and store it in the user terminal 200 .

In addition, various payment information registered by the user may be included in the user terminal 200 . The payment information may include card information, simple payment information, account transfer information, various point information, and the like.

A user may have to register his/her user information on the management server 300 in order to receive a payment service through a facial image provided by the identity authentication system 100 of the present invention. In this case, the user may register user information and information on the user terminal 200 on the management server 300 through the user terminal 200 .

User information registered in the management server 300 through the user terminal 200 may include an ID, name, gender, mobile phone number, address, e-mail address, service identification number, etc., for the user terminal 200 The information may include a Personal Identification Number (PIN) number, an International Mobile Equipment Identity (IMEI), and the like.

The management server 300 controls and manages the plurality of identity authentication systems 100 , and may serve to store information about the user and information about the user terminal 200 , and according to an embodiment, identity authentication The facial image of the user obtained through the system 100 may be transmitted to the management server 300 to extract the first vector data.

The external server 400 is a server that exists separately from the management server 300, and according to an embodiment, the external server 400 manages a financial institution server, a PG (Payment Gateway) server, and an electronic access list for performing payment. It may be composed of a server that

According to an embodiment of the present invention, the communication network used by the identity authentication system 100 , the user terminal 200 , the management server 300 , and the external server 400 to communicate has its communication mode such as wired and wireless. It may be configured regardless of, and for example, a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN) may be implemented as various communication networks. Preferably, the communication network according to an embodiment of the present invention may be a known World Wide Web (WWW) or the like.

In addition, the communication network used by the identity authentication system 100 to communicate with the user terminal 200 locally is to be built using technologies such as UWB (Ultra Wideband), NFC (Near Field Communication), ultrasound, MAT, and beacon. can

2 is a block diagram schematically showing the configuration of the identity authentication system 100 according to an embodiment of the present invention.

Referring to FIG. 2 , the identity authentication system 100 includes an image detection unit 110 , a vector data extraction unit 120 , a vector data transmission unit 130 , an authentication result receiving unit 140 , a payment execution unit 150 , and body temperature. It may be configured to include a management unit 160 , an access list management unit 170 , an article management unit 180 , a communication unit 191 , a storage unit 192 , and a control unit 193 .

The image detector 110 may be configured as a device capable of photographing and storing an image, such as a camera or a camcorder, and may recognize and store a human face in the process of capturing an image in real time.

The image detection unit 110 may operate as a built-in form of the identity authentication system 100 , but otherwise, the image detection unit 110 may receive an image obtained from a camera outside the identity authentication system 100 .

The image detection unit 110 according to an embodiment of the present invention may include not only a function of extracting a user's face image, but also a function of measuring a user's body temperature and an electronic access list management function.

When the image detection unit 110 additionally includes a function of measuring a user's body temperature, the image detection unit 110 may be configured in the form of a thermal imaging camera or the like. In addition, the image detection unit 110 records the time at which the user's face image is detected so that the access list management unit 170, which will be described later, manages the access list of a specific place through such time information and user information.

The vector data extractor 120 may extract vector data of the face image based on the face image detected by the image detector 110 . According to an embodiment, various types of algorithms such as PCA, LDA, and EBGM may be used as the face recognition algorithm using vector data, but is not limited thereto.

According to an embodiment, the vector data extraction unit 120 may extract the first vector data from the facial image by itself, but otherwise, the detected facial image is transmitted to the management server 300 and on the management server 300 . A first vector data extraction from the facial image may be performed.

According to an embodiment, the vector data extraction unit 120 may control the facial image to be deleted from the self-authentication system 100 after the extraction of the first vector data is completed through the facial image.

In this way, after the vector data for authentication is extracted based on the user's face image, the face image is deleted, so that the security level for the face image, which is personal information, can be improved. Even when vector data extraction is performed on the management server 300 , when vector data is extracted based on the facial image similarly, the corresponding facial image may be deleted on the management server 300 .

Vector data extraction may be implemented through Open API technology, and vector data extraction through such a technology may be performed through the identity authentication system 100 , the user terminal 200 , or the management server 300 .

The vector data transmitter 130 may transmit the first vector data extracted based on the face image detected by the image detector 110 to the user terminal 200 . The vector data transmitter 130 may additionally transmit the first vector data to the management server 300 or a separate cloud server.

In such a transmission of the first vector data, the vector data transmission unit 130 recognizes the user terminal 200 based on a phone number or PIN and transmits the first vector data to the recognized user terminal 200 . This can be done in a way that transmits

Such first vector data transmission may be performed in a form directly transmitted from the identity authentication system 100 to the user terminal 200 , and vector data transmission when the first vector data extraction is performed by the management server 300 . The unit 130 may control so that the first vector data is transmitted from the management server 300 to the user terminal 200 side.

According to an embodiment of the present invention, the vector data transmission unit 130 transmits the first vector data extracted from the detected face image to the user terminal 200, a predetermined distance from the location where the image detection unit 110 is installed. The first vector data may be transmitted to the user terminals 200 located within.

For example, when the identity authentication system 100 is installed in a specific store, when the identity authentication system 100 detects a user's face image, a plurality of user terminals 200 located in the store are extracted through the facial image. 1 Vector data can be transmitted.

In this process, the identity authentication system 100 transmits the first vector data to the user terminals 200 located within a predetermined distance from the location where the image detection unit 110 is installed, the display of the identity authentication system 100 A list of user information on the user terminal 200 located within a predetermined distance from the location where the image detection unit 110 is installed may be displayed through a unit (not shown).

In the process of capturing the user terminal 200 located within a predetermined distance from the location where the image detection unit 110 is installed, the identity authentication system 100 is configured to utilize the function of the Global Positioning System (GPS) of the user terminal 200 . can

That is, the user terminals 200 may continuously generate location information of the terminal through GPS, and the identity authentication system 100 recognizes the user's biometric information (facial image) and is designated by the identity authentication system 100 . Various data including the first vector data may be transmitted to the user terminal 200 located within a predetermined distance from a specific location.

In this case, the user may select his/her own information from the list of user information displayed on the display unit of the self-authentication system 100 to control transmission of the first vector data to his/her user terminal 200 .

For example, the user information displayed on the display unit of the identity authentication system 100 may consist of a part or all of a user name, a nickname, and a phone number, and the user uses his/her own information among the list displayed on the display unit through this. can be selected.

According to another embodiment of the present invention, the self-authentication system 100 receives user information or information about the user terminal 200 from the user after acquiring a facial image through the image detection unit 110 and adds the information to the received information. The first vector data may be transmitted to the corresponding user terminal 200 .

When the user is authenticated by the user terminal 200, if it is set so that payment can be performed immediately even if additional manipulation or control of the user terminal 200 is not performed, this configuration allows the user to use the user terminal ( 200), payment can be made through the face image even when not carrying.

The authentication result receiving unit 140 may receive from the user terminal 200 whether the first vector data and the second vector data registered in advance on the user terminal 200 match, and perform user authentication based on this. . When the first vector data and the second vector data match, the authentication result receiving unit 140 may receive user information to be authenticated from the user terminal 200 .

When a user registers a facial image on the user terminal 200, it is transmitted to the management server 300 or the cloud server, and the corresponding facial image on the management server 300 or the cloud server is deep learning technology. Binary data for the facial image is generated using the , and the original facial image may be deleted on the management server 300 or the cloud server.

Additionally, when a user registers a facial image on the user terminal 200 , the user terminal 200 may store binary data for the facial image through deep learning technology. Even in this case, the facial image used to generate the binary data may be deleted on the user terminal 200 . In this way, binary data may be simultaneously distributed and stored in the user terminal 200 and the management server 300 .

The binary data generated or stored on the user terminal 200 , the management server 300 , or a separate cloud server may include phone number information.

According to an embodiment of the present invention, user authentication may be performed not only on the user terminal 200 but also on the management server 300 or a separate cloud server. Since the binary data includes phone number information, when a user uses the identification system 100, authentication can be performed without inputting his or her phone number into the identification system 100, the user terminal 200 and the management server In 300, security may be enhanced by performing double authentication, respectively.

According to an embodiment, the first vector data and the second vector data may be stored on the management server 300 , the cloud server, or the user terminal 200 in the form of binary data, respectively.

On the user terminal 200 , it may be determined whether the first vector data and the second vector data match through a face recognition algorithm, and the comparison of the vector data through such an algorithm is performed by software or an application installed on the user terminal 200 . can be performed by The coincidence of the first vector data and the second vector data may mean that a degree of coincidence that can probabilistically guarantee that the two vector data is the face of the same person is achieved.

The user terminal 200 may transmit the comparison result to the user authentication system 100 , and the authentication result receiver 140 may receive and process the result. The authentication result receiving unit 140 may control the payment procedure to be performed by the payment performing unit 150 to be described later when the user authentication is legally completed. On the other hand, if the identity authentication fails, authentication failure information or a re-authentication request It may be transmitted to the user through the user authentication system 100 or the user terminal 200 .

The authentication result receiving unit 140 may additionally receive whether the first vector data and the second vector data match from the management server 300 as well as the user terminal 200 . In this case, the user authentication is performed from the user terminal 200 . It may be performed based on whether the first vector data and the second vector data received from the management server 300 match as well as whether the received first vector data and the second vector data match. That is, by double determining whether the vector data matches or not, the effect of two-factor authentication may occur, and thus security may be strengthened. According to an embodiment, the cloud server may replace the role of the management server 300 in relation to two-factor authentication.

The user terminal 200 may request additional authentication from the user when the first vector data and the second vector data match, and transmit the identity authentication information to the identity authentication system 100 only when the additional authentication is completed. For example, even when user authentication is performed through a face image according to a user's settings, payment may be performed only when additional authentication by the user's fingerprint, password, certificate, etc. is completed.

When the payment performing unit 150 determines that the authentication result receiving unit 140 has successfully completed self-authentication, the payment performing unit 150 is based on the user information of the user whose self-authentication is performed through the matching of the first vector data and the second vector data. A payment request may be made to the payment server. As described above, the payment server may be one of the external servers 400 .

When performing a payment request, the payment performing unit 150 may transmit information on a payment method previously registered by the user through the user terminal 200 together with the payment server. The user can designate a payment method that he or she wants to use in advance through the user terminal when payment is performed by self-authentication through facial image recognition, and the user terminal 200 is the first vector data When information indicating that the and second vector data match is transmitted to the identity authentication system 100 , it may be transmitted together.

According to an embodiment of the present invention, a payment request by the payment performing unit 150 uses a payment method that is preset to correspond to the characteristic value through the characteristic value of the first vector data extracted based on the detected facial image. may be doing

For example, when the user recognizes a facial image for payment, the payment method may be determined differently according to the user's facial expression.

According to another embodiment of the present invention, an image of another body part of the user other than the face image of the user may be additionally detected through the image detection unit 110 . Such image detection of other body parts may be performed simultaneously with the moment the user's face image is extracted. In this case, a feature value of an image of a body part other than the face may be extracted, and such feature value extraction may be performed in the manner of the vector data extraction unit 120 described above.

In this case, the image detection unit 110 may perform a payment request so that a payment method previously designated by the user is used to correspond to the corresponding characteristic value through the characteristic value of the image of another body part instead of the face image.

For example, when the user makes a specific hand shape such as a V shape when taking a facial image, the image of the corresponding part is detected together, so that the payment can proceed in such a way that a specific credit card set to correspond to the corresponding motion is used. In case of any other operation, payment may be processed in a different payment method due to image detection of the corresponding part.

The body temperature management unit 160 may manage the user's body temperature information measured through the image detection unit 110 . The body temperature management unit 160 may display the measured user's body temperature through the display unit of the self-authentication system 100 , and may guide the measured body temperature by voice through an output device included in the self-authentication system 100 . .

When the user's body temperature is out of a preset normal temperature range, the body temperature manager 160 may notify the user through the above-described methods.

The body temperature management unit 160 may transmit the user's information together with the user's body temperature information to the management server 300 , and in this case, the management server 300 determines that the corresponding user's body temperature is an abnormal category through the change in body temperature of a specific user. The time of change can be calculated. That is, through this function, a change in body temperature of a specific user can be identified.

The access list management unit 170 may record the time at which the image detection unit 110 detects the user's face image, and may create and manage it in the form of an electronic access list.

According to an embodiment, the electronic access list information generated by the access list management unit 170 may be integratedly managed by the management server 300 .

When the identity authentication system 100 of the present invention is applied to a courier service field or an automatic sales field, the product management unit 180 may provide the product to a user who has made a payment. That is, the identity authentication system may be mounted in an unmanned vending machine or a product delivery device, and the unmanned vending machine may be configured in the form of a vending machine, an unmanned sales robot, a storage box, etc., and the product delivery device may be a drone or a delivery robot. It may be configured in the form of, etc.

In this case, the article management unit 180 controls the unmanned vending device or the article delivery device to provide goods to the user through the unmanned vending device or the article delivery device based on the user's identification and payment results, or the unmanned vending device or the article. By operating the opening and closing device of the delivery device, the user can obtain the purchased item.

The communication unit 191 enables the identity authentication system 100 to communicate with the user terminal 200 , the management server 300 , and the external server 400 . The communication network used by the communication unit 191 to perform communication may be configured regardless of the communication mode, such as wired and wireless, for example, a local area network (LAN), a metropolitan area network (MAN). It may be implemented in various communication networks, such as an area network) and a wide area network (WAN). As described above, the local area network may be implemented through Ultra Wideband (UWB), Near Field Communication (NFC), ultrasound, MAT, beacon, and the like.

The storage unit 192 serves to store information collected, generated, and processed in various components of the identity authentication system 100 . That is, the storage unit 192 may store information on users who use the identity authentication system 100 , information on user terminals, information on an algorithm for extracting vector data, and the like. The storage unit 192 may include, for example, a memory, a cache, a buffer, and the like, and may be composed of software, firmware, hardware, or a combination of at least two or more thereof.

The control unit 193 includes an image detection unit 110, a vector data extraction unit 120, a vector data transmission unit 130, an authentication result receiving unit 140, a payment execution unit 150, and a body temperature management unit in the identity authentication system 100. 160 , the access list management unit 170 , the article management unit 180 , the communication unit 191 , and the storage unit 192 may perform a function of controlling data flow. That is, the control unit 193 includes the image detection unit 110 , the vector data extraction unit 120 , the vector data transmission unit 130 , the authentication result receiving unit 140 , the payment execution unit 150 , the body temperature management unit 160 , and access. The list management unit 170 , the article management unit 180 , the communication unit 191 , and the storage unit 192 may support each to perform a unique function.

In FIG. 2 , the image detection unit 110 , the vector data extraction unit 120 , the vector data transmission unit 130 , the authentication result reception unit 140 , the payment execution unit 150 , the body temperature management unit 160 , and the access list management unit 170 . ) and the article management unit 180 may be configured to be integrated as one control unit 193 because the control unit 193 is functionally classified.

3 is a flowchart illustrating a method of providing a payment service through facial authentication to a user by the identity authentication system 100 according to an embodiment of the present invention.

Referring to FIG. 3 , when a user enters a specific place or stands in front of a device such as a camera to perform payment through a face image at the place, the identity authentication system 100 detects the user's face image through the camera It can be done (S310).

Thereafter, the identity authentication system 100 may transmit the detected facial image of the user to the management server 300 (S320), and the management server 300 may extract the first vector data from the received facial image ( S330). The first vector data extracted by the management server 300 may be transmitted to the user terminal 200 (S340).

According to another embodiment of the present invention, extraction of the first vector data from the detected facial image may not be performed on the management server 300 but may be made within the identity authentication system 100 itself.

The user terminal 200 may perform a comparison between the first vector data received from the management server 300 and the second vector data registered and stored by the user (S350). When the first vector data and the second vector data match, the user authentication is successfully performed, and the user terminal 200 transmits payment information to the identity authentication system 100 together with information indicating that the user authentication is successful in this case. It can be (S360).

The identity authentication system 100 may receive payment information from the user terminal 200 and transmit a payment request to the payment server through the corresponding payment information (S370). Although a separate payment server is not shown in FIG. 3 , the payment server may communicate with the identity authentication system 100 as one of the external servers 400 .

The identity authentication system 100 may then receive a payment result from the payment server (S380), and transmit the received payment result information to the user terminal 200 (S390).

4 is a flowchart illustrating a process in which the identity authentication system 100 generates an electronic access list based on a user's body temperature and access time information according to an embodiment of the present invention.

Referring to FIG. 4 , the identity authentication system 100 detects the user's face image through the thermal imaging camera (S410), and can also measure the user's body temperature through the thermal imaging camera, and the facial image detection is performed. It is possible to record the time information to be (S420)

Thereafter, the identity authentication system 100 may extract the first vector data from the face image (S430), and transmit the extracted first vector data to the user terminal 200 (S440). Unlike the example in FIG. 3 , the extraction of the first vector data is shown to be made by itself in the identity authentication system 100 rather than the management server 300 , but as shown in FIG. 3 , the first vector data is extracted by the management server 300 . Extraction of data may also be made.

The user terminal 200 compares the received first vector data with the second vector data stored in advance (S450), and when the first vector data and the second vector data match, the user authentication information is authenticated. It can be transmitted to the system 100 (S460).

The self-authentication system 100 may transmit body temperature information and access time information along with user information to the management server 300 ( S470 ), and the management server 300 creates an electronic access list based on the received information. It can be created and managed (S480).

In this way, in the process illustrated in FIG. 4 , the self-authentication system 100 does not perform payment through self-authentication through a facial image, and generates an electronic access list by using the measured body temperature and entry time record and user information. and can be managed.

5 is a flowchart for explaining a process of providing purchased goods through identity authentication when the identity authentication system 100 according to an embodiment of the present invention is mounted in an article delivery device for delivery.

That is, the identity authentication system 100 may be mounted on a device such as a drone or an unmanned delivery robot, or alternatively, it may be mounted on a device managed by a person who delivers goods.

The self-authentication system 100 may receive and store information about the goods to be delivered (eg, information of a purchased user) from the management server 300 in advance, and accordingly, in the process of FIG. 5 , the management server 300 Identity authentication and product delivery may be performed without communication with the .

The identity authentication system 100 may detect a facial image of the user who wants to receive the goods delivered through the camera (S510). Thereafter, the identity authentication system 100 may extract the first vector data from the facial image (S520), and transmit the extracted first vector data to the user terminal 200 (S530).

The user terminal 200 may perform a comparison between the first vector data received from the identity authentication system 100 and the second vector data registered and stored by the user (S540), and the result of the comparison is the first vector data When it is determined that the and second vector data match, the user authentication information may be transmitted to the user authentication system 100 (S550).

The identity authentication system 100 may deliver the goods purchased by the user to the user based on the identity authentication information received from the user terminal 200 (S560).

As described above, according to various embodiments of the present invention, the user can conveniently perform payment through a face image, and can perform payment even in a situation where the user terminal is not carried.

In addition, as payment is performed in a non-face-to-face environment, human costs can be saved, and the security of personal information can be strengthened as authentication is performed in a biometric decentralized identification (DID).

The steps of a method or algorithm described in relation to an embodiment of the present invention may be implemented directly in hardware, as a software module executed by hardware, or by a combination thereof. A software module may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any type of computer-readable recording medium well known in the art to which the present invention pertains.

In the above, the embodiments of the present invention have been described with reference to the accompanying drawings, but those skilled in the art to which the present invention pertains know that the present invention may be embodied in other specific forms without changing the technical spirit or essential features thereof. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

100: identity authentication system
200: user terminal
300: management server
400: external server

Claims (17)

In a method for the identity authentication system to perform identity authentication based on a face image and utilize the identity authentication result,
detecting a user's face image through an image detection unit;
extracting first vector data of the detected face image;
transmitting the extracted first vector data to a user terminal;
performing identity authentication by receiving from the user terminal whether the first vector data and the second vector data registered in the user terminal match;
performing a payment request to a payment server based on the user information for which the user authentication has been performed;
receiving a payment result corresponding to the payment request from the payment server;
measuring the user's body temperature through the image detection unit;
recording the time at which the image detection unit detects the user's face image; and
Calculating the time when the body temperature of a specific user changes to an abnormal category through the change in body temperature of a specific user;
Transmitting the extracted first vector data to the user terminal comprises:
The method further comprising the step of transmitting the first vector data to a user terminal located within a predetermined distance from the location where the image detection unit is installed,
Transmitting the first vector data to a user terminal located within a predetermined distance from the location where the image detection unit is installed,
displaying a list of user information of a user terminal located within a predetermined distance from a location where the image detection unit is installed through a display unit of the identity authentication system; and
Receiving selection information on at least one or more of the displayed user information list through the user authentication system, and transmitting the first vector data to a user terminal corresponding to the selected user information,
The payment request is a payment request using a predetermined payment method to correspond to a user's expression recognized through the feature value of the first vector data.
delete delete delete According to claim 1,
The step of extracting the first vector data of the detected face image,
Transmitting the detected facial image to the management server and controlling the first vector data extraction from the facial image on the management server to be performed, a method of performing self-authentication of the self-authentication system and utilizing the self-authentication result.
delete delete According to claim 1,
Transmitting the extracted first vector data to the user terminal comprises:
The method further comprising the step of recognizing the user terminal through a phone number or a PIN (Personal Identification Number).
According to claim 1,
Communication between the identity authentication system and the user terminal,
A method of performing self-authentication of the self-authentication system and utilizing the self-authentication result, which is performed using at least one method of UWB (Ultra wideband), NFC (Near Field Communication), Bluetooth, ultrasound, MAT, or beacon .
delete delete delete According to claim 1,
The self-authentication system is mounted in an unmanned sales device or a product delivery device,
Based on the results of identification and payment, the product is provided by the unmanned vending device or the product delivery device, or an opening and closing device of the unmanned vending device or the product delivery device is operated. How to perform and use your identity verification results.
According to claim 1,
The user terminal,
When the first vector data and the second vector data match, additional authentication is requested from the user and the identity authentication information is transmitted to the identity authentication system only when the additional authentication is completed, performing identity authentication of the identity authentication system and How to use the identity verification results.
According to claim 1,
The face image is a method of performing self-authentication of a self-certification system and utilizing a result of self-authentication, characterized in that the facial image is deleted from the self-certification system after the extraction of the first vector data through the face image is completed.
According to claim 1,
transmitting the extracted first vector to the management server; and
The method further comprises the step of receiving, from the management server, whether the first vector data and the second vector data registered in the management server match,
Self authentication is performed based on whether the vector data received from the user terminal matches and whether the vector data received from the management server matches.
In the identity authentication system that performs identity authentication based on a face image and uses the identity authentication result,
an image detection unit for detecting a user's face image;
a vector data extraction unit for extracting first vector data of the detected face image;
a vector data transmission unit for transmitting the extracted first vector data to a user terminal located within a predetermined distance from a location where the image detection unit is installed; and
an authentication result receiver configured to receive from the user terminal whether the first vector data and the second vector data registered in the user terminal match, and perform user authentication;
a payment performing unit for performing a payment request to a payment server based on the user information for which the user authentication has been performed, and receiving a payment result corresponding to the payment request from the payment server;
a body temperature management unit measuring the user's body temperature through the image detection unit and calculating a point in time when the user's body temperature changes to an abnormal category through a change in body temperature of a specific user; and
and an access list management unit that records the time at which the image detection unit detects the user's face image,
The first vector data transmission of the vector data transmission unit,
Displaying a list of user information of a user terminal located within a certain distance from the location where the image detection unit is installed through the display unit of the identity authentication system,
receiving selection information on at least one of the user information lists displayed through the display unit, and transmitting the first vector data to a user terminal corresponding to the selected user information;
The payment request is a payment request using a predetermined payment method to correspond to a user's expression recognized through a feature value of the first vector data.

Images