WO2022220570A1

WO2022220570A1 - Payment method and payment system using user terminal or dedicated terminal installed in product transfer means

Info

Publication number: WO2022220570A1
Application number: PCT/KR2022/005330
Authority: WO
Inventors: 이선관; 박신영
Original assignee: 주식회사 고스트패스
Priority date: 2021-04-13
Filing date: 2022-04-13
Publication date: 2022-10-20
Also published as: US20240202695A1; EP4325410A1

Abstract

A payment method and a payment system using a user terminal are illustrated. A method for performing payment using a user terminal by a payment system according to an embodiment of the present invention may comprise the steps in which: the user terminal recognizes a product to be purchased; a seller terminal having recognized biometric information of a user transmits the biometric information of the user to the user terminal; the user terminal performs personal authentication according to whether the biometric information of the user received from the seller terminal coincides with biometric information pre-stored in the user terminal; and when the personal authentication is successfully performed on the user terminal, the user terminal performs payment for the product recognized via the user terminal.

Description

Payment method and payment system using a dedicated terminal installed in a user terminal or a means of transporting goods

Various embodiments of the present invention relate to a technology for performing an offline payment for a product or service using a biometric information recognition-based technology using a user terminal.

Various embodiments of the present invention relate to a technology for recognizing a product that a consumer wants to purchase and performing a payment using a dedicated terminal installed in a product transportation means.

As technology advances, payment methods for purchasing goods are also increasingly diversified. In particular, a lot of methods for performing payment through a smartphone, which almost everyone has at all times, are being developed.

Accordingly, at present, payment can be made using a disposable barcode or QR code generated by a smartphone, and a user can authenticate biometric information such as a facial image, iris, and fingerprint through a smartphone and perform payment accordingly. may be

However, the recognition of the product the user wants to purchase has generally been carried out by recognizing the barcode displayed on the product with a barcode reader of the store, or by recognizing the product and inputting it to a POS machine by an employee of the store.

Accordingly, when a buyer purchases a large number of products, it takes time to recognize the products in order to pay for them, and accordingly, when there are many customers in a specific store, congestion may occur at the place where the payment is performed.

Accordingly, there was a need for a new system capable of paying for purchased products in a more convenient and quick manner.

In addition, for example, the consumer may recognize a product to be purchased by using a camera or other means mounted on his/her smartphone and perform payment through the smartphone.

However, when a consumer purchases a large number of products, such as a large mart, it is inconvenient to recognize the products that the consumer wants to purchase one by one.

Accordingly, there is a need for a system that allows the user to automatically recognize and pay for the product that the consumer wants to purchase, even if the user does not directly recognize the product one by one using a terminal such as his or her smartphone.

In addition, even when the consumer does not have his or her smartphone in hand, it is possible to perform payment using a system that allows payment using a smartphone, or a method that minimizes the operation of a smartphone in hand. There was a need for a system that existed.

Various embodiments of the present invention have an object to establish a system in which recognition and payment for the selected product are automatically performed when selecting and purchasing an offline product.

Various embodiments of the present invention aim to build an automatic payment system in a manner that minimizes the operation of the terminal owned by the consumer offline.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

According to one of various embodiments of the present invention for solving the above-described problems, there is provided a method for a payment system to perform a payment using a user terminal, the method comprising: recognizing, by the user terminal, a product to be purchased; transmitting, by the merchant terminal recognizing the user's biometric information, the user's biometric information to the user terminal; performing, by the user terminal, identity authentication through whether the biometric information of the user received from the seller terminal matches the biometric information stored in advance on the user terminal; and performing, by the user terminal, payment for the product recognized through the user terminal when the user authentication is successfully performed on the user terminal, a method of performing a payment in a payment system may be disclosed.

The biometric information may include any one or more of fingerprint information, iris information, facial image information, vein information, electrocardiogram information, and voice information.

The merchant terminal recognizes the user terminal passing through the gate connected to the merchant terminal and transmits a payment request signal to the user terminal, and the user terminal sends a payment request signal to the product based on the payment request signal received from the merchant terminal. payment can be made for

In the step of recognizing the product to be purchased by the user terminal, when the external image of the product is collected by the image capturing unit mounted on the user terminal, the user terminal analyzes the external image of the collected product to determine the type of product and specifying the quantity.

The step of specifying the type and quantity of the product by analyzing the external image of the collected product by the user terminal is performed by an artificial intelligence engine mounted on the user terminal, wherein the artificial intelligence engine includes the appearance of the product. It may be to perform learning through images.

The step of the user terminal recognizing the product to be purchased may include obtaining, by the user terminal, information on the product through an electronic tag included in the product.

The step of recognizing the product to be purchased by the user terminal may include recognizing only the product located in a predetermined product storage means. In addition, the product storage means may be configured as a cart, basket or bag.

The user terminal may provide information on the total price of one or more products recognized as purchase target products through a display device or a sound generating device.

The step of recognizing the product to be purchased by the user terminal may include, when a barcode or QR code is recognized by the image capturing unit mounted on the user terminal, the type of product corresponding to the barcode or QR code collected by the user terminal may be specified.

In the step of recognizing the product to be purchased by the user terminal, the product whose barcode or QR code is recognized by the image capturing unit mounted on the user terminal specifies the type of product through the barcode or QR code, For a product whose barcode or QR code is not recognized on the image, the type of product may be specified by analyzing the external image of the product.

The step of recognizing, by the user terminal, a product to be purchased may be characterized in that it is a method of receiving product recognition information from a product recognition device connected to the seller terminal.

Communication between the user terminal and the seller terminal may be performed using at least one method of ultra wideband (UWB), near field communication (NFC), Bluetooth, ultrasound, MAT, or beacon.

In the user terminal performing payment for the product recognized through the user terminal, the user terminal is a QR code or barcode including information on at least one or more products recognized as a purchase target and payment method information. creating a; and performing, by the merchant terminal recognizing the QR code or barcode, payment based on product information and payment method information included in the QR code or barcode.

According to another one of various embodiments of the present invention for solving the above problems, a method for a payment system to perform a payment using a user terminal includes: recognizing, by the user terminal, a product to be purchased; recognizing, by the user terminal, the user's biometric information; performing, by the user terminal, identity authentication through whether the recognized biometric information and biometric information stored in advance on the user terminal match; and when the user authentication is successfully performed on the user terminal, the user terminal performs payment for the product recognized through the user terminal.

According to another one of the various embodiments of the present invention for solving the above-described problems, there is provided a payment system using a user terminal, the merchant terminal recognizing the user's biometric information and transmitting the user's biometric information to the user terminal; and the product to be purchased is recognized, the user's biometric information received from the seller terminal matches the user's biometric information stored in advance, and identity authentication is performed, and the product recognized when the identity authentication is successfully performed A payment system may be disclosed, including a purchaser terminal for performing a payment for .

According to one of various embodiments of the present invention for solving the above-described problems, in the method for a payment system to perform a payment using a dedicated terminal installed in a product transportation means, the dedicated terminal selects at least one purchase target product when it is determined that the recognized product is located in the product transportation means and includes the product as a preliminary purchase list; acquiring, by the dedicated terminal, identification information for performing payment for at least one or more products located in the product transportation means from the user, and acquiring biometric information of the user; transmitting, by the dedicated terminal, the biometric information and payment information to a user terminal recognized through the identification information; and performing, by the user terminal, self-authentication through the received biometric information, and performing payment for the product included in the preliminary purchase list through the payment information when self-authentication is successfully performed, A payment method of a payment system may be disclosed.

The identification information may be configured as a PIN number.

The payment method of the payment system may further include the step of receiving, by the dedicated terminal, whether the user terminal performs payment, and controlling opening and closing of an entrance means at a specific location upon completion of payment.

The payment method of the payment system may further include the step of receiving, by the dedicated terminal, whether the user terminal performs payment, and providing payment completion information to the user through a display unit or an audio output unit of the dedicated terminal. .

The dedicated terminal may transmit payment information to the user terminal only when receiving adult authentication-related information from the user terminal when there is a product requiring adult authentication among the recognized products.

If there is a product that requires adult authentication among the products recognized by the dedicated terminal, payment by the user terminal receiving the payment information may be controlled to be possible only when adult authentication is completed on the user terminal .

In the process of recognizing the product to be purchased by the dedicated terminal, when the external image of the product is collected by the image photographing unit mounted on the dedicated terminal, the exclusive terminal transmits the external image of the collected product to the management server, The type and quantity of the product may be specified through analysis on the management server.

The step of specifying the type and quantity of the product by analyzing the appearance image of the collected product by the management server is characterized in that it is performed by an artificial intelligence engine mounted in the management server, wherein the artificial intelligence engine includes the appearance of the product. Learning can be done through images.

The machine learning algorithm utilized by the AI engine may be configured as one of haar like, convolutional neural network (CNN), YOLO, or SSD.

The step of recognizing, by the dedicated terminal, a product to be purchased may include obtaining, by the dedicated terminal, information on the product through an electronic tag included in the product.

In the step of recognizing the product to be purchased by the dedicated terminal, when the barcode or QR code is recognized by the image capturing unit mounted on the dedicated terminal, the type of product corresponding to the barcode or QR code collected by the dedicated terminal may be specified.

In the step of recognizing the product to be purchased by the dedicated terminal, the product whose barcode or QR code has been recognized by the image capturing unit mounted on the dedicated terminal specifies the type of product through the barcode or QR code, For a product whose barcode or QR code is not recognized on the image, the type of product may be specified by analyzing the external image of the product.

According to one of various embodiments of the present invention for solving the above-described problems, in the method of performing a payment using a dedicated terminal connected to a camera installed in a product transportation means in a payment system, the dedicated terminal purchases at least one recognizing a target product and including the product as a preliminary purchase list when it is determined that the recognized product is located in the product transportation means; acquiring, by the dedicated terminal, identification information for performing payment for at least one or more products located in the product transportation means from the user, and acquiring biometric information of the user; transmitting, by the dedicated terminal, the biometric information and payment information to a user terminal recognized through the identification information; and performing, by the user terminal, self-authentication through the received biometric information, and performing payment for the product included in the preliminary purchase list through the payment information when self-authentication is successfully performed, A payment method of a payment system may be disclosed.

According to another one of various embodiments of the present invention for solving the above problems, in the payment system using a dedicated terminal installed in a product transportation means, at least one purchase target product is recognized and the recognized product is the product When it is determined that the product is located in the transportation means, the product is included in the preliminary purchase list, identification information for performing payment for at least one product located in the product transportation means is acquired from the user, and biometric information of the user is acquired. and a dedicated terminal for transmitting the biometric information and payment information to a user terminal recognized through the identification information; and a user terminal that performs identity authentication through the biometric information received from the dedicated terminal, and performs payment for the product included in the preliminary purchase list through the payment information when the identity authentication is successfully performed. A payment system may be disclosed.

According to an embodiment of the present invention, when a consumer selects an item to be purchased in a store, the consumer's terminal automatically recognizes it, and when the consumer goes out of the store or is located in a specific place, based on identity authentication through the consumer's biometric information Since the payment is made automatically, the convenience of product selection and payment by consumers may be increased.

According to an embodiment of the present invention, payment may be made through a dedicated terminal installed in a product transportation means, and payment may be performed through identity authentication even in a situation in which the consumer does not have his/her own terminal.

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a schematic diagram of an overall environment in which a payment system according to an embodiment of the present invention operates.

2 is a block diagram schematically showing the configuration of a user terminal according to an embodiment of the present invention.

3 is a diagram illustrating a method in which a user terminal according to an embodiment of the present invention recognizes and pays for a product by using the payment system of the present invention.

4 is a diagram illustrating a method in which a user terminal recognizes and pays for a product by using the payment system of the present invention according to another embodiment of the present invention.

5 is a schematic diagram of an entire environment in which a payment system according to an embodiment of the present invention operates.

6 is a block diagram schematically showing the configuration of a dedicated terminal according to an embodiment of the present invention.

7 is a block diagram schematically showing the configuration of a management server according to an embodiment of the present invention.

8 is a flowchart illustrating a method in which a dedicated terminal according to an embodiment of the present invention recognizes and pays for a product using the payment system of the present invention.

9A to 9B are flowcharts for explaining a method in which a dedicated terminal pays for a product requiring adult authentication for purchase according to an embodiment of the present invention.

A payment method and a payment system using a user terminal are shown. According to an embodiment of the present invention, there is provided a method for a payment system to perform a payment using a user terminal, the method comprising: recognizing, by the user terminal, a product to be purchased; transmitting, by the merchant terminal recognizing the user's biometric information, the user's biometric information to the user terminal; performing, by the user terminal, identity authentication through whether the biometric information of the user received from the seller terminal matches the biometric information stored in advance on the user terminal; and performing, by the user terminal, payment for the product recognized through the user terminal when the user authentication is successfully performed on the user terminal.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular also includes the plural, unless specifically stated otherwise in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components. Like reference numerals refer to like elements throughout, and "and/or" includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various elements, these elements are not limited by these terms, of course. These terms are only used to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may be the second component within the spirit of the present invention.

In the entire specification, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated. In addition, terms such as "...unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software. .

In this specification, a 'user' may mean a subject who purchases a specific product using the payment system of the present invention, and a 'seller' may mean a subject who sells a specific product using the payment system of the present invention. have.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a schematic diagram of an overall environment in which a payment system 10 according to an embodiment of the present invention operates.

Referring to FIG. 1 , the payment system 10 may be configured in a form including a user terminal 100 , a seller terminal 200 , a product recognition device 300 , a management server 400 , and an external server 500 . have.

The payment system 10 may be installed and utilized in a place that sells various products offline.

The user terminal 100 is a terminal used by a user to use the payment system 10 , and the user terminal 100 may recognize a product that the user wants to purchase through various methods and perform payment therefor.

The user terminal 100 is controlled by the user, and may access the management server 400 in the payment system 10 through a web browser or computer software or application installed on the user terminal 100 . The user terminal 100 may exchange various data with the seller terminal 200, the management server 400, and the external server 500 in the payment system 10, and based on such data, the user terminal 100 You can determine the content to be displayed through the screen (display unit) of

The user terminal 100 is a mobile phone, a smart phone, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet PC, etc. all kinds of handheld-based that can be connected to a web server through a network. Among digital devices that may include a wireless communication device, have a memory means such as a personal computer (eg, a desktop computer, a notebook computer, etc.), a workstation, a PDA, a web pad, and the like and a microprocessor equipped with a computing power It could be one.

The seller terminal 200 is a terminal used by the seller to use the payment system 10 , and the seller terminal 200 can manage information on products to be sold, and is a biometric device on the user terminal 100 . When self-authentication is performed based on the information, biometric information may be preferentially obtained and transmitted to the user terminal 100 side.

According to an embodiment of the present invention, biometric information used for identity authentication for payment may be composed of any one or a combination of fingerprint information, iris information, facial image information, vein information, electrocardiogram information, and voice information. .

The seller terminal 200 may be connected to various other devices installed at the place where the product is sold to perform communication, and these other devices may constitute the product recognition device 300 or the gate.

According to one embodiment, a gate is installed at a specific place (eg, an exit) of a place where various products are sold, and the gate recognizes the user terminal 100 passing through it and transmits information about the user terminal to the seller terminal ( 200), payment may be performed in such a way that the seller terminal transmits a payment request signal to the recognized user terminal 100 . The user terminal 100 may receive a payment request signal from the seller terminal 200 and perform payment accordingly.

The seller terminal 200 is controlled by the seller, and it can access the management server 400 in the payment system 10 through a web browser or computer software or an application installed on the seller terminal 200 . The seller terminal 200 may exchange various data with the user terminal 100, the management server 400, and the external server 500 in the payment system 10, and based on such data, the seller terminal 200 You can determine the content to be displayed through the screen (display unit) of

The merchant terminal 200 is a mobile phone, a smart phone, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet PC, etc. all kinds of handheld (Handheld) based that can be connected to the web server through the network. Among digital devices that may include a wireless communication device, have a memory means such as a personal computer (eg, a desktop computer, a notebook computer, etc.), a workstation, a PDA, a web pad, and the like and a microprocessor equipped with a computing power It could be one.

The product recognition device 300 recognizes information about the product when the user accesses and possesses the product that the user wants to purchase, and displays the user terminal 100 information of the user and information on the product the user accesses and possesses to the user terminal ( 100) or may be transmitted to the seller terminal 200 . A method of recognizing a product by the product recognition device 300 may be performed in the same or similar manner as a product recognition method of the user terminal 100, which will be described later.

Although the product recognition device 300 is illustrated in the form of a camera capable of collecting images in FIG. 1 , it may be configured as a barcode scanner or an electronic device capable of recognizing an electronic tag.

The management server 400 may manage data so that the payment system 10 operates smoothly and exchange necessary data with the user terminal 100 and the seller terminal 200 . For example, the management server 400 may collectively manage a plurality of offline stores, and accordingly, the seller terminals 200 located in the plurality of offline stores and the user terminal 100 for performing payment in the offline store. can communicate with them.

The external server 500 is a server that exists separately from the management server 400 , and according to an embodiment, the management server 400 obtains various data necessary for the smooth operation of the payment system 10 from the external server 500 . and the user terminal 100 or the seller terminal 200 may also acquire necessary data through communication with the external server 500 . For example, the external server 500 may be composed of a server managed by a wholesaler providing products to be sold, a credit card server for payment, a PG server, and the like.

The management server 400 and the external server 500 may include hardware such as a control unit having at least one processor, a communication module, a storage unit (eg, memory), or software for an algorithm operation.

According to an embodiment of the present invention, in order for the user terminal 100 , the seller terminal 200 , the product recognition device 300 , the management server 400 and the external server 500 to communicate within the payment system 10 , The communication network used may be configured regardless of its communication mode, such as wired and wireless, for example, a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN: wide). It can be implemented in various communication networks such as an area network). Preferably, the communication network according to an embodiment of the present invention may be a well-known World Wide Web (WWW) or the like.

In detail, communication between the user terminal 100 and the seller terminal 200 existing in a specific area for selling products is UWB (Ultra wideband), NFC (Near Field Communication), Bluetooth (Bluetooth), ultrasound, It may be configured in a form in which at least one method of MAT or beacon is utilized.

In addition, the user terminal 100 and the seller terminal 200 may check the location information of the user terminal 100 and the seller terminal 200 by utilizing a Global Positioning System (GPS) and generate data on the location information. .

2 is a block diagram schematically showing the configuration of the user terminal 100 according to an embodiment of the present invention.

Referring to FIG. 2 , the user terminal 100 includes an image capturing unit 110 , a product recognition unit 120 , an identity authentication performing unit 130 , a product information providing unit 140 , a product payment performing unit 150 , It may be configured to include a communication unit 160 , a storage unit 170 , and a control unit 180 .

The image capturing unit 110 may generate an image by visually capturing the periphery of the user terminal 100 , and the image may be configured in the form of a picture in a still state, but may also be configured in the form of an image composed of a plurality of frames. have.

When the user terminal 100 is located in a specific space utilizing the payment system 10, the image capturing unit 110 may automatically operate without user manipulation to perform image capturing. In order to utilize 10), when a specific application is executed on the user terminal 100, image capturing may be performed.

The product recognition unit 120 may recognize a product that the user wants to purchase in the vicinity of the user terminal 100 through various methods.

According to an embodiment, the method for the product recognition unit 120 to recognize a product to be purchased may be through image analysis. That is, the external image of the product is analyzed by the image capturing unit 110 mounted on the user terminal 100 to specify the type and quantity of the product.

In this way, the product recognition unit 120 may recognize a product to be purchased and accumulate information on the product in the form of a 'shopping basket' on the user terminal 100 .

The product recognition unit 120 may recognize and analyze only the image of the object picked up by the user in analyzing and collecting the external image of the product. That is, the product recognition unit 120 may recognize only the items picked up by the user through image analysis, rather than recognizing all products present on the photographed image and classifying them as purchase target products.

According to an embodiment, the product recognition unit 120 may recognize the purchase target product by recognizing a barcode or QR code displayed on the purchase target product, not by analyzing the external image of the product.

The product recognition unit 120 recognizes the barcode or QR code present on the image photographed by the image photographing unit 110, specifies the type and number of products corresponding to the collected barcode or QR code, and selects the purchase target It can be managed as a product.

According to an embodiment of the present invention, when the product recognition unit 120 recognizes the purchase target product based on the image photographed by the image capturing unit 110 , a method of analyzing the external image of the product, and You can comprehensively utilize the displayed barcode or QR code.

In detail, when the product recognition unit 120 recognizes the product to be purchased, the product whose barcode or QR code is recognized by the image capturing unit 110 specifies the type of product through the recognized barcode or QR code. And, for products whose barcode or QR code is not recognized on the collected images, the type of product can be specified through the analysis of the external image of the product.

That is, since only a part of the product may appear in the image of the product photographed by the image capturing unit 110, the barcode or QR code displayed on the product may not be recognized, so the product recognition method through external image analysis is used together. This can increase the accuracy of product recognition.

The product recognition unit 120 according to an embodiment may additionally include an artificial intelligence management unit 121 and an electronic tag management unit 122 .

The artificial intelligence management unit 121 analyzes the external image of the product obtained by the product recognition unit 120 by the image capturing unit 110 to specify the type and quantity of the product, and the product recognition unit 121 is installed in the user terminal 100. Let it be done through an artificial intelligence engine.

The artificial intelligence engine included in the artificial intelligence management unit 121 may utilize machine learning or deepnering technology. The artificial intelligence engine can improve image analysis ability by setting a plurality of product images as learning data and performing learning through the set learning data.

Machine learning utilized by the artificial intelligence engine is haar like, convolutional neural network (cnn), and convolutional neural network-based transformation model (R-CNN, Fast R-CNN, Faster R-CNN, YOLO, SSD). , Mask R-CNN) may be used at least one algorithm.

Such an artificial intelligence engine may be implemented in software in the user terminal 100 .

The electronic tag management unit 122 allows the user terminal 100 to acquire product information in an electronic tag recognition method rather than an image-based method acquired by the image capturing unit 110 when the user terminal 100 recognizes a product to be purchased. do.

The electronic tag may be applied in a form utilizing RFID (Radio Frequency Identification) and NFC (Near Field Communication) technology, and the electronic tag may be included or attached to each product in a form including product information including a price.

The electronic tag management unit 122 may recognize an electronic tag located within a predetermined interval with the user terminal 100 so that the user terminal 100 recognizes a product to be purchased through this.

According to an embodiment of the present invention, the product recognition unit 120 may recognize a product located in the product storage means when recognizing a product to be purchased. For example, the product storage means may include a cart, a basket, or a bag used at a product sales place, and the basket may include a plastic bag, a shopping cart, or the like.

When the product recognition unit 120 recognizes a product located in the product storage means using the image analysis method, the product recognized by analyzing only the external images of the products located inside the product storage means from the image photographed by the image capturing unit 110 can be treated as products to be purchased.

According to an embodiment, the product recognition unit 120 may recognize only products located in the product storage means used in a specific place. That is, only a predetermined product storage means may be recognized without recognizing the product located in the storage means or the loading means personally held by the user.

When the product recognition unit 120 recognizes a product to be purchased based on image analysis, whether it is a product storage means used in a specific place is preferentially determined through image analysis, and the product storage means used in a specific location is determined on the image If recognized, image analysis of products located inside the corresponding product storage means may be additionally performed.

When the product recognition unit 120 recognizes a product to be purchased based on communication with the electronic tag, a predetermined product storage means used in a specific place may also include an electronic tag, and accordingly, the electronic tag and Only products existing within a certain distance may be recognized as purchase target products.

According to an embodiment, the product recognition unit 120 receives product recognition information from the seller terminal 200 without directly utilizing the above-described image analysis method or electronic tag method in recognizing a product to be purchased. You can also use this.

The seller terminal 200 may be connected to the product recognition device 300 , and the product recognition device 300 may recognize the product in the same or similar manner as the product recognition unit 120 of the user terminal 100 operates. have. That is, the product recognition device 300 recognizes the product by analyzing the external image of the product, by recognizing the product through a barcode or QR code displayed on the product, or by communicating with the electronic tag included in the product. Recognition methods can be used.

The product recognition device 300 may provide information on the user terminal 100 to the seller terminal 200 by additionally acquiring user information when the user approaches and possesses the product.

The recognition of the user terminal 100 as described above may be performed by the product recognition device 300 receiving the location information of the user terminal 100 in real time and based thereon, and the product recognition device 300 may display the user's face image It may be performed in a manner of recognizing a user in a manner of collecting and analyzing, etc. and determining information on the user terminal 100 corresponding to the recognized user.

According to an embodiment, the above-described operation of the product recognition device 300 may be performed in the seller terminal 200 . That is, the product recognition device 300 and the seller terminal 200 may be integrated and operated as one device.

The identity authentication performing unit 130 may receive biometric information from the seller terminal 200 and perform identity authentication based on whether the received biometric information matches biometric information previously stored on the user terminal 100 .

For example, when a facial image among biometric information is used for identity authentication, the seller terminal 200 identifies the user through the photographed user's facial image and corresponds to the user terminal 100 corresponding to the identified user. Images can be sent. The user authentication performing unit 130 compares the facial image received from the seller terminal 200 with the facial image previously stored in the user terminal 100 , and when it is determined that the two images match, the user authentication may be performed.

The product information providing unit 140 may provide information on the product information to the user when the product recognition unit 120 recognizes a purchase target product that the user wants to purchase. In detail, the product information providing unit 140 may provide information on the total price of one or more products recognized as purchase target products to the user through the display device or sound generating device of the user terminal 100 . .

According to an embodiment, when the product recognition unit 120 recognizes only the products located in the predetermined product storage means, the product information providing unit 140 may provide information on the types, quantities and prices of products located in the predetermined product storage means. can be provided to users.

Through such a function, the user can grasp the type, quantity, and number of products recognized through his or her user terminal 100 , and thus can conveniently proceed with shopping as desired.

The product payment performing unit 150 may perform payment for the product when the user authentication is successfully performed on the user authentication performing unit 130 of the user terminal 100 .

The product payment performing unit 150 according to an embodiment may receive a payment request signal from the seller terminal 200 and proceed with payment according to the received payment request signal. As described above, the seller terminal 200 may be connected to a gate installed in a specific place, and the gate recognizes the user or the user terminal 100 when the user or the user terminal 100 passes through the corresponding gate. Information on the user terminal 100 may be transmitted to the seller terminal 200 . The seller terminal 200 may receive information about the user or the user terminal 100 from the gate and transmit a payment request signal to the corresponding user terminal 100 so that the payment proceeds.

That is, when the user selects the products he wants to purchase at a specific offline location, the user terminal 100 recognizes the selected purchase target products, and when the user passes the gate at the exit, payment for the recognized products is performed by the user terminal Selection and payment of products may be made in a form that is automatically made on ( 100 ).

Alternatively, when the user terminal 100 arrives at a specific location or leaves a specific location, the product payment performing unit 150 may perform payment for selected purchased products.

According to an embodiment, the product payment performing unit 150 may generate a QR code or barcode for all products recognized by the user terminal 100 as a purchase target product, and such a QR code or barcode is a seller terminal 200 , and accordingly, payment for all products recognized as purchase target products may be performed. That is, the QR code or barcode generated by the product payment performing unit 150 may include information on all products recognized as purchase target products and information on payment methods together.

According to another embodiment, the product payment performing unit 150 recognizes the product to be purchased through the product recognition device 300 and generates a QR code or barcode by the seller terminal 200 to perform payment by recognizing it. . In this case, the product payment performing unit 150 may perform recognition of a QR code or a barcode through the image capturing unit 110 of the user terminal 100 . The QR code or barcode generated by the seller terminal 200 may include information on all products recognized as purchase target products.

According to another embodiment, the product payment performing unit 150 may proceed with payment for the products recognized by the product recognition unit 120 without communication with the seller terminal 200 . That is, in this embodiment, payment for products recognized by the user terminal 100 can be performed without the presence of the seller terminal 200 . In this case, the identity authentication performing unit 130 also performs identity authentication through the biometric information obtained by the user terminal 100 itself, not through the seller terminal 200, and performs payment when the identity authentication is successfully performed. can

The product payment performing unit 150 may proceed with payment through various payment methods, such as credit card payment, check card payment, debit card payment, account transfer payment, virtual currency payment, point payment, and mobile phone micropayment. may be using personal authentication through biometric information.

According to an embodiment, the product payment performing unit 150 may support payment through a PISP (Payment Instruction Service Provider). PISP provides financial services that do not utilize the payment infrastructure of existing banks through open APIs, and allows consumers to make payments or remittances using their accounts simply by logging into a specific service. .

The communication unit 160 enables the user terminal 100 to communicate with the seller terminal 200 , the management server 400 , and the external server 500 . The communication network used by the communication unit 160 to perform communication may be configured regardless of its communication mode, such as wired and wireless, for example, a local area network (LAN), a metropolitan area network (MAN). It may be implemented in various communication networks, such as an area network) and a wide area network (WAN). As described above, the local area network may be implemented through Ultra Wideband (UWB), Near Field Communication (NFC), ultrasound, MAT, beacon, and the like.

The storage unit 170 serves to store information collected, generated, and processed in various components of the user terminal 100 . That is, the storage unit 170 may store information about a user, information about a payment method, information about an algorithm used by the artificial intelligence engine, and the like. The storage unit 170 may include, for example, a memory, a cache, a buffer, and the like, and may be composed of software, firmware, hardware, or a combination of at least two or more thereof.

The control unit 180 includes an image capturing unit 110 , a product recognition unit 120 , an identity authentication performing unit 130 , a product information providing unit 140 , a product payment performing unit 150 , a communication unit 160 , and a storage unit. The function of controlling the data flow between 170 may be performed. That is, the control unit 180 includes the image capturing unit 110 , the product recognition unit 120 , the identity authentication performing unit 130 , the product information providing unit 140 , the product payment performing unit 150 , the communication unit 160 and The storage unit 170 may support to perform each unique function.

In FIG. 2 , the image capturing unit 110 , the product recognition unit 120 , the identity authentication performing unit 130 , the product information providing unit 140 , and the product payment performing unit 150 divide the control unit 180 functionally. Since it is a configuration, it may be configured to be integrated as one control unit 180 .

3 is a diagram illustrating a method in which the user terminal 100 according to an embodiment of the present invention recognizes and pays for a product by using the payment system 10 of the present invention.

In FIG. 3 , the recognition of the product that the user wants to purchase is exemplified as being performed by image capturing and analysis, but otherwise, the recognition of the product may be performed in various ways such as barcode recognition, QR code recognition, or electronic tag recognition. .

When a user arrives at a specific place selling products offline and starts shopping, the image capturing unit 110 such as a camera mounted on the user terminal 100 may operate.

The user terminal 100 may take an image of a surrounding product through a camera (S310), and then recognize a purchase target product through image analysis (S320). According to an embodiment, the recognition of the purchase target product of the user terminal 100 may be performed based on image analysis of the products held by the user's hand. That is, not all products captured on the photographed image are recognized as purchase target products, but only products held by the user or having a distance from the user less than a certain distance may be recognized as purchase target products. According to another embodiment, the user terminal 100 may recognize only a product located in a predetermined specific product storage means as a purchase target product.

The seller terminal 200 may recognize the user's biometric information (S330), and transmit the recognized biometric information to the user terminal 100 (S340). In this case, the seller terminal 200 may determine to which user terminal 100 to transmit the recognized user's biometric information through user information matching the biometric information or information of the user terminal 100 .

For example, when a facial image among biometric information is used for user recognition, the seller terminal 200 may specify the user through analysis of the recognized facial image and transmit the facial image to the user terminal 100 corresponding to the user. . Alternatively, the seller terminal 200 may transmit biometric information to a plurality of user terminals 100 located in a specific place, and location information (eg, GPS) transmitted by the user terminal 100 to the seller terminal 200 . location information), the user terminal 100 to which the biometric information is to be transmitted may be specified.

After receiving the biometric information from the seller terminal 200 , the user terminal 100 may perform user authentication by comparing the received biometric information with the biometric information previously stored in the user terminal 100 ( S350 ). ).

Thereafter, the seller terminal 200 may transmit a payment request signal to the user terminal 100 (S360). For example, the seller terminal 200 may transmit a payment request signal when the user terminal 100 leaves a specific product sales place based on the location information of the user terminal 100 . can also transmit a payment request signal when the user arrives at a specific location or leaves the product sales place by analyzing the user's movement.

After receiving the payment request signal from the seller terminal 200, the user terminal 100 may perform payment for products recognized as purchase targets (S370). According to another embodiment, even if the payment request signal is not received from the seller terminal 200 , the user may operate the user terminal 100 to proceed with the payment.

4 is a diagram illustrating a method in which the user terminal 100 according to another embodiment of the present invention recognizes and pays for a product by using the payment system 10 of the present invention.

In FIG. 4 , the product recognition device 300 may recognize products that the user possesses to purchase because it exists with a separate product recognition device 300 . Alternatively, according to another embodiment of the present invention, the product recognition device 300 and the seller terminal 200 may be integrated into one device to operate.

Referring to FIG. 4 , when the user is shopping in an offline store, etc., the product recognition device 300 takes an image of the product the user wants to purchase ( S410 ), and can recognize the purchase target product through image analysis. (S420). According to an embodiment, an analysis technique using an artificial intelligence engine may be used for such image analysis.

The product recognition device 300 may transmit information on products recognized as purchase target products to the seller terminal 200 (S430).

The seller terminal 200 according to an embodiment may recognize the location of the user terminal 100 through the location information transmitted from the user terminal 100 (S440), and additionally recognize the user's biometric information (S450) . Thereafter, the seller terminal 200 may transmit the recognized biometric information to the user terminal 100 recognized through the location information, and the information about the recognized product received from the product recognition device 300 together with the user terminal It can be transmitted to (100) (S460).

Thereafter, the seller terminal 200 may receive a pass signal indicating that the user terminal 100 has passed from a gate connected through a local area network or the like (S470). Alternatively, the gate may take an image through a camera installed near the gate, recognize the user through a facial image, etc. in the captured image, and transmit information about the recognized user to the seller terminal 200 .

Thereafter, the seller terminal 200 transmits a payment request signal to the recognized user terminal 100 (S480), and the user terminal 100 accordingly pays for the purchase target products included in the information received in step S460. can be performed (S490).

As such, according to various embodiments of the present invention, recognition of the user, the user terminal 100, and the products the user wants to purchase can be automatically performed in various ways, and all the products the user wants to purchase When a user selects and moves to a specific location or leaves a specific location, payment for the selected products may be performed.

5 is a schematic diagram of an entire environment in which the payment system 1000 according to an embodiment of the present invention operates.

Referring to FIG. 5 , the payment system 1000 may be configured to include a dedicated terminal 10000 , a user terminal 20000 , a management server 30000 , an external server 40000 , and an access means 50000 . .

The payment system 1000 may be installed and utilized in places where various products are sold offline.

The dedicated terminal 10000 may be installed and operated in the product transportation means 2000 . The dedicated terminal 10000 may recognize the product and include the product in the preliminary purchase list when the user moves the product that the user wants to purchase to the product transportation means 2000, and may later add to the products included in the preliminary purchase list. Payment information may be generated and transmitted to the user terminal 20000 .

According to an embodiment, the dedicated terminal 10000 may operate in conjunction with a camera installed in the product transportation means 2000, and receives an image photographed by the camera and performs an operation for product recognition and payment based on the received image can be performed.

In this case, the dedicated terminal 10000 may be located at a self-desk or payment counter where a user can recognize and pay for a product by himself or herself, and may be implemented as a POS terminal or a kiosk device.

The user terminal 20000 is a terminal held and controlled by the user, and the dedicated terminal 10000 or the management server 30000 in the payment system 1000 through a web browser or computer software or application installed on the user terminal 20000. can connect to The user terminal 20000 may exchange various data with the dedicated terminal 10000, the management server 30000, and the external server 40000 in the payment system 1000, and based on such data, the user terminal 20000 You can determine the content to be displayed through the screen (display unit) of

The dedicated terminal 10000 or the user terminal 20000 is a mobile phone, a smart phone, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet PC, etc. all kinds of handhelds that can be connected to a web server through a network. It may include a (handheld)-based wireless communication device, and has a memory means such as a personal computer (eg, a desktop computer, a notebook computer, etc.), a workstation, a PDA, a web pad, etc. It may be one of the digital devices equipped with

The user terminal 20000 may serve to perform payment for products that the user wants to purchase using the payment system 1000 . The user terminal 20000 may send and receive various types of information from the dedicated terminal 10000 , and such communication may be performed through the management server 30000 as an intermediate medium.

The user terminal 20000 may receive information on at least one product from the dedicated terminal 10000 , and the information on the product may be delivered in the form of a preliminary purchase list managed by the dedicated terminal 10000 . The user terminal 20000 may perform payment based on product information received from the dedicated terminal 10000 , and user authentication or adult authentication may be preceded for payment.

The management server 30000 may manage data so that the payment system 1000 operates smoothly and exchange necessary data with the dedicated terminal 10000 and the user terminal 20000 . For example, the management server 30000 may collectively manage a plurality of offline stores, and accordingly, the dedicated terminals 10000 located in the plurality of offline stores and the offline store to purchase products in the offline store. Communication with the user terminals 20000 may be performed.

The external server 40000 is a server that exists separately from the management server 30000 , and according to an embodiment, the management server 30000 obtains various data necessary for the smooth operation of the payment system 1000 from the external server 40000 . The dedicated terminal 10000 or the user terminal 20000 may also acquire necessary data through communication with the external server 40000. For example, the external server 40000 may include a server managed by a wholesaler providing products to be sold, a credit card server that requires communication to perform payment, a PG server, and the like.

The management server 30000 and the external server 40000 may include hardware such as a control unit having at least one processor, a communication module, a storage unit (eg, memory), or software for an algorithm operation.

The access means 50000 separates a specific offline space where a user purchases a product from the outside or other spaces, and may be configured in the form of a gate or an entrance door operating in an open/close format.

According to an embodiment, the opening/closing operation of the access means 50000 may be controlled by the dedicated terminal 10000 or the management server 30000 .

According to an embodiment of the present invention, the dedicated terminal 10000, the user terminal 20000, the management server 30000, the external server 40000 and the access means 50000 are used to communicate within the payment system 1000. The communication network may be configured regardless of its communication mode, such as wired and wireless, and for example, a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN). Network) can be implemented in various communication networks. Preferably, the communication network according to an embodiment of the present invention may be a well-known World Wide Web (WWW) or the like.

Wireless communication is, for example, LTE, LTE Advance (LTE-A), CDMA (code division multiple access), WCDMA (wideband CDMA), UWB (ultra wide band), UMTS (universal mobile telecommunications system), WiBro (Wireless) Broadband) or GSM (Global System for Mobile Communications) may include cellular communication using at least one. According to one embodiment, the wireless communication is, for example, WiFi (wireless fidelity), Bluetooth, Bluetooth low energy (BLE), Zigbee (Zigbee), NFC (near field communication), magnetic secure transmission (Magnetic Secure Transmission), radio It may include at least one of a frequency (RF) or a body area network (BAN). According to one embodiment, the wireless communication may include GNSS. The GNSS may be, for example, Global Positioning System (GPS), Global Navigation Satellite System (Glonass), Beidou Navigation Satellite System, or Galileo, the European global satellite-based navigation system.

6 is a block diagram schematically showing the configuration of a dedicated terminal 10000 according to an embodiment of the present invention.

Referring to FIG. 6 , the dedicated terminal 10000 includes a product recognition unit 11000 , a purchase list management unit 12000 , an identification information acquisition unit 13000 , a biometric information management unit 14000 , a payment information management unit 15000 , and an access means. It may be configured to include a management unit 16000 , a communication unit 17000 , a storage unit 18000 , and a control unit 190 .

The product recognition unit 11000 may recognize a product that the user places in the product transportation means 2000 through various recognition methods.

According to an embodiment, the product recognition unit 11000 may generate an image by visually photographing the surroundings. That is, the product recognition unit 11000 may acquire an image of an external product by using an image collection device such as a camera module or a camcorder module mounted on the dedicated terminal 10000 . The image collected by the product recognition unit 11000 may be in the form of a still picture, but may also be in the form of an image composed of a plurality of frames.

The product recognition unit 11000 according to an exemplary embodiment may automatically operate to take an image without a user's manipulation. Alternatively, the user may start taking an image by manipulating the dedicated terminal 10000 in a specific manner.

According to an embodiment, the product recognition unit 11000 may recognize a product through image analysis in recognizing a product to be purchased on the photographed image. Such image analysis may be performed in the dedicated terminal 10000 , but may also be performed in the management server 30000 . When image analysis is performed on the management server 30000, the product recognition unit 11000 transmits the photographed image to the management server 30000 and analyzes the image from the management server 30000 to receive information on a specific product. can do.

The image analysis performed on the dedicated terminal 10000 or the management server 30000 may be performed by an artificial intelligence engine included in the dedicated terminal 10000 or the management server 30000 . Such an artificial intelligence engine can perform image analysis by using machine learning or deep learning technology. The artificial intelligence engine can improve image analysis ability by setting a plurality of product images as learning data and performing learning through the set learning data.

The machine learning utilized by the AI engine is haar like and convolutional neural network (cnn) or convolutional neural network-based transformation model (R-CNN, Fast R-CNN, Faster R-CNN, YOLO, SSD). , Mask R-CNN) may be used at least one algorithm.

Such an artificial intelligence engine may be implemented in hardware or software on the dedicated terminal 10000 or the management server 30000 .

According to an embodiment, the product recognition unit 11000 may recognize the purchase target product by recognizing a barcode or QR code displayed on the purchase target product, not by analyzing the external image of the product. That is, the product recognition unit 11000 may recognize a barcode or QR code existing on the photographed image, and specify the type and number of products corresponding to the collected barcode or QR code.

According to an embodiment of the present invention, the product recognition unit 11000 uses a method of analyzing an external image of a product and a barcode or QR code displayed on the product in recognizing a product to be purchased based on the photographed image. methods can be used comprehensively.

In detail, when the product recognition unit 11000 recognizes the product to be purchased, the product for which the barcode or QR code is recognized on the collected image specifies the type of product through the recognized barcode or QR code, and For products whose barcode or QR code is not recognized on the image, the type of product can be specified through analysis of the external image of the product.

That is, since only a part of the product may appear on the image acquired by the product recognition unit 11000, the barcode or QR code displayed on the product may not be recognized accordingly, and the product recognition method through external image analysis is used together. This can increase the accuracy of product recognition.

Such an operation of the product recognition unit 11000 may be performed on the management server 30000 as the product recognition unit transmits the collected images to the management server 30000 .

According to an embodiment of the present invention, the product recognition unit 11000 allows the product information to be acquired by the electronic tag recognition method rather than the photographed image analysis-based method in recognizing the product to be purchased.

The product recognition unit 11000 recognizes an electronic tag located within a predetermined interval with the dedicated terminal 10000 when recognizing a product by using an electronic tag so that the user terminal 20000 recognizes a product to be purchased through this. can do.

When it is determined that the product recognized by the product recognition unit 11000 is located in the product transportation means 2000 , the purchase list management unit 12000 may include the product as a preliminary purchase list.

That is, the purchase list management unit 12000 may determine whether to include the product in the preliminary purchase list according to whether the product recognized by the product recognition unit 11000 is located in the product transportation means 2000 .

According to an embodiment, the purchase list management unit 12000 may recognize that the product included in the preliminary purchase list is removed from the product transportation means 2000 and delete the recognized product from the preliminary purchase list.

The identification information acquisition unit 13000 may collect identification information for performing payment from the user. The collection of such identification information may be performed through an input unit of the dedicated terminal 10000, and the dedicated terminal 10000 may acquire identification information from a user through an input unit such as a touch screen, keyboard, mouse, voice recognition, etc. .

The identification information acquisition unit 13000 may specify information of the user and the user terminal 20000 through the acquired identification information.

The identification information may consist of an ID, password, PIN number, or the like, or a combination thereof. According to an embodiment, the PIN number may be replaced with biometric information to be described later.

The biometric information management unit 14000 may acquire the user's biometric information after the identification information acquisition unit 13000 acquires the identification information from the user or in the process of acquiring it. Such biometric information may be used for identity authentication for payment.

According to an embodiment, the dedicated terminal 10000 may acquire and manage biometric information by communicating with a separate identity authentication device.

According to an embodiment of the present invention, biometric information may be distributed and stored in the dedicated terminal 10000, the user terminal 20000, the management server 30000, or other cloud to perform authentication. That is, one piece of biometric information may be stored and stored in at least one of the above-described media, and at least a portion of the biometric information may be stored in a distributed form in a specific medium.

For example, the biometric information may be stored in the form of one of encrypted vector data, a pattern value, or a hash value, and may be stored in the user terminal 20000 , the management server 30000 , or other cloud environments.

According to an embodiment, the biometric information management unit 14000 transmits the sensing information of the user to the management server 30000 or the external server 40000 using a wireless communication circuit, and the management server 30000 or the external server 40000. It is possible to obtain identification information such as a mobile phone number for the identity authentication device from In addition, the biometric information management unit 14000 may transmit sensing information of the user to the identified identity authentication device using a wireless communication circuit and receive authentication data from the identity authentication device. The biometric information manager 14000 may perform a predetermined function based on authentication data or may output an authentication failure message through an input/output device.

The payment information management unit 15000 may generate payment information for products included in the preliminary purchase list and transmit it to the user terminal 20000 specified by the identification information acquisition unit 13000 . In this process, the biometric information management unit 14000 may transmit the acquired user's biometric information to the user terminal 20000 together.

The user terminal 20000 may receive biometric information and payment information from the dedicated terminal 10000 , and according to an embodiment, the biometric information and payment information may be transmitted to the user terminal 20000 through the management server 30000 . have.

The user terminal 20000 may perform user authentication through the received biometric information. That is, the user terminal 20000 may determine whether the received biometric information matches the biometric information previously stored in the user terminal 20000 , and may perform identity authentication based on this. When the user authentication is successfully performed, the user terminal 20000 may perform payment for products included in the preliminary purchase list through the received payment information.

After performing the payment, the user terminal 20000 may transmit information on the completed payment to the dedicated terminal 10000 or the management server 30000 . The dedicated terminal 10000 that has received the information on whether to perform payment may provide payment completion information to the user through the display unit or the voice output unit of the dedicated terminal 10000 .

The user terminal 20000 may proceed with payment through various payment methods such as credit card payment, check card payment, debit card payment, account transfer payment, virtual currency payment, point payment, open banking payment, mobile phone micropayment, etc. The payment method may be using personal authentication through biometric information. The payment through the card on the user terminal 10000 may be performed through a PG (Payment Gateway) company server, but may be directly connected to the card company server without going through the PG company server and the payment may be performed.

The user terminal 20000 may perform payment through a PISP (Payment Instruction Agency Service Provider). PISP provides financial services that do not utilize the payment infrastructure of existing banks through open APIs, and allows consumers to make payments or remittances using their accounts simply by logging into a specific service. .

According to an embodiment, the payment information management unit 15000 may include products (eg, alcohol, cigarettes, etc.) that require adult authentication among products recognized by the product recognition unit 11000 and included in the preliminary purchase list. If present, payment information may be transmitted to the user terminal 20000 only when adult authentication-related information is received from the user terminal 20000 .

According to another embodiment, the payment information management unit 15000 is recognized by the product recognition unit 11000 and when there is a product requiring adult authentication among products included in the preliminary purchase list, the user terminal ( 20000), payment information may be generated and transmitted so that payment can be performed only when adult authentication is completed on the user terminal 20000.

When the dedicated terminal 10000 receives the payment completion information from the user terminal 20000, the access means management unit 16000 may control opening and closing of the access means 50000 at a specific location based on this.

For example, the access means 50000 may be an exit of a specific business site, and the access means management unit 16000 enters and exits so that only a user who has completed payment for products located in the product transportation means 2000 can pass through the corresponding exit. means 50000 can be controlled.

According to an embodiment, the access means management unit 16000 identifies the location of the dedicated terminal 10000, and opens the access means 50000 only when the location of the dedicated terminal 10000 is located near the access means 50000. can be controlled

The communication unit 17000 enables the dedicated terminal 10000 to communicate with the user terminal 20000 , the management server 30000 , the external server 40000 , and the access means 50000 . The communication network used by the communication unit 17000 to perform communication may be configured regardless of the communication mode such as wired and wireless, for example, a local area network (LAN), a metropolitan area network (MAN: Metropolitan). It may be implemented in various communication networks, such as an area network) and a wide area network (WAN). As described above, the local area network may be implemented through Ultra Wideband (UWB), Near Field Communication (NFC), ultrasound, MAT, beacon, and the like.

The storage unit 18000 serves to store information collected, generated, and processed in various components of the dedicated terminal 10000 . That is, information about a user, information about a payment method, information about an algorithm used by the artificial intelligence engine, etc. may be stored in the storage 18000 . The storage unit 18000 may include, for example, a memory, a cache, a buffer, and the like, and may be composed of software, firmware, hardware, or a combination of at least two or more thereof. Memory may include volatile and/or non-volatile memory. The memory may store, for example, commands or data related to at least one other component of the identity authentication device. According to one embodiment, the memory may store software and/or programs. A program may include, for example, a kernel, middleware, an application programming interface (API), and/or an application program (or "application"), and the like. The memory may include, for example, an internal memory or an external memory. Internal memory includes, for example, volatile memory (eg DRAM, SRAM, or SDRAM, etc.), non-volatile memory (eg one time programmable ROM (OTPROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, flash memory). , a hard drive, and a solid state drive (SSD), the external memory may include a flash drive, for example, a compact flash (CF), secure digital (SD), Micro-SD, It may include a Mini-SD, extreme digital (xD), a multi-media card (MMC), a memory stick, etc. The external memory may be functionally or physically connected to the identity authentication device through various interfaces.

The control unit 190 includes a product recognition unit 11000, a purchase list management unit 12000, an identification information acquisition unit 13000, a biometric information management unit 14000, a payment information management unit 15000, an access means management unit 16000, a communication unit ( 17000) and the storage unit 18000 may perform a function of controlling data flow. That is, the control unit 190 includes a product recognition unit 11000, a purchase list management unit 12000, an identification information acquisition unit 13000, a biometric information management unit 14000, a payment information management unit 15000, an access means management unit 16000, The communication unit 17000 and the storage unit 18000 may support to perform their own functions, respectively.

6, the product recognition unit 11000, the purchase list management unit 12000, the identification information acquisition unit 13000, the biometric information management unit 14000, the payment information management unit 15000 and the access means management unit 16000 are the control unit 190 Since it is a functionally classified configuration, it may be configured to be integrated as one control unit 190 .

7 is a block diagram schematically showing the configuration of a management server 30000 according to an embodiment of the present invention.

Referring to FIG. 7 , the management server 30000 includes a product specifying unit 31000 , a purchase list management unit 32000 , an identification information management unit 33000 , a biometric information management unit 34000 , a payment information management unit 35000 , an access means management unit 36000 , a communication unit 37000 , a storage unit 38000 , and a control unit 390 may be included.

The product specifying unit 31000, the purchase list management unit 32000, the identification information management unit 33000, the biometric information management unit 34000, the payment information management unit 35000, the access means management unit 36000, the communication unit of the management server 30000 37000), the storage unit 38000, and the control unit 390 are the product recognition unit 11000, the purchase list management unit 12000, the identification information acquisition unit 13000, the biometric information management unit 14000 of the dedicated terminal 10000, respectively. The payment information management unit 15000 , the access means management unit 16000 , the communication unit 17000 , the storage unit 18000 , and the control unit 190 may perform similar roles.

For example, the product specifying unit 31000 receives the image photographed by the product recognition unit 11000 and analyzes it through an artificial intelligence engine to specify the recognized product, and transmit information on the specified product to the dedicated terminal 10000 ) or add it to the purchase list. In addition, the purchase list management unit 32000 , the identification information management unit 33000 , and the biometric information management unit 34000 may receive the purchase list, the identification information, and the user's biometric information from the dedicated terminal 10000 , respectively, to manage and utilize them. The payment information management unit 35000 and the access means management unit 36000 may also receive payment information and management information on the access means from the dedicated terminal 10000 to manage and utilize them.

That is, the management server 30000 can receive and manage the necessary data from the corresponding component of the dedicated terminal 10000, and the mediation that delivers it to the user terminal 20000, the external server 40000 or the access means 50000 can play a role.

The management server 30000 according to an embodiment may be located in a specific space where a user purchases a product, but unlike this, it may be located outside a specific space to manage a plurality of branches together.

As described above, according to the embodiment of the present invention, even when the user terminal 20000 and the management server 30000 are not located in the offline branch where the user purchases the product, only the dedicated terminal 10000 installed in the product transportation means 2000 is used. Through this, product recognition and payment can be made.

8 is a flowchart illustrating a method in which the dedicated terminal 10000 according to an embodiment of the present invention recognizes and pays for a product by using the payment system 1000 of the present invention.

Referring to FIG. 8 , the dedicated terminal 10000 installed in the product transportation means 2000 may specify the number and type of products by photographing an image of the product through an external image photographing method.

The dedicated terminal 10000 may recognize the product that the user wants to purchase through various methods as described above. In FIG. 8 , a process in which a method for specifying the type and number of goods through an image analysis method among these various methods is used will be described as an example.

The dedicated terminal 10000 may take an image of a product that the user wants to purchase by taking an external image (S410), and may transmit the captured image to the management server 30000 (S420).

The management server 30000 may receive an image of a product from the dedicated terminal 10000 and analyze the image. Such image analysis can be performed by the artificial intelligence engine mounted on the management server 30000, and the type and number of products can be determined through recognition of barcodes or QR codes included in images as well as product image self-analysis. may be specified.

The dedicated terminal 10000 may receive information about the product recognized through the analysis of the product image from the management server 30000 (S430), and then determine whether the recognized product is located in the product transportation means 2000 When it is determined that the recognized product is located in the product transportation means 2000, the product may be included in the preliminary purchase list (S440).

Thereafter, when the user wants to purchase products in the product transportation means 2000 , the user may input identification information into the dedicated terminal 10000 , and the dedicated terminal 10000 receives identification information from the user and based on it By calling user information, it is possible to specify the user terminal 20000 (S450).

The dedicated terminal 10000 may acquire the user's biometric information, generate payment information for products included in the preliminary purchase list, and transmit the biometric information and payment information to the user terminal 20000 (S460).

On the user terminal 20000 side, user authentication may be performed through the biometric information received from the dedicated terminal 10000 , which includes the biometric information received from the dedicated terminal 10000 and the biometric information stored on the user terminal 20000 . can be performed based on the comparison of Thereafter, when the user authentication is normally completed, the user terminal 20000 may perform payment through the payment information received from the dedicated terminal 10000 .

Such payment may be performed through various payment methods such as credit card payment, check card payment, debit card payment, account transfer payment, virtual currency payment, point payment, open banking payment, mobile phone micropayment, payment through PISP, and the like.

After performing the payment, the user terminal 20000 may transmit information on payment completion to the dedicated terminal 10000 , and the dedicated terminal 10000 receives whether the payment is performed from the user terminal 20000 and the payment is normally completed. In this case, the access means 50000 may be controlled in an open state (S470).

According to an embodiment, the control of the access means 50000 may not be immediately performed at the time the payment is completed. That is, when the product transport means 2000 in a state in which payment is normally completed moves near the access means 50000, the access means 50000 is controlled to an open state according to the location information of the dedicated terminal 10000 and the access means 50000 can be In addition, if an additional product is recognized in the product transportation means 2000 after payment is completed, control of the access means 50000 by the dedicated terminal 10000 is not performed until additional payment for the added product is made. can

9A to 9B are flowcharts illustrating a method in which the dedicated terminal 10000 pays for a product requiring adult authentication for purchase according to an embodiment of the present invention.

As described above, the dedicated terminal 10000 may process payment for a product requiring adult authentication in a different manner as shown in FIGS. 9A to 9B .

Referring to FIG. 9A first, the dedicated terminal 10000 checks whether a product requiring adult authentication exists in the preliminary purchase list in the payment step (S510), and generates payment information if there is an adult authentication required product in the user terminal Before transmitting to 20000, it is possible to request adult authentication-related information from a specific user terminal 20000 through identification information (S520).

Thereafter, the dedicated terminal 10000 receives the adult authentication-related information from the user terminal 20000 and checks it ( S530 ), and only when the adult authentication is normally completed, payment information of products included in the preliminary purchase list to the user It can be transmitted to the terminal 20000 (S540).

Next, referring to FIG. 9B , the dedicated terminal 10000 checks whether a product requiring adult authentication exists in the preliminary purchase list in the payment step ( S550 ), and generates payment information for products included in the preliminary purchase list In the process, payment information may be generated in a form in which payment is possible only when adult authentication is completed and transmitted to the user terminal 20000 (S560).

In order to perform payment through the payment information received from the dedicated terminal 10000 on the user terminal 20000 side, adult authentication must be completed, and payment can be performed only after adult authentication is successfully completed (S570).

As such, the payment system 1000 may be equipped with an adult authentication verification system required for product purchase through various methods.

According to the above-described various embodiments, the payment system of the present invention can support a consumer's convenient non-face-to-face payment through a dedicated terminal installed in a product transportation means, and through this, the operation of an unmanned store can also be convenient. In addition, the consumer may perform payment by using the terminal even in a situation where the consumer does not own the terminal.

The steps of the method or algorithm described in relation to the embodiment of the present invention may be implemented directly in hardware, implemented as a software module executed by hardware, or implemented by a combination thereof. A software module may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any type of computer-readable recording medium well known in the art to which the present invention pertains.

As mentioned above, although embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains can realize that the present invention can be embodied in other specific forms without changing its technical spirit or essential features. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

Claims

In a method for a payment system to make a payment using a user terminal,

recognizing, by the user terminal, a product to be purchased;

transmitting, by the merchant terminal recognizing the user's biometric information, the user's biometric information to the user terminal;

performing, by the user terminal, identity authentication through whether the biometric information of the user received from the seller terminal matches the biometric information stored in advance on the user terminal; and

When the user authentication is successfully performed on the user terminal, the user terminal comprising the step of performing a payment for a product recognized through the user terminal, the payment method of the payment system.
According to claim 1,

The biometric information includes any one or more of fingerprint information, iris information, facial image information, vein information, electrocardiogram information, and voice information.
According to claim 1,

The seller terminal,

Transmitting a payment request signal to the user terminal by recognizing the user terminal passing through the gate connected to the seller terminal,

The user terminal,

A method of performing a payment in a payment system for performing a payment for a product based on a payment request signal received from the merchant terminal.
According to claim 1,

The step of recognizing the product to be purchased by the user terminal comprises:

When the external image of the product is collected by the image capturing unit mounted on the user terminal, the user terminal analyzes the external image of the collected product to specify the type and quantity of the product.
5. The method of claim 4,

The step of specifying the type and quantity of the product by analyzing the external image of the collected product by the user terminal,

It is characterized in that it is performed by an artificial intelligence engine mounted on the user terminal,

The artificial intelligence engine is to perform learning through the external image of the product, the payment method of the payment system.
According to claim 1,

The step of recognizing the product to be purchased by the user terminal comprises:

The method for performing payment in a payment system, wherein the user terminal acquires product information through an electronic tag included in the product.
According to claim 1,

The step of recognizing the product to be purchased by the user terminal comprises:

A method of performing a payment in a payment system, characterized in that only products located in a predetermined product storage means are recognized.
8. The method of claim 7,

The product storage means,

A method of performing payment in a payment system, characterized in that it is a cart, basket or bag.
According to claim 1,

The user terminal is

A method of performing a payment in a payment system, characterized in that information on the total price of one or more products recognized as purchase target products is provided through a display device or a sound generating device.
According to claim 1,

The step of recognizing the product to be purchased by the user terminal comprises:

When the barcode or QR code is recognized by the image capturing unit mounted on the user terminal, the user terminal specifies the type of product corresponding to the collected barcode or QR code, the payment method of the payment system.
According to claim 1,

The step of recognizing the product to be purchased by the user terminal comprises:

For products whose barcode or QR code is recognized by the image capturing unit mounted on the user terminal, the type of product is specified through the barcode or QR code, and the product whose barcode or QR code is not recognized on the collected images is the appearance of the product. A method of performing payment in a payment system, which specifies the type of product through image analysis.
According to claim 1,

The step of recognizing the product to be purchased by the user terminal comprises:

A method of performing payment in a payment system, characterized in that the method is a method of receiving product recognition information from a product recognition device connected to the merchant terminal.
According to claim 1,

The step of the user terminal performing payment for the product recognized through the user terminal,

generating, by the user terminal, a QR code or barcode including information on at least one or more products recognized as purchase targets and payment method information; and performing, by the merchant terminal recognizing the QR code or barcode, payment based on product information and payment method information included in the QR code or barcode.
In a method for a payment system to make a payment using a user terminal,

recognizing, by the user terminal, a product to be purchased;

recognizing, by the user terminal, the user's biometric information;

performing, by the user terminal, identity authentication through whether the recognized biometric information and biometric information stored in advance on the user terminal match; and

When the user authentication is successfully performed on the user terminal, the user terminal comprising the step of performing a payment for a product recognized through the user terminal, the payment method of the payment system.
In the payment system using a user terminal,

a seller terminal for recognizing the user's biometric information and transmitting the user's biometric information to the user terminal; and

Recognizes the product to be purchased, performs self-authentication based on whether the user's biometric information received from the seller terminal matches the previously stored biometric information, A payment system comprising a buyer terminal for performing a payment for.