CN117157655A

CN117157655A - Payment method and payment system using user terminal or dedicated terminal mounted on commodity transportation means

Info

Publication number: CN117157655A
Application number: CN202280028602.0A
Authority: CN
Inventors: 李宣官; 朴信映
Original assignee: Ghost Pass Inc
Current assignee: Ghost Pass Inc
Priority date: 2021-04-13
Filing date: 2022-04-13
Publication date: 2023-12-01
Also published as: KR20220154600A

Abstract

The present invention relates to a payment method and a payment system using a user terminal. The method for a payment system to perform payment using a user terminal according to an embodiment of the present invention may be configured to include: the user terminal identifies the commodity to be purchased; a step in which a seller terminal that recognizes biometric information of a user transmits the biometric information of the user to the user terminal; the user terminal performing principal identity authentication by whether the biometric information of the user received from the seller terminal is identical to the biometric information pre-stored on the user terminal; and when the user terminal successfully performs identity authentication of the user, the user terminal performs payment for the commodity identified by the user terminal.

Description

Payment method and payment system using user terminal or dedicated terminal mounted on commodity transportation means

Technical Field

Various embodiments of the present invention relate to a technique for performing payment for goods or services on-line using a user terminal using a biometric-based technology.

Various embodiments of the present invention relate to a technique for recognizing a commodity that a consumer wants to purchase and performing payment using a dedicated terminal installed in a commodity transportation means.

Background

With the development of technology, payment methods for purchasing articles are also becoming more and more diversified. In particular, many methods of smart phone payment by almost everyone carrying them around are being developed.

Thus, payment can now be performed using a one-time bar code or a two-dimensional code (QR code) generated on a smart phone, etc., and a user can also authenticate biometric information such as a facial image, iris, fingerprint through the smart phone and perform corresponding payment.

However, identification of a commodity that a user wants to purchase has conventionally been performed by identifying a bar code displayed on an article using a bar code reader of a store, or by identifying an article by a worker of a store and inputting the identified article into a POS device or the like.

Therefore, when a buyer purchases a plurality of goods, it is necessary to identify the time of the goods in order to perform payment, and thus, when there are many customers in a specific store, congestion occurs at all of the sites where payment is performed.

Thus, there is a need for a new system that can pay for purchased goods in a more convenient and faster manner.

Also, for example, a consumer may use a camera or other device mounted on a smartphone to identify the merchandise that is desired to be purchased and perform payment through the smartphone.

However, in the case where a consumer purchases a plurality of commodities, it is inconvenient to identify commodities that the consumer wants to purchase one by one.

Therefore, there is a need for a system capable of automatically recognizing the goods that the consumer wants to purchase and performing payment even if the user does not directly recognize the goods one by one using his/her own terminal such as a smart phone.

Also, there is a need for a system that can perform payment using a smart phone even if a consumer does not carry his/her own smart phone, or a system that performs payment in a manner that minimizes the operation of a smart phone carried in his/her hand.

Disclosure of Invention

Technical problem to be solved by the invention

It is an aim of various embodiments of the present invention to construct a system for automatically effecting identification and payment of selected items when selected items are selected and purchased on-line.

It is an aim of various embodiments of the present invention to construct an off-line automated payment system that minimizes the way in which a consumer-held terminal operates.

The problems to be solved by the present invention are not limited to the above-described problems, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

Technical proposal

According to one aspect of various embodiments of the present invention for solving the above-described problems, there may be disclosed a method for a payment system to perform a payment using a user terminal, the method for the payment system to perform the payment including: the user terminal identifies the commodity to be purchased; a step in which a seller terminal that recognizes biometric information of a user transmits the biometric information of the user to the user terminal; the user terminal performing principal identity authentication by whether the biometric information of the user received from the seller terminal is identical to the biometric information pre-stored on the user terminal; and when the user terminal successfully performs identity authentication of the user, the user terminal performs payment for the commodity identified by the user terminal.

The biometric information may include any one or more of fingerprint information, iris information, facial image information, vein information, electrocardiogram information, or voice information.

The seller terminal may be configured to: identifying the user terminal through a gate connected with the seller terminal and transmitting a payment request signal to the user terminal, the user terminal may be configured to: payment for the commodity is performed based on a payment request signal received from the seller terminal.

The step of the user terminal identifying the commodity to be purchased may include: when the image capturing unit mounted on the user terminal captures an outline image of the commodity, the user terminal analyzes the captured outline image of the commodity to specify the type and number of the commodity.

The step of the user terminal specifying the type and number of the commodity by analyzing the acquired outline image of the commodity is characterized in that the step is executed by an artificial intelligence engine mounted on the user terminal; the artificial intelligence engine can learn through the outline image of the commodity.

The step of the user terminal identifying the commodity to be purchased may include: and the step of acquiring commodity information by the user terminal through the electronic tag included in the commodity.

The step of identifying the commodity to be purchased by the user terminal may be characterized by: only the merchandise located within the predetermined merchandise storage tool is identified. The commodity keeping tool may be constituted by a cart, a basket, or a bag.

The user terminal may be characterized by: information related to the total price of one or more items identified as items to be purchased is provided by a display device or a sound generation device.

The step of the user terminal identifying the commodity to be purchased may include: and a step in which when the image capturing unit mounted on the user terminal recognizes the barcode or the two-dimensional code, the user terminal designates the type of the commodity corresponding to the acquired barcode or two-dimensional code.

The step of the user terminal identifying the commodity to be purchased may include: and a step of designating the type of the commodity by the barcode or the two-dimensional code by the commodity which is recognized by the image capturing unit mounted on the user terminal, and designating the type of the commodity by analyzing the outline image of the commodity without recognizing the barcode or the two-dimensional code from the captured image.

The step of identifying the commodity to be purchased by the user terminal may be characterized by: commodity identification information is received from a commodity identification apparatus connected to the seller terminal.

Communication between the user terminal and the seller terminal may be performed using at least one of Ultra Wideband (UWB), near field communication (Near Field Communication, NFC), bluetooth (Bluetooth), ultrasonic waves, MAT, or beacons.

The step of the user terminal performing payment for the goods identified by the user terminal may further include: a step in which the user terminal generates a two-dimensional code or a barcode including information on one or more items identified as items to be purchased and payment instrument information; and a step of executing payment by the seller terminal recognizing the two-dimensional code or bar code based on commodity information and payment instrument information included in the two-dimensional code or bar code.

According to another aspect of various embodiments of the present invention for solving the above-mentioned problems, a method for a payment system to perform payment using a user terminal may be configured to include: the user terminal identifies the commodity to be purchased; a step in which the user terminal recognizes biometric information of the user; the user terminal executing identity authentication by whether the recognized biometric information is identical to biometric information pre-stored on the user terminal; and when the user terminal successfully performs identity authentication of the user, the user terminal performs payment for the commodity identified by the user terminal.

According to another aspect of various embodiments of the present invention for solving the above-mentioned problems, there may be disclosed a payment system employing a user terminal, the payment system including: a seller terminal identifying and transmitting biological information of a user to a user terminal; and a purchaser terminal identifying a commodity to be purchased, and performing principal identity authentication by whether the biometric information of the user received from the seller terminal is identical to the biometric information pre-stored therein, and when the principal identity authentication is successfully performed, performing payment for the identified commodity.

According to an aspect of various embodiments of the present invention for solving the above-described problems, there may be disclosed a method of performing payment by a payment system using a dedicated terminal installed in a commodity transportation, the method of performing payment by the payment system including: the special terminal identifies more than one commodity to be purchased, and when the identified commodity is judged to be positioned in the commodity transportation means, the commodity is included in a preparation purchase list; a step in which the dedicated terminal obtains, from a user, identification information for performing payment for one or more items located in the item transport means, and obtains biometric information of the user; the step of the private terminal sending the biometric information and the payment information to the user terminal identified by the identification information; and the user terminal performing principal authentication through the received biometric information, and when the principal authentication is successfully performed, performing payment for the goods included in the preliminary purchase list through the payment information.

The characteristic of the identification information may be constituted by a PIN code.

The method for the payment system to execute the payment may further include: and the special terminal receives whether the user terminal executes payment or not and controls the opening and closing of the access tool at a specific position when the payment is completed.

The method for the payment system to execute the payment may further include: and the special terminal receives whether the user terminal has executed payment, and provides payment completion information to the user through a display part or a voice output part of the special terminal.

The dedicated terminal may be characterized in that: when there is a commodity requiring adult authentication among the identified commodities, payment information is transmitted to the user terminal only in the case where adult authentication related information is received from the user terminal.

When there is a commodity requiring adult authentication among commodities identified by the dedicated terminal, it is possible to control payment of the user terminal that receives the payment information to be performed only in the case where adult authentication is completed on the user terminal.

The process of identifying the commodity to be purchased by the dedicated terminal may be that, when the image capturing section mounted on the dedicated terminal captures an outline image of the commodity, the dedicated terminal transmits the captured outline image of the commodity to a management server and designates the type and number of the commodity through analysis on the management server.

The step of analyzing the collected outline image of the commodity and designating the kind and number of the commodity by the management server is characterized in that: the method is executed by an artificial intelligence engine mounted on the management server, and the artificial intelligence engine can learn through the outline image of the commodity.

The machine learning algorithm employed by the artificial intelligence engine may consist of one of haar (like) features, convolutional neural networks (Convolutional Neural Networks, CNN), YOLO (You Only Look Once), or single step multi-frame object detection (Single Shot MultiBox Detector, SSD).

The step of the dedicated terminal identifying the commodity to be purchased may include: and the special terminal acquires commodity information through an electronic tag included in the commodity.

The step of the dedicated terminal identifying the commodity to be purchased may include: and a step in which, when the bar code or the two-dimensional code is recognized by the image capturing unit mounted on the dedicated terminal, the dedicated terminal designates the type of the commodity corresponding to the acquired bar code or two-dimensional code.

The step of the dedicated terminal identifying the commodity to be purchased may include: and a step of designating the type of the commodity by the barcode or the two-dimensional code by the commodity which is recognized by the image capturing unit mounted on the user terminal, and designating the type of the commodity by analyzing the outline image of the commodity without recognizing the barcode or the two-dimensional code from the captured image.

According to an aspect of various embodiments of the present invention for solving the above-described problems, there may be disclosed a method of performing payment by a payment system using a dedicated terminal connected to a camera mounted on a commodity transportation, the method of performing payment by the payment system including: the special terminal identifies more than one commodity to be purchased, and when the identified commodity is judged to be positioned in the commodity transportation means, the commodity is included in a step of preparing a purchasing list; a step in which the dedicated terminal obtains, from a user, identification information for performing payment for one or more commodities located in the commodity transportation means, and obtains biometric information of the user; the step of the private terminal sending the biometric information and the payment information to the user terminal identified by the identification information; and the user terminal performing principal authentication through the received biometric information, and when the principal authentication is successfully performed, performing payment for the goods included in the preliminary purchase list through the payment information.

According to another aspect of various embodiments of the present invention for solving the above-described problems, there may be disclosed a payment system employing a dedicated terminal mounted on a commodity transportation, the payment system comprising: a dedicated terminal that recognizes one or more commodities to be purchased, and when it is judged that the recognized commodity is located in the commodity transportation means, includes the commodity in a preliminary purchase list, obtains discrimination information for performing payment for the one or more commodities located in the commodity transportation means from a user, and obtains biological information of the user, and transmits the biological information and payment information to the user terminal recognized by the discrimination information; and a user terminal performing principal identity authentication through the biometric information received from the dedicated terminal, and performing payment for the goods included in the preliminary purchase list through the payment information when the principal identity authentication is successfully performed.

Advantageous effects

According to the embodiment of the invention, when the consumer selects the to-be-purchased article in the store, the terminal of the consumer automatically identifies the article, and when the consumer leaves the store or is located at a specific position, the payment is automatically realized based on personal identity authentication through the biological information of the consumer, so that the convenience of the consumer in selecting the commodity and paying can be increased.

According to the embodiment of the present invention, payment can be achieved by a dedicated terminal installed in a commodity transportation means, and payment can be performed by personal identification even in the case where a consumer does not hold his own terminal.

The effects of the present invention are not limited to the above-described effects, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

Drawings

Fig. 1 is a schematic diagram of the overall environment of the payment system actions according to an embodiment of the invention.

Fig. 2 is a block diagram schematically showing a configuration of a user terminal according to an embodiment of the present invention.

Fig. 3 is a diagram for explaining a manner in which a user terminal recognizes goods and performs payment using the payment system of the present invention according to an embodiment of the present invention.

Fig. 4 is a diagram illustrating a manner in which a user terminal recognizes goods and performs payment using the payment system of the present invention according to another embodiment of the present invention.

Fig. 5 is a schematic diagram of the overall environment of payment system operation according to an embodiment of the present invention.

Fig. 6 is a block diagram schematically showing the configuration of a dedicated terminal according to an embodiment of the present invention.

Fig. 7 is a block diagram schematically showing the configuration of a management server according to an embodiment of the present invention.

Fig. 8 is a flowchart for explaining a manner in which a dedicated terminal according to an embodiment of the present invention recognizes goods and performs payment using the payment system of the present invention.

Fig. 9a to 9b are flowcharts for explaining a manner in which a dedicated terminal performs payment for goods requiring adult authentication at the time of purchase according to an embodiment of the present invention.

Detailed Description

DETAILED DESCRIPTION OF EMBODIMENT (S) OF INVENTION

The terminology used in the description presented herein is for the purpose of describing particular embodiments and is not intended to be limiting of the invention. In this specification, the singular forms also include the plural unless otherwise indicated. As used in this specification, "comprising" and/or "includes" does not exclude the presence or addition of more than one other element than the ones mentioned. Throughout the specification, the same reference numeral refers to the same constituent element, and "and/or" includes all combinations of each or more of the referenced constituent elements. Although "first", "second", etc. are used to describe various constituent elements, these constituent elements are of course not limited to these terms. These terms are only used to distinguish one element from another. Therefore, the first component described below may be the second component within the technical idea of the present invention.

Throughout the specification, unless the contrary is stated, a portion "comprising" a certain constituent element means that other constituent elements are also included, and not excluded. Also, terms such as "..section" and "module" recited in the specification refer to a unit of processing at least one function or action, which may be implemented as hardware or software, or a combination of hardware and software.

In this specification, "user" may refer to a subject who purchases a specific commodity using the payment system of the present invention, and "seller" may refer to a subject who sells a specific commodity using the payment system of the present invention.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings.

Fig. 1 is a schematic diagram of the overall environment in which a payment system 10 operates in accordance with one embodiment of the present invention.

Referring to fig. 1, the payment system 10 may be configured to include a user terminal 100, a seller terminal 200, a goods recognition device 300, a management server 400, and an external server 500.

The payment system 10 may be installed for use at various locations where goods are sold under line.

The user terminal 100 is a terminal used by a user in order to utilize the payment system 10, and the user terminal 100 may identify and perform payment for goods that the user wants to purchase in various ways.

The user terminal 100 is controlled by a user and may access the management server 400 within the payment system 10 through a web browser or computer software or application installed on the user terminal 100. The user terminal 100 may exchange various data with the seller terminal 200, the management server 400, and the external server 500 within the payment system 10, and may determine contents to be displayed through a screen (display section) of the user terminal 100 based on these data.

Such a user terminal 100 may include all types of hand-held (hand-hold) wireless communication devices, such as mobile phones, smartphones, personal digital assistants (Personal Digital Assistant, PDAs), portable multimedia players (Portable Multimedia Player, PMPs), tablet computers, etc., capable of connecting to a web server over a network, and may be one of digital devices equipped with a personal computer (e.g., desktop, notebook, etc.), a workstation, a PDA, a web pad, etc., storage means and loaded with a microprocessor to have computing capabilities.

The seller terminal 200 is a terminal that the seller uses in order to utilize the payment system 10, the seller terminal 200 can manage information of goods to be sold, and when personal authentication is performed on the user terminal 100 based on biometric information, biometric information can be preferentially acquired and transmitted to the user terminal 100 side.

According to an embodiment of the present invention, the biometric information used for identity authentication of the principal employed at the time of payment may be composed of any one of fingerprint information, iris information, facial image information, vein information, electrocardiogram information, or voice information, or a combination thereof.

The seller terminal 200 may be connected to and communicate with various other devices installed at a commodity sales site, and these other devices may be configured as a commodity identification apparatus 300 or a gate (gate) or the like.

According to an embodiment, payment may be made by installing a door at a specific place (e.g., an export) within a place where various goods are sold, and when the door identifies the user terminal 100 passing through the door and transmits information related to the user terminal to the seller terminal 200, the seller terminal transmits a payment request signal to the identified user terminal 100. The user terminal 100 receives the payment request signal from the seller terminal 200 and performs a corresponding payment.

Such a seller terminal 200 is controlled by the seller and can access the management server 400 within the payment system 10 through a web browser or computer software or application installed on the seller terminal 200. The seller terminal 200 may exchange various data with the user terminal 100, the management server 400, and the external server 500 within the payment system 10, and may determine contents to be displayed through a screen (display section) of the seller terminal 200 based on these data.

These seller terminals 200 may include all types of hand-held (Handheld) based wireless communication devices, such as mobile phones, smartphones, personal digital assistants (Personal Digital Assistant, PDAs), portable multimedia players (Portable Multimedia Player, PMPs), tablet computers, etc., capable of connecting to a web server over a network, and may be one of digital devices equipped with a personal computer (e.g., desktop, notebook, etc.), a workstation, PDA, web pad, etc., storage means and loaded with a microprocessor to have computing capabilities.

When a user accesses and holds a commodity that the user wants to purchase, the commodity identification apparatus 300 may identify information related to the commodity and transmit information of the user terminal 100 of the user and information related to the commodity held after the user access to the user terminal 100 or the seller terminal 200. The method of identifying the article by the article identifying device 300 may be performed in the same or similar manner as the article identifying method of the user terminal 100 described later.

The article identification apparatus 300 is shown in fig. 1 as a form of a camera capable of capturing an image, but may be composed of a barcode scanner or an electronic device capable of identifying an electronic tag, or the like, unlike this.

The management server 400 manages data so that the payment system 10 operates smoothly and can exchange necessary data with the user terminal 100 and the seller terminal 200. For example, the management server 400 may integrally manage a plurality of off-line stores, and thus may communicate with the seller terminals 200 located in the plurality of off-line stores and the user terminals 100 to which the off-line stores are to perform payments.

The external server 500 is a server existing separately from the management server 400, and according to an embodiment, the management server 400 may acquire various data required for smooth operation of the payment system 10 from the external server 500, and the user terminal 100 or the seller terminal 200 may also acquire necessary data through communication with the external server 500. For example, the external server 500 may be composed of a server managed by a wholesaler providing goods for sale, a credit card server for performing Payment, a Payment Gateway (PG) server, and the like.

Such a management server 400 and an external server 500 may be configured to include hardware such as a control part having at least one processor, a communication module, a storage part (e.g., a memory), or software for algorithm calculation.

According to an embodiment of the present invention, in the payment system 10, the communication networks used by the user terminal 100, the seller terminal 200, the article identification apparatus 300, the management server 400, and the external server 500 for communication may be configured in a plurality of communication modes, which may not distinguish between wired or wireless modes, and the like. For example, it may be implemented by various communication networks such as a local area network (LAN, local Area Network), a metropolitan area network (MAN, metropolitan Area Network), a wide area network (WAN, wide Area Network), and the like. Preferably, the communication network according to an embodiment of the present invention may also be a known World Wide Web (WWW), or the like.

In detail, the communication between the user terminal 100 and the seller terminal 200 existing in a specific region where goods are sold may be configured to take at least one of Ultra Wideband (UWB), near field communication (Near Field Communication, NFC), bluetooth (Bluetooth), ultrasonic wave, MAT, or beacon in a local area network.

Also, the user terminal 100 and the seller terminal 200 can confirm the location information of the user terminal 100 and the seller terminal 200 by using a global positioning system (Global Positioning System, GPS) and generate data of the location information.

Fig. 2 is a block diagram showing the configuration of the user terminal 100 according to an embodiment of the present invention.

Referring to fig. 2, the user terminal 100 may be configured to include an image capturing section 110, a commodity identification section 120, a principal identity authentication execution section 130, a commodity information providing section 140, a commodity payment execution section 150, a communication section 160, a storage section 170, and a control section 180.

The image photographing part 110 may visually photograph the periphery of the user terminal 100 and generate an image, which may be configured in the form of a still picture, but may also be configured in the form of an image composed of a plurality of frames.

Unlike the image photographing section 110 which may automatically perform an action to photograph an image without an operation of the user when the user terminal 100 is located in a specific space where the payment system 10 is employed, the image photographing may be performed when the user executes a specific application on the user terminal 100 in order to employ the payment system 10.

The commodity identification section 120 may identify commodities that the user wants to purchase around the user terminal 100 in various ways.

According to an embodiment, the method of identifying the commodity to be purchased by the commodity identification part 120 may be performed by image analysis. That is, the image capturing unit 110 mounted on the user terminal 100 analyzes the outline image of the commodity, and can specify the type and number of commodities.

In this way, the article identifying portion 120 can identify articles to be purchased and accumulate information related to the articles in the form of "shopping carts" or the like on the user terminal 100.

When the collection is performed by analyzing the outline image of the commodity, the commodity identification part 120 may identify and analyze only the image of the commodity held by the user. That is, the article identifying section 120 may identify only the article held by the user by analyzing the image, instead of identifying and classifying all the articles present on the photographed image as articles to be purchased.

According to an embodiment, the article identifying portion 120 may identify the article to be purchased by identifying a bar code or a two-dimensional code displayed on the article to be purchased, instead of identifying the article to be purchased by analyzing an outline image of the article.

The commodity identification section 120 identifies a barcode or a two-dimensional code present on the image captured by the image capturing section 110, and designates the kind and the number of commodities corresponding to the acquired barcode or two-dimensional code, so that it can be managed as a commodity to be purchased.

According to an embodiment of the present invention, when identifying a commodity to be purchased based on an image captured by the image capturing section 110, the commodity identification section 120 may employ a method of analyzing an outline image of the commodity and a method of employing a barcode or a two-dimensional code displayed on the commodity in combination.

In detail, when the commodity identification part 120 identifies the commodity to be purchased, the type of the commodity may be specified by the identified barcode or two-dimensional code for the commodity whose barcode or two-dimensional code is identified by the image capturing part 110, and the type of the commodity may be specified by analyzing the outline image of the commodity for the commodity whose barcode or two-dimensional code is not identified on the captured image.

That is, the image of the commodity photographed by the image photographing part 110 may display only a part of the commodity, and thus may not recognize a bar code or a two-dimensional code displayed on the appearance of the commodity, however, a commodity recognition method by analyzing the outline image is simultaneously adopted, so that the accuracy of commodity recognition may be improved.

The article recognition part 120 according to an embodiment may additionally include an artificial intelligence management part 121 and an electronic tag management part 122.

When the commodity identification section 120 analyzes the outline image of the commodity acquired by the image capturing section 110 to specify the type and number of commodities, the artificial intelligence management section 121 may execute the specified type and number of commodities by an artificial intelligence engine mounted in the user terminal 100.

The artificial intelligence engine included in the artificial intelligence management part 121 may employ a machine learning or deep learning technique. The artificial intelligence engine may set a plurality of commodity images as learning data and learn through the set learning data, so that the image analysis capability may be improved.

The machine learning adopted by the artificial intelligence engine can be at least one algorithm adopted by haar like, convolutional Neural Network (CNN) and deformation model based on convolutional neural network (regional convolutional neural network (R-CNN, region-CNN), fast regional convolutional neural network (Fast R-CNN), faster regional convolutional neural network (Fast R-CNN), YOLO, SSD, mask regional convolutional neural network (Mask R-CNN)).

Such an artificial intelligence engine may be implemented in software within the user terminal 100.

When the user terminal 100 recognizes an article to be purchased, the electronic tag management section 122 may acquire article information by an electronic tag recognition manner instead of acquiring article information based on the image acquired by the image capturing section 110.

The electronic tag may be adapted in the form of radio frequency identification technology (Radio Frequency Identification, RFID), near field communication (Near Field Communication, NFC) technology, and the electronic tag may be included in or attached to each article in the form of including article information having a price.

The electronic tag management section 122 may identify electronic tags located within a prescribed interval from the user terminal 100, thereby causing the user terminal 100 to identify the article to be purchased.

According to an embodiment of the present invention, when the commodity identification portion 120 identifies a commodity to be purchased, the commodity located in the commodity storing tool can be identified. For example, the commodity keeping tool may be a cart, basket, or bag used at a commodity sales site, and the basket may be a plastic bag, shopping cart, or the like.

When the commodity identification unit 120 identifies the commodity located in the commodity storage tool by image analysis, only the outline image of the commodity located in the commodity storage tool in the image captured by the image capturing unit 110 is analyzed, and the identified commodity is handled as the commodity to be purchased.

According to an embodiment, the commodity identification unit 120 may identify only commodities located in a commodity storing tool used in a specific location. That is, the commodity in the storage tool or the loading tool held by the user is not recognized, and only the predetermined commodity storage tool is recognized.

When the commodity identification unit 120 identifies a commodity to be purchased based on the image analysis, it first determines whether the commodity is a commodity storage tool used in a specific location by the image analysis, and when the commodity storage tool used in the specific location is identified on the image, the image analysis of the commodity located inside the commodity storage tool may be additionally performed.

When the article identification portion 120 identifies an article to be purchased based on communication with the electronic tag, a predetermined article keeping tool used in a specific location may also include the electronic tag, and therefore, only articles present within a prescribed distance from the electronic tag may be identified as articles to be purchased.

According to an embodiment, when identifying the article to be purchased, the article identifying portion 120 may also employ article identifying information received from the seller terminal 200, instead of directly employing the image analysis method or the electronic tag method described above.

The seller terminal 200 may be connected to the article recognition apparatus 300, and the article recognition apparatus 300 may recognize the article in the same or similar manner as the article recognition portion 120 of the user terminal 100 operates. That is, the article identifying apparatus 300 may employ a method of identifying an article by an outline image analysis of the article, a method of identifying an article by a bar code or a two-dimensional code displayed on the article, or a method of identifying an article by communication with an electronic tag included in the article.

When the user approaches and holds the article, the article recognition apparatus 300 may additionally acquire user information and provide information related to the user terminal 100 to the seller terminal 200.

Such recognition of the user terminal 100 may be performed based on the commodity recognition apparatus 300 receiving the position information of the user terminal 100 in real time, and may also be performed in such a manner that the commodity recognition apparatus 300 recognizes the user by collecting facial images of the user or the like and analyzing and determines the user terminal 100 information corresponding to the recognized user.

According to an embodiment, the actions of the article identification device 300 described above may be performed at the seller terminal 200. That is, the article identification device 300 and the seller terminal 200 may be integrated into one device to operate.

The principal identity authentication performing section 130 receives the biometric information from the seller terminal 200 and performs principal identity authentication based on whether the received biometric information and the biometric information prestored on the user terminal 100 agree.

For example, when the face image in the biometric information is used for personal identity authentication, the seller terminal 200 can identify the user by the photographed face image of the user, and transmit the face image to the user terminal 100 corresponding to the identified user. The personal authentication performing part 130 may compare the face image received from the seller terminal 200 with the face image pre-stored in the user terminal 100, and perform personal authentication if it is judged that the images are identical.

When the article identifying portion 120 identifies an article to be purchased that the user wants to purchase, the article information providing portion 140 may provide information related to the article to the user. In detail, the commodity information providing section 140 may provide information related to the total price of one or more commodities identified as commodities to be purchased to the user through the display device or the sound generating device of the user terminal 100.

According to an embodiment, when the commodity identification part 120 identifies only the commodity located in the predetermined commodity storing tool, the commodity information providing part 140 may provide the type, number, and price information of the commodity located in the predetermined commodity storing tool to the user.

By such a function, the user can determine the type and number of the identified commodity through his own user terminal 100, so that shopping can be conveniently performed at his own will.

When the principal authentication is successfully performed by the principal authentication performing section 130 of the user terminal 100, the commodity payment performing section 150 may perform payment for the commodity.

The commodity payment performing part 150 according to an embodiment may receive the payment request signal from the seller terminal 200 and make payment accordingly. As described above, the seller terminal 200 may be connected to a door installed at a specific place, and when a user or the user terminal 100 passes through the door, the door may identify the user or the user terminal 100 and transmit information related to the user or the user terminal 100 to the seller terminal 200. The seller terminal 200 may receive information related to the user or the user terminal 100 from the gate and transmit a payment request signal to the corresponding user terminal 100 to perform payment.

That is, when a user selects a commodity that the user wants to purchase at a specific place under the line, the user terminal 100 recognizes the selected commodity to be purchased, and when the user passes through a gate at an exit, the selection and payment of the commodity can be realized in a form that payment for the recognized commodity is automatically realized on the user terminal 100.

In contrast, when the user terminal 100 arrives at a specific location or leaves a specific place, the commodity payment performing section 150 may perform payment for the selected purchased commodity.

According to an embodiment, the commodity payment performing part 150 may generate two-dimensional codes or bar codes for all commodities identified as to-be-purchased by the user terminal 100, and such two-dimensional codes or bar codes may be identified by the seller terminal 200, whereby payment for all commodities identified as to-be-purchased may be performed. That is, the two-dimensional code or the bar code generated by the commodity payment performing section 150 may include information related to all commodities identified as to be purchased and information related to the payment method.

According to another embodiment, when the seller terminal 200 recognizes a commodity to be purchased through the commodity recognition apparatus 300 and generates a two-dimensional code or a bar code, the commodity payment performing part 150 may recognize the two-dimensional code or the bar code and perform payment. In this case, the commodity payment execution section 150 can recognize a two-dimensional code or a bar code by the image capturing section 110 of the user terminal 100. The two-dimensional code or bar code generated by the seller terminal 200 may include information related to all items identified as to be purchased.

According to another embodiment, the commodity payment performing part 150 may perform payment for the commodity identified by the commodity identifying part 120 without communicating with the seller terminal 200. That is, in this embodiment, payment for the goods identified by the user terminal 100 itself may be performed in the absence of the seller terminal 200. In this case, the principal identity authentication performing section 130 may also perform principal identity authentication through the biometric information acquired by the user terminal 100 itself instead of through the seller terminal 200, and may perform payment when the principal identity authentication is successfully performed.

The commodity payment execution unit 150 may make payment by various payment methods such as credit card payment, check card payment, debit card payment, bank transfer payment, virtual money payment, payment by mobile phone, and the like, and the payment method may also employ personal identification by biometric information.

According to an embodiment, the commodity payment performing part 150 may support payment by a payment initiation service provider (PISP, payment Initiation Service Provider). PISP provides a financial service through an open API that does not take the form of the payment infrastructure of an existing bank, so that a consumer can use an account held by the consumer to perform a payment or remittance by simply logging into a particular service.

The communication unit 160 causes the user terminal 100 to perform communication with the seller terminal 200, the management server 400, the external server 500, and the like. The communication network used by the communication section 160 for performing communication may be configured in a plurality of communication modes, and the communication modes may not be differentiated between wired or wireless modes. For example, various communication networks such as a local area network (LAN, local Area Network), a metropolitan area network (MAN, metropolitan Area Network), a wide area network (WAN, wide Area Network), and the like may be implemented. As described above, the local area network may be implemented by Ultra Wide Band (UWB), near field communication (Near Field Communication, NFC), ultrasonic waves, MAT, beacons, and the like.

The storage unit 170 performs a function for storing information acquired, generated, and processed in various configuration units of the user terminal 100. That is, the storage unit 170 may store user-related information, payment method-related information, information related to an algorithm used by the artificial intelligence engine, and the like. For example, such a storage section 170 may include a memory (memory), a cache (cache), a buffer (buffer), or the like, and may be constituted by software, firmware, hardware, or a combination of at least two of them.

The control unit 180 may perform a function of controlling data flow among the image capturing unit 110, the commodity identification unit 120, the personal identification authentication execution unit 130, the commodity information providing unit 140, the commodity payment execution unit 150, the communication unit 160, and the storage unit 170. That is, the control section 180 may support the image capturing section 110, the commodity identification section 120, the principal identity authentication execution section 130, the commodity information providing section 140, the commodity payment execution section 150, the communication section 160, and the storage section 170 to execute the unique functions, respectively.

In fig. 2, the image capturing unit 110, the commodity identification unit 120, the personal identification authentication execution unit 130, the commodity information providing unit 140, and the commodity payment execution unit 150 are configured to classify the control unit 180 by function, and thus may be arranged and integrated into one control unit 180.

Fig. 3 is a diagram for explaining a manner in which the user terminal 100 recognizes goods and performs payment using the payment system 10 of the present invention according to an embodiment of the present invention.

In contrast to the recognition of the commodity that the user wants to purchase, which is shown in fig. 3, is performed by image capturing and analysis, the commodity may be recognized by various means such as bar code recognition, two-dimensional code recognition, or electronic tag recognition.

When the user arrives at a specific place where goods are sold offline and starts shopping, the image photographing part 110 such as a camera mounted on the user terminal 100 may perform an action.

The user terminal 100 may capture an image of the surrounding commodity by a camera (step S310), and thereafter, may identify the commodity to be purchased by image analysis (step S320). According to an embodiment, the identification of the commodity to be purchased of the user terminal 100 may be based on image analysis to perform the identification of the commodity held by the user's hand. That is, not all the items captured on the photographed image are identified as items to be purchased, but only items held by the user's hand or items having a distance from the user less than a prescribed distance may be identified as items to be purchased. According to another embodiment, the user terminal 100 may also identify only the goods located within the predetermined specific goods keeping tool as goods to be purchased.

The seller terminal 200 may identify the biometric information of the user (step S330) and transmit the identified biometric information to the user terminal 100 (step S340). In this case, the seller terminal 200 can determine to which user terminal 100 the biometric information of the identified user is transmitted through the user information or the information of the user terminal 100 matched with the biometric information.

For example, when a face image in the biometric information is used for user identification, the seller terminal 200 may designate a user through analysis of the identified face image and transmit the face image to the user terminal 100 corresponding to the user. In contrast, the seller terminal 200 may also transmit biometric information to a plurality of user terminals 100 located within a specific location, and may also designate the user terminal 100 to which the biometric information is to be transmitted through location information (e.g., GPS location information) transmitted by the user terminal 100 to the seller terminal 200.

After receiving the biometric information from the seller terminal 200, the user terminal 100 may perform principal identity authentication by comparing the received biometric information with the biometric information pre-stored in the user terminal 100 (step S350).

Thereafter, the seller terminal 200 may transmit a payment request signal to the user terminal 100 (step S360). For example, when the user terminal 100 leaves a specific commodity sales site, the seller terminal 200 may also transmit a payment request signal based on the location information of the user terminal 100, in contrast to which the payment request signal may also be transmitted in the case where the user arrives at the specific location or leaves the commodity sales site by analyzing the user's actions using Closed Circuit Television (CCTV) of the specific commodity sales site.

After receiving the payment request signal from the seller terminal 200, the user terminal 100 may perform payment for the goods identified as to be purchased (step S370). According to another embodiment, the user can make a payment by operating the user terminal 100 even in a state where the payment request signal is not received from the seller terminal 200.

Fig. 4 is a diagram for explaining a manner in which a user terminal 100 according to another embodiment of the present invention recognizes goods and performs payment using the payment system 10 of the present invention.

In fig. 4, there is a separate article recognition apparatus 300, and the article recognition apparatus 300 may perform recognition of an article held by a user for purchase. In contrast, according to another embodiment of the present invention, the article identification device 300 and the seller terminal 200 may be integrated into one device and perform actions.

Referring to fig. 4, when the user makes shopping at a store or the like on line, the article identifying apparatus 300 may capture an image of an article that the user wants to purchase (step S410), and identify the article to be purchased through image analysis (step S420). According to an embodiment, artificial intelligence engine analysis techniques may also be employed in such image analysis.

The article identification device 300 may transmit information related to the article identified as the article to be purchased to the seller terminal 200 (step S430).

The seller terminal 200 according to an embodiment can identify the location of the user terminal 100 through the location information transmitted from the user terminal 100 (step S440), and additionally identify the biometric information of the user (step S450). After that, the seller terminal 200 may transmit the recognized biometric information to the user terminal 100 recognized through the location information, and transmit the information of the recognized commodity received from the commodity recognition apparatus 300 to the user terminal 100 together (step S460).

Thereafter, the seller terminal 200 may receive a pass signal indicating that the user terminal 100 has passed through from a door connected by a local area network or the like (step S470). In contrast, the door may capture an image by a camera or the like mounted near the door, identify a user from the captured image by a face image or the like, and transmit information about the identified user to the vendor terminal 200.

Thereafter, the seller terminal 200 transmits a payment request signal to the identified user terminal 100 (step S480), and the user terminal 100 may thereby perform payment of the goods to be purchased included in the information received in step S460 (step S490).

Thus, according to various embodiments of the present invention, identification of the user, the user terminal 100, and the related goods that the user wants to purchase may be automatically performed in various ways, and when the user selects all goods that want to purchase and moves to or away from a specific location, payment for the selected goods may be performed.

Fig. 5 is a schematic diagram of the overall environment in which the payment system 1000 operates according to an embodiment of the present invention.

Referring to fig. 5, the payment system 1000 may be configured in a form including a dedicated terminal 10000, a user terminal 20000, a management server 30000, an external server 40000, and an access tool 50000.

The payment system 1000 may be installed for use at various locations where goods are sold under line.

The dedicated terminal 10000 can be mounted on the commodity transportation means 2000 and operated. When the user moves the commodity that the user wants to purchase to the commodity transportation means 2000, the dedicated terminal 10000 may recognize the commodity and include the commodity in the preliminary purchase list, and then may generate payment information related to the commodity included in the preliminary purchase list and transmit it to the user terminal 20000.

According to an embodiment, the dedicated terminal 10000 may be linked with a camera mounted on the commodity transportation means 2000, and may receive an image photographed by the camera and perform an action of identifying and paying for a commodity based thereon.

In this case, the dedicated terminal 10000 may be located at a self-service station or a cash register station that enables the user to recognize and pay for goods by himself, and may also be implemented as a POS terminal or a self-service terminal device.

The user terminal 20000, which is a terminal held by a user and controlled by the user, can be connected to the dedicated terminal 10000 or the management server 30000 within the payment system 1000 through computer software or an application installed on a web browser or the user terminal 20000. The user terminal 20000 can exchange various data with the dedicated terminal 10000, the management server 30000, and the external server 40000 within the payment system 1000, and can determine contents to be displayed by a screen (display portion) of the user terminal 20000 based on these data.

The dedicated terminal 10000 or the user terminal 20000 may include all types of hand-held (Handheld) based wireless communication devices, such as mobile phones, smartphones, personal digital assistants (Personal Digital Assistant, PDA), portable multimedia players (Portable Multimedia Player, PMP), tablet computers, etc., capable of connecting to a web server through a network, and may be one of digital devices equipped with a personal computer (e.g., desktop, notebook, etc.), a workstation, PDA, web pad, etc., storing means and loaded with a microprocessor to have computing capabilities.

The user terminal 20000 may function as a user performing payment for goods that are desired to be purchased using the payment system 1000. The user terminal 20000 can exchange various information with the dedicated terminal 10000, and such communication is realized with the management server 30000 as an intermediary.

The user terminal 20000 may receive information on one or more goods from the dedicated terminal 10000, and the goods-related information may be transmitted in the form of a preliminary purchase list managed by the dedicated terminal 10000. The user terminal 20000 may perform payment based on commodity information received from the dedicated terminal 10000, and may also perform principal identity authentication or adult authentication first for payment.

The management server 30000 manages data so that the payment system 1000 operates smoothly, and can exchange necessary data with the dedicated terminal 10000 and the user terminal 20000. For example, the management server 30000 may manage a plurality of off-line stores as a whole, and thereby may communicate with a dedicated terminal 10000 located in the plurality of off-line stores and a user terminal 20000 to perform payment in the off-line stores for purchasing goods.

The external server 40000 is a server existing separately from the management server 30000, and according to an embodiment, the management server 30000 can acquire various data required for smooth operation of the payment system 1000 from the external server 40000, and the dedicated terminal 10000 or the user terminal 20000 can also acquire necessary data through communication with the external server 40000. For example, the external server 40000 may be composed of a server managed by a wholesaler or the like who provides a commodity for sale, a credit card server that needs communication for performing Payment, a Payment Gateway (PG) server, or the like.

Such a management server 30000 and an external server 40000 may be configured to include hardware such as a control portion having at least one processor, a communication module, a storage portion (e.g., a memory), or software for arithmetic calculation.

The access tool 50000 separates an off-line specific space in which a user purchases a commodity from the outside or other space, and may be configured in the form of a door or an access opening that operates in an opening-closing manner.

According to an embodiment, the opening and closing operation of the access tool 50000 can be controlled by the dedicated terminal 10000 or the management server 30000.

According to an embodiment of the present invention, in the payment system 1000, a communication network used for communication by the dedicated terminal 10000, the user terminal 20000, the management server 30000, the external server 40000, and the access tool 50000 may be configured into a plurality of communication modes, which may not distinguish between wired or wireless modes, and the like. For example, it may be implemented by various communication networks such as a local area network (LAN, local Area Network), a metropolitan area network (MAN, metropolitan Area Network), a wide area network (WAN, wide Area Network), and the like. Preferably, the communication network according to an embodiment of the present invention may also be a known World Wide Web (WWW), or the like.

For example, the wireless communication may include cellular communication using at least one of LTE, long term evolution Advanced (LTE-a), code division multiple access (code division multipleaccess, CDMA), wideband Code Division Multiple Access (WCDMA), ultra Wideband (UWB), universal mobile telecommunications system (universal mobile telecommunications system, UMTS), wireless broadband (Wireless Broadband, wiBro), or global system for mobile communications (Global System for Mobile Communications, GSM), etc. According to one embodiment, for example, the wireless communication may include at least one of WiFi (wireless fidelity), bluetooth low energy (Bluetooth Low Energ, BLE), zigbee, near field communication (near field communication, NFC), magnetic security transmission (Magnetic Secure Transmission), radio Frequency (RF), or body area network (Body Area Network, BAN). According to one embodiment, the wireless communication may include a global navigation satellite system (Global Navigation Satellite System, GNSS). The GNSS may be, for example, a Global positioning System (Global Positioning System, GPS), a Global navigation satellite System (Global Navigation Satellite System, glonass), a Beidou navigation satellite System (Beidou Navigation Satellite System) or Galileo (Galileo), a European Global satellite navigation System (the European global satellite-based navigation system).

Fig. 6 is a block diagram schematically showing the configuration of a dedicated terminal 10000 according to an embodiment of the present invention.

Referring to fig. 6, the dedicated terminal 10000 may be configured to include a commodity identification section 11000, a purchase list management section 12000, a discrimination information obtaining section 13000, a biological information management section 14000, a payment information management section 15000, an access tool management section 16000, a communication section 17000, a storage section 18000, and a control section 190.

The article identifying portion 11000 may identify the article placed on the article transport 2000 by the user through various identification methods.

According to an embodiment, the article recognition portion 11000 may visually capture the periphery and generate an image. That is, the commodity identification portion 11000 may obtain an image related to an external commodity using an image pickup device such as a camera module or a camera (camera) module mounted on the dedicated terminal 10000. The image collected by the commodity identification unit 11000 may be configured as a still picture, but may be configured as a video composed of a plurality of frames.

Unlike the commodity identification section 11000 according to an embodiment, which can automatically perform an action to take an image without a user operation, the user can also start image taking by operating the dedicated terminal 10000 in a specific manner.

According to an embodiment, when identifying a commodity to be purchased on a photographed image, the commodity identification portion 11000 may identify the commodity through image analysis. Such image analysis may be performed at the dedicated terminal 10000, but may also be performed at the management server 30000. When image analysis is performed on the management server 30000, the article identifying portion 11000 transmits the photographed image to the management server 30000, and analyzes the image from the management server 30000 so that information related to a specific article can be received.

The image analysis performed on the dedicated terminal 10000 or the management server 30000 may be performed by an artificial intelligence engine included in the dedicated terminal 10000 or the management server 30000. Such artificial intelligence engines may employ machine learning or deep learning techniques to perform image analysis. The artificial intelligence engine may set a plurality of commodity images as learning data and learn through the set learning data, so that the image analysis capability may be improved.

The machine learning adopted by the artificial intelligence engine can be at least one algorithm adopted by haar like, convolutional Neural Network (CNN) or deformation model based on convolutional neural network (regional convolutional neural network (R-CNN, region-CNN), fast regional convolutional neural network (Fast R-CNN), faster regional convolutional neural network (Fast R-CNN), YOLO, SSD, mask regional convolutional neural network (Mask R-CNN)).

Such an artificial intelligence engine may be implemented in hardware or software on a dedicated terminal 10000 or a management server 30000.

According to an embodiment, the article identifying portion 11000 may identify the article to be purchased by identifying a bar code or a two-dimensional code displayed on the article to be purchased, instead of identifying the article to be purchased by analyzing an outline image of the article. That is, the commodity identification unit 11000 can specify the type and number of commodities corresponding to the acquired barcode or two-dimensional code by identifying the barcode or two-dimensional code present on the captured image.

According to an embodiment of the present invention, when the article identifying portion 11000 identifies an article to be purchased based on a captured image, a method of analyzing an outline image of the article and a method of using a barcode or a two-dimensional code displayed on the article may be used in combination.

In detail, when the commodity identification part 11000 identifies a commodity to be purchased, the type of the commodity can be specified by the identified barcode or two-dimensional code for the commodity whose barcode or two-dimensional code is identified on the acquired image, and the type of the commodity can be specified by analyzing the outline image of the commodity for the commodity whose barcode or two-dimensional code is not identified on the acquired image.

That is, only a part of the commodity may be displayed on the image obtained by the commodity identification part 11000, and therefore a bar code or a two-dimensional code displayed on the appearance of the commodity may not be identified, however, a method of identifying the commodity by analysis of the outline image is adopted at the same time, so that the accuracy of commodity identification may be improved.

Such an operation of the commodity identification unit 11000 may be executed by the management server 30000 as the commodity identification unit transmits the acquired image to the management server 30000.

According to an embodiment of the present invention, when identifying an article to be purchased, the article identifying portion 11000 acquires article information in an electronic tag identification manner, not based on analyzing a captured image.

The electronic tag may be adapted in the form of radio frequency identification technology (Radio Frequency Identification, RFID) and near field communication (Near Field Communication, NFC) technology, and the electronic tag may be included in or attached to each article in the form of including article information having a price.

When the electronic tag is used to identify the commodity, the commodity identification portion 11000 causes the user terminal 20000 to identify the commodity to be purchased by identifying the electronic tag located within a prescribed interval from the dedicated terminal 10000.

When it is determined that the commodity identified by the commodity identification portion 11000 is located within the commodity transportation 2000, the purchase list management portion 12000 may include the commodity in the preliminary purchase list.

That is, the purchase list managing unit 12000 may determine whether or not to include the commodity in the preliminary purchase list, based on whether or not the commodity identified by the commodity identifying unit 11000 is located in the commodity transportation 2000.

According to an embodiment, the purchase list managing section 12000 may identify that the commodity included in the preliminary purchase list is removed from the commodity transporting means 2000, and delete the identified commodity from the preliminary purchase list.

The identification information obtaining section 13000 may collect identification information for the user to perform payment. The collection of such discrimination information may be performed by an input section of the dedicated terminal 10000, and the dedicated terminal 10000 may obtain discrimination information from a user by an input section of a touch panel, a keyboard, a mouse, voice recognition, or the like.

The identification information obtaining section 13000 can specify information of the user and the user terminal 20000 by the obtained identification information.

The identification information may consist of an ID, a password, a PI N code, etc., or a combination thereof. According to an embodiment, the PI N code may be replaced by biological information as described below.

After or during the acquisition of the identification information from the user by the identification information acquisition section 13000, the biological information management section 14000 can acquire the biological information of the user. This biometric information can be used for identity authentication of the principal used in payment.

According to an embodiment, the dedicated terminal 10000 can obtain and manage biological information by communicating with a separate principal authentication device.

According to an embodiment of the present invention, the biometric information may be stored in the private terminal 10000, the user terminal 20000, the management server 30000, or other cloud, etc., by distribution and authentication is performed. That is, one piece of biological information may be stored and kept in one or more media described above, and at least a part of the biological information may also be stored in a dispersed form in a specific medium.

For example, the biometric information may be stored in one of encrypted vector data, pattern value, or hash value, and may be stored in the user terminal 20000, the management server 30000, or other cloud environment.

According to an embodiment, the biological information management section 14000 transmits the sensed information of the user to the management server 30000 or the external server 40000 using a wireless communication circuit, and receives the identification information (for example, a mobile phone number) related to the own identity authentication apparatus from the management server 30000 or the external server 40000. The biometric information management unit 14000 may transmit the user's sensing information to the identified personal authentication device by using the wireless communication circuit and receive authentication data from the personal authentication device. The biometric information management unit 14000 may perform a predetermined function based on the authentication data or output an authentication failure message via the input/output device.

The payment information management unit 15000 may generate payment information for the commodity included in the preliminary purchase list and transmit the same to the user terminal 20000 designated by the identification information obtaining unit 13000. In this process, the biological information management unit 14000 may transmit the obtained biological information of the user to the user terminal 20000.

The user terminal 20000 may receive the biometric information and the payment information from the dedicated terminal 10000, and the biometric information and the payment information according to an embodiment may also be transmitted to the user terminal 20000 through the management server 30000.

The user terminal 20000 can perform personal authentication by the received biometric information. That is, the user terminal 20000 may determine whether the received biometric information matches the biometric information pre-stored on the user terminal 20000, and based thereon, perform principal identity authentication. When the principal identity authentication is successfully performed, the user terminal 20000 can perform payment for the goods included in the preliminary purchase list through the received payment information.

After performing the payment, the user terminal 20000 may transmit information related to the completion of the payment to the dedicated terminal 10000 or the management server 30000. The dedicated terminal 10000 that receives information on whether to pay or not may also provide payment completion information to the user through a display section or a voice output section of the dedicated terminal 10000.

The user terminal 20000 can make payment through various payment means such as credit card payment, check card payment, debit card payment, bank transfer payment, virtual money payment, open bank payment, mobile phone micropayment, etc., and the payment method can also use principal identity authentication through biological information. The card Payment on the user terminal 10000 may be performed through a Payment Gateway (PG) company server, but may be directly connected to the card company server to perform the Payment without passing through the PG company server.

The user terminal 20000 may perform payment by a payment instruction proxy service provider (PI SP). The PI SP may provide a financial service in the form of a payment infrastructure that does not take the form of an existing bank through the open AP I and allows the consumer to use the consumer's holding account to perform payment or remittance by simply logging into a particular service.

According to an embodiment, when there is a commodity (for example, wine, tobacco, or the like) requiring adult authentication among the commodities identified by the commodity identification section 11000 and included in the preliminary purchase list, the payment information management section 15000 may transmit the payment information to the user terminal 20000 only in the case where information related to adult authentication is received from the user terminal 20000.

According to another embodiment, when there is a commodity requiring adult authentication among commodities identified and included in the preliminary purchase list by the commodity identification section 11000, the payment information management section 15000 generates and transmits payment information to perform payment on the user terminal 20000 that received the payment information only in the case where adult authentication is completed on the user terminal 20000.

When the dedicated terminal 10000 receives information on payment completion from the user terminal 20000, the access tool management unit 16000 can control the opening and closing of the access tool 50000 at a specific position based on the information.

For example, the access tool 50000 may be an exit of a particular business location, and the access tool management portion 16000 may control the access tool 50000 such that only a user who has completed payment for goods located on the goods transport 2000 may pass through the exit.

According to an embodiment, the access tool management part 16000 grasps the position of the dedicated terminal 10000 and controls the access tool 50000 to be opened only when the position of the dedicated terminal 10000 is located near the access tool 50000.

The communication unit 17000 can communicate the dedicated terminal 10000 with the user terminal 20000, the management server 30000, the external server 40000, the access tool 50000, and the like. The communication network used by the communication unit 17000 for performing communication may be configured in a plurality of communication modes, and the communication modes may not be different from wired or wireless modes. For example, various communication networks such as a local area network (LAN, local Area Network), a metropolitan area network (MAN, metropolitan Area Network), a wide area network (WAN, wide Area Network), and the like may be implemented. As described above, the local area network may be implemented by Ultra Wide Band (UWB), near field communication (Near Field Communication, NFC), ultrasonic waves, MAT, beacons, and the like.

The storage unit 18000 performs a function for storing information acquired, generated, and processed in various arrangement units of the dedicated terminal 10000. That is, the storage unit 18000 may store user-related information, payment method-related information, information related to an algorithm used by the artificial intelligence engine, and the like. For example, such a storage section 18000 may include a memory (memory), a cache (cache), a buffer (buffer), or the like, and may be configured of software, firmware, hardware, or a combination of at least two of them. The memory may include volatile and/or nonvolatile memory. For example, the memory may store instructions or data related to at least one other component of the personal authentication apparatus. According to one embodiment, the memory may store software and/or programs. For example, programs may include a kernel (kernel), middleware, application programming interfaces (Application Program Interface, APIs), and/or application programs (or "applications"). For example, the memory may include an internal memory or an external memory. For example, the internal Memory includes at least one of volatile Memory (e.g., dynamic Random Access Memory (Dynamic Random Access Memory, DRAM), static Random Access Memory (SRAM), or synchronous dynamic Random Access Memory (Synchronous Dynamic Random-Access Memory, SDRAM), nonvolatile Memory (e.g., one-time programmable ROM (One Time Programmable ROM, OTPROM), programmable read-Only Memory (Programmable Read-Only Memory, PROM), erasable programmable read-Only Memory (Erasable Programmable Read Only Memory, EPROM), electrically erasable programmable read-Only Memory (Electrically Erasable Programmable read Only Memory, EEPROM), mask ROM, flash Memory, hard disk drive, or Solid State Drive (SSD)), the external Memory may include a flash drive (flash drive), such as Compact Flash (CF) card, secure Digital (SD) card, micro SD card, extreme digital (xD) card, multimedia card (multi-media) or the like, and may be connected to the MMC through an external Memory interface or the like.

The control section 190 may perform a function of controlling the data flow between the commodity identification section 11000, the purchase list management section 12000, the identification information obtaining section 13000, the biological information management section 14000, the payment information management section 15000, the access tool management section 16000, the communication section 17000, and the storage section 18000. That is, the control section 190 may support the commodity identification section 11000, the purchase list management section 12000, the identification information obtaining section 13000, the biological information management section 14000, the payment information management section 15000, the access tool management section 16000, the communication section 17000, and the storage section 18000 to perform the unique functions, respectively.

In fig. 6, the commodity identification unit 11000, the purchase list management unit 12000, the identification information acquisition unit 13000, the biological information management unit 14000, the payment information management unit 15000, and the access tool management unit 16000 are functionally arranged in a classified manner in the control unit 190, and thus can be integrated into one control unit 190.

Fig. 7 is a block diagram schematically showing the configuration of the management server 30000 according to an embodiment of the present invention.

Referring to fig. 7, the management server 30000 may be configured to include a commodity specifying unit 31000, a purchase list managing unit 32000, a discrimination information managing unit 33000, a biological information managing unit 34000, a payment information managing unit 35000, an access tool managing unit 36000, a communication unit 37000, a storage unit 38000, and a control unit 390.

The commodity specifying section 31000, the purchase list managing section 32000, the discrimination information managing section 33000, the biological information managing section 34000, the payment information managing section 35000, the access tool managing section 36000, the communication section 37000, the storage section 38000, and the control section 390 of the management server 30000 correspond to the commodity identifying section 11000, the purchase list managing section 12000, the discrimination information obtaining section 13000, the biological information managing section 14000, the payment information managing section 15000, the access tool managing section 16000, the communication section 17000, the storage section 18000, and the control section 190 of the dedicated terminal 10000, respectively, and perform similar functions.

For example, the commodity specifying unit 31000 may analyze and specify the identified commodity by receiving the image captured by the commodity identifying unit 11000 through the artificial intelligence engine, and may transmit or add information on the specified commodity to the purchase list to the dedicated terminal 10000. The purchase list managing unit 32000, the identification information managing unit 33000, and the biometric information managing unit 34000 may each receive the purchase list, the identification information, and the biometric information of the user from the dedicated terminal 10000, and manage and use the same. The payment information management unit 35000 and the access tool management unit 36000 may also receive management information on the payment information and the access tool from the dedicated terminal 10000, and manage and use the same.

That is, the management server 30000 can receive necessary data from the corresponding configuration of the dedicated terminal 10000 and manage it, and can perform mediation of transmitting it to the user terminal 20000, the external server 40000, or the access tool 50000.

Unlike the management server 30000 according to an embodiment, which may be located in a specific space where a user purchases goods, may be located outside the specific space and manage a plurality of business points together.

Thus, according to the embodiment of the present invention, even when the user terminal 20000 and the management server 30000 are not located in an off-line business where the user purchases the commodity, the identification and payment of the commodity can be achieved only by the dedicated terminal 10000 installed in the commodity transportation means 2000.

Fig. 8 is a flowchart for explaining a manner in which the dedicated terminal 10000 according to an embodiment of the present invention recognizes and makes payment for goods using the payment system 1000 of the present invention.

Referring to fig. 8, a dedicated terminal 10000 installed in the commodity transportation means 2000 can designate the number and kind of commodities by capturing an external image in such a manner that an image of the commodity is captured.

The dedicated terminal 100000 may identify items that the user wants to purchase in various ways as described above. In fig. 8, among such various modes, a procedure of using a mode of specifying the kind, the number, and the like of the commodity by the image analysis mode will be exemplified.

The dedicated terminal 10000 can capture an image related to a commodity that the user wants to purchase by capturing an external image (step S410), and transmit the captured image to the management server 30000 (step S420).

The management server 30000 may receive an image related to a commodity from the dedicated terminal 10000 and perform analysis on the image. Such image analysis can be performed by an artificial intelligence engine mounted in the management server 30000, and can specify the type and number of products by identifying a barcode, a two-dimensional code, or the like included in the image, in addition to analyzing the product image itself.

The dedicated terminal 10000 may receive information on the article identified through the analysis of the article image from the management server 30000 (step S430), and thereafter, determine whether the identified article is located in the article transport 2000, and may include the article in the preliminary purchase list when it is determined that the identified article is located in the article transport 2000 (step S440).

Thereafter, when the user wants to purchase the commodity in the commodity transportation 2000, the user may input the identification information to the dedicated terminal 10000, and the dedicated terminal 10000 may receive the identification information from the user and introduce the user information to specify the user terminal 20000 based on the identification information (step S450).

The dedicated terminal 10000 can obtain the biometric information of the user, generate payment information related to the goods included in the preliminary purchase list, and transmit the biometric information and the payment information to the user terminal 20000 side (step S460).

The personal identity authentication may be performed by the biometric information received from the dedicated terminal 10000 on the user terminal 20000 side, which may be performed based on a comparison of the biometric information received from the dedicated terminal 10000 and the biometric information stored on the user terminal 20000. Thereafter, when the identity authentication of the own person is successfully completed, the user terminal 20000 can perform payment through the payment information received from the dedicated terminal 10000.

Such payments may be performed by a variety of payment methods, such as credit card payments, check card payments, debit card payments, account transfer payments, virtual currency payments, payments by open bank payments, cell phone micropayments, payments by PI SP, and the like.

After the payment is performed, the user terminal 20000 may transmit information on the completion of the payment to the dedicated terminal 10000, and the dedicated terminal 10000 may receive whether the payment is performed or not from the user terminal 20000, and may control the access tool 50000 to be in an open state when the payment is successfully completed (step S470).

According to an embodiment, control of the access tool 50000 may not be performed immediately upon completion of the payment. That is, when the commodity transporting means 2000 in a state where payment is successfully completed moves to the vicinity of the access means 50000, the access means 50000 can be controlled to be in an open state based on the position information of the dedicated terminal 10000 and the access means 50000. Also, when additional goods are identified in the goods-transporting means 2000 after the payment is completed, the dedicated terminal 10000 may not perform control of the access means 50000 until additional payment for the additional goods is achieved.

Fig. 9a to 9b are flowcharts for explaining a manner in which the dedicated terminal 10000 according to an embodiment of the present invention performs payment for goods requiring adult authentication at the time of purchase.

As described above, as shown in fig. 9a to 9b, the dedicated terminal 10000 can process payment of goods requiring adult authentication in different manners.

Referring first to fig. 9a, the dedicated terminal 10000 confirms whether or not there is a commodity requiring adult authentication in the preliminary purchase list in the payment step (step S510), and when there is a commodity requiring adult authentication, requests information related to adult authentication to the designated user terminal 20000 by means of the discrimination information before generating and transmitting the payment information to the user terminal 20000 (step S520).

After that, the dedicated terminal 10000 receives the information related to the adult authentication from the user terminal 20000 and performs confirmation related thereto (step S530), and can transmit payment information of the commodity included in the preliminary purchase list to the user terminal 20000 only when the adult authentication is successfully completed (step S540).

Next, referring to fig. 9b, the dedicated terminal 10000 confirms whether or not there is a commodity requiring adult authentication in the preliminary purchase list in the payment step (step S550), generates payment information in a form that can be paid only when adult authentication is completed in the process of generating payment information for the commodity included in the preliminary purchase list, and transmits it to the user terminal 20000 (step S560).

In order to perform payment through the payment information received from the dedicated terminal 10000, the user terminal 20000 needs to complete adult authentication, and only after successful completion of adult authentication, can perform payment (step S570).

In this way, the payment system 1000 can be equipped with an adult authentication confirmation system required for purchasing goods in various ways.

According to the various embodiments described above, the payment system of the present invention can support convenient non-face-to-face payment by consumers through a dedicated terminal installed in a commodity transportation, whereby operation of an unmanned shop can also be facilitated. And, even in the case where the consumer does not hold the terminal, the payment can be performed using the terminal.

The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by hardware, or in a combination of the two. The software modules may also reside on RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), flash Memory (Flash Memory), hard disk, removable magnetic disk, CD-ROM, or any form of computer readable recording medium known in the art to which the invention pertains.

While the embodiments of the present invention have been described above with reference to the drawings, it will be understood by those skilled in the art that the present invention may be embodied in other specific forms without changing the technical spirit or essential features of the present invention. Accordingly, it should be understood that the above-described embodiments are illustrative in all respects, rather than restrictive.

Claims

1. A method of performing a payment by a payment system employing a user terminal, wherein,

the method for the payment system to execute the payment comprises the following steps:

the user terminal identifies the commodity to be purchased;

a step in which a seller terminal that recognizes biometric information of a user transmits the biometric information of the user to the user terminal;

The user terminal performing principal identity authentication by whether the biometric information of the user received from the seller terminal is identical to the biometric information pre-stored on the user terminal; and

and when the user terminal successfully executes identity authentication of the user, the user terminal executes the step of paying for the commodity identified by the user terminal.

2. The method of performing payment by a payment system of claim 1 wherein,

the biological information includes any one or more of fingerprint information, iris information, facial image information, vein information, electrocardiogram information, or voice information.

3. The method of performing payment by a payment system of claim 1 wherein,

the seller terminal is configured to:

identifying the user terminal through a gate connected with the seller terminal and transmitting a payment request signal to the user terminal,

the user terminal is configured to:

payment for the commodity is performed based on a payment request signal received from the seller terminal.

4. The method of performing payment by a payment system of claim 1 wherein,

the step of identifying the commodity to be purchased by the user terminal comprises the following steps:

When the image capturing unit mounted on the user terminal captures an outline image of the commodity, the user terminal analyzes the captured outline image of the commodity to specify the type and number of the commodity.

5. The method of performing payment by a payment system of claim 4 wherein,

the step of the user terminal specifying the kind and number of the commodity by the acquired outline image of the commodity is performed by an artificial intelligence engine mounted on the user terminal,

the artificial intelligence engine learns through the outline image of the commodity.

6. The method of performing payment by a payment system of claim 1 wherein,

and the step of acquiring commodity information by the user terminal through the electronic tag included in the commodity.

7. The method of performing payment by a payment system of claim 1 wherein,

in the step of identifying the commodity to be purchased, the user terminal only identifies the commodity located in the predetermined commodity keeping tool.

8. The method of performing payment by a payment system of claim 7 wherein,

the commodity safekeeping tool is a cart, basket or bag.

9. The method of performing payment by a payment system of claim 1 wherein,

the user terminal provides information related to a total price of one or more goods identified as goods to be purchased through a display device or a sound generation device.

10. The method of performing payment by a payment system of claim 1 wherein,

and a step in which when the image capturing unit mounted on the user terminal recognizes the barcode or the two-dimensional code, the user terminal designates the type of the commodity corresponding to the acquired barcode or two-dimensional code.

11. The method of performing payment by a payment system of claim 1 wherein,

and a step of designating the type of the commodity by the barcode or the two-dimensional code by the commodity which is recognized by the image capturing unit mounted on the user terminal, and designating the type of the commodity by analyzing the outline image of the commodity without recognizing the barcode or the two-dimensional code from the captured image.

12. The method of performing payment by a payment system of claim 1 wherein,

The step of the user terminal identifying the article to be purchased is implemented in a manner of receiving article identification information from the article identification device,

wherein the article identification device is connected with the seller terminal.

13. The method of performing payment by a payment system of claim 1 wherein,

the step of the user terminal performing payment for the goods identified by the user terminal further includes:

a step in which the user terminal generates a two-dimensional code or a barcode including information on one or more items identified as items to be purchased and payment instrument information; and

the seller terminal recognizing the two-dimensional code or bar code performs a payment based on commodity information and payment instrument information included in the two-dimensional code or bar code.

14. A method of performing a payment by a payment system employing a user terminal, wherein,

the user terminal identifies the commodity to be purchased;

a step in which the user terminal recognizes biometric information of the user;

the user terminal executing identity authentication by whether the recognized biometric information is identical to biometric information pre-stored on the user terminal; and

15. A payment system employing a user terminal, wherein,

the payment system includes:

a seller terminal identifying and transmitting biological information of a user to a user terminal; and

and a purchaser terminal identifying a commodity to be purchased, and performing principal identity authentication by whether the biometric information of the user received from the seller terminal is identical to the biometric information pre-stored therein, and when the principal identity authentication is successfully performed, performing payment for the identified commodity.