KR20220154600A - Payment method and system using a dedicated terminal installed in product transportation method - Google Patents

Abstract

A payment method and payment system using a dedicated terminal installed in a product transport means are disclosed. According to one of various embodiments of the present invention, the method for a payment system to perform a payment using a dedicated terminal installed in a product transport means comprises the step of: recognizing, by the dedicated terminal, at least one product to be purchased and including the product in a preliminary purchase list when it is determined that the recognized product is located within the product transport means; obtaining, by the dedicated terminal, identification information for performing payment for at least one product located in the product transport means from a user, and acquiring biometric information of the user; transmitting, by the dedicated terminal, the biometric information and payment information to a user terminal recognized through the identification information; and performing, by the user terminal, identity authentication through the received biometric information and when identity authentication is successfully performed, performing payment for product in the preliminary purchase list through the payment information.

Description

Payment method and payment system using a dedicated terminal installed in the means of transportation of goods {PAYMENT METHOD AND SYSTEM USING A DEDICATED TERMINAL INSTALLED IN PRODUCT TRANSPORTATION METHOD}

Various embodiments of the present invention relate to a technology for recognizing a product that a consumer wants to purchase and performing payment using a dedicated terminal installed in a means of transporting the product.

As technology develops, payment methods for purchasing goods are gradually diversifying. In particular, a method of making a payment through a smartphone that most people always carry is being developed.

For example, a consumer may recognize a product to be purchased by using a camera or other means installed in his or her smartphone and make a payment through the smartphone.

However, when a consumer purchases a large number of products, such as in a large mart, there is inconvenience in recognizing the products that the consumer wants to purchase.

Therefore, there is a need for a system that automatically recognizes and pays for a product that a consumer wants to purchase without requiring the user to directly recognize the product one by one using a terminal such as his/her smartphone.

In addition, a system that allows consumers to make payments using their smartphones even when they do not carry their smartphones in their hands, or a method that minimizes the operation of their smartphones in their hands. It was a situation where a system was needed.

Korean Patent Publication No. 10-2021-0010598

An object of various embodiments of the present invention is to construct an automatic payment system in a way that minimizes manipulation of a terminal possessed by a consumer offline.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

According to one of various embodiments of the present invention for solving the above problems, in a method for performing a payment using a dedicated terminal installed in a means of transporting goods in a payment system, the dedicated terminal provides at least one product to be purchased. recognizing and including the recognized product in a preliminary purchase list when it is determined that the recognized product is located within the means of transporting the product; obtaining, by the dedicated terminal, identification information for performing payment for at least one product located in the means of transporting goods from a user, and acquiring biometric information of the user; transmitting, by the dedicated terminal, the biometric information and payment information to a user terminal recognized through the identification information; and, by the user terminal, performing identity authentication through the received biometric information and performing payment for products included in the preliminary purchase list through the payment information when identity authentication is successfully performed. A payment execution method of a payment system may be disclosed.

The identification information may be characterized in that it consists of a PIN number.

The biometric information may include any one or more of fingerprint information, iris information, facial image information, vein information, electrocardiogram information, or voice information.

The payment execution method of the payment system may further include the step of receiving, by the dedicated terminal, whether or not the user terminal performs payment, and controlling opening/closing of an access means at a specific location when payment is completed.

The payment execution method of the payment system may further include receiving, by the dedicated terminal, whether or not the user terminal has performed payment, and providing payment completion information to the user through a display unit or an audio output unit of the dedicated terminal. .

The dedicated terminal may transmit payment information to the user terminal only when receiving adult authentication-related information from the user terminal when there is a product requiring adult authentication among recognized products.

If there is a product that requires adult authentication among the products recognized by the dedicated terminal, the user terminal that has received the payment information can perform payment only when adult authentication is completed on the user terminal. .

In the process of recognizing the product to be purchased by the dedicated terminal, when the external image of the product is collected by the image capturing unit mounted on the exclusive terminal, the dedicated terminal transmits the collected external image of the product to the management server. It may be to specify the type and quantity of products through analysis on the management server.

The step of specifying the type and quantity of the product by analyzing the external image of the collected product by the management server is performed by an artificial intelligence engine installed in the management server, and the artificial intelligence engine is characterized in that the external appearance of the product Learning can be done through images.

The machine learning algorithm utilized by the artificial intelligence engine may be composed of one of haar like, convolutional neural network (CNN), YOLO, or SSD.

The step of recognizing a product to be purchased by the dedicated terminal may include obtaining product information through an electronic tag included in the product by the dedicated terminal.

In the step of recognizing a product to be purchased by the dedicated terminal, when a barcode or QR code is recognized by an image capture unit mounted in the dedicated terminal, the type of product corresponding to the barcode or QR code collected by the dedicated terminal may be to specify

In the step of recognizing a product to be purchased by the dedicated terminal, the product whose barcode or QR code is recognized by the image capture unit mounted in the dedicated terminal specifies the type of product through the barcode or QR code, and collects For a product whose barcode or QR code is not recognized on the image, the type of product may be specified through an external image analysis of the product.

According to one of various embodiments of the present invention for solving the above problems, in the method for performing payment using a dedicated terminal connected to a camera installed in a means of transporting goods in a payment system, the dedicated terminal makes at least one purchase Recognizing a target product and including the product in a preliminary purchase list when it is determined that the recognized product is located within the means of transporting the product; obtaining, by the dedicated terminal, identification information for performing payment for at least one product located in the means of transporting goods from a user, and acquiring biometric information of the user; transmitting, by the dedicated terminal, the biometric information and payment information to a user terminal recognized through the identification information; and, by the user terminal, performing identity authentication through the received biometric information and performing payment for products included in the preliminary purchase list through the payment information when identity authentication is successfully performed. A payment execution method of a payment system may be disclosed.

According to another one of various embodiments of the present invention for solving the above problems, in a payment system using a dedicated terminal installed in a means of transporting goods, at least one product to be purchased is recognized and the recognized product is the product. If it is determined that the product is located within the means of transportation, the corresponding product is included in the preliminary purchase list, identification information for performing payment for at least one or more products located within the means of transportation is acquired from the user, and biometric information of the user is acquired. and a dedicated terminal for transmitting the biometric information and payment information to a user terminal recognized through the identification information; and a user terminal configured to perform identity authentication through the biometric information received from the dedicated terminal and, when identity authentication is successfully performed, perform payment for products included in the preliminary purchase list through the payment information. To, the payment system can be disclosed.

According to an embodiment of the present invention, payment can be made through a dedicated terminal installed in a means of transporting goods, and payment can be performed through identity authentication even in a situation where a consumer does not have his/her own terminal.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

1 is a schematic diagram of an entire environment in which a payment system operates according to an embodiment of the present invention.
2 is a block diagram schematically showing the configuration of a dedicated terminal according to an embodiment of the present invention.
3 is a block diagram schematically showing the configuration of a management server according to an embodiment of the present invention.
4 is a flowchart illustrating a method for a dedicated terminal to recognize and pay for a product using the payment system of the present invention according to an embodiment of the present invention.
5 is a flowchart illustrating a method of paying for a product requiring adult authentication for purchase by a dedicated terminal according to an embodiment of the present invention.

Terminology used herein is for describing the embodiments and is not intended to limit the present invention. In this specification, singular forms also include plural forms unless specifically stated otherwise in a phrase. As used herein, "comprises" and/or "comprising" does not exclude the presence or addition of one or more other elements other than the recited elements. Like reference numerals throughout the specification refer to like elements, and “and/or” includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various components, these components are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first element mentioned below may also be the second element within the technical spirit of the present invention.

When it is said that a certain part "includes" a certain component throughout the specification, it means that it may further include other components without excluding other components unless otherwise stated. In addition, terms such as "...unit" and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software. .

In this specification, 'user' may refer to an entity such as a consumer who purchases a specific product using the payment system of the present invention, and 'seller' refers to an entity that sells products using the payment system of the present invention. can do. In addition, the product transportation means is a means for storing products that consumers want to purchase within a specific area, and may consist of a cart, basket, bag, etc. used in a product sales place, and the basket may consist of a plastic bag, a shopping cart, etc. It can be, but is not limited to this example.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a schematic diagram of an entire environment in which a payment system 10 according to an embodiment of the present invention operates.

Referring to FIG. 1 , the payment system 10 may be configured in a form including a dedicated terminal 100, a user terminal 200, a management server 300, an external server 400, and an access means 500. .

The payment system 10 may be installed and utilized in a place where various products are sold offline.

The dedicated terminal 100 may be installed and operated in the product transportation means 20 . When a product the user wants to purchase is moved to the product transportation means 20, the dedicated terminal 100 can recognize the product and include the product in the preliminary purchase list, and later on the products included in the preliminary purchase list. Payment information may be generated and transmitted to the user terminal 200 .

According to an embodiment, the dedicated terminal 100 may operate in conjunction with a camera installed in the means of transporting goods 20, receive an image captured by the camera, and perform an operation for recognizing and paying for a product based thereon. can be performed.

In this case, the dedicated terminal 100 may be located at a self-desk or payment counter where a user can recognize and pay for a product by himself, and may be implemented as a POS terminal or a kiosk device.

The user terminal 200 is a terminal held and controlled by a user, and a dedicated terminal 100 or management server 300 in the payment system 10 through a web browser or computer software or application installed on the user terminal 200. can access The user terminal 200 can exchange various data with the dedicated terminal 100, the management server 300, and the external server 400 within the payment system 10, and based on such data, the user terminal 200 It is possible to determine the contents to be displayed through the screen (display unit) of the .

The dedicated terminal 100 or the user terminal 200 is a mobile phone, smart phone, PDA (Personal Digital Assistant), PMP (Portable Multimedia Player), tablet PC, and the like, all types of handhelds that can be connected to a web server through a network. It may include a handheld-based wireless communication device, and has a memory means such as a personal computer (eg, a desktop computer, a notebook computer, etc.), a workstation, a PDA, a web pad, etc. It may be one of the digital devices equipped with

The user terminal 200 may play a role of making a payment for products that the user wants to purchase using the payment system 10 . The user terminal 200 can send and receive various types of information from the dedicated terminal 100, and such communication may be performed through the management server 300 as a medium.

The user terminal 200 may receive information on at least one product from the dedicated terminal 100, and the information on the product may be delivered in the form of a preliminary purchase list managed by the dedicated terminal 100. The user terminal 200 may perform payment based on the product information received from the dedicated terminal 100, and authentication of the user or adult may be required for payment.

The management server 300 can manage data so that the payment system 10 can operate smoothly and exchange necessary data with the dedicated terminal 100 and the user terminal 200 . For example, the management server 300 may manage a plurality of offline stores as a whole, and accordingly, the dedicated terminals 100 located in the plurality of offline stores, and a person who wants to make a payment to purchase a product at the offline store Communication with the user terminals 200 can be performed.

The external server 400 is a server that exists separately from the management server 300. According to an embodiment, the management server 300 obtains various data necessary for smooth operation of the payment system 10 from the external server 400. The dedicated terminal 100 or the user terminal 200 can also obtain necessary data through communication with the external server 400. For example, the external server 400 may include a server managed by a wholesale company providing products to be sold, a credit card server requiring communication to perform payment, a PG server, and the like.

The management server 300 and the external server 400 may include hardware such as a control unit having at least one processor, a communication module, a storage unit (eg, memory), or software for algorithm operation.

The access unit 500 separates a specific off-line space where a user purchases a product from the outside or other spaces, and may be configured in the form of a gate or door that operates in an open/closed manner.

According to an embodiment, the opening/closing operation of the access unit 500 may be controlled by the dedicated terminal 100 or the management server 300 .

According to an embodiment of the present invention, the dedicated terminal 100, the user terminal 200, the management server 300, the external server 400, and the access means 500 are used to communicate within the payment system 10. The communication network may be configured regardless of its communication mode, such as wired and wireless, for example, a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN). Network) can be implemented in various communication networks. Preferably, the communication network according to an embodiment of the present invention may be a well-known World Wide Web (WWW) or the like.

Wireless communication includes, for example, LTE, LTE-A (LTE Advance), CDMA (code division multiple access), WCDMA (wideband CDMA), UWB (ultra wide band) UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband ), or cellular communication using at least one of GSM (Global System for Mobile Communications). According to one embodiment, wireless communication, for example, WiFi (wireless fidelity), Bluetooth, Bluetooth Low Energy (BLE), Zigbee, near field communication (NFC), magnetic secure transmission (Magnetic Secure Transmission), radio It may include at least one of a frequency (RF) and a body area network (BAN). According to one embodiment, wireless communication may include GNSS. GNSS may be, for example, a Global Positioning System (GPS), a Global Navigation Satellite System (Glonass), a Beidou Navigation Satellite System or Galileo, the European global satellite-based navigation system.

2 is a block diagram schematically showing the configuration of a dedicated terminal 100 according to an embodiment of the present invention.

Referring to FIG. 2 , the dedicated terminal 100 includes a product recognition unit 110, a purchase list management unit 120, an identification information acquisition unit 130, a biometric information management unit 140, a payment information management unit 150, and access means. It may include a management unit 160, a communication unit 170, a storage unit 180 and a control unit 190.

The product recognition unit 110 may recognize a product that the user places on the product transportation means 20 through various recognition methods.

According to one embodiment, the product recognition unit 110 may create an image by visually photographing the surroundings. That is, the product recognition unit 110 may acquire an image of an external product by utilizing an image collecting device such as a camera module or a camcorder module mounted in the dedicated terminal 100 . The image collected by the product recognition unit 110 may be configured in the form of a photograph in a still state, but may also be configured in the form of a video consisting of a plurality of frames.

The product recognizer 110 according to an embodiment may automatically operate and capture an image without a user's manipulation. Alternatively, the user may start capturing an image by manipulating the dedicated terminal 100 in a specific way.

According to one embodiment, the product recognition unit 110 may recognize a product through image analysis in recognizing a product to be purchased on a photographed image. Such image analysis may be performed in the dedicated terminal 100 or in the management server 300 . When image analysis is performed on the management server 300, the product recognition unit 110 transmits the captured image to the management server 300 and analyzes the image from the management server 300 to receive information on a specific product. can do.

Image analysis performed on the dedicated terminal 100 or the management server 300 may be performed by an artificial intelligence engine included in the dedicated terminal 100 or the management server 300 . Such an artificial intelligence engine may perform image analysis using machine learning or deep learning technology. The artificial intelligence engine can improve image analysis ability by setting a plurality of product images as learning data and performing learning through the set learning data.

The machine learning used by the artificial intelligence engine is a haar like and convolutional neural network (cnn) or a convolutional neural network-based transformation model (R-CNN, Fast R-CNN, Faster R-CNN, YOLO, SSD , Mask R-CNN) may be used.

Such an artificial intelligence engine may be implemented in hardware or software on the dedicated terminal 100 or the management server 300 .

According to an embodiment, the product recognition unit 110 may recognize a product to be purchased by recognizing a barcode or QR code displayed on the product to be purchased, rather than by analyzing an external image of the product. That is, the product recognition unit 110 may recognize barcodes or QR codes present on the photographed image and specify the type and number of products corresponding to the collected barcodes or QR codes.

According to an embodiment of the present invention, in recognizing a product to be purchased based on a photographed image, the product recognition unit 110 analyzes the external image of the product and utilizes a barcode or QR code displayed on the product. The method can be used comprehensively.

In detail, when the product recognition unit 110 recognizes the product to be purchased, the product for which the barcode or QR code is recognized on the collected image specifies the type of product through the recognized barcode or QR code, and the collected For a product whose barcode or QR code is not recognized on the image, the type of product can be specified through an external image analysis of the product.

That is, since only a part of the product may appear on the image acquired by the product recognition unit 110, the barcode or QR code displayed on the exterior of the product may not be recognized accordingly, and the product recognition method through external image analysis is also utilized. By doing so, the accuracy of product recognition can be improved.

This operation of the product recognition unit 110 may be performed on the management server 300 as the product recognition unit transmits the collected images to the management server 300 .

According to an embodiment of the present invention, in recognizing a product to be purchased, the product recognition unit 110 enables product information to be acquired using an electronic tag recognition method rather than a photographed image analysis basis.

The electronic tag may be applied in a form utilizing radio frequency identification (RFID) and near field communication (NFC) technologies, and the electronic tag may be included in or attached to each product in a form including product information including a price.

When recognizing a product using an electronic tag, the product recognition unit 110 recognizes an electronic tag located within a certain distance from the exclusive terminal 100 so that the user terminal 200 recognizes a product to be purchased. can do.

When it is determined that the product recognized by the product recognition unit 110 is located in the product transportation means 20, the purchase list manager 120 may include the corresponding product as a preliminary purchase list.

That is, the purchase list management unit 120 may determine whether to include the corresponding product in the preliminary purchase list according to whether the product recognized by the product recognition unit 110 is located in the product transportation means 20 .

According to an embodiment, the purchase list management unit 120 may recognize that a product included in the preliminary purchase list is removed from the product transportation means 20 and may delete the recognized product from the preliminary purchase list.

The identification information acquiring unit 130 may collect identification information for making a payment from a user. Such collection of identification information may be performed through an input unit of the dedicated terminal 100, and the dedicated terminal 100 may acquire identification information from a user through an input unit such as a touch screen, keyboard, mouse, and voice recognition. .

The identification information acquisition unit 130 may specify information about the user and the user terminal 200 through the acquired identification information.

Identification information may consist of ID, password, PIN number, etc. or a combination thereof. According to one embodiment, the PIN number may be replaced with biometric information to be described later.

The biometric information management unit 140 may acquire the user's biometric information after the identification information acquisition unit 130 acquires the identification information from the user or in the process of acquiring the identification information. Such biometric information may be used for user authentication for payment.

According to an embodiment, the dedicated terminal 100 may acquire and manage biometric information by communicating with a separate identity authentication device.

According to an embodiment of the present invention, biometric information used for user authentication for payment may consist of any one or a combination of fingerprint information, iris information, facial image information, vein information, electrocardiogram information, or voice information. .

According to an embodiment of the present invention, biometric information may be distributedly stored in the dedicated terminal 100, the user terminal 200, the management server 300, or other clouds, and authentication may be performed. That is, one piece of biometric information may be stored in at least one of the aforementioned media, and at least a portion of biometric information may be stored in a distributed form in a specific medium.

For example, biometric information may be stored in one of encrypted vector data, pattern values, and hash values, and may be stored in the user terminal 200, the management server 300, or other cloud environments.

According to an embodiment, the biometric information management unit 140 transmits the user's sensing information to the management server 300 or the external server 400 using a wireless communication circuit, and the management server 300 or the external server 400 It is possible to obtain identification information such as a mobile phone number for the identity authentication device from. In addition, the biometric information management unit 140 may transmit the user's sensing information to the identified identity authentication device using a wireless communication circuit and receive authentication data from the identity authentication device. The biometric information management unit 140 may perform a predetermined function based on authentication data or output an authentication failure message through an input/output device.

The payment information management unit 150 may generate payment information for products included in the preliminary purchase list and transmit it to the user terminal 200 specified by the identification information acquisition unit 130 . During this process, the biometric information management unit 140 may transmit the acquired biometric information of the user to the user terminal 200 together.

The user terminal 200 may receive biometric information and payment information from the dedicated terminal 100, and according to an embodiment, the biometric information and payment information may be transmitted to the user terminal 200 through the management server 300. have.

The user terminal 200 may perform identity authentication through the received biometric information. That is, the user terminal 200 may determine whether the received biometric information matches the biometric information pre-stored on the user terminal 200 and perform identity authentication based on the determination. When identity authentication is successfully performed, the user terminal 200 may perform payment for products included in the preliminary purchase list through the received payment information.

After performing the payment, the user terminal 200 may transmit information about the completed payment to the dedicated terminal 100 or the management server 300 . The dedicated terminal 100 receiving information on whether to perform payment may provide payment completion information to the user through a display unit or an audio output unit of the dedicated terminal 100 .

The user terminal 200 may proceed with payment through various payment methods such as credit card payment, check card payment, debit card payment, account transfer payment, virtual currency payment, point payment, open banking payment, mobile phone micropayment, and the like. The payment method may be a method of using identity authentication through biometric information. Payment through a card on the user terminal 100 may be performed through a PG (Payment Gateway) company server, but may be directly connected to a card company server without passing through a PG company server and the payment may be performed.

The user terminal 200 may perform payment through PISP (Payment Instruction Agency Service Provider). PISP provides a form of financial service that does not utilize the payment infrastructure of existing banks through an open API, and allows consumers to make payments or remittances using their accounts just by logging in to a specific service. .

According to an embodiment, the payment information management unit 150 may select products that require adult authentication (eg, alcoholic beverages, cigarettes, etc.) among products recognized by the product recognition unit 110 and included in the preliminary purchase list. If present, payment information may be transmitted to the user terminal 200 only when adult authentication related information is received from the user terminal 200 .

According to another embodiment, the payment information management unit 150, when there is a product that requires adult authentication among products recognized by the product recognition unit 110 and included in the preliminary purchase list, the user terminal receiving the payment information ( 200), payment information can be generated and transmitted so that payment can be performed only when adult authentication is completed on the user terminal 200.

When the access means management unit 160 receives the payment completion information from the user terminal 200, the dedicated terminal 100 may control opening and closing of the access means 500 at a specific location based on this information.

For example, the access means 500 may be an exit of a specific business place, and the access means management unit 160 allows only users who have completed payment for products located in the product transportation means 20 to pass through the corresponding exit. The means 500 can be controlled.

According to an embodiment, the access means manager 160 determines the location of the dedicated terminal 100 and opens the access means 500 only when the dedicated terminal 100 is located near the access means 500. You can control it.

The communication unit 170 enables the dedicated terminal 100 to communicate with the user terminal 200, the management server 300, the external server 400, and the access means 500. The communication network used by the communication unit 170 to perform communication may be configured regardless of its communication mode, such as wired and wireless, for example, a local area network (LAN) and a metropolitan area network (MAN). Area Network), wide area network (WAN), etc. may be implemented in various communication networks. As described above, the local area network may be implemented through Ultra Wideband (UWB), Near Field Communication (NFC), ultrasound, MAT, beacon, and the like.

The storage unit 180 serves to store information collected, generated, and processed in various components of the dedicated terminal 100 . That is, the storage unit 180 may store information about a user, information about a payment method, information about an algorithm used by an artificial intelligence engine, and the like. The storage unit 180 may include, for example, a memory, a cache, a buffer, and the like, and may be composed of software, firmware, hardware, or a combination of at least two or more of these. Memory may include volatile and/or non-volatile memory. The memory may store, for example, commands or data related to at least one other component of the identity authentication device. According to one embodiment, the memory may store software and/or programs. Programs may include, for example, kernels, middleware, application programming interfaces (APIs), and/or application programs (or "applications"). The memory may include, for example, an internal memory or an external memory. Built-in memory includes, for example, volatile memory (e.g. DRAM, SRAM, or SDRAM, etc.), non-volatile memory (e.g. one time programmable ROM (OTPROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, flash memory) , a hard drive, or a solid state drive (SSD) The external memory may include a flash drive, for example, a compact flash (CF), secure digital (SD), Micro-SD, It may include Mini-SD, extreme digital (xD), multi-media card (MMC), memory stick, etc. The external memory may be functionally or physically connected to the user authentication device through various interfaces.

The control unit 190 includes a product recognition unit 110, a purchase list management unit 120, an identification information acquisition unit 130, a biometric information management unit 140, a payment information management unit 150, an access means management unit 160, a communication unit ( 170) and the storage unit 180 may perform a function of controlling data flow. That is, the control unit 190 includes a product recognition unit 110, a purchase list management unit 120, an identification information acquisition unit 130, a biometric information management unit 140, a payment information management unit 150, an access means management unit 160, The communication unit 170 and the storage unit 180 may support each to perform a unique function.

2, the product recognition unit 110, the purchase list management unit 120, the identification information acquisition unit 130, the biometric information management unit 140, the payment information management unit 150, and the access means management unit 160 are the control unit 190 Since it is a functionally classified configuration, it can be integrated and configured as one control unit 190.

Figure 3 is a block diagram schematically showing the configuration of the management server 300 according to an embodiment of the present invention.

Referring to FIG. 3 , the management server 300 includes a product specification unit 310, a purchase list management unit 320, an identification information management unit 330, a biometric information management unit 340, a payment information management unit 350, and an access means management unit. 360, a communication unit 370, a storage unit 380, and a control unit 390 may be configured.

The product specification unit 310 of the management server 300, the purchase list management unit 320, the identification information management unit 330, the biometric information management unit 340, the payment information management unit 350, the access means management unit 360, the communication unit ( 370), the storage unit 380, and the control unit 390 include the product recognition unit 110, purchase list management unit 120, identification information acquisition unit 130, biometric information management unit 140, The payment information management unit 150, the access means management unit 160, the communication unit 170, the storage unit 180, and the control unit 190 may perform similar roles.

For example, the product specifying unit 310 receives an image taken by the product recognizing unit 110, analyzes it through an artificial intelligence engine, specifies a recognized product, and transmits information on the specified product to the dedicated terminal 100. ) or added to the purchase list. In addition, the purchase list management unit 320, the identification information management unit 330, and the biometric information management unit 340 may receive, manage, and utilize the purchase list, identification information, and user's biometric information from the dedicated terminal 100, respectively. The payment information management unit 350 and the access means management unit 360 may also receive payment information and access means management information from the dedicated terminal 100 to manage and utilize them.

That is, the management server 300 can receive and manage necessary data from a corresponding component of the dedicated terminal 100 and mediate it by transferring it to the user terminal 200, external server 400 or access means 500. role can be fulfilled.

The management server 300 according to an embodiment may be located in a specific space where a user purchases a product, but may be located outside a specific space and manage a plurality of branches together.

As such, according to an embodiment of the present invention, even when the user terminal 200 and the management server 300 are not located in an offline branch where a user purchases a product, only the dedicated terminal 100 installed in the product transportation means 20 is provided. Through this, product recognition and payment can be made.

4 is a flowchart illustrating a method of recognizing and paying for a product by using the payment system 10 of the present invention in the dedicated terminal 100 according to an embodiment of the present invention.

Referring to FIG. 4 , the dedicated terminal 100 installed in the means of transporting goods 20 may specify the number and type of goods by taking an image of the goods through external image capture.

As described above, the dedicated terminal 100 may recognize a product that the user wants to purchase through various methods. In FIG. 4 , a process in which the type and number of products are specified through the image analysis method among these various methods will be described as an example.

The dedicated terminal 100 may capture an image of a product the user wants to purchase through external image capture (S410), and may transmit the captured image to the management server 300 (S420).

The management server 300 may receive an image of a product from the dedicated terminal 100 and perform analysis on the image. Such image analysis may be performed by an artificial intelligence engine installed in the management server 300, and the type and number of products may be determined through recognition of barcodes or QR codes included in the image as well as product image analysis itself. may be specified.

The dedicated terminal 100 may receive information on the product recognized through the analysis of the product image from the management server 300 (S430), and then determine whether the recognized product is located in the product transportation means 20 If it is determined that the recognized product is located in the product transportation means 20, the corresponding product may be included in the preliminary purchase list (S440).

Thereafter, when the user wants to purchase products in the means of transportation 20, the user can input identification information into the dedicated terminal 100, and the dedicated terminal 100 receives the identification information from the user and based on this The user terminal 200 may be specified by calling user information (S450).

The dedicated terminal 100 may acquire the user's biometric information, generate payment information for products included in the preliminary purchase list, and transmit the biometric information and payment information to the user terminal 200 (S460).

On the side of the user terminal 200, authentication may be performed through the biometric information received from the dedicated terminal 100, which is the biometric information received from the dedicated terminal 100 and the biometric information stored on the user terminal 200. It can be performed based on the comparison of Thereafter, when authentication is normally completed, the user terminal 200 may perform payment through the payment information received from the dedicated terminal 100 .

Such payment may be performed through various payment methods such as credit card payment, check card payment, debit card payment, account transfer payment, virtual currency payment, point payment, open banking payment, mobile phone small amount payment, and payment through PISP.

The user terminal 200 may transmit information about payment completion to the dedicated terminal 100 after performing the payment. In this case, the access means 500 may be controlled to be open (S470).

According to an embodiment, control of the access means 500 may not be immediately performed when payment is completed. That is, when the product transportation means 20 in a state in which payment is normally completed moves near the access means 500, the access means 500 is controlled to be opened according to the location information of the dedicated terminal 100 and the access means 500. It can be. In addition, when an additional product is recognized in the product transportation means 20 after the payment is completed, the control of the access means 500 by the dedicated terminal 100 will not be performed until the additional payment for the added product is made. can

5 is a flowchart illustrating a method of paying for a product requiring adult authentication for purchase by the dedicated terminal 100 according to an embodiment of the present invention.

As described above, the dedicated terminal 100 may process payment for products requiring adult authentication in different ways, as shown in (a) and (b) of FIG. 5 .

Looking at (a) of FIG. 5 first, the dedicated terminal 100 checks whether there are products requiring adult authentication in the preliminary purchase list in the payment step (S510), and if there are products requiring adult authentication, the payment information is sent. Before generating and transmitting to the user terminal 200, adult authentication related information may be requested from a specific user terminal 200 through identification information (S520).

Thereafter, the dedicated terminal 100 receives adult authentication-related information from the user terminal 200, performs confirmation thereof (S530), and transmits payment information of products included in the preliminary purchase list to the user only when adult authentication is normally completed. It can be transmitted to the terminal 200 (S540).

Next, referring to (b) of FIG. 5, in the payment step, the dedicated terminal 100 checks whether there are products requiring adult authentication in the preliminary purchase list (S550), and determines information about the products included in the preliminary purchase list. In the process of generating payment information, only when adult authentication is completed, payment information may be generated in a form in which payment is possible and transmitted to the user terminal 200 (S560).

The user terminal 200 needs to complete adult authentication in order to make a payment through the payment information received from the dedicated terminal 100, and can perform the payment only after successfully completing the adult authentication (S570).

In this way, the payment system 10 may have an adult authentication confirmation system required for product purchase through various methods.

According to various embodiments described above, the payment system of the present invention can support convenient non-face-to-face payment of consumers through a dedicated terminal installed in a means of transporting goods, and through this, the operation of unmanned stores can also be made convenient. In addition, the consumer may perform payment using the terminal even in a situation where the consumer does not own the terminal.

The embodiments described above may be implemented as hardware components, software components, and/or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate (FPGA). array), programmable logic units (PLUs), microprocessors, or any other device capable of executing and responding to instructions. A processing device may run an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of software. For convenience of understanding, there are cases in which one processing device is used, but those skilled in the art will understand that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it can include. For example, a processing device may include a plurality of processors or a processor and a controller. Other processing configurations are also possible, such as parallel processors.

Software may include a computer program, code, instructions, or a combination of one or more of the foregoing, which configures a processing device to operate as desired or processes independently or collectively. You can command the device. Software and/or data may be any tangible machine, component, physical device, virtual equipment, computer storage medium or device, intended to be interpreted by or provide instructions or data to a processing device. Alternatively, it may be permanently or temporarily embodied in a signal wave to be transmitted. Software may be distributed on networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer readable media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program commands recorded on the medium may be specially designed and configured for the embodiment or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CDROMs and DVDs, and magnetic-optical media such as floptical disks. Included are hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Although the embodiments of the present invention have been described with reference to the accompanying drawings, those skilled in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features of the present invention. you will be able to understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

10: Payment system
20: Transportation of goods
100: dedicated terminal
200: user terminal
300: management server
400: external server

Claims (10)

A method for making a payment using a dedicated terminal installed in a means of transportation for a payment system, the method comprising:
recognizing at least one product to be purchased by the dedicated terminal and including the product in a preliminary purchase list when it is determined that the recognized product is located within the means of transporting the product;
obtaining, by the dedicated terminal, identification information for performing payment for at least one product located in the means of transporting goods from a user, and acquiring biometric information of the user;
transmitting, by the dedicated terminal, the biometric information and payment information to a user terminal recognized through the identification information; and
The user terminal performs identity authentication through the received biometric information and, when identity authentication is successfully performed, performing payment for products included in the preliminary purchase list through the payment information,
In the process of recognizing the product to be purchased by the dedicated terminal, when the external image of the product is collected by the image capturing unit mounted on the exclusive terminal, the dedicated terminal transmits the collected external image of the product to the management server. To specify the type and quantity of products through analysis on the management server,
In the specification of the type and quantity of products, the product for which the barcode or QR code is recognized on the external image of the product collected by the image capturing unit specifies the type of product through the barcode or QR code, and on the collected external image For products whose barcodes or QR codes are not recognized, the type of product is specified through product image analysis.
The method for the dedicated terminal to determine whether or not the recognized product to be purchased is located in the product transportation means is to determine through product image analysis information received from the management server,
If there is a product that requires adult authentication among the products recognized by the dedicated terminal, payment of the user terminal that has received the payment information is controlled to be performed only when adult authentication is completed on the user terminal. How the system performs payments.
According to claim 1,
Characterized in that the identification information consists of a PIN number, the payment method of the payment system.
According to claim 1,
The biometric information includes any one or more of fingerprint information, iris information, facial image information, vein information, electrocardiogram information, or voice information.
According to claim 1,
The payment execution method of the payment system further comprising the step of receiving, by the dedicated terminal, whether or not the user terminal performs payment, and controlling opening and closing of an access means at a specific location when payment is completed.
According to claim 1,
The payment execution method of the payment system further comprising the step of receiving, by the dedicated terminal, whether or not the user terminal has performed payment, and providing payment completion information to the user through a display unit or an audio output unit of the dedicated terminal.
According to claim 1,
The step of specifying the type and quantity of the product by analyzing the external image of the collected product by the management server,
Characterized in that it is performed by an artificial intelligence engine mounted on the management server,
The artificial intelligence engine is to perform learning through the appearance image of the product, the payment method of the payment system.
According to claim 6,
The machine learning algorithm used by the artificial intelligence engine is composed of one of haar like, convolutional neural network (CNN), YOLO or SSD.
According to claim 1,
The step of recognizing the product to be purchased by the dedicated terminal,
The payment method of the payment system, wherein the dedicated terminal acquires product information through an electronic tag included in the product.
A method for performing payment using a dedicated terminal connected to a camera installed in a means of transporting goods by a payment system,
recognizing at least one product to be purchased by the dedicated terminal and including the product in a preliminary purchase list when it is determined that the recognized product is located within the means of transporting the product;
obtaining, by the dedicated terminal, identification information for performing payment for at least one product located in the means of transporting goods from a user, and acquiring biometric information of the user;
transmitting, by the dedicated terminal, the biometric information and payment information to a user terminal recognized through the identification information; and
The user terminal performs identity authentication through the received biometric information and, when identity authentication is successfully performed, performing payment for products included in the preliminary purchase list through the payment information,
In the process of recognizing the product to be purchased by the dedicated terminal, when the external image of the product is collected by the image capturing unit mounted on the exclusive terminal, the dedicated terminal transmits the collected external image of the product to the management server. To specify the type and quantity of products through analysis on the management server,
In the specification of the type and quantity of products, the product for which the barcode or QR code is recognized on the external image of the product collected by the image capturing unit specifies the type of product through the barcode or QR code, and on the collected external image For products whose barcodes or QR codes are not recognized, the type of product is specified through product image analysis.
The method for the dedicated terminal to determine whether or not the recognized product to be purchased is located in the product transportation means is to determine through product image analysis information received from the management server,
If there is a product that requires adult authentication among the products recognized by the dedicated terminal, payment of the user terminal that has received the payment information is controlled to be performed only when adult authentication is completed on the user terminal. How the system performs payments.
In a payment system using a dedicated terminal installed in a means of transporting goods,
Recognizing at least one product to be purchased, and including the product as a preliminary purchase list when it is determined that the recognized product is located within the means of transporting the product;
Acquiring identification information for performing payment for at least one or more products located in the means of transporting goods from the user, acquiring biometric information of the user,
a dedicated terminal for transmitting the biometric information and payment information to a user terminal recognized through the identification information; and
A user terminal that performs identity authentication through biometric information received from the dedicated terminal and, when identity authentication is successfully performed, performs payment for products included in the preliminary purchase list through the payment information; ,
In the process of recognizing the product to be purchased by the dedicated terminal, when the external image of the product is collected by the image capturing unit mounted on the exclusive terminal, the dedicated terminal transmits the collected external image of the product to the management server. To specify the type and quantity of products through analysis on the management server,
In the specification of the type and quantity of products, the product for which the barcode or QR code is recognized on the external image of the product collected by the image capturing unit specifies the type of product through the barcode or QR code, and on the collected external image For products whose barcodes or QR codes are not recognized, the type of product is specified through product image analysis.
The method for the dedicated terminal to determine whether or not the recognized product to be purchased is located in the product transportation means is to determine through product image analysis information received from the management server,
If there is a product that requires adult authentication among the products recognized by the dedicated terminal, payment of the user terminal that has received the payment information is controlled to be performed only when adult authentication is completed on the user terminal. system.

Images