KR20110122890A - Auto-charge system using goods image search and method thereof - Google Patents

Abstract

PURPOSE: An automatic payment system through the image of product search is provided to perform payment process of a buyer based on registered payment unit information. CONSTITUTION: An entrance processing unit(1) confirms identity information and body information. An exit processing unit(2) transmits an image of the product. The exit processing unit discharges the product by an exit signal. The exit processing unit opens an exit gate(100). A server(40) calculates the payment amount of the purchased product information.

Description

Unattended payment system and its method through product image search {AUTO-CHARGE SYSTEM USING GOODS IMAGE SEARCH AND METHOD THEREOF}

The present invention relates to an unattended payment system and method through product image retrieval, and more particularly, to generate an image of the goods selected by the buyer connected to the server to register as a member and set the payment means information in advance and the generated By retrieving the pre-stored product information based on the image and generating and outputting the purchase information including the purchase product list and the payment amount, the buyer can exit the store without the payment step, and the server is later included in the purchase information. The present invention relates to an unmanned payment system and method through a product image search for performing the payment processing of the payment amount based on the predetermined payment means information of the buyer.

With the development of high-tech technologies such as home shopping and internet shopping malls, distribution channels are diversifying and existing retail retailers are becoming more competitive.

In addition, price competition is intensifying with the increase in handling products and the increase in size of shops. In addition to the reduction of logistics costs, the reduction of fixed costs such as labor costs is also an important competitive factor.

However, if you want to purchase a product at a retail store such as a supermarket, convenience store, or mart, the cashier checks the purchased product at the checkout counter and checks the purchase and checks the product with a point of sale system such as a barcode scanner. Since all the buyers wait in line for a long time in front of the checkout counter, it takes a lot of time to purchase and pay for the goods, and there is a problem that a lot of fixed costs such as labor costs by the clerk in the retail retailer side.

In addition, the terminal operating method of the conventional POS system is relatively difficult, so that it is difficult for the purchaser to acquire and use the operating method.

In addition, the conventional distribution retailer has a problem that the accuracy of the monitoring is reduced because it monitors the theft of goods through the eyes of people such as CCTV or security personnel.

Therefore, the operation of the terminal for payment of the purchased product is simple at the checkout counter of the retail retailer, so that the purchaser can easily acquire the operation method by himself, so that the payment processing can be made automatically without the clerk and the payment processing time of the purchased product is minimized. Change is needed.

The present invention has been proposed to solve the problems of the prior art as described above, the object of the present invention is to automatically process the payment process after outputting the purchase information for the goods selected by the buyer without the cashier at the checkout counter of the retail retail It is to provide an unattended payment system and a method through a product image search to enable.

Another object of the present invention is to create an image of a product selected by a purchaser who registers and registers payment means information in advance by accessing a server, and searches for pre-stored product information based on the generated image. By generating and outputting purchase information including the amount of money, the buyer can exit the store without a payment step, and the server subsequently processes the payment of the payment amount included in the purchase information. As a result, the present invention provides an unmanned payment system and method through a product image search that significantly shortens the product purchase time in a store.

It is another object of the present invention, an unmanned payment system through a product image search that can accurately monitor whether or not theft of the goods by measuring and comparing the weight at the time of entering the store and the weight at the time of leaving the shop for the confirmed identity of the buyer and its To provide a way.

In order to achieve the above object, the unattended payment system through the product image search according to the present invention, the entrance processing unit for confirming the identity information and body information of the buyer entering the store; When the buyer who wants to leave the store arranges the goods in the designated location, the images of the goods are photographed and transmitted to request the purchase goods information search and the payment amount calculation, the goods are reconfirmed and the identity and body information of the buyer is reconfirmed. And an exit processing unit configured to open the exit gate for discharging the goods and leaving the shopper's store by the exit possible signal; And register the registration information and payment means information input from the buyer connected for membership registration in advance, and stores the identity information and body information of the buyer confirmed in the entrance processing unit, and transmitted by the exit processing unit The purchase amount is searched based on the image of the goods, the payment amount is calculated, and the purchaser can decide whether to exit the buyer based on the result of the product reconfirmation by the egress processor and the identification information and the body information of the buyer. And generating a signal and including a server that performs a payment process for the payment amount based on the payment means information of the registered buyer after the buyer leaves the store.

In order to achieve the above object, the unattended payment method through the product image search according to the present invention comprises the steps of: a purchaser accessing a server in advance to register membership information and payment means information; Checking the identity information and the weight of the buyer entering the store entrance; Photographing and transmitting product images when goods to be purchased by the buyer are arranged at a designated location at a store exit; Calculating, by the server, a payment amount by searching for purchase product information based on the transmitted product images; Reconfirming the merchandise and reconfirming the identity and weight of the buyer; Allowing the server to discharge the goods and leave the shopper's store if the product reconfirmation result, the purchaser's identity information, and the weight reconfirmation result are all normal; And performing, by the server, payment processing for the payment amount of the purchaser who has left the store based on the pre-registered payment means information of the purchaser.

According to the present invention, a buyer registers as a member in advance, registers membership information and payment method information, and only the buyer whose identity information is confirmed enters the store, checks the purchase product and calculates the payment amount, It is possible to exit the store, and since the payment processing is performed based on the pre-registered payment means information on the payment amount of the buyer later, it is possible to significantly shorten the waiting time of the buyer at the checkout counter.

The present invention uses the product image photographing the product in order to identify the product, and furthermore, the operation method compared to the conventional bar code scan, because the purchase product information search and payment amount calculation can be made by simply photographing the image of the product. Simple, there is an effect that the buyer can easily use themselves.

The present invention has the effect of preventing the carelessness or cheating of the customer by measuring and comparing the weight of the customer when the identity information is confirmed and the weight of the exit.

According to the present invention, by confirming the purchase goods and calculating the payment amount by photographing the images of the goods selected in the store by the buyer whose identity information is confirmed, the store can be exited without payment processing, and thus the time for the buyer to wait at the checkout counter is shortened. It can be applied to future retailers such as unmanned stores and self-payment. In addition, there is no need for equipment such as POS and barcode scanner, and it is possible to reduce the number of workers such as clerks, thereby reducing costs and securing price competitiveness.

1 is an exemplary diagram of an unmanned payment system configuration through a product image search according to the present invention,
2 is an exemplary diagram of an unmanned store configuration to which an unmanned payment system using a product image search according to the present invention is applied,
3 and 4 are flowcharts illustrating an unmanned payment method through a product image search according to the present invention. FIG. 3 is a flowchart illustrating a method of confirming identity information and body information of a buyer when entering a store, and FIG. Is a flowchart illustrating an unmanned payment method through product image retrieval by photographing products selected by a city buyer.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

1 is an exemplary diagram of an unmanned payment system configuration through the image search according to the present invention.

As shown in Figure 1, the unattended payment system through the image search according to the present invention, the entrance processing unit (1) for confirming the identity information and body information of the buyer entering the store; When the buyer who wants to leave the store arranges the goods in the designated location, the images of the goods are photographed and transmitted to request the purchase goods information search and the payment amount calculation, the goods are reconfirmed and the identity and body information of the buyer is reconfirmed. An exit processing unit (2) which opens the exit gate for discharging the goods and exiting the buyer according to an exit possible signal; And pre-registration registration information and payment means information input from the connected buyer for membership registration, and stores the identity information and body information at the time of entry confirmed by the entrance processing unit (1), the exit processing unit ( 2) calculates the payment amount by searching the purchase product information based on the image of the goods transmitted by 2), and the buyer according to the result of the product reconfirmation by the exit processing unit 2 and the identity information and body information reconfirmation result of the buyer Determine whether the user is sent out, generate the exitable signal, send the payment amount and purchase list to the mobile communication terminal of the buyer through SMS service, and send the registered payment method information of the registered buyer after the buyer exits; It is configured to include a server 40 for performing a payment processing for the payment amount based on.

The entrance processing unit 1 includes an identity confirmation unit 10 for confirming the identity of the buyer who wants to enter the store, an entrance gate 20 for allowing the buyer to enter the store in which the identity information is confirmed, and the entrance gate. It comprises a visitor information input unit 30 for inputting the buyer's image and body information passed through 20. The body information includes the buyer's weight, height, and the like.

The visitor information input unit 30 includes a photographing unit 31 for capturing an image of the buyer passing through the entrance gate 20 and a weight measuring unit 32 for measuring the weight of the buyer.

2 is an exemplary diagram of an unmanned store configuration to which an unmanned payment system through an image search according to the present invention is applied.

As illustrated in FIG. 2, the monitoring camera 50 is disposed at a predetermined location of a store, that is, an unmanned store, and records a situation of the unmanned store and transmits the situation to the server 40.

The exit processing unit 2, when the buyer who wants to exit the store arranges the goods in the designated location, the purchase goods confirmation unit 60 for requesting the purchase goods information search and payment amount calculation by photographing and transmitting the image of the goods, and The re-confirmation by performing the image re-shooting and weighing of the goods is a purchase product re-confirmation unit 80, an identity information re-confirmation unit 70 for re-confirming the identity information and body information of the buyer, and is transmitted from the server 40 It comprises a commodity discharge unit 90 for discharging the goods by the exit possible signal, and an exit gate 100 for allowing the buyer to exit by the exit possible signal transmitted from the server 40. .

The purchase product checking unit 60 is a product that the buyer arranged on the conveyor belt at a predetermined interval is moved along the conveyor belt when the location is located in the designated place to photograph the product images and transmits to the server 40 sequentially A request is made to search for purchased product information and calculate a payment amount for the goods.

The purchase product checking unit 60 may display the purchase list and the payment amount when the purchase list and the payment amount are transmitted from the server 40.

Before visiting a store, a buyer who wants to register as a member may access the server 40 and input member registration information and payment means information to register with the server 40.

The membership registration information registered in the server 40 includes the purchaser's identification number (for example, a social security number, a credit card number, a membership card number, etc.), a mobile phone terminal number, an address, an e-mail address, and the like.

The payment means information registered in the server 40 indicates a type of payment means and a paymentable identification number according to the payment means. For example, when the payment means is a credit card, the payment means information may be a credit card number. The payment means, as well as a credit card, all currently available payment means such as debit card (or check card), bank transfer, designated date direct debit, cash deposit can be used.

In the present invention, a product image is used as an identification means for identifying each product. The server 40 stores a product image of each product in advance, searches for a product image corresponding to the product image photographed and transmitted by the purchase product checking unit 60 of the exit processing unit 2, and corresponds to the retrieved product image. The purchase product information including the name of the product, the price of the product, etc. may be obtained and the payment amount may be calculated, and this may be provided to the purchase product checking unit 60 to enable the buyer to check.

In addition, the server 40 considers a product image that can be photographed with respect to one product in the purchase product checking unit 60 of the egress processing unit 2 and considers a plurality of product images (for example, a plurality of products according to a difference in shooting distance). Product images, multiple product images due to differences in shooting angles, etc.) can be stored. When a plurality of product images are stored for one product, a product image that best matches the product image photographed and transmitted by the purchase product checking unit 60 of the exit processing unit 2 is selected from among the plurality of product images. do. Therefore, the hit rate of the product search can be further increased.

On the other hand, the server 40, if the result of the product reconfirmation by the exit processing unit 2 and the identity and body information reconfirmation results of the buyer is all normal, the exit processing unit (2) to the exit possible signal allowing the purchaser of the buyer Will output Therefore, the present invention can shorten the time the buyer spends at the checkout counter because the buyer can check out the goods without the payment process only by calculating the payment amount for the goods to be confirmed by the purchaser whose identity information is confirmed.

After the buyer leaves the store, the server 40 transmits the payment amount and the purchase list to the mobile communication terminal of the buyer through an SMS service. Therefore, the buyer can easily check the payment amount and purchase list even after leaving the store.

It can also be sent via the buyer's email. The buyer's mobile communication terminal phone number, the buyer's email address, etc. refer to the member registration information registered in advance in the server 40.

In addition, the server 40 performs the payment processing based on the payment means information registered in advance by the buyer with respect to the payment amount of the buyer leaving the store.

Now, the unattended payment method through the image search according to the present invention will be described.

3 and 4 are flowcharts illustrating an unattended payment method through an image search according to the present invention, and FIG. 3 is a flowchart illustrating a method of confirming identity information and body information (eg, weight) of a buyer when entering a store. FIG. 4 is a flowchart illustrating an unmanned payment method through image search of a product by photographing products selected by a buyer when leaving a store.

First, the unattended payment method through the image search according to the present invention includes the steps of a purchaser accessing the server 40 in advance to register the membership registration information and payment means information; Confirming identity information and weight of the buyer entering the store entrance (S10-S20); Photographing and transmitting product images when the goods to be purchased by the buyer are arranged at a designated location of a store exit (S30 and S32); A step (S34, S36, S38) of searching the purchase product information based on the transmitted product images and calculating a payment amount by the server 40; Re-confirming the merchandise and re-confirming the identity information and the weight of the buyer (S40, S46); (S42, S48, S50) permitting the discharge of the product and leaving the shop by the server when the result of the reconfirmation of the goods, the identity information and the weight reconfirmation result of the buyer are all normal (S42, S48, S50); And performing, by the server 40, payment processing for the payment amount of the buyer who has left the store based on the information on the pre-registered payment means of the buyer (S52).

After allowing the buyer to leave the store, the server 40 further transmits the payment amount and the purchase list of the buyer to the buyer's mobile communication terminal through an SMS service (not shown in the drawing). It is made to include.

And generating an alarm if there is an error in any one of the reconfirmation results of the goods, the identity information of the buyer and the reconfirmation result of the weight.

The reconfirmation of the goods, re-photograph the image of the goods request to re-search the purchase goods information, the server 40 re-search the purchase goods information based on the image of the re-photographed goods to recalculate the payment amount and recalculation If the settled payment amount and purchase product information coincide with the calculated settlement amount and purchase product information, it is determined that the reconfirmation result of the goods is normal.

In addition, the identity information and weight reconfirmation of the buyer is to compare the identity information and weight when the buyer enters the store and the identity information and weight at the time of leaving the store. The result is judged normal. The comparison of the weight at the buyer's point of view and the weight at the time of leaving is to easily detect whether the goods are stolen.

Now, a series of processes for purchasing a product using an unattended payment method through image search according to the present invention will be described with reference to the accompanying drawings.

The purchaser accesses the server 40 in advance and registers membership registration information and payment means information. Therefore, the server 40 manages member registration information and payment method information for each buyer registered as a member.

Thereafter, the identity information confirming unit 10 of the entrance processing unit 1 receives the purchaser's identification number from the buyer visiting the store to confirm the identity information (S10). At this time, the identity information verification unit 10 may use a variety of methods, such as membership card (for example, RFID card), fingerprint, member registration ID input to confirm the identity information of the buyer. If the buyer is not a registered member in the server 40, the server 40 and the identity information check unit 10 may induce a member registration (S14). On the other hand, after preparing a non-member card at the entrance of the store can be used when visitors want to use the non-member card. When a non-member card visitor wants to calculate a product at the exit processing unit 2, the store may be discharged after completing the payment processing such as credit card payment.

However, when the buyer is a member registered in the server 40, the entrance gate 20 is opened and the buyer passes through, and the visitor information input unit 30 takes a picture of the buyer passing through the entrance gate 20. The buyer's body information, that is, the weight is measured through the electronic balance. The photograph of the buyer and the weight at the time of entry are transmitted to the server 40 and stored (S12, S16, S18, S20).

When a buyer who selects a plurality of products while moving a store intends to end shopping, the buyer arranges the products at a predetermined interval in the purchase product checking unit 60 of the exit processing unit 2 disposed at the store exit side.

Then, the purchase product checking unit 60 photographs the image of the product when the goods moved along the conveyor belt is located at the designated position and transmits the photographed product image to the server 40 to obtain the product purchase information corresponding to the product image. Request a search (S30, S32).

The server 40 searches for and confirms the purchase product information (for example, a product name, a manufacturer, a weight, a price, etc.) corresponding to the product image based on the received product image, and repeats this process by the number of products to purchase the list. (Purchase product list) generation and payment amount (purchase total amount) are calculated (S34, S36, S38). The calculated payment amount may be transmitted from the server 40 to the purchase product checking unit 60 and displayed to be confirmed by the buyer. At this time, the purchase list may also be transmitted and displayed.

When the payment amount is calculated as described above, the purchase product reconfirmation unit 80 reconfirms the goods to be purchased.

The server 40 re-calculates the purchase amount by re-searching the purchase product information based on the product images transmitted from the purchase product reconfirmation unit 80, and repurchases the purchase product information and the re-calculated payment product information. If it is consistent with the calculated payment amount, it is determined that there is no error (S40, S42). However, if the re-purchased purchase product information and the recalculated payment amount do not match the retrieved purchase product information and the calculated payment amount, the server 40 determines that there is an error and performs the product checking process again, thereby making an error in the purchase product information. And correct the payment amount (S44).

On the other hand, the buyer passes through the identity information reconfirmation unit 70, the identity information reconfirmation unit 70 reconfirms the identity information of the buyer and re-measures the weight. The server 40 compares the weight at the time of the purchaser's entrance with the re-measured weight to check whether the server 40 matches (S46).

If the reconfirmation result of the goods, the identity information and the weight reconfirmation result of the buyer are all normal, the server 40 controls the product discharge unit 90 and the exit gate 100 to discharge the product and the store exit of the buyer. Allowed (S48, S50).

Therefore, the buyer leaves the store by packing the goods discharged through the product discharge unit 90 after passing through the exit gate (100). Therefore, the shopping time is considerably shortened on the buyer side because the payment amount is calculated only by photographing the product image and the user can exit the store without the payment processing step for the payment amount.

After the buyer leaves the store, the server 40 may transmit the payment amount and the purchase list to the mobile terminal of the buyer through an SMS service. Alternatively, the server 40 may transmit the payment amount and the purchase list to the buyer's email.

Thereafter, the server 40 performs payment processing based on the registered payment means information of the registered buyer with respect to the payment amount of the buyer (S52).

Next, a process of purchasing a product using an unattended payment method through a product image search according to the present invention from a buyer's side will be described.

The buyer accesses the server 40 and registers the membership registration information and the payment means information in advance.

The buyer who visits the store enters the store through the identification information through the admission processing unit 1 and the body information (especially the weight) at the time of entry. At this time, a companion or a photograph is taken and input, and the weight of the companion is also measured and stored.

After the shopping is over, the buyer takes out the product to a designated position on the outlet side of the store, that is, the purchase product checking unit 60 of the exit processing unit 2.

Due to the image photographing of the goods through the purchase product checking unit 60, the purchase product information search and payment amount calculation by the server 40 are performed.

When the payment amount is calculated, the buyer relocates the goods in the product reconfirmation unit 80 so that the product can be reconfirmed, and the buyer himself passes through the identity information reconfirmation unit 70 so that the identity information and the weight can be reconfirmed. . At this time, if an error occurs as a result of product reconfirmation or identity information and weight reconfirmation, an alarm is triggered so that the error can be handled.

If the product reconfirmation results, identity information and weight reconfirmation results are all normal, the buyer leaves the store with the goods passing through the product discharge unit 90 after passing through the exit gate (100).

The payment amount and the purchase list are received by the mobile terminal of the buyer leaving the store, and the buyer confirms this.

Thereafter, the server 40 performs payment processing based on the pre-registered payment means information for the payment amount of the buyer.

Those skilled in the art will appreciate that the present invention can be implemented in a modified form without departing from the spirit or the scope of the present invention. The disclosed embodiments are not intended to limit the invention but to illustrate the invention. Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible from this. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

1: entrance processing unit 2: exit processing unit
10: identity verification unit 20: entrance gate
30: visitor information input unit 40: server
50: surveillance camera 60: purchase product identification unit
70: identity information reconfirmation unit 80: purchase goods reconfirmation unit
90: product discharge unit 100: exit gate

Claims (8)

An entrance processing unit for confirming identification information and body information of a buyer entering a store;
When the buyer who wants to leave the store arranges the goods in the designated location, the images of the goods are photographed and transmitted to request the purchase product information search and the payment amount calculation, the reconfirmation of the goods and the identification and body information of the buyer And an exit processing unit configured to open the exit gate for discharging the goods and leaving the shopper's store by the exit possible signal; And
Register registration information and payment means information input from the connected buyer for membership registration in advance, stores the identity information and physical information of the buyer confirmed in the entrance processing unit, and the product transmitted by the exit processing unit The purchase price information is searched based on the image of the user, and the payment amount is calculated. And a server that performs a payment processing for the payment amount based on the registered buyer's payment means information after the buyer leaves the store. system. The method according to claim 1, wherein the server,
After the buyer leaves the unattended payment system through the product image search, characterized in that for transmitting the payment amount and purchase list to the mobile communication terminal of the buyer through the SMS service. The method according to claim 1, wherein the server,
In order to identify each product, the product image of each product is stored in advance, the product image corresponding to the product image photographed and transmitted by the purchase product identification unit of the exit processing unit is searched, and the purchased product information corresponding to the retrieved product image is retrieved. Unattended payment system through the product image search, characterized in that obtaining and calculating the payment amount. The method according to claim 1, wherein the entrance processing unit,
Identity information confirmation unit for confirming the identity information of the buyer who wants to enter the store,
An entrance gate that allows the buyer to enter the store whose identity information is confirmed, and
Unattended payment system through the product image search comprising a visitor information input unit for inputting the image and body information of the buyer passing through the entrance gate. The method according to claim 1, The exit processing unit,
When the buyer who wants to leave the store arranges the goods in the designated location, the purchase goods confirmation unit requests to search for the purchase goods information and calculate the payment amount by photographing and transmitting the images of the goods;
Reconfirmation by re-photographing the image of the goods and measuring the weight is purchased product reconfirmation unit;
An identity information reconfirmation unit for reconfirming the identity information and the body information of the buyer;
A commodity discharge unit for discharging the commodities according to an exit possible signal transmitted from the server;
Unattended payment system through the product image search, characterized in that it comprises an exit gate for opening the permit of the buyer by the exit possible signal transmitted from the server. A purchaser accessing a server in advance to register membership registration information and payment means information;
Checking the identity information and the weight of the buyer entering the store entrance;
Photographing and transmitting product images when goods to be purchased by the buyer are arranged at a designated location at a store exit;
Calculating, by the server, a payment amount by searching for purchase product information based on the transmitted product images;
Reconfirming the merchandise and reconfirming the identity and weight of the buyer;
Allowing the server to discharge the goods and leave the shopper's store if the product reconfirmation result, the purchaser's identity information, and the weight reconfirmation result are all normal; And
And performing, by the server, payment processing for the payment amount of the purchaser who has left the store based on the purchase means information registered in advance by the purchaser. The method of claim 6,
After the step of allowing the buyer to leave the store, the server further comprises the step of transmitting the payment amount and purchase list of the buyer to the mobile communication terminal of the buyer via the SMS service, characterized in that the product image search Unattended payment method through. The method of claim 6,
If there is an error in any one of the re-confirmation results of the goods and the identity information and weight re-confirmation results of the buyer, further comprising the step of generating an alarm.

Images