KR101428465B1 - Settlement system and method for shopping - Google Patents

Abstract

The present invention relates to a shopping payment system and a method thereof which automatically recognize products which are purchased in a major supermarket or a shopping center in a conveyer, and calculates and pays an accumulated amount of money thereby. More specifically, the shopping payment system includes: a transfer conveyer which transfers products by stages; a product information recognizing device which photographs the products transferred by the transfer conveyer and recognizes product information from the photographed image; and a payment terminal which transmits and receives data by communicating with the product information recognizing device, calculates an accommodated amount of money by product information which is received from the product information recognizing device, and pays the calculated amount of money.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a payment system,

The present invention relates to a shopping payment system and a method for automatically purchasing a product to be purchased at a shopping mall, a shopping mall, or the like, and calculating and accumulating an accumulated amount of the product.

As the general consumer goods industry becomes larger, marts are also becoming larger.

Customers who use these large-sized marts are able to purchase products with comparative price advantage because they can select a variety of products in comparison with those using a general retail store, and their use is increasing. The number will increase.

However, a large-sized shopping mall, which is used by a plurality of customers at the same time, generally uses a shopping cart to store a selected product and use a checkout counter to calculate selected products. In each checkout, It is troublesome for the consumer to put each of the purchased products into the shopping cart again after picking up the goods and recognize the barcode by putting them into the counter.

In addition, there is a time-consuming problem in that the barcode recognition process is performed for each product in the calculation process in the case of the time zone in which the consumer frequently uses the product.

Korean Patent Publication No. 2013-0027099

It is an object of the present invention to provide a shopping payment system and a method thereof that can shorten the time required for shopping and payment, provide convenience to consumers, and reduce labor costs at a business site.

According to an aspect of the present invention, there is provided a shopping payment system including: a conveying conveyor for sequentially conveying goods; A product information recognizing device for photographing a product conveyed through the conveying conveyor and recognizing the product information from the photographed image; And a payment terminal communicating with the goods information recognizing device to transmit and receive data, to calculate an accumulated amount based on the goods information received from the goods information recognizing device, and to settle the calculated amount.

Here, the product information recognizing device may include at least one photographing equipment for photographing the product in various directions; A barcode extracting unit for extracting a barcode image by analyzing a multifaceted image of a product photographed through the photographing equipment; A barcode recognition unit for recognizing the barcode image extracted by the barcode extraction unit and receiving product information including a product name and price information; And a communication interface for transmitting / receiving data to / from the payment terminal through wire or wireless communication.

The apparatus may further include a correction request unit for requesting correction of the position of the product when the barcode extraction unit fails to extract the barcode image.

In addition, the barcode extracting unit may identify a surface of the product image on which the barcode is printed, cut out a portion estimated to be a barcode image from the print surface, perform angle correction and rotation correction, and output the barcode image as a final barcode image And an image correction unit.

The payment terminal may include a sign pad for recognizing the card information upon request of the credit card payment of the consumer, outputting the approval result, and inputting the signature.

According to an embodiment of the present invention, the sign pad includes a recognition unit that recognizes an input signature and converts the signature into recognition information, and the recognition unit includes an image recognition unit that recognizes an image of the signature, an acceleration recognition unit that recognizes the signature acceleration, A pressure-pressure recognizing section for recognizing the signature pressure, and a signature time recognizing section for recognizing the signature time.

On the other hand, the shopping settlement method of the present invention comprises the steps of: a) photographing a product, which is sequentially transported by a conveying conveyor, by a product information recognition device; b) recognizing and storing product information from an image of the product photographed by the product information recognizing device; c) calculating a cumulative amount of money based on the data received by the payment terminal and the received merchandise information transmitted from the merchandise information recognizing device; d) displaying the goods information and the calculated amount in the payment terminal; And e) settlement of the calculated amount through the payment terminal according to the selection of the payment means of the consumer.

Here, the step b) may include photographing a product transferred from the photographing equipment of the product information recognizing device in various directions; Extracting a barcode image by analyzing and correcting a multifaceted image of a product photographed through the photographing equipment; Recognizing the barcode image extracted by the product information recognizing device and inputting and storing product information including a product name and price information of the product; And transmitting the goods information to the payment terminal.

The method may further include requesting correction of the position of the product when the recognition error occurs due to the failure to extract the barcode image in step b).

Therefore, the shopping payment system and the method of the present invention automatically recognize the product information and display the cumulative amount by simply loading the products selected by the consumer in self-shopping and payment through the goods information recognition device on the conveying conveyor And the time required for shopping can be shortened.

In addition, it provides convenience to consumers, and it is advantageous in terms of labor costs because the cashier does not need to act as a cashier for payment of goods.

1 is a schematic view showing a shopping settlement system of the present invention;
2 is a block diagram showing a goods information recognizing apparatus according to an embodiment of the present invention;
3 is a block diagram illustrating a configuration of a card settlement method according to an embodiment of the present invention.
4 is a block diagram illustrating a recognition unit of a payment terminal according to an embodiment of the present invention.
5 is a flowchart showing a shopping settlement method of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a shopping settlement system and a method thereof according to the present invention will be described in detail with reference to the accompanying drawings.

Fig. 1 is a schematic view showing a shopping settlement system according to the present invention, and Fig. 2 is a block diagram showing a goods information recognizing apparatus as a constitution of the present invention. FIG. 3 is a block diagram illustrating a configuration of a card settlement method according to an embodiment of the present invention, and FIG. 4 is a block diagram illustrating a recognition unit of a payment terminal according to an embodiment of the present invention.

1, the present invention comprises a transfer conveyor 100 equipped with a product information recognition apparatus 200 and a settlement terminal 300, so that the amount of goods to be loaded and transferred to the transfer conveyor 100 The product information including the product information is automatically stored and displayed by the product information recognizing device 200 and the cumulative amount of goods to be purchased is settled by using the payment terminal 300, And to enable efficient shopping.

First, the conveying conveyor 100 sequentially transfers the goods for loading and transferring the products selected by the customer. That is, the conveying conveyor 100 is interlocked with the product information recognizing apparatus 200. When the product information recognizing apparatus 200 stops the conveyance during the process of recognizing the commodity information of one commodity and the recognition process is completed Sequential transfer is performed so that the next product can perform the recognition process.

For this, the conveying conveyor 100 is not shown in the figure, but may include a detection sensor 110 and a control unit.

The sensing sensor 110 senses the loaded goods.

The control unit interlocks with the product information recognizing apparatus 200 to recognize that the product information recognizing apparatus 200 is in the process of recognizing and recognizing the completion of the recognition, and selectively controls driving of the conveying conveyor 100.

Specifically, the sensing sensor 110 is mounted on the conveying conveyor 100, and when it senses a product conveyed at a mounting position, it transmits a sensing signal, and the control unit controls the conveying conveyor 100 in response to a sensing signal of the sensing sensor 110. [ (100) is temporarily stopped.

If the recognition result signal is transmitted to the control unit after the product information recognition apparatus 200 completes the recognition process, the control unit controls the conveyance of the product, which is detected by the detection sensor 110, (100), and so on.

According to the embodiment of the present invention, the product information recognition device 200 collects product information including the amount of a product by photographing and recognizing a bar-code printed on the package of the product, (100), and recognizes the product information from the photographed image. Here, the 'product information' means not only the price of a product but also a product name, a manufacturer, and sales information for each product (for example, a prizewinning prizewinning a free one).

1, the product information recognizing apparatus 200 may be mounted on the conveying conveyor 100 and may be interlocked with the control unit of the conveying conveyor 100 as described above .

2, the product information recognizing apparatus 200 may include a photographing apparatus 210, a barcode extracting unit 220, a barcode recognizing unit 230, and a communication interface 240.

First, the photographing equipment 210 is mounted on the conveying conveyor 100 to photograph the appearance of the commodity. Preferably, at least one photographing apparatus 210 is provided to photograph commodities from various directions.

The barcode extracting unit 220 extracts a barcode image by analyzing the multifaceted image of the product photographed through the photographing equipment 210.

The barcode extracting unit 220 may include an image correcting unit 221 for correcting the photographed image and outputting only a barcode image in order to extract a barcode image.

 The image correcting unit 221 recognizes the surface of the image of the product photographed from the at least one photographing equipment 210 on which the bar code is printed and cuts out only a portion estimated as a bar code image from the print surface, And outputs a final barcode image of a proper shape that can be recognized by the barcode recognition unit 230 by performing correction.

This takes into account the directionality of a typical bar code and recognition failure due to image distortion, minimizing recognition errors and shortening the time required for errors.

The barcode recognition unit 230 is a conventional bar-code reader, and recognizes the image-type barcode extracted by the barcode extraction unit 220. [ The barcode recognition unit 230 recognizes the barcode and can collect product information such as the price of the product, the name of the product, the manufacturer, and the sales information, as described above, Input and save.

The communication interface 240 is a means for mutually transmitting and receiving data by providing wired or wireless communication with the payment terminal 300 to perform settlement for an accumulated amount of goods and is stored in the barcode recognition unit 230 Transmits the data of the product information to the payment terminal 300 or transmits the accumulated amount of the goods calculated by the payment terminal 300 to the product information recognition apparatus 200. [

The product information recognizing apparatus 200 according to the present embodiment further includes a correction requesting unit 250. The correction requesting unit 250 receives the barcode image from the barcode extracting unit 220, If so, ask to correct the position of the item.

For example, if it is difficult to confirm whether the barcode print surface of the merchandise is located in the lower portion of the photographing equipment that can not be photographed or overlapped with other merchandise, the correction request unit 250 determines that the barcode image can not be extracted, Have the consumer mark the location to be calibrated or output a warning sound. For this, the product information recognition apparatus 200 may include a display 260 and a speaker 270.

The display 260 of the product information recognition apparatus 200 displays not only the notification for correcting the position of the product but also the product information recognized by the barcode recognition unit 230 so that the consumer can display the shopping status To be recognized.

In addition, the display 260 displays the accumulated amount through the data transmitted from the payment terminal 300, thereby confirming the total cost of the products selected by the consumer.

The settlement terminal 300 communicates with the goods information recognition apparatus 200 by wire or wireless to transmit and receive data, calculates an accumulated amount based on the goods information received from the goods information recognition apparatus 200, .

Here, the term " cumulative amount " means the sum of the amounts of goods that are accumulated as the goods selected by the consumer are recognized by the product information recognition apparatus 200.

The settlement terminal 300 may be variously implemented through a payment method according to a known technology such as cash settlement, card settlement, or cash and card concurrent settlement.

In the present invention, the case where the payment terminal 300 is a credit card settlement will be described as an example.

The settlement terminal 300 includes all terminals for a settlement system other than a credit card settlement terminal and a POS terminal as well as a card settlement system. For example, the settlement terminal 300 may include a settlement terminal of an NFC (near field communication) A mobile voucher payment terminal, an IC card payment terminal, and a complex payment terminal capable of integrally recognizing them.

The payment terminal 300 recognizes the card to be paid and outputs an approval result according to the card settlement.

The payment terminal 300 loads the MS card reader unit. When the MS card in which the credit card number, the debit card number, and the like are recorded closely moves and a predetermined electrical signal is loaded on the magnetic head, And acquires predetermined information from at least one track (Track) provided in the recording medium.

In this embodiment, the settlement terminal 300 may include a sign pad 310 for recognizing the card information and outputting the approval result when requesting a credit card payment by a consumer, and for inputting a signature.

The sign pad 310 may be integrated with the settlement terminal 300 or may be connected to the settlement terminal 300 through an interface (not shown) in the form of a module, Receives the identification information from the sign pad 310, generates a payment request message including the identification information, and transmits the payment request message to the VAN server 400 of the VAN company using the communication network.

And also receives and outputs information on the approval result telegram from the subscriber server 400 (card issuer server 500).

That is, the payment terminal 300 outputs payment processing result information or the like, which is generated as a result of performing the card payment processing, to the printing apparatus. The payment terminal 300 prints the print information in accordance with a pre- And a printing protocol and a driver for printing through the printing apparatus.

The payment terminal 300 includes a sign pad 310 for inputting signature information as described above. The sign pad 150 includes a recognition unit for recognizing the inputted signature and switching the recognition information 320).

The recognition unit 320 recognizes the signature input from the sign pad 310 and converts the signature into recognition information. The recognition information is transmitted to the payment terminal 300, Generates a payment request message including the recognition information and transmits the payment request message to the bank server 400 in the transaction so that the identification information included in the payment request message in the card issuer server 500 And comparing and analyzing them with previously stored comparison identification information to prevent the authenticity of the consumer, that is, the card theft.

4, the recognition unit 320 includes an image recognition unit 321 for recognizing the signature image, an acceleration recognition unit 322 for recognizing the signature acceleration, A signature section 323, and a signature time recognition section 324 for recognizing the signature time.

The reason why the recognition unit 320 is composed of the image recognition unit 321, the acceleration recognition unit 322, the pattern pressure recognition unit 323 and the signature time recognition unit 324 is that the signature image However, since the signature image can be easily stolen once exposed, there has been a problem in that it is not effective.

In the present invention, not only a signature image but also a signature acceleration, a pressure in a signature, and a time required for a signature can be introduced as functions for authentication, respectively.

For this, an image sensor, an acceleration sensor, a pressure sensing sensor, and a time sensing sensor are installed in the sine pad 310, though not shown in the drawing, so that the plurality of sensors are transmitted to the payment terminal . The data transmitted in this way becomes the recognition information.

The sign pad 310 further comprises an encryption unit 330, and the encryption unit 330 encrypts the recognition information generated by the recognition unit 320.

This is because the security requirements including Confidentiality, Authentication, Integrity, and the like required in the course of performing credit card settlement by the user are transmitted to the sign pad 310 without using a separate authentication server on the network, The encryption unit 330 encrypts or decrypts the recognition information and prevents the identification information itself from being stolen by adding an authenticator to prevent information from being falsified.

The subscriber server 400 is connected to the payment terminal 300 through a communication network when the payment terminal 300 requests a card payment, And mediates card settlement between the terminal 300 and the card issuer server 500.

The credit card company server 500 receives the payment request telegram from the bank server 400 and analyzes the stored comparison identification information and the payment request telegram to transmit the approval result telegram.

Specifically, in one configuration of the present invention, the card issuer server 500 receives the payment request message including the identification information from the subscriber server 400 and authenticates matters (such as whether the card limit is exceeded) about general authentication In particular, compares and analyzes the recognition information included in the payment request specialization with the previously stored comparison recognition information, generates the approval result telegram, and transmits the approval result telegram to the server 400.

The comparison recognition information is data that is generated and stored at the time of card issuance by the user, and the comparison recognition information is information about the signature image, the signature acceleration, the signature pressure, and the signature time.

5 is a flowchart showing the shopping settlement method of the present invention.

5, when the customer sequentially loads the products selected in the shopping process onto the conveying conveyor 100, the customer sequentially transfers the products to the conveying conveyor 100, The product information recognizing device 200 photographs each product. (S100)

The product information recognition apparatus 200 recognizes and stores product information from an image of a photographed product, and more specifically, it photographs a product transferred from one or more photographed equipment 210 in various directions, And extracts the barcode image by analyzing and correcting the multifaceted image of the product (S200).

If a recognition error occurs due to the failure to extract the barcode image, the correction request unit 250 of the product information recognition apparatus 200 requests the consumer to correct the position of the product. A character of the display 260, a voice of the speaker 270, etc. (S251)

Then, the product information recognizing device 200 recognizes the barcode image and inputs and stores the product information including the product name and the price information of the product (S300). The product information data thus stored is transmitted to the communication interface 240 to the payment terminal 300 (S400)

The settlement terminal 300 receives the merchandise information transmitted from the merchandise information recognition apparatus 200 and the settlement terminal 300 calculates the accumulated amount through the received data.

Then, the payment terminal 300 displays the goods information and the calculated amount, and the payment amount is paid through the payment terminal 300 according to the payment method of the consumer, that is, cash settlement or card settlement. (S600 )

Here, the cash settlement method or the card settlement method can be variously performed through known technologies and the like, and a detailed description thereof will be omitted.

As described above, according to the present invention, the merchandise information recognizing device 200 automatically recognizes the merchandise information and loads the accumulated merchandise selected by the customer in the conveying conveyor 100, As a result, the time required for shopping can be shortened, and convenience for the consumer can be provided. In the case of a business site, labor costs can be reduced because the cashier does not need to play the role of the cashier.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. Therefore, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.

100: conveying conveyor 110: detection sensor
200: goods information recognizing device 210: photographing equipment
220: Barcode extracting unit 221: Image correction unit
230: Barcode recognition unit 240: Communication interface
250: correction request unit 300: payment terminal
310: Sine Pad 400:
500: card company server

Claims (9)

A conveyance conveyor including a sensing sensor for sensing a loaded merchandise and a control unit for driving the merchandise according to a recognition process of the merchandise so as to be driven by a sensing signal of the sensing sensor.
A product information recognizing device mounted on the conveying conveyor for photographing a product conveyed through the conveying conveyor and recognizing the product information from the photographed image;
Communicates with the merchandise information recognizing device to transmit and receive data, calculates the accumulated amount based on the merchandise information received from the merchandise information recognizing device, makes the settlement of the calculated amount, recognizes the card information upon request of the credit card payment by the consumer, And a payment terminal including a sign pad for inputting a signature,
The product information recognizing device includes:
At least one photographing equipment for photographing the product in various directions;
A bar code image is extracted by analyzing a multifaceted image of a product photographed through the photographing equipment, a bar code image is extracted from the image of the product, an area estimated as a bar code image is cut out from the print surface, And an image correction unit for performing rotation correction and outputting the resultant image as a final barcode image;
A barcode recognition unit for recognizing the barcode image extracted by the barcode extraction unit and receiving product information including a product name and price information;
A communication interface for transmitting / receiving data to / from the payment terminal through wire or wireless communication;
A correction request unit for requesting correction of the position of the product when the barcode extraction unit fails to extract the barcode image;
A display for displaying the correction request of the correction request unit or displaying the recognized product information and the accumulated amount of the goods; And
And a speaker for outputting a correction request of the correction request unit as a warning sound,
The sine pad may include:
An image recognition apparatus comprising an image sensor, an acceleration sensor, a pressure sensor, and a time sensor, the image recognition unit recognizing an image of a signature by each sensor, an acceleration recognition unit recognizing signature acceleration, A sign recognition unit for recognizing a time and recognizing an input signature and converting the received signature into recognition information; and an encryption unit for encrypting and transmitting the recognition information generated by the recognition unit. delete delete delete delete delete delete delete delete

Images