JP2020119033A - Self-service register system - Google Patents

Abstract

To provide a self-service register system that allows a customer to make check-out for a purchased article without being forced to perform complicated operation like finding a barcode attached to the article.SOLUTION: An article specifying camera 180 images an article when the article is moved from a shopping basket Cs to a check-out basket Bc, and outputs the image as article image data. The article image data is utilized to make check-out for the article as a purchased article. A control device 110 performs check-out processing on the purchased article on determining, based upon shopping basket image data output from the shopping basket camera 170, that the shopping basket Cs is emptied and there is no next shopping basket Cs.SELECTED DRAWING: Figure 2

Description

The present invention relates to a self-checkout system.

In recent years, in supermarkets and mass retailers, customers scan the barcode attached to their purchased products for the purpose of reducing stress due to customers waiting for cashiers and eliminating labor shortages of employees who operate cashiers. The introduction of a self-checkout system that performs settlement is underway (see Patent Document 1).

JP, 2014-52721, A

However, forcing a customer to perform a complicated work (a so-called bar code scanning process) such as reading a bar code attached to each product using a scanner is rather inefficient.

Further, when the barcode is attached to a place that is difficult to find, there is a problem that it takes more time and effort to find the barcode.

The present invention has been made in view of the above-described circumstances, and is a self-checkout system capable of quickly adjusting a purchased product without forcing a customer to perform a complicated work such as searching for a barcode attached to the product. One of the purposes is to provide.

A self-checkout system according to an embodiment of the present invention includes a product master database that stores product information including a product master image for specifying a product for each product handled in a store, and a first imaging device that captures an accommodation state of a shopping cart. Then, when the customer takes out the product in the shopping basket and transfers it to the settlement basket, the second image pickup device that images the product and the image of the taken product and the product master image are compared, Whether to continue to specify the purchased product based on the specification unit that specifies the purchased product, the output unit that outputs the product information corresponding to the specified purchase product, and the shopping cart image that shows the accommodation status of the shopping cart that was captured , Or an inquiring section for inquiring a customer as to whether or not to start the settlement of a purchased product, and a settlement section for executing a settlement process when the start of the settlement is instructed in response to the inquiry.

ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to settle a purchased product promptly, without forcing a customer to perform a complicated work such as searching for a barcode attached to the product.

It is a figure showing the schematic structure of the self-checkout system concerning this embodiment. It is a figure which shows the hardware constitutions of the self-checkout terminal provided in each lane. It is explanatory drawing of a camera for member authentication. It is explanatory drawing of a shopping basket camera. It is explanatory drawing of a camera for product specification. It is the figure which illustrated the registration contents of the product master database. It is the figure which illustrated the registration contents of the member customer database. It is a sequence diagram which shows a member authentication process. It is the figure which illustrated the message for member customers and the message for general customers. It is a sequence diagram which shows a goods scan process. It is the figure which illustrated the product information of the purchased product. It is a flow chart which shows payment processing. It is the figure which illustrated the message for member customers and the message for general customers.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The same elements will be denoted by the same reference symbols, without redundant description.

A. In the present embodiment, it is assumed that the self-checkout system is installed in a large-scale mass retailer, a supermarket, or the like, but the present invention is also applicable to any store that sells products (convenience stores, specialty stores, etc.).

(1) Configuration FIG. 1 is a diagram showing a schematic configuration of a self-checkout system 1000 installed in a store S according to this embodiment.
As shown in FIG. 1, the self-checkout system 1000 includes self-checkout terminals 100 provided in a plurality of self-checkout lanes Ls-1 to Ls-n, a settlement machine 200, and a management server 300. The self-checkout terminal 100, the settlement machine 200, and the management server 300 are connected via a communication network N so that they can communicate with each other. The communication network N is, for example, the Internet, a LAN, a dedicated line, a telephone line, a corporate network, a mobile communication network, Bluetooth (registered trademark), WiFi (Wireless Fidelity), another communication line, or a combination thereof. It does not matter whether it is wired or wireless. The numbers of the self-checkout terminal 100, the settlement machine 200, and the management server 300 can be arbitrarily set and changed according to the design of the self-checkout system 1000 and the like.

FIG. 2 is a diagram showing a hardware configuration of the self-checkout terminal 100 provided in each lane Ls.
The self-checkout terminal 100 includes a control device 110, a storage unit 120, an input unit 130, an output unit 140, a communication unit 150, a member authentication camera 160, a shopping cart camera 170, and a product identification camera 180. Prepare

The control device 110 includes a CPU, a ROM, a RAM, and the like, and the CPU executes various control programs stored in the ROM or the like to centrally control each unit of the self-checkout terminal 100.
The storage unit 120 is configured by a hard disk or the like and stores various data.
The input unit 130 includes various operation buttons, a touch panel, a card reader, and the like.
The output unit 140 includes a display panel or the like that displays information regarding products and information regarding settlement.
The communication unit 150 includes various communication interfaces and exchanges various data with the settlement machine 200 and the management server 300.

The member authentication camera (third imaging device) 160 is provided, for example, on the ceiling near the entrance of the settlement area Af in the store S, as shown in FIG. The member authentication camera 160 images the face of the customer who purchases the product in the store and outputs it as the face image data of the customer. The customer face image data output from the member authentication camera 160 is used to authenticate whether the customer is a customer who has already registered as a member (so-called member authentication). The member authentication camera 160 may be provided on the ceiling near the entrance of the store S. For convenience of explanation, customers who have already registered as members are referred to as “member customers”, customers who have not yet registered as members are referred to as “general customers”, and if it is not necessary to distinguish them, they are simply referred to as “customers”.

The shopping cart camera (first imaging device) 170 is provided on the ceiling of each corresponding lane Ls, as shown in FIG. 4, for example. The shopping cart camera 170 stores the shopping cart Cs placed at a predetermined position on the pedestal St by each customer at the time of settlement (specifically, whether the shopping cart Cs is empty, or the shopping cart Cs contains an item). Is captured and output as shopping basket image data (details will be described later).

For example, as shown in FIG. 5, the product specifying camera (second image pickup device) 180 includes a shopping bag, an eco bag brought by a customer, a shopping bag, and the like (hereinafter, these are collectively referred to as a “payment basket”) Bc. Is installed in the vicinity of the basket attachment part Bs to which is attached. The product specification camera 180 images the product when the customer moves the product from the shopping cart Cs to the settlement basket Bc and outputs it as product image data. The product image data is used when the product is settled as a purchased product (details will be described later). Although FIG. 5 exemplifies a case where four product specifying cameras 180 are provided along the edge of the basket attachment portion Bs, the installation location and the number of the product specifying cameras 180 are appropriately set. -Can be changed.

The settlement machine 200 is an apparatus that reads a barcode written on a receipt and performs settlement processing. The settlement machine 200 supports various payment methods, for example, cash payment, point card payment, credit card/debit card payment, and electronic money payment using a mobile terminal. ing. The customer completes the settlement process by holding the settlement receipt over the settlement machine 200 and paying the designated fee (settlement) using cash, a card, electronic money, or the like.

The management server 300 is configured by, for example, a server computer, and plays a role of centrally controlling the operation of each device and each terminal included in the self-checkout terminal 100. Although details will be described later, the management server 300 is connected to, for example, a host computer inside or outside the store and has a function of managing product information of products sold in the store S, and member information of member customers who use the self-checkout system 1000. It has a management function.

FIG. 6 is a diagram exemplifying the registration contents of the product master database DB1 included in the management server 300, and FIG. 7 is a diagram exemplifying the registration contents of the member customer database DB2.

As shown in FIG. 6, in the product master database DB1, product information including a product master image for specifying a product, a product name, a price, a weight, raw materials, and a production area is registered for each product handled in the store S. .. The product master image is used to identify the product purchased by the customer. The product master image is preferably a 3D image viewed from a 360° direction, but it may be a 2D image or the like.

As shown in FIG. 7, in the member customer database DB2, a face image for authentication, a member ID, a password, a name, a sex, an age, an address, a telephone number, a cash card number, and a payment method (cashless) are stored for each member customer. In addition to basic information including payment, etc., purchase history information indicating purchase history at the store (including affiliated stores) and point information indicating the number of member points available at the store are stored. Note that the purchase history information includes information indicating the date and time of the product purchased by the member in the past fixed period (for example, 5 years), the product name, the quantity, the place of purchase, and the like. In addition to the member customer database DB2, a database storing preference information indicating the preference of each member customer may be held. In this case, the preference information includes information indicating a field (for example, sports, investment, interior, etc.) in which the member customer is interested. Of course, the preference information may be included in the member customer database DB2.

(2) Operation Next, the operation of the self-checkout system 1000 according to the present embodiment will be described.

<Member authentication process>
FIG. 8 is a sequence diagram showing the member authentication process. In the following description, it is assumed that the customer approaches the settlement area Af in order to perform the settlement using the self-checkout terminal 100 after putting a plurality of products in the shopping cart Cs.

When the member authentication camera 160 provided on the ceiling near the entrance of the checkout area Af detects a customer entering the checkout area Af, the member authentication camera 160 images the face of the customer and outputs it as face image data of the customer (step S1). ). When the control device 110 receives the face image data of the customer, the control device 110 transmits the face image data of the customer to the management server 300 and inquires whether the customer is a member customer (step S2). Upon receiving the face image data of the customer from the self-checkout terminal 100, the management server (authentication unit) 300 refers to the member customer database DB2 to perform member authentication as to whether the customer is a member customer or a general customer. Perform (step S3). Specifically, the management server 300 compares and collates the face image of the customer specified by the face image data of the customer with the face image for authentication of the member customer registered in the member customer database DB2. , Perform member authentication. Then, the management server 300 notifies the self-checkout terminal 100 of the result of the member authentication (step S4). When the management server 300 determines that the customer is a member customer as a result of the member authentication, the management server 300 reads the basic information of the customer from the member customer database DB2 and sends the basic information to the self-checkout terminal 100.

Upon receiving the member authentication notification from the management server 300 (step S5), the control device 110 of the self-checkout terminal 100 outputs a message for member customers or a message for general customers to the output unit 140 based on the notification result. It is displayed on the display panel (step S6).

FIG. 9 is a diagram exemplifying a message M1 for member customers and a message M2 for general customers displayed on the display panel.

In the message M1 for member customers, the member ID and member name of the customer are displayed. If a member customer has a product-related privilege (such as a product discount), the customer may be notified of the privilege.
On the other hand, the message M2 for general customers includes a message or the like that explains how to use the self-checkout terminal 100 in an easy-to-understand manner using moving images or images.

In this way, the display message on the display panel is distributed according to the result of the member authentication, so that the customer can smoothly proceed with the settlement process.

<Product scanning process>
FIG. 10 is a sequence diagram showing the product scanning process.
The customer places the shopping basket Cs containing the product in a predetermined position on the pedestal St. When the shopping cart camera 170 provided on the ceiling of the corresponding lane Ls detects that the shopping cart Cs is placed at a predetermined position on the pedestal St, the shopping cart Cs is stored (that is, the shopping cart Cs is empty). Imaging of the shopping basket Cs is started in order to know whether or not there is a product in the shopping basket Cs (step SA1). Specifically, the shopping cart camera 170 detects whether or not the shopping cart Cs is placed at a predetermined position on the pedestal St using an infrared sensor or the like mounted therein. When detecting that the shopping cart Cs is placed, the shopping cart camera 170 starts capturing an image of the shopping cart Cs. The shopping basket camera 170 outputs the captured image to the control device 110 as shopping basket image data. The control device 110 grasps the accommodation state of the shopping cart Cs based on the shopping cart image data sequentially output from the shopping cart camera 170 (step SA2).

On the other hand, when the customer places the shopping basket Cs at a predetermined position on the pedestal St, the customer sequentially takes out the products from the shopping basket Cs and moves them to the settlement basket Bc in order to start the settlement. The product specification camera 180 installed near the basket attachment portion Bs sequentially images the products transferred from the shopping basket Cs to the settlement basket Bc, and when specified (scanned), outputs the product image data to the control device 110 ( Step SA3).

When the control device 110 receives the product image data, the control device 110 transmits the product image data to the management server 300 and inquires about product information related to the product (step SA4). When the management server (specification unit) 300 receives the product image data from the self-checkout terminal 100, the management server (specification unit) 300 refers to the product master database DB1, identifies the product shown in the product image data, and acquires the product information related to the product ( Step SA5). The method for identifying a product will be described by way of an example. The management server 300 performs matching processing between the received product image data and each product master image registered in the product master database DB1 to determine the similarity between images. To detect. The management server 300 identifies the product of the product master image with the highest degree of similarity as the product shown in the product image data. Then, the management server 300 acquires product information related to the product from the product master database DB1. In the present embodiment, the matching process such as feature point matching is exemplified as the method for identifying the product, but other methods (for example, histogram comparison) may be used.

When the management server 300 acquires the product information of the product (that is, the purchased product) shown in the product image data, the management server 300 returns the acquired product information to the self-checkout terminal 100 (step SA6). Upon receiving the product information of the purchased product from the management server 300, the control device 110 of the self-checkout terminal 100 displays the product information on the display panel of the output unit 140 (step SA7).

FIG. 11 is a diagram exemplifying the product information of each purchased product displayed on the display panel.
In FIG. 11, the total price is displayed on the display panel together with the product name, quantity, and price of each purchased product. However, what information is displayed on the display panel can be arbitrarily set and changed, and for example, the product master image of each purchased product may be displayed on the display panel.

When the control device 110 displays the product information on the display panel, the control device 110 determines whether or not the shopping basket Cs is empty based on the shopping basket image data output from the shopping basket camera 170 (step SA8). When the control device 110 determines that the shopping basket Cs is not empty (that is, the shopping basket Cs contains products) (step SA8; NO), the process returns to step SA4 and repeats the above-described processing.

On the other hand, when the control device (inquiry unit) 110 determines that the shopping cart Cs has become empty (step SA8; YES), the next shopping cart Cs exists (that is, whether the purchased product to be specified still exists). ) A query message as to whether or not it is displayed on the display panel of the output unit 140 (step SA9).

Upon confirming the inquiry message displayed on the display panel, the customer appropriately operates the touch panel of the input unit 130 to input whether the next shopping cart Cs exists or whether the scan of the purchased product has been completed.
When the control device 110 detects that the customer has input that the next shopping cart Cs exists (step SA10; YES), the control device 110 returns to step SA3 and moves the next shopping cart Cs to the settlement basket Bc. Scan purchased products. Since the operation after this is the same as the above, further description will be omitted.

On the other hand, when the control device 110 determines that the scan of the purchased commodities is completed (step SA10; NO), it starts the settlement process shown below.

<Payment processing>
FIG. 12 is a flowchart showing the settlement process executed by the self-checkout terminal 100.
The control device (settlement unit) 110 first displays a settlement method inquiry message on the display panel of the output unit 140 (step SB1).

FIG. 13 is a diagram exemplifying a payment method inquiry message Mh1 for member customers and a payment method inquiry message Mh2 for general customers, which are displayed on the display panel.
In the payment method inquiry message Mh1 for member customers, the member ID and member name of the customer are displayed, and if a credit card number is already registered, it is determined whether cashless payment is acceptable. Includes a message prompting the user.
On the other hand, the settlement method inquiry message Mh2 for general customers includes a message or the like that explains the settlement method using cash or the like in an easy-to-understand manner using moving images or images.

Upon confirming the payment method inquiry message displayed on the display panel, the customer appropriately operates the touch panel of the input unit 130 to select a payment method (for example, cashless payment, cash payment, card payment, etc.).

When the control device (settlement unit) 110 detects that the customer selects a payment method, the control device (settlement unit) 110 makes payment for the purchased product using the selected payment method (step SB2), and ends the process. To explain the payment by way of example, when cash payment is selected, a ticket receipt machine (not shown) issues a settlement receipt based on the product information of each purchased product. It should be noted that the receipt is printed with the product name, quantity, and price of each purchased product, as well as the total price. The customer goes to the checkout machine 200 with the receipt to be issued. The customer holds the receipt over the checkout machine 200, selects cash payment as the payment method, and then pays for the purchased product. Customers can use various payment methods such as cash, point cards, credit cards and electronic money.

As described above, according to the self-checkout system 1000 according to the present embodiment, each customer simply performs a natural operation of moving a product from the shopping basket Cs to the checkout basket Bc, and the customer selects the product as a purchase target product. It becomes possible to specify (scan).

Further, each customer can carry one item in each hand and scan two items at a time. Therefore, the time required for product scanning can be shortened as compared with the conventional self-checkout in which the products to which the barcodes are attached must be scanned one by one. In addition, each customer does not have to perform a complicated work such as searching for a barcode attached to a product, and can quickly settle the product.

B. Others The present invention is not limited to the above-described embodiments, and can be implemented in various other forms without departing from the scope of the present invention. Therefore, the above embodiments are merely examples in all respects, and should not be construed as limiting. For example, the processing steps described above can be arbitrarily changed in order or executed in parallel within a range that does not cause a contradiction in the processing content. Further, some (or all) of the functions of the management server 300 may be installed in each self-checkout terminal 100.

1000... Self-checkout system, 100... Self-checkout terminal, 110... Control device, 120... Storage section, 130... Input section, 140... Output section, 150... Communication section, 160... Member authentication camera, 170... Shopping cart camera, 180... Product specifying camera, 200... payment machine, 300... management server, Cs... shopping basket, Bc... payment basket, DB1, product master database, DB2... member customer database.

Claims (5)

For each product handled in the store, a product master database that stores product information including a product master image for product identification,
A first imaging device for imaging the accommodation state of the shopping basket;
A second imaging device for imaging the product when the customer takes out the product in the shopping basket and transfers it to the checkout basket;
By comparing the captured image of the product with the product master image, a specifying unit for specifying the purchase product of the customer,
An output unit that outputs the product information corresponding to the specified purchase product,
An inquiry unit for inquiring of the customer as to whether to continue to specify the purchased product or to start the settlement of the purchased product based on the image of the shopping basket showing the accommodation state of the shopping basket captured;
A self-registration system comprising: a settlement unit that executes a settlement process when the start of the settlement is instructed in response to the inquiry. A member customer database that stores member information including a face image for authentication for each member customer,
A third image pickup device for picking up the face image of the customer at the entrance;
By further comparing the captured face image of the customer with the face image for authentication, an authentication unit for performing member authentication is further provided,
The settlement section is
The self-checkout system according to claim 1, wherein when the customer is judged to be a member customer by the member authentication, cashless payment is permitted to the customer. The self-checkout system according to claim 2, further comprising: a privilege granting unit that grants a privilege related to a product to the customer when it is determined by the member authentication that the customer is a member customer. The self-registration system according to any one of claims 1 to 3, wherein a plurality of the second imaging devices are arranged in the vicinity of the settlement basket. The self-checkout system according to claim 4, wherein the output unit includes a display device that displays the product information.

Images