JP5473155B2 - Checkout device and sales processing program - Google Patents

Description

  Embodiments described herein relate generally to a self-checkout apparatus and a sales processing program for causing a computer to function as a self-checkout apparatus.

  In recent years, retail stores such as supermarkets and drug stores have used self-checkout devices that perform operations from customer code input to payment processing by their own operations.

  By the way, products sold at retail stores include products with a fixed unit price per unit (referred to as fixed-price products) and products with a fixed unit price per unit weight (referred to as scale-sold products). In the case of a self-checkout device, a fixed price product has a fixed price and can be registered for sales. However, since the price of the product sold by weight varies depending on the amount purchased by the customer, it cannot be registered for sales.

JP 2009-053846 A

  The problem to be solved by the present invention is to provide a self-checkout device capable of registering sales of products sold by weight.

In one embodiment, the checkout device includes a scale unit, an imaging unit, a product recognition unit, a product data detection unit, and a scale sale product sales unit. The scale unit measures the weight of the placement object placed on the placement part for placing the product. The imaging unit images the product recognition area that faces the reading window. The product recognizing means recognizes the product held over the reading window from the image captured by the imaging unit . The product data detection unit detects product data including at least a unit price of the product recognized by the product recognition unit and a flag for identifying whether or not the product is a sale product with a unit price per unit weight. The weighing product sales means determines the price of the product from the weight information measured by the scale unit and the unit price of the product data when the product is identified as the weighing sale product from the product data flag detected by the product data detection means. Calculate and process sales.

1 is an overall configuration diagram of a self-checkout system according to an embodiment. The schematic diagram which shows the goods master record of the goods master file which a goods server manages in the same system. The external appearance perspective view of the self-POS terminal in the same system. The block block diagram of the self-POS terminal in the same system. The schematic diagram which shows the main data files preserve | saved with HDD of the self POS terminal in the same system. The schematic diagram which shows the main memory areas formed in RAM of the self POS terminal in the same system. The flowchart which shows the process sequence which CPU of the self POS terminal in the same system performs according to a sales process program. 6 is a flowchart showing a processing procedure executed by a camera controller of a self-POS terminal in the system according to a command from a CPU.

  Hereinafter, an embodiment of a checkout device will be described with reference to the drawings. This embodiment is a case where the present invention is applied to a self-type POS (Point Of Sales) terminal in which the operation from the input of the product code to the settlement process is performed by the customer's own operation.

  FIG. 1 is an overall configuration diagram of a self-checkout system 10 constructed in a retail store such as a supermarket or a drug store where a self-checkout device is introduced. The system 10 includes a product server 11 and a plurality of self-POS terminals 12. The merchandise server 11 and each self-POS terminal 12 are connected via a network 13 such as a LAN (Local Area Network) so as to be capable of bidirectional communication.

  The product server 11 manages the product master file 14. The product master file 14 stores a product master record 14R created for each product for all products sold in the store.

  FIG. 2 is a schematic diagram showing the data structure of the product master record 14R. In the present embodiment, product information such as product classification, product name, unit price, weigh-in sale flag, set weight, product image and the like is described in the product master record 14R in association with the product code which is an identification code unique to the product.

  Whether the product sold by the corresponding product code is a fixed-price product with a fixed unit price per unit or a unit product with a unit price per unit weight (meat, vegetables, prepared foods, etc.) Identify The set weight is an average weight per point of the product specified by the corresponding product code. Note that the set weight is set for fixed-price products, and is not set for scale-selling products. The product image is an image obtained by capturing the product specified by the corresponding product code.

  FIG. 3 is an external perspective view of the self-POS terminal 12 which is an aspect of the self-checkout device. The self POS terminal 12 has a first mounting table 21 for placing an unregistered product on one side surface (right side surface in FIG. 3) of the main body 20, and the other side surface (left side surface in FIG. 3). ), The second mounting table 22 for placing the registered product is arranged.

  The first mounting table 21 has a mounting surface 21a on which a shopping basket for putting products to be purchased by a shopper can be put together.

  The second mounting table 22 has a mounting surface 22a on which a shopping bag such as a shopping bag hung on a pair of bag holding arms 23a, 23b can be mounted. The bag holding arms 23 a and 23 b are attached to the lower surface of the temporary mounting table 24, and the temporary mounting table 24 is mounted above the second mounting table 22 by a support arm 25. The 2nd mounting base 22 incorporates the scale part 64 (refer FIG. 4). The weighing unit 64 measures the total weight of the heavy objects placed on the placement surface 22a and the temporary placement table 42.

  The main body 20 includes a display 32 with a touch panel 31 on the front upper portion thereof. Further, a reading window 33, a card insertion port 34, a receipt issuing port 35, a coin insertion port 36, a coin discharge port 37, a bill insertion port 38, and a bill discharge port 39 are formed on the front surface of the main body 20.

  The display 32 is an LCD provided with a touch panel 31 having an information input function by a shopper's touch operation on the screen, and displays a guidance message for informing the shopper of the operation method. Also, the product name, price, total purchase amount, deposit amount, change amount, etc. of the registered product are displayed.

  The reading window 33 has a rectangular shape and is formed in the main body 20 so as to face a recognition area of a product registered for sale in the self-POS terminal 12. A digital camera 72 (see FIG. 4) such as a CCD image sensor is disposed in the main body 20 on the back side of the reading window 33. When a user (shopper) of the self-POS terminal 12 holds a product over the reading window 33, an image including the product is captured by the camera 72. The self POS terminal 12 analyzes the image taken by the camera 72 and recognizes a product included in the image.

  The card insertion slot 34 is an insertion slot for a shopper's point card or IC card for payment. The receipt issuance port 35 is a receipt issuance port for a receipt printed when the checkout operation is completed. The coin slot 36 is a slot for coins for payment. The coin discharge port 37 is a discharge port for coins as change. The bill insertion slot 38 is a bill insertion slot for payment. The banknote discharge port 39 is a discharge port for banknotes as change.

  FIG. 4 is a block diagram showing a main configuration of the self-POS terminal 12. The self-POS terminal 12 includes a CPU (Central Processing Unit) 51 as a main control unit. The CPU 311 is connected to a ROM (Read Only Memory) 53, a RAM (Random Access Memory) 54, an HDD (Hard Disk Drive) 55, a communication interface 56, a reader / writer via a bus line 52 such as an address bus and a data bus. A writer interface 57, a coin insertion / dispensing unit 58, a bill insertion / dispensing unit 59, a camera controller 60, a touch panel controller 61, a display controller 62, a printer controller 63, and an analog / digital converter (hereinafter abbreviated as A / D). Connect 64a.

  The communication interface 56 controls data transmission / reception with the product server 11 connected via the network 13.

  The reader / writer interface 57 controls data transmission / reception with the card reader / writer 71. The card reader / writer 71 reads data from the card inserted from the card insertion slot 34 and writes data to the card.

  The coin insertion / dispensing unit 58 has a function of selecting coins inserted from the coin insertion slot 36 according to denomination and storing them in a safe, and picking up coins as change from the safe and paying them to the coin discharge opening 37. It has a function to put out.

  The bill insertion / dispensing unit 59 selects the bills inserted from the bill insertion slot 38 according to denomination and stores them in a safe, and picks up bills as change from the safe and pays them to the bill discharge port 39. It has a function to put out.

  The camera controller 60 controls imaging on / off of the digital camera 72 as an imaging unit. The touch panel controller 61 controls the touch panel 31 and takes in position coordinate data on the screen touched by the user. The display controller 62 causes the display 32 to display a screen corresponding to the display data. The printer controller 320 controls receipt printing by the receipt printer 73 and issues a receipt from the receipt issuing port 35.

  The scale unit 64 receives a load applied to the mounting surface 22a of the second mounting table 22 and the temporary mounting table 42 and converts the load cell 64b into an electric signal, and a load signal (electric signal) output from the load cell 64b. A / D 64b for converting the data into digital data. The CPU 51 detects the total weight of the products placed on the second mounting table 22 from the digital data taken in via the A / D 64a.

  As shown in FIG. 5, the self-POS terminal 12 having such a configuration stores a program file 81, a sales registration file 82, and a threshold file 83 in the HDD 55. The program file 81 stores at least a sales processing program to be described later. The sales registration file 82 stores sales data of products whose sales are registered at the POS terminal 12. The threshold value file 83 stores a threshold value for determining whether or not the product image captured by the camera 72 matches the image of each product registered in the product master file 14.

  Further, as shown in FIG. 6, the self-POS terminal 12 has a product image memory 91, a product data memory 92, a current weight memory 93, a previous weight memory as memory areas necessary for the CPU 51 to execute the sales processing program. 94 and the difference memory 95 are formed in the RAM 54.

  FIG. 7 is a flowchart showing the procedure of the CPU 51 operating in accordance with the sales processing program. FIG. 8 is a flowchart showing the procedure of the camera controller 60 operating in cooperation with the CPU 51. Hereinafter, the flow from when the shopper registers sales of the purchased product using the self-POS terminal 12 and completes the settlement will be described with reference to the flowcharts of FIGS.

  First, the shopper places the product he / she purchases on the first mounting table 21. Further, the shopper spreads shopping bags such as shopping bags on the mounting surface 22 of the second mounting table 22. The shopping bag handle is hung on the pair of bag holding arms 23a and 23b.

  Next, the shopper touches the registration start declaration button according to the guidance displayed on the display 32. Then, in the self POS terminal 2, the sales processing program is activated. By starting this program, the CPU 51 transmits an imaging on command to the camera controller 60 (step P1).

  The camera controller 60 that has received the imaging-on command command outputs an imaging-on signal to the camera 72 (step Q1). The camera 72 that has received this imaging ON signal images the product recognition area facing the reading window 33 at a cycle of, for example, 30 fps. The frame images are sequentially sent to the camera controller 60.

  When the camera controller 60 captures the frame image data from the camera 72 (step Q2), the camera controller 60 detects a product image from the image data (step Q3). Here, when the product image is not reflected in the frame (NO in step Q3), the camera controller 60 determines whether or not a business end command has been received (step Q5). If the business end command has not been received (NO in step Q5), the camera controller 60 captures the next frame image data.

  If even a part of the product image is reflected in the frame (YES in step Q3), the camera controller 60 writes the frame image data in the product image memory 91 (step Q4). Thereafter, the camera controller 60 determines whether or not a business end command has been received (step Q5).

  In this way, the camera controller 60 repeatedly executes the processes of steps Q2, Q3, and Q4 until the business end command is received. That is, every time frame image data is captured from the camera 72, the camera controller 60 searches for a product image, and if a product image is detected, the camera controller 60 overwrites the product image memory 91 with the frame image data.

  On the other hand, the CPU 51 that has transmitted the imaging ON command to the camera controller 60 waits for the frame image data including the product image to be written in the product image memory 91 (step P2). When frame image data including a product image is written in the product image memory 91 (YES in step P2), the CPU 51 executes a product recognition process (step P3: product recognition means).

  Specifically, the CPU 51 reads the state of the surface such as hue and unevenness as the feature amount from the product image included in the frame image data. Then, the CPU 51 refers to the image data of each product stored in the product master file 14 and recognizes the product as a specific object. In order to shorten the processing time, the outline and size of the product are not considered.

  Recognizing an object included in an image in this way is called generic object recognition. Regarding such general object recognition, various recognition techniques are described in the following documents.

Keiji Yanai, “Current Status and Future of General Object Recognition”, Transactions of Information Processing Society of Japan, Vol.48, No.SIG16, [searched on August 10, 2010], Internet <URL: http: //mm.cs. uec.ac.jp/IPSJ-TCVIM-Yanai.pdf>
Further, techniques for performing general object recognition by dividing an image into regions for each object are described in the following documents.

Jamie Shotton et al., “Semantic Texton Forests for Image Categorization and Segmentation”, [searched August 10, 2010], Internet <URL: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1. 1.145.3036 & rep = repl & type = pdf>
If the product is recognized from the frame image data in this way, the CPU 51 calculates the similarity for the recognized product (step P4). The similarity indicates how similar the product images included in the frame image data are when the product image stored in the product master file 14 is 100% = [similarity 1.0]. . As described above, the similarity is calculated based on, for example, the color of the surface and the unevenness. Note that, for example, the weight may be changed according to the hue and the unevenness state.

  If the similarity is calculated, the CPU 51 determines whether or not the similarity exceeds a threshold set in advance in the threshold file 83 (step P5). If not exceeded (NO in step P5), the CPU 51 waits for the next frame image data to be written in the product image memory 91 (step P2).

  On the other hand, if the similarity exceeds the threshold (YES in step P5), the CPU 51 detects the product master record 14R of the product recognized from the frame image data from the product master file 14, and stores it in the product data memory 92. Store (step P6: product data detection means). Then, the CPU 51 displays the product name in this record 14R on the display 32 (step P7).

  Next, the CPU 51 acquires weight data of the recognized product (step P8). Specifically, the CPU 51 waits for the weight value measured by the scale unit 64 to change. If a change in weight is detected, the CPU 51 copies the weight value that has been stored in the current weight memory 93 to the previous weight memory 84 and overwrites the current weight value in the current weight memory 93. Then, the difference between the weight value of the previous weight memory 84 is calculated from the weight value of the current weight memory 93 and the difference memory 95 is overwritten. The CPU 51 acquires the weight value overwritten in the difference memory 95 as the weight data of the recognized product.

  Next, the CPU 51 checks the scale sale flag of the product master record 14R stored in the product data memory 92, and identifies whether the recognized product is a scale sale product or a fixed price product (step P9).

  In the case of a fixed amount product (NO in step P9), the CPU 51 determines whether or not the reference weight of the product master record 14R is the same as the weight value in the difference memory 95 (step P10: weight determination means). For example, if the error between the reference weight and the weight value of the difference memory 95 is within a predetermined allowable range, it is determined that there is identity, and if it is outside the allowable range, it is determined that there is no identity. When it is determined that there is no identity (NO in step P10), the CPU 51 notifies an error.

  On the other hand, when it is determined that there is identity (YES in step P10), the CPU 51 sets the unit price of the product master record 14R as the price of the recognized product (step P11). Then, merchandise sales data including the merchandise code, price, and sales score = 1 of the merchandise is registered in the sales registration file 82 (step P13: fixed price merchandise sales means).

  On the other hand, in the case of a product sold by weight (YES in step P9), the CPU 51 calculates the price of the recognized product by multiplying the unit price of the product master record 14R by the weight value of the difference memory 95 (step P12). Thereafter, the CPU 51 registers product sales data including the product code, the price, and the sales score = 1 of the product in the sales registration file 82 (step P13: measure sale product sales means).

  When the sales registration process in step P13 is completed, the CPU 51 determines whether or not an operation end input has been performed via the touch panel 31 (step P14). When the end of business has not been input (NO in step P14), the CPU 51 waits for the next frame image data to be written in the product image memory 91 (step P2).

  If a business end input has been made (YES in step P14), the CPU 51 sends a business end command to the camera controller 60 (step P15). Further, the CPU 51 performs a settlement process based on each product sales data registered in the sales registration file 82 (step P16). This settlement processing includes change calculation and payout processing, receipt issuance processing, and the like.

  On the other hand, the camera controller 60 that has received the business end command (YES in step Q5) outputs an imaging off signal to the camera 72 (step Q6). The camera 72 that has received this imaging off signal ends the imaging operation.

  The shopper who touched the registration start declaration button picks up the products placed on the first mounting table 21 one by one and holds them over the reading window 33. Then, an image of the product is captured by the camera 72, the product is automatically recognized from the product image, and the product name is displayed on the display 32. Therefore, the shopper puts the product over the reading window 33 in the shopping bag of the second mounting table 22. Alternatively, it is placed on the temporary mounting table 24.

  At this time, if the product is a flat-rate product, it is determined whether the amount of change in the weight measured by the scale unit 64 provided on the second mounting table 22 and the recognized reference weight of the flat-rate product are the same. Is done. If it is determined that there is identity, the sales data of the product is registered for sales using the unit price of the recognized flat-rate product as the price.

  On the other hand, when the product is a product sold by weight, the amount of change in weight measured by the scale unit 64 provided on the second mounting table 22 is determined as the sales amount of the recognized product sold by weight. Then, the price is calculated from the unit price and weight of the recognized quantity sale product, and sales data of the product is registered as sales.

  As described above, the self-POS terminal 12 of the present embodiment discriminates between the sale item and the fixed amount item. Then, for a weigh-in sale product, the weight change of the scale unit 64 is determined as the sale amount of the product, and the price is calculated by multiplying the unit price by the weight which is the sale amount. On the other hand, for fixed-price products, the unit price set in advance is used as the price. Then, the self-POS terminal 12 registers product sales data including the price in the sales registration file 82 for both the quantity sale product and the fixed price product.

  The shopper touches the business end declaration button after moving all the products placed on the first mounting table 21 to the second mounting table 22 side. Then, a settlement process is performed based on the sales data of each product registered in the sales registration file 82. That is, processing such as display of the total amount, calculation and display of the deposit amount, calculation and display of the change amount, issuance of a receipt, and the like are performed.

  Therefore, according to the self POS terminal 12 of the present embodiment, not only fixed-price products but also weighed-sale products can be registered by self. In this case, even a shopper who has a mixture of fixed-price merchandise and scale-selling merchandise as purchased merchandise, all of the purchased merchandise can be correctly registered and processed for settlement.

  In addition, the self-POS terminal 12 of the present embodiment includes a camera 72 as an imaging unit, and automatically recognizes a purchased product from an image of a product photographed by the camera 72. Therefore, compared to existing self-checkout devices that recognize products by reading barcodes and two-dimensional data codes, shoppers are aware of the location where barcodes and two-dimensional data codes are attached. Since it is not necessary to hold it over the reading window, workability is good.

The present invention is not limited to the above embodiment.
For example, in the embodiment, the scale unit 64 is provided on the second mounting table 22, but may be provided on the first mounting table 21. In this case, when the shopper picks up one product placed on the first mounting table 21 and holds it over the reading window 33, the CPU 51 detects a change in the weight of the weighing unit 64. By storing the amount of change in the difference memory 95, data processing similar to that of the first embodiment can be executed.

  In the embodiment, the product data record 14R of the recognized product is detected from the product master file 14 managed by the product server 11. However, the local product file is stored in the HDD 55 of each self-POS terminal 12, and this product data record 14R is detected. The product data record 14R of the recognized product may be detected from the product file. By doing so, the time required for communication on the network 13 can be shortened, so that the processing efficiency can be improved.

  In the embodiment, the purchased product is recognized from the image of the product photographed by the camera 72. However, the self-checkout terminal that recognizes the purchased product using an existing barcode or two-dimensional data code is also used. The present invention can be similarly applied.

  In the above embodiment, the sales processing program for realizing the functions of the invention is recorded in advance in the HDD 55 which is a program storage unit in the apparatus. However, the present invention is not limited to this, and a similar program may be downloaded from the network to the apparatus. Alternatively, a similar program recorded on the recording medium may be installed in the apparatus. The recording medium may be in any form as long as it can store a program such as a CD-ROM or a memory card and can be read by the apparatus. Further, the function obtained by installing or downloading the program may be realized in cooperation with an OS (operating system) in the apparatus.

In addition, although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.
Hereinafter, the invention described in the scope of claims of the present application will be appended.
[1] A scale unit that measures the weight of a placement object placed on a placement unit for placing a product, a product recognition unit that recognizes a product held over a reading window, and a recognition unit that recognizes the product Product data detection means for detecting product data including at least a product unit price and a flag for identifying whether or not the product is a weight sale product for which the unit price per unit weight is determined, and detected by the product data detection means When the product is identified as a product sold by weight from the flag of the product data, the price of the product is calculated from the weight information measured by the scale unit and the unit price of the product data, and sales processing is performed. A check-out device comprising: a measure-sale product sales means.
[2] When the product is identified as not being measured and sold from the flag of the product data detected by the product data detection means, the reference weight included in the product data is weight information measured by the scale unit; A weight determination means for determining whether or not they have identity, and when determined to have identity by the weight determination means, a fixed amount product sales means for selling the product at a unit price included in the product data; The checkout device according to appendix [1], further comprising:
[3] The product recognizing means includes an imaging unit that images a product recognition area facing the reading window, and recognizes a product held over the reading window from an image captured by the imaging unit. The checkout device according to [1] or [2].
[4] The supplementary note [1], wherein the weighing unit measures the weight of the object placed on the first placement part for placing the product before being held over the reading window. The checkout device according to any one of [3] to [3].
[5] The appendix [1], wherein the weighing unit measures the weight of the object placed on the second placement part for placing the product after being held over the reading window. ] To [3].
[6] A computer serving as a checkout device including a weighing unit for weighing the placed object placed on the placement unit for placing the product and a reading window for holding the product, Product data for detecting product data including at least a product recognition function for recognizing a product held over a window, a unit price of the product recognized by the product recognition function, and a flag for identifying whether the product is a product sold by weight. From the detection function and the weight information measured by the scale unit and the unit price of the product data when the product is identified as a product sold by weight from the flag of the product data detected by the product data detection function A sales processing program for realizing a function of selling a quantity-sold product for calculating and selling the price of the product.

  DESCRIPTION OF SYMBOLS 12 ... Self POS terminal (self-checkout apparatus), 14 ... Product master file, 21 ... 1st mounting base, 22 ... 2nd mounting base, 31 ... Display, 32 ... Touch panel, 33 ... Reading window, 51 ... CPU 64 ... Scale unit, 72 ... Camera, 81 ... Program file, 82 ... Sales registration file, 83 ... Threshold file.

Claims (5)

A weighing unit that weighs the weight of the object placed on the placing part for placing the product;
An imaging unit that images the product recognition area facing the reading window;
Product recognition means for recognizing a product held over the reading window from an image captured by the imaging unit ;
Product data detection means for detecting product data including at least a unit price of the product recognized by the product recognition means and a flag for identifying whether or not the product is a weight sale product with a unit price per unit weight determined;
When it is identified from the flag of the product data detected by the product data detection means that the product is a product sold by weight, the price of the product is calculated from the weight information measured by the scale unit and the unit price of the product data. Measured sales product sales means to calculate and process sales,
A checkout device comprising: When the product is identified as not being measured and sold from the flag of the product data detected by the product data detection means, the reference weight included in the product data is identical to the weight information measured by the scale unit. Weight determination means for determining whether or not to have,
If it is determined by the weight determination means that they are identical, a fixed-price product sales means for selling the product at a unit price included in the product data;
The checkout device according to claim 1, further comprising: The scale unit, according to claim 1 or 2, characterized in that weighing the weight of the first placed on the placing part has been mounting object for placing the product before being held over the reading window Checkout device. The scale unit, to claim 1 or 2, characterized in that weighing the weight of the second mounted on the mounting portion has been mounting object for placing a product after it has been held over the reading window Checkout device as described. A scale unit that weighs the weight of the object placed on the placement unit for placing the product, a reading window for holding the product, and an imaging unit that images the product recognition area facing the reading window; To a computer as a checkout device with
A product recognition function for recognizing a product held over the reading window from an image captured by the imaging unit ;
A product data detection function for detecting product data including at least a unit price of the product recognized by the product recognition function and a flag for identifying whether or not the product is a product sold by weight;
When the product is identified as a product sold by weight from the flag of the product data detected by the product data detection function, the price of the product is calculated from the weight information measured by the scale unit and the unit price of the product data. Calculates and sells products by weight sales,
Sales processing program to realize.

Images