JP2011054038A - Self-checkout terminal device and control program for the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a self-checkout terminal and a control program for the same for reducing a time for registering products and preventing a customer from feeling a sense of discomfort. <P>SOLUTION: The self-checkout terminal device 101 includes: a recognition camera 299 for photographing products; a recognition part M1 for recognizing a shopping cart and products taken out of the shopping cart from an image photographed by the recognition camera; a scan determination part M3 which is started by the recognition part and determines whether or not the product is scanned; and a notification part M4 for notifying an error alarm when it is determined by the scan determination part that the product is not scanned. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a self-checkout terminal device and a control program therefor, and is applied to, for example, a self-checkout terminal used in a self-checkout system.

  Some self-checkout terminal devices perform product registration confirmation for each scan to prevent fraud, for example (see, for example, Patent Document 1). The product registration confirmation is performed by confirming whether the weight of the scanned product matches each weight increase of the shopping basket after the scan. The weight of the product is registered in the prior information processing apparatus. Check that the weight of the product scanned by the customer matches the weight increase in the shopping basket after the scan, and if the increase is different from the weight registered in the information processing device Recognize and raise an error.

  However, with the above-described configuration, it takes time to determine the weight after placing the product in the shopping basket after scanning. For this reason, the customer scans the next product even though the product registration confirmation has not been completed, and the device generates an error even if the device is illegal. In addition, if a product other than the scanned item, such as a wallet, is placed, an error will occur, and if the number of items is large, the scanned item can be placed on the weighing device. If there is no error, an error occurs. If the product is light, there is a problem that the product registration cannot be checked as a weight error range. These errors cause discomfort to the customer.

  Therefore, the present invention provides a self-checkout terminal device and a control program thereof that can shorten the product registration time and prevent the customer from feeling uncomfortable.

  A self-checkout terminal device according to an aspect of the present invention includes a recognition camera that captures a product, and a recognition unit that recognizes a shopping basket and a product that is taken out of the shopping basket from an image captured by the recognition camera. A scan determination unit that is activated by the recognition unit to determine whether or not the product has been scanned; and a notification unit that notifies an error warning when the scan determination unit determines that the product has not been scanned. It has.

  A control program for a self-checkout terminal device according to an aspect of the present invention is extracted from an image photographed by the recognition camera to a self-checkout terminal device including a recognition camera that images a product from the shopping basket and the shopping basket. A procedure for recognizing a product to be read, a procedure for determining whether or not the product has been scanned, and a procedure for notifying an error warning when it is determined that the product has not been scanned by the determination procedure.

  According to the present invention, it is possible to obtain a self-checkout terminal device and a control program thereof that can shorten the product registration time and prevent the customer from feeling uncomfortable.

1 is a block diagram showing an example of the overall system configuration according to a first embodiment of this invention. The figure which shows the arrangement | positioning state of each part in the self-checkout system which concerns on 1st Embodiment. The perspective view which shows the external appearance structural example of the self-checkout terminal device which concerns on 1st Embodiment. The block diagram which shows the electrical structural example of the self-checkout terminal device which concerns on 1st Embodiment. The block diagram which shows the example of a control program of the self-checkout terminal device which concerns on 1st Embodiment. The flowchart for demonstrating the scan determination operation | movement of the self-checkout terminal device which concerns on 1st Embodiment. The flowchart for demonstrating goods locus | trajectory recognition operation | movement of the self-checkout terminal device which concerns on 1st Embodiment. The perspective view for demonstrating the goods registration operation | movement of the self-checkout terminal device which concerns on 1st Embodiment. The block diagram which shows the example of a control program of the self-checkout terminal device which concerns on 2nd Embodiment. The flowchart for demonstrating goods registration operation | movement of the self-checkout terminal device which concerns on 2nd Embodiment.

  Embodiments of the present invention will be described below with reference to the drawings. In this description, common parts are denoted by common reference numerals throughout the drawings.

[First Embodiment]
<1. Configuration example>
A configuration example of the self-checkout terminal device, its product registration operation, and its control program according to the first embodiment of the present invention will be described with reference to FIGS.
1-1. Overall system configuration example
First, an example of the entire system configuration will be described with reference to FIG.
As shown in the figure, the system of this embodiment is constructed by connecting a plurality of self-checkout systems 11, a plurality of POS terminals 21, and a store controller 31 via a communication network 41.
The self-checkout system 11 is configured by assigning one attendant terminal 501 to a plurality of self-checkout terminals 101. The self checkout terminal 101 includes a settlement terminal 201.
The self-checkout terminal 101 according to the present example proposes that product settlement can be performed by recognizing a product by a camera without including a scale device for confirming the weight of the scanned product. Details will be described below.

1-2. Self-checkout system layout example
Next, an arrangement example of each part in the self-checkout system 11 according to the present embodiment will be described with reference to FIG.
As shown in the figure, in the self-checkout system 11 of the present embodiment, one attendant terminal 501 is assigned to four self-checkout terminals 101. The self-checkout terminal 101 is arranged such that a pair of self-checkout terminals 101 are arranged in parallel along the customer passage 121, and the pair of self-checkout terminals 101 face the front side via the customer passage 121. Has been.

  An attendant terminal 501 is disposed at the end of the customer passage 121. The attendant terminal 501 has a form of a personal computer having a main body unit 502, a display 503 as a display unit, a keyboard 504, and a ponting device 505 as an operation unit, and is placed on the attendant table 601. ing.

  On the display 503 of the attendant terminal 501, each processing status of the self-checkout terminal 101 connected to the attendant terminal is displayed in real time.

  The self-checkout terminal 101 is provided with a display pole (not shown) as an alarm device that displays the current state. This display pole has a light emitting part.

  When an error occurs in the self-checkout terminal 101, the display color at the tip of the display pole changes to red indicating the error, and at the same time, error information such as a scan error is sent to the attendant terminal 501 and is displayed on the display of the attendant terminal 501. The details of the error are displayed.

1-3. Example of external configuration of self-checkout terminal device
Next, an external configuration example of the self-checkout terminal 201 according to this example will be described with reference to FIG.
As shown in the figure, the settlement terminal 201 has a housing 202 in which a product basket mounting table 102 for mounting a bag (not shown) containing products to be purchased by a customer protrudes from the left side. . On the upper surface of the commodity basket mounting table 102, a protrusion 103 for positioning the basket is formed in an L shape.

  The housing 202 of the payment terminal 201 includes a base housing 202a installed on the floor and a small upper housing 202b placed on the upper surface of the base housing 202a. The front surface of the base housing 202a is inclined so as to narrow the projected area of the base housing 202a as it goes downward. As a result, the base housing 202a has a shape that is offset toward the back as it goes downward.

  Various user interfaces are provided in the upper housing 202b. That is, in the upper housing 202b, a barcode scanner 203 as a product code reading unit is arranged on the left side, and a printer cover 204 and a monitoring camera 205 are arranged on the right side. These barcode scanner 203, printer cover 204, and monitoring camera are arranged. Between 205, a card reading unit 206 and a numeric keypad 207 as a settlement unit are arranged. The barcode scanner 203 is a vertical scanner that functions as a product code reading unit that reads a product code attached to a product. The printer cover 204 is provided with a receipt issuing port 208.

  A receipt printer 251 is built in the upper housing 202 b on the back side of the printer cover 204, and a receipt (not shown) printed by the receipt printer 251 is issued from a receipt issuing port 208. The printer cover 204 is attached to the upper housing 202b so as to be openable and closable, and is opened by pulling the flap 209. The monitoring camera 205 is disposed above the printer cover 204. The card reading unit 206 establishes wireless communication with a non-contact IC card (not shown), and reads / writes information from / to the non-contact IC card. As an example, the non-contact IC card can store and save electronic money having a value equivalent to cash. As another example, the contactless IC card stores and stores an identification number for identifying a debited bank account. Used. In the figure, an antenna (not shown) is incorporated in the back of the portion marked “CARD” in the circle, and wireless communication with the non-contact IC card is established through this antenna. The numeric keypad 207 is used for inputting a personal identification number at the time of settlement with a non-contact IC card.

  An LCD 210 serving as a display unit having a liquid crystal display panel is attached to the upper housing 202b. The LCD 210 has a touch panel 211 as an input unit on its display surface and a card reading groove 212 on the right side. A card reader / writer 252 as a settlement unit is built in the card reading groove 212. The card reader / writer 252 reads information recorded on a magnetic card such as a credit card, for example, a card number or a password.

  The base housing 202a incorporates a coin / banknote deposit / withdrawal device. As a part of the deposit / withdrawal device, a coin insertion slot 213 is disposed on the central upper surface of the base housing 202a, and a coin payout outlet 214 is disposed on the left side thereof. In addition, a bill insertion slot 215 and a bill dispensing outlet 216 are arranged at the upper right position on the front side of the base housing. Such a depositing / withdrawing apparatus has a mechanism that enables handling of money and banknotes, and a controller that controls the mechanism.

  A display pole 217 for displaying the current state of the self-checkout terminal 101 is erected from the back surface of the base housing 202a. The display pole 217 has a light emitting portion 218 that selectively emits blue and red light at the tip.

  The recognition camera 299 is installed on the display pole 217 so that the entire self-checkout terminal 101 enters the imaging range. As will be described later, the recognition camera 299 recognizes that the product has come out of the shopping basket, or recognizes the trajectory of the product moving from the shopping basket to the storage bag.

  On the storage bag base 302, a base 306 for temporarily placing a product by a customer and a hook 304 for hooking the storage bag are arranged.

1-4. Configuration example of self-checkout terminal device
Next, a configuration example of the self-checkout terminal 201 according to this example will be described with reference to FIG. FIG. 4 is a block diagram showing an electrical hardware configuration of the self-checkout terminal 201.

  As shown in the figure, it is a block diagram showing an electrical hardware configuration of the payment terminal 201. The payment terminal 201 has a control unit 253 as an information processing unit therein. For example, the control unit 253 may have a semiconductor chip configuration in which an operation sequence is written, or may have a microcomputer configuration in which an operation program is stored in the RAM 254 or the like. Here, the control unit 253 having a microcomputer configuration is taken as an example.

  The CPU 255 is the core of the control unit 253. A ROM 255 that stores fixed data in a fixed manner, a RAM 254 that stores variable data in a rewritable manner, a VRAM 257 that generates a display image to be displayed on the LCD 210, and an HDD 258 are connected to the CPU 255 via a system bus 259. Yes. As an example, the HDD 258 stores operation programs, various display frames, PLU files, department files, image files, sales files, and other files, product placement location definitions, various rule information, and the like. All or a part of the program, various display frames, various files, various rule information, and the like are transferred to the RAM 254 and used when the settlement terminal 201 is activated. These PLU files, department files, image files, sales files, and other various files constitute a product data file.

  The control unit 253 includes a barcode scanner 203, LCD 210, touch panel 211, card reading unit 206, numeric keypad 207, card reader / writer 252, receipt printer 251, monitoring camera 205, light emitting unit 218, and deposit / withdrawal device 221. An interface 260 that mediates data communication is connected via a system bus 259 and is controlled by the control unit 253. The control unit 253 controls each of these units, and executes product sales data processing including search processing, product information registration processing, and settlement processing.

  Furthermore, as will be described later, when the barcode attached to the product is read by the barcode scanner 203, the scan determination unit M3 stores, for example, “1” data in the RAM 254 as product information registration corresponding to the product. Is set and the fact that the product has been scanned successfully is stored. When the flag set in the RAM 254 is confirmed and the product settlement is completed, the scan determination unit M3 resets the “1” data flag in the RAM 254 in preparation for the next product scan. The above operation is performed for each product to be scanned.

  The settlement process is a process for calculating a settlement amount based on the unit price acquired by the search process and executing settlement of the settlement amount. The settlement amount is calculated by calculating the total sales amount including the necessary consumption tax calculation according to the closing operation on the touch panel 211, and is temporarily registered in the RAM 254 or the like or registered in the sales file. In the payment process, the calculated payment amount enables payment using a magnetic card such as cash, a credit card, electronic money, or a contactless IC card that stores and stores an identification number for specifying a bank account. The handling of cash is executed by the deposit / withdrawal device 221 provided in the base housing 202a, and the handling of the magnetic card is executed by the card reader / writer 252 provided in the card reading groove 212 to handle the non-contact IC card. Is executed via the card reading unit 206.

  A communication interface 261 is also connected to the control unit 253 via the system bus 259. The communication interface 261 is connected to the communication network 41 and realizes data communication between the attendant terminal 501 and the store controller 31 and the self-checkout terminal 101.

  The recognition camera 299 recognizes that the product has come out of the shopping basket, and recognizes the product moving between the shopping basket and the storage bag and the lead wire thereof. Image data captured by the recognition camera 299 is stored in, for example, the RAM 254 and displayed on the touch panel 211 when an error warning is issued.

1-5. Control program
Next, a control program of the self-checkout terminal apparatus 101 according to this example will be described with reference to FIG. The illustrated control program serves as a program module (M1 to M4) that causes a CPU (control unit) 255 to execute a procedure (S0, S11 to S12, S21 to S25) relating to a product registration operation described later.

  As shown in the figure, the self-checkout terminal device 101 according to this example includes at least a recognition unit M1, a product trajectory recognition unit M2, a scan determination unit M3, and an error warning notification unit M4, which are configured as a control program.

  The recognizing unit M1 recognizes the shopping cart placed on the product basket mounting table 102 and the product taken out from the shopping basket from the image taken by the recognition camera 299, and the product trajectory recognizing unit M2 and the scan determining unit. Each M3 is activated.

  The merchandise locus recognizing unit M2 receives the activation from the recognizing unit M1, and recognizes the locus until the merchandise is put into the storage bag from the shopping basket. Details will be described with reference to FIG.

  Upon receiving the activation from the recognition unit M1, the scan determination unit M3 performs a scan determination operation illustrated in FIG. That is, the scan determination unit M3 receives the activation from the recognition unit M1 (step S0), determines whether or not the product has been scanned (step S11), and if the product is scanned by the barcode scanner 203 (Yes) ), For example, a flag of “1” data is set in the RAM 254 as product information registration corresponding to the product (step S12).

  If the flag set in the RAM 254 is not confirmed as the product is scanned by the barcode scanner 203, the error warning notification unit M4 notifies the error warning by causing the light emitting unit 218 to emit light from blue to red, for example. . In addition, when it is determined that the product 440 has not been scanned, the error warning notification unit M4 displays on the touch panel 211 an image of the product that is the target of the error warning acquired and analyzed from the recognition camera 299. .

<2. Product registration (product settlement) operation>
Next, the product registration operation of the self-checkout terminal device 101 according to this example will be described. Here, although it demonstrates along the process sequence flow shown in FIG. 7, the goods registration operation | movement shown in FIG. 7 is performed for every one target goods which read a code symbol.
(Step S0)
First, as shown in FIG. 8, the recognizing unit M1 detects the shopping basket 400 placed on the product basket mounting table 102 and the image from the image taken by the recognition camera 299 in which the entire self-checkout terminal 101 enters the imaging range. When the product 440 taken out from the shopping basket 400 is recognized, the product trajectory recognition unit M2 and the scan determination unit M3 are activated.

(Step S21)
Subsequently, the product trajectory recognition unit M2 receives the activation from the recognition unit M1, acquires and analyzes the image data of the product 440 and the conductor 477 taken from the recognition camera 299, and the product 440 is obtained from the shopping basket 400. It is determined whether or not it has been taken out.

(Step S22)
Subsequently, the merchandise locus recognizing unit M2 determines that the merchandise 440 is taken out from the shopping basket 400 (Yes) at the time of the above step S21 (Yes), the merchandise trajectory recognizing unit M2 obtains the merchandise 440 and the conductor 477 image data taken from the recognition camera 299. It is acquired and analyzed, and it is determined whether or not the product 440 is put in the storage bag 401.

(Step S23)
Subsequently, when it is determined that the product 440 is put in the storage bag 401 (Yes), the scan determination unit M3 determines between the analyzed shopping basket 400 and the conducting wire 477 of the storage bag 401 in step S22. Then, it is determined whether or not the product 440 is scanned by the barcode scanner 203 by reading the barcode. Specifically, according to the flow shown in FIG. 6, it is determined whether, for example, a flag of “1” data is set in the RAM 254 as product information registration corresponding to the product 440.

(Step S24)
Subsequently, in step S23, the error warning notification unit M4 has not scanned the product 440 between the shopping basket 400 and the conductor 477 of the storage bag 401 (in the RAM 254 as product information registration corresponding to the product 440). If the flag is not set) (No), for example, an error warning is notified by causing the light emitting unit 218 to emit light from blue to red.

Therefore, when a product 440 that has not been registered by the barcode scanner 203 moves to the storage bag 401, an error warning can be instantly generated.
In addition, when it is determined that the product 440 has not been scanned (No), the error warning notification unit M4 displays, on the touch panel 211, the image of the product that is the target of the error warning acquired and analyzed from the recognition camera 299. Display. Therefore, even when the product 440 cannot confirm the product registration and gives an error warning, the selection screen, operation screen, operation button, etc. on the keyboard 207 or the touch panel 211 while recognizing the product 440 on the touch panel 211 with an image. By operating the, the product registration can be confirmed, and the customer can be prevented from feeling uncomfortable.

(Step S25)
Subsequently, in step S23, the scan determination unit M3 scans the product 440 between the shopping basket 400 and the conductor 477 of the storage bag 401 (a flag is stored in the RAM 254 as product information registration corresponding to the product 440). Set), if it is determined that the registration settlement of the product has been completed (Yes), the flag in the RAM 254 as the product information registration corresponding to the product 440 is reset (“1” data → “0” data), Prepare for the next product registration.
With the above steps, the product registration operation for one target product 440 according to this example is completed.

  Then, the above steps are performed for all the products in the shopping basket 400 and, for example, a “total button” on the touch panel 211 is operated, for example, settlement for all the products in the shopping basket 400 can be performed. For example, when the number of products in the shopping basket 400 is “15”, the above steps are performed for all “15” products, and finally, for example, the “total button” on the touch panel 211 is operated, Payment can be made for all “15” products.

  In order to register merchandise settlement, it is not always necessary to recognize the trajectory of the merchandise 440 before and after scanning, and it can be simplified. More specifically, it will be described in the second embodiment.

<3. Effect>
According to the self-checkout terminal device, its product registration operation, and its control program according to this embodiment, at least the following effects (1) to (2) can be obtained.

(1) Product registration time can be shortened and customer discomfort can be prevented.
When registering products, the recognition camera 299 is used to recognize and track the products 440 before and after scanning, so that the product registration confirmation can be completed instantly. As a result, the next product can be scanned without waiting for the weight of the scanned product to be settled, so the time to complete the product registration confirmation can be shortened, the occurrence of errors can be avoided, and customer discomfort can be avoided. It can prevent giving.

(2) The product registration confirmation can be performed for the product for which the product registration could not be confirmed because the product is recognized by the image.
Even when the product 440 cannot be registered and an error warning occurs, an image of the product that is the target of the error warning acquired and analyzed from the recognition camera 299 can be displayed on the touch panel 211. Therefore, the product registration can be confirmed by operating the operation buttons and the like on the keyboard 207 and the touch panel 211 while recognizing the displayed product 440 as an image, and it is possible to prevent the customer from feeling uncomfortable.

  Furthermore, not limited to this, other items that have not been scanned, such as wallets, etc., if there are a large number of items and the scanned items cannot be placed, etc. Even if the product cannot be checked, the product registration confirmation can be performed in the same manner.

[Second Embodiment (an example in which image recognition is simpler)]
Next, a self-checkout terminal device according to a second embodiment of the present invention, a configuration example of its control program, and its product registration operation will be described. This example does not track the entire trajectory from when the product is taken out of the shopping basket until it is put into the storage bag, but only by recognizing that the product has been taken out of the shopping basket. This is a simple example. In this description, the description of the same parts as those in the first embodiment is omitted.
<Configuration example (control program)>
First, a configuration example of a control program for a self-checkout terminal apparatus according to the second embodiment of the present invention will be described with reference to FIG.
As shown in the figure, the control program of the self-checkout terminal device 101 according to the present example is different from the first embodiment in that it does not include the product locus recognition unit M2. That is, the control program according to this example includes a recognition unit M1, a scan determination unit M3, and an error warning notification unit M4.

  The recognizing unit M1 recognizes the shopping cart placed on the product basket mounting table 102 and the product taken out from the shopping basket from the image taken by the recognition camera 299, and activates the scan determining unit M3.

  The scan determination unit M3 receives the activation from the recognition unit M1, and performs the scan determination operation shown in FIG.

  If the flag set in the RAM 254 is not confirmed as the product is scanned by the barcode scanner 203, the error warning notification unit M4 notifies the error warning by causing the light emitting unit 218 to emit light from blue to red, for example. . In addition, when it is determined that the product 440 has not been scanned, the error warning notification unit M4 displays on the touch panel 211 an image of the product that is the target of the error warning acquired and analyzed from the recognition camera 299. .

<Product registration (product settlement) operation>
Next, the product registration operation of the self-checkout terminal device 101 according to the second embodiment will be described with reference to FIG. As shown in the figure, the product registration operation according to the present example is different from the first embodiment in that the above step (S23) for determining the trajectory until the product is put in the storage bag is not performed.

(Step S0)
Similarly to the above, first, the recognizing unit M1 recognizes the shopping basket 400 placed on the product basket mounting table 102 from the image taken by the recognition camera 299 in which the entire self-checkout terminal 101 enters the imaging range. The scan determination unit M3 is activated.

(Step S31)
Subsequently, the recognizing unit M1 acquires and analyzes the image data of the product 440 taken from the recognition camera 299, and recognizes that the product 440 has been taken out from the shopping basket 400.

(Step S32)
Subsequently, when the scan determination unit M3 recognizes that the product 440 has been taken out of the shopping basket 400 (Yes) in the above step S31, is the product 440 scanned by the barcode scanner 203? Determine whether or not. Specifically, it is determined whether, for example, a “1” data flag is set in the RAM 254 as product information registration corresponding to the product 440.

(Step S33)
Subsequently, the error warning notification unit M4 determines that the product 440 has not been scanned (the flag is not set in the RAM 254 as product information registration corresponding to the product 440) in the above-described step S32 ( No) For example, an error warning is notified by causing the light emitting unit 218 to emit light from blue to red.

Therefore, when a product 440 that has not been registered by the barcode scanner 203 moves to the storage bag 401, an error warning can be instantly generated.
In addition, when it is determined that the product 440 has not been scanned (No), the error warning notification unit M4 displays, on the touch panel 211, the image of the product that is the target of the error warning acquired and analyzed from the recognition camera 299. Display. Therefore, even if the product 440 is lightweight and the product registration cannot be confirmed and an error warning is issued, the selection screen, the operation screen, the keyboard 207 and the touch panel 211 are recognized while the product 440 on the touch panel 211 is recognized by an image. By operating the operation button or the like, the product registration can be confirmed, and the customer can be prevented from feeling uncomfortable.

(Step S34)
Subsequently, in step S32, the scan determination unit M2 determines that the product 440 is scanned (a flag is set in the RAM 254 as product information registration corresponding to the product 440), and the product registration settlement is completed. If yes (Yes), the flag in the RAM 254 as product information registration corresponding to the product 440 is reset (“1” data → “0” data) to prepare for registration of the next product.
With the above steps, the product registration (product settlement) operation of one target product 440 according to this example is completed.

  Then, the above steps are performed for all the products in the shopping basket 400 and, for example, a “total button” on the touch panel 211 is operated, for example, settlement for all the products in the shopping basket 400 can be performed.

<Effect>
According to the second embodiment, at least the following effects (1) to (2) can be obtained.

  Furthermore, according to the configuration and operation according to this example, instead of tracking the entire trajectory from when the product is taken out of the shopping basket to being put into the storage bag, only that the product has been taken out of the shopping basket. By recognizing, image recognition can be performed more simply. Therefore, it is advantageous in that the time until the completion of product registration confirmation can be further shortened. In addition, since the configuration and operation can be simplified, it can be said that it is advantageous for reducing the manufacturing cost.

  The present invention has been described using the above embodiment, but the present invention is not limited to the above embodiment, and various modifications can be made without departing from the scope of the invention in the implementation stage. . Further, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent elements are deleted from all the constituent elements shown in the above embodiment, at least one of the problems described in the column of the problem to be solved by the invention can be solved, and is described in the column of the effect of the invention. When at least one of the effects is obtained, a configuration in which this configuration requirement is deleted can be extracted as an invention.

DESCRIPTION OF SYMBOLS 101 ... Self-checkout terminal, 299 ... Recognition camera, M1 ... Recognition part, M2 ... Merchandise locus | trajectory recognition part, M3 ... Scan determination part, M4 ... Error warning alerting | reporting part.

JP 2007-73031 A

Claims (6)

A recognition camera that shoots the product,
A recognition unit for recognizing a shopping basket and a product taken out of the shopping basket from an image photographed by the recognition camera;
A scan determination unit that is activated by the recognition unit and determines whether the product has been scanned;
A self-checkout terminal device comprising: a notification unit that notifies an error warning when the scan determination unit determines that the product has not been scanned. The self-assembling unit according to claim 1, further comprising a product trajectory recognizing unit that is activated by the recognizing unit and recognizes a trajectory from when the product is taken out of a shopping basket to being put into a storage bag. Checkout terminal device. When the product is scanned, the scan determination unit sets a flag in the storage unit as product information registration corresponding to the product,
3. The self-checkout terminal device according to claim 1, wherein when the payment registration of the product is completed, the flag in the storage unit is reset. The said notification part displays the image of the said goods used as the object of the error warning acquired from the said recognition camera on a panel, when it determines with the goods not being scanned. The self-checkout terminal device according to any one of the above. The self-checkout terminal device according to any one of claims 1 to 4, wherein the recognition camera is installed so that the entire self-checkout terminal device falls within an imaging range. To a self-checkout terminal device equipped with a recognition camera that images products,
A procedure for recognizing a shopping basket and a product taken out of the shopping basket from an image taken by the recognition camera;
A procedure for determining whether the product has been scanned;
A control program for executing an error warning procedure when it is determined by the determination procedure that the product has not been scanned.

Images