JP2010044479A - Pos terminal equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To detect an inaccurate operation with a simple configuration without increasing a burden on an operator. <P>SOLUTION: POS terminal equipment includes: a camera 37 which images merchandise unregistered in the POS terminal equipment; a camera 38 which images merchandise already registered in the POS terminal equipment; a detection part 110; an arithmetic part 111; and a decision part 112. The detection part 110 detects that the unregistered merchandise has been taken out by an operator on the basis of the image captured by the camera 37, and detects that new merchandise has been added as registered merchandise on the basis of the image captured by the camera 38. The decision part 112 decides whether or not the merchandise has been registered in the POS terminal equipment by the arithmetic part 111 from the time when the unregistered merchandise is taken out by the operator until the time when the new merchandise is added as the registered merchandise according to monitor data 121 and registration status to be transmitted from the arithmetic part 111. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technology of a POS terminal device that integrates the selling price of a product purchased by a customer. More specifically, the present invention relates to a technique for suppressing registration mistakes and reliably registering products in a POS terminal device.

  When a customer pays a purchase price at a cashier counter, a POS terminal device is used in a store to calculate the total price (settlement price) by integrating the selling price of each product purchased by the customer. In order for the POS terminal device to calculate the payment amount, it is necessary to input the selling price of the purchased product for each product. However, in recent POS terminal devices, instead of the store clerk inputting the selling price of each product, each product is registered in the POS terminal device, and the POS terminal device acquires the selling price of the registered product from the product master. It is configured. As an operation performed by an operator for registering a product in the POS terminal device, a technique as described in Patent Document 1 has been proposed, but a barcode attached to the product is used as a scanner. The most common operation is reading.

  However, an operation for causing a scanner to read a barcode is less reliable than, for example, a key operation or the like, and is often not recognized by the POS terminal device as an effective registration operation. Therefore, in the POS terminal device, when it was recognized as a valid registration operation (more accurately, when the barcode was read), a sound (input completion sound) was reproduced from the speaker, and the registration was performed normally. The technology for notifying the operator of the above is adopted. If the input completion sound is not played back even though the operator has performed an operation for registering a certain product, the operator determines that the previously performed operation is incomplete and performs the operation. Try again.

  However, if the POS terminal device detects only “when an accurate operation is performed” and leaves the detection of “when an accurate operation is not performed” to the operator, an operator's judgment error (for example, input) A situation in which the purchased product is not registered in the POS terminal device due to a mistake in hearing the completion sound or the like. If the merchandise is not registered in the POS terminal device, the store cannot receive the price for the merchandise for which registration failed, which is a serious problem. In particular, recently, a POS terminal device (a POS terminal device having a self mode) in which a customer becomes an operator has appeared, and countermeasures against an operation error and a determination error have become important matters.

  Therefore, conventionally, a pair of weighing platforms is provided, and the weight of the product before registration and the weight of the product after registration are respectively weighed and collated, so that "If the exact operation was not performed POS terminal apparatus capable of detecting "" has been proposed. Such a POS terminal device is described in Patent Document 2, for example.

JP 2004-206357 A Japanese Patent No. 3812367

  However, as in the technique described in Patent Document 2, the configuration including the weighing platform has a problem that the apparatus configuration itself becomes large. In addition, there is a problem that accurate detection cannot be performed when a customer places personal items on the weighing table (or hands on the weighing table).

  The present invention has been made in view of the above-described problems, and an accurate operation has not been performed with respect to an operation for registering a product with respect to the POS terminal device without increasing the burden on the operator and with a simple configuration. The purpose is to detect cases.

  In order to solve the above-mentioned problem, the invention of claim 1 is a POS terminal device for accumulating the selling price of products purchased by a customer, and registers the products purchased by the customer according to the registration operation by the operator. Monitoring means for optically monitoring a product, determination means for determining whether a registration operation by an operator has been normally performed on the registration means based on a monitoring result of the monitoring means, Output means for outputting a determination result by the determination means.

  Further, the invention of claim 2 is the POS terminal device according to the invention of claim 1, wherein the monitoring means monitors an operation performed by an operator for registering a product with the registration means. The product is monitored, and the determination unit is configured to register the product when an operation performed to register the product is detected by the monitoring unit and registration is not performed by the registration unit. It is determined that the operation is not normally performed as a registration operation for the product.

  Further, the invention of claim 3 is the POS terminal device according to the invention of claim 1 or 2, further comprising a first storage space in which goods before registration by the registration means are to be stored, and the monitoring The means monitors the product in the first storage space.

  Further, the invention of claim 4 is the POS terminal device according to any one of claims 1 to 3, further comprising a second storage space in which the goods for which registration by the registration means is completed should be stored, The monitoring means monitors the product in the second storage space.

  The invention according to claim 5 is the POS terminal device according to any one of claims 1 to 4, wherein the monitoring means includes an imaging camera for imaging a product, and an image captured by the imaging camera is displayed. The product is monitored based on the above.

  The invention of claim 6 is the POS terminal device according to any one of claims 1 to 5, wherein the monitoring means includes an objective sensor for optically detecting an object, and the object is detected by the objective sensor. The product is monitored based on the detection.

  The invention of claim 7 is the POS terminal device according to the invention of claim 1 or 2, wherein the registration means stores a product before the registration by the registration means and the registration means. A second storage space for storing the product for which registration has been completed, and wherein the monitoring means receives a light from the product stored in the first storage space, and the second storage space. The second light receiving means for receiving the light from the stored product, and the collating means for collating the monitoring result by the first light receiving means with the monitoring result by the second light receiving means.

  The invention of claim 8 is the POS terminal apparatus according to the invention of claim 7, wherein the first light receiving means and the second light receiving means are imaging cameras for imaging a subject.

  The invention according to claim 9 is the POS terminal device according to the invention of claim 7, wherein the first light receiving means and the second light receiving means are color sensors that output a light quantity distribution of received light. Features.

  According to the first to ninth aspects of the present invention, the monitoring means for optically monitoring the product, and whether or not the registration operation by the operator has been normally performed on the registration means based on the monitoring result of the monitoring means. Compared to monitoring products based on the weight of the product, it is possible to detect an abnormality in the registration operation with a simple configuration and without requiring a special operation from the operator. it can.

  In the invention according to claim 2, the operation performed by the operator to monitor the product by registering the product to the registration unit is detected, and the operation performed to register the product by the monitoring unit is detected, In addition, when registration by the registration means is not performed, it is possible to obtain a determination result at an early stage by determining that the operation performed for registering the product is not normally performed as the registration operation for the product. Since it can do, for example, it can determine before goods are thrown into a back basket.

  According to the third aspect of the present invention, it is possible to detect that the product has been taken out for performing the registration operation by monitoring the product in the first storage space.

  According to the fourth aspect of the present invention, it is possible to detect an increase in the number of products that are considered to have been registered by monitoring the products in the second storage space.

  According to the fifth aspect of the present invention, the monitoring means includes an imaging camera that images the product, and monitoring accuracy is improved by monitoring the product based on the image captured by the imaging camera.

  According to the sixth aspect of the present invention, the monitoring means includes an objective sensor that optically detects an object, and the product is monitored based on detection of the object by the objective sensor.

  According to the seventh aspect of the present invention, it is possible to verify the coincidence of the registered product by providing a collating unit that collates the monitoring result by the first light receiving unit and the monitoring result by the second light receiving unit. Therefore, the determination accuracy is improved.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described in detail with reference to the accompanying drawings.

<1. First Embodiment>
FIG. 1 is a perspective view showing a POS terminal device 1 according to the first embodiment. FIG. 2 is a front view of the POS terminal device 1 according to the first embodiment.

  In FIGS. 1 and 2, for convenience of illustration and description, the Z-axis direction is defined as the vertical direction, and the XY plane is defined as the horizontal plane. However, these directions are defined for convenience in order to grasp the positional relationship, and do not limit each direction described below. The same applies to the following drawings.

  As shown in FIGS. 1 and 2, the POS terminal device 1 includes a pedestal portion 2 and a cash register portion 3, which are combined with each other to form an integral structure. Although details will be described later, the POS terminal device 1 according to the present embodiment is configured as a device that integrates the selling prices of products purchased by customers.

  In the following description, the operation mode of the POS terminal device 1 that is set on the assumption that it is operated by a store clerk is referred to as “customer service mode” and is set on the assumption that it is operated by a customer. The operation mode of the apparatus 1 is referred to as “self mode”.

  The pedestal unit 2 includes a housing 20 and a pair of mounting tables 21 and 22. The pedestal unit 2 has a function of supporting the cash register unit 3 with respect to the floor surface in the store, and forms a so-called customer service counter.

  The housing 20 has a plurality of drawers convenient for storing small items such as shopping bags and disposable chopsticks. These drawers can be pulled out from the inside of the housing 20 in the (+ Y) direction as needed. Further, as shown in FIG. 2, the register unit 3 is attached to the upper part of the housing 20.

  On the mounting tables 21 and 22 provided at both ends of the pedestal unit 2 in the X-axis direction, products related to payment are placed. While visiting the store, the customer selects a product to be purchased from the displayed products (products sold) and puts them in the shopping cart. When the selection of the product is completed, the customer places the shopping cart into which the product has been placed on the mounting table 21 (or mounting table 22) of the pedestal unit 2 and pays the purchase price for the product. That is, a product that a customer intends to purchase is usually placed on the mounting table 21 (or the mounting table 22) in a state where it is put in a shopping cart.

  In the present embodiment, the product before being registered in the POS terminal device 1 is placed on the placing table 21, and the product after being registered in the POS terminal device is assumed to be placed on the placing table 22. I do. That is, an example will be described in which the mounting table 21 corresponds to a first storage space in which a product before registration is completed and the mounting table 22 corresponds to a second storage space in which registration is completed. However, it is a matter that should be appropriately determined according to the layout in the store as to which of the mounting tables 21 and 22 the product before being registered is placed.

  The cash register unit 3 includes a storage unit 30, a button group 31, a display 32, a scanner 33, a card reader 34, an electronic money reading unit 35, a printer 36, and cameras 37 and 38.

  In FIG. 1, a coin receiving unit 300 and a bill receiving unit 301 are provided on the (+ Y) side surface of the storing unit 30. The coin receiving unit 300 includes an insertion slot for storing coins received from a customer in the storage unit 30 and a tray for paying out coins as change to the customer. Moreover, the banknote receipt part 301 has the function to pay out the banknote as a change with respect to a customer while accommodating the banknote received from the customer in the inside of the accommodating part 30. FIG.

  Although details are not shown, the button group 31 includes a plurality of keys (operation buttons). The button group 31 in the present embodiment is operated to change the basic settings of the POS terminal device 1 and the like. That is, the button group 31 should be allowed to be operated only by an operator on the store side (a worker or a clerk and not a customer). In the POS terminal device 1 according to the present embodiment, in the customer service mode. The button group 31 is set to be valid, and the button group 31 is set to be invalid in the self mode.

  The display 32 is a touch panel type liquid crystal panel, and not only displays various types of information on the screen according to the control by the control unit 10, but also allows the operator to touch the screen on which a predetermined image is displayed. The information assigned to the image can be input. The information input from the display 32 includes product information (identification code, selling price, etc.) relating to a product that is difficult to attach a bar code to be described later, such as fruits and vegetables.

  The product information acquired by the display 32 is transmitted to the control unit 10, and the product related to the product information (the product indicated by the identification code included in the product information) is registered in the POS terminal device 1. That is, the display 32 can register a product purchased by a customer in accordance with an operation (hereinafter referred to as “touch operation”) of touching a displayed image by an operator.

  The scanner 33 acquires product information by reading an image (barcode) attached to each product. A bar code is printed on each product handled in the store, or a label on which the bar code is printed is attached.

  The product information read from the barcode includes an identification code for individually identifying the product to which the barcode is attached. Therefore, the POS terminal device 1 is configured to be able to search various information (product name, selling price, etc.) related to the product indicated by the identification code using this identification code as a search key. The POS terminal device 1 according to the present embodiment performs a search by referring to a product master (product database) stored in a store controller (not shown) connected via a network, and sells each product. Get information.

  The product information acquired by the scanner 33 is transmitted to the control unit 10 in the same manner as the product information acquired by the display 32, and the product related to the product information is registered in the POS terminal device 1. That is, the scanner 33 can register a product to be purchased by a customer in accordance with an operation (hereinafter, referred to as “scanning operation”) for holding the product over the scanner 33 by the operator.

  The product master may be stored in the POS terminal device 1. In addition, the product information acquired from the barcode attached to the product is not limited to the identification code, and may include information indicating the selling price of the product, a check digit, and the like.

  The card reader 34 reads information from a card (member card, point card, credit card, etc.) brought by the customer. In addition, the electronic money reading unit 35 has a function for realizing electronic payment by withdrawing the price of the product purchased by the customer from the electronic money terminal possessed by the customer. Further, the printer 36 has a function of issuing a receipt by printing a list of purchased products and selling prices and a total amount (integrated amount).

  Each of the cameras 37 and 38 is a general digital camera provided with a light receiving element such as a CCD, and has a function of imaging a subject in an imaging range at a predetermined time interval. Images captured by the cameras 37 and 38 are transmitted to the control unit 10.

  The imaging range of the camera 37 in the state shown in FIGS. 1 and 2 is set so as to include the product placed on the placement table 21 and monitors the product in the first storage space. On the other hand, the imaging range of the camera 38 is set so as to include products placed on the mounting table 22, and monitors the products in the second storage space.

  Although not described in detail, the POS terminal device 1 is configured such that the register unit 3 rotates (rotates about the Z-axis direction) with respect to the pedestal unit 2. The POS terminal device 1 is used in the direction shown in FIGS. 1 and 2 in the customer service mode, but is used in a state where the cash register unit 3 is rotated by 180 ° in the self mode (this allows the display 32 and the like to be Facing the direction). Therefore, in the self mode, the imaging range of the camera 37 is set so as to include the product placed on the placement table 22, and the product in the second storage space is monitored. On the other hand, the imaging range of the camera 38 is set so as to include the product placed on the placing table 21, and the product in the first storage space is monitored. Unless otherwise specified, in the following description, the description will be made assuming that there is an arrangement in the customer service mode (an arrangement shown in FIGS. 1 and 2).

  FIG. 3 is a bus wiring diagram of the POS terminal device 1 according to the first embodiment. As shown in FIG. 3, the control unit 10 mainly operates in accordance with a program 120 to calculate various data, a storage unit 12 that stores various data such as a program 120 and monitoring data 121, and an external unit (not shown). A communication unit 13 that performs data communication with a terminal device (store controller having a product database) or the like via a network is provided.

  FIG. 4 is a diagram illustrating functional blocks of the POS terminal device 1 according to the first embodiment together with a data flow. The detection unit 110, the calculation unit 111, and the determination unit 112 illustrated in FIG. 4 are functional blocks realized by the CPU 11 operating according to the program 120.

  The detection unit 110 detects that a product has been taken out from the mounting table 21 (first storage space) based on the image captured by the camera 37, and also mounts the mounting table 22 (based on the image captured by the camera 38). It is detected that the product is placed in the second storage space. That is, the detection unit 110 compares the images captured by the camera 37 at predetermined time intervals, detects an operation (operation) in which the operator takes out the product from the mounting table 21, and optically selects the product in the first storage space. To monitor. Further, the images taken at predetermined time intervals by the camera 38 are compared to detect an operation (operation) in which the operator places the product on the mounting table 22, and the product in the second storage space is optically monitored. It has a function. In addition, you may comprise so that operation may be detected not only by the difference of the two images imaged by the predetermined time interval but by performing the image recognition process with respect to a difference.

  Further, the detection unit 110 creates (or updates) the monitoring data 121 based on the detection result, and stores the monitoring data 121 in the storage unit 12. The monitoring data 121 according to the present embodiment is “0 (not detected: no operation for taking out the product)” or “1 (detected: product) in the value of the product monitoring result in the first storage space. An operation for taking out the image was performed). Similarly, in the value of the placement flag, the monitoring result of the product in the second storage space is “0 (not detected: no operation for placing the product is not performed)” or “1 (detected: product is The operation to be placed was performed).

  The computing unit 111 creates the settlement data 122 based on the product information transmitted from the display 32 or the scanner 33 to register the product related to the product information in the POS terminal device 1. That is, the display 32, the scanner 33, and the calculation unit 111 mainly correspond to registration means in the present invention.

  More specifically, the calculation unit 111 creates a new record in the settlement data 122 when product information is transmitted from the display 32 or the scanner 33. Then, the merchandise identification code included in the transmitted merchandise information is stored in the created new record, thereby registering the merchandise indicated by the identification code in the POS terminal device 1. Accordingly, the settlement data 122 includes at least a list of products (products to be purchased) registered in the POS terminal device 1.

  Further, when storing the product identification code included in the product information in a new record of the settlement data 122, the calculation unit 111 notifies that the product indicated by the identification code has been registered in the POS terminal device 1. Is transmitted to the determination unit 112.

  Unless the operator of the POS terminal device 1 performs a normal registration operation (operation recognized as normal, specifically, touch operation or scanning operation) on the display 32 or the scanner 33, the display 32 or the scanner 33 The product information is not transmitted to the calculation unit 111, and the product is not registered in the POS terminal device 1. Therefore, product information is transmitted to the calculation unit 111 and a registration notification is transmitted from the calculation unit 111 to the determination unit 112. This indicates that a normal registration operation has been performed on the display 32 or the scanner 33. Show.

  Further, when the product information transmitted from the display 32 or the scanner 33 includes the sale price information of the product, the calculation unit 111 records the sale price information of the product in the settlement data 122 indicated by the identification code of the product. To store. On the other hand, if the product information does not include the selling price information, based on the identification code included in the product information, the selling price information of the product is retrieved from the external store controller via the communication unit 13 and acquired. Then, the acquired selling price information of the product is stored in the record of the adjustment data 122 indicated by the identification code of the product.

  Further, every time new selling price information is stored in the settlement data 122, the calculation unit 111 newly obtains an accumulated amount of the selling price information and updates the settlement data 122. That is, the settlement data 122 includes at least a value (integrated amount) obtained by integrating the selling prices of the products registered in the POS terminal device 1 up to that point.

  In this way, the POS terminal device 1 integrates the selling price of the registered product (product purchased by the customer) by the calculation unit 111. The settlement data 122 created and updated by the calculation unit 111 is displayed on the display 32 as necessary. When the payment is completed, the payment data 122 is transmitted to the printer 36 and a receipt is issued.

  The determination unit 112 determines whether or not the registration operation (touch operation or scan operation) by the operator on the display 32 or the scanner 33 has been normally performed based on the monitoring data 121 and the registration notification transmitted from the calculation unit 111. Determine. The determination result by the determination unit 112 is stored in the storage unit 12 as determination data 123 and is appropriately displayed (output) on the display 32.

  Although details are not shown in FIG. 4, the determination unit 112 updates the value of the registration flag when a registration notification is received from the calculation unit 111. The registration flag indicates that the product has been registered in the POS terminal device 1, either “0 (not detected: registration operation not performed)” or “1 (detection: registration operation performed)”. Shown by value.

  The determination unit 112 has a function of appropriately resetting these values to “0” when the registration flag and the extraction flag and placement flag of the monitoring data 121 are referred to.

  The above is description of the structure and function of the POS terminal device 1 in 1st Embodiment. Although the details are omitted in FIG. 4, the CPU 11 of the POS terminal device 1 switches the operation mode of the POS terminal device 1 between “self mode” and “customer service mode” and sets it as setting data. It has a function. For example, the CPU 11 in the present embodiment enables the operation on the button group 31 while the operation mode is the customer service mode, and disables the operation on the button group 31 while the operation mode is the self mode.

  Next, the operation of the POS terminal device 1 will be briefly described.

  FIG. 5 is a flowchart showing the operation of the POS terminal device 1 according to the first embodiment. Unless otherwise specified, the processing shown in FIG. 5 is executed by the control unit 10 of the POS terminal device 1. In FIG. 5, the process of integrating the selling price of the product is omitted.

  When the process shown in FIG. 5 is started, the POS terminal device 1 is in a standby state after executing predetermined initial settings until the operator instructs the start of payment for one customer (step S1). Note that at the time of this initial setting, the values of the registration flag, the extraction flag, and the placement flag are reset to “0”. In this standby state, processing such as switching between the self mode and the customer service mode is also executed, but the description thereof is omitted.

  A shopping cart (hereinafter referred to as “front basket”) into which a product purchased by a customer has been placed is placed on the placing table 21, and a shopping cart in which a product has not yet been placed on the placing table 22 (hereinafter referred to as “rear basket”). Is prepared (placed), the operator instructs the POS terminal device 1 to start settlement.

  In response to this instruction, the control unit 10 determines Yes in step S <b> 1, and the display 32 and the scanner 33 are ready to accept an operation performed by the operator for registering the product. On the other hand, the registration notification can be transmitted. In addition, imaging by the cameras 37 and 38 is started, and creation and update of the monitoring data 121 by the detection unit 110 is started.

  If it determines with Yes in step S1, the determination part 112 will monitor an extraction flag and a mounting flag (step S2, S3), and it will be in the state which the control part 10 monitors the completion | finish of payment (step S4). This state is referred to as a “registration standby state” in the POS terminal device 1 for convenience of explanation.

  When the determination unit 112 detects that the extraction flag is “1” in the registration standby state, the determination unit 112 determines Yes in step S2. At this time, the determination unit 112 resets the values of the extraction flag, the placement flag, and the registration flag to “0”. However, in the POS terminal device 1 according to the present embodiment, when it is determined Yes in step S2, the value of the placement flag is always “0”, and thus it is not necessary to reset again.

  As described above, when the detection unit 110 determines that a product has been taken out from the first space based on an image of the first space taken by the camera 37, the value of the take-out flag is rewritten to “1”. In other words, if it is determined as Yes in step S2, the product is taken out from the previous basket (a shopping cart in which a product that has not been registered in the POS terminal device 1 among products purchased by the customer) is placed. Means that.

  When it is determined as Yes in step S2, the determination unit 112 enters a state of monitoring the values of the registration flag, the placement flag, and the removal flag (steps S5, S6, and S7), and the control unit 10 monitors the completion of payment (step S8). It becomes. This state is referred to as a “registration confirmation state” in the POS terminal device 1 for convenience of explanation.

  When the value of the registration flag becomes “1” in the registration confirmation state, the determination unit 112 determines Yes in step S5. As described above, the value of the registration flag is “1” when a registration notification is transmitted from the calculation unit 111 to the determination unit 112. That is, after determining Yes in step S2 (when entering the registration confirmation state), the value of the registration flag once reset to “0” is “1”. It means that it is registered in the POS terminal device 1.

  Therefore, when it determines with Yes in step S5, the determination part 112 regards that the goods taken out from the previous basket were normally registered into the POS terminal device 1, and determined that the operation performed in order to register goods was normal. And return to the registration standby state for the next product. At this time, the determination unit 112 returns to the registration standby state without resetting the value of the registration flag to “0” (details will be described later).

  When the value of the placement flag becomes “1” in the registration confirmation state, the determination unit 112 determines Yes in step S6. At this time, the determination unit 112 resets the value of the placement flag to “0”.

  As described above, when the detection unit 110 determines that a product is placed in the second space based on the image of the second space captured by the camera 38, the value of the placement flag is rewritten to “1”. It is done. In other words, the determination of Yes in step S6 means that the product has been put into the back basket (the shopping cart in which the product registered in the POS terminal device 1 among the products purchased by the customer is put in). means.

  In other words, in the registration confirmation state, it is not determined as Yes in Step S5 but determined as Yes in Step S6, which means that the product taken out from the previous basket is put into the rear basket without being registered. Means that Therefore, if it determines with Yes in step S6, the determination part 112 will judge that operation for registering the goods by an operator was improper (it was not normal), and will produce the determination data 123 which shows an error. .

  As a result, the POS terminal device 1 executes a recovery process (step S9). The recovery process is a process for displaying the determination data 123 on the display 32. However, for example, a process for stopping the process related to the settlement and warning the operator may be performed. In this case, the operator instructs the POS terminal device 1 that received the warning to recover, and the POS terminal device 1 whose state has been recovered thereby returns to the registration standby state again.

  In this way, the POS terminal device 1 can detect that the product has been put into the rear car without being registered even though the product has been taken out from the car. Therefore, during that time, it can be detected that the registration operation has not been performed normally.

  In the registration confirmation state, when the value of the extraction flag becomes “1”, the determination unit 112 determines Yes in step S7. At this time, the determination unit 112 resets the value of the extraction flag to “0”.

  When in the registration confirmation state, it is not determined as Yes in Step S5, and it is determined as Yes in Step S7, the product extracted from the previous basket is not registered, and the next product is transferred from the previous basket. It means that it has been taken out. In this case, the whereabouts of the previously extracted product is unknown, but the determination unit 112 according to the present embodiment indicates that the operation for registering the product by the operator is inappropriate (not normal). Determination is made, and determination data 123 indicating an error is created. Then, according to the determination data 123 indicating an error, the POS terminal device 1 executes a recovery process (step S9).

  As described above, the POS terminal device 1 can detect that the next product has been taken out from the previous basket without being registered even though the product has been taken out from the previous basket. Therefore, during that time, it can be detected that the registration operation has not been performed normally. In addition, although the goods taken out previously were thrown into the back basket, without being registered, also when it is not detected by the detection part 110 with the throwing-in action to a back basket, it determines with Yes in step S7. Accordingly, even in such a case, the POS terminal apparatus 1 can detect that the registration operation has not been performed normally.

  Further, in the registration confirmation state, when the payment completion is instructed, the determination unit 112 determines Yes in step S8.

  When in the registration confirmation state, it is determined not to be Yes in step S5 and determined to be Yes in step S8 so that the checkout process is terminated without registering the product taken out from the previous basket. It means that it was instructed. In this case, the whereabouts of the extracted product is unknown, but the determination unit 112 in the present embodiment determines that the operation for registering the product by the operator was inappropriate (not normal). Then, determination data 123 indicating an error is created. Then, according to the determination data 123 indicating an error, the POS terminal device 1 executes a recovery process (step S9).

In this way, the POS terminal device 1 can detect that the product has been instructed to end the checkout process without being registered even though the product has been taken out from the previous basket. Therefore, during that time, it can be detected that the registration operation has not been performed normally.
When the value of the placement flag becomes “1” in the registration standby state, the determination unit 112 determines Yes in step S3. At this time, the determination unit 112 resets the value of the placement flag to “0”, and determines whether the value of the registration flag is “1” at this time (step S10).

  When the value of the placement flag is “1” in the registration standby state, the following two cases are assumed. The first is a case where the product is put into the rear car without the take-out flag in the monitoring data 121 being “1” (it cannot be detected that the product has been taken out from the front car). . The second case is when the product is registered normally in the registration confirmation state (after it is determined Yes in step S5), and then returns to the registration standby state. This is a case where the detecting unit 110 detects that the car is put in the car. As already described, when it is determined Yes in step S5, the determination unit 112 maintains the value of the registration flag as “1”.

  Therefore, in both cases of the former and the latter, if the value of the registration flag is “1” at the time when step S10 is executed, the registration operation has already been performed normally for the product put in the rear basket. It can be considered that it was done. Therefore, if the determination unit 112 determines Yes in step S10, the determination unit 112 resets the value of the registration flag to “0”, determines that the operation performed to register the product is normal, and waits for registration for the next product. Return to state.

  On the other hand, if the value of the registration flag is “0” at the time when step S10 is executed, it means that the former case (extraction operation detection error) is sure and the registration operation has not yet been performed. . Therefore, if the determination part 112 determines with No in step S10, it will determine with the operation performed in order to register goods not being normal, and will produce the determination data 123 which shows an error. Thereby, the POS terminal device 1 executes a recovery process (step S9). As described above, the POS terminal device 1 can determine whether or not the operation for registering the product by the operator has been normally performed even when the operation for taking out the product cannot be detected.

  In the registration waiting state, when the payment completion is instructed, the control unit 10 determines Yes in step S4. In this case, the POS terminal device 1 ends the checkout process for one customer, issues a receipt by the printer 36, and returns to the process of step S1. And it will be in a standby state until the start of the account settlement for the next customer is instructed.

  As described above, in the POS terminal device 1 according to the first embodiment, the registration operation by the operator is normally performed based on the cameras 37 and 38 and the detection unit 110 that optically monitor the product and the monitoring data 121. By providing the determination unit 112 that determines whether or not the product has been received and the display 32 that outputs the determination data 123, a situation in which the product registration operation should be performed is detected, and the product registration operation is performed in that situation as well. By detecting that the product has not been received, it is possible to detect that the operation for registering the product by the operator has not been performed normally. Therefore, it is possible to detect an abnormality in the registration operation with a simple configuration and without requiring a special operation from the operator as compared with the case where the product is monitored based on the weight of the product.

  Further, the apparatus further includes a mounting table 21 (first storage space) in which the product before registration is to be stored, and the product on the mounting table 21 is monitored by the camera 37 so that the product is taken out for performing a registration operation. Can be detected. That is, the situation where the operation for registration should be performed can be accurately detected, and the accuracy is improved.

  In addition, the mounting table 22 (second storage space) that should store the products for which registration has been completed is further provided, and by monitoring the products on the mounting table 22 by the camera 38, the number of products considered to have been registered has increased. Can be detected. That is, the situation where the operation for registration should be performed can be accurately detected, and the accuracy is improved.

  Moreover, the monitoring accuracy improves by providing the cameras 37 and 38 which image goods, and monitoring goods based on the images imaged by the cameras 37 and 38.

  Furthermore, by monitoring the products in the front and rear baskets, for example, when the product is put into the rear basket without performing an operation for causing the scanner 33 to scan a barcode, it is detected as an inappropriate operation. be able to. That is, not only when the operation by the operator is not accurate, but also when the operation itself is forgotten can be detected.

  The POS terminal device 1 according to the present embodiment includes two cameras 37 and 38, and products (shopping carts) in both the first storage space (mounting table 21) and the second storage space (mounting table 22). The product that is put into the product is monitored. However, a configuration provided with only one of these cameras 37 and 38 may be used. For example, it is detected by the camera 37 that a product has been taken out from the shopping cart placed on the placing table 21, and no product has been registered in the POS terminal device 1 within a predetermined time after the product has been taken out. In this case, the registration operation may be determined to be inappropriate. Alternatively, in the case of realizing only with the camera 38, it is detected that the product has been put into the shopping cart placed on the placing table 22, and the product is not registered between the previous launch and the current launch. In this case, the registration operation may be determined to be inappropriate.

  Further, for example, an objective sensor using infrared rays or the like is installed so as to monitor products in the first storage space (mounting table 21) and the second storage space (mounting table 22), and the mounting table 21 (mounting table) is detected by the objective sensor. 22) When a new object (such as an operator's hand) is detected, imaging is performed by the cameras 37 and 38, and it is determined whether the product has been taken out by image recognition on the captured image (the product has been inserted). You may comprise. That is, a configuration for determining the imaging timing (shutter chance) of the cameras 37 and 38 may be provided separately. With this configuration, the number of times of imaging by the cameras 37 and 38 and image data comparison processing (calculation processing of the detection unit 110) can be suppressed, and efficient determination becomes possible.

<2. Second Embodiment>
In the POS terminal device 1 according to the first embodiment, an operation for registering a product in the POS terminal device 1 is detected by detecting an operation in which the product is taken out from the front basket and an operation in which the product is put into the rear basket. It was configured to detect the situation to be done. And in that situation, it was constituted so that it might be judged whether registration operation was performed normally by detecting that registration of goods was not performed. However, it is also possible to determine whether or not the registration operation has been performed normally by monitoring the operation itself performed by the operator to register the product.

  FIG. 6 is a perspective view showing a POS terminal device 1a according to the second embodiment.

  The POS terminal device 1a according to the second embodiment is different from the POS terminal device 1 according to the first embodiment in that objective sensors 39 and 40 are provided instead of the cameras 37 and 38. In the POS terminal device 1a according to the second embodiment, the same reference numerals are given to configurations having the same functions as those of the POS terminal device 1 according to the first embodiment, and description thereof will be omitted as appropriate.

  The objective sensors 39 and 40 are respectively disposed in the vicinity of both sides of the scanner 33 in the X-axis direction, and irradiate infrared rays or the like in the (+ Y) direction and receive the reflected light, thereby controlling the received light amount. It has a function to output to.

  FIG. 7 is a diagram illustrating functional blocks of the POS terminal device 1a according to the second embodiment together with a data flow. The POS terminal device 1a includes a detection unit 110a and a determination unit 112a.

  The detection unit 110a detects the presence of an object in the (+ Y) direction (forward) of each objective sensor 39, 40 based on outputs from the objective sensors 39, 40 (indicating the amount of light received). More specifically, the detection unit 110a in the second embodiment detects an operation that causes the scanner 33 to read the barcode of the product (operation performed by the operator to register the product), and the detection result Is created (or updated).

  As shown in FIG. 6, the objective sensor 39 is disposed on the (+ X) side (mounting table 21 side) with respect to the scanner 33. On the other hand, the objective sensor 40 is disposed on the (−X) side (mounting table 22 side) with respect to the scanner 33. In the present embodiment, when a series of operations when the operator registers the product, the product in the front basket (the product placed on the mounting table 21) is taken out and held toward the scanner 33 to perform barcode processing. Is read, and then the product is put into the rear basket (mounted on the mounting table 22).

  Accordingly, when the detection unit 110a detects an object with the objective sensor 40 disposed on the mounting table 22 side after detecting the object with the objective sensor 39 disposed on the mounting table 21 side with respect to the scanner 33, Then, it is determined that the operation performed for registering the product by the operator is performed, and the monitoring data 121a is created. More specifically, the value of the operation detection flag in the monitoring data 121a is rewritten to “1”.

  As described above, the POS terminal device 1a according to the second embodiment includes the two objective sensors 39 and 40, and each objective sensor is disposed in the vicinity of both sides in the X-axis direction of the scanner 33. It is possible to detect an operation performed for registering a product by an operator more accurately than in the case where the product is configured. For example, the operator's arm (detected as an object) moves from the mounting table 22 side to the mounting table 21 side in order to take out the next product after putting the product into the rear basket. Even if the + Y) direction is crossed, the detection unit 110a does not erroneously detect this.

  Note that the operator stands in the (+ Y) direction of the scanner 33 during the settlement process. Therefore, in order not to erroneously detect other movements of the operator, it is preferable that the detection ranges of the objective sensors 39 and 40 are set to be relatively short (for example, around the upper portion of the storage unit 30).

  The determination unit 112a monitors the value of the operation detection flag in the monitoring data 121a while the checkout process for one customer is being performed. Then, when the value of the operation detection flag becomes “1”, the value of the operation detection flag is reset to “0” and it is confirmed whether the value of the registration flag is “1”. If the value of the registration flag is not “1” when the value of the registration flag is confirmed, the product has not been registered even though an operation to be performed for registering the product has been performed (registration It is determined that the operation has not been performed normally, and determination data 123 indicating an error is created.

  As described above, the POS terminal device 1a according to the second embodiment monitors the product by monitoring the operations performed by the operator for registering the product with the objective sensors 39 and 40 and the detection unit 110a. The determination unit 112a according to the second embodiment performs an operation performed to register the product when an operation performed by the operator to register the product is detected and the registration is not performed. Can be obtained as the registration operation for the product, the same effect as the POS terminal device 1 in the first embodiment can be obtained.

  Further, in the POS terminal device 1a, it is detected that the registration operation is inappropriate before the product is put into the rear basket (in the flow of processing for one product, the first implementation is performed). The determination data 123 can be obtained at a timing earlier than the form), so that the burden on the operator is reduced compared with the case where the product for which registration failed is taken out from the rear basket and the registration operation must be performed again. .

  In the POS terminal device 1a according to the second embodiment, the objective sensors 39 and 40 have been described as an example of a configuration for optically monitoring products. However, as a configuration for detecting whether or not an operation for causing the scanner 33 to read the barcode of the product is performed, a configuration for detecting the operation by image recognition using a camera that captures the operation may be employed.

<3. Third Embodiment>
The POS terminal device 1 according to the first embodiment performs an operation for taking out a product from the front basket and an operation for putting the product into the rear basket based on images captured by the camera 37 and the camera 38, respectively. It explained that it detected independently. However, it is possible to further improve the detection accuracy by collating the product monitoring status in the first storage space with the product monitoring status in the second storage space.

  FIG. 8 is a front view of the POS terminal device 1b according to the third embodiment. The POS terminal device 1b in the third embodiment is different from the POS terminal device 1 in the first embodiment in that cameras 37a and 38a are provided instead of the cameras 37 and 38. Note that in the POS terminal device 1b according to the third embodiment, the same reference numerals are given to configurations having the same functions as those of the POS terminal device 1 according to the first embodiment, and description thereof will be omitted as appropriate.

  The cameras 37 a and 38 b are both fixed to the POS terminal device 1 b via a stand (not shown), take images at predetermined time intervals, and transmit the images to the control unit 10.

  The camera 37a is disposed above the mounting table 21 that is the first storage space, and has an imaging range on the mounting table 21 that is below. That is, the camera 37a is arranged so as to pick up an image of the tip cage placed on the placement table 21 from above.

  The camera 38a is disposed above the mounting table 22 that is the second storage space, and has an imaging range on the mounting table 22 that is below. That is, the camera 38a is arranged so as to take an image of the basket from above after being placed on the placing table 22.

  FIG. 9 is a diagram illustrating functional blocks of the POS terminal device 1b according to the third embodiment together with a data flow. As shown in FIG. 9, the POS terminal device 1b includes a detection unit 110b, a determination unit 112b, and a collation unit 113 as functional blocks.

  The detection unit 110b creates monitoring data 121 based on the same procedure as the detection unit 110 in the first embodiment, based on images captured by the cameras 37a and 38a.

  The detection unit 110b has a function of creating the first image data 124 indicating the product taken out from the front basket, and a function of creating the second image data 125 indicating the product put into the rear basket. Yes.

  As described above, the detection unit 110b compares two images captured by the camera 37a (images captured at a predetermined time interval), and a product is extracted from the previous basket based on the difference image. Detect that. When it is determined that the product has been taken out, the latter of the two images taken by the camera 37a should have taken an image of the product being taken out from the front basket by the operator's hand. Therefore, when it is determined that the product has been taken out from the front basket, the detection unit 110b extracts the image of the product possessed by the object recognized as the hand of the operator from the latter image, and the first image data 124 To do. That is, the first image data 124 indicates the monitoring result of the product by the camera 37a.

  Similarly, when it is determined that the product has been put into the rear car, the detection unit 110b detects an image of the product possessed by the object recognized as the operator's hand, out of the two images captured by the camera 38a. The second image data 125 is extracted from the latter image. That is, the second image data 125 indicates the monitoring result of the product by the camera 38a.

  The collation unit 113 compares the first image data 124 and the second image data 125 in accordance with a request from the determination unit 112b, and captures the product captured in the first image data 124 and the second image data 125. Check against the product that has been added. Then, the collation result is transmitted to the determination unit 112b as a collation flag value. In the present embodiment, when the value of the collation flag is “0”, it means that the collation result is inconsistent, and when the value of the collation flag is “1”, it means that the collation result is coincident. And

  The determination unit 112b requests the value of the verification flag from the verification unit 113 at a predetermined timing (for example, the timing determined as Yes in step S10 illustrated in FIG. 5). If the value of the collation flag is “0” at that time, determination data 123 indicating an error is created.

  As described above, the collation unit 113 verifies the matching between the product taken out from the front basket and the product put into the back basket by collating the images, so that the determination accuracy of the determination unit 112b of the POS terminal device 1b is determined. Will improve. That is, it can be detected as an abnormality in the registration operation that a product different from the product taken out from the previous basket has been put into the rear basket.

  It should be noted that completely specifying each product based on the captured image is problematic in terms of the resolution of the cameras 37a and 38a, the load on the CPU 11, and the like. However, in the POS terminal device 1b, the product is not registered based on an image obtained by capturing the product, so that it is not necessary to have an accuracy enough to completely identify each product. For example, there is no need to accurately distinguish between summer oranges and grapefruits, and when a yellow round product is taken out of the front basket, the yellow round product is also put into the rear basket. If the property can be confirmed, a sufficient effect can be obtained. Therefore, for example, a color sensor with a simple configuration can be used instead of the cameras 37a and 38a.

  As described above, the POS terminal device 1b according to the third embodiment can obtain the same effects as the POS terminal device 1 according to the first embodiment.

  In addition, by providing the collation unit 113 that collates the monitoring result by the camera 37a with the monitoring result by the camera 38a, it is possible to verify the consistency of the registered product. Therefore, the determination accuracy is improved as compared with the case of simply determining whether or not registration has been performed.

  The collation unit 113 refers to the settlement data 122, identifies the actually registered product, acquires the appearance characteristics (color and shape) of the product from the product master, and obtains the first image data 124. Or you may make it compare with the characteristic of the goods currently imaged by the 2nd image data 125. FIG. In this way, by increasing the number of comparison objects, the accuracy of matching can be improved. For example, when only one of an operation for taking out a product or an operation for putting in a product can be detected (the first image data 124 or the first The product characteristics can also be collated even when only one of the two image data 125 is created.

  Further, the POS terminal device 1b according to the third embodiment may be provided with a configuration corresponding to the objective sensors 39 and 40 of the POS terminal device 1a according to the second embodiment so as to perform so-called multiple detection. As a result, further improvement in accuracy can be expected.

<4. Modification>
Although the embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and various modifications can be made.

  For example, although the functional blocks shown in the above embodiments have been described as being realized by the CPU 11 operating according to the program 120, some or all of those functions are realized by a dedicated logic circuit (hardware). You may comprise as follows.

  Moreover, each process (step) shown to the said embodiment is an illustration to the last, Comprising: For example, it is not limited to the content and order shown in FIG. In particular, since how much detection is performed is in a trade-off relationship with an increase in misinformation, the determination criteria, procedures, and the like may be changed according to the limit required for the POS terminal device.

It is a perspective view which shows the POS terminal device in 1st Embodiment. It is a front view of the POS terminal device in a 1st embodiment. It is a bus wiring diagram of the POS terminal device in a 1st embodiment. It is a figure which shows the functional block of the POS terminal device in 1st Embodiment with the flow of data. It is a flowchart which shows operation | movement of the POS terminal device in 1st Embodiment. It is a perspective view which shows the POS terminal device in 2nd Embodiment. It is a figure which shows the functional block of the POS terminal device in 2nd Embodiment with the flow of data. It is a front view of the POS terminal device in 3rd Embodiment. It is a figure which shows the functional block of the POS terminal device in 3rd Embodiment with the flow of data.

Explanation of symbols

1, 1a, 1b POS terminal device 10 Control unit 11 CPU
110, 110a, 110b detection unit 111 operation unit 112, 112a, 112b determination unit 113 collation unit 12 storage unit 120 program 121, 121a monitoring data 122 settlement data 123 determination data 124 first image data 125 second image data 13 communication unit 21 , 22 Mounting table 31 Button group 32 Display 33 Scanner 34 Card reader 35 Electronic money reader 36 Printer 37, 37a, 38, 38a Camera 39, 40 Objective sensor

Claims (9)

A POS terminal device that accumulates the selling price of a product purchased by a customer,
A registration means for registering a product to be purchased by a customer according to a registration operation by an operator;
Monitoring means for optically monitoring the product;
A determination unit that determines whether a registration operation by an operator has been normally performed on the registration unit based on a monitoring result of the monitoring unit;
An output means for outputting a determination result by the determination means;
A POS terminal device comprising: The POS terminal device according to claim 1,
The monitoring unit monitors the product by monitoring an operation performed by an operator to register the product with the registration unit;
The determination means detects an operation performed for registering the product when the operation performed for registering the product is detected by the monitoring means, and registration is not performed by the registration means. It is determined that the registration operation has not been normally performed. The POS terminal device according to claim 1 or 2,
A first storage space for storing the product before registration by the registration unit is completed;
The POS terminal device characterized in that the monitoring means monitors products in the first storage space. The POS terminal device according to any one of claims 1 to 3,
A second storage space for storing products for which registration by the registration means has been completed;
The POS terminal device characterized in that the monitoring means monitors products in the second storage space. The POS terminal device according to any one of claims 1 to 4,
The monitoring means includes an imaging camera for imaging products,
A POS terminal device that monitors products based on an image captured by the imaging camera. The POS terminal device according to any one of claims 1 to 5,
The monitoring means includes an objective sensor for optically detecting an object,
A POS terminal device that monitors a product based on detection of an object by the objective sensor. The POS terminal device according to claim 1 or 2,
A first storage space for storing products before registration by the registration means is completed;
A second storage space for storing products for which registration by the registration means is completed;
Further comprising
The monitoring means includes
First light receiving means for receiving light from the product stored in the first storage space;
Second light receiving means for receiving light from the product stored in the second storage space;
Collating means for collating the monitoring result by the first light receiving means with the monitoring result by the second light receiving means;
A POS terminal device comprising: The POS terminal device according to claim 7,
The POS terminal device, wherein the first light receiving means and the second light receiving means are imaging cameras for imaging a subject. The POS terminal device according to claim 7,
The POS terminal device, wherein the first light receiving means and the second light receiving means are color sensors that output a light amount distribution of received light.

Images