JP2015125479A - Product sales data processing device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a product sales data processing device and program that allow for conservation of an amount of power consumption when compared with a usual startup situation in a state where an operator is away.SOLUTION: A product sales data processing device comprises: sales registration means for performing a sales registration of a product using information identifying the product output by a product read device; a display device that displays information pertain to at least the sales registration for an operator; a sensor that is provided at a fixed distance or more apart from the product read device and, when detecting existence of the operator within the fixed distance with respect to a direction facing a display surface of the display device, outputs a detection signal; and display control means for, when the detection signal is input from the sensor, turning on the display device, and when the detection signal is not input from the sensor, turning off the display device.

Description

  Embodiments described herein relate generally to a merchandise sales data processing apparatus and a program.

  2. Description of the Related Art Conventionally, in a POS (Point Of Sales) terminal or the like that performs sales registration of a product using information (code information, information recognized by a general object, etc.) specifying a product output by a product reading device, a display device for an operator And display devices for customers.

  By the way, according to the conventional POS terminal, when the power is on, the operator display device and the customer display device are always driven regardless of the operation / non-operation by the operator. ing.

  Further, according to the conventional POS terminal, when shifting from the operating state to the hibernation state, it is necessary to change to the hibernation mode by an operator's key operation or the like, which is troublesome for the operator. Therefore, there is a situation where the operator temporarily leaves the POS terminal without performing a troublesome operation for changing to the sleep mode. As described above, when the operator temporarily leaves the POS terminal without changing to the sleep mode, there is a problem that an unauthorized operation of the POS terminal by the customer can be easily performed.

  The problem to be solved by the present invention is to provide a merchandise sales data processing apparatus and program capable of saving power consumption in a state where the operator is away from the normal startup state.

  The product sales data processing apparatus according to the embodiment displays sales registration means for registering sales of the product using information specifying the product output from the product reading device, and at least information related to the sales registration is displayed to the operator. A detection signal is output when it is detected that an operator is present within a certain distance with respect to a direction facing the display surface of the display device, which is provided at a certain distance or more from the display device and the product reading device. And a display control unit that turns on the display device when a detection signal is input from the sensor and turns off the display device when the detection signal is not input from the sensor.

FIG. 1 is a perspective view illustrating an example of a checkout system according to the embodiment. FIG. 2 is an enlarged perspective view showing a part of the POS terminal. FIG. 3 is a block diagram illustrating a hardware configuration of the POS terminal and the commodity reading apparatus. FIG. 4 is a conceptual diagram illustrating the data structure of a PLU file. FIG. 5 is a block diagram illustrating functional configurations of the POS terminal and the commodity reading apparatus. FIG. 6 is a conceptual diagram illustrating an example of commodity detection. FIG. 7 is a flowchart illustrating an example of the operation of the commodity reading apparatus. FIG. 8 is a flowchart showing a procedure of sales registration processing executed by the POS terminal.

  Embodiments of a product sales data processing device and a program will be described in detail below with reference to the accompanying drawings. In addition, embodiment described below is one Embodiment of a merchandise sales data processing apparatus and a program, Comprising: The structure, specification, etc. are not limited. This embodiment is an example of application to a POS terminal that registers and settles a product related to one transaction, which is introduced into a store such as a supermarket as a product sales data processing device.

  FIG. 1 is a perspective view illustrating an example of a checkout system 1 according to the embodiment. As shown in FIG. 1, a checkout system 1 includes a product reading device 101 that reads information about a product, and a POS (Point Of Sales) terminal 11 that is a product sales data processing device that performs registration and settlement of products related to one transaction. With.

  The POS terminal 11 is placed on the upper surface of the drawer 21 on the checkout table 41. The drawer 21 is controlled by the POS terminal 11 for the opening operation. On the upper surface of the POS terminal 11, a keyboard 22 that is pressed down by an operator (a store clerk) is arranged. A display device 23 that displays information toward the operator is provided behind the keyboard 22 when viewed from the operator who operates the keyboard 22. The display device 23 displays information on the display surface 23a. A touch panel 26 is laminated on the display surface 23a. A customer display device 24 is erected so as to be rotatable further back than the display device 23. The customer display device 24 displays information on the display surface 24a. The customer display device 24 shown in FIG. 1 has the display surface 24a facing the front side in FIG. 1, but the customer display device 24 is rotated so that the display surface 24a faces the back side in FIG. Thus, the customer display device 24 displays information to the customer.

  Here, FIG. 2 is an enlarged perspective view showing a part of the POS terminal 11. As shown in FIG. 2, the POS terminal 11 includes a sensor 27 for detecting the location of the operator below the display device 23. The sensor 27 is a direct reflection type infrared sensor that has high directivity and can detect stillness. The detection distance of the sensor 27 of the present embodiment is defined within, for example, 80 cm with respect to the direction facing the display surface 23a of the display device 23.

  That is, when the operator operates the POS terminal 11 (for example, when operating the keyboard 22 or the display device 23), the sensor 27 can detect the location of the operator. Further, when the operator is separated by 80 cm or more in the direction facing the display surface 23a of the display device 23, the sensor 27 cannot detect the location of the operator.

  A horizontally long table-shaped counter table 151 is arranged so as to form an L shape with the checkout table 41 on which the POS terminal 11 is placed. A cargo receiving surface 152 is formed on the upper surface of the counter table 151. A shopping basket 153 for storing the product G is placed on the cargo receiving surface 152. The shopping basket 153 may be divided into a first shopping basket 153a brought in by a customer and a second shopping basket 153b placed at a position sandwiching the commodity reading device 101 from the first shopping basket 153a. it can. The shopping basket 153 is not limited to a so-called basket shape, and may be a tray or the like. The shopping basket 153 (second shopping basket 153b) is not limited to a so-called basket shape, and may be a box shape, a bag shape, or the like.

  On the receiving surface 152 of the counter table 151, the commodity reading apparatus 101 connected to the POS terminal 11 so as to be able to transmit and receive data is installed. The commodity reading apparatus 101 includes a thin rectangular housing 102. A reading window 103 is disposed in front of the housing 102. A display / operation unit 104 is attached to the upper portion of the housing 102. The display / operation unit 104 is provided with a display device 106 on which a touch panel 105 is laminated. A keyboard 107 is disposed on the right side of the display device 106. A card reading groove 108 of a card reader (not shown) is provided on the right side of the keyboard 107. A customer display device 109 for providing information to the customer is installed on the back left side of the display / operation unit 104 as viewed from the operator.

  Such a product reading apparatus 101 includes a product reading unit 110 (see FIG. 3). The product reading unit 110 has an imaging unit 164 (see FIG. 3) disposed on the back side of the reading window 103.

  In the first shopping basket 153a brought in by the customer, a product G related to one transaction is stored. The commodity G in the first shopping basket 153a is moved to the second shopping basket 153b by an operator who operates the commodity reading apparatus 101. In this movement process, the product G is directed to the reading window 103 of the product reading apparatus 101. At this time, the imaging unit 164 (see FIG. 3) arranged in the reading window 103 images the product G.

  In the commodity reading apparatus 101, referring to the PLU file F1 (see FIG. 4), the commodity G included in the image captured by the image capturing unit 164 is displayed as a barcode or QR code (registered trademark) attached to the commodity G. It is specified by reading code information or general object recognition (details will be described later). Next, the product reading apparatus 101 displays a screen for accepting confirmation of the identified product G, input of the number, etc., on the display / operation unit 104, and the product ID of the product G for which confirmation input has been accepted, Such information is notified to the POS terminal 11. In the POS terminal 11, based on information such as the product ID and the number notified from the product reading device 101, information related to sales registration such as product classification, product name, and unit price of the product corresponding to the product ID is stored in the sales master file ( (Not shown) and the like to record sales.

  Here, the commodity reading apparatus 101 is installed at a position away from the sensor 27 provided below the display device 23 of the POS terminal 11 in a direction facing the display surface 23a of the display device 23 by, for example, 80 cm or more. By installing the product reading device 101 at such a position, when the operator is operating the product reading device 101, when the operator moves 80 cm or more in the direction facing the display surface 23 a of the display device 23. Therefore, the sensor 27 does not detect the location of the operator.

  FIG. 3 is a block diagram illustrating a hardware configuration of the POS terminal 11 and the commodity reading apparatus 101. The POS terminal 11 includes a microcomputer 60 as an information processing unit that executes information processing. The microcomputer 60 is configured by connecting a ROM (Read Only Memory) 62 and a RAM (Random Access Memory) 63 to a CPU (Central Processing Unit) 61 that executes various arithmetic processes and controls each unit.

  The drawer 61, the keyboard 22, the display device 23, the touch panel 26, the customer display device 24, and the sensor 27 are all connected to the CPU 61 of the POS terminal 11 through various input / output circuits (not shown). Has been. These are controlled by the CPU 61.

  The keyboard 22 includes a numeric key 22d, a temporary fastening key 22e, and a fastening key 22f on which numbers such as “1”, “2”, “3”,...

  An HDD 64 (Hard Disk Drive) is connected to the CPU 61 of the POS terminal 11. The HDD 64 stores programs and various files. All or a part of the programs and various files stored in the HDD 64 are copied to the RAM 63 and executed by the CPU 61 when the POS terminal 11 is activated. An example of a program stored in the HDD 64 is a product sales data processing program PR. An example of a file stored in the HDD 64 is a PLU file F1 distributed and stored from the store computer SC.

  The program PR for operating the CPU 61 of the POS terminal 11 is a file in an installable or executable format and is a computer such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk). It is recorded on a readable recording medium and provided.

  The program PR for operating the CPU 61 of the POS terminal 11 may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. The program PR for operating the CPU 61 of the POS terminal 11 may be provided or distributed via a network such as the Internet.

  The PLU file F1 is a product file in which an association between information related to sales registration of the product G and an image of the product G is set for each product G to be displayed and sold in the store.

  FIG. 4 is a conceptual diagram illustrating the data configuration of the PLU file F1. As shown in FIG. 4, for each product G, the PLU file F1 includes a product ID uniquely assigned to each product G, product information to which the product G belongs, product information such as product name, unit price, and product image obtained by capturing the product. (Reference image) is a file that stores product information of the product G. The product image is a captured image (photograph) of the product used for determining the similarity. The PLU file F1 is configured to be readable by the commodity reading apparatus 101 via a connection interface 65 described later.

  Note that the data configuration of the PLU file F1 is not limited to the example of FIG. 4, and for example, feature quantities such as color shades and surface irregularities read from a product image may be stored for each product.

  Returning to FIG. 3, a communication interface 25 for executing data communication with the store computer SC is connected to the CPU 61 of the POS terminal 11 via an input / output circuit (not shown). The store computer SC is installed in a store backyard or the like. A PLU file F1 distributed to the POS terminal 11 is stored in the HDD (not shown) of the store computer SC.

  Further, the CPU 61 of the POS terminal 11 is connected to a connection interface 65 that enables data transmission / reception with the commodity reading apparatus 101. The product reading apparatus 101 is connected to the connection interface 65. The CPU 61 of the POS terminal 11 is connected to a printer 66 that prints on receipts. The POS terminal 11 prints the transaction content of one transaction on the receipt under the control of the CPU 61.

  The commodity reading apparatus 101 also includes a microcomputer 160. The microcomputer 160 is configured by connecting a ROM 162 and a RAM 163 to a CPU 161 via a bus. The ROM 162 stores a program executed by the CPU 161. The CPU 161 is connected with an imaging unit 164, an audio output unit 165, and a time measuring unit 166 via various input / output circuits (none of which are shown). The operations of the imaging unit 164 and the audio output unit 165 are controlled by the CPU 161. The display / operation unit 104 is connected to the product reading unit 110 and the POS terminal 11 via the connection interface 176. The operation of the display / operation unit 104 is controlled by the CPU 161 of the product reading unit 110 and the CPU 61 of the POS terminal 11.

  The imaging unit 164 is a color image sensor such as a CCD (Charged Coupled Device) imaging device or a CMOS (Complementary Metal Oxide Semiconductor) imaging device, and is an imaging unit that performs imaging from the reading window 103 in color under the control of the CPU 161. is there. For example, the imaging unit 164 captures a 30 fps moving image. Frame images (captured images) sequentially captured at a predetermined frame rate by the imaging unit 164 are stored in the RAM 163.

  The audio output unit 165 is an audio circuit and a speaker for generating a preset warning sound or the like. The audio output unit 165 performs warning sound or audio notification under the control of the CPU 161. The clock unit 166 is an RTC (Real Time Clock) or the like, and clocks time under the control of the CPU 161.

  Furthermore, a connection interface 175 that connects to the connection interface 65 of the POS terminal 11 and enables data transmission / reception with the POS terminal 11 is connected to the CPU 161. In addition, the CPU 161 transmits and receives data to and from the display / operation unit 104 via the connection interface 175.

  Next, the functional configuration of the CPU 161 and the CPU 61 realized by the CPU 161 and the CPU 61 executing the program will be described with reference to FIG.

  FIG. 5 is a block diagram illustrating functional configurations of the POS terminal 11 and the commodity reading apparatus 101. As illustrated in FIG. 5, the CPU 161 of the product reading apparatus 101 executes a program stored in the ROM 162, thereby causing an image capturing unit 51, a product detection unit 52, a code reading unit 53, an object recognition unit 54, and a mode switching unit. 55, functions as an input reception unit 56 and an information output unit 57.

  Similarly, the CPU 61 of the POS terminal 11 has functions as a sales registration unit 611 and a display control unit 612 by executing the program PR.

  The image capturing unit 51 outputs an imaging on signal to the imaging unit 164 and causes the imaging unit 164 to start an imaging operation. The image capturing unit 51 sequentially captures color frame images captured by the image capturing unit 164 and stored in the RAM 163 after the start of the image capturing operation. The capturing of the frame image by the image capturing unit 51 is performed in the order stored in the RAM 163.

  The product detection unit 52 detects all or part of the product G included in the frame image captured by the image capture unit 51 using a pattern matching technique or the like. Specifically, an outline or the like is extracted from an image obtained by binarizing the captured frame image. Next, the contour line extracted from the latest frame image is compared with the contour line extracted from the current frame image, and the part that has changed, that is, the product directed to the reading window 103 for sales registration G reflection is detected. As another method for detecting the product G, the presence or absence of a skin color region is detected from the captured frame image. Next, when the skin color area is detected, that is, when the reflection of the clerk's hand is detected, the product G that is assumed to be gripped by the clerk's hand by detecting the above-described contour line. Attempt to extract contours. At this time, when the contour indicating the shape of the hand and the other contours are detected, since the store clerk's hand holds the product G, the reflection of the product G is detected.

  FIG. 6 is a conceptual diagram illustrating an example of detection of the product G. As shown in FIG. 6, the image capturing unit 51 compares the latest frame images G10 and G20 with each other, the frame image G10 in which nothing is captured from the difference in luminance gradation, and the product G or the clerk's hand H. The frame image G20 having a reflection of some object such as is identified. Next, the image capturing unit 51 detects the product G by performing image processing such as the above-described extraction of the contour line and detection of the skin color region on the frame image G <b> 20 in which the reflection of some object is identified.

  The code reading unit 53 is based on the frame image captured by the image capturing unit 51, and includes a barcode or a two-dimensional code (for example, QR code (registered trademark)) attached to the product G captured by the imaging unit 164. ) And the like are decoded and read. Based on the read code information, the product G captured by referring to the PLU file F1 is specified. Specifically, the code reading unit 53 reads a frame image stored in the RAM 163 and detects a barcode by a pattern matching technique or a two-dimensional code from a predetermined finder pattern. Next, the code reading unit 53 reads product information of the product G such as a product code (product ID) from the detected barcode or two-dimensional code. Next, the code reading unit 53 specifies the product G corresponding to the product information (for example, product code) read with reference to the PLU file F1.

  Based on the frame image captured by the image capturing unit 51, the object recognition unit 54 reads the surface state such as the hue of the product G captured by the image capturing unit 164 and the surface roughness as a feature amount. Based on the read feature amount, the product G captured by referring to the PLU file F1 is specified. Specifically, the object recognition unit 54 reads the frame image stored in the RAM 163 and detects all or part of the product G using a pattern matching technique or the like. For example, an outline or the like is extracted from an image obtained by binarizing the captured frame image. Next, the contour line extracted from the previous frame image is compared with the contour line extracted from the current frame image, and the product G directed to the reading window 103 for sales registration is detected.

  As another method for detecting a product, the presence or absence of a skin color region is detected from a captured frame image. Next, when a skin color area is detected, that is, when a clerk's hand is detected, it is assumed that the clerk's hand is grasped by detecting the above-described contour line in the vicinity of the skin color area. Try to extract the outline of the product. At this time, when the contour indicating the shape of the hand and the contour of the other object are detected in the vicinity of the contour of the hand, the product is detected from the contour of the object.

  Next, the object recognizing unit 54 reads the surface state such as the hue of the product G and the surface unevenness from the whole or a part of the product G imaged by the imaging unit 164 as a feature amount. Note that the object recognition unit 54 does not consider the outline or size of the product G in order to shorten the processing time.

  In addition, the object recognition unit 54 reads the surface state such as the color of the registered product and the surface unevenness from the image of each product registered in the PLU file F1 (hereinafter referred to as registered product) as a feature amount. The degree of similarity between the product G and the product registered in the PLU file F1 is calculated by comparing with the feature amount of G. Here, the similarity is the degree of similarity of all or part of the product G when the image of each product stored in the PLU file F1 is 100% = “similarity: 1.0”. It indicates whether or not Note that, for example, the similarity may be calculated by changing the weight between the color tone and the surface roughness. Next, the object recognizing unit 54 identifies the product with the highest calculated similarity as the captured product G among the products in the PLU file F1.

Such object recognition for recognizing an object included in an image is called generic object recognition. Regarding such general object recognition, various recognition techniques are described in the following documents.
Keiji Yanai, “Current Status and Future of General Object Recognition”, IPSJ Journal, Vol. 48, no. SIG16 [Search August 10, 2010], Internet <URL: http://mm.cs.uec.ac.jp/IPSJ-TCVIM-Yanai.pdf>

Further, techniques for performing general object recognition by dividing an image into regions for each object are described in the following documents.
Jamie Shotton et al., “Semantic Texton Forests for Image Categorization and Segmentation”, [searched August 10, 2010], Internet <URL: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1. 1.145.3036 & rep = rep1 & type = pdf>

  It should be noted that the method of calculating the degree of similarity between the captured image of the product G and the registered product image registered in the PLU file F1 is not particularly limited. For example, the similarity between the captured image of the product G and each registered product registered in the PLU file F1 may be calculated as an absolute evaluation or may be calculated as a relative evaluation.

  When calculating the similarity as an absolute evaluation, the captured image of the product G and each registered product registered in the PLU file F1 are compared on a one-to-one basis, and the similarity derived as a result of this comparison is used as it is. do it. Further, when calculating the similarity as a relative evaluation, if five registered products (products GA, GB, GC, GD, GE) are registered in the PLU file F1, the captured product G is The similarity is 0.6, the similarity is 0.1 for the product GB, the similarity is 0.1 for the product GC, the similarity is 0.1 for the product GD, and the product GE On the other hand, the similarity may be calculated such that the similarity is 0.1, and the total similarity with each registered product is 1.0 (100%).

  Here, the case where the product G can be identified by the object recognition of the object recognition unit 54 refers to the case where a product whose similarity exceeds the predetermined threshold is found from the PLU file F1. For example, when the similarity is calculated as a relative evaluation, it is assumed that five registered products (products GA, GB, GC, GD, GE) are registered in the PLU file F1. The threshold for determining that object recognition has been completed is 0.5. The similarity of the product GA to the imaged product G is 0.6, the similarity of the product GB is 0.1, the similarity of the product GC is 0.1, the similarity of the product GD is 0.1, the similarity of the product GE When the degree is 0.1 or the like, it is assumed that the object recognition unit 54 can recognize the object because the similarity of the product GA exceeds the threshold value. Further, the similarity of the product GA to the imaged product G is 0.4, the similarity of the product GB is 0.2, the similarity of the product GC is 0.2, the similarity of the product GD is 0.1, and the product GE If the similarity is 0.1 or the like, it is assumed that the object recognition by the object recognition unit 54 is not possible because the similarity of the product GA does not exceed the threshold.

  The mode switching unit 55 performs an operation mode (code reading mode) in which the code reading unit 53 specifies the product G and performs a second reading process in which the object recognition unit 54 specifies the product G. Switch between modes (object recognition mode). Specifically, the mode switching unit 55 determines that the product detection unit 52 has detected the product G included in the frame image captured by the image capturing unit 51 within a predetermined time period. The product G is specified by the code reading unit 53 by switching to the code reading mode. When the code reading unit 53 cannot identify the product G within a predetermined time, the mode switching unit 55 causes the object recognition unit 54 to identify the product G by switching to the object recognition mode.

  Here, the time for the mode switching unit 55 to switch from the code reading mode in which the code reading unit 53 performs the first reading process to the object recognition mode in which the object recognition unit 54 performs the second reading process is set in the ROM 162 or the like in advance. For example, in order to attempt to read the code information from a plurality of frame images, it is set at about several hundred msec. More specifically, when an image is captured at 30 fps by the imaging unit 164, a value of about 340 msec is set in order to attempt to read code information from a frame image of about 10 frames. Note that the switching setting described above may be set not only by time but also by the number of frames. Specifically, when the code information cannot be read from a frame image of a predetermined number of frames (for example, 10 frames) and the product G cannot be specified by the code reading unit 53, the configuration is switched to the object recognition mode. May be.

  The input receiving unit 56 receives various input operations corresponding to the display on the display device 106 via the touch panel 105 or the keyboard 107. For example, the information output unit 57 displays a confirmation screen for the product G specified by the code reading unit 53 or the object recognition unit 54 on the display device 106, and the sales of the specified product G based on a selection operation on the confirmation screen. An input operation (confirmation operation) for registration is accepted by the keyboard 107. The confirmation operation accepted by the information output unit 57 is notified to the POS terminal 11 by the information output unit 57. In addition, after the confirmation operation for registering sales of the product G, the input receiving unit 56 displays an operation screen for receiving an input of the number of products G to be registered for sales on the display device 106, and the number input operation is performed by the keyboard. Accept at 107. The number received by the input receiving unit 56 is notified to the POS terminal 11 by the information output unit 57. The POS terminal 11 receives the confirmation operation and the number notification, and performs sales registration in the sales registration unit 611.

  The information output unit 57 sends information (for example, product ID and product name) and the number indicating the product to the POS terminal 11 via the connection interface 175 for the product G for which the confirmation operation has been performed as described above. Output. As information output to the POS terminal 11 by the information output unit 57, the product ID read from the PLU file F1 by the information output unit 57 based on the product G specified by the code reading unit 53 or the object recognition unit 54 is directly used. The product name that can specify the product ID or the file name of the product image may be notified, and the storage location (storage address in the PLU file F1) of the product ID may be notified. You may notify to the POS terminal 11.

  The sales registration unit 611 of the POS terminal 11 functions as a sales registration unit, and is based on service information such as a product ID output from the information output unit 57, the number of registered sales, a discount amount and a discount rate. , Register sales of the corresponding product. Specifically, the sales registration unit 611 records the notified product ID and the product classification, the product name, the unit price, etc. corresponding to the product ID together with the number in the sales master file etc. with reference to the PLU file F1. Register sales.

  The display control unit 612 of the POS terminal 11 functions as a display control unit. When a detection signal is input from the sensor 27, the display device 23 and the customer display device 24 are turned on, and the detection is detected from the sensor 27. When no signal is input, the display device 23 and the customer display device 24 are turned off.

  Note that the display control unit 612 of the POS terminal 11 may enter a standby state without supplying power other than the memory (ROM 62 or RAM 63) when no detection signal is input from the sensor 27.

  Next, the operation of the checkout system 1 will be described in detail. First, the operation of the commodity reading apparatus 101 will be described. FIG. 7 is a flowchart illustrating an example of the operation of the commodity reading apparatus 101.

  As illustrated in FIG. 7, when the processing is started in response to the start of product registration by the POS terminal 11, the image capturing unit 51 outputs an imaging on signal to the imaging unit 164 and performs imaging by the imaging unit 164. Start (step S11). Next, the image capturing unit 51 starts capturing the frame image captured by the image capturing unit 164 and stored in the RAM 163 (step S12). Next, the mode switching unit 55 switches the operation mode to the code reading mode in which the code reading unit 53 performs the first reading process for specifying the product G (step S13).

  Next, the CPU 161 determines whether or not the product detection unit 52 has detected the product G from the frame image captured by the image capture unit 51 (step S14). Here, when the commodity G is not detected (step S14: No), the CPU 161 stands by for processing. When the product G is detected from the frame image captured by the image capturing unit 51 (step S14: Yes), the CPU 161 starts measuring time by the time measuring unit 166 and within a predetermined time set in advance, the code reading unit 53 Thus, it is determined whether or not the code information is decoded and the product G can be specified (step S15).

  If the time counting unit 166 times out a certain time and times out and the product G cannot be identified by the code reading unit 53 within the certain time (step S15: No), the mode switching unit 55 identifies the product G by the object recognition unit 54. The operation mode is switched to the object recognition mode for performing the second reading process (step S16).

  Therefore, in the product reading apparatus 101, the code reading is performed by switching to the code reading mode for a certain period of time in response to the product detection unit 52 detecting the product G included in the frame image captured by the image capturing unit 51. When the product G is specified by the unit 53 and the product G cannot be specified within a certain time, the object recognition unit 54 specifies the product G by switching to the object recognition mode. For this reason, the product reading apparatus 101 can identify the product G without reducing the processing speed in the code reading unit 53 or the object recognition unit 54 because the object recognition is not performed simultaneously with the reading of the code information. . In addition, since the code reader 53 switches to the object recognition mode when the product G cannot be specified within a certain time, the object recognition is not performed after the product G is specified by reading the code information. The product G can be identified efficiently.

  For example, in the frame image G20 illustrated in FIG. 6, when a barcode attached to the product G is reflected, the barcode is read by the code reading unit 53 without specifying the product G by the object recognition unit 54. Is decoded, and the product G is specified. In addition, in the frame image G20 illustrated in FIG. 6, when the barcode attached to the product G is not reflected (for example, when the barcode is not directed to the reading window 103), the code reading unit 53 makes certain The product G cannot be specified in time. As described above, when the code reading unit 53 cannot identify the product G within a predetermined time, the object recognition mode is switched to the object recognition mode, so that the object recognition unit 54 is irrelevant to the reflection of the barcode or the like attached to the product G. The product G can be specified by

  Subsequent to step S16, the CPU 161 starts measuring time by the time measuring unit 166 and determines whether the object recognition is performed by the object recognizing unit 54 within a predetermined time set in advance and the product G can be specified (step S16). S17).

  If the time counting unit 166 times out a certain time and times out and the product G cannot be identified by object recognition by the object recognition unit 54 within the certain time (step S17: No), the CPU 161 returns the process to step S13. Thereby, the mode switching unit 55 switches the operation mode from the object recognition mode to the code reading mode (step S13). As described above, when the product G cannot be specified by the code reading unit 53 and the object recognition unit 54, it is assumed that the product G directed to the reading window 103 cannot be specified, and the operation mode is switched to the code reading mode. The process is returned before the product G is detected. Therefore, the object recognition unit 54 with a heavy processing load is operated only when it is necessary to specify the product G.

  When the product G can be specified by the code reading unit 53 or the object recognition unit 54 while the time measuring unit 166 measures a certain time (step S15: Yes, step S17: Yes), the input receiving unit 56 A reading result such as information (product name, product image) indicating the product G identified with reference to the file F1 is displayed on the display device 106 (step S18). Next, the input receiving unit 56 receives confirmation of the product G to be registered for sales and input of the number thereof from the keyboard 107 (step S19). Next, the information output unit 57 outputs the product ID for the product G confirmed in step S19 and the number received in step S19 to the POS terminal 11 (step S20).

  Next, the CPU 161 determines the presence / absence of business end from the POS terminal 11 by a product registration end notification or the like (step S21). When business is continued (step S21: No), the CPU 161 returns the process to step S13 to continue the process. When the business is to be ended (step S21: Yes), the image capturing unit 51 outputs an imaging off signal to the imaging unit 164, ends imaging by the imaging unit 164 (step S22), and ends the process.

  In the above-described flowchart of the commodity reading apparatus 101, in step S15 and step S17, it is determined whether the code information can be decoded within a certain time or whether the object can be recognized within a certain time. Illustrated. However, the determination may be not only time but also the number of frames. Specifically, it may be determined whether or not the code information can be read from a frame image of a predetermined number of frames (for example, 10 frames). Similarly, it may be determined whether or not the object is recognized from a frame image of a predetermined number of frames (for example, 3 frames). Depending on the state of the frame image (for example, blurring of the merchandise G that is reflected), it may take time to read the code information and recognize the object, and the number of frames that can be processed before the determination may vary. Therefore, it is possible to make the number of frames processed until the determination constant by determining whether or not the code information can be decoded with a predetermined number of frames, or whether or not the object can be recognized with a predetermined number of frames. .

  Further, the CPU 161 may change the display on the display screen of the display device 106 in accordance with the switching of the reading process. Specifically, when the operation mode is the code reading mode, the fact that the code information attached to the product G is being read is displayed on the display screen. Next, when the operation mode is switched from the code reading mode to the object recognition mode, a message indicating that the object is being recognized is displayed on the display screen. By displaying the current operation mode on the display screen in this way, it is possible to notify the operator of whether the reading process is currently performed by reading code information or reading by object recognition. By giving such notification, for example, when a display indicating that the code information is being read is displayed, the operator can be prompted to put the code information on the reading window 103. Further, when the display indicating that the object is being recognized is displayed, the operator can be made aware that it is not necessary to force code information into the reading window 103. In the above-described flowchart of the commodity reading apparatus 101, the configuration in which the code reading mode is first switched to the object recognition mode is illustrated. However, the switching order of the code reading mode and the object recognition mode is not particularly limited. For example, the processes in steps S13 and S16 may be exchanged and switched in the reverse order to the order described above.

  Next, the operation of the POS terminal 11 will be described. FIG. 8 is a flowchart showing the procedure of sales registration processing executed by the POS terminal 11.

  When the operator operates the product reading apparatus 101 to perform product registration work, the operator is positioned when the operator moves 80 cm or more in the direction facing the display surface 23a of the display device 23. Therefore, the sensor 27 Does not detect the whereabouts of the operator.

  Therefore, when the operator operates the product reading apparatus 101 to perform product registration work, the CPU 61 does not input a detection signal from the sensor 27, so the display device 23 of the POS terminal 11 and the customer display device 24 is turned off. That is, in this case, the display of the display device 23 of the POS terminal 11 and the display device 24 for the customer is off.

  As described above, when the operator is not in front of the POS terminal 11, by turning off the display device 23 and the customer display device 24 of the POS terminal 11, unnecessary electricity is reduced and energy saving is supported. can do.

  When the operator is not in front of the POS terminal 11, the display device 23 and the customer display device 24 of the POS terminal 11 are automatically turned off by a signal from the sensor 27 that senses that the operator is not present. The customer can be informed that 11 is in a dormant state.

  Then, when the registration work by the operation of the commodity reading apparatus 101 is finished and the operator changes his / her direction and stands in front of the POS terminal 11 which is 80 cm away, the sensor 27 detects the location of the operator.

  When the CPU 61 (display control unit 612) inputs a detection signal from the sensor 27 (step S31: Yes), the display device 23 and the customer display device 24 of the POS terminal 11 are turned on (step S32). That is, when the registration work by the operation of the commodity reading apparatus 101 is completed and the operator changes its direction and stands in front of the POS terminal 11, the display device 23 and the customer display device 24 of the POS terminal 11 are displayed.

  In this way, the sensor 27 detects whether or not the operator is in front of the POS terminal 11, and the signal from the sensor 27 automatically turns on and off the display device 23 and the customer display device 24 of the POS terminal 11. Thus, the time for the operator to operate the POS terminal 11 can be reduced.

  Further, the CPU 61 receives the product ID and the number of products G output by the product reading device 101 in step S20 of FIG. 7 (step S33).

  Thereafter, when the sales registration process is started in response to an operation instruction on the keyboard 22 by the operator, the CPU 61 (sales registration unit 611) determines the product type or the like from the PLU file F1 based on the product ID and the number received in step S33. The unit price and the like are read, and the sales of the product G read by the product reading device 101 are registered in the sales master file (step S34).

  Subsequently, the CPU 61 determines whether or not the sales registration process is ended by an operation instruction of the keyboard 22 (step S35). When continuing the sales registration process (step S35: No), the CPU 61 returns to step S34 again to continue the sales registration process.

  On the other hand, when ending the sales registration process (step S35: Yes), the CPU 61 determines whether or not a detection signal is input from the sensor 27 (step S36).

  When the operator moves to the product reading device 101 to carry out the product registration work for the next customer's purchased product, or when the operator leaves the POS terminal 11, no detection signal is input from the sensor 27 (step S36: No), the CPU 61 (display control unit 612) turns off the display device 23 and customer display device 24 of the POS terminal 11 (step S37), and the display device 23 and customer display device 24 of the POS terminal 11 are turned off. Is deleted and the process returns to step S31.

  On the other hand, when the detection signal is input from the sensor 27 (step S36: Yes), the CPU 61 (display control unit 612) turns on the display device 23 and the customer display device 24 of the POS terminal 11. The process returns to step S33.

  When the operator leaves the POS terminal 11 as described above, the sensor 27 detects that the operator is gone, and automatically turns off the display of the display device 23 and the customer display device 24 of the POS terminal 11. It is possible to prevent the customer from easily accessing the POS terminal 11 and illegally operating the POS terminal 11.

  In the present embodiment, the display device 23 and the customer display device 24 of the POS terminal 11 are displayed only when the sensor 27 detects the operator and inputs a detection signal to the CPU 61. This is not a limitation. For example, only when the sensor 27 detects an operator and inputs a detection signal to the CPU 61, the mode is switched to the sleep mode (power-saving standby power supply mode), and power supply other than the memory is not performed as much as possible. You may make it enter. As a result, the POS terminal 11 can be operated only in a state where the operator is detected by the sensor 27, and in a state where the operator is not detected by the sensor 27, the power consumption can be saved compared to the normal startup state. Can do.

  Thus, according to the POS terminal 11 of the embodiment, the power consumption can be saved when the operator is away from the POS terminal 11 as compared with the normal activation state.

  Further, according to the POS terminal 11 of the embodiment, when the operator is away from the POS terminal 11, it is possible to prevent a customer from easily accessing the POS terminal 11 and illegally operating the POS terminal 11.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

11 Merchandise Sales Data Processing Device 27 Sensor 611 Sales Registration Unit 612 Display Control Unit

JP 2013-156938 A

Claims (6)

Sales registration means for registering sales of the product using information identifying the product output by the product reading device;
A display device for displaying at least information related to the sales registration to an operator;
A sensor that outputs a detection signal when it is detected that an operator is present within the certain distance with respect to a direction facing the display surface of the display device, provided away from the commodity reading device by a certain distance;
Display control means for turning on the display device when a detection signal is input from the sensor, and for turning off the display device when no detection signal is input from the sensor;
A product sales data processing device comprising: The sensor is provided apart from the product reading device by a certain distance,
The merchandise sales data processing apparatus according to claim 1. The sensor is provided below the display device,
3. The merchandise sales data processing apparatus according to claim 1, wherein The sensor is a direct reflection type infrared sensor,
The merchandise sales data processing apparatus according to any one of claims 1 to 3, wherein When the detection signal is not input from the sensor, the display control unit enters a standby state without performing power supply other than the memory.
The merchandise sales data processing apparatus according to any one of claims 1 to 4, wherein Computer
Sales registration means for registering sales of the product using information identifying the product output by the product reading device;
The operator exists within the predetermined distance with respect to the direction facing the display surface of the display device that is provided at a certain distance or more away from the commodity reading apparatus and displays at least the information related to sales registration to the operator. Display control means for turning on the display device when a detection signal is input from a sensor that outputs a detection signal when the detection is detected, and turning off the display device when no detection signal is input from the sensor When,
Program to function as.

Images