JP2014146384A - Product reading device, product reading method, and product reading program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a product reading device that can read information of products without largely replacing a procedure for products with bar-codes and products without the bar-codes.SOLUTION: A product reading device comprises: a function of identifying a product included in an image from the image taken by an imaging unit; and a function of identifying a data code attached to the product included in the same image. It is possible to switch between the functions via switching means. The product reading device sends information on the product identified by product identification processing or information on the data code identified by data code identification processing to a POS terminal.

Description

  Embodiments described herein relate generally to a commodity reading apparatus using an imaging unit and a commodity reading program for causing a computer to function as the commodity reading apparatus.

  One type of data code is a barcode. A product sold in a supermarket or the like is usually attached with a barcode indicating a product code unique to the product. 2. Description of the Related Art Commodity reading devices that read a commodity code of a commodity by scanning a barcode attached to the commodity with a scanner are widely used. In addition, a product reading device that reads a product code of a product by recognizing a barcode attached to the product from an image of the product taken by an imaging unit such as a CCD camera has been developed. The merchandise code read by these merchandise reading devices is output to a POS (Point Of Sales) terminal and used for sales data processing of the merchandise.

  By the way, not all products have barcodes attached. For example, bar codes are often not added to loosely sold vegetables, fruits, side dishes, and the like. Therefore, in order to deal with such a barcode-free product, a conventional product reading apparatus generally uses a display device as a touch panel. When an image of a product without a barcode is displayed on the touch panel screen and a product is selected by an operator's touch input, the product code of the selected product is output from the product reading device to the POS terminal.

JP 2008-033640 A

  An operator (a store clerk or a customer) who operates this type of conventional commodity reading apparatus holds the barcode portion of the commodity over the reading window for the commodity with the barcode attached thereto. However, for a product without a barcode, a desired product is selected from the touch panel screen. In this way, the operation procedure differs greatly between products with barcodes and products without barcodes.

  The problem to be solved by the present invention is to provide a product reading apparatus and a product reading program capable of reading product information between a product with a barcode attached and a product without a barcode, without greatly changing the operation procedure. It is something to try.

  In one embodiment, the product reading apparatus includes an image capturing unit, a product recognition unit, a data code recognition unit, a switching unit, and an output unit. The image capturing unit captures an image captured by the imaging unit. The product recognition unit recognizes a product included in the image from one image captured by the image capture unit. The data code recognition means recognizes a data code included in the image from the one image. The switching means determines whether the product recognition process by the product recognition means or the data by the data code recognition means depends on whether or not a contact type operator arranged around the reading window for holding the product imaged by the imaging means is input. The code recognition process is switched from a state in which one of the default processes is valid to a state in which the other non-default process is valid. The output means outputs product information or data code information recognized by a valid process among the product recognition process or the data code recognition process.

1 is an external view of a store accounting system according to a first embodiment. The block diagram which shows the hardware constitutions of the goods reading apparatus and POS terminal which are integrated in the same system. The schematic diagram which shows the data structure of the goods data file used with the system. The schematic diagram which shows the function structure which CPU implement | achieves in the goods reading apparatus of the system. The flowchart which shows the principal part procedure of the information processing which CPU performs according to a goods reading program in the goods reading apparatus of the system. The flowchart which shows the principal part procedure of the information processing which CPU performs according to a goods reading program in the goods reading apparatus of the system. The top view which shows an example of the registration screen displayed on a touch panel in the goods reading apparatus of the same system. The top view which shows an example of the image recognition screen displayed on a touchscreen in the goods reading apparatus of the same system. The top view which shows an example of the goods confirmation screen displayed on a touch panel in the goods reading apparatus of the system. The top view which shows an example of the quantity input screen displayed on a touchscreen in the goods reading apparatus of the system. The flowchart which shows the principal part procedure of the information processing which CPU performs in the goods reading apparatus which concerns on 2nd Embodiment according to a goods reading program. The flowchart which shows the principal part procedure of the information processing which CPU performs in the goods reading apparatus which concerns on 2nd Embodiment according to a goods reading program. The top view which shows an example of the image recognition screen displayed on a touchscreen in the merchandise reading apparatus which concerns on 2nd Embodiment. The flowchart which shows the principal part procedure of the information processing which CPU performs in the goods reading apparatus which concerns on 3rd Embodiment according to a goods reading program. The flowchart which shows the principal procedure of the information processing which CPU performs in the goods reading apparatus which concerns on 4th Embodiment according to a goods reading program. The external appearance perspective view of the goods reading apparatus which concerns on 5th Embodiment.

  Hereinafter, an embodiment of a commodity reading apparatus will be described with reference to the drawings. This embodiment is a case where the present invention is applied to a vertical product reading apparatus standing on an accounting counter provided in a store such as a supermarket.

(First embodiment)
FIG. 1 is an external view of a store accounting system according to an embodiment. This system includes a commodity reading device 1 as a registration unit and a POS (Point Of Sales) terminal 2 as a settlement unit. The commodity reading device 1 is attached on the accounting counter 3. The POS terminal 2 is installed on the cash register 4 via the drawer 5. The product reading device 1 and the POS terminal 2 are electrically connected by a communication cable (not shown).

  The product reading apparatus 1 includes a keyboard 11, a touch panel 12, and a customer display 13 as devices necessary for product registration. These display / operation devices (keyboard 11, touch panel 12, customer display 13) are attached to a thin rectangular housing 1 </ b> A constituting the main body of the commodity reading apparatus 1.

  An imaging unit 14 is built in the housing 1A. A rectangular reading window 1B is formed in front of the housing 1A. The imaging unit 14 includes a CCD (Charge Coupled Device) imaging device that is an area image sensor and its drive circuit, and an imaging lens for forming an image of the imaging region on the CCD imaging device. The imaging region refers to a region of a frame image that forms an image on the area of the CCD imaging device from the reading window 1B through the imaging lens. The imaging unit 14 outputs an image of the imaging region formed on the CCD imaging device through the imaging lens.

  The POS terminal 2 includes a keyboard 21, an operator display 22, a customer display 23, and a receipt printer 24 as devices necessary for payment.

  The checkout counter 3 has an elongated shape along the customer passage on the back side. The cash register 4 is placed substantially perpendicular to the transaction counter 3 on the front side of the end of the transaction counter 3 on the downstream side with respect to the moving direction of the customer moving along the transaction counter 3. The front side of the accounting counter 3 and the front side of the cash register 4 serve as a space for so-called cashiers in charge of accounting.

  In the approximate center of the accounting counter 3, the housing 1A of the commodity reading apparatus 1 is erected with the keyboard 11, the touch panel 12, and the reading window 1B facing the cashier side on the front side. The customer display 13 of the commodity reading apparatus 1 is attached to the housing 1A so as to face the customer passage.

  The receiving surface on the upstream side of the customer movement direction across the commodity reading device 1 of the accounting counter 3 is a space for placing a shopping basket 6 in which unregistered commodity M to be purchased by the shopper is placed. In addition, the downstream receiving surface is a space for placing a shopping basket 7 into which the product M registered by the product reading device 1 is placed.

  FIG. 2 is a block diagram illustrating a hardware configuration of the commodity reading device 1 and the POS terminal 2. The commodity reading apparatus 1 includes a CPU (Central Processing Unit) 101 as a control unit main body. A ROM 103 and a RAM 104 are connected to the CPU 101 via a bus line 102 such as an address bus or a data bus. The ROM 103 stores a program executed by the CPU 101.

  In addition, the imaging unit 14 is connected to the bus line 102 via an input / output circuit (not shown). In addition, the keyboard 11, the touch panel 12, and the customer display 13, which are display / operation devices, are connected to the bus line 102 via the connection interface 105 and the connection interface 106. The touch panel 12 includes a panel display unit 121 using, for example, a liquid crystal display, and a touch panel sensor 122 arranged on the screen of the display unit.

  The POS terminal 2 also includes a CPU 201 as a control unit main body. The CPU 201 is connected to a ROM 203, a RAM 204, an HDD (Hard Disk Drive) device 205, a communication interface 206, and a connection interface 207 via a bus line 202. Further, the keyboard 21, the operator display 22, the customer display 23, the printer 24, and the drawer 5 are connected to the bus line 202 through input / output circuits (not shown).

  The communication interface 206 is connected to a store computer SC serving as the center of the store via a network such as a LAN (Local Area Network). With this connection, the POS terminal 2 can transmit / receive data to / from the store computer SC. For example, the POS terminal 2 receives the product data file 8 from the store computer SC. The received product data file 8 is stored in the HDD device 205.

  The connection interface 207 is connected to both connection interfaces 105 and 106 of the commodity reading apparatus 1 via a communication cable. With this connection, the POS terminal 2 can transmit and receive data to and from the commodity reading device 1. For example, the POS terminal 2 receives product information read by the product reading device 1. The POS terminal 2 transmits the data in the product data file 8 to the product reading device 1.

  FIG. 3 is a schematic diagram showing the data structure of the product data file 8. As shown in FIG. 3, the product data file 8 stores the product attribute (product classification), name (product name), unit price, appearance feature parameter, etc. in association with the product code for identifying each product. . The appearance feature parameter is obtained by quantifying the standard appearance feature amount of a product such as the shape, surface color, pattern, unevenness, etc. of the product for each product.

  In the store accounting system including the commodity reading apparatus 1 and the POS terminal 2 having such a configuration, as shown in FIG. 4, the CPU 101 of the commodity reading apparatus 1 includes the image captured by the imaging unit 14 that is an imaging unit. Product recognition means 31 for recognizing a product to be read, data code recognition means 32 for recognizing a data code attached to a product included in the image from the image captured by the imaging unit 14, and product recognition processing by the product recognition means 31 The switching means 33 for switching which one of the data code recognition processes by the data code recognition means 32 is valid, the information of the product recognized by the product recognition means 31 or the data code recognized by the data code recognition means 32 It has a function as output means 34 for outputting information. These functions are realized according to a commodity reading program stored in the ROM 103.

  Each function of the CPU 101 will be described with reference to the flowcharts of FIGS. This flowchart shows the main procedure of the information processing executed by the CPU 101 in accordance with the product reading program.

  This process is started, for example, when a command for instructing the start of product registration is input from the POS terminal 2 via the connection interface 105. First, the CPU 101 displays the registration screen 40 on the panel display unit 121 of the touch panel 12 (ST1).

  An example of the registration screen 40 is shown in FIG. As illustrated, the registration screen 40 has a current area 41 and a detail area 42. The current area 41 is an area for displaying the product name, unit price, quantity, amount, etc. of the latest registered product. The detail area 42 is an area for displaying the product name, unit price, quantity, amount, etc. of each product registered in one commercial transaction. The registration screen 40 also displays an image of the [automatic recognition] button 43. The function of the “automatic recognition” button 43 will be described later.

  Next, the CPU 101 outputs an imaging on signal to the imaging unit 14 (ST2). In response to this imaging on signal, the imaging unit 14 starts imaging of the imaging region. Frame images captured by the imaging unit 14 are sequentially stored in the RAM 104. Therefore, the CPU 101 captures the frame image stored in the RAM 104 (ST3).

  Each time a frame image is captured, the CPU 101 analyzes the image and recognizes a barcode that is a type of data code (ST4). A barcode recognition technique based on image analysis is described in, for example, Japanese Patent Application Laid-Open No. 2008-033640.

  CPU 101 determines whether or not the barcode has been recognized from the frame image (ST5). If the barcode cannot be recognized (NO in ST5), CPU 101 determines whether or not the image of [automatic recognition] button 43 has been touched (ST6). When the touch operation is not performed (NO in ST6), CPU 101 captures the next frame image from RAM 104 (ST3).

  When the barcode can be recognized from the frame image (YES in ST5), CPU 101 reads binary code information from the barcode (ST7). Then, the CPU 101 outputs the read code information to the POS terminal 2 via the connection interface 105 (ST8).

  When the CPU 201 of the POS terminal 2 receives the code information from the product reading device 1, the CPU 201 searches the product data file 8 with the code information. When a product code matching the code information is detected, the product name, unit price, etc. associated with the product code are read. Then, the product sales data including the product code, the product name and unit price, the number of sales, the sales price, etc. is registered in the RAM 204. Also, the registered product information such as the product code, product name, unit price, number of sales, sales price, etc. is output to the product reading device 1 via the connection interface 207. The registered product information output to the product reading device 1 is given to the touch panel 12 via the connection interface 106 and displayed in the current area 41 of the registration screen 40 displayed on the panel display unit 121.

  After outputting the code information to the POS terminal 2 in step ST8, the CPU 101 determines whether or not a command for instructing the end of product registration has been input (ST9). When the end command is not input (NO in ST9), CPU 101 fetches the next frame image from RAM 104 (ST3).

  When an end command is input via connection interface 105 (YES in ST9), CPU 101 outputs an imaging off signal to imaging unit 14 (ST10). With this imaging off signal, the imaging unit 14 ends imaging of the imaging area.

  The termination command command is output from the POS terminal 2 to the commodity reading device 1 in response to an input operation of, for example, the [Total] key arranged on the keyboard 11. That is, the CPU 201 of the POS terminal 2 outputs an end command to the product reading device 1 when the key signal of the [Total] key is input from the product reading device 1. Further, based on the product sales data registered in the RAM 204, a registration closing process for one commercial transaction is executed.

  When it is detected in step ST6 that the image of [automatic recognition] button 43 has been touched (YES in ST6), CPU 101 causes panel display unit 121 to display image recognition screen 50. Then, the frame image captured by the imaging unit 14 is displayed on the image recognition screen 50 (ST11).

  An example of the image recognition screen 50 is shown in FIG. As shown in the figure, the image recognition screen 50 has a frame image display area 51 and is displayed in a pop-up on the registration screen 40. At this time, the image of the [automatic recognition] button 43 is deleted from the registration screen 40.

  CPU 101 recognizes product M included in the image from the frame image fetched from RAM 104, that is, the frame image displayed in display area 51 of image recognition screen 50 (ST12). Specifically, the CPU 101 first detects the presence or absence of a skin color region from the frame image. When the skin color area is detected, that is, when the reflection of the operator's hand is detected, the CPU 101 extracts a contour line or the like from the binarized image of the frame image. As a result, the CPU 101 attempts to extract the contour of the product M that is assumed to be held by the operator's hand. When the contour of the product M is extracted, the CPU 101 reads feature quantities such as the shape of the product, the color of the surface, the pattern, and the unevenness state from the image in the contour. If these product feature quantities can be read, the CPU 101 considers that the product M has been recognized. The CPU 101 repeats the product recognition process for the frame image displayed in the display area 51 until the product M can be recognized.

Such a technique for recognizing an object included in an image is called generic object recognition. Regarding this general object recognition technique, various recognition techniques are described in the following documents.
Keiji Yanai, “Current Status and Future of General Object Recognition”, IPSJ Journal, Vol. 48, no. SIG16 [Search August 10, 2010], Internet <URL: http://mm.cs.uec.ac.jp/IPSJ-TCVIM-Yanai.pdf>
Further, a technique for performing general object recognition by dividing an image into regions for each object is described in the following document.
Jamie Shotton et al., “Semantic Texton Forests for Image Categorization and Segmentation”, [Search August 10, 2010], Internet <URL: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1. 1.145.3036 & rep = repl & type = pdf>
If the product M can be recognized from the frame image, the CPU 101 outputs the feature amount data of the recognized product M to the POS terminal 2 (ST13).

  When the CPU 201 of the POS terminal 2 inputs the feature value data of the product M from the product reading device 1, the feature value data is collated with the appearance characteristic parameters for each product stored in the product data file 8. Then, the product having the appearance feature parameter most similar to the feature amount of the product M is determined as the product M.

  When the product M is determined, the CPU 201 reads the product code, product name, unit price, etc. of the product M from the product data file 8. In addition, the sales amount is calculated by setting the number of sales points to “1”. Then, finalized product information such as a product code, a product name, a unit price, a sales point, and a sales price is output to the product reading device 1 via the connection interface 207. The confirmed product information output to the product reading device 1 is given to the touch panel 12 via the connection interface 106 and displayed in the current area 41 of the registration screen 40 displayed on the panel display unit 121.

  A display example of the registration screen 40 at this time is shown in FIG. As shown in the drawing, in the current area 41 of the registration screen 40, the name, unit price, score, amount, etc. of the product M recognized from the frame image are displayed. In addition, images of an [OK] button 44, a [Quantity] button 45, and a [Cancel] button 46 are also displayed.

  CPU101 which output the feature-value data of the goods M to the POS terminal 2 in step ST13 waits for fixed goods information (ST14). If confirmed product information is received from POS terminal 2 via connection interface 105 (YES in ST14), CPU 101 stores this confirmed product information in RAM 104 (ST15). Next, the CPU 101 waits for the touch operation of any of the [OK] button 44, the [Quantity] button 45, or the [Cancel] button 46 on the touch panel 12 (ST16, ST17, ST18).

  If the CPU 101 detects that the image of the [Cancel] button 46 has been touched by a signal from the touch panel sensor 122 input via the connection interface 105 (YES in ST18), the CPU 101 reads the next frame image from the RAM 104. Capture (ST3). At this time, instead of the [OK] button 44, the [Quantity] button 45, and the [Cancel] button 46, the image of the [Automatic recognition] button 43 is displayed again on the registration screen 40.

  When CPU 101 detects that the image of [Quantity] button 45 has been touched by a signal from touch panel sensor 122 input via connection interface 105 (YES in ST17), CPU 101 displays a quantity input screen on panel display 121. 60 is displayed (ST19).

  One display example of the quantity input screen 60 is shown in FIG. As shown in the figure, the quantity input screen 60 includes a numeric key from [0] to [9] and an [Enter] key, and is popped up on the registration screen 40 in a superimposed manner.

  CPU 101 waits for a quantity to be entered from quantity entry screen 60 (ST20). When it is detected by the signal from touch panel sensor 122 that the [Enter] key is input after the number is set by the number key (YES in ST20), CPU 101 recognizes the number data as a quantity. Then, the sales point data stored in the RAM 104 is changed to the entered quantity. Further, the sales amount data is also changed to an amount obtained by multiplying the unit price by the quantity entered (ST21). At this time, as shown in FIG. 10, the number of sales points and the sales amount displayed in the current area 41 are similarly changed. Thereafter, the CPU 101 waits again for any of the button images of the [OK] button 44, the [Quantity] button 45, or the [Cancel] button 46 to be touched (ST16, ST17, ST18).

  On the other hand, when it is detected from the touch panel sensor 122 that the image of the [OK] button 44 has been touched (YES in ST16), the CPU 101 stores the product code, product name, unit price, Finalized product information such as the number of sales points and sales price is output to the POS terminal 2 (ST22).

  The CPU 201 of the POS terminal 2 that has received the confirmed product information from the product reading device 1 via the connection interface 207 registers the confirmed product information in the RAM 204 as product sales data.

  After outputting the confirmed product information to the POS terminal 2 in step ST22, the CPU 101 determines whether or not a command for instructing the end of product registration has been input (ST23). When the end command is not input (NO in ST23), CPU 101 captures the next frame image from RAM 104 (ST3). At this time, instead of the [OK] button 44, the [Quantity] button 45, and the [Cancel] button 46, the image of the [Automatic recognition] button 43 is displayed again on the registration screen 40.

  When the end command is input (YES in ST23), CPU 101 outputs an imaging off signal to imaging unit 14 (ST24). With this imaging off signal, the imaging unit 14 ends imaging.

  As described above, the product reading device 1 configures the data code recognition unit 33 by the process of step ST4 of the information processing procedure executed by the CPU 101 according to the product reading program, and configures the product recognition unit 31 by the process of step ST12. The switching means 33 is configured by the processing of step ST6, and the output means 34 is configured by the processing of step ST8 or ST13.

  The data code (barcode) recognition process by the data code recognition unit 32 can be executed after a command for instructing the start of product registration is input, but the product recognition process by the product recognition unit 31 is performed. If the image of the [automatic recognition] button 43 is not touched, it is not executed. Moreover, when the information of one product recognized in the product recognition process is output to the POS terminal 2, the process returns to step ST3. That is, the data code recognition process by the data code recognition means 32 is effective.

  As described above, the commodity reading apparatus 1 uses the data code recognition process by the data code recognition unit 32 as a default process. When switching is declared by an operation input of the automatic recognition button 43, non-default processing, that is, product recognition processing by the product recognition means 31 is validated. This non-default product recognition process ends when one product is recognized, and the data code recognition process, which is the default process, is enabled again.

  Further, when the [automatic recognition] button 43 is touched in step ST6, the commodity reading apparatus 1 displays the image recognition screen 50 on the panel display unit 121 in step ST11. When the image recognition screen 50 is displayed, the operator of the product reading device 1 can recognize that the non-default processing, that is, the product recognition processing by the product recognition means 31 is effective. That is, the commodity reading apparatus 1 constitutes an informing means for informing that the non-default processing is effective by the processing in step ST11.

  Each time a store cashier in which the store accounting system of the present embodiment is introduced takes out an unregistered product M from the shopping basket 6, it determines whether or not the product has a barcode. If a barcode is attached, the surface of the product with the barcode attached is held over the reading window 1B. Then, the processing of steps ST3, 4, 7, and 8 of the information processing procedure shown in FIG. 5 is executed in order, and the product name of the product M is displayed in the current area 41 of the registration screen 40 displayed on the touch panel 12. The number of sales points, unit price, and sales price are displayed. Further, the sales data of the product M is registered in the POS terminal 2.

  On the other hand, in the case of a product without a barcode, after touching the image of the [automatic recognition] button 43 displayed on the touch panel 12, the product is held over the reading window 1B. Then, the processing of steps ST11, 12, 13, 14, and 15 of the information processing procedure is executed in order, and the product name, the number of sales points, the unit price, and the sales price of the product M are displayed in the current area 41 of the registration screen 40. Is done.

  At this time, the sales score is “1”. When there are a plurality of products M, the cashier touches the image of the [Quantity] button 45. Then, since the quantity input screen 60 is displayed, the cashier inputs the quantity of the product M. Then, the number of sales points and the sales amount of the current area 41 are changed. Thereafter, when the cashier touches the image of the [OK] button 47, the POS terminal 2 registers the sales data of the product M for the input quantity.

  As described above, in the commodity reading apparatus 1 according to the present embodiment, similarly to the commodity with the barcode attached, the commodity information with respect to the commodity without the barcode attached can be obtained only by holding the commodity over the reading window 1B. It can be read. Therefore, the operation procedure is not greatly changed between the product with the barcode attached and the product with no barcode attached.

  Moreover, the product reading apparatus 1 uses the data code recognition process by the data code recognition unit 32 as a default process, and the product recognition process by the product recognition unit 31 is effective as long as the image of the [automatic recognition] button 43 is not touched. Must not. At present, products sold in supermarkets or the like are usually attached with a barcode as a kind of data code, and there are fewer products without a barcode. Therefore, the operator simply holds the barcode of the product over the reading window 1B for most of the registered products, and the image of the [automatic recognition] button 43 for some products not attached with the barcode. Since it is sufficient to hold the product over the reading window 1 </ b> B after touching, the product reading device 1 with excellent work efficiency can be provided.

  When one product is recognized by the product recognition process by the product recognition unit 31, the process automatically returns to the data code recognition process by the data code recognition unit 32. For this reason, the operator only has to touch the image of the [automatic recognition] button 43 only when registering a product without a barcode. Accordingly, in a store where there are more products with barcode attached than products without barcode, the number of times of touching the [automatic recognition] button 43 is small, and the operation is efficient without being complicated.

  Further, when the operator touches the image of the [automatic recognition] button 43, the image recognition screen 50 is displayed on the panel display unit 121. Therefore, the operator can easily recognize that the product recognition processing by the product recognition means 31 is effective because the image recognition screen 50 is displayed. That is, the operator can easily recognize that non-default processing is effective.

(Second Embodiment)
Next, a second embodiment will be described. In the first embodiment, the non-default process, that is, the product recognition process by the product recognition unit 31 is terminated when one product is recognized. Then, the default processing, that is, the data code recognition processing by the data code recognition means 32 becomes effective again. For this reason, it is necessary to touch the image of the [automatic recognition] button 43 every time a product without a barcode is registered. In the second embodiment, when products without a barcode are continuously registered, processing can be performed without touching the image of the [automatic recognition] button 43.

  This second embodiment is different from the first embodiment in part of the information processing executed by the CPU 201 in accordance with the product reading program. The main steps of the information processing in the second embodiment are shown in FIG. This is shown in the flowchart of FIG. The same parts as those in the information processing procedure of the first embodiment shown in FIGS. 5 and 6 are denoted by the same reference numerals, and detailed description thereof is omitted.

  As shown in FIG. 11, also in the second embodiment, when it is detected in step ST6 that the image of the [automatic recognition] button 43 has been touched (YES in ST5), the CPU 101 displays the panel display unit 121. The image recognition screen 50 is displayed on the screen. Then, the frame image captured by the imaging unit 14 is displayed on the image recognition screen 50 (ST11).

  An example of the image recognition screen 50 in the second embodiment is shown in FIG. As shown in the figure, the image recognition screen 50 has a frame image display area 51 and is displayed as a pop-up on the registration screen 40. At this time, the image of the [automatic recognition] button 43 is deleted from the registration screen 40, and the images of the [end recognition] button 47 and the [cancel] button 48 are displayed instead.

  Thereafter, the CPU 101 recognizes the product M included in the image from the frame image displayed in the display area 51 of the image recognition screen 50 (ST12). The CPU 101 also monitors whether the image of the [recognition end] button 47 or the [cancel] button 48 is touched (ST31, ST32). If the image of [Cancel] button 48 is touched (YES in ST32), CPU 101 captures the next frame image from RAM 104 (ST33). Then, returning to the process of step ST12, the CPU 101 recognizes the product M included in the captured frame image (ST12).

  On the other hand, when the image of [recognition end] button 47 is touched (YES in ST31), CPU 101 returns to the process of step ST3. Then, the CPU 101 captures the next frame image from the RAM 104 (ST3), analyzes the image, and recognizes a barcode which is a kind of data code (ST4).

  If product M can be recognized from the frame image without touching the image of [Recognition end] button 47 or [Cancel] button 48 (NO in ST31, NO in ST32), CPU 101 is recognized. The feature amount data of the product M is output to the POS terminal 2 (ST13). Thereafter, the CPU 101 executes the processes of steps ST14 to ST24 described in the first embodiment.

  However, in the first embodiment, when an end command is not input in the process of step ST23 (NO in ST23), the CPU 101 returns to the process of step ST3. However, in the second embodiment, the step It returns to the process of step ST12 through the process of ST33. In other words, in the first embodiment, when the end command is not input, the CPU 101 fetches the next frame image from the RAM 104 and executes the barcode recognition process. However, in the second embodiment, the CPU 101 The product recognition process is executed for the next frame image.

  As described above, in the commodity reading apparatus 1 according to the second embodiment, when the image of the [automatic recognition] button 43 is touch-operated and the non-default commodity recognition process is started, the [recognition end] button 47 is touch-operated. Until this is done, the process does not return to the data code recognition process which is the default process. In other words, when non-default processing is enabled, the valid state is maintained until the end is declared by touch input of the [Recognition end] button 47, and when the end is declared, the default processing is enabled. Here, the [recognition end] button 47 functions as a declaring means for declaring the end of non-default processing.

  With the product reading device 1 according to the second embodiment, there is no need to touch the image of the [automatic recognition] button 43 each time a product without a barcode is continuously registered.

(Third and fourth embodiments)
In the first or second embodiment, when the image of the [automatic recognition] button 43 is touch-operated in the state where the default processing, that is, the data code recognition processing by the data code recognition means 32 is valid (in ST6) YES), non-default processing, that is, product recognition processing by the product recognition means 31 is enabled (ST12). However, comparing the barcode recognition accuracy by the data code recognition unit 32 with the product recognition accuracy by the product recognition unit 31, the data code recognition unit 32 has a higher recognition accuracy. For this reason, even if the product recognition processing by the product recognition means 31 is valid, if the barcode can be recognized from the image, it is better to execute the data code recognition processing by the data code recognition means 32.

  Therefore, next, the commodity reading apparatus 1 further includes an interrupt unit that executes a recognition process that has not been validated before executing the recognition process that has been validated by the switching unit 33. The third and fourth embodiments will be described in which when the recognition process that has not been executed is executed but cannot be recognized, the recognized recognition process is executed. Incidentally, in the third embodiment, a confirmation unit is provided in the commodity reading apparatus 1 according to the first embodiment, and the fourth embodiment confirms with the commodity reading apparatus 1 according to the second embodiment. Means are provided.

  FIG. 14 shows a main procedure of information processing executed by the CPU 101 in accordance with the product reading program in the product reading apparatus 1 according to the third embodiment. In addition, the same code | symbol is attached | subjected to the processing step which is common in FIG. 5 which is the same processing procedure of 1st Embodiment, and detailed description is abbreviate | omitted.

  As can be seen by comparing FIG. 5 and FIG. 14, the third embodiment is different from the first embodiment in that the determination process of ST41 is added after the image recognition screen display process of step ST11. is there. That is, the CPU 101 determines again whether or not the barcode has been recognized from the frame image (ST41). If the barcode can be recognized (YES in ST41), CPU 101 reads binary code information from the barcode (ST7). If the barcode cannot be recognized (NO in ST41), CPU 101 recognizes product M included in the image from the frame image (ST12).

  Thus, in 3rd Embodiment, the goods reading apparatus 1 comprises an interruption means by the process of step ST41 of the information processing procedure which CPU101 performs.

  Next, FIG. 15 shows a main procedure of information processing executed by the CPU 101 in accordance with the product reading program in the product reading apparatus 1 according to the fourth embodiment. In addition, the same code | symbol is attached | subjected to the processing step which is common in FIG. 11 which is the same processing procedure of 2nd Embodiment, and detailed description is abbreviate | omitted.

  As can be seen by comparing FIG. 11 and FIG. 15, the fourth embodiment is different from the second embodiment in that the determination process of ST51 is added after the image recognition screen display process of step ST11. is there. That is, the CPU 101 determines again whether or not the barcode has been recognized from the frame image (ST51). If the barcode can be recognized (YES in ST51), CPU 101 reads binary code information from the barcode (ST7). When the barcode cannot be recognized (NO in ST51), CPU 101 recognizes product M included in the image from the frame image (ST12).

  Thus, in 4th Embodiment, the goods reading apparatus 1 comprises an interruption means by the process of step ST51 of the information processing procedure which CPU101 performs.

  According to the third or fourth embodiment, even after the operator touches the image of the [automatic recognition] button 43, the commodity reading apparatus 1 executes the data code recognition process which is a default process again, It is determined whether or not the barcode can be recognized from the frame image. If the barcode cannot be recognized, the product reading device 1 executes a product recognition process which is a process other than the default, and recognizes the product from the frame image.

  On the other hand, when the barcode can be recognized, the commodity reading device 1 reads the barcode information and outputs it to the POS terminal 2. That is, even after the operator touches the image of the [automatic recognition] button 43, the merchandise reading apparatus 1 executes the data code recognition process with priority over the merchandise recognition process. Therefore, even if the product recognition process by the product recognition unit 31 is valid, if the barcode can be recognized from the image, the data code recognition process by the data code recognition unit 32 is executed. For this reason, even when the automatic recognition button 43 is pressed due to an erroneous operation, barcode reading can be performed.

(Fifth embodiment)
In the first to fourth embodiments, the image of the [automatic recognition] button 43 is displayed on the registration screen 40 as a switch for operating the switching unit 33. For this reason, in the store accounting system shown in FIG. 1, when registering a product without a barcode, the operator proceeds with the following procedure.

  First, the operator takes out the unregistered product M from the shopping basket 6 with the right hand. Then, it is confirmed whether or not a bar code is attached to the product M. When the barcode is not attached, the operator touches the image of the [automatic recognition] button 43 with the left hand. Alternatively, after holding the product M with the left hand, the image of the [automatic recognition] button 43 is touched with the right hand. Thereafter, the operator holds the product over the reading window 1B. Thus, if the product is correctly recognized, the operator puts the product into the shopping basket 7.

  The reading window 1B is formed at the center of the housing 1A. On the other hand, the registration screen 40 is displayed on the touch panel 12 provided above the housing 1A. Therefore, the operator touches the [Automatic recognition] button 43 of the touch panel 12 with the hand not holding the product, or raises the hand holding the product and touches the [Automatic recognition] button 43, and then lowers the hand. Over the reading window 1B. As described above, when the [automatic recognition] button 43 is provided on the touch panel 12, the work efficiency of the operator is lowered.

  Therefore, in the fifth embodiment, as a switch for operating the switching unit 33, as shown in FIG. 16, a contact type operating element 70 is disposed in the vicinity of the peripheral portion of the reading window 1 </ b> B in the commodity reading apparatus 1. In the example of FIG. 16, the operation element 70 is disposed on the right side toward the reading window 1 </ b> B, that is, on the side surface on the upstream side in the customer movement direction. The operation element 70 is a capacitive touch switch.

  In the fifth embodiment, the operator proceeds with the product registration work according to the following procedure. First, the operator takes out the unregistered product M from the shopping basket 6 with the right hand. Then, it is confirmed whether or not a bar code is attached to the product M. When the bar code is not attached, the operator touches the operation element 70 with the finger of the right hand holding the product. Next, the operator holds the product over the reading window 1B. Thus, if the product is correctly recognized, the operator puts the product into the shopping basket 7.

  As described above, according to the fifth embodiment, the operator moves a product taken out from the shopping basket 6 on the upstream side in the customer movement direction across the product reading device 1 to the downstream shopping basket 6. Among the products with the barcode attached, the barcode portion is held over the reading window 1B, and the product without the barcode is touched with the operation unit 70 to operate the switching means 33. It is possible to hold the product M over the reading window 1B. Therefore, even when a product with a barcode and a product without a barcode are mixed, many products can be registered smoothly, so that the operator's workload can be reduced.

  In the fifth embodiment, the operation element 70 is a contact type switch. Therefore, unless the operator touches the operation element 70, the product recognition process by the product recognition means 31 is not effective. If a non-contact type switch is applied, the product recognition process by the product recognition means 31 is effective when the operator holds the product over the reading window 1B, and the barcode is attached, Although the product recognition process with low recognition accuracy is executed, such a problem cannot occur in the fifth embodiment.

The present invention is not limited to the above embodiment.
For example, each of the above embodiments is applied to the commodity reading device 1 of the accounting counter to which the cashier corresponds, but the application example is not limited to this. For example, the present invention can be applied to a product reading device of a self-checkout system in which a customer himself performs accounting. In addition, the commodity reading device 1 may be integrated with the POS terminal 2. In short, the present invention can be applied to a checkout system including the commodity reading device 1 and the POS terminal 2.

  In the first to fourth embodiments, the image of the [automatic recognition] button 43 is displayed on the registration screen 40 as a command for operating the switching unit 33. However, the switching unit 33 is limited to this. It is not a thing. For example, one of the keys arranged on the keyboard 11 may be a key having the same function as the [automatic recognition] button 43. The same applies to the [OK] button 44, the [Quantity] button 45, the [Recognition end] button 47, and the [Cancel] buttons 46 and 48. Alternatively, the switching means 33 can be configured by a foot switch provided at the foot of the cashier (or customer). The user's operability can be improved by operating such a foot switch with his / her foot.

  In the fifth embodiment, the position of the operation element 70 as a command for operating the switching unit 33 is set on the right side of the reading window 1B. However, the position of the operation element 70 is not limited to this. For example, the upper side or the lower side in the peripheral portion of the reading window 1B may be used. Further, the operation element 70 may be provided not only on the right side but also on the left side toward the reading window 1B. By providing the controls 70 on the left and right of the periphery of the reading window 1b, there is a merit that it is possible to deal with the customer moving direction from the right side to the left lane toward the reading window, or in the opposite direction. .

  In addition, for the [recognition end] button 47 required in the second and fourth embodiments, a contact-type operation element may be provided around the reading window 1B instead.

  Further, in the embodiment, the image recognition screen 50 and the quantity input screen 60 are displayed on the registration screen 40 in a pop-up display, but are not displayed in the pop-up display but displayed on the panel display unit 121 instead of the registration screen 40. You may let them.

  In the above embodiment, the notification means is to display the image recognition screen 50. However, the notification means is not limited to this, and non-default processing is effective by other notification means such as display and sound. It can also be configured to notify that.

  In the embodiment, the data code recognition process by the data code recognition unit 32 is set as a default. However, the product recognition process by the product recognition unit 31 may be set as a default. Such an aspect becomes more effective as the ratio of products not attached to products attached with a data code such as a barcode increases. The data code recognized by the data code recognition unit 32 is not limited to a barcode, and may be a two-dimensional code, for example.

  In the above embodiment, the appearance feature parameters for each product are stored in the product data file 8. However, the product recognition unit 31 can store the product information even if the image information of the product having a standard appearance is stored instead of the parameters. It is possible to recognize.

  In the above embodiment, a product reading program for realizing the functions of the invention is recorded in advance in the ROM 103 which is a program storage unit in the apparatus. However, the present invention is not limited to this, and a similar program may be downloaded from the network to the apparatus. Alternatively, a similar program recorded on the recording medium may be installed in the apparatus. The recording medium may be in any form as long as it can store a program such as a CD-ROM or a memory card and can be read by the apparatus. Further, the function obtained by installing or downloading the program may be realized in cooperation with an OS (operating system) in the apparatus.

  In addition, although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  DESCRIPTION OF SYMBOLS 1 ... Merchandise reading apparatus, 2 ... POS terminal, 8 ... Product data file, 12 ... Touch panel, 14 ... Imaging part, 40 ... Registration screen, 43 ... Automatic recognition button, 47 ... Recognition end button, 50 ... Image recognition screen, 60 ... Quantity input screen, 70 ... Operator, 101, 201 ... CPU.

Embodiments described herein relate generally to a commodity reading apparatus using an imaging unit , a commodity reading method, and a commodity reading program for causing a computer to function as the commodity reading apparatus.

In one embodiment, the commodity recognition apparatus includes an image capturing means, and SWITCHING means, and display means. Image capture means, write no take an image pickup means has captured. SWITCHING means, depending on whether the switch is input, the captured image from the Product recognizing commodity recognition processing or captured image from recognizing the data code data code recognition one of the first one of the processing The state where the process is valid is switched to the state where the other second process is valid. Display means, if the valid state goods recognition processing, and displays the image captured by the imaging means.

Claims (9)

Image capturing means for capturing an image captured by the image capturing means;
Product recognition means for recognizing a product included in the image from one image captured by the image capture means;
Data code recognition means for recognizing a data code included in the image from the one image;
The product recognition process by the product recognition means or the data code by the data code recognition means, depending on whether or not a contact type operation element arranged around the reading window for holding the product imaged by the imaging means is input. Switching means for switching from a state in which one of the default processes is valid to a state in which the other non-default process is valid;
Output means for outputting information on the product or data code recognized by the processing in an effective state among the product recognition processing or the data code recognition processing;
A product reading apparatus comprising:   2. The product reading apparatus according to claim 1, wherein when the non-default processing is enabled, the default processing is enabled after recognizing one product or data code by the non-default processing. Declaring means for declaring the end of the non-default processing;
2. The non-default processing is maintained until the end is declared by the declaring unit, and the default processing is enabled when the end is declared by the declaring unit. The product reading device described.   The product reading apparatus according to claim 1, further comprising notification means for notifying that the non-default processing is valid. Before executing the non-default processing enabled by the switching means, further comprising an interrupt means for executing the default processing,
2. The commodity reading apparatus according to claim 1, wherein when the default process is executed by the interrupt means but cannot be recognized, the non-default process is executed.   6. The commodity reading apparatus according to claim 5, wherein after executing the non-default process and recognizing one commodity or data code, the default process is validated.   The commodity reading apparatus according to claim 1, wherein the contact-type operation element is a capacitance-type touch switch.   The output means outputs the product information or data code information to a POS terminal having a product data file in which the product name, unit price, and appearance characteristic parameters are stored in association with a product code for identifying each product. The commodity reading apparatus according to claim 1, wherein: On the computer,
An image capture function for capturing an image captured by the imaging means;
A product recognition function for recognizing a product included in the image from one image captured by the image capture function;
A data code recognition function for recognizing a data code included in the image from the one image;
The product recognition process by the product recognition function or the data code by the data code recognition function, depending on whether or not a contact type operator arranged around the reading window for holding the product imaged by the imaging means is input A switching function for switching from a state where one of the default processes is valid to a state where the other non-default process is valid;
An output function for outputting product information or data code information recognized by processing in an effective state of the product recognition processing or data code recognition processing;
Product reading program to realize.

Images