JP2013069306A - Merchandise information reading apparatus, merchandise information processing apparatus and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To further reliably read a service label attached to merchandise.SOLUTION: A merchandise information reading apparatus comprises: image capturing means which captures an image picked up by imaging means; first reading means which detects a code symbol BC from the image of merchandise G captured by the image capturing means and reads merchandise information represented in the code symbol; second reading means which detects a service label SL representing a content of service to be applied to the merchandise from the image captured by the image capturing means when the reading by the first reading means is not established, and reads service information corresponding to the service label SL; and third reading means which detects a character string CS from the image captured by the image capturing means when the reading by the second reading means is established, and reads the merchandise information represented in the character string. The service label SL is attached at such a position as to prevent the code symbol from being read.

Description

  Embodiments described herein relate generally to a commodity information reading apparatus and a program.

  Conventionally, retail stores such as supermarkets often sell products at discounted prices. In this case, on the store side, a label (hereinafter referred to as a service label) displaying a discount amount or a discount rate is attached to the product to clearly indicate to the customer that the product is a discount product. In addition, when an operator of a POS (Point Of Sales) terminal has a service label attached to a product purchased by a customer, the operator reads a barcode attached to the product using a scanner device, and also uses a keyboard or a touch panel. The processing related to discounting is performed by operating etc.

  Also, with regard to barcode reading, there is known a technique for capturing an image of a barcode or service label using an image sensor such as a CCD and reading information relating to a product code or discount from the image of the captured barcode or service label. ing.

  By the way, in the above-described conventional technology, the store clerk moves the bar code attached to the product into the imaging area of the image sensor, thereby reading the product code. However, if the barcode and the service label are separated, there is a possibility that the service label does not exist in the imaging area of the image sensor, and the clerk needs to move the service label into the imaging area of the image sensor. The operation was complicated. In this case, if the service label is overlooked, sales registration is performed without discounting, so a technique capable of more reliably reading the service label is desired.

  A product information reading device according to an embodiment is a product information reading device that reads the product information from a product to which a code symbol representing product information and a character string are attached. The product information reading device includes: A reading unit, a second reading unit, and a third reading unit are provided. The image capturing unit captures an image captured by the imaging unit. The first reading unit detects a code symbol from the product image captured by the image capturing unit, and reads the product information represented by the code symbol. The second reading unit detects a service label representing the content of the service applied to the product from the image captured by the image capturing unit when reading by the first reading unit is not established, and corresponds to the service label. Read service information. When reading by the second reading unit is established, the third reading unit detects a character string from the image captured by the image capturing unit, and reads the product information represented in the character string. The service label is affixed at a position where the code symbol cannot be read.

FIG. 1 is a perspective view schematically showing a configuration of a checkout system according to the embodiment. FIG. 2 is a block diagram showing the configuration of the POS terminal and the product information reading device. FIG. 3 is a diagram illustrating an example of a relationship between an imaging region of the imaging unit and a product. FIG. 4 is a diagram for explaining the label feature file. FIG. 5 is a flowchart showing a procedure of information output processing performed by the product information reading apparatus.

  Hereinafter, the product information processing apparatus and the program according to the present embodiment will be described with reference to a checkout system. This embodiment demonstrates the example applied to the checkout system introduced in stores, such as a restaurant and a supermarket.

  FIG. 1 is a perspective view schematically showing a configuration of a checkout system according to the present embodiment. As shown in FIG. 1, the checkout system includes a POS terminal 100 and a product information reading device 200.

  The POS terminal 100 is a product information processing apparatus for registering sales of products purchased by customers, and is placed on the checkout table 11. The POS terminal 100 includes a keyboard 101, an operator display 102, a customer display 103, a printer 104, and a drawer 105. Each unit provided in the POS terminal 100 will be described later.

  A counter table 12 having a horizontally long table is arranged so as to form an L shape with the checkout table 11. A load receiving surface 13 is formed on the upper surface of the counter table 12. The merchandise information reading apparatus 200 is placed on the cargo receiving surface 13 and connected to the POS terminal 100 so as to be communicable with each other by wire or wirelessly.

  The product information reading device 200 is a reader device that detects a code symbol (described later) attached to a product and outputs various information (product code, etc.) read from the code symbol to the POS terminal 100. As shown in FIG. 1, the product information reading apparatus 200 includes a reading window 201, a keyboard 202, an operator display 203, and a customer display 204. In addition, each part with which the merchandise information reading apparatus 200 is provided is mentioned later.

  On the cargo receiving surface 13, a shopping basket 14 for storing a product G to which a code label to be described later is attached is placed. The shopping basket 14 is classified into a first shopping basket 14a brought in by a customer and a second shopping basket 14b placed at a position sandwiching the merchandise information reading device 200 from the first shopping basket 14a.

  In the first shopping basket 14a brought in by the customer, the commodity G for one transaction is stored. Each product G is provided with a barcode representing the product code, a QR code (registered trademark), or the like as a code symbol. Here, the product code is an identification code assigned to each product to specify the product G, and is a JAN code as an example. In addition, a service label representing the content of the service provided by the store for the product G is affixed to the code symbols of some or all the products G (see FIG. 3).

  By the way, the commodity G in the first shopping basket 14a is moved to the second shopping basket 14b by the operator who operates the commodity information reading apparatus 200. In this movement process, the code symbol attached to the product G is directed to the reading window 201 of the product information reading apparatus 200. At this time, an imaging unit 215 (see FIG. 2), which will be described later, provided in the reading window 201 images a code symbol attached to the product G. The merchandise information reading apparatus 200 detects code symbols and service labels included in the captured image and reads various data.

  Hereinafter, the configuration of the checkout system will be described. FIG. 2 is a block diagram showing the configuration of the POS terminal 100 and the product information reading device 200.

  First, the configuration of the POS terminal 100 will be described. The POS terminal 100 includes a CPU (Central Processing Unit) 111, a ROM (Read Only Memory) 112, and a RAM (Random Access Memory) 113 as microcomputers that execute information processing.

  The CPU 111 performs overall control of the POS terminal 100 by executing various programs stored in the ROM 112 and a storage unit 114 described later. The ROM 112 stores a program for performing basic operations. The RAM 113 is a main storage device of the POS terminal 100 and functions as a work area for the CPU 111.

  Further, the above-described keyboard 101, display 102, display 103, printer 104, and drawer 105 are connected to the CPU 111 via various input / output circuits (not shown).

  The keyboard 101 is an input device that notifies the CPU 111 of key information (hereinafter referred to as key information) input from an operator who operates the POS terminal 100. The keyboard 101 is provided with various operation keys such as a numeric keypad for inputting numbers and operators, and a “tightening” key necessary for settlement of a commodity price.

  The display device 102 and the display device 103 have a display device such as an LCD (Liquid Crystal Display), and display various information such as product names and prices based on instructions from the CPU 111. Here, the display device 102 is a display device for an operator who operates the POS terminal 100, and a display surface thereof is arranged facing the operator (see FIG. 1). The display 103 is a display for customers, and its display surface is arranged toward the customer (see FIG. 1). In addition, it is good also as a form which implement | achieves all the keys or some keys of the keyboard 101 on a touch panel by making the indicator 102 into a touch panel structure.

  The printer 104 is a printing device such as a thermal printer, and prints receipts, journals, and the like under the control of the CPU 111. The drawer 105 is a cash drawer for storing cash or the like, and opens and closes under the control of the CPU 111.

  The CPU 111 is connected to a storage unit 114 and a communication I / F 115 via various input / output circuits (not shown).

  The storage unit 114 is a storage medium such as an HDD (Hard Disk Drive) or a flash memory, and stores a program 114a that can be executed by the CPU 111 and various files. An example of the program 114a stored in the storage unit 114 is a settlement processing program. An example of a file stored in the storage unit 114 is a PLU file 114b. Here, the PLU file 114b is a file that stores a product code uniquely assigned to each product in association with information about the product such as the name, price, and product classification of the product.

  The communication I / F 115 is an interface for performing data communication with the product information reading apparatus 200. The CPU 111 transmits / receives various data to / from the product information reading device 200 via the communication I / F 115.

  Next, the configuration of the product information reading device 200 will be described. As shown in FIG. 2, the product information reading apparatus 200 includes a CPU 211, a ROM 212, and a RAM 213 as a microcomputer that executes information processing.

  The CPU 211 comprehensively controls the product information reading apparatus 200 by executing various programs stored in the ROM 212. The ROM 212 stores a program for performing basic operations. The RAM 213 is a main storage device of the product information reading apparatus 200 and functions as a work area for the CPU 211.

  In addition, the above-described keyboard 202, display 203, and display 204 are connected to the CPU 211 via various input / output circuits (not shown).

  The keyboard 202 is an input device that notifies the CPU 211 of key information input from an operator who operates the product information reading apparatus 200. The keyboard 202 is used when inputting the number of products sold or inputting a product code of a product for which a barcode cannot be read.

  The display device 203 and the display device 204 have a display device such as an LCD, and display various types of information such as product names and prices based on instructions from the CPU 211. Here, the display device 203 is a display device for an operator who operates the product information reading apparatus 200, and the display surface thereof is arranged facing the operator (see FIG. 1). The display 204 is a display for customers, and its display surface is arranged facing the customer (see FIG. 1). In addition, it is good also as a form which implement | achieves all the keys or some keys of the keyboard 202 on this touch panel by making the display device 203 into a touch panel structure.

  The CPU 211 is connected to a communication I / F 214, an imaging unit 215, and a storage unit 216 via various input / output circuits (not shown).

  The communication I / F 214 is an interface for performing data communication with the POS terminal 100. The CPU 211 transmits / receives various data to / from the POS terminal 100 via the communication I / F 214. The imaging unit 215 is an image sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS), and is provided in the reading window 201 shown in FIG. The imaging unit 215 starts / stops imaging in accordance with the control of the CPU 211.

  Here, with reference to FIG. 3, the relationship between the imaging region of the imaging part 215 and the goods G is demonstrated. FIG. 3 is a diagram illustrating an example of the relationship between the imaging region of the imaging unit 215 and the product G. A region surrounded by a broken line in the figure is an imaging region 215a that is a region that the imaging unit 215 can capture in one frame.

  A label L indicating a product name (pig rose thin slice), a price (200 yen), and the like is attached to the product G. The label L is attached with a barcode BC, which is a code symbol, and the product code of the product G is expressed in a coded state. In addition, a character string (hereinafter referred to as an OCR character) CS representing a numerical value (2012345678903) of a product code incorporated in the barcode BC is displayed below the barcode BC. In addition, a service label SL representing the service content related to the product G is affixed on the barcode BC of the product G shown in FIG.

  Here, the service label SL is pasted on the barcode BC so as to cover a part or all of the bars constituting the barcode BC. For example, when the bar code BC is a JAN symbol, the service label SL is affixed at a position covering the center bar or guard bar necessary for recognition as a bar coat. The barcode BC cannot be read due to the application of the service label SL. In this way, in a store using this checkout system, when a service such as discount is applied to a specific product, the code symbol (bar code BC) of the product is made unreadable. A service label according to the service content shall be affixed to the top.

  Returning to FIG. 2, the storage unit 216 is a storage medium such as an HDD or a flash memory, and stores a program 216 a that can be executed by the CPU 211 and various files. Here, examples of the program 216 a stored in the storage unit 216 include a control program for the imaging unit 215, a code symbol reading program, a service label reading program, and an OCR character reading program. The storage unit 216 stores a label feature file 216b as a file necessary for the operation of the product information reading apparatus 200.

  FIG. 4 is a diagram for explaining the label feature file 216b. As shown in the figure, the label feature file 216b stores label feature data indicating the appearance characteristics of the service label and service information indicating the service content of the service label in association with each other.

  Here, the label feature data is information extracted from a service label by recognition processing such as pattern recognition or OCR. The service information is information obtained by converting information about the service content represented by the service label into an alphanumeric value so that it can be used by the POS terminal 100. For example, as shown in FIG. 3, for the service label SL represented as “half price from display price”, in the label feature file 216b of FIG. Since one label feature data corresponds, service information “−50%” meaning 50% discount is stored in association with this label feature data. Note that the service label attached to the product is not limited to the service label SL shown in FIG. As shown in the label feature data of No. 2, it may represent that a predetermined amount is discounted.

  Next, characteristic functions of the product information reading apparatus 200 will be described. The CPU 211 cooperates with programs stored in the ROM 212 and the storage unit 216, as shown in FIG. 2, to obtain an image data capturing unit 221, a code symbol reading unit 222, a service label reading unit 223, and an OCR character reading unit 224. And the information output unit 225 is realized.

  The image data capturing unit 221 causes the imaging unit 215 to start an imaging operation by outputting an imaging on signal to the imaging unit 215. The image data capturing unit 221 captures image data in the imaging area 215 a captured by the imaging unit 215 and stores the image data in the RAM 213. Further, when receiving an instruction from the OCR character reading unit 224, the image data capturing unit 221 captures image data in the imaging area 215a captured by the imaging unit 215 and stores the image data in the RAM 213.

  The code symbol reading unit 222 executes code symbol reading processing for detecting an image of a code symbol such as a barcode or QR code from the image data stored in the RAM 213 by the image data capturing unit 221.

  Specifically, the code symbol reading unit 222 binarizes one frame of image data stored in the RAM 213 in the code symbol reading process, and whether or not a data area regarding the code symbol exists in the binarized data. To detect. For example, when the code symbol is a JAN symbol, the JAN symbol is detected based on the center bar and the guard bar. When the code symbol reading unit 222 detects a data area related to the code symbol, the code symbol reading unit 222 decodes the code symbol to read the product code represented by the code symbol. The code symbol reading unit 222 stores the read product code in the RAM 213.

  The service label reading unit 223 executes a service label reading process for detecting the image of the service label from the image data stored in the RAM 213 by the image data capturing unit 221 when the code symbol reading unit 222 fails to read the code symbol. To do.

  Specifically, the service label reading unit 223 performs character recognition of a character string detected from a predetermined area in image data by pattern recognition or OCR character recognition in a service label reading process, a mark feature such as a picture and a symbol, and a label feature. The label feature data (see FIG. 4) of the file 216b is collated, and when the degree of coincidence becomes a predetermined value or more, it is determined that a service label is detected in that area. When the service label reading unit 223 detects the service label, the service label reading unit 223 reads the service information associated with the label feature data of the service label from the label feature file 216b and stores it in the RAM 213. It is assumed that an arbitrary value such as 90% can be set as the threshold value for determining the degree of coincidence.

  The OCR character reading unit 224 executes an OCR character reading process of detecting an OCR character from the image data stored in the RAM 213 by the image data capturing unit 221 when the service label reading unit 223 has read the service label.

  Specifically, in the OCR character reading process, the OCR character reading unit 224 compares one frame of image data stored in the RAM 213 with registered character data stored in advance in the storage unit 216 for product code identification. When a character string having a high degree of coincidence is detected, it is determined that an OCR character string has been detected. When the OCR character reading unit 224 detects the OCR character string, the OCR character reading unit 224 reads the numerical value represented by the OCR character string as a product code and stores it in the RAM 213.

  The information output unit 225 transmits (outputs) the product code stored in the RAM 213 to the POS terminal 100 via the communication I / F 214. In addition, when the service information is stored in the RAM 213, the information output unit 225 transmits the service information together with the product code to the POS terminal 100 via the communication I / F 214.

  On the other hand, when the CPU 111 of the POS terminal 100 receives a product code from the product information reading apparatus 200, the CPU 111 refers to the PLU file 114b, reads the price of the product corresponding to the product code, and registers the product for sale. Further, when the service information is received together with the product code, the CPU 111 of the POS terminal 100 executes a process according to the content of the service information. For example, if the service information is “−50%”, the price of the product read from the PLU file 114b is reduced by 50% and then sales registration is performed.

  Next, the operation of the checkout system of this embodiment will be described with reference to FIG. Here, FIG. 5 is a flowchart showing a procedure of information output processing performed by the product information reading apparatus 200. This information output process is started in response to a predetermined signal instructing the start of a transaction transmitted from the POS terminal 100.

  First, the image data capturing unit 221 outputs an imaging on signal to the imaging unit 215, and starts an imaging operation by the imaging unit 215 (step S11). Next, the image data capturing unit 221 captures the image data captured by the image capturing unit 215 and stores it in the RAM 213 (step S12).

  When the image data is stored in the RAM 213, the code symbol reading unit 222 starts the above-described code symbol reading process (step S13), and determines whether or not a code symbol image exists in the image data stored in the RAM 213. Determination is made (step S14). If it is determined that a code symbol exists (step S14; Yes), the code symbol reading unit 222 reads a product code from the code symbol and stores it in the RAM 213 (step S15). Then, the information output unit 225 transmits the product code stored in the RAM 213 to the POS terminal 100 (step S16), and proceeds to step S25.

  On the other hand, when the code symbol reading unit 222 determines that no code symbol exists (step S14; No), the service label reading unit 223 starts the above-described service label reading process for the image data stored in the RAM 213. (Step S17). Here, the service label reading unit 223 determines whether or not the image of the service label exists in the image data stored in the RAM 213. If it is determined that the service label image does not exist (step S18; No), the process proceeds to step S12. By returning, the image data capturing unit 221 is made to capture new image data.

  If it is determined in step S18 that the image of the service label exists in the image data (step S18; Yes), the service label reading unit 223 reads the service information corresponding to the service label from the label feature file 216b, and the RAM 213. (Step S19).

  Subsequently, the OCR character reading unit 224 starts the above-described OCR character reading process on the image data stored in the RAM 213 (step S20). Here, the OCR character reading unit 224 determines whether or not there is an OCR character in the image data stored in the RAM 213. By instructing the acquisition of image data, the image data acquisition unit 221 is made to acquire new image data (step S22), and the process returns to step S21 again. The OCR character reading unit 224 repeatedly executes the process of step S21; No → step S22 until an OCR character is detected from the image data.

  If it is determined in step S21 that an OCR character exists in the image data (step S21; Yes), the OCR character reading unit 224 reads a numerical value represented by the OCR character as a product code and stores it in the RAM 213 (step S23). Subsequently, the information output unit 225 transmits the product code and service information stored in the RAM 213 to the POS terminal 100 (step S24), and proceeds to step S25.

  In step S25, the CPU 211 determines whether or not a transaction end is instructed by a predetermined signal from the POS terminal 100 (step S25). When the transaction end is not instructed (step S25; No), the process returns to step S12 again, and the processes of steps S12 to S24 are repeatedly executed until the sales registration of all the commodities is completed. It is assumed that the product code (and service information) stored in the RAM 213 is cleared every time the sale of the product is registered, that is, every time the product code of one product is transmitted to the POS terminal 100.

  In step S25, when the CPU 211 receives an instruction to end the transaction (step S25; Yes), the image data capturing unit 221 stops the imaging operation by the imaging unit 215 by outputting an imaging off signal to the imaging unit 215. (Step S26), the process is terminated.

  As described above, according to the present embodiment, when the reading of the code symbol is established, that is, when the service label is not attached, the product code read from the code symbol is transmitted to the POS terminal 100, and the service is performed. When the reading of the code symbol is not established due to the label sticking, the service information corresponding to the service label is transmitted to the POS terminal 100 together with the product code read from the OCR character. Thereby, since it becomes possible to read the service label attached to the product more reliably, the oversight of the service label by the store clerk can be prevented. In addition, by sticking the service label on the code symbol, it is possible to save the trouble of separately adjusting the reading position of the service label according to the imaging region 215a, so that the service label can be read efficiently. it can.

  The embodiment of the present invention has been described above, but the present invention is not limited to this, and various modifications, substitutions, additions, and the like are possible without departing from the spirit of the present invention.

  For example, in the above-described embodiment, the product code is represented by the code symbol and the OCR character as the product information regarding the product.

  In addition, the program executed by the POS terminal 100 and the product information reading apparatus 200 of the above-described embodiment can be installed in a file in an installable format or an executable format, a CD-ROM, a flexible disk (FD), a CD-R, a DVD ( The recording medium may be recorded on a computer-readable recording medium such as a digital versatile disk).

  The program executed by the POS terminal 100 and the product information reading device 200 of the above embodiment is stored on a computer connected to a network such as the Internet, and is provided by being downloaded via the network. Also good. Further, the program executed by the POS terminal 100 and the product information reading apparatus 200 of the above embodiment may be configured to be provided or distributed via a network such as the Internet.

  In the above embodiment, the label feature file 216b is stored in the product information reading device 200. However, the label feature file 216b is stored in an external storage device (for example, a server device) accessible by the product information reading device 200. May be stored.

DESCRIPTION OF SYMBOLS 11 Checkout stand 12 Counter stand 13 Cargo receiving surface 14, 14a, 14b Shopping basket 100 POS terminal 101 Keyboard 102 Display 103 Display 103 104 Printer 105 Drawer 111 CPU
112 ROM
113 RAM
114 storage unit 114a program 114b PLU file 115 communication I / F
200 Product Information Reading Device 201 Reading Window 202 Keyboard 203 Display 204 Display 211 211 CPU
212 ROM
213 RAM
214 Communication I / F
215 Imaging unit 216 Storage unit 216a Program 216b Label feature file 221 Image data capturing unit 222 Code symbol reading unit 223 Service label reading unit 224 OCR character reading unit 225 Information output unit

JP 2008-33640 A

Embodiments described herein relate generally to a product information reading device , a product information processing device, and a program.

The product information reading apparatus according to the embodiment includes a capturing unit that captures an image of a product purchased by a customer, a symbol detecting unit that detects a code symbol representing an identification code for identifying the product from the image, and the code symbol A first identification code reading means for reading the identification code from the image; a label detection means for detecting a service label representing the content of the service provided for the product from the image; and a service content reading means for reading the service content from the service label A character string detecting means for detecting a character string representing an identification code for identifying the product from the image, a second identification code reading means for reading the identification code from the character string, and the first identification code reading means The service code read by the service content reading means when the identification code cannot be read by And an output means for outputting the identification code read by the scan content and the second identification code reading means.

Hereinafter, a product information reading device , a product information processing device, and a program according to the present embodiment will be described as an example of a checkout system. This embodiment demonstrates the example applied to the checkout system introduced in stores, such as a restaurant and a supermarket.

Claims (6)

A product information reading device that reads the product information from a product with a code symbol and a character string representing product information.
Image capturing means for capturing an image captured by the image capturing means;
A first reading unit that detects the code symbol from the image of the product captured by the image capturing unit and reads the product information represented by the code symbol;
When reading by the first reading unit is not established, a service label representing the content of the service applied to the product is detected from the image captured by the image capturing unit, and service information corresponding to the service label is obtained. A second reading means for reading;
A third reading unit that detects the character string from the image captured by the image capturing unit when the reading by the second reading unit is established, and reads the product information represented in the character string;
With
The product information reading apparatus, wherein the service label is attached at a position where the code symbol cannot be read.   The second reading means, based on a feature file that manages label feature data defining features of each service label, identifies an area in the image in which the degree of coincidence with the label feature data is a predetermined value or more. The product information reading device according to claim 1, wherein the product information reading device is detected as a label. The feature file manages service information in association with the label feature data,
The product information reading apparatus according to claim 2, wherein the second reading unit reads, from the feature file, service information corresponding to a service label detected from an image captured by the image capturing unit.   The commodity information reading according to any one of claims 1 to 3, wherein the code symbol is a JAN symbol, and the service label is attached to a position covering a center bar or a guard bar of the JAN symbol. apparatus.   When the first reading unit reads the product information, the product information is transmitted to an external device. When the third reading unit reads the product information, the second reading unit reads the product information. The product information reading apparatus according to any one of claims 1 to 4, further comprising a transmission unit that transmits the read service information to the external apparatus. A product information reading apparatus for reading the product information from a product with a code symbol and a character string representing product information.
Image capturing means for capturing an image captured by the image capturing means;
A first reading unit that detects the code symbol from the image of the product captured by the image capturing unit and reads the product information represented by the code symbol;
When reading by the first reading unit is not established, a service label representing the content of the service applied to the product is detected from the image captured by the image capturing unit, and service information corresponding to the service label is obtained. A second reading means for reading;
A third reading unit that detects the character string from the image captured by the image capturing unit when the reading by the second reading unit is established, and reads the product information represented in the character string;
To function,
The service label is affixed at a position where the code symbol cannot be read.

Images