JP5255027B2 - Code reader and program - Google Patents

Description

  Embodiments described herein relate generally to a code reader and a program.

  2. Description of the Related Art Conventionally, in supermarkets, code symbols such as barcodes and two-dimensional codes (for example, QR codes (registered trademark)) affixed to products are imaged by a digital camera such as a CCD (Charge Coupled Device) image sensor, and the imaging is performed. A code reading device is used that detects a code symbol from the detected image and reads product information such as a product code from the detected code symbol.

  By the way, in the conventional code reader, the operator holds the product over the digital camera to capture the barcode, but cannot check whether the barcode attached to the product is within the imaging range of the digital camera. . Therefore, in the conventional code reader, if the barcode attached to the product is not within the imaging range of the digital camera even though the product is held over the digital camera, the product is again held over the digital camera. There is a problem that the barcode needs to be read.

The code reading apparatus according to the embodiment includes an imaging unit, a capturing unit, a detecting unit, a reading unit, and a display unit. The capturing unit captures an image of the imaging area captured by the imaging unit. The detection means detects a code symbol indicating product information from the image of the imaging area. The reading unit reads product information from the code symbol detected by the detection unit. The display means displays an image including a frame surrounding the detected code symbol as a code symbol display in the image of the imaging area while the product information is being read. When a plurality of code symbols are detected from the image of the imaging area, the detecting unit selects a code symbol having the highest degree of coincidence with a preset code symbol from the plurality of code symbols. The code symbol detected from

FIG. 1 is a perspective view showing a checkout system. FIG. 2 is a block diagram illustrating a hardware configuration of the POS terminal and the code reading device. FIG. 3 is a diagram illustrating an example of a relationship with an imaging area of an imaging unit of a product. FIG. 4 is a block diagram illustrating a functional configuration of a CPU included in the code reading device. FIG. 5 is a diagram illustrating an example of an image captured by the captured image capturing unit. FIG. 6 is a diagram illustrating an example of an image displayed on the display device. FIG. 7 is a diagram illustrating an example of an image displayed on the display device. FIG. 8 is a diagram illustrating an example of an image displayed on the display device. FIG. 9 is a flowchart showing a flow of output processing of product information by the code reading apparatus according to the present embodiment.

  Hereinafter, a code reading apparatus and a program according to the present embodiment will be described with reference to the drawings, taking a checkout system as an example. The checkout system includes a POS (Point Of Sales) terminal for registering and paying for a product for one transaction. This embodiment is an application example to a checkout system introduced in a store such as a restaurant or a supermarket.

  FIG. 1 is a perspective view showing a checkout system. As shown in FIG. 1, the checkout system 1 includes a POS terminal 11 that performs registration and settlement of commodities related to one transaction. The POS terminal 11 is placed on the upper surface of the drawer 21 on the checkout table 51. The drawer 21 is controlled by the POS terminal 11 for the opening operation. On the upper surface of the POS terminal 11, a keyboard 22 that is pressed by an operator (user) is arranged. A display device 23 that displays information toward the operator is provided behind the keyboard 22 when viewed from the operator who operates the keyboard 22. The display device 23 displays information on the display surface 23a. A touch panel 26 is laminated on the display surface 23a. A customer display device 24 is erected so as to be rotatable further behind the display device 23. The customer display device 24 displays information on the display surface 24a. The customer display device 24 shown in FIG. 1 has the display surface 24a facing the front side in FIG. 1, but the customer display device 24 is rotated so that the display surface 24a faces the back side in FIG. Thus, the customer display device 24 displays information to the customer.

  A horizontally long table-shaped counter table 151 is arranged so as to form an L shape with the checkout table 51 on which the POS terminal 11 is placed. A cargo receiving surface 152 is formed on the upper surface of the counter table 151. On the cargo receiving surface 152, a shopping basket 153 for storing the product A with the barcode BC is placed. The shopping basket 153 can be divided into a first shopping basket 153a brought in by a customer and a second shopping basket 153b positioned at a position sandwiching the code reader 101 from the first shopping basket 153a.

  A code reader 101 connected to the POS terminal 11 so as to be able to transmit and receive data is installed on the receiving surface 152 of the counter table 151. The code reading device 101 includes a thin rectangular housing 102. A reading window 103 is disposed in front of the housing 102. A display / operation unit 104 is attached to the upper portion of the housing 102. The display / operation unit 104 is provided with a display device 106 on which a touch panel 105 is laminated. A keyboard 107 is disposed on the right side of the display device 106. A card reading groove 108 of a card reader (not shown) is provided on the right side of the keyboard 107. A customer display device 109 for providing information to the customer is installed on the back left side of the display / operation unit 104 as viewed from the operator. A customer touch panel 109 a is laminated on the display surface of the customer display device 109.

  In the first shopping basket 153a brought in by the customer, a product A for one transaction is stored. A barcode BC in which a product code related to the product A is encoded is attached to the product A. The product A is moved to the second shopping basket 153b by the operator's hand. In this moving process, the barcode BC is directed to the reading window 103 of the code reading device 101. At this time, the imaging unit 164 (see FIG. 2) arranged on the back side of the reading window 103 images the barcode BC. The code reader 101 detects the barcode BC included in the image captured by the imaging unit 164, and reads the product code related to the product A from the detected barcode BC. The product code read from the bar code BC is a code assigned to each product for specifying the product A, and is a JAN code that is a 13-digit number as an example. In the present embodiment, the barcode BC is described as an example of the code symbol, but it goes without saying that the code symbol may be a two-dimensional code such as a QR code (registered trademark).

  FIG. 2 is a block diagram illustrating a hardware configuration of the POS terminal and the code reading device. The POS terminal 11 includes a microcomputer 60 as an information processing unit that executes information processing. The microcomputer 60 is configured by connecting a ROM (Read Only Memory) 62 and a RAM (Random Access Memory) 63 to a CPU (Central Processing Unit) 61 that executes various arithmetic processes and controls each unit.

  The drawer 61, the keyboard 22, the display device 23, the touch panel 26, and the customer display device 24 are all connected to the CPU 61 of the POS terminal 11 through various input / output circuits (all not shown). . These are controlled by the CPU 61.

  The keyboard 22 includes a numeric keypad 22d, a temporary tightening key 22e, and a tightening key 22f on which numbers such as “1”, “2”, “3”.

  An HDD (Hard Disk Drive) 64 is connected to the CPU 61 of the POS terminal 11. The HDD 64 stores programs and various files. All or a part of the programs and various files stored in the HDD 64 are copied to the RAM 63 and sequentially executed by the CPU 61 when the POS terminal 11 is activated. An example of a program stored in the HDD 64 is a product sales data processing program PR. An example of a file stored in the HDD 64 is a PLU file F1 distributed and stored from the store computer SC. The PLU file F1 is a file that stores information related to products such as the name, unit price, and product classification of each product code uniquely assigned to each product.

  A communication interface 25 for performing data communication with the store computer SC is connected to the CPU 61 of the POS terminal 11 via an input / output circuit (not shown). The store computer SC is installed in a store backyard or the like. A PLU file F1 distributed to the POS terminal 11 is stored in the HDD (not shown) of the store computer SC.

  Further, the CPU 61 of the POS terminal 11 is connected to a connection interface 65 that enables data transmission / reception with the code reader 101. The CPU 61 of the POS terminal 11 receives product information such as a product code read by the code reading device 101 via the connection interface 65, and sells and registers the product indicated by the received product information. Therefore, the connection interface 65 is connected to the code reading device 101. The CPU 61 of the POS terminal 11 is connected to a printer 66 that prints on receipts and the like. The POS terminal 11 prints the transaction content of one transaction on the receipt under the control of the CPU 61.

  The code reading device 101 also includes a microcomputer 160. The microcomputer 160 is configured by connecting a ROM 162 and a RAM 163 to a CPU 161 via a bus. The ROM 162 stores a program executed by the CPU 161. An imaging unit 164 is connected to the CPU 161 via various input / output circuits (all not shown). The operation of the imaging unit 164 is controlled by the CPU 161. The display / operation unit 104 is connected to the POS terminal 11 via the connection interface 176. The operation of the display / operation unit 104 is controlled by the CPU 61 of the POS terminal 11.

  The imaging unit 164 is a CCD image sensor, a COMS image sensor, or the like, and captures an image from the reading window 103 under the control of the CPU 161. For example, it is assumed that the imaging unit 164 captures an image at a predetermined frame rate (for example, 30 fps).

  Here, the relationship between the product processed by the code reading apparatus 101 according to the present embodiment and the imaging area of the imaging unit 164 will be described. FIG. 3 is a diagram illustrating an example of a relationship with an imaging area of an imaging unit of a product. An area surrounded by a chain line in the figure is an imaging area 63 that is an area where the imaging unit 164 can capture an image in one frame. A label L on which a barcode BC is printed is affixed to the product A shown in FIG. In the barcode BC, product information such as a product code is incorporated as information necessary for selling and registering the product A with the POS terminal 11. In addition, a product code “2101234567890” incorporated in the barcode BC is displayed in numbers below the barcode BC.

  Returning to FIG. 2, the CPU 161 is connected to a connection interface 175 that connects to the connection interface 65 of the POS terminal 11 and enables data transmission / reception with the POS terminal 11. The product code read from the barcode BC included in the image captured by the image capturing unit 164 of the code reader 101 under the control of the CPU 161 is output via the connection interface 175, and the POS terminal via the connection interface 65. 11 is input.

  Next, functional units of the code reading apparatus 101 realized by the CPU 161 sequentially executing programs will be described with reference to FIG. FIG. 4 is a block diagram illustrating a functional configuration of a CPU included in the code reading device. As illustrated in FIG. 4, the CPU 161 sequentially executes a program stored in the ROM 162 to function as a captured image capturing unit 1611, a code detection unit 1612, a reading unit 1613, a display unit 1614, and an output unit 1615. Is provided.

  The captured image capturing unit 1611 outputs an imaging on signal to the imaging unit 164 and causes the imaging unit 164 to start an imaging operation. The captured image capturing unit 1611 sequentially captures images in the imaging area 63 captured by the imaging unit 164. The captured image capturing unit 1611 stores the captured images in the RAM 163 in the order in which the captured images are captured by the imaging unit 164.

  Here, an image captured by the captured image capturing unit 1611 will be described with reference to FIG. FIG. 5 is a diagram illustrating an example of an image captured by the captured image capturing unit. As illustrated in FIG. 5, the captured image capturing unit 1611 stores an image D corresponding to the imaging area 63 in the RAM 163.

  The code detection unit 1612 detects the barcode BC from the image D captured by the captured image capture unit 1611 and stored in the RAM 163. Specifically, the code detection unit 1612 detects a barcode BC by a pattern matching technique from the image D stored in the RAM 163, detects a two-dimensional code from a predetermined finder pattern, and the like. In addition, when a plurality of barcodes BC are detected from the image D, the code detection unit 1612 selects a barcode BC having the highest degree of coincidence with a preset code symbol among the plurality of detected barcodes BC. Suppose that the barcode BC is detected from the image D.

  When the code detection unit 1612 detects the barcode BC, the reading unit 1613 reads product information such as a product code from the barcode BC detected by the code detection unit 1612. The reading unit 1613 stores the read product information in the RAM 163.

  The display unit 1614 displays the barcode BC detected by the code detection unit 1612 on the image D captured by the captured image capture unit 1611 and stored in the RAM 163 while the product information is being read by the reading unit 1613. The image including the code symbol display is displayed.

  FIG. 6 is a diagram illustrating an example of an image displayed on the display device. In this embodiment, the display unit 1614 causes the code detection unit 1612 to display the image D stored in the RAM 163 captured by the captured image capture unit 1611 while the product information is being read by the reading unit 1613. An image D1 including a frame 601 surrounding the detected barcode BC is displayed on the display device 106. Specifically, when reading of product information by the reading unit 1613 is started, the display unit 1614 reads the image D stored in the RAM 163 by the captured image capturing unit 1611. Then, the display unit 1614 detects the coordinates of the barcode BC in the read image D. Next, the display unit 1614 generates an image D1 in which a frame 601 surrounding the coordinates of the detected barcode BC is superimposed on the read image D, and displays the generated image D1 on the display device 106. Thereby, the operator can confirm that the product information is read from the barcode BC printed on the label L attached to the product A.

  In the present embodiment, the display unit 1614 displays the image D1 including the frame 601 surrounding the barcode BC detected by the code detection unit 1612 on the display device 106 as the code symbol display. The image D is not limited to this as long as an image including a code symbol display indicating the barcode BC is displayed. For example, the display unit 1614 may display on the display device 106 an image including an area display such as an arrow indicating an area where the barcode BC detected by the code detection unit 1612 exists in the image D as a code symbol display. .

  Further, the display unit 1614 displays a guide display indicating that the barcode BC is not detected on the display device 106 when the barcode detector 1612 does not detect the barcode BC.

  FIG. 7 is a diagram illustrating an example of an image displayed on the display device. In the present embodiment, the display unit 1614 guides and displays a message 701 indicating that the barcode BC such as “No symbol” has not been detected in the image D when the barcode detector 1612 does not detect the barcode BC. Is displayed on the display device 106. Specifically, the display unit 1614 reads the image D stored in the RAM 163 by the captured image capturing unit 1611 when the barcode BC is not detected by the code detection unit 1612. Then, the display unit 1614 generates an image D2 in which the message 701 is superimposed on the read image D, and displays the generated image D2 on the display device 106. Thereby, the operator can recognize that the product information is not read from the barcode BC printed on the label L attached to the product A.

  Furthermore, when a plurality of barcodes BC are detected from the image D by the code detection unit 1612, the display unit 1614 displays the barcode BC having the highest degree of coincidence with a preset code symbol among the plurality of barcodes BC. An image including a code symbol display is displayed on the display device 106.

  FIG. 8 is a diagram illustrating an example of an image displayed on the display device. In the present embodiment, when a plurality of barcodes BC attached to the products A, A ′, and A ″ are detected by the code detection unit 1612, the display unit 1614 is set in advance among the plurality of barcodes BC. An image 603 including a frame 601 that surrounds the barcode BC having the highest degree of coincidence with the code symbol (the barcode BC attached to the product A) is displayed on the display device 106. Specifically, when reading of product information by the reading unit 1613 is started, the display unit 1614 reads the image D stored in the RAM 163 by the captured image capturing unit 1611. The display unit 1614 then displays the barcode BC (product A) determined to have the highest degree of coincidence with the code symbol preset by the code detection unit 1612 among the plurality of barcodes BC included in the read image D. The coordinates of the barcode BC) attached to the image D are detected. Next, the display unit 1614 generates an image D3 in which a frame 801 surrounding the coordinates of the detected barcode BC is superimposed on the read image D, and displays the generated image D3 on the display device 106. As a result, when the operator accidentally puts the products A, A ′, and A ″ into the imaging range of the imaging unit 164 at the same time, the plurality of barcodes BC attached to the products A, A ′, and A ″. Since it is possible to recognize which product information has been read from the barcode BC attached to any product, when reading the product information of the remaining products, the product information of the products for which the product information has already been read is displayed. It can prevent reading.

  When the product information is stored in the RAM 163 by the reading unit 1613, the output unit 1615 outputs the product information stored in the RAM 163 to the POS terminal 11. The POS terminal 11 performs sales registration of the product A based on the product information received from the code reading device 101.

  Next, the flow of product information output processing by the code reader 101 will be described. FIG. 9 is a flowchart showing a flow of output processing of product information by the code reading apparatus according to the present embodiment.

  When processing is started in response to the start of product registration by the POS terminal 11, the captured image capturing unit 1611 outputs an imaging on signal to the imaging unit 164 and starts imaging by the imaging unit 164 (step S901). . Next, the captured image capturing unit 1611 captures the image D captured by the imaging unit 164 and stored in the RAM 163 (step S902). Next, the code detection unit 1612 detects the barcode BC included in the image D captured by the captured image capture unit 1611 (step S903).

  The reading unit 1613 determines whether the barcode BC is detected by the code detection unit 1612 (step S904). If the barcode BC is not detected (step S904: No), the process returns to step S902, and the process for the next image D is performed.

  When the barcode BC is detected (step S904: Yes), the reading unit 1613 reads product information from the detected barcode BC (step S905). The product information read by the reading unit 1613 is output to the POS terminal 11 by the output unit 1615. In the POS terminal 11, the sales registration of the product related to one transaction is performed by referring to the PLU file F1 based on the input product information. The display unit 1614 includes a frame 601 that surrounds the barcode BC detected by the code detection unit 1612 in the image D captured by the captured image capture unit 1611 while the product information is being read by the reading unit 1613. The displayed image D1 (see FIG. 6) is displayed on the display device 106 (step S906).

  Next, the CPU 161 determines the presence / absence of business end from the POS terminal 11 based on the end notification of product registration (step S907). When the business is continued (step S907: No), the CPU 161 returns to step S902 to continue the process for the next image D. When the business is to be ended (step S907: Yes), the CPU 161 outputs an imaging off signal to the imaging unit 164, ends the imaging by the imaging unit 164 (step S908), and ends the process.

  As described above, according to the code reading apparatus 101 according to the present embodiment, the image D is captured, the captured image D is captured, and the barcode BC indicating the product information of the product to be registered for sale is detected from the captured image D. By reading the product information from the detected barcode BC and displaying the image including the code symbol display indicating the detected barcode BC on the captured image D while the product information is being read, Since it can be confirmed whether BC is in the imaging range of the imaging unit 164, if the barcode BC attached to the product A is not in the imaging range of the imaging unit 164, the product A is again selected. The barcode BC need not be read over the imaging unit 164.

  The program executed by the code reading apparatus 101 according to the present embodiment is provided by being preinstalled in the ROM 162 or the like, but is a CD-ROM or flexible disk (FD) in an installable or executable format file. Further, the recording medium may be provided by being recorded on a computer-readable recording medium such as a CD-R or a DVD (Digital Versatile Disk).

  Furthermore, the program executed by the code reading apparatus 101 according to the present embodiment may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. In addition, the program executed by the code reading apparatus 101 of the present embodiment may be provided or distributed via a network such as the Internet.

101 Code reader 161 CPU
162 ROM
163 RAM
164 Imaging unit 1611 Captured image capturing unit 1612 Code detection unit 1613 Reading unit 1614 Display unit

Japanese Patent Laid-Open No. 06-223271

Claims (4)

Imaging means;
Capture means for capturing an image of the imaging area imaged by the imaging means;
Detecting means for detecting a code symbol indicating product information from the image of the imaging area;
Reading means for reading product information from the code symbol detected by the detection means;
Display means for displaying an image including a frame surrounding the detected code symbol as a code symbol display in the image of the imaging area while the product information is read;
When a plurality of code symbols are detected from the image of the imaging area, the detecting unit selects a code symbol having the highest degree of coincidence with a preset code symbol from the plurality of code symbols. A code reading device characterized in that the code symbol is detected from the code symbol. The code reading apparatus according to claim 1, wherein the display unit displays a guide display indicating that no code symbol is detected when the code symbol is not detected by the detection unit. Computer
Capture means for capturing an image of the imaging area captured by the imaging means;
Detecting means for detecting a code symbol indicating product information from the image of the imaging area;
Reading means for reading product information from the code symbol detected by the detection means;
While the product information is being read, the image of the imaging area functions as display means for displaying an image including a frame surrounding the detected code symbol as a code symbol display,
When a plurality of code symbols are detected from the image of the imaging area, the detecting unit selects a code symbol having the highest degree of coincidence with a preset code symbol from the plurality of code symbols. Program to be code symbol detected from. 4. The program according to claim 3, wherein the display means displays a guide display indicating that no code symbol is detected when the code symbol is not detected by the detecting means.

Images