JP2012038215A - Code reader and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a code reader and a program which can detect more reliably fraudulence in commodity sales registration.SOLUTION: A code reader of an embodiment comprises imaging means, capturing means, reading means, storage control means and detecting means. The capturing means captures images taken by the imaging means. The reading means detects a code symbol representing commodity information of a commodity from the image captured by the capturing means, and reads commodity information represented by the code symbol from the detected code symbol. The storage control means stores the read commodity information and the image captured by the capturing means in association with each other in a storage unit. The detecting means detects fraudulence by using the images stored in the storage unit.

Description

  Embodiments described herein relate generally to a code reader and a program.

  2. Description of the Related Art Conventionally, in supermarkets and the like, a code reading device is used in which a code symbol such as a barcode attached to a product is imaged by an image sensor such as a CCD camera, and barcode data is read from the captured image.

  Patent Document 1 discloses a technique related to a handy type scanner that decodes a label image captured by a CCD camera. In contrast to such handy-type scanners, vertical-type scanners installed on counters such as supermarkets allow operators to handle products using both hands, rather than reading bar codes with handy-type scanners. Can also increase work efficiency.

  By the way, in recent years, a point-of-sale (POS) terminal for self-checkout is provided for customers to perform sales registration and accounting processing of purchased products, and a sales form in which customers perform sales registration and accounting processing of products has been adopted. There are an increasing number of stores. In such a POS terminal for self-checkout, the customer scans the barcode attached to the product with a scanner and registers the sale of the product. Therefore, instead of the barcode attached to the actually purchased product, There is a problem that illegal sales registration occurs such as scanning a barcode attached to the product with a scanner.

  The code reading apparatus according to the embodiment includes an imaging unit, a capturing unit, a reading unit, a detecting unit, a storage control unit, and a detecting unit. The capturing unit captures an image captured by the imaging unit. The reading unit detects a code symbol representing product information of a product from the image captured by the capturing unit, and reads product information represented by the code symbol from the detected code symbol. The storage control unit stores the read product information and the image captured by the capture unit in a storage unit in association with each other. The detection means detects fraud using an image stored in the storage unit.

FIG. 1 is a schematic diagram showing the overall system configuration. FIG. 2 is a perspective view showing a self-checkout terminal. FIG. 3 is a perspective view showing a state in which the shopping bag is held by the holding arm. FIG. 4 is a block diagram showing an electrical hardware configuration of the payment terminal. FIG. 5 is a diagram illustrating an example of the relationship between the product and the imaging area of the camera. FIG. 6 is a diagram for explaining the product master file. FIG. 7 is a block diagram showing a functional configuration of the payment terminal according to the present embodiment. FIG. 8 is a diagram illustrating an example of image data captured by the capturing unit. FIG. 9 is an example of image data stored in the product master file. FIG. 10 is a flowchart showing the procedure of merchandise sales registration processing performed by the payment terminal.

  FIG. 1 is a schematic diagram showing the overall system configuration. The system of the present embodiment is constructed by connecting a plurality of self-checkout systems 11, a plurality of POS terminals 21, and a store controller 31 via a communication network 41. The self-checkout system 11 is configured by assigning one attendant terminal 501 to a plurality of self-checkout terminals 101. The self-checkout terminal 101 is a terminal for reading product information from a bar code affixed to a product purchased by a customer and selling registration of the product purchased by the customer. 301.

  FIG. 2 is a perspective view showing a self-checkout terminal. The self-checkout terminal 101 includes a settlement terminal 201 and a scale device 301.

  The payment terminal 201 has a housing 202 from which a product basket mounting table 102 for mounting a basket (not shown) containing products to be purchased by a customer protrudes from the side.

  The housing 202 of the payment terminal 201 includes a base housing 202a installed on the floor and an upper housing 202b placed on the upper surface of the base housing 202a. The front surface of the base housing 202a is inclined so as to narrow the projected area of the base housing 202a as it goes downward. As a result, the base housing 202a has a shape that is offset toward the back as it goes downward.

  In the upper housing 202 b, a camera 203 such as a CCD (Charged Coupled Device) camera is disposed on the product basket mounting table 102 side, and a printer cover 204 is disposed on the opposite side of the product basket mounting table 102. A card insertion slot 212 is disposed between the camera 203 and the printer cover 204.

  The camera 203 is built in a reading window 203a formed of a glass plate, and is an imaging unit that images a code symbol such as a barcode or a two-dimensional code attached to a product, a product, and the like.

  The printer cover 204 is provided with a receipt issuing port 208. A receipt printer 251 (see FIG. 4) is built in the back side of the printer cover 204, and a receipt (not shown) printed by the receipt printer 251 is issued from a receipt issuing port 208. The printer cover 204 is attached to the upper housing 202b so as to be freely opened and closed.

  A card reader / writer 252 (see FIG. 4) that is a magnetic card reader / writer capable of reading and writing data with respect to the magnetic card is built in the card insertion slot 212. A credit card is inserted into the card insertion slot 212 as a magnetic card.

  The upper housing 202b is attached with an LCD 210 as a display unit for displaying the product name, price, image, etc. of the product registered for sale to the shopper. On the screen of the LCD 210, there is a touch panel 211 as an input unit on which various keys for accepting input when performing sales registration of a product that cannot be registered with a code symbol, a closing key necessary for settlement of the product price, and the like are arranged. Laminated.

  The base housing 202a incorporates a coin / banknote deposit / withdrawal device 221 (see FIG. 4). As a part of the deposit / withdrawal device 221, a coin insertion slot 213 is disposed on the central upper surface of the base housing 202a, and a coin payout outlet 214 is disposed on the left side of the coin insertion slot 213. Further, on the right side of the coin insertion slot 213, a bill insertion slot 215 and a banknote outlet 216 are arranged. Such a depositing / withdrawing apparatus 221 has a mechanism that enables handling of coins and banknotes, and a controller that controls the mechanism (not shown). About the structure of such a mechanism part, the process procedure in a control part, etc., since the content is known, description is abbreviate | omitted.

  Further, a display pole 217 as an alarm device for displaying the current state of the self-checkout terminal 101 is erected from the back surface of the base housing 202a. The display pole 217 has a light emitting portion 218 that selectively emits blue and red light at the tip.

  Next, the scale device 301 will be described with reference to FIGS. 2 and 3. FIG. 3 is a perspective view showing a state in which the shopping bag is held by the holding arm. The scale device 301 is configured such that a scale pan 303 is provided on an upper portion of a scale housing 302, and a bag holder 304 is attached to the scale pan 303. The weighing pan 303 has a mounting table 303a on its upper surface. The bag holder 304 is attached to the mounting table 303a. Therefore, when viewed from the bag holder 304, the weighing pan 303 constitutes a pedestal. That is, a pole-shaped arm support portion 305 is erected at the rear center portion of the mounting table 303a, and a temporary mounting table 306 for mounting an article is fixed to the upper end of the arm support unit 305. The temporary placement table 306 is a table that has a flat upper surface and is used for temporarily placing a product after a code symbol or product image is captured by the camera 203 of the payment terminal 201. Both the mounting table 303a and the temporary mounting table 306 play a role as a mounting unit for mounting a product to which a product code is input.

  A pair of holding arms 307, a hook 308, and a camera holding arm 311 are attached to the lower surface of the temporary table 306. That is, the arm attachment 309 (see FIG. 3) is fixed to the both ends of the lower surface of the temporary placing table 306. The fixing is performed by various fixing methods such as screwing and adhesive fixing. A holding arm 307 is embedded in each of the arm attachments 309. Further, a hook / camera mounting tool 310 (see FIG. 3) is fixed at the center of the lower surface of the temporary placing table 306. The fixing is performed by various fixing methods such as screwing and adhesive fixing. A hook 308 and a camera holding arm 311 are embedded in the hook / camera attachment 310.

  The holding arm 307 has a register bag 401 as a storage member such as a plastic bag provided to a customer in a supermarket or the like, that is, an opening 402 and a pair of grips 403 protruding from the opening 402. In order to hold the shopping bag 401 folded so that the 403 is positioned on both sides, the pair of grips 403 are held in a skewered state. In order to realize such a holding state, a slit 404 is formed in the handle 403. In addition, the plastic bag 401 is formed with a pair of ears 406 that are positioned between the pair of handles 403 and can be removed by the perforation 405, and hooks 407 are formed in these ears 406. ing. The hook 308 is inserted through the hooking hole 407, thereby holding the shopping bag 401 together with the holding arm 307. The camera holding arm 311 is provided above the opening 402 of the plastic bag 401 held by the holding arm 307, and a CCD camera or the like that captures an image in the plastic bag 401, which is a storage member for storing products registered for sale. The camera 312 (housing member imaging unit) is held.

  FIG. 4 is a block diagram showing an electrical hardware configuration of the payment terminal. The payment terminal 201 has a control unit 253 as an information processing unit therein. For example, the control unit 253 may have a semiconductor chip configuration in which an operation sequence is written, or may have a microcomputer configuration in which an operation program is stored in a RAM (Random Access Memory) 254 or the like. Here, the control unit 253 having a microcomputer configuration will be introduced.

  The central part of the control unit 253 is a CPU (Central Processing Unit) 255. The CPU 255 includes a ROM (Read Only Memory) 256 that stores fixed data in a fixed manner, a RAM 254 that stores rewritable data in a rewritable manner, a VRAM 257 that generates a display image to be displayed on the LCD 210, and an HDD 258. Connected through.

  The control unit 253 mediates data communication with the cameras 203 and 312, the LCD 210, the touch panel 211, the card reader / writer 252, the receipt printer 251, the light emitting unit 218, and the deposit / withdrawal device 221 via the system bus 259. An interface 260 is connected and is controlled by the control unit 253. In addition, a communication interface 261 is also connected to the control unit 253 via a system bus 259. The communication interface 261 is connected to the communication network 41 and realizes data communication between the attendant terminal 501 and the store controller 31 and the self-checkout terminal 101. Note that, although not shown, an interface that realizes data communication with the scale device 301 is also connected to the control unit 253 via the system bus 259.

  As described above, the camera 203 images a code symbol or a product attached to the product. As described above, the camera 312 captures an image in the shopping bag 401.

  Here, the relationship between the product processed by the settlement terminal 201 according to the present embodiment and the imaging areas of the cameras 203 and 312 will be described with reference to FIG. FIG. 5 is a diagram illustrating an example of the relationship between the product and the imaging area of the camera. In FIG. 5, an area surrounded by a chain line is an imaging area 500 that is an area that the cameras 203 and 312 can capture in one frame. A label 502 on which a barcode 503 is printed is attached to the product 501 shown in FIG.

  The label 502 displays product information such as a product name “xxx”, a unit price “200 yen”, a capacity “500 ml”, a barcode 503, and the like. The bar code 503 incorporates information such as a product code as product information necessary for sales registration of the product 501 with the POS terminal 21. In addition, a product code “20120300000015” incorporated in the barcode 503 is displayed in numbers below the barcode 503.

  The HDD 258 stores a product master file T (see FIG. 6), a sales file for storing sales data, and the like in addition to a program for operating the control unit 253. FIG. 6 is a diagram for explaining the product master file. The product master file T stores product information extracted from the label 502 and the like by character recognition processing such as OCR, product information such as unit price and weight, image data captured by the camera 203, and the like in association with the product code. It is a storage unit.

  Next, characteristic functions of the payment terminal 201 according to the present embodiment will be described. FIG. 7 is a block diagram showing a functional configuration of the payment terminal according to the present embodiment. The CPU 255 operates according to a program stored in the HDD 258 expanded in the RAM 254, so that as shown in FIG. 7, a capturing unit 701, a reading unit 702, a storage control unit 704, a detection unit 705, a display control unit 706, and It functions as the output unit 707.

  When receiving the instruction from the reading unit 702, the capturing unit 701 outputs an imaging on signal to the camera 203 and causes the camera 203 to start an imaging operation. The capturing unit 701 captures image data in the imaging area 500 captured by the camera 203 and stores the captured image data in the RAM 254.

  Further, when receiving an instruction from the reading unit 702, the capturing unit 701 outputs an imaging on signal to the camera 312 to cause the camera 312 to start an imaging operation. Then, the capturing unit 701 captures image data in the imaging area 500 captured by the camera 312 (image data in the shopping bag 401) and stores it in the RAM 254.

  FIG. 8 is a diagram illustrating an example of image data captured by the capturing unit. As shown in FIG. 8, the image data 800 captured by the capturing unit 701 includes a label 502 attached to the product 501, a barcode 503 displayed on the label 502, and the product 501. .

  The reading unit 702 detects the barcode 503 from the image data 800 (image data in the imaging area 500 captured by the camera 203) stored in the RAM 254 by the capturing unit 701, and the product 501 from the detected barcode 503. A barcode reading process for reading information is performed.

  More specifically, the reading unit 702 binarizes one frame of image data 800 (image data in the imaging area 500 captured by the camera 203) stored in the RAM 254, and stores the barcode 503 in the binarized data. It is detected whether or not there is a data area regarding. When the reading unit 702 detects a data area related to the barcode 503 in the captured image data 800, the reading unit 702 reads barcode data (JAN code) obtained by decoding the barcode 503 as product information of the product 501. The barcode data includes a manufacturer code, a product code as product information, a check digit, and the like. The reading unit 702 stores the read barcode data in the RAM 254. The reading unit 702 performs character recognition processing such as OCR (Optical Character Reader) on one frame of image data 800 (image data in the imaging area 500 captured by the camera 203) stored in the RAM 254. Thus, the product name, unit price, capacity, and the like are read as product information of the product 501. The reading unit 702 stores the read product information in the RAM 254.

  The storage control unit 704 determines whether the product code included in the barcode data read by the reading unit 702 and stored in the RAM 254 is already stored in the product master file T stored in the HDD 258. If the storage control unit 704 determines that the product code included in the barcode data is not stored in the product master file T, the storage control unit 704 stores the product code included in the barcode data stored in the RAM 254, the product name, Product information such as unit price and capacity and image data 800 stored in the RAM 254 (image data in the imaging area 500 captured by the camera 203) are associated with each other and stored in the product master file T. This saves the operator from having to take an image of the product 501 and store it in the product master file T using the captured product 501 image, so that the maintenance of the image of the product 501 stored in the product master file T can be saved. Can be facilitated.

  In the present embodiment, the storage control unit 704 stores the image data 800 stored in the RAM 254 in the product master file T. However, the image of the product 501 can be detected from the image data 800 stored in the RAM 254. Alternatively, the image of the detected product 501 may be stored in the product master file T. Specifically, a background image as a background of the product 501 is set in advance, and an image excluding the preset background image is detected from the image data 800 stored in the RAM 254, whereby the image of the product 501 is changed. To detect. Here, the background image is an image of clothes or the like of an operator who operates the settlement terminal 201. For example, if the operator is a store clerk at the settlement terminal 201, the apron image worn by the store clerk is set as the background image.

  The detection unit 705 reads product information using the capacity associated with the product code included in the barcode data stored in the RAM 254 in the product master file T and the load measured by the scale device 301. It is determined whether or not a product that has not been stored in the shopping bag 401. The detection unit 705 does not match the weight converted from the capacity associated with the product code included in the barcode data stored in the RAM 254 in the product master file T with the load measured by the scale device 301. Detect fraud.

  If the detection unit 705 determines that the product code included in the barcode data stored in the RAM 254 is already stored in the product master file T, the detection unit 705 uses the image data 800 stored in the product master file T. To detect fraud. Note that the detection unit 705 deletes the barcode data, the merchandise information, and the image data 800 stored in the RAM 254 when detecting fraud.

  Specifically, when the detection unit 705 determines that the product code included in the barcode data stored in the RAM 254 is already stored in the product master file T, the image data 800 captured by the capture unit 701 is displayed. Pattern matching is performed between the image data in the imaging area 500 captured by the camera 203 and the image data 800 in which the product code included in the barcode data stored in the RAM 254 is associated in the product master file T. The detecting unit 705 then compares the image data 800 captured by the capturing unit 701 with the image data 800 in which the product code included in the barcode data stored in the RAM 254 is associated in the product master file T. Detect fraud if not done.

  Here, an example of fraud detection by the detection unit 705 will be described with reference to FIGS. 5, 8, and 9. FIG. 9 is an example of image data stored in the product master file.

  In the conventional self-checkout terminal, even if a bar code of another product is illegally affixed to the product 501, the weight associated with the product code included in the barcode data in the product master file T, and the weighing device When the load measured by 301 is the same, fraud could not be detected.

  However, in the present embodiment, the detection unit 705 detects the image data 900 of other products associated with the product code included in the barcode data read from the illegally attached barcode from the product master file T (see FIG. 9). Then, the detection unit 705 performs pattern matching between the read image data 900 of other products and the image data 800 (image data in the imaging area 500 captured by the camera 203) captured by the capture unit 701. Detect fraud when does not match. Accordingly, fraud can be detected even if the barcode data is read from the barcode of another product having the same weight as the product 501 instead of the barcode 503 of the product 501 to be actually purchased.

  Furthermore, the detection unit 705 performs pattern matching between the image data 800 in the imaging area 500 captured by the camera 203 and the image data 800 in the shopping bag 401, and detects fraud if they do not match. . Accordingly, even if a product having the same weight as the product from which the barcode data has been read is stored in the shopping bag 401 instead of the product from which the barcode data has been read, fraud can be detected.

  The display control unit 706 displays the image data 800 captured by the capturing unit 701 (image data in the imaging area 500 captured by the camera 203) on the LCD 210. Accordingly, the operator can perform the barcode data reading operation while confirming whether or not the product from which the barcode data is read is a desired product.

  The output unit 707 outputs barcode data to the POS terminal 21 via the communication I / F 261 when the detection unit 705 detects no fraud.

  Next, merchandise sales registration processing performed by the payment terminal 201 will be described with reference to FIG. FIG. 10 is a flowchart showing the procedure of merchandise sales registration processing performed by the payment terminal.

  The CPU 255 of the settlement terminal 201 starts an information output process when a business activation is instructed by a command from the POS terminal 21. The capturing unit 701 outputs an imaging on signal to the camera 203 and causes the camera 203 to start an imaging operation (step S1001). Then, the capturing unit 701 captures the image data 800 captured by the camera 203 and stores it in the RAM 254 (step S1002).

  The reading unit 702 starts the barcode reading process described above (step S1003). Further, the display control unit 706 displays the image data 800 stored in the RAM 254 by the capturing unit 701 on the LCD 210 (step S1004).

  Next, the storage control unit 704 determines whether or not the product code read by the barcode reading process by the reading unit 702 is stored in the product master file T stored in the HDD 258 (step S1005). When the product code read by the barcode reading process is stored in the product master file T (step S1005: Yes), the detection unit 705 uses the product code read by the barcode reading process in the product master file T. Fraud is detected using the image data 800 stored in association with each other (step S1006). When the product code read by the barcode reading process by the reading unit 702 is not stored in the product master file T stored in the HDD 258 (step S1005: No), the storage control unit 704 is stored in the RAM 254. The product code, product information, and image data 800 are associated with each other and stored in the product master file T (step S1012).

  If no fraud is detected by the detection unit 705 (step S1007: No), the output unit 707 outputs the barcode data stored in the RAM 254 to the POS terminal 21 (step S1008). On the other hand, when the detection unit 705 detects fraud (step S1007: Yes), the detection unit 705 deletes the barcode data, the product information, and the image data 800 stored in the RAM 254 (step S1011).

  Thereafter, when the end of the barcode reading process is instructed by a command from the POS terminal 21, the reading unit 702 ends the barcode reading process (step S1009: Yes) and outputs an imaging off signal to the camera 203. (Step S1010).

  As described above, according to the settlement terminal 201 according to the present embodiment, the barcode is obtained from the camera 203, the capture unit 701 that captures the image data 800 captured by the camera 203, and the image data 800 captured by the capture unit 701. 503 is detected, the reading unit 702 that reads the product code represented by the barcode 503 from the detected barcode 503, and the read product code and the image data 800 captured by the capturing unit 701 are associated with each other, and the product master file T Instead of the bar code 503 of the product 501 to be actually purchased, the storage control unit 704 to be stored in the image data 800 and the detection unit 705 that detects fraud using the image data 800 stored in the product master file T. Even if barcode data is read from barcodes of other products, fraud is detected. It is possible to, it is possible to detect the fraud in the sales registration of goods more reliably.

  Note that the program executed by the settlement terminal 201 according to the present embodiment may be provided by being incorporated in advance in the ROM 256 or the like. The program executed by the settlement terminal 201 of the present embodiment is a file in an installable format or an executable format, such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk). You may comprise so that it may record and provide on a computer-readable recording medium.

  Furthermore, the program executed by the payment terminal 201 of the present embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Further, the program executed by the payment terminal 201 of the present embodiment may be configured to be provided or distributed via a network such as the Internet.

201 Payment terminal 203, 312 Camera 255 CPU
258 HDD
701 Capture unit 702 Reading unit 704 Storage control unit 705 Detection unit 706 Display control unit

Japanese National Patent Publication No. 10-501360

Claims (6)

Imaging means;
Capture means for capturing an image captured by the imaging means;
Reading means for detecting a code symbol representing product information of a product to be registered for sale from the image captured by the capturing unit, and reading the product information represented by the code symbol from the detected code symbol;
Storage control means for associating and storing the read product information and the image captured by the capture means in a storage unit;
Detecting means for detecting fraud using the image stored in the storage unit;
A code reading device comprising:   In the case where the read product information is already stored in the storage unit, the detection unit matches the image already stored in association with the read product information and the image captured by the capture unit. The code reading device according to claim 1, wherein fraud is detected when not. A storage member imaging means for capturing an image in the storage member for storing the product;
The capture means captures an image in the storage member imaged by the storage member imaging means,
The code according to claim 2, wherein the detection unit detects fraud when the image in the storage member captured by the capture unit does not match the image captured by the capture unit. Reader.   The code reading device according to claim 1, further comprising a display control unit that displays the captured image on a display unit. Computer
Capture means for capturing an image captured by the imaging means;
A reading unit that detects a code symbol representing product information of a product from the image captured by the capturing unit, and reads the product information represented by the code symbol from the detected code symbol;
Storage control means for associating and storing the read product information and the image captured by the capture means in a storage unit;
Detecting means for detecting fraud using the image stored in the storage unit;
Program to function as.   In the case where the read product information is already stored in the storage unit, the detection unit matches the image already stored in association with the read product information and the image captured by the capture unit. 6. The program according to claim 5, wherein fraud is detected if not.

Images