JP5489928B2 - Product code reader and program - Google Patents

Description

  Embodiments described herein relate generally to a product code reader and a program.

  Conventionally, in a store such as a supermarket, a code symbol such as a barcode or a two-dimensional code (for example, QR code (registered trademark)) attached to a product is imaged by a digital camera such as a CCD image sensor and detected from the captured image. A product code reading device is used that reads a product code by detecting and decoding the generated code symbol. The store clerk registers the products purchased by the customer by taking out the products stored in the shopping cart brought to the counter stand and holding them over the digital camera of the product code reader.

  By the way, in the product code reading device, before a clerk registers a product purchased by a customer, it is necessary to set the clerk as a regular user. For example, an input operation such as an identification number of a clerk preset as a user and a password is performed before the registration operation of the product. However, the above-described conventional product code reading apparatus requires time and effort for setting as a user, which is troublesome. In addition, the store clerk has to remember his / her identification number and password, which is not easy to use.

In order to solve the above-described problem, an embodiment of the present invention includes an imaging unit, an actuator, an image capturing unit, an authentication unit, a code reading unit, a control unit, and an output unit. This is a featured product code reader. The imaging means captures an image. The actuator moves a support member that supports the imaging unit to adjust a direction in which the imaging unit captures an image. Image capturing means captures an image in which the imaging means has captured. The authentication unit authenticates the user by comparing at least a part of the captured image with an authentication image set in advance for each user. When the user is authenticated, the code reading unit detects a code symbol included in the captured image and reads code information corresponding to the code symbol. The control means controls the actuator and directs the imaging means in the first direction when reading code information using the code reading means, and the imaging when authenticating a user using the authentication means. Orient the means in the second direction. The output means outputs the read code information as read information.

Further, an embodiment of the present invention provides a computer of a product code reading apparatus having an imaging unit that captures an image, and an actuator that adjusts a direction in which the imaging unit captures an image by moving a support member that supports the imaging unit. The program is made to function as an image capturing unit, an authenticating unit, a code reading unit, and an output unit. The image capturing unit captures an image captured by the imaging unit. The authentication unit authenticates the user by comparing at least a part of the captured image with an authentication image set in advance for each user. When the user is authenticated, the code reading unit detects a code symbol included in the captured image and reads code information corresponding to the code symbol. The control means controls the actuator and directs the imaging means in the first direction when reading code information using the code reading means, and the imaging when authenticating a user using the authentication means. Orient the means in the second direction. The output means outputs the read code information as read information.

FIG. 1 is an external perspective view schematically showing the configuration of a checkout lane system. FIG. 2 is a block diagram showing the configuration of the product code reading apparatus according to the present embodiment. FIG. 3 is a flowchart showing an example of the operation of the product code reading apparatus according to the present embodiment. FIG. 4 is a cross-sectional external view illustrating the configuration of the camera. FIG. 5 is a cross-sectional external view illustrating the configuration of the camera.

  Hereinafter, a product code reading device and a program according to the present embodiment will be described with reference to the drawings, taking a checkout lane system as an example. The checkout lane system includes a POS terminal that registers and settles a product for one transaction, and a product code reading device that reads a product code attached to the product, and is an example of a store system. This embodiment is an application example to a checkout lane system introduced in a store such as a restaurant or a supermarket.

  FIG. 1 is an external perspective view schematically showing the configuration of the checkout lane system 4. As shown in FIG. 1, a checkout lane system 4 includes a soccer stand 1 for placing a shopping basket containing merchandise, a merchandise code reader 2 erected substantially in the center of the soccer stand 1, A code reader 2 and a POS terminal 3 connected to each other via a transmission path (not shown) are provided.

  The POS terminal 3 performs sales registration of products purchased by customers. As shown in FIG. 1, the POS terminal 3 includes a keyboard 31, an operator (store clerk) display 32, a customer display 33, a receipt printing printer 34, a cash drawer 35, and the like. Etc. are provided. The keyboard 31 is provided with a fastening key or the like necessary for settlement of the commodity price. The POS terminal 3 has the same configuration and functions as the POS terminal that is used as standard in this type of checkout lane system.

  The product code reading device 2 reads a code symbol (hereinafter referred to as a bar code) such as a barcode or a two-dimensional code attached to the product when the store clerk holds the product over the reading window 21 and includes the product included in the barcode. This is a device for outputting information to the POS terminal 3. As shown in FIG. 1, the product code reading device 2 mainly includes a reading window 21, a keyboard 22, a customer display 23 a, a store clerk display 23 b, a card reading unit 24, and a buzzer 25. . The keyboard 22 accepts operator operations using various keys. For example, the keyboard 22 accepts input from various keys when registering a product that cannot be registered with a barcode. The customer display 23a is a display that displays information for the customer, and displays, for example, the name and price of the registered product to the customer. The store clerk display 23b is a display that displays information for the store clerk, and displays, for example, the name and price of the registered product to the store clerk. The card reading unit 24 reads information recorded on a magnetic card or an IC card. The buzzer 25 sounds a buzzer sound when the barcode attached to the product is read, and notifies the operator. The product code reader 2 provided with the reading window 21 has a camera 20 (see FIG. 2) built therein.

  FIG. 2 is a block diagram showing the configuration of the product code reading device 2 according to the present embodiment. The product code reader 2 includes a CPU 50 (Central Processing Unit), a ROM 42 (Read Only Memory), a RAM 43 (Random Access Memory), a communication I / F 44, an input / output port 46, a keyboard controller 47, and a display controller. 48, a camera controller 49, and a memory 45, which are mainly connected by a bus line 41 such as an address bus or a data bus.

  The CPU 50 functions as a control unit that controls the overall operation of the product code reading device 2. The ROM 42 stores programs according to the present embodiment, other programs that control the operation of the CPU 50, and the like. The RAM 43 functions as a work area when the CPU 50 develops various programs stored in the ROM 42. The RAM 43 stores various data such as image data captured by the camera 20.

  The communication I / F 44 is connected to information devices such as a POS terminal 3 (see FIG. 1) connected via a bus (not shown) and a store computer (not shown) that manages and manages store data. Control data communication. The input / output port 46 is a communication port connected to the card reading unit 24 and the buzzer 25, and inputs data read by the card reading unit 24 and outputs a drive signal to the buzzer 25. The keyboard controller 47 captures key signals from the keyboard 22. The display controller 48 controls data display on the customer display 23a and the store clerk display 23b. The camera controller 49 controls the imaging operation of the camera 20.

  The camera 20 is a digital camera such as a CCD image sensor or a CMOS image sensor. The camera 20 captures an image (a user's face in the present embodiment) of a bar code attached to a product and a user (store clerk) who uses the product code reading device 2 or the POS terminal 3.

  The memory 45 is a rewritable nonvolatile memory or the like, and stores setting data such as authentication data F. This setting data stores data distributed from the POS terminal 3 or the store computer. The authentication data F is data in which an authentication image is set in advance for each store clerk who performs product registration using the product code reading device 2 or the POS terminal 3. Specifically, for each identification code (store clerk code) uniquely assigned to a store clerk, image data obtained by capturing the face of the store clerk is set in association with the authentication image. Note that the image data itself associated with each identification code need not be included in the authentication data F. For example, a file including image data may be provided separately from the authentication data F in the memory 45 by designating a file name or storage address for storing the image data for each identification code.

  Here, a functional configuration of the product code reading device 2 realized by the CPU 50 executing the program will be described. The CPU 50 operates according to a program stored in the ROM 42 expanded in the RAM 43, so that an image data capturing unit 51, a barcode reading unit 52, an authentication unit 53, and an information output unit 54 are operated as shown in FIG. Function as.

  The image data capturing unit 51 outputs an imaging on signal to the camera controller 49 to cause the camera 20 to start an imaging operation. The image data capturing unit 51 captures image data (frame image) in the imaging area captured by the camera 20 after the imaging operation is started, and stores it in the image work area of the RAM 43.

  The barcode reading unit 52 detects a barcode included in the frame image captured by the image data capturing unit 51. Specifically, barcode detection by a pattern matching technique from a captured frame image, detection of a two-dimensional code from a predetermined finder pattern, and the like are performed. The barcode reader 52 reads the code information corresponding to the detected barcode by converting the detected barcode into code information (for example, JAN code) according to a predetermined rule. Thereby, when the barcode attached to the product is imaged when the product is imaged by the reading window 21, the barcode reading unit 52 corresponds to the barcode from the frame image in which the barcode is captured. Code information (for example, a product code) can be read.

  The authentication unit 53 authenticates the user by comparing at least a partial region of the frame image captured by the image data capturing unit 51 with the authentication image set for each user in the authentication data F. Do. Specifically, the authentication unit 53 detects a human face area from the frame image, and compares the detected face area image with a face image preset for each user in the authentication data F. Then, the user's face authentication is performed.

  More specifically, the authentication unit 53 detects a skin color area from the frame image captured by the image data capturing unit 51. The authentication unit 53 also binarizes the frame image to extract a contour line, and extracts a contour portion of a preset face shape. Next, when the contour portion of the extracted face shape is a skin color region, the authentication unit 53 sets the contour portion as a face region. Next, the authentication unit 53 compares the detected face area image with the face image set for each user in the authentication data F using a known pattern matching technique, and compares the facial features (eyes, ears, A user who uses a facial image whose similarity is equal to or greater than a predetermined value.

  The information output unit 54 outputs code information such as a product code read by the barcode reading unit 52 to the POS terminal 3 via the communication I / F 44 as read information. Thereby, the POS terminal 3 refers to the product master information in which the product name, product classification, unit price, etc. are set for each product code based on the code information such as the product code read by the product code reading device 2. Thus, the product read by the product code reading device 2 is specified. Next, the POS terminal 3 sets the specified product as a product that the customer purchases, and performs sales registration and settlement.

  Next, the operation of the product code reading device 2 according to the present embodiment will be described in detail. FIG. 3 is a flowchart showing an example of the operation of the product code reading apparatus 2 according to the present embodiment.

  As shown in FIG. 3, when the process is started, the image data capturing unit 51 outputs an imaging on signal to the camera controller 49 and starts imaging by the camera 20 (S1). Next, the CPU 50 determines whether or not the user authenticated by the authentication unit 53 has been set (S2). In the initial stage of activation, the user is not set because the authentication unit 53 does not authenticate the user. By authenticating the user in S10 to S19 described later, the authenticated user is set.

  When the user has been set (S2: YES), the CPU 50 sets the operation mode of the product code reading device 2 to the product reading mode (S3). In this commodity reading mode, the code information is read from the image captured by the camera 20 and captured by the image data capturing unit 51, so the direction in which the camera 20 captures is the front direction (first direction) of the reading window 21. To do.

  4 and 5 are cross-sectional external views illustrating the configuration of the camera 20. As shown in FIGS. 4 and 5, in the camera 20, an image sensor 201 such as a CCD image sensor or a CMOS image sensor is supported by a support member 202. The support member 202 is fixed at the position shown in FIG. 4 or FIG. This sliding movement is realized by an actuator (not shown) driven by the camera controller 49 under the control of the CPU 50. That is, in S <b> 4, as shown in FIG. 4, under the control of the CPU 50, the direction of the imaging area 70 a by the imaging element 201 is controlled to be the front of the reading window 21. As described above, in the product code reading device 2, in the product reading mode, the direction of the imaging area 70a by the image sensor 201 is the front of the reading window 21 so that the barcode attached to the product is smoothly read. I have to.

  The camera 20 is not limited to the configuration illustrated in FIGS. 4 and 5 in particular as long as it can adjust the imaging direction. For example, a mirror may be provided between the image sensor 201 and the reading window 21, and the angle of the mirror may be adjusted by an actuator.

  Next, the image data capturing unit 51 captures the image data in the imaging area 70a captured by the camera 20 and stores it in the image work area of the RAM 43 (S4). Next, the barcode reading unit 52 detects a barcode included in the image captured by the image data capturing unit 51, and performs barcode reading processing for reading code information corresponding to the detected barcode (S5). . Next, the information output unit 54 outputs the code information read by the barcode reading unit 52 as read information to the POS terminal 3 via the communication I / F 44 (S6), and advances the process to S7.

  In S <b> 7, the CPU 50 determines the presence / absence of business end from the POS terminal 3 based on the end notification of product registration. When the business is continued (S7: NO), the CPU 50 returns the process to S2 and continues the process. When the job is to be ended (S7: YES), the CPU 50 outputs an imaging off signal to the camera controller 49, ends the imaging by the camera 20 (S8), and ends the process.

  When the user has not been set (S2: NO), the CPU 50 sets the operation mode of the product code reading device 2 in the authentication mode (S10). In this authentication mode, in order to perform face authentication of the user from an image captured by the camera 20 and captured by the image data capturing unit 51, the direction in which the camera 20 captures is a direction upward from the front direction of the reading window 21 ( In the second direction). Specifically, as shown in FIG. 5, under the control of the CPU 50, the direction of the imaging area 70 a by the imaging element 201 is controlled to be upward from the front of the reading window 21. As described above, in the product code reader 2, in the authentication mode, the direction of the imaging area 70a by the imaging element 201 is directed upward so that the face of the person to be authenticated can be easily captured. In particular, when imaging for reading a product and imaging of a person's face to be authenticated are performed using the same camera 20, the imaging direction is switched between the first direction and the second direction described above. As a result, it is possible to perform imaging according to the application.

  Next, the CPU 50 issues a notification prompting the user to set by using a notification sound from the buzzer 25 or a display screen on the store clerk display 23b (S11). By this notification, the store clerk who uses the product code reading device 2 can recognize that the user is not set and authentication is required.

  Next, the image data capturing unit 51 captures the image data in the imaging area 70a captured by the camera 20 and stores it in the image work area of the RAM 43 (S12). Next, the authentication unit 53 determines whether or not a human face has been detected from the image captured by the image data capturing unit 51 (S13). If the face of the person cannot be detected (S13: NO), the process returns to S11 because the face of the person to be authenticated is not reflected in the frame image acquired this time.

  When a human face can be detected (S13: YES), the authentication unit 53 compares the detected face with the face image set for each user in the authentication data F (S15). Next, the authentication unit 53 determines whether or not the similarity is equal to or greater than a predetermined value as a result of the comparison in S15 and the detected face matches the user registered in the authentication data F (S16). .

  If there is no face image with a similarity equal to or greater than the predetermined value and the detected face does not match the user registered in the authentication data F (S16: NO), the authentication unit 53 causes the buzzer 25 to provide a notification sound or a clerk. The user is notified that the user is not registered on the display screen of the display 23b (S17), and the process returns to S11.

  When there is a face image having a similarity point equal to or greater than a predetermined value and the detected face matches the user registered in the authentication data F (S16: YES), the authentication unit 53 is authenticated for the matching user. The user is set (S18). Next, since the user has been authenticated and set, the CPU 50 ends the authentication mode (S19), and advances the process to S7.

  As described above, the product code reading device 2 includes the image data capturing unit 51, the barcode reading unit 52, the authentication unit 53, and the information output unit 54. The image data capturing unit 51 captures an image captured by the camera 20. When the user is authenticated (S2: YES), the barcode reading unit 52 detects a code symbol included in the captured image and reads code information corresponding to the code symbol. The authentication unit 53 performs user authentication (S18) by comparing at least a part of the captured image with an authentication image preset for each user in the authentication data F. The information output unit 54 outputs the read code information as read information. Therefore, the merchandise code reading device 2 can easily set the user before reading the merchandise without performing an input operation such as a store clerk identification number and a password.

  In the present embodiment, the configuration in which the authentication unit 53 performs face authentication using a face image preset for each user in the authentication data F is exemplified. However, the authentication image set in advance for each user is not limited to the user's face, but the user's physical features (for example, wrinkles of the hand) and articles that the user usually possesses You may use the image which imaged (a driver's license, a shop assistant's card, etc.). In this case, the user can be authenticated by causing the reading window 21 to read the physical features of the user and the articles that the user usually possesses.

  The program executed by the product code reading device 2 of the present embodiment is provided by being incorporated in advance in a ROM or the like. The program executed by the product code reading apparatus 2 of the present embodiment is a file in an installable format or an executable format, such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk), or the like. You may comprise so that it may record and provide on a computer-readable recording medium.

  Furthermore, the program executed by the product code reading device 2 of the present embodiment may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. Further, the program executed by the product code reading device 2 of the present embodiment may be configured to be provided or distributed via a network such as the Internet.

  The program executed by the product code reading device 2 of the present embodiment has a module configuration including the above-described units (image data capturing unit 51, bar code reading unit 52, authentication unit 53, information output unit 54). As actual hardware, a CPU (processor) reads out and executes a program from the ROM, and the above-described units are loaded onto the main storage device. The image data capturing unit 51, the barcode reading unit 52, and the authentication unit 53 are loaded. The information output unit 54 is generated on the main storage device.

2 Product code reader 3 POS terminal 4 Checkout lane system 20 Camera 21 Reading window 41 Bus line 42 ROM
43 RAM
44 Communication I / F
45 Memory 49 Camera controller 50 CPU
51 Image Data Acquisition Unit 52 Barcode Reading Unit 53 Authentication Unit 54 Information Output Unit 70a Imaging Area 201 Imaging Element 202 Supporting Member 203 Receiving Unit F Authentication Data

JP 2008-33640 A

Claims (5)

An imaging means for capturing an image;
An actuator that moves a support member that supports the imaging unit to adjust a direction in which the imaging unit captures an image;
An image capturing means for capturing an image of the imaging means has captured,
An authentication means for authenticating a user by comparing at least a partial area of the captured image with an authentication image set in advance for each user;
Code reading means for detecting a code symbol included in the captured image and reading code information corresponding to the code symbol when the user is authenticated;
When the actuator is controlled and the code information is read using the code reading means, the imaging means is directed in the first direction, and when the user is authenticated using the authentication means, the imaging means is set to the second direction. Control means for directing in the direction of
Output means for outputting the read code information as read information;
A product code reading device comprising: The authentication means compares at least a partial area of the captured image with a user's physical feature portion or an image of an article on the user that is preset for each user. Authenticating,
The product code reading device according to claim 1. The authentication unit detects a face area of a person from the captured image, and performs face authentication for comparing the detected face area with the face image of the user set in advance for each user. ,
The product code reading device according to claim 1. An imaging means for capturing an image;
A product code reader computer having an actuator that moves a support member that supports the imaging unit to adjust a direction in which the imaging unit captures an image .
An image capturing means for capturing an image of the imaging means has captured,
An authentication means for authenticating a user by comparing at least a partial area of the captured image with an authentication image set in advance for each user;
Code reading means for detecting a code symbol included in the captured image and reading code information corresponding to the code symbol when the user is authenticated;
When the actuator is controlled and the code information is read using the code reading means, the imaging means is directed in the first direction, and when the user is authenticated using the authentication means, the imaging means is set to the second direction. Control means for directing in the direction of
Output means for outputting the read code information as read information;
A program characterized by making it function. The authentication unit detects a face area of a person from the captured image, and performs face authentication for comparing the detected face area with the face image of the user set in advance for each user. ,
The program according to claim 4 .

Images