JP2013121134A - Imaging device, commodity sales processing device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To eliminate the need to provide a plurality of illumination boards even if a product reading device includes a plurality of imaging units, and also to eliminate the need to increase the number of times for light irradiation from the illumination boards.SOLUTION: An imaging device of an embodiment comprises first imaging means, generation means, irradiation means, and second imaging means. The first imaging means acquires an image in which a first imaging region is imaged according to a first imaging control signal which causes imaging at prescribed intervals. The generation means generates an illumination control signal which makes the irradiation means irradiate an irradiation region including the first imaging region with light in synchronization with imaging by the first imaging means, and a second imaging control signal which causes imaging a second imaging region in synchronization with imaging by the first imaging means. The irradiation means irradiates the first imaging region and the second imaging region with light according to the generated illumination control signal. The second imaging means acquires an image by imaging the second imaging region according to the generated second imaging control signal.

Description

  Embodiments described herein relate generally to an imaging apparatus, a merchandise sales processing apparatus, and a program.

  A merchandise processing apparatus that is an input terminal of a POS (Point Of Sales) system includes a keyboard for inputting data, a scanner that reads data from a barcode attached to the merchandise, and data that is input from the keyboard and the scanner. It is equipped with a display that displays the data. In general use, in the case of a product without a barcode, it is essential for an operator of the product processing apparatus to input data using a keyboard. Specifically, the operator needs to input data numerically using a keyboard or to select desired data from options prepared in advance. In view of this, a product processing apparatus has been developed that uses an image recognition function for recognizing a product to be registered from an acquired image, thereby reducing an operator's trouble of inputting data using a keyboard.

  Incidentally, in addition to a scanner that reads data from a barcode attached to a product, a product processing apparatus having an image recognition function that recognizes a product to be registered from the acquired image acquires an image obtained by capturing the barcode. Imaging means (for example, a monochrome camera) and imaging means (for example, a color camera) for acquiring an image used for the image recognition function are provided. In general, in a product processing apparatus including a plurality of imaging units, it is necessary to install irradiation units that irradiate light in the imaging range captured by the plurality of imaging units as many as the number of imaging units, and light from each irradiation unit. It is also necessary to increase the timing of irradiation by the number of imaging means.

  The imaging apparatus according to the embodiment includes a first imaging unit, a generation unit, an irradiation unit, and a second imaging unit. The first imaging unit obtains an image obtained by imaging the first imaging area in accordance with a first imaging control signal for imaging at a predetermined interval. The generating means is synchronized with the imaging by the first imaging means, an irradiation control signal for irradiating light to the irradiation area including the first imaging area, and the imaging means is synchronized with the imaging by the first imaging means. A second imaging control signal for generating an image of the second imaging area substantially the same as the first imaging area is generated. The irradiation unit irradiates light to the irradiation region according to the generated illumination control signal. The second imaging unit acquires an image by imaging the second imaging region in accordance with the generated second imaging control signal.

FIG. 1 is a perspective view showing the overall configuration of the POS system according to the present embodiment. FIG. 2 is a schematic longitudinal side view of the commodity reading apparatus. FIG. 3 is a block diagram illustrating a hardware configuration of the POS terminal and the commodity reading apparatus. FIG. 4 is a conceptual diagram illustrating the data configuration of the product master file. FIG. 5 is a block diagram illustrating functional configurations of the POS terminal and the commodity reading apparatus. FIG. 6 is a timing chart for explaining the exposure timing of the first imaging unit and the second imaging unit and the irradiation timing of the illumination board. FIG. 7 is a flowchart showing an example of the operation of the POS system according to the present embodiment. FIG. 8 is a diagram for explaining a process when a reading process failure occurs.

  Hereinafter, the present embodiment will be described with reference to the drawings. FIG. 1 is a perspective view showing the overall configuration of the POS system according to the present embodiment. As shown in FIG. 1, a POS (Point Of Sales) system 1 includes a POS terminal 11 that performs registration and settlement of commodities related to one transaction. The POS terminal 11 is placed on the upper surface of the drawer 21 on the checkout table 51. The POS terminal 11 controls the opening operation of the drawer 21. The POS terminal 11 has a keyboard 22 that is pressed down by an operator (user) on the top surface. Further, the POS terminal 11 is provided with a display device 23 that displays information toward the operator on the back side of the keyboard 22 when viewed from the operator who operates the keyboard 22. The display device 23 displays information on the display surface 23a. In the POS terminal 11, the touch panel 26 is stacked on the display surface 23a. In addition, the POS terminal 11 has a customer display device 24 erected in a freely rotatable manner on the back side of the display device 23. The customer display device 24 displays information on the display surface 24a. The customer display device 24 shown in FIG. 1 has the display surface 24a facing the front side in FIG. 1, but the customer display device 24 is rotated so that the display surface 24a faces the back side in FIG. To display information to the customer.

  The POS system 1 is provided with a horizontally-long counter-shaped counter table 151 so as to form an L shape with a checkout table 51 on which the POS terminal 11 is placed. A cargo receiving surface 152 is formed on the upper surface of the counter table 151. A shopping basket 153 for storing the product A is placed on the cargo receiving surface 152. The shopping basket 153 can be divided into a first shopping basket 153a brought in by a customer and a second shopping basket 153b positioned at a position sandwiching the commodity reading device 101 from the first shopping basket 153a. The shopping basket 153 is not limited to a so-called basket shape, and may be a tray used in a store such as a bakery store or a donut store.

  On the receiving surface 152 of the counter stand 151, a commodity reading apparatus 101 connected to the POS terminal 11 so as to be able to transmit and receive data is installed. The commodity reading apparatus 101 includes a thin rectangular housing 102. A first reading window 103 and a second reading window 108 provided above the first reading window 103 are arranged on the front surface of the housing 102. A display / operation unit 104 is attached to the upper portion of the housing 102. The display / operation unit 104 is provided with a display device 106 on which a touch panel 105 is laminated. A keyboard 107 is disposed on the right side of the display device 106. A customer display device 109 for providing information to the customer is installed on the back left side of the display / operation unit 104 as viewed from the operator.

  Such a product reading apparatus 101 includes a product reading unit 110 (see FIG. 3). In the commodity reading unit 110, a first imaging unit 164 (see FIG. 2) is disposed on the back side of the first reading window 103, and a second imaging unit 168 is disposed on the back side of the second reading window 108.

  In the first shopping basket 153a brought in by the customer, a product A for one transaction is stored. The commodity A is moved from the first shopping basket 153a to the second shopping basket 153b by the operator's hand. In this moving process, the product A is directed to the first reading window 103 or the second reading window 108 of the product reading apparatus 101. The first imaging unit 164 (see FIG. 2) disposed on the back side of the first reading window 103 optically transmits a product ID (product information) indicating the product A from a code symbol such as a barcode attached to the product A. A monochrome image obtained by capturing the product A that has the first imaging area B1 (see FIG. 2) for reading the image and exists in the first imaging area B1 (see FIG. 2) is acquired. In addition, the second imaging unit 168 (see FIG. 2) disposed on the back side of the second reading window 108 is a range for reading the product ID of the product A from the product image of the product A, and the first imaging area. B2 (see FIG. 2) has a second imaging area B2 at least partially overlapping (or substantially the same as the first imaging area B1 (see FIG. 2)), and the second imaging area B2 (see FIG. 2) A color image is obtained by capturing the product A existing in the. The merchandise reading apparatus 101 detects a merchandise image of all or part of the merchandise A included in the image acquired by the first imaging unit 164 (see FIG. 2) or the second imaging unit 168 (see FIG. 2). In the commodity reading apparatus 101, all or a part of the commodity A is included in at least one of the image acquired by the first imaging unit 164 (see FIG. 2) and the image acquired by the second imaging unit 168 (see FIG. 2). When it is detected that an image is included, the image is output to the POS terminal 11. In the present embodiment, the first imaging unit 164 acquires a monochrome image and the second imaging unit 168 acquires a color image. However, the present invention is not limited to this. For example, the first imaging unit 164 and Even if a color image is acquired by both of the second imaging units 168 and a color image captured by either one (that is, a color image used for the first reading process in the reading unit 504 described later) is converted into a monochrome image. good. The first imaging unit 164 may acquire a color image, and the second imaging unit 168 may acquire a monochrome image.

  When the POS terminal 11 receives the image output from the commodity reading apparatus 101, the image acquired by the first imaging unit 164 (see FIG. 2) and the second imaging unit 168 (see FIG. 2) among the received images. From which the product ID is readable is specified from among the images acquired by the above. When it is determined that the product ID can be read from the image acquired by the first imaging unit 164 (see FIG. 2), the POS terminal 11 is acquired by the first imaging unit 164 (see FIG. 2). A product ID (product information) indicating the product A is read from a code symbol such as a barcode or a two-dimensional code included in the image. Next, the POS terminal 11 stores information related to sales registration of the product A in association with the product ID (for example, product classification, product name, unit price, product image, etc.) from the product master file F1 (see FIG. 4). Information associated with the read product ID is read. Then, the POS terminal 11 registers the sales of the product A by recording the read information in a sales master file (not shown).

  On the other hand, when the POS terminal 11 specifies that the product ID can be read from the image acquired by the second imaging unit 168 (see FIG. 2), the product stored in the product master file F1 (see FIG. 4). With reference to the image, the product A that is a specific object is recognized from all or part of the product images of the product A included in the image acquired by the second imaging unit 168 (see FIG. 2). Next, the POS terminal 11 reads information related to the product A such as the product ID of the recognized product A from the product master file F1 (see FIG. 4). Thereby, the POS terminal 11 reads the product ID (product information) from the image acquired by the second imaging unit 168 (see FIG. 2). Then, the POS terminal 11 registers the sales of the product A by recording the read information in a sales master file (not shown).

  FIG. 2 is a schematic longitudinal side view of the commodity reading apparatus. In the product reading apparatus 101, a product reading unit 110 is built in the housing 102. The product reading unit 110 includes at least a part of the first imaging unit 164 that acquires an image for reading the product ID from the code symbol attached to the product A existing in the first imaging region B1, and the first imaging region B1. A second image acquisition region B2 that overlaps (or substantially the same as the first image pickup region B1) and that obtains an image for reading the product ID from the product image of the product A existing in the second image pickup region B2. An imaging unit 168 is provided.

  The second imaging unit 168 acquires an image obtained by imaging the second imaging region B2 from above the first imaging unit 164. In the present embodiment, the second imaging unit 168 acquires an image obtained by imaging the second imaging region B2 from above the first imaging unit 164, but the first imaging unit 164 acquires the first imaging region B1. If the image which imaged 2nd imaging region B2 from the direction different from the direction which image | photographs is acquired, it will not be limited to this.

  The first imaging unit 164 is disposed in combination with the front cover member 117 disposed on the opposite side of the front cover member 117 and the front cover member 117 disposed on the first imaging region B1 side where the product A is disposed. A box-shaped housing 112 formed of the back-side cover member 118 is included.

  The housing 112 includes an imaging board 113 including a CCD imaging device and an irradiation area D including the first imaging area B1, and an illumination board 116 that is an illumination device that irradiates the irradiation area D with illumination light. And an image processing board 115 that performs image processing on a captured image acquired by a CCD (Charged Coupled Device) imaging device (or a CMOS (Complementary Metal Oxide Semiconductor) imaging device). When a conventional commodity reading apparatus includes a plurality of imaging units, an irradiation unit that irradiates light to an imaging region of the imaging unit is set for each imaging unit. On the other hand, in the present embodiment, the second imaging region B2 of the second imaging unit 168 is made substantially the same as the first imaging region B1 of the first imaging unit 164, so that the illumination board 116 allows the first imaging region B1. Since it is possible to irradiate both the second imaging region B2 and the light, it is not necessary to provide as many irradiation units as the number of imaging units.

  The front cover member 117 has a surface plate 117a positioned closest to the first imaging region B1 in the housing 112 on the first imaging region B1 side, and has a central portion of the surface plate 117a facing inward. A recessed portion 117b is formed. The recessed portion 117b is formed with a quadrangular pyramid-shaped wall whose cross-sectional area decreases toward the back, and an opening 117c is opened at the innermost portion of the recessed portion 117b.

  The imaging board 113 includes an imaging substrate 114 provided with a CCD imaging device that is an area image sensor and a drive circuit for the CCD imaging device, an imaging lens 119 that forms an image of the first imaging region B1 on the CCD imaging device, It has.

  The image processing board 115 is an image processing apparatus, and recognizes one piece of frame data from which the product image can be detected from the moving image data output from the imaging board 113. Then, the image processing board 115 outputs the recognized frame data.

  The illumination board 116 is arrange | positioned in the back | inner side of the opening part 117c. On the board 116a of the illumination board 116, an imaging opening 116c of the imaging board 113 is provided. A plurality of LED light emitting elements 116b are arranged on the board 116a of the illumination board 116 located in the innermost opening 117c of the recessed portion 117b so as to surround the opening 116c. Thereby, the plurality of LED light emitting elements 116b irradiate light to the irradiation region D including the first imaging region B1. In the present embodiment, the irradiation region D is irradiated with light by the LED light emitting element 116b included in the first imaging unit 164. However, the present invention is not limited to this, and the second imaging unit 168 is provided with an irradiation unit. The irradiation region D may be irradiated with light.

  The first imaging unit 164 configured as described above is built in the housing 102 by aligning the position of the opening 117c with the first reading window 103 formed in the housing 102 of the commodity reading apparatus 101. Thereby, the imaging board 113 has its reading optical axis C1 directed to the first imaging region B1 located outside the first reading window 103. The imaging lens 119 has a focal length such that the reflected light from the first imaging region B1 focuses on the CCD image sensor. Thereby, the imaging board | substrate 114 and the imaging lens 119 provided in the imaging board 113 acquire the product image of the product A located in 1st imaging area B1.

  The second imaging unit 168 is arranged in combination with the front side cover member 121 arranged on the second imaging region B2 side where the product A is arranged, and on the opposite side of the front side cover member 121. A box-shaped housing 120 formed of the back-side cover member 122 is included.

  The housing 120 includes an imaging board 123 including a color CCD imaging device (or a color CMOS imaging device) and an image processing board 124 that performs image processing on a captured image acquired by the color CCD imaging device. Yes.

  The front cover member 121 is provided with a surface plate 121a positioned closest to the second imaging region B2 in the housing 120 on the second imaging region B2 side, and in the central portion of the surface plate 121a, inward. A recessed portion 121b is formed. The recessed portion 121b is formed with a quadrangular pyramid-shaped wall whose cross-sectional area decreases toward the back, and an opening 121c is formed in the innermost portion of the recessed portion 121b.

  The image pickup board 123 includes an image pickup substrate 125 including a color CCD image pickup element and a drive circuit for the color CCD image pickup element, and an imaging lens 126 that forms an image picked up in the second image pickup area B2 on the color CCD image pickup element. ing.

  The image processing board 124 is an image processing apparatus, and recognizes one piece of frame data from which the product image can be detected from the moving image data output from the imaging board 123. Then, the image processing board 124 outputs the recognized frame data.

  Further, the second imaging unit 168 has a transparent protective cover 127 in the opening 121c.

  The second imaging unit 168 configured as described above is built in the housing 102 by aligning the position of the opening 121c with the second reading window 108 formed in the housing 102 of the commodity reading apparatus 101. Thereby, the imaging board 123 has its reading optical axis C2 directed to the second imaging region B2 located outside the second reading window 108. The imaging lens 126 has a focal length such that the reflected light from the second imaging region B2 focuses on the color CCD image sensor. Thereby, the imaging board | substrate 125 and the imaging lens 126 provided in the imaging board 123 acquire the product image of the product A located in 2nd imaging region B2.

  FIG. 3 is a block diagram illustrating a hardware configuration of the POS terminal and the commodity reading apparatus. The POS terminal 11 includes a microcomputer 60 as an information processing unit that executes information processing. In the microcomputer 60, a ROM (Read Only Memory) 62 and a RAM (Random Access Memory) 63 are connected by a bus to a CPU (Central Processing Unit) 61 that executes various arithmetic processes and controls each unit.

  The drawer 61, the keyboard 22, the display device 23, the touch panel 26, and the customer display device 24 are all connected to the CPU 61 of the POS terminal 11 through various input / output circuits (all not shown). . These are controlled by the CPU 61.

  The keyboard 22 includes a numeric keypad 22d, a temporary tightening key 22e, and a tightening key 22f on which numbers such as “1”, “2”, “3”.

  An HDD (Hard Disk Drive) 64 is connected to the CPU 61 of the POS terminal 11. The HDD 64 stores programs and various files. All or a part of the programs and various files stored in the HDD 64 are copied to the RAM 63 and sequentially executed by the CPU 61 when the POS terminal 11 is activated. An example of a program stored in the HDD 64 is a product sales data processing program PR. An example of a file stored in the HDD 64 is a product master file F1 distributed and stored from the store computer SC.

  The product master file F1 is a file that stores information related to sales registration of the product A and the product image of the product A in association with each product A to be displayed and sold in the store. FIG. 4 is a conceptual diagram illustrating the data configuration of the product master file. As shown in FIG. 4, the product master file F1 is a product ID for uniquely identifying each product A, a product ID for identifying the product A, a product classification to which the product A belongs, a product name, a unit price, and the like. And the product image of the product A are stored in association with each other.

  Returning to FIG. 3, a communication interface 25 for executing data communication with the store computer SC is connected to the CPU 61 of the POS terminal 11 via an input / output circuit (not shown). The store computer SC is installed in a store backyard or the like. An HDD (not shown) of the store computer SC stores a product master file F1 distributed to the POS terminal 11.

  Further, the CPU 61 of the POS terminal 11 is connected to a connection interface 65 that enables data transmission / reception with the commodity reading apparatus 101. The product reading apparatus 101 is connected to the connection interface 65. The CPU 61 of the POS terminal 11 is connected to a printer 66 that prints on a receipt or the like. The printer 66 prints the transaction content of one transaction on the receipt under the control of the CPU 61.

  The commodity reading apparatus 101 also includes a microcomputer 160. In the microcomputer 160, a ROM 162 and a RAM 163 are connected to a CPU 161 by a bus. The ROM 162 stores a program executed by the CPU 161. An imaging device 167 and an audio output unit 165 are connected to the CPU 161 via various input / output circuits (all not shown). The operations of the imaging device 167 and the audio output unit 165 are controlled by the CPU 161. The display / operation unit 104 is connected to the POS terminal 11 via the connection interface 176. The operation of the display / operation unit 104 is controlled by the CPU 61 of the POS terminal 11.

  The imaging device 167 acquires an image obtained by imaging the first imaging region B1 and an image obtained by imaging the second imaging region B2. In the present embodiment, as described above, the imaging device 167 includes the first imaging unit 164 that acquires the image of the first imaging region B1, the second imaging unit 168 that acquires the image of the second imaging region B2, and the irradiation region. An illumination board 116 for irradiating D with light is provided. The first imaging unit 164 images the first imaging region B1 in accordance with a first exposure timing pulse (first imaging control signal) that causes imaging at a predetermined interval (for example, 1/5000 second) input by the CPU 161. To obtain a monochrome frame image. The illumination board 116 irradiates the irradiation region D with light according to the exposure timing pulse generated by the CPU 161. The second imaging unit 168 captures the second imaging region B2 according to the second exposure timing pulse (second imaging control signal) generated by the CPU 161, and acquires a color frame image. Then, the CPU 161 converts the frame image acquired by the first imaging unit 164 and the frame image acquired by the second imaging unit 168 into an imaging unit (the first imaging unit 164 and the second imaging unit) that acquired the frame images. 168) is added and an image pickup unit ID is added and stored in the RAM 163. The first imaging unit 164 can change the frame rate at which the first imaging region B1 is imaged in accordance with the first exposure timing pulse input by the CPU 161. In addition, the illumination board 116 included in the first imaging unit 164 can also change the intensity at which the LED light emitting element 116b is lit by the CPU 161.

  The audio output unit 165 is an audio circuit and a speaker for generating a preset warning sound or the like. The sound output unit 165 performs notification by sound such as a warning sound under the control of the CPU 161.

  Furthermore, a connection interface 175 that connects to the connection interface 65 of the POS terminal 11 and enables data transmission / reception with the POS terminal 11 is connected to the CPU 161. The CPU 161 outputs the frame images acquired by the first imaging unit 164 and the second imaging unit 168 of the commodity reading apparatus 101 via the connection interface 175 and inputs them to the POS terminal 11 via the connection interface 65.

  Next, functional units of the CPU 161 and the CPU 61 that are realized by the CPU 161 and the CPU 61 sequentially executing programs will be described with reference to FIGS. 5 and 6. FIG. 5 is a block diagram illustrating functional configurations of the POS terminal and the commodity reading apparatus. FIG. 6 is a timing chart for explaining the exposure timing of the first imaging unit and the second imaging unit and the irradiation timing of the illumination board. As shown in FIG. 5, the CPU 161 has functions as an acquisition unit 501, a detection unit 502, and an output unit 503 by sequentially executing programs. Similarly, the CPU 61 has functions as a reading unit 504, a recognition unit 505, and a registration unit 506.

  The capturing unit 501 sequentially captures the frame images acquired by the first imaging unit 164 and the second imaging unit 168 and stored in the RAM 163 after the imaging operation is started. The capturing unit 501 captures frame images in the order stored in the RAM 163.

  Further, as illustrated in FIG. 6, the capturing unit 501 captures the first imaging region B1 by the first imaging unit 164, and the vertical synchronization signal VD and horizontal synchronization for measuring the timing in the vertical direction and the horizontal direction. Using the signal HD as a trigger, a first exposure timing pulse for causing the first imaging unit 164 to perform imaging at a predetermined interval is output to the first imaging unit 164. Thereby, the acquisition unit 501 causes the first imaging unit 164 to perform the master operation by imaging the first imaging region B1 at a predetermined interval.

  Further, as illustrated in FIG. 6, the acquisition unit 501 synchronizes with the first exposure timing pulse output to the first imaging unit 164 (that is, in synchronization with imaging by the first imaging unit 164), and the illumination board 116. An irradiation timing pulse (illumination control signal) that causes the irradiation region D to be irradiated with light is generated. Then, the acquisition unit 501 outputs the generated irradiation timing pulse to the illumination board 116. Thereby, the acquisition unit 501 causes the illumination board 116 to perform a slave operation by irradiating the irradiation region D with light in synchronization with imaging by the first imaging unit 164.

  Furthermore, as illustrated in FIG. 6, the acquisition unit 501 performs the second imaging in synchronization with the first exposure timing pulse output to the first imaging unit 164 (that is, in synchronization with imaging by the first imaging unit 164). A second exposure timing pulse (second imaging control signal) that causes the unit 168 to perform imaging is generated. Then, the acquisition unit 501 outputs the generated second exposure timing pulse to the second imaging unit 168. Thereby, the acquisition unit 501 causes the second imaging unit 168 to perform the slave operation by performing imaging of the second imaging region B2 in synchronization with the first imaging unit 164.

  As described above, the first imaging unit 164 performs the master operation, and the first imaging unit 164 performs the imaging by causing the illumination board 116 and the second imaging unit 168 to perform the slave operation in synchronization with the imaging of the first imaging unit 164. Since there is no need to irradiate light separately for each timing to be performed and for each second imaging unit 168 to perform imaging, it is not necessary to provide a plurality of illumination boards 116 even when the commodity reading apparatus 101 has a plurality of imaging units. In addition, it is not necessary to increase the number of times of irradiating light from the lighting board 116.

  The detection unit 502 detects all or part of the product image of the product A included in the frame image captured by the capture unit 501 using a pattern matching technique, a character recognition technique, or the like.

  In the present embodiment, the detection unit 502 detects the presence or absence of a skin color region from the captured frame image. When the skin color area is detected, that is, when the reflection of the operator's hand is detected, the detection unit 502 extracts a contour line or the like from the binarized image of the captured frame image. Accordingly, the detection unit 502 attempts to extract the contour of the product A that is assumed to be held by the operator's hand. At this time, if the contour indicating the shape of the hand and the other contour are detected, it is determined that the operator is holding the product A.

  The output unit 503 outputs the frame image captured by the capturing unit 501 to the POS terminal 11 via the connection interface 175. The output unit 503 may sequentially output the frame image captured by the capturing unit 501 to the POS terminal 11, but outputs the frame image in which all or part of the product A is detected by the detection unit 502 to the POS terminal 11. It shall be. As described above, the frame image in which all or part of the product A is detected by the detection unit 502 is output to the POS terminal 11, so that the frame image does not include all or part of the product A. It is possible to prevent the POS terminal 11 from reading the merchandise information from the code symbols included in the POS terminal 11 and recognizing the merchandise A executed with reference to the merchandise master file F1. Since reading of product information and recognition processing of a specific object (product A) require processing time, all or part of product A that is not expected to be read of product information or recognition of a specific object is not included. By preventing the processing with the frame image, the processing time can be shortened.

  The reading unit 504 (first reading unit) is a frame image acquired by the first imaging unit 164 among the frame images output from the output unit 503 (a frame image to which the imaging unit ID of the first imaging unit 164 is added). Then, a code symbol such as a barcode or a two-dimensional code is detected, and a first reading process for reading a product ID (product information) for identifying the product A from the detected code symbol is performed.

  The recognizing unit 505 refers to the product image of the product master file F1, and among the frame images output by the output unit 503, the frame image acquired by the second imaging unit 168 (the imaging unit ID of the second imaging unit 168 is the same). The product A is recognized as a specific object by reading the state of the surface such as the hue and the unevenness of the surface from the whole or a part of the image of the product A included in the added frame image). Next, the recognizing unit 505 reads the product ID of the recognized product A from the product master file F1. Accordingly, the recognition unit 505 (second reading unit) is a process different from the first reading process, and performs a second reading process of reading the product ID from the frame image acquired by the second imaging unit 168. In the present embodiment, the recognition unit 505 recognizes the product A by general object recognition. Note that the recognition unit 505 does not consider the outline or size of the product A in order to shorten the processing time. In the POS terminal 11, the product read by the product reading device 101 can be specified from the products registered in advance in the product master file F1 based on the recognition result of the recognition unit 505.

Recognizing an object contained in an image in this way is called generic object recognition. Regarding such general object recognition, various recognition techniques are described in the following documents.
Keiji Yanai, “Current Status and Future of General Object Recognition”, IPSJ Journal, Vol. 48, no. SIG16 [Search August 10, 2010], Internet <URL: http://mm.cs.uec.ac.jp/IPSJ-TCVIM-Yanai.pdf>

Further, techniques for performing general object recognition by dividing an image into regions for each object are described in the following documents.
Jamie Shotton et al., “Semantic Texton Forests for Image Categorization and Segmentation”, [August 10, 2010 search], Internet <URL: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1. 1.145.3036 & rep = rep1 & type = pdf>

  The registration unit 506 stores information related to sales registration of the product A indicated by the product ID read by the reading unit 504 or the product ID indicated by the product ID read by the recognition unit 505 from the product master file F1 (for example, the product A Product ID, product classification, product name, unit price, etc.). Then, the registration unit 506 registers sales of the product A by recording the read information in a sales master file or the like.

  Next, the operation of the POS system 1 will be described in detail. FIG. 7 is a flowchart showing an example of the operation of the POS system according to the present embodiment.

  First, the operation on the commodity reading apparatus 101 side will be described. As shown in FIG. 7, when processing is started in response to the start of product registration by the POS terminal 11, the capture unit 501 uses the vertical synchronization signal VD and the horizontal synchronization signal HD as a trigger to perform the first exposure timing. By generating a pulse and outputting the generated first exposure timing pulse to the first imaging unit 164, imaging by the first imaging unit 164 is started (step S700).

  In addition, the capturing unit 501 generates an irradiation timing pulse and a second exposure timing pulse that are synchronized with the first exposure timing pulse simultaneously with the generation of the first exposure timing pulse, and the generated irradiation timing pulse is sent to the illumination board 116. By outputting and outputting the generated second exposure timing pulse to the second imaging unit 168, the irradiation of light by the illumination board 116 and the imaging by the second imaging unit 168 are started (step S701).

  Next, the capturing unit 501 captures a frame image acquired by the first imaging unit 164 and the second imaging unit 168 and stored in the RAM 163 (step S702). Next, the detection unit 502 obtains the product A from each of the frame image to which the imaging unit ID of the first imaging unit 164 is added and the frame image to which the imaging unit ID of the second imaging unit 168 is added. All or part of the product image is detected (step S703). Next, the output unit 503 includes all or part of the product A from at least one of the frame image to which the imaging unit ID of the first imaging unit 164 is added and the frame image to which the imaging unit ID of the second imaging unit 168 is added. Is detected, the frame image to which the imaging unit ID of the first imaging unit 164 is added and the frame image to which the imaging unit ID of the second imaging unit 168 is added are output to the POS terminal 11 (step S704).

  Next, the CPU 161 determines the presence / absence of business end from the POS terminal 11 based on the end notification of product registration (step S705). When the business is continued (step S705: No), the CPU 161 returns the process to step S702 and continues the process. When the work is to be ended (step S705: Yes), the capturing unit 501 stops the output of the first exposure timing pulse, the irradiation timing pulse, and the second exposure timing pulse, and the first imaging unit 164 and the second imaging unit. The imaging by the unit 168 and the light irradiation by the illumination board 116 are terminated (step S706), and the process is terminated.

  Next, the operation on the POS terminal 11 side will be described. As illustrated in FIG. 7, when processing is started in response to the start of product registration in response to an operation instruction on the keyboard 22, the CPU 61 outputs the imaging unit ID of the first imaging unit 164 output from the product reading device 101. The frame image to which the added frame image and the imaging unit ID of the second imaging unit 168 are added is received (step S707). Next, the reading unit 504 detects the code symbol from the frame image to which the imaging unit ID of the first imaging unit 164 is added, and reads the product ID from the detected code symbol. Processing is executed (step S708). Further, the recognizing unit 505 refers to the product image of the product master file F1, and from the product image of the product A included in the frame image to which the imaging unit ID of the second imaging unit 168 is added among the received frame images. A second reading process for recognizing the product A and reading the product ID of the recognized product A from the product master file F1 is executed (step S709).

  When the first reading process by the reading unit 504 and the second reading process by the recognition unit 505 are performed and the product ID read by the reading unit 504 matches the product ID read by the recognition unit 505, the registration unit 506 Performs sales registration of the product A indicated by the product ID read by the reading unit 504 (or the product A indicated by the product ID read by the recognition unit 505) (step S710).

  Here, when the product ID read by the first reading process by the reading unit 504 and the product ID read by the second reading process by the recognition unit 505 do not match, the registration unit 506 performs the first reading process. Sales registration of the product A indicated by the product ID read by the preset reading process (for example, the first reading process) out of the product ID read by the second reading process and the product ID read by the second reading process is performed. To do. In the present embodiment, the product indicated by the product ID read by the first reading process when the product ID read by the first reading process does not match the product ID read by the second reading process. Although sales registration of A is performed, the present invention is not limited to this, and sales registration of the product A indicated by the product ID read by the second reading process may be performed.

  In addition, when any one of the first reading process by the reading unit 504 and the second reading process by the recognition unit 505 fails and the product ID is not read, the registration unit 506 performs the successful reading process. Assume that sales registration of the product A indicated by the read product ID is performed.

  FIG. 8 is a diagram for explaining a process when a reading process failure occurs. In FIG. 8, a frame image 801 is a monochrome frame image acquired by the first imaging unit 164, and a frame image 802 is a color frame image acquired by the second imaging unit 168. As shown in FIG. 8, when the barcode image 803 included in the frame image 801 is unclear and the reading of the product ID from the barcode image 803 fails in the first reading process, the recognition unit 505 performs the second reading process. By executing general object recognition (object recognition) using the frame image 802 acquired by the second imaging unit 168, the product X of the product X is recognized by recognizing what the product X included in the frame image 802 is. Read the ID. Then, the registration unit 506 performs sales registration of the product A indicated by the product ID read from the frame image 802 by the recognition unit 505. Accordingly, when the product ID is read from the code symbol such as a barcode and the product reading apparatus 101 performs a reading operation while holding the product A over the first imaging region B1. If reading of the product ID from the frame image obtained by imaging the second imaging area B2 that is substantially the same as the first imaging area B1 is successful, the product A is again held over the first imaging area B1. Since the sales registration of the product A is performed without the need, the operational feeling of the operator who operates the product reading apparatus 101 can be improved.

  Next, the CPU 61 determines whether or not there is an end of business due to the end of sales registration by an operation instruction of the keyboard 22 (step S711). When business is to be continued (step S711: No), the CPU 61 returns the process to step S707 and continues the process. When the business is to be ended (step S711: Yes), the CPU 61 ends the process.

  As described above, according to the POS system 1 according to the present embodiment, the first imaging unit 164 that acquires an image obtained by imaging the first imaging region B1 according to the first exposure timing pulse that performs imaging at a predetermined interval, and the first imaging. The irradiation timing pulse for irradiating the irradiation region D including the first imaging region B1 in synchronization with the imaging by the unit 164, and substantially the same as the first imaging region B1 in synchronization with the imaging by the first imaging unit 164 A capturing unit 501 that generates a second exposure timing pulse for performing imaging of the second imaging region B2, an illumination board 116 that irradiates light to the irradiation region D according to the generated irradiation timing pulse, and a generated second A second imaging unit 168 that captures an image of the second imaging region B2 in accordance with the exposure timing pulse and acquires an image, thereby enabling the first imaging unit 164 to capture an image. Since there is no need to irradiate light separately for the timing at which the image capturing and the second imaging unit 168 perform imaging, it is not necessary to provide a plurality of illumination boards 116 even when the commodity reading apparatus 101 has a plurality of imaging units. In addition, it is not necessary to increase the number of times of irradiating light from the lighting board 116.

  Further, according to the POS system 1 according to the present embodiment, the second imaging unit 168 images the second imaging region B1 from a direction different from the direction in which the first imaging unit 164 images the first imaging region B1. The product ID can be read by the second reading process for the image acquired by the second imaging unit 168 even when the product ID is not read by the first reading process for the image acquired by the first imaging unit 164. In some cases, the reading accuracy of the product ID can be improved.

  Further, according to the POS system 1 according to the present embodiment, the second imaging unit 168 acquires an image obtained by imaging the second imaging region B2 from above the first imaging unit 164, so that the same line of sight as the operator is obtained. The image of the product X can be acquired and the product ID can be read.

  Note that the program executed by the POS terminal and the product reading apparatus of the present embodiment is provided by being incorporated in advance in a ROM or the like, but is not limited to this, and is a file in an installable format or an executable format. In such a case, the program may be recorded on a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (Digital Versatile Disk).

  Furthermore, the program executed by the POS terminal and the commodity reading apparatus of the present embodiment may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. Further, the program executed by the POS terminal and the product reading apparatus of the present embodiment may be provided or distributed via a network such as the Internet.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 POS system 11 POS terminal 101 Goods reading apparatus 116 Illumination board 164 1st imaging part 168 2nd imaging part 501 Capture part 502 Detection part 503 Output part 504 Reading part 505 Recognition part 506 Registration part

JP 2010-267175 A

The imaging apparatus according to the embodiment includes a first imaging unit, a generation unit, an irradiation unit, and a second imaging unit. The first imaging unit obtains an image obtained by imaging the first imaging area in accordance with a first imaging control signal for imaging at a predetermined interval. The generation means synchronizes with the imaging by the first imaging means, and controls the illumination control signal for irradiating the irradiation area including the first imaging area and the imaging with the first imaging means . A second imaging control signal for performing imaging of the two imaging areas is generated. The irradiation unit irradiates light to the first imaging region and the second imaging region according to the generated illumination control signal. The second imaging unit acquires an image by imaging the second imaging region in accordance with the generated second imaging control signal.

Claims (6)

First imaging means for acquiring an image obtained by imaging the first imaging area in accordance with a first imaging control signal for imaging at a predetermined interval;
An irradiation control signal for irradiating light to an irradiation area including the first imaging area in synchronization with imaging by the first imaging means, and the first imaging area in synchronization with imaging by the first imaging means Generating means for generating a second imaging control signal for imaging substantially the same second imaging area;
Irradiating means for irradiating the irradiation area with light according to the generated illumination control signal;
Second imaging means for capturing an image of the second imaging region in accordance with the generated second imaging control signal;
An imaging apparatus comprising:   The imaging apparatus according to claim 1, wherein the second imaging unit acquires an image obtained by imaging the second imaging region from a direction different from a direction in which the first imaging unit images the first imaging region.   The imaging apparatus according to claim 2, wherein the second imaging unit acquires an image obtained by imaging the second imaging region from above the first imaging unit. The first imaging unit acquires a monochrome image obtained by imaging the first imaging region,
The imaging apparatus according to claim 1, wherein the second imaging unit acquires a color image obtained by imaging the second imaging area. First imaging means for acquiring an image obtained by imaging the first imaging area in accordance with a first imaging control signal for imaging at a predetermined interval;
An irradiation control signal for irradiating light to an irradiation area including the first imaging area in synchronization with imaging by the first imaging means, and the first imaging area in synchronization with imaging by the first imaging means Generating means for generating a second imaging control signal for imaging substantially the same second imaging area;
Irradiating means for irradiating the irradiation area with light according to the generated illumination control signal;
Second imaging means for capturing an image of the second imaging region in accordance with the generated second imaging control signal;
First reading means for reading product information by first processing from an image acquired by the first imaging means;
Second reading means for reading product information from an image acquired by the second imaging means by a second process different from the first process;
Registration means for registering sales of the product indicated by the product information read by the first reading means or the second reading means;
Product sales processing device with First imaging means for acquiring an image obtained by imaging a first imaging area according to a first imaging control signal for imaging at a predetermined interval, and an irradiation area including the first imaging area according to an illumination control signal for performing light irradiation An imaging apparatus comprising: irradiation means for irradiating light; and second imaging means for acquiring an image obtained by imaging a second imaging area substantially the same as the first imaging area in accordance with a second imaging control signal for performing imaging. The computer to control,
The irradiation control signal for irradiating the irradiation area with light in synchronization with imaging by the first imaging means, and the imaging of the second imaging area in synchronization with imaging by the first imaging means Generating means for generating a second imaging control signal;
Program to function as.

Images