JP2019062499A - Code recognition apparatus, code recognition method, and code recognition program - Google Patents

Abstract

To provide a code recognition apparatus, a code recognition method, and a code recognition program, for efficiently determining authenticity using code images.SOLUTION: A user terminal 10 includes a control unit 11, an imaging unit 13, and an illumination unit 14. Then, the control unit 11 detects a code image area in a first image photographed using ambient light, decodes first code recognition information in the code image area, detects the code image area in a second image photographed using the illumination unit 14, decodes second code recognition information in the same code image area included in the first image, and, when the first code recognition information and the second code recognition information are different, determines that the second code recognition information is authentic and specifies the code information.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a code recognition apparatus, code recognition method and code recognition program for acquiring information from a code image.

  In order to provide various information, code images such as barcodes and two-dimensional codes are used. A technique for capturing such a code image and reading identification code information is also being studied (see, for example, Patent Document 1).

  In addition, a two-dimensional code using a plurality of colors has also been studied (see, for example, Patent Document 2). In the technique described in this document, each of the two-dimensional code regions corresponding to the item to be detected is specified among the two-dimensional code attached to the item included in the image. Specifically, based on an edge image generated from an acquired image (original image), extraction of candidate regions in the edge image, characteristic features of corresponding regions in the original image corresponding to the extracted candidate regions After determining whether or not any pattern is included, the area of the two-dimensional code is detected in the original image. Also, color determination processing is performed on the area of each cell of the detected two-dimensional code area, and the encoded information is identified based on the determination result of the color of the area of each cell.

JP, 2009-198266, A JP 2012-33033 A

  However, in the technique described in Patent Document 2, it is necessary to perform decoding in order to determine the authenticity of the code image. Moreover, since the code image is always visible, the method of determining the authenticity is limited.

  A code recognition device that solves the above-mentioned problems includes an imaging unit and a control unit. The control unit detects a code image area in a first image captured using a first light source, decodes the first code recognition information in the code image area, and captures a second image captured using a second light source. In the image, a code image area is detected, and second code recognition information is decoded in the same code image area included in the first image, and the first code recognition information and the second code recognition information are different, The second code recognition information is determined to be authentic, and code information is specified.

  According to the present invention, the code image can be used to efficiently determine authenticity.

BRIEF DESCRIPTION OF THE DRAWINGS The system schematic of this embodiment. Explanatory drawing of the process sequence of this embodiment. It is explanatory drawing of the process sequence of this embodiment, Comprising: (a) is a genuine code image usually taken, (b) is a genuine code image shot in flash, (c) is a code image of a fake normally photographed, ( d) An illustration of a fake code image captured in flash, (e) a code image of other fake captured normally, and (f) a code image of another fake captured in flash. Explanatory drawing of the process sequence of other embodiment. Explanatory drawing of the process sequence of other embodiment.

  An embodiment of the present invention will now be described with reference to FIGS. 1 to 3. In the present embodiment, a code recognition apparatus, a code recognition method, and a code recognition program used when acquiring information using a code image will be described. In the present embodiment, a security code image that can determine the authenticity of the code image is used.

As shown in FIG. 3A, as a security code image (code image 300), an image (color code image) divided into a plurality of areas and colored in each area is used. As the color code image, for example, the technology disclosed in Patent Document 2 can be used. In this color code image, a plurality of areas (cells 302) surrounded by a frame 301 defining a code image area are colored in a plurality of predetermined colors, and the combination of the colors allows each code image to be identified. . In the present embodiment, each cell 302 of the code image 300 is printed with an ink (hereinafter referred to as retroreflective ink) which can not be seen (not seen) by visible light but can be identified by flashlight. Therefore, as shown in FIG. 3A, the code image 300 captured normally is an image of only the frame 301. By using the retroreflective ink, incident light from a specific direction is reflected in the same direction as the incident direction, as shown in FIG. The color (code element) of the cell 302 can be raised. In FIG. 3 (b), each color is represented by a difference of hatching.
In order to provide information using such a code image 300, in the present embodiment, the user terminal 10 is used as a code recognition device.

  As shown in FIG. 1, the user terminal 10 is an information processing terminal used by a user, such as a smartphone terminal or a tablet terminal. The user terminal includes a control unit 11, a touch panel display 12, an imaging unit 13, an illumination unit 14, and the like. The touch panel display 12 functions as an input unit and an output unit. The imaging unit 13 captures a code image and acquires this color image. The illumination unit 14 emits a light source (flash light).

  The control unit 11 includes control means (CPU, RAM, ROM, etc.) and performs code analysis processing. Therefore, the control unit 11 functions as the image acquisition unit 111, the illumination control unit 112, and the code analysis unit 113 by executing the code recognition program stored in the storage unit.

  The image acquisition unit 111 executes a process of acquiring a photographed image (color image) from the photographing unit 13 in ambient light (first light source). Here, ambient light means ambient light when the illumination unit 14 is not caused to emit light. Furthermore, the image acquisition unit 111 acquires a captured image in conjunction with light emission of the illumination unit 14 described later.

The illumination control unit 112 executes a process of controlling a flash light (a flash light source as a second light source) of the illumination unit 14.
The code analysis unit 113 functions as a decoder, specifies a frame of the code image by an edge image (layout pattern) of the color code in the acquired color image, and extracts the code image. Then, the code analysis unit 113 decodes the colored code image to acquire code information.

Next, the processing procedure of the code recognition method of the security code image will be described according to FIG. 2 using the system configured as described above.
First, the control unit 11 of the user terminal 10 executes a normal shooting process (step S1-1). Specifically, when the user desires to determine the authenticity of the security code image, the user terminal 10 activates a code recognition program for confirming the security code image. Then, the imaging unit 13 of the user terminal 10 captures a security code image. In this case, the image acquisition unit 111 of the control unit 11 acquires a photographed image (color image) photographed using the photographing unit 13. In this case, the illumination unit 14 does not emit the flash light, and ambient light is used.

  Next, the control unit 11 of the user terminal 10 performs frame detection processing (step S1-2). Specifically, the code analysis unit 113 of the control unit 11 detects a frame of a code image in the captured image by layout pattern recognition.

  Next, the control unit 11 of the user terminal 10 executes determination processing as to whether or not code recognition is possible (step S1-3). Specifically, the code analysis unit 113 of the control unit 11 determines whether or not decoding is possible in each cell of the code image detected in the captured image (first image). If code information (first code recognition information) can be obtained and thus decoding is possible, it is determined that code recognition is possible.

  When it is determined that the code can be recognized (in the case of “YES” in step S1-3), the control unit 11 of the user terminal 10 executes fake determination processing (step S1-4). Specifically, the code analysis unit 113 of the control unit 11 outputs a message indicating that the image is not a security code image on the touch panel display 12. Then, the code recognition process is ended.

  On the other hand, when it is determined that the code recognition is not possible (in the case of “NO” in step S1-3), the control unit 11 of the user terminal 10 executes the flash photographing process (step S1-5). Specifically, the illumination control unit 112 of the control unit 11 instructs the illumination unit 14 to emit the flash light. In this case, the image acquisition unit 111 acquires from the imaging unit 13 a captured image (second image) when the flash light is emitted.

  Next, the control unit 11 of the user terminal 10 executes frame detection processing (step S1-6). Specifically, the code analysis unit 113 of the control unit 11 detects a frame in the captured image when the flash light is emitted at the same position as the frame position detected in step S1-2.

  Next, as in step S1-3, the control unit 11 of the user terminal 10 executes determination processing as to whether or not code recognition is possible (step S1-7). Here, when the code information (the second code recognition information) can be obtained and thus the code information can be decoded, it is determined that the code can be recognized.

When it is determined that the code can be recognized (in the case of “YES” in step S1-7), the control unit 11 of the user terminal 10 executes an authenticity determination process (step S1-8). Specifically, the code analysis unit 113 of the control unit 11 determines that the image is a security code image, and outputs the decoding result to the touch panel display 12.
On the other hand, also when it is determined that the code can not be recognized (in the case of “NO” in step S1-7), the control unit 11 of the user terminal 10 executes fake determination processing (step S1-4).

The photographed code image will be described with reference to FIG.
When the code image 300 shown in FIG. 3A is obtained in the normal shooting process (step S1-1), and the code image 300 shown in FIG. 3B is obtained in the flash shooting process (step S1-5) In step S1-8, an authenticity determination process is performed (step S1-8).

  When the code image 310 shown in FIG. 3C is obtained in the normal shooting process (step S1-1), and the code image 310 shown in FIG. 3D is obtained in the flash shooting process (step S1-5) In step S1-4, a fake determination process is performed (step S1-4).

  When the code image 320 shown in FIG. 3E is acquired in the normal shooting process (step S1-1), the fake object determination process is executed (step S1-4). In this case, even when the flash shooting process (step S1-5) is performed, the code image 320 shown in FIG. 3 (f) is obtained to be the same as the code image 320 shown in FIG. 3 (e), It is not a security code image.

According to the present embodiment, the following effects can be obtained.
(1) In the present embodiment, as the code image 300, an image (color code image) divided into a plurality of cells 302 and colored in each cell 302 is used. The code image 300 is printed with retroreflective ink which is invisible (invisible) with visible light but whose color can be identified by flashlight. By using the retroreflective ink, it is possible to determine the authenticity of the security code image from the image captured using the ambient light (first light source) and the flash light (second light source).

  (2) In the present embodiment, when it is determined that code recognition is possible (in the case of “YES” in step S1-3), the control unit 11 of the user terminal 10 executes fake determination processing (step S1-4) . Thus, information indicating that the image is not a security code image can be quickly output.

  (3) In the present embodiment, the control unit 11 of the user terminal 10 executes frame detection processing (step S1-6) and determination processing (step S1-7) as to whether or not code recognition is possible. When it is determined that the code can be recognized (in the case of “YES” in step S1-7), the control unit 11 of the user terminal 10 executes an authenticity determination process (step S1-8). Thereby, information indicating that it is a security code image can be output.

The above embodiment may be modified as follows.
In the above embodiment, the control unit 11 of the user terminal 10 executes the flash shooting process (step S1-5) after the normal shooting process (step S1-1). When photographing using a plurality of types of light sources, the order is not limited. For example, the normal shooting process may be performed after the flash shooting process. Also in this case, decoding is performed on each captured image in the frame of the code image at the same position.

  -Although the illumination part 14 was used as a 2nd light source in the said embodiment, it is not limited to the illumination part 14 of the user terminal 10 as a 2nd light source. For example, an external light source that can be controlled by the control unit 11 of the user terminal 10 may be used.

  In the above embodiment, when it is determined that the code can be recognized (in the case of “YES” in step S1-3), the control unit 11 of the user terminal 10 executes the fake determination process (step S1-4). Instead of this, it is also possible to determine whether the security code image is true or false after performing both the normal shooting and the flash shooting. In this case, the code analysis unit 113 holds data on the allowable number of times of photographing of the code image.

The code recognition process will be described with reference to FIG.
First, similarly to steps S1-1 and S1-2, the control unit 11 of the user terminal 10 executes a normal shooting process (step S2-1) and a frame detection process (step S2-2).

  Next, the control unit 11 of the user terminal 10 executes a decoding process (step S2-3). Specifically, the code analysis unit 113 of the control unit 11 decodes the code image configured by the detected frame. Then, the code analysis unit 113 temporarily stores the decoding result in the memory.

  Next, the control unit 11 of the user terminal 10 executes the flash photographing process (step S2-4) and the frame detection process (step S2-5) as in steps S1-5 and S1-6.

  Next, as in step S2-3, the control unit 11 of the user terminal 10 executes the decoding process (step S2-6). Specifically, the code analysis unit 113 of the control unit 11 decodes the code image configured by the detected frame.

  Next, the control unit 11 of the user terminal 10 executes code comparison processing (step S2-7). Specifically, the code analysis unit 113 of the control unit 11 compares the code acquired from the code image for normal imaging and temporarily stored in the memory with the code acquired from the code image for flash imaging.

  Next, the control unit 11 of the user terminal 10 executes a determination process as to whether or not the recognition is completed (step S2-8). Specifically, the code analysis unit 113 of the control unit 11 can not decode in the normal shooting, and determines that the decoding is completed when the decoding is performed in the flash shooting.

  When it is determined that the recognition is completed (in the case of “YES” in step S2-8), the control unit 11 of the user terminal 10 executes the authenticity determination process as in step S1-8 (step S2-9).

  On the other hand, when it is determined that the recognition is not completed (in the case of “NO” in step S2-8), the control unit 11 of the user terminal 10 executes count-up processing of the number of times of imaging (step S2-10). Specifically, the code analysis unit 113 of the control unit 11 adds “1” to the number of times of shooting recorded in the memory.

  Next, the control unit 11 of the user terminal 10 executes determination processing as to whether or not it is a recognition error (step S2-11). Specifically, the code analysis unit 113 of the control unit 11 compares the number of times of photographing recorded in the memory with the allowable number of times. If the number of times of photographing exceeds the allowable number of times, it is determined as a recognition error.

  When it is determined that a recognition error has occurred (in the case of “YES” in step S2-11), the control unit 11 of the user terminal 10 executes fake determination processing as in step S1-4 (step S2-12).

  On the other hand, when it is determined that the number of times of photographing is equal to or less than the allowable number and it is not a recognition error (in the case of "NO" in step S2-11), the control unit 11 of the user terminal 10 returns to the normal photographing process (step S2-1). . Thus, it is possible to determine whether the security code image is true or false by repeating normal shooting and flash shooting.

In the above embodiment, code recognition processing of the security code image is executed. In addition to this, it may be used together with code recognition processing of a normal code image.
The code recognition process will be described with reference to FIG.
First, as in steps S1-1 to S1-3, the control unit 11 of the user terminal 10 determines whether the normal imaging process (step S3-1), the frame detection process (step S3-2), and the code recognition are possible. The determination process (step S3-3) is performed.

  When it is determined that the code can be recognized (in the case of “YES” in step S3-3), the control unit 11 of the user terminal 10 executes normal handling processing (step S3-4). Specifically, the code analysis unit 113 of the control unit 11 causes the touch panel display 12 to output a message indicating that the code image is a normal code image and decoded code information.

  On the other hand, when it is determined that the code can not be recognized (in the case of “NO” in step S3-3), the control unit 11 of the user terminal 10 performs flash photographing processing (step S3-3) as in steps S1-5 to S1-7. 5) A frame detection process (step S3-6) and a determination process (step S3-7) as to whether or not the code can be recognized are executed.

  When it is determined that the code can be recognized (in the case of “YES” in step S3-7), the control unit 11 of the user terminal 10 executes the authenticity determination process (step S3-8) as in the case of S1-8.

  When it is determined that the code can not be recognized (in the case of “NO” in step S3-7), the control unit 11 of the user terminal 10 executes an error process (step S3-9). Specifically, the code analysis unit 113 of the control unit 11 outputs an error message to the touch panel display 12. Thus, decoding of the normal code image and the security code image can be used in combination.

  In the above embodiment, a color code image is used as the code image, but the code image is not limited to this. For example, it is also possible to use a barcode or a two-dimensional code image. In this case, the code image is configured in the area where the code image is printed, and a frame visible by the first light source and the second light source is provided. Then, the area where the frame is printed is photographed by the first light source, and the authenticity of the security code image is determined by the image of the area photographed by the second light source.

  In the above embodiment, only the frame is visible in ambient light. Alternatively, the code element may be embedded in part of the frame of the code image. In this case, the first code element acquired by normal photographing (photographing using the first light source) and the second code element acquired by flash photographing (photographing using the second light source) are temporarily stored in the memory, Decode by combining. For example, arithmetic operations are performed using the first code element and the second code element, or the decoding method of the second code element is changed based on the first code element. Thereby, the authenticity determination and decoding of the security code image can be performed using the information acquired from the photographed image by the first light source and the information acquired from the photographed image by the second light source.

  DESCRIPTION OF SYMBOLS 10 ... User terminal, 11 ... Control part, 12 ... Touch-panel display, 13 ... Photography part, 14 ... Illumination part, 300, 310, 320 ... Code image, 301 ... Frame, 302 ... Cell.

Claims (6)

A code recognition apparatus comprising an imaging unit and a control unit, wherein
The control unit
Detecting a code image area in a first image photographed using a first light source, and decoding first code recognition information in the code image area;
A code image area is detected in a second image captured using a second light source, and second code recognition information is decoded in the same code image area included in the first image;
A code recognition apparatus characterized in that, when the first code recognition information and the second code recognition information are different, the second code recognition information is determined to be authentic and the code information is specified.   The code recognition apparatus according to claim 1, wherein the first light source is ambient light, and the second light source is a flash light source.   3. The code recognition device according to claim 1, wherein the second code recognition information is decoded based on the result of the decoding of the first code recognition information.   The code recognition device according to any one of claims 1 to 3, wherein the code image area uses a color code which is a combination of coloring in a plurality of cells arranged in a frame. A code recognition method using a code recognition device comprising an imaging unit and a control unit,
The control unit
Detecting a code image area in a first image photographed using a first light source, and decoding first code recognition information in the code image area;
A code image area is detected in a second image captured using a second light source, and second code recognition information is decoded in the same code image area included in the first image;
A code recognition method characterized in that, when the first code recognition information and the second code recognition information are different, the second code recognition information is judged as genuine and the code information is specified. A code recognition program for use in a code recognition apparatus comprising an imaging unit and a control unit, the code recognition program comprising:
The control unit is
Detecting a code image area in a first image photographed using a first light source, and decoding first code recognition information in the code image area;
A code image area is detected in a second image captured using a second light source, and second code recognition information is decoded in the same code image area included in the first image;
A code recognition program characterized in that, when the first code recognition information and the second code recognition information are different, the second code recognition information is determined to be authentic to function as means for specifying code information.

Images