JP2010226580A - Color correction method and imaging system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To carry out color correction of an image of an imaging object well by properly reflecting a prescribed prepared environment and an imaging environment when the imaging object is imaged by an imaging means. <P>SOLUTION: An imaging system 1 enables pretreatment. In the pretreatment, a prescribed first color reference pattern is imaged, and first color information is extracted from the first color reference pattern. In the pretreatment, a two-dimensional code wherein the first color information is recorded and a second reference pattern is arranged is also prepared. Meanwhile, when the imaging object is actually imaged, the prepared two-dimensional code is imaged together with an imaging object, and second color information is extracted by specifying the second color reference pattern in the image. Color correction of an image of the imaging object is carried out based on the first color information recorded in the two-dimensional code and the extracted second color information. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a color correction method and an imaging system.

  When the imaging object is imaged by a camera or the like, even if the same object is imaged, if the imaging environment is different (for example, the amount or type of ambient light or the distance or angle from the imaging means to the imaging object) If they are different, there is a problem that the color, density, or luminance of the obtained image is different. Conventionally, such a problem has been dealt with by performing color correction using a color chart, for example.

Japanese Patent No. 3766380

  For example, in Patent Document 1, a color chart with a specified color is imaged together with an imaging target, and each color of the imaging target is corrected based on the color value of the color chart portion in the captured image. Since the color chart is provided with each color specified in advance, it is possible to quantitatively grasp the state of the imaging environment by detecting the color value of the color chart portion. If color correction is performed based on the color values of the color chart portion, the image to be imaged can be brought close to the intended color state based on the original color of the color chart.

  However, in the case of the above method, it is necessary to purchase and appropriately manage a color chart in which the specified color is accurately attached, which may be disadvantageous in terms of management load and cost. For example, if the color chart is lost or becomes dirty, a regular color chart must be purchased each time, increasing the financial burden on the user.

  Further, when a color chart is imaged together with an imaging target, how to detect the color chart quickly and accurately becomes a problem. For example, if the color state of the color chart changes due to the external environment, such as when the color chart is exposed to strong light, it becomes difficult to detect the specified color arrangement, and it takes time to detect the color chart. There is a concern that the color chart detection itself becomes impossible.

  The present invention has been made in order to solve the above-described problems. When an imaging target is imaged by an imaging unit, the color correction of the image of the imaging target is appropriately reflected in a predetermined prior environment and imaging environment. It is an object of the present invention to provide a method and a system that can be performed easily and with a reduced burden.

The invention of claim 1 is a color correction method for performing color correction of an image to be imaged that is imaged by an imaging means, the first imaging step of imaging a first color reference pattern by the first imaging means,
A first extraction step of extracting first color information from the first color reference pattern imaged in the first imaging step by a first extraction means; and a second color reference pattern corresponding to the first color reference pattern And a code creation step of creating a two-dimensional code in which the first color information extracted in the first extraction step is recorded by a code creation means, and the same as the first imaging means, or the first A second imaging step for imaging the imaging object together with the two-dimensional code created in the code creation step by the imaging means different from the one imaging means; and a second extraction means for the second imaging step. A second extraction step for specifying the second color reference pattern in the captured image of the two-dimensional code and extracting the second color information from the second color reference pattern. And reading means for reading the first color information from the image of the two-dimensional code imaged in the second imaging step by the reading means; and the first color information read in the reading step; Based on the second color information extracted in the second extraction step, a color correction step of performing color correction by color correction means on the image to be imaged imaged in the second imaging step; It is characterized by including.

  According to a second aspect of the present invention, in the color correction method according to the first aspect, the first color reference pattern is arranged in an information code, and the first imaging step is the same as the imaging unit or the The information code is imaged by an optical information reading unit different from the imaging unit, and in the first extraction step, the optical information reading unit is used to specify a specific color pattern indicating the first color reference pattern from the information code. A process of detecting a cell group of a color array and a process of detecting color data of each cell constituting the cell group are performed, and the color data of each cell is extracted as the first color information. It is said.

  According to a third aspect of the present invention, in the color correction method according to the first or second aspect, after the reading step and the second extracting step, the first color information read in the reading step and the first color information. A determination step for comparing the second color information extracted in two extraction steps to determine whether there is a predetermined difference between the first color information and the second color information; A notification step of performing a notification when it is determined that there is the predetermined difference, and when it is determined that there is the predetermined difference in the determination step, with respect to the image to be imaged The color correction step is performed.

  Invention of Claim 4 is the color correction method as described in any one of Claims 1-3, Comprising: In the said 2nd imaging step, the said two-dimensional code created in the said code creation step is used. The plurality of the two-dimensional codes are imaged together with the imaging target in a state of being dispersed in the imaging area, and the image of the imaging target captured in the second imaging step is divided into a plurality of areas in the color correction step. In addition, the color correction for each region is performed based on the second color information of the two-dimensional code adjacent to each region.

  According to a fifth aspect of the present invention, in the color correction method according to any one of the first to fourth aspects, the first color reference pattern includes a plurality of color cells arranged in a predetermined arrangement. The second color reference pattern has the same cell arrangement as the first color reference pattern. In the first extraction step, an RGB component is extracted for each cell color from the image of the first color reference pattern, and in the second extraction step, each image of the second color reference pattern is A process of extracting RGB components for each cell color is performed. In the color correction step, based on the RGB component for each cell color of the first color reference pattern and the RGB component for each cell color of the second color reference pattern, the R component of the image to be imaged , G component and B component are respectively corrected.

The invention of claim 6 is an imaging system comprising an optical information reading means, a code creating means, and an imaging device, wherein the optical information reading means is an information code in which a first color reference pattern is arranged. And a first extraction means for detecting the first color reference pattern in the information code imaged by the first imaging means and extracting the first color information from the first reference pattern. And.
The code creation means includes a two-dimensional code in which a second color reference pattern corresponding to the first color reference pattern is arranged and the first color information extracted by the first extraction means is recorded in a data area It is configured to create.
Further, the imaging apparatus may include an imaging unit capable of imaging an imaging target together with the two-dimensional code created by the code creating unit, and an image of the two-dimensional code captured together with the imaging target by the imaging unit. A second extraction means for specifying the second color reference pattern and extracting the second color information from the second color reference pattern; and an image of the two-dimensional code imaged together with the imaging target by the imaging means. Based on the reading means for reading the first color information, the first color information read by the reading means, and the second color information extracted by the second extracting means, an image is taken by the imaging means. Color correction means for performing color correction on the image to be imaged.

According to the first aspect of the present invention, prior to imaging of the imaging target, the first color reference pattern is captured in advance, and the first color information is extracted from the captured first color reference pattern. Then, a two-dimensional code in which the extracted first color information is recorded and a second color reference pattern corresponding to the first color reference pattern is arranged is created.
If it does in this way, it will specify quantitatively how the color of the 1st color reference pattern is expressed in the prior environment when the 1st color reference pattern was imaged, and the information which reflected the prior environment It can be recorded in a two-dimensional code as (first color information).
In the two-dimensional code, a second color reference pattern corresponding to the first color reference pattern is arranged. Accordingly, when the two-dimensional code is imaged, not only the data (first color information) reflecting the environment when the first color reference pattern is imaged, but also the pattern (first color reference pattern) from which the data is generated ) And a corresponding pattern image can be acquired.
On the other hand, when the imaging target is actually imaged, the two-dimensional code created as described above is imaged together with the imaging target, and the second color information is extracted from the second color reference pattern attached to the two-dimensional code. .
In this way, it is possible to acquire information (second color information) that quantitatively indicates how the second color reference pattern is expressed when the imaging target is actually imaged. Since the second color information is data reflecting the imaging environment when the imaging target is actually imaged, the second color information is based on the second color information and information (first color information) quantitatively indicating the prior environment. Thus, if color correction is performed on the image to be imaged, both the imaging environment when the imaging target is actually imaged and the prior environment when the first color reference pattern is imaged in advance are considered. Thus, appropriate color correction can be performed.

According to a second aspect of the present invention, the first color reference pattern is arranged in the information code, and in the step of imaging the first color reference pattern (first imaging step), the optical information reading means reads the first color reference pattern from the information code. A cell group having a specific color arrangement indicating one color reference pattern is detected.
In this way, a part of the information code can be used as the first color reference pattern. In addition, the first color reference pattern can be quickly and accurately specified using the recognition processing of each cell by the optical information reading means.
In the step of extracting the first color information (first extraction step), the color data of each cell constituting the cell group is detected, and the color data of each cell is extracted as the first color information. In this way, the environment (preliminary environment) when the first color reference pattern is imaged can be expressed in detail by the color data of a plurality of cells, and the extraction process is also performed quickly and accurately for each cell. It can be carried out.

The invention of claim 3 compares, after the reading step and the second extracting step, the first color information read in the reading step and the second color information extracted in the second extracting step. It is determined whether or not there is a predetermined difference between the information and the second color information. In this way, whether or not there is a difference between the environment when the first color reference pattern is imaged (preliminary environment) and the environment when the imaging target is actually imaged (imaging environment) is based on the color information. If there is a difference, the user can be informed.
Further, when it is determined that there is a predetermined difference in the determination step, color correction is performed on the image to be captured. In this way, when the environment (imaging environment) when the imaging target is imaged is similar to the environment (preliminary environment) when the first color reference pattern is imaged, the color correction is omitted and the processing is performed quickly. When the imaging environment has changed to some extent with respect to the previous environment, color correction can be performed to correct image changes due to environmental differences.

  In the invention of claim 4, when imaging the imaging target, a plurality of two-dimensional codes created in the code creation step are dispersed in the imaging area, and in this state, the imaging target is imaged together with the plurality of two-dimensional codes. is doing. The obtained image to be imaged is divided into a plurality of areas, and color correction for each area is performed based on color information (second color information) of a two-dimensional code close to each area. . In this way, it is possible to appropriately perform color correction for each area in consideration of the imaging environment and the prior environment of each area.

In the invention of claim 5, a first color reference pattern in which cells of a plurality of colors are configured in a predetermined arrangement and a second color reference pattern having the same cell arrangement as the first color reference pattern are used. In the first extraction step, RGB components are extracted for each cell color from the first color reference pattern image, and in the second extraction step, each cell color is extracted from the second color reference pattern image. Processing for extracting RGB components is performed. In this way, the environment (pre-environment) when the first color reference pattern is imaged is quantified specifically and in detail by the RGB components extracted for each cell color of the first color reference pattern. Can do. Further, the environment (imaging environment) when the imaging target is imaged can also be quantified specifically and in detail by the RGB components extracted for each cell color of the second color reference pattern. Furthermore, since the first color reference pattern and the second color reference pattern are composed of the same cell arrangement, the RGB components for each cell color of the first color reference pattern and the cell colors of the second color reference pattern If each RGB component is extracted, it becomes clear how much the R component, the G component, and the B component change due to the change from the previous environment to the imaging environment. If the R component, G component, and B component of the image to be captured are corrected based on the above, the influence of both environments on the R component, the influence of both environments on the G component, and the influence of both environments on the B component are specified. Therefore, it is possible to appropriately correct the R component, the G component, and the B component of the image to be imaged.
As described above, according to the present invention, it is possible to independently perform an accurate evaluation of the influences of both environments and to perform correction in consideration of each of RGB, and it is possible to perform more appropriate correction for all components. .

  According to the invention of claim 6, it is possible to realize an imaging system having the same effect as that of claim 1.

FIG. 1 is a block diagram schematically illustrating an imaging system according to the first embodiment. FIG. 2 is a flowchart illustrating the flow of pre-processing performed by the imaging system of FIG. FIG. 3A is an explanatory diagram illustrating the information code imaging process. FIG. 3B is an explanatory diagram illustrating an information code to which the first color reference pattern is attached. FIG. 4 is an explanatory diagram for conceptually explaining the first color information. FIG. 5 is an explanatory diagram illustrating a two-dimensional code including the second color reference pattern. FIG. 6 is a flowchart illustrating the flow of imaging processing performed by the imaging system of FIG. FIG. 7 is a flowchart illustrating the flow of the reading process performed in the imaging process of FIG. FIG. 8 is a flowchart illustrating the flow of the second color reference pattern detection process performed in the imaging process of FIG. FIG. 9 is a flowchart illustrating the flow of correction data generation processing performed in the imaging processing of FIG. FIG. 10 is an explanatory diagram for explaining a state in which an imaging target is imaged together with a two-dimensional code. FIG. 11 is an explanatory diagram illustrating the second color reference pattern detection process. 12A is an explanatory diagram for explaining the first color information read from the two-dimensional code, and FIG. 12B is an explanatory diagram for explaining the second color information extracted from the second color reference pattern. is there. FIG. 13 is an explanatory diagram illustrating difference data between the first color information and the second color information. FIG. 14 is an explanatory diagram for conceptually explaining the state of imaging processing performed in the imaging system according to the second embodiment. FIG. 15 is a flowchart illustrating a reading process performed by the imaging system according to the second embodiment. FIG. 16 is an explanatory diagram for conceptually explaining an example in which detection of any two-dimensional code has failed.

[First embodiment]
Hereinafter, a color correction method and an imaging system according to a first embodiment of the present invention will be described with reference to the drawings.
(overall structure)
First, the overall configuration of the imaging system will be described.
FIG. 1 is a block diagram schematically illustrating an imaging system according to the present invention. As shown in FIG. 1, the imaging system 1 according to the first embodiment includes an imaging device 10, an information processing device 20, and a printing device 30, and is configured as a system that can image various imaging targets. ing.

The imaging device 10 is configured as a camera that can image various objects, and includes a light receiving sensor that can receive reflected light from the imaging target. The light receiving sensor provided in the imaging device 10 is configured as an area sensor in which light receiving elements such as a C-MOS and a CCD are two-dimensionally arranged, and outputs image data to be imaged to the information processing device 20. I am doing.
In the present embodiment, the imaging device 10 corresponds to an example of “first imaging unit” and “second imaging unit”.

  The information processing apparatus 20 is configured as a personal computer, for example, and includes a storage unit such as a CPU, ROM, and RAM, and is configured to perform various types of information processing. The information processing apparatus 20 has a function of storing and storing image data from the imaging apparatus 10 in a storage unit, a function of performing various image processing relating to the image data, and various imaging processes as shown in FIGS. It has functions.

  The printing apparatus 30 is connected to the information processing apparatus 20 and is configured as a known printer that receives a print command and data to be printed from the information processing apparatus 20 and performs printing.

  Next, an imaging process performed using the imaging system 1 according to the present embodiment will be described. In the imaging system 1 according to the present embodiment, roughly divided, two processes, a pre-process necessary for performing color correction, and an imaging process for actually capturing an object are performed. Hereinafter, each process performed in the system will be described in detail.

(Pre-processing)
First, pre-processing will be described.
FIG. 2 is a flowchart illustrating the flow of pre-processing performed by the imaging system of FIG. FIG. 3A is an explanatory diagram illustrating the information code imaging process. FIG. 3B is an explanatory diagram illustrating an information code to which the first color reference pattern is attached. FIG. 4 is an explanatory diagram for conceptually explaining the first color information.

  The pre-process shown in FIG. 2 is a process executed by the information processing apparatus 20, and first, a process of capturing an information code with the first color reference pattern is performed (S1). In this process, as shown in FIG. 3A, the imaging device 10 causes the imaging device 10 to image the object R to which the information code Q1 is attached, and the image data of the information code Q1 is acquired from the imaging device 10.

  The information code Q1 used in S1 has, for example, a configuration as shown in FIG. 3B, and a first color reference pattern P1 defined in advance is arranged at a predetermined position in the code. In the example of FIG. 3B, the information code Q1 is configured as a QR code, and one central dark region of the finder pattern FP that should be provided in the QR code is converted into the first color reference pattern P1. I am doing.

  As shown in FIG. 3B, the first color reference pattern P1 is a cell in which a plurality of cells having the same size as information display unit cells (that is, light cells and dark cells) constituting the information code Q1 are collected. It is composed of groups. In this cell group, a plurality of types of cells are arranged in a matrix of 3 rows and 3 columns, and in the example of FIG. 3B, 8 types of cells are arranged in a predetermined order. . Specifically, a white cell 51 is arranged at a corner position of the cell group near the corner of the information code Q1, and a cyan cell 52 and a red cell 53 are clockwise from the white cell 51 along the outer edge. , Green cell 54, white cell 55, magenta cell 56, blue cell 57, and yellow cell 58. A black cell 59 is disposed in the center.

  In the present embodiment, the information code imaging process of S1 corresponds to an example of a “first imaging step”. The imaging device 10 and the information processing device 20 correspond to an example of “first imaging unit”.

  As shown in FIG. 2, after the process of S1, a process of detecting the first color reference pattern P1 from the image of the information code Q1 acquired in S1 is performed (S2). In the imaging system 1 according to the present embodiment, the first color reference pattern is used at the point where the QR code is used as the information code to be imaged at S1, and at a predetermined position of the QR code (in the example of FIG. A point where P1 is arranged is defined in advance. In S2, a code area is specified in the captured image, and a specific color array indicating the first color reference pattern is displayed in the dark color area of any finder pattern. A cell group is detected. It should be noted that various known methods can be used as the method for specifying the code area of the QR code, and known methods can also be used as the method for specifying the finder pattern.

  Further, in the process of S2, after specifying the position of the code area and the finder pattern as described above, a predetermined position where the first color reference pattern P1 is to be arranged in the code area is referred to. In the present embodiment, it is preliminarily specified that the first color reference pattern P1 is arranged at a predetermined position in the information code Q1, and for example, as shown in FIG. 3B, the first color reference pattern P1 is arranged in the center area of the finder pattern FP2. When it is specified in advance that the one-color reference pattern P1 is to be arranged, the center area of the specified finder pattern FP2 among the three finder patterns FP1 to FP3 detected as described above is referred to, and Confirm that the cell group exists. For example, after specifying the central region of the finder pattern FP2, a 3 × 3 cell group in the central region is arranged in a predetermined arrangement (cyan cells, red cells, green cells clockwise from the white cells at the corners along the outer edge). , White cells, magenta cells, blue cells, yellow cells, and a black cell at the center). If it is a predetermined array, the first color reference pattern P1 is Subsequent processing is performed assuming that it has been detected.

  As shown in FIG. 2, after the process of S2, a process of extracting the first color information is performed (S3). In this process, the color data of each cell is extracted from the first color reference pattern P1 detected in S2. Specifically, in the first color reference pattern P1 configured as a 3 × 3 matrix cell group as shown in FIG. 3B, the R component, G component, and B component for each cell are detected. . For example, the R component luminance value, the G component luminance value, and the B component luminance value of the white cell 51 are obtained, and similarly, the R component luminance value, the G component luminance value, and the B component luminance are obtained for the cyan cell 52, respectively. . The other red cell 53, green cell 54, white cell 55, magenta cell 56, blue cell 57, yellow cell 58, and black cell 59 also have R component luminance values, G component luminance values, and B component luminances. Find each value. FIG. 4 exemplifies the R component luminance value, the G component luminance value, and the B component luminance value of each color cell thus obtained. Such data corresponds to “first color information”. Yes.

  In the present embodiment, two white cells are provided in the first color reference pattern P1, but when a plurality of cells of a predetermined color are provided in the color reference pattern in this way, the R component of any one cell. The luminance value, the G component luminance value, and the B component luminance value may be included in the first color information as representative values of the color, and the average value of the R component luminance values and the average value of the G component luminance values of a plurality of cells of the same color The average value of the B component luminance values may be taken as the representative value of the color and included in the first color information.

  In the present embodiment, the processes of S2 and S3 correspond to an example of “first extraction step”. The information processing apparatus 20 corresponds to an example of a “first extraction unit” and has a function of extracting the “first color information” from the first color reference pattern P1 imaged in the first imaging step.

  As shown in FIG. 2, a two-dimensional code generation process is performed after the process of S3 (S4). In this two-dimensional code creation process, a two-dimensional code in which the second color reference pattern P2 corresponding to the first color reference pattern P1 is arranged at a predetermined position and the “first color information” extracted in S3 is recorded. Q2 image data is generated.

  FIG. 5 illustrates a code configuration of the two-dimensional code Q2 generated in S4. This two-dimensional code Q2 is configured as a QR code, and a predetermined position in the code (specifically, any one of the dark areas in the center of the finder patterns FP4 to FP6) is replaced with the second color reference pattern P2. It has a configuration. The second color reference pattern P2 has the same eight types (eight colors) of cells as the first color reference pattern P1 shown in FIG. 3B arranged in a 3 × 3 matrix. The cells are arranged in the same cell array as the first color reference pattern P1. Specifically, as in the first color reference pattern P1, white cells 61 are arranged at the corner positions, and cyan cells 62, red cells 63, and green are clockwise from the white cells 61 along the outer edge. A cell 64, a white cell 65, a magenta cell 66, a blue cell 67, and a yellow cell 68 are arranged. A black cell 69 is disposed in the center.

  Further, the “first color information” is recorded in a data area (for example, the area D1) of the two-dimensional code Q2. A QR code generation method in which predetermined information (here, the first color information, etc.) is recorded in the data area is a well-known technique and will not be described in detail. For example, it can be generated using a method defined in the JIS standard. . In FIG. 5, the arrangement of the data area is conceptually indicated by a one-dot chain line, but various configurations such as an example defined in JIS and other known examples can be adopted for the configuration of the data area.

As shown in FIG. 2, the process of printing a two-dimensional code is performed after the process of S4 (S5). In the process of S <b> 5, the print command and the print data including the image data of the two-dimensional code Q <b> 2 are output to the printing device 30. When the printing device 30 acquires the print command and the print data from the information processing device 20, The two-dimensional code Q2 is printed on a recording medium such as paper.
In the present embodiment, the processes of S4 and S5 correspond to an example of a “two-dimensional code creation step”. Further, the information processing apparatus 20 and the printing apparatus 30 correspond to an example of a “code creation unit”.

  In the present embodiment, the information code Q1 (see FIG. 3) used in S1 is printed by the printing apparatus 30 that prints the two-dimensional code Q2. The recording medium (such as paper) on which the information code Q1 is recorded is the same type of medium (for example, the same type of paper) as the recording medium on which the two-dimensional code Q2 is printed in S5.

(Target imaging processing)
Next, a process (imaging process) for actually imaging an imaging target will be described.
FIG. 6 is a flowchart illustrating the flow of the imaging process. FIG. 7 is a flowchart illustrating the flow of the reading process performed in the imaging process. FIG. 8 is a flowchart illustrating the flow of the second color reference pattern detection process performed in the imaging process. FIG. 9 is a flowchart illustrating the flow of the correction data generation process performed in the imaging process. FIG. 10 is an explanatory diagram for explaining a state in which an imaging target is imaged together with a two-dimensional code. FIG. 11 is an explanatory diagram illustrating the second color reference pattern detection process. 12A is an explanatory diagram for explaining the first color information read from the two-dimensional code, and FIG. 12B is an explanatory diagram for explaining the second color information extracted from the second color reference pattern. is there. FIG. 13 is an explanatory diagram illustrating difference data between the first color information and the second color information.

In the imaging process shown in FIG. 6, first, a process of imaging an object to be imaged (imaging object) together with the two-dimensional code Q1 created by the pre-processing is performed (S10). For example, as shown in FIG. 10, the object T (imaging target) and the two-dimensional code Q1 are arranged close to each other, and in this state, an imaging command is given to the imaging device 10 to capture them.
In the present embodiment, the process of S10 corresponds to an example of “second imaging step”. The imaging device 10 and the information processing means 20 correspond to an example of “imaging means” and “second imaging means”.

  As shown in FIG. 6, after the process of S10, a reading process for reading the two-dimensional code Q2 is performed (S20). This reading process is performed, for example, as shown in FIG. 7. First, image data obtained by imaging the object T together with the two-dimensional code Q1 is acquired from the imaging device 10 (S21), and the two-dimensional code Q2 in the image data is acquired. Is detected (S22). Furthermore, referring to the format data of the two-dimensional code Q2, the code type of the two-dimensional code Q2 is specified (S23), and the decoding process of the two-dimensional code Q2 is performed (S24). The code area detection process (S22), the code type identification process (S23), and the decoding process (S24) are well-known techniques in various two-dimensional codes such as QR codes, and thus detailed descriptions thereof are omitted.

If the decoding is successful in S24, the decoding result is stored in storage means (for example, RAM, HDD, etc.) in the information processing apparatus 20 (S25). In the present embodiment, since “first color information” is recorded in the data area of the two-dimensional code Q2, when decoding is successful, “first color information” is recorded in the storage means. Become. FIG. 12A conceptually shows “first color information” obtained by decoding.
In the present embodiment, the process of S20 corresponds to an example of a “reading step”. The information processing apparatus 20 corresponds to an example of “reading unit”.

  As shown in FIG. 6, after the reading process (S20), a process for determining whether or not the decoding is successful is performed (S30). If the decoding is successful in S20 (S30: Yes), a process for detecting the second color reference pattern is performed (S40). On the other hand, if the decoding is not successful in S20 (S30: No), the imaging process shown in FIG. 6 is terminated. If the decoding is not successful, the color correction of the image of the object captured in S10 may not be performed, or the color correction may be performed using correction data generated in the past. May be.

Next, the second color reference pattern detection process in S40 will be described.
The process of S40 is a process of detecting the second color reference pattern P1 in the image of the two-dimensional code Q2 imaged in S10, and is performed according to the flow as shown in FIG. In the example of FIG. 8, first, in the code area of the two-dimensional code Q1, a 3 × 3 cell group having any cell as a base cell is extracted, and the color of each cell constituting the cell group is recognized ( S41). For example, as shown in FIG. 11, any cell C1 is set as a base cell, and a 3 × 3 cell group X1 arranged in the right direction and the downward direction is extracted from the cell. And the color of each cell which comprises this cell group X1 is each recognized. Then, it is determined whether or not the array of the cell group X1 is the same array as the second color reference pattern P2 (FIG. 5) (S42). As described above, in the second color reference pattern P2, white cells are arranged at corner positions, and cyan cells, red cells, green cells, white cells, magenta cells are clockwise from the white cells along the outer edge. A blue cell and a yellow cell are arranged, and a black cell is arranged at the center. Therefore, if the cell group X1 has such a cell arrangement, it is determined that a cell group corresponding to the second color reference pattern P2 has been found, the process proceeds to Yes in S42, and the cell group (second color reference pattern) Coordinate data specifying a cell group corresponding to P2 is stored (S44).

  On the other hand, if the cell group X1 has a cell arrangement different from that of the second color reference pattern P2, the process proceeds to No in S42 and the base cell is shifted by one cell (S43), and the shifted cell C2 is set as the base cell. The processes of S41 and S42 are repeated for the group X2. Such processing is sequentially performed while shifting the base cell, and is repeated until a cell group corresponding to the second color reference pattern P2 is found.

  As shown in FIG. 6, the determination process of S50 is performed after the process of S40. In S50, it is determined whether or not the detection of the second color reference pattern P2 is successful in S40. If the second color reference pattern P2 is normally detected in S40 (S50: Yes), the process proceeds to S60. Correction data generation processing is performed. On the other hand, when the second color reference pattern P2 is not normally detected (S50: No), the imaging process shown in FIG. 6 is terminated. If the second color reference pattern P2 is not detected, color correction of the image of the object imaged in S10 may not be performed, or color correction is performed using correction data generated in the past. Correction may be performed.

Next, the correction data generation process of S60 will be described.
The process of S60 is performed according to the flow as shown in FIG. 9, for example. First, the process of extracting the second color information from the second color reference pattern P2 detected in S40 is performed (S61). The extraction of the second color information is performed by the same method as the extraction of the first color information described above, and RGB components are extracted for each cell color constituting the second color reference pattern P2. For example, the R component luminance value, the G component luminance value, and the B component luminance value of the white cell 61 (see FIG. 5) are respectively obtained. Similarly, for the cyan cell 62, the R component luminance value, the G component luminance value, B Each component luminance is obtained. The other red cell 63, green cell 64, white cell 65, magenta cell 66, blue cell 67, yellow cell 68, and black cell 69 also have R component luminance values, G component luminance values, and B component luminances. Find each value. FIG. 12B illustrates the R component luminance value, the G component luminance value, and the B component luminance value of each color cell thus obtained. Such data is represented as “second color information”. It corresponds.

  After the extraction process of S61, the “first color information” obtained by the reading process of S20 (FIG. 6) is read from the storage means (S62), and the “first color information” and the “second color information” are read out. Is generated (S63). There are various methods of generating difference data. In FIG. 13, as an example, the RGB component for each cell color of the second color reference pattern P2 is subtracted from the RGB component for each cell color of the first color reference pattern P1. Each value is obtained. For example, as shown in FIG. 12A, in the first color information, the R component luminance value of the white cell is 156, and in the second color information as shown in FIG. 12B, the R component luminance value of the white cell. Therefore, the difference data of the R component of the white cell is set to −58 in FIG. Similarly, in the first color information, the G component luminance value of the white cell is 154, and in the second color information, the G component luminance value of the white cell is 180. 26. In the first color information, the B component luminance value of the white cell is 148, and in the second color information, the B component luminance value of the white cell is 90. To do. The same applies to the other colors. In the first color information, the R component luminance value of the cyan cell is 74, and in the second color information, the R component luminance value of the cyan cell is 90. The difference data of the G component of the color cell is set to -16.

  In this way, the corresponding component values of the corresponding colors of the second color information are sequentially subtracted from the component values of the respective colors of the first color information, and difference data is generated for each component value of each color. Difference data such as 13 is acquired.

  After the process of S63, a process of calculating correction data is performed as shown in FIG. 9 (S64). In this embodiment, as correction data, a value to be added to the R component luminance value of the captured image (R component addition value), a value to be added to the G component luminance value (G component addition value), and an addition to the B component luminance value Each value (B component addition value) to be calculated is calculated. There are various methods for calculating each component addition value. Here, in the difference data acquired in S63, an average value is obtained for each component, and the average value for each component is used as each component addition value. . For example, in the example of FIG. 13, the R component difference data for all colors is “−58, −16, −25, −49, −17, −17, −9, −24”. −27 ”(here, rounded off) is the R component addition value. Similarly, an average value (−12) of G component difference data for all colors is calculated as a G component addition value, and an average value (24) of B component difference data for all colors is calculated as a B component addition value. After calculating the correction data (added value for each component) in this way, the correction data is stored in the storage means (S65).

  As shown in FIG. 6, when the process of S60 ends, a notification process is performed (S70). This notification process is a process for notifying the fact that correction data has been generated by some method. For example, information such as “correction data generation completion” is displayed on a display (not shown) provided in the information processing apparatus 20. Alternatively, the fact that the correction data has been created may be notified by a predetermined voice or the like.

  After S70, a process for generating a corrected image is performed (S80). In the process of S80, color correction processing based on the correction data obtained in S60 is performed on the image data generated in S10. Specifically, the R component addition value, the G component addition value, and the B component addition value are set for the R component luminance value, the G component luminance value, and the B component luminance value of each pixel of the image data obtained in S10. to add. For example, in the image data, when the R component luminance value, G component luminance value, and B component luminance value of a certain pixel are 100, 120, and 130, respectively, the above R component addition value (−27), G component The addition value (−12) and the B component addition value (24) are added to correct the R component luminance value, the G component luminance value, and the B component luminance value to 73, 108, and 154, respectively. Such correction processing is performed on the R component, G component, and B component of all pixels, and the finally obtained image is stored or output as an image to be captured (corrected image).

  In the present embodiment, the processes of S40 and S61 correspond to an example of a “second extraction step”. S60 and S80 correspond to an example of a “color correction step”. The information processing apparatus 20 corresponds to an example of “second extraction unit” and “color correction unit”.

(Main effects of this embodiment)
In the present embodiment, prior to imaging of the imaging target, the first color reference pattern P1 is captured in advance, and the first color information is extracted from the captured first color reference pattern P1. Then, a two-dimensional code Q2 in which the extracted first color information is recorded and the second color reference pattern P2 corresponding to the first color reference pattern P1 is arranged is created. If it does in this way, in the environment (prior environment) when the 1st color reference pattern P1 was imaged, it will specify quantitatively how the color of the 1st color reference pattern P1 is expressed, Information that reflects the prior environment (first color information) can be recorded in the two-dimensional code Q2.

In the two-dimensional code Q2, a second color reference pattern P2 corresponding to the first color reference pattern P1 is arranged. Accordingly, when the two-dimensional code Q2 is imaged, not only the data (first color information) reflecting the environment when the first color reference pattern P1 is imaged, but also the pattern (first color) from which the data is generated An image of a pattern corresponding to the reference pattern P1) can also be acquired.
Further, when the imaging target is actually imaged, the two-dimensional code Q2 created as described above is imaged together with the imaging target, and the second color information is extracted from the second color reference pattern P2 attached to the two-dimensional code Q2. is doing. In this way, it is possible to acquire information (second color information) that quantitatively indicates how the second color reference pattern P2 is color-expressed when the imaging target is actually imaged. Since the second color information is data reflecting the imaging environment when the imaging target is actually imaged, the second color information is based on the second color information and information (first color information) quantitatively indicating the prior environment. Thus, if color correction is performed on the image to be captured, both the imaging environment when the imaging target is actually captured and the preliminary environment when the first color reference pattern P1 is captured in advance are considered. Thus, appropriate color correction can be performed.

In the present embodiment, the first color reference pattern P1 is arranged in the information code Q1, and functions as an optical information reading unit in the step of capturing the first color reference pattern P1 (first imaging step). The information processing apparatus 20 detects a cell group having a specific color arrangement indicating the first color reference pattern P1 from the information code Q1.
In this way, a part of the information code Q1 can also be used as the first color reference pattern P1. Further, the first color reference pattern P1 can be specified quickly and accurately by using the recognition processing of each cell by the optical information reading means.
In the step of extracting the first color information (first extraction step), the color data of each cell constituting the cell group is detected, and the color data of each cell is extracted as the first color information. In this way, the environment (pre-environment) when the first color reference pattern P1 is imaged can be expressed in detail by the color data of a plurality of cells, and the extraction process is also quick and accurate for each cell. Can be done.

  In the present embodiment, a first color reference pattern P1 in which cells of a plurality of colors are configured in a predetermined arrangement and a second color reference pattern P2 having the same cell arrangement as the first color reference pattern P1 are used. ing. In the first extraction step, the RGB component is extracted for each cell color from the image of the first color reference pattern P1, and in the second extraction step, the image of the second color reference pattern P2 is extracted. Thus, processing for extracting RGB components for each cell color is performed. In this way, the environment (pre-environment) when the first color reference pattern P1 is imaged is quantified specifically and in detail by the RGB components extracted for each cell color of the first color reference pattern P1. can do. Also, the environment (imaging environment) when the imaging target is imaged can be quantified specifically and in detail by the RGB components extracted for each cell color of the second color reference pattern P2.

  Further, since the first color reference pattern P1 and the second color reference pattern P2 are configured in the same cell arrangement, the RGB components for each cell color of the first color reference pattern P1 and the second color reference pattern P2 If the RGB components for each cell color are respectively extracted, it is clear how much the R component, the G component, and the B component change due to the change from the previous environment to the imaging environment. Become. Then, if the R component, G component, and B component of the image to be imaged are corrected in consideration of this change, the influence of both environments on the R component, the influence of both environments on the G component, and both environments are the B component. The R component, the G component, and the B component of the image to be imaged can be appropriately corrected by specifically considering the influence on the image.

  As described above, according to the present invention, it is possible to accurately evaluate the influence of both environments for each component of RGB, and to independently correct each component in consideration of the influence of both environments on each component. Thus, more appropriate correction can be performed for all components.

[Second Embodiment]
Next, a second embodiment will be described. FIG. 14 is an explanatory diagram for conceptually explaining the state of imaging processing performed in the imaging system according to the second embodiment. FIG. 15 is a flowchart illustrating a reading process performed by the imaging system according to the second embodiment. FIG. 16 is an explanatory diagram for conceptually explaining an example in which detection of any two-dimensional code has failed.

  The imaging system according to the second embodiment has the same hardware configuration as that of the first embodiment, and the same pre-processing as that of the first embodiment is performed. Therefore, with reference to FIGS. 1 to 5 as appropriate, detailed description thereof will be omitted.

Hereinafter, imaging processing performed in the imaging system according to the second embodiment will be described.
In the imaging system according to the second embodiment, the imaging process is performed in the same flow as in FIG. 6, and therefore the process will be described with reference to FIG. 6. In the present embodiment, the specific contents of each process performed in the imaging process are slightly different from those in the first embodiment.

  First, the processing of S10 will be described. In the present embodiment, a plurality of the above-described two-dimensional codes Q2 (FIG. 5) are created in the pre-processing. Thus, the image is taken together with the object T (imaging object). Note that the image data obtained by this processing is stored in storage means (not shown) in the information processing apparatus 20.

  When the process of S10 is completed, a reading process is performed (S20). In the present embodiment, for example, the reading process is performed in the flow as shown in FIG. 15, and first, the process of acquiring the image data generated in S10 is performed (S221). And the process which detects a code area | region in the captured image comprised by the image data is performed (S222). As a method for detecting the code area, a known method similar to that of the first embodiment is used. In this embodiment, a plurality of two-dimensional codes Q2 are imaged as shown in FIG. Each code area of the two-dimensional code Q2 is detected.

  In S223 to S226, the detected code areas are decoded and registered. First, in S223, paying attention to one of the code areas, the code type of the two-dimensional code Q2 constituting the code area is specified (S223). Then, the decoding process for the code area is performed (S224). Thereafter, in S224, it is determined whether or not the decoding of the code area is successful (S225). If the decoding is successful, the two-dimensional code Q2 of the code area is registered (S226). In the registration processing in S226, the position information (position data of the code area in the captured image) about the code area successfully decoded in S224 and the decoding result (second color information) are stored.

  Thereafter, it is determined whether or not decoding has been attempted for all the code areas detected in S222 (S227). If any code area remains, the process proceeds to Yes in S227, and the remaining code area is determined. The processing of S223 to S226 is performed. On the other hand, if the processing from S223 onward is performed for all the detected code areas, the process proceeds to No in S227, and the reading process is terminated.

  As shown in FIG. 6, after the reading process in S20 is completed, it is determined in S30 whether or not any code area has been successfully decoded. If there is a code area that has been successfully decoded, the process proceeds to S30. The process proceeds to Yes, and the second color reference pattern detection process of S40 is performed. In the second color reference pattern detection process of S40, the process shown in FIG. 8 is performed for each code area that has been successfully decoded, and the second color reference pattern P2 is detected in each code area. In this way, the second color reference pattern P2 is detected in all the code areas that have been successfully decoded.

  After the process of S40, as shown in FIG. 6, it is determined whether or not the detection of any of the second color reference patterns P2 is successful (S50), and if successful, Yes in S50. Then, the correction data generation process is performed (S60).

  In the present embodiment, difference data similar to that in FIG. 13 is generated for all the second color reference patterns that have been successfully detected in the processing of S60, and correction similar to that in the first embodiment is performed for each second color reference pattern. Data is calculated. For example, when the second color reference patterns P2a, P2b, P2c, and P2d as shown in FIG. 14 are detected in S40, the second color reference patterns P2a, P2b, P2c, and P2d are detected as shown in FIG. The correction data corresponding to each of the second color reference patterns P2a, P2b, P2c, and P2d is calculated and stored.

  For example, a method for generating correction data corresponding to the second color reference pattern P2a will be described. First, the second color information is extracted from the second color reference pattern P2a (similar to S61: FIG. 9) and the second color reference is made. First color information recorded in the pattern P2a is read (similar to S62: FIG. 9), and difference data corresponding to the second color reference pattern P2a is calculated based on the first color information and the second color information (S63). Same as FIG. 9). Then, based on the difference data, correction data (R component addition value, G component addition value, B component addition value) corresponding to the second color reference pattern P2a is calculated by the same method as in the first embodiment (S64). Same as FIG. 9), and memorize it.

  Such processing is also performed for the other second color reference patterns P2b, P2c, and P2d, and correction data (R component addition value, G component addition value, B component addition value) corresponding to the second color reference pattern P2b, Correction data corresponding to the second color reference pattern P2c (R component addition value, G component addition value, B component addition value), correction data corresponding to the second color reference pattern P2d (R component addition value, G component addition value, B component addition value) is calculated. When such correction data is generated, a notification process similar to that of the first embodiment is performed (S70), and then a process of generating a corrected image is performed (S80).

  In the present embodiment, the corrected image generation method in S80 is different from that in the first embodiment. In the processing in S80 of the present embodiment, first, the position of each two-dimensional code Q2 in the image to be imaged acquired in S10. And the image is divided into a plurality of regions based on the position of the two-dimensional code Q2. There are various image division methods. For example, as shown in FIG. 14, the center position (for example, the center in the vertical direction and the horizontal direction) P1 of the image of the target T (imaging target) is obtained, and the center position is determined. A method of setting each boundary line passing through P1 and passing through an intermediate position of two-dimensional codes adjacent to each other is mentioned. In the example of FIG. 14, a boundary line L1 passing through the middle position between the upper left two-dimensional code Q2a and the upper right two-dimensional code Q2b and passing through the center position P1 is set. Similarly, the upper right two-dimensional code Q2b and the right A boundary line L2 passing through the intermediate position of the lower two-dimensional code Q2d and passing through the central position P1 is set, passes through the intermediate position of the lower right two-dimensional code Q2d and the lower left two-dimensional code Q2c, and the central position A boundary line L3 passing through P1 is set, and a boundary line L4 passing through the middle position between the upper left two-dimensional code Q2a and the lower left two-dimensional code Q2c and passing through the center position P1 is set. By setting such boundary lines L1 to L4, the captured image AR is divided into four areas AR1 to AR4.

  Then, after the image is divided into a plurality of regions in this way, color correction for each region is performed based on the second color information of the two-dimensional code Q2 that is close to each region. For example, as shown in FIG. 14, when the two-dimensional code Q2 is arranged in each of the divided areas AR1 to AR4, the color correction of each area is performed by correction data obtained by the two-dimensional code Q2 in each area. Based on. For example, the color correction of the image in the area AR1 is performed based on correction data corresponding to the two-dimensional code Q2a included in the area AR1 (that is, correction data corresponding to the second color reference pattern P2a). R component addition value, G component addition value, and B component addition value of correction data corresponding to the second color reference pattern P2a with respect to the R component luminance value, G component luminance value, and B component luminance value of each pixel in the area AR1 Are respectively added.

  The same applies to the other areas AR2 to AR4. For the area AR2, color correction (color correction similar to the area AR1) is performed on the correction data corresponding to the two-dimensional code Q2b included in the area AR2, and the area AR3 is displayed. Also, color correction (color correction similar to the area AR1) is performed using correction data corresponding to the two-dimensional code Q2d included in the area AR3. For the area AR4, color correction (color correction similar to that for the area AR1) is performed using correction data corresponding to the two-dimensional code Q2c included in the area AR4.

  In the above method, as shown in FIG. 16, even when only three of the two-dimensional codes Q2 that should originally be four are detected (or when only three are successfully decoded), Color correction can be appropriately performed based on these three two-dimensional codes Q2. In this case, the captured image can be divided into a plurality of regions based on the three successfully decoded two-dimensional codes Q2e, Q2f, and Q2g. For example, as shown in FIG. 16, the upper-right two-dimensional code Q2e and the lower-right code A boundary line L21 passing through the intermediate position of the two-dimensional code Q2f and passing through the center position P1, and similarly passing through the intermediate position of the two-dimensional code Q2f on the lower right and the two-dimensional code Q2g on the lower left, A boundary line L22 passing through the center position P1 is set, and further, a boundary line L23 passing through an intermediate position between the lower left two-dimensional code Q2g and the upper right two-dimensional code Q2e and passing through the center position P1 is set. By setting such boundary lines L21 to L23, the captured image can be divided into three areas AR21 to AR23. Also in this case, the color correction of each area can be performed based on the correction data obtained by the two-dimensional code Q2 in each area.

[Other Embodiments]
The present invention is not limited to the embodiments described with reference to the above description and drawings. For example, the following embodiments are also included in the technical scope of the present invention.

  In the above embodiment, an example in which the imaging unit (first imaging unit) that images the first color reference pattern P1 and the imaging unit (second imaging unit) that images the second color reference pattern P2 is the same is shown. These may be imaged by different imaging means.

  In the embodiment described above, the imaging apparatus 10 is used as a means for capturing an image, and the imaging system 1 using an information processing apparatus 20 separate from the imaging apparatus 10 as a means for performing various image processing such as color correction. Although illustrated, the configuration of the imaging system is not limited to such a configuration. For example, the imaging system and the information processing unit may be provided in a single case.

  In the above embodiment, as an example of the processing of S1, an example in which the QR code Q1 with the first color reference pattern P1 is captured has been described. However, other types may be used as long as the first color reference pattern is attached. Information code (for example, data matrix code, maxi code, etc.).

  In the above-described embodiment, an example in which the information code Q1 to which the first color reference pattern P1 is attached in S1 is shown. However, the present invention is not limited to this example as long as an image of the first color reference pattern P1 can be acquired. For example, only the first color reference pattern P1 may be imaged.

  In the above embodiment, the point where the first color reference pattern P1 is arranged in the specific part of the information code Q1 is defined in advance. However, the cell arrangement is not performed without predefining the position where the first color reference pattern P1 is arranged. You may prescribe only. In this case, a process for detecting a prescribed cell array may be performed in S2.

  In the above embodiment, as the second color reference pattern, a pattern having the same color arrangement as the first color reference pattern is exemplified, but the “second color reference pattern corresponding to the first color reference pattern” It is not restricted to the same structure. For example, although the cell arrangement is different from that of the first color reference pattern, a cell group including all types included in the first color reference pattern may be configured as the second color reference pattern.

In the first embodiment, when the correction data is generated in S60 (FIG. 6), the color correction processing is performed on the image to be imaged. However, the first color information and the first color information between S60 and S70 are used. A determination step is provided for comparing the two color information and determining whether or not there is a predetermined difference between the first color information and the second color information, and when it is determined in this determination step that there is a predetermined difference You may make it perform the alerting | reporting process (notification step) of S70. There are various “predetermined differences”. For example, when the absolute value of any of the R component addition value, the G component addition value, and the B component addition value obtained as correction data exceeds a predetermined threshold (for example, 10) It may be determined that there is a “predetermined difference”. Alternatively, there is a “predetermined difference” when the absolute value of any of the difference values obtained for each color and for each component based on the first color information and the second color information exceeds a predetermined threshold (for example, 10). You may make it judge.
When it is determined that there is a “predetermined difference” in the determination step, the color correction process (color correction step) in S80 can be performed. In this way, whether or not there is a difference between the environment when the first color reference pattern P1 is imaged (preliminary environment) and the environment when the imaging target is actually imaged (imaging environment) is determined by the color information. It can be determined appropriately as a reference, and if there is a difference, the user can be informed accordingly. Further, when the environment (imaging environment) when the imaging target is imaged is similar to the environment (preliminary environment) when the first color reference pattern P1 is imaged, the color correction is omitted to speed up the processing. If the imaging environment has changed to some extent with respect to the previous environment, color correction can be performed to correct image changes due to environmental differences.

  In the second embodiment, an example of dividing an image has been shown, but the dividing method is not limited to this. For example, the captured image may be divided into a plurality of predetermined regions regardless of the position of the two-dimensional code. In this case, the color correction of each area may be performed based on the two-dimensional code included in each area (or the closest two-dimensional code if not included).

DESCRIPTION OF SYMBOLS 1 ... Imaging system 10 ... Imaging device (Imaging means, 1st imaging means, 2nd imaging means)
20. Information processing apparatus (first extraction means, second extraction means, reading means, code creating means, color correcting means, optical information reading means)
30 ... Printing device (code creation means)
Q1 ... Information code Q2 ... Two-dimensional code P1 ... First color reference pattern P2 ... Second color reference pattern

Claims (6)

A color correction method for performing color correction of an image to be imaged captured by an imaging means,
A first imaging step of imaging a first color reference pattern by a first imaging means;
A first extraction step of extracting first color information from the first color reference pattern imaged in the first imaging step by a first extraction unit;
Code creation for creating a two-dimensional code in which a second color reference pattern corresponding to the first color reference pattern is arranged and in which the first color information extracted in the first extraction step is recorded is created by a code creation means Steps,
A second imaging step of imaging the imaging object together with the two-dimensional code created in the code creation step by the imaging means that is the same as or different from the first imaging means;
A second extraction unit that specifies the second color reference pattern in the image of the two-dimensional code imaged in the second imaging step and extracts the second color information from the second color reference pattern; An extraction step;
A reading step of reading the first color information from the image of the two-dimensional code imaged in the second imaging step by a reading unit;
Based on the first color information read in the reading step and the second color information extracted in the second extraction step, an image of the imaging target imaged in the second imaging step is added. On the other hand, a color correction step for performing color correction by the color correction means,
A color correction method comprising: The first color reference pattern is arranged in an information code;
In the first imaging step, imaging of the information code is performed by an optical information reading unit that is the same as or different from the imaging unit, and in the first extraction step, by the optical information reading unit, A process of detecting a cell group of a specific color array indicating the first color reference pattern from the information code, and a process of detecting color data of each cell constituting the cell group are performed, and the color of each cell The color correction method according to claim 1, wherein data is extracted as the first color information. After the reading step and the second extracting step, the first color information read in the reading step is compared with the second color information extracted in the second extracting step, and the first color A determination step of determining whether there is a predetermined difference between the information and the second color information;
An informing step for informing when it is determined by the determining step that the predetermined difference exists;
Including
The color correction according to claim 1, wherein the color correction step is performed on the image to be imaged when it is determined that the predetermined difference is present in the determination step. Method. In the second imaging step, a plurality of the two-dimensional codes created in the code creation step are imaged together with the imaging target in a state where a plurality of the two-dimensional codes are dispersed in an imaging area,
In the color correction step, the image to be imaged captured in the second imaging step is divided into a plurality of regions, and color correction for each region is performed using the second of the two-dimensional code adjacent to each region. The color correction method according to claim 1, wherein the color correction method is performed based on color information. The first color reference pattern includes a plurality of color cells arranged in a predetermined arrangement,
The second color reference pattern is composed of the same cell array as the first color reference pattern,
In the first extraction step, an RGB component is extracted for each cell color for the image of the first color reference pattern,
In the second extraction step, a process of extracting RGB components for each cell color is performed on the image of the second color reference pattern,
In the color correction step, based on the RGB component for each cell color of the first color reference pattern and the RGB component for each cell color of the second color reference pattern, the R component of the image to be captured, G The color correction method according to claim 1, wherein each of the component and the B component is corrected. An imaging system comprising an optical information reading means, a code creating means, and an imaging device,
The optical information reading means includes
First imaging means for imaging an information code on which a first color reference pattern is arranged;
First extraction means for detecting the first color reference pattern in the information code imaged by the first imaging means and extracting the first color information from the first reference pattern;
With
The code creation means creates a two-dimensional code in which a second color reference pattern corresponding to the first color reference pattern is arranged and the first color information extracted by the first extraction means is recorded in a data area Is configured to
The imaging device
Imaging means capable of imaging an imaging target together with the two-dimensional code created by the code creating means;
Second extraction means for specifying the second color reference pattern and extracting the second color information from the second color reference pattern in the image of the two-dimensional code imaged together with the imaging target by the imaging means; ,
Reading means for reading the first color information from the image of the two-dimensional code imaged together with the imaging object by the imaging means;
Based on the first color information read by the reading unit and the second color information extracted by the second extraction unit, color correction is performed on the image to be imaged captured by the imaging unit. Color correction means to perform;
An imaging system comprising:

Images