JP2016001108A - Colorimetric system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To eliminate the need of acquiring data of a base length and an angle of view in advance in a colorimetric system having a colorimetric device combined with a digital camera.SOLUTION: A colorimetric system 1a includes: a colorimeter 3 that measures a color of a measurement point SP; a first digital camera 2 that photographs the measurement point SP and creates image data showing a first image 31 that is a color image including an image of the measurement point SP; a corresponding point specification part 51 that takes a point corresponding to the measurement point SP in the first image 31 as a corresponding point 37 and specifies the corresponding point 37 through corresponding point search; and a position information calculation part 52 that calculates position information indicating the position, on the first image 31, of the corresponding point 37 specified by the corresponding point specification part 51.

Description

  The present invention relates to a system using a color measuring device.

  A colorimeter is a device that can measure color and is applied in various industrial fields. The colorimeter may be used alone or in combination with other devices. As a specific example, a colorimeter that measures the color of the target portion of the subject, a digital camera that captures a color image of the subject including the target portion, and a digital camera using the color of the target portion measured by the colorimeter There has been proposed a photographing system including a color correction unit that corrects the color of a color image photographed in (see, for example, Patent Document 1).

JP-A-2005-341175 (paragraphs 0019 to 0033)

  The color correction unit of the above system calculates the correction coefficient using the color of the target portion measured by the colorimeter and the color of the portion (corresponding portion) on the color image corresponding to the target portion. Need to be identified. In the above system, the corresponding portion is specified using the base line length between the position of the colorimeter and the position of the digital camera, the angle of view of the colorimeter, the angle of view of the digital camera, and the like. Therefore, such data has to be acquired in advance, which is complicated.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a color measurement system in which data such as a baseline length and an angle of view need not be acquired in advance in a color measurement system that combines a color measurement device and a digital camera.

  A colorimetric system according to the present invention that achieves the above-described object shows a colorimetric device that measures the color of a measurement location, and a first image that is a color image that captures the measurement location and includes an image of the measurement location. A first digital camera that generates image data; a corresponding location in the first image that corresponds to the measurement location; and a corresponding location specifying unit that identifies the corresponding location by corresponding location search; and the corresponding location A position information calculation unit that calculates position information indicating the position on the first image where the corresponding portion specified by the specifying unit is located.

  Due to the difference in parallax caused by the difference between the optical axis of the colorimetric device and the optical axis of the first digital camera, the measurer determines that the corresponding location corresponding to the measurement location in the first image is the first location. It is hard to understand where it is on the image. According to the color measurement system according to the present invention, the corresponding part is specified by the corresponding point search. Therefore, even if there is no data such as the base line length between the optical axis of the color measuring device and the optical axis of the first digital camera, the angle of view of the color measuring device, and the angle of view of the first digital camera, Can be identified.

  In the above-described configuration, the color measurement device includes a light receiving optical system through which light from the measurement point passes, a branching unit that branches the light that has passed through the light receiving optical system into a first direction and a second direction, The color of the measurement location is measured using light branched in the second direction, and the color measurement system photographs the measurement location using the light branched in the first direction. And a second digital camera that generates image data indicating a second image including the image of the measurement location, and the corresponding location specifying unit uses the first image and the second image. The corresponding part is specified by the corresponding point search.

  In this configuration, a corresponding portion is specified by a corresponding point search using the first image obtained by the first digital camera and the second image obtained by the second digital camera.

  In the above configuration, the corresponding location specifying unit cuts out an image including the image of the measurement location from the second image, uses the cut out image as a reference window, and a reference window that is an image cut out from the first image; The corresponding part is specified by pattern matching with the reference window.

  This configuration is an aspect in which a corresponding portion is specified by searching for a corresponding point using the first image and the second image.

  In the above-described configuration, the color measurement system further includes a template storage unit that stores a template indicating an image of a characteristic portion of the subject including the measurement location, and the color measurement device includes the measurement location of the measurement location in the second image. The image is adjusted so that the image is located at the center, and the corresponding location specifying unit displays the image corresponding to the image of the feature portion in the first image as the first image and the feature portion as the second image. The first image and the second image are searched using the template using the image corresponding to the image of the second image as the second image, and the first image and the second image obtained as a result of the search are searched for. When the image is overlaid, the location of the first image corresponding to the center of the second image is identified as the corresponding location.

  According to this configuration, it is possible to specify the corresponding location using the characteristic portion of the subject. In this configuration, it is assumed that the image of the measurement location is adjusted in advance so as to be positioned at the center of the second image.

  In the above configuration, the color measurement system further includes a projection unit that projects a predetermined pattern onto the measurement location, and the first digital camera captures the predetermined pattern and includes the image of the predetermined pattern. The second digital camera captures the predetermined pattern, generates image data indicating the second image including the image of the predetermined pattern, and the corresponding location specifying unit Cut out an image including the image of the predetermined pattern from the second image, pattern-matching the reference window and the reference window, which are images cut out from the first image, using the cut-out image as a reference window The corresponding portion is specified by specifying the image of the predetermined pattern on the first image.

  According to this configuration, since the corresponding point search is performed using the predetermined pattern projected on the measurement location, the corresponding location can be specified even if the subject is plain.

  The said structure WHEREIN: The said corresponding location specific | specification part performs the said corresponding point search with respect to the setting area | region preset as an area | region where the said corresponding point search is performed in a said 1st image.

  In this configuration, the corresponding point search target is not the entire first image but a set area. Therefore, since the range to be searched for corresponding points can be narrowed down, the time required for specifying the corresponding points can be shortened.

  The said structure WHEREIN: The said colorimetry system is further provided with the input part which inputs the said setting area | region on the said 1st image.

  This configuration is an aspect of setting the setting area.

  In the above-described configuration, the colorimetric system determines in advance a difference from a value in a predetermined color system indicating the color of the measurement location measured by the colorimetric device in the pixels constituting the first image. The image processing apparatus further includes a setting area setting unit that extracts pixels having a color less than or equal to a predetermined value and sets a predetermined area including the extracted pixels as the setting area.

  According to this configuration, the setting area can be automatically set using the color value of the measurement location measured by the color measuring device.

  In the above configuration, the color measurement device includes a housing having an attachment portion to which the first digital camera can be attached, and the color measurement system includes the color measurement device and the attachment portion attached to the attachment portion. A positional relationship information storage unit that stores positional relationship information indicating a relative positional relationship with the first digital camera; and a setting region setting unit that sets the setting region using the positional relationship information. .

  According to this configuration, the setting area can be automatically set.

  In the above-described configuration, the color measurement device includes a light receiving optical system through which light from the measurement point passes, a branching unit that branches the light that has passed through the light receiving optical system into a first direction and a second direction, The color of the measurement location is measured using light branched in the second direction, and the color measurement system is arranged at a location where the light branched in the first direction can be received. And a chart having a mark in which at least the X coordinate value and the Y coordinate value coincide with the position of the measurement location in an XYZ orthogonal coordinate system in which the optical axis direction of the color measurement device is the Z direction. The first digital camera shoots the mark, generates image data indicating a third image that is a color image including the image of the mark, and the second digital camera Take a picture of the mark Image data indicating a fourth image including the image of the image is generated, and the corresponding location specifying unit cuts out the image of the mark from the third image and the fourth image, and If the difference in luminance is equal to or smaller than a predetermined value, the location on the first image corresponding to the position of the image of the mark on the third image is set as the corresponding location.

  According to this configuration, since the corresponding portion is specified using the luminance, the monochrome camera can be used as the second digital camera.

  In the above-described configuration, the color measurement device includes a light receiving optical system through which light from the measurement point passes, a branching unit that branches the light that has passed through the light receiving optical system into a first direction and a second direction, The color of the measurement location is measured using light branched in the second direction, and the color measurement system is arranged at a location where the light branched in the first direction can be received. In the XYZ orthogonal coordinate system in which the optical axis direction of the digital camera and the colorimetric device is the Z direction, at least the X coordinate value and the Y coordinate value are at positions that match the position of the measurement location, and a plurality of different densities And a chart having a mark constituted by the area, wherein the first digital camera captures the mark and generates image data indicating a third image which is a color image including the image of the mark And the second digital The camera captures the mark, generates image data indicating a fourth image including the mark image, and the colorimetric device causes the mark image to be positioned at the center of the fourth image. Adjusted in advance, and the corresponding location specifying unit includes the third image and the third image so that the mark image included in the third image overlaps the mark image included in the fourth image. The fourth image is arranged, and the location of the first image corresponding to the center of the fourth image in this arrangement state is specified as the corresponding location.

  According to this configuration, since the corresponding portion is specified using the mark constituted by a plurality of regions having different densities, the monochrome camera can be used as the second digital camera.

  In the above-described configuration, the color measurement system is in an XYZ orthogonal coordinate system in which the optical axis direction of the color measurement device is the Z direction, and at least the X coordinate value and the Y coordinate value are at a position that matches the position of the measurement location. A chart having a mark; and a color of the mark is measured by the colorimetric device, and the first digital camera captures a third image, which is a color image including the mark image. The corresponding location specifying unit cuts out the image of the mark from the third image, a value in a predetermined color system indicating the color of the cut out image of the mark, and the colorimetry Corresponding to the position of the image of the mark on the third image if the difference from the value in the predetermined color system indicating the color of the mark measured by the apparatus is not more than a predetermined value The first to The point on the image, and the corresponding locations.

  According to this configuration, since the corresponding portion is specified using the color of the mark measured by the color measurement device, the second digital camera is unnecessary.

  The said structure WHEREIN: The said colorimetry system is further provided with the display part and the display control part which displays the said 1st image containing the mark which shows the said corresponding location on the said display part.

  According to this configuration, the measurer can visually recognize the position of the measurement location.

  In the above configuration, the color measurement system includes the first color information indicating the color of the measurement location measured by the color measurement device and the image data indicating the first image, and the color of the corresponding location. A correction coefficient calculation unit that calculates a color correction coefficient using the second color information indicating

  According to this configuration, the correction coefficient used for correcting the color of the first image can be calculated.

  According to the present invention, in a color measurement system that combines a color measurement device and a digital camera, it is possible to eliminate the need to previously acquire data such as the baseline length and the angle of view.

It is a schematic diagram which shows the outline | summary of the color measurement system which concerns on 1st Embodiment. It is a schematic diagram of the color measurement system which concerns on 1st Embodiment. It is a schematic diagram which shows a 2nd image. It is a block diagram which shows the structure of the color measurement system which concerns on 1st Embodiment. It is a schematic diagram of a spectroscopic part. It is a flowchart explaining operation | movement of the color measurement system which concerns on 1st Embodiment. It is a schematic diagram of the display part which displays a 1st image so that a corresponding location may be located in the center point of a display part. It is a schematic diagram of the color measurement system which concerns on the 1st modification of 1st Embodiment. It is a schematic diagram of the color measurement system which concerns on the 2nd modification of 1st Embodiment. It is a block diagram which shows the structure of the color measurement system which concerns on the 3rd modification of 1st Embodiment. It is a schematic diagram of the color measurement system which concerns on the 4th modification of 1st Embodiment. It is a schematic diagram of the color measurement system which concerns on the 5th modification of 1st Embodiment. It is a block diagram which shows the structure of the color measurement system which concerns on the 6th modification of 1st Embodiment. It is a schematic diagram which shows the state in which the setting area | region is automatically set by the setting area | region setting part. It is a block diagram which shows the structure of the color measurement system which concerns on the 7th modification of 1st Embodiment. It is a schematic diagram of the color measurement system which concerns on 2nd Embodiment. It is a schematic diagram of a chart. It is a schematic diagram which shows a 4th image. It is a schematic diagram of the color measurement system which concerns on the modification of 2nd Embodiment. It is a schematic diagram of the chart used in the modification of 2nd Embodiment. It is a schematic diagram which shows a 4th image. It is a schematic diagram of the color measurement system which concerns on 3rd Embodiment. In the color measurement system which concerns on 3rd Embodiment, it is a schematic diagram which shows the state by which the chart is arrange | positioned. It is a schematic diagram of a chart. It is a schematic diagram of the chart used in the modification of 3rd Embodiment.

  Hereinafter, first to third embodiments of the present invention will be described in detail with reference to the drawings. In each figure, the structure which attached | subjected the same code | symbol shows that it is the same structure, The description is abbreviate | omitted about the content which has already demonstrated the structure.

  FIG. 1 is a schematic diagram showing an overview of a color measurement system 1a according to the first embodiment. The color measurement system 1 a includes a first digital camera 2, a colorimeter 3, a corresponding location specifying unit 51, a position information calculation unit 52, and a position information storage unit 61.

  The first digital camera 2 captures the subject 100 located within the range of the angle of view α and generates image data indicating a color image of the subject 100. The subject 100 includes a measurement point SP where the color is measured. Therefore, the first digital camera 2 captures the measurement spot SP and generates image data indicating the first image 31 (FIG. 2) that is a color image including an image of the measurement spot SP.

  The colorimeter 3 functions as a color measuring device that measures the color of the measurement point SP.

  As will be described later with reference to FIG. 2, a location corresponding to the measurement location SP in the first image 31 that is a color image is defined as a correspondence location 37. The corresponding location specifying unit 51 specifies the corresponding location 37 by searching for corresponding points.

  The position information calculation unit 52 calculates position information indicating the position on the first image 31 where the corresponding point 37 specified by the corresponding point specifying unit 51 is located.

  The position information storage unit 61 stores the position information calculated by the position information calculation unit 52.

  FIG. 2 is a schematic diagram of the color measurement system 1a according to the first embodiment. The color measurement system 1 a includes a first digital camera 2, a colorimeter 3, a second digital camera 4, and an information processing device 5.

  The first digital camera 2 includes an optical system such as an objective lens, and a two-dimensional solid-state imaging device that receives light that has passed through the objective lens. The first image 31 that is a color image photographed by the first digital camera 2 may be either a still image or a moving image. A digital color camera or a digital color movie can be used as the first digital camera 2.

  The angle of view α of the first digital camera 2 is larger than the angle of view β of the colorimeter 3.

  The first digital camera 2 is installed so that the optical axis 101 of the first digital camera 2 is parallel or substantially parallel to the optical axis 103 of the colorimeter 3. In addition, the first digital camera 2 is installed at a position where the subject 100 can be photographed from the same side as the side where the colorimeter 3 measures the color of the measurement spot SP as viewed from the measurer.

  The first digital camera 2 is outside the colorimeter 3 and is installed as described above using a tripod or the like. The installation position of the first digital camera 2 may be a position where the subject 100 can be photographed. When viewed from the measurer, the subject 100 can be photographed from the same side as the side where the color of the measurement point SP is measured by the colorimeter 3 (FIG. 2), and the measurement point on the optical axis 101 of the first digital camera 2 is measured. It is preferable to install the first digital camera 2 so that the SP is located.

  A first image 31, which is a color image taken by the first digital camera 2, is displayed on the display unit 30 of the information processing device 55. Therefore, the measurer can check the subject 100 photographed by the first digital camera 2 while looking at the display unit 30. In the case of the first digital camera 2 equipped with an EVF (Electronic View Finder), the subject 100 can be confirmed by looking at the EVF.

  The colorimeter 3 is a color luminance meter having one point (spot) of the subject 100 as a measurement location SP. Note that a colorimeter 3 may be a two-dimensional color luminance meter, a spectral luminance meter, or the like.

  The colorimeter 3 includes an optical finder 10 that allows a measurer to check the measurement location SP.

  The second digital camera 4 is detachably attached to a mount portion provided in the optical viewfinder 10. The second digital camera 4 photographs the measurement spot SP via the optical finder 10 and generates image data indicating a second image 90 (FIG. 3) including the image 91 of the measurement spot. The range captured by the second digital camera 4 is the range of the angle of view β of the colorimeter 3. The second image 90 photographed by the second digital camera 4 may be color or monochrome.

  FIG. 3 is a schematic diagram showing the second image 90. The second image 90 is an image of a part of the subject 100 including the image 91 of the measurement location. A circular area is shown as an image 91 of the measurement location. This virtually shows an image 91 of the measurement location, not an actual image. As shown in FIG. 2, since the measurement spot SP is located on the optical axis 103 of the colorimeter 3, the measurement spot image 91 is located at the center of the second image 90.

  Referring to FIG. 2, software (application) dedicated to the colorimeter is installed in the information processing apparatus 5. In the first embodiment, the personal computer is the information processing device 5, but a smartphone or a tablet terminal may be the information processing device 5.

  The information processing apparatus 5 has functions as the corresponding location specifying unit 51, the position information calculation unit 52, and the position information storage unit 61 described with reference to FIG. The information processing apparatus 5 includes a display unit 30 and executes processing for displaying the first image 31 captured by the first digital camera 2 on the display unit 30, processing for searching for corresponding points described later, and the like. To do.

  The first image 31 includes an x-axis 34, a y-axis 35, and a cursor 36 in addition to the image 32 of the subject 100 and the background. The point where the x-axis 34 and the y-axis 35 intersect indicates the center point 33 of the display unit 30. A center point 33 indicates the position of the optical axis 101 of the first digital camera 2. A circular area is shown as a corresponding location 37. This shows not the actual image but the corresponding portion 37 virtually.

  FIG. 4 is a block diagram showing the configuration of the color measurement system 1a according to the first embodiment. In addition to the optical finder 10, the colorimeter 3 includes a light receiving optical system 12, including an objective lens, a branch mirror 13, a plane boundary 14, a relay optical system 15, a spectroscopic unit 16, a control processing unit 17, a storage unit 18, and An IF unit 19 is provided.

  The colorimeter 3 includes a light receiving optical system 12 through which the light L from the measurement point SP passes, and a branching unit (branching mirror) that branches the light L that has passed through the light receiving optical system 12 into a first direction and a second direction. 13), and the color of the measurement spot SP is measured using the light L2 branched in the second direction. More specifically, the light L incident on the light receiving optical system 12 is converged on the branch mirror 13 by the light receiving optical system 12. Thereby, an image 20 is formed on the branch mirror 13. In addition, the light L from the measurement location SP means the light L reflected from the measurement location SP or emitted from the measurement location SP.

  A part of the light L converged on the branch mirror 13 is reflected by the branch mirror 13 as light L1, and the rest passes through the branch mirror 13 as light L2. Of the light L converged on the branch mirror 13, for example, 10 percent is reflected and 90 percent is transmitted.

  The light L2 enters the spectroscopic unit 16. FIG. 5 is a schematic diagram of the spectroscopic unit 16. The spectroscopic unit 16 includes, for example, an imaging optical system 40, a reflective diffraction grating 41, a line sensor 42, and a housing 43 that houses the imaging optical system 40, the reflective diffraction grating 41, and the line sensor 42. Prepare.

  The housing 43 is a box formed of a material having a light shielding property with respect to a wavelength range in which the line sensor 42 can receive light. An incident opening (for example, a slit) 44 that guides the light L <b> 2 into the housing 43 is formed on one side surface of the housing 43.

  The light L2 is refocused on the entrance aperture 44 by the relay optical system 15 (FIG. 4). The light L2 incident from the incident aperture 44 enters the imaging optical system 40, is collimated by the imaging optical system 40, enters the reflective diffraction grating 41, and is diffracted by the reflective diffraction grating 41. And reflected. The reflected light is incident on the imaging optical system 40 again, and is formed on the light receiving surface 45 of the line sensor 42 by the imaging optical system 40 as a wavelength dispersion image of the optical image.

  The line sensor 42 includes a plurality of photoelectric conversion elements arranged along one direction. The photoelectric conversion element is, for example, a silicon photodiode (SPD). The line sensor 42 photoelectrically converts the wavelength dispersion image of the optical image formed on the light receiving surface 45 by each of the plurality of photoelectric conversion elements, thereby generating an electric signal representing the intensity level of each wavelength. Then, the line sensor 42 outputs this electric signal (measurement result) to the control processing unit 17 (FIG. 4).

  The spectroscopic unit 16 is not limited to a polychromator using the diffraction grating described above. A polychromator that combines a continuous interference film filter and an SPD (silicon photodiode), or a tristimulus type that measures colors by rotating three color filters may be used.

  The control processing unit 17, the storage unit 18, and the IF unit 19 will be described with reference to FIG.

  The storage unit 18 is a circuit that is connected to the control processing unit 17 and stores various predetermined programs and various predetermined data under the control of the control processing unit 17. The various predetermined programs include, for example, a control processing program such as a measurement program for measuring the light L2. Various kinds of predetermined data include correction coefficients obtained by the control processing unit 17 described later.

  The storage unit 18 includes, for example, a ROM (Read Only Memory) that is a nonvolatile storage element, and an EEPROM (Electrically Erasable Programmable Read Only Memory) that is a rewritable nonvolatile storage element. The storage unit 18 further includes a RAM (Random Access Memory) serving as a working memory of the control processing unit 17 that temporarily stores data generated during execution of the predetermined program.

  The control processing unit 17 is a circuit that is connected to the spectroscopic unit 16, the storage unit 18, and the IF unit 19, controls each unit of the colorimeter 3 according to the function of each unit, and calculates the color of the measurement location SP. . The control processing unit 17 includes, for example, a CPU (Central Processing Unit) and its peripheral circuits.

  The control processing unit 17 will be described in detail. The control processing unit 17 calculates the color indicated by the light L2 (that is, the color of the measurement spot SP) based on the electrical signal (measurement result) output from the line sensor 42 (FIG. 5).

  Here, when the spectral distribution (measurement result) of the light L2 is P (λ) and the CIE color matching functions are x (λ), y (λ), and z (λ), the tristimulus values of the light L2 are as follows: It is given by Equation (1), Equation (2), and Equation (3). The CIE color matching functions x (λ), y (λ), and z (λ) are stored in the storage unit 18 in advance.

X = ∫P (λ) · x (λ) dλ (1)
Y = ∫P (λ) · y (λ) dλ (2)
Z = ∫P (λ) · z (λ) dλ (3)
The control processing unit 17 calculates the first color information indicating the color of the measurement point SP using Expression (1), Expression (2), and Expression (3).

  The IF unit 19 is a circuit that is connected to the control processing unit 17 and inputs / outputs data to / from an external device under the control of the control processing unit 17. Specifically, as the IF unit 19, an RS-232C interface circuit that is a serial communication method, an interface circuit that uses the Bluetooth (registered trademark) standard, an interface circuit that performs infrared communication such as an IrDA (Infrared Data Association) standard, And an interface circuit using a USB (Universal Serial Bus) standard. The same applies to IF units 39, 40, and 80 described later. Thus, the communication using the IF units 19, 39, 40, and 80 may be wired or wireless.

  Next, the optical finder 10 will be described. The light L <b> 1 reflected by the branch mirror 13 is totally reflected by the plane boundary 14 and enters the optical finder 10. The incident light L <b> 1 is converged by the relay optical system 21 in the optical finder 10, and a relay image 22 of the image 20 is formed in the optical finder 10. The measurer can see the relay image 22 through the eyepiece 11 when the second digital camera 4 is removed from the mount provided on the optical viewfinder 10.

  As described above, the light beam incident on the single light receiving optical system (the light receiving optical system 12 including the objective lens) is split by the light beam splitting means (branching mirror 13) and guided to the optical finder 10 and the spectroscopic unit 16. Accordingly, the measurement spot SP can be viewed on the optical finder 10 using the same light receiving optical system 12 as the light receiving optical system 12 used for color measurement.

  The optical axis 103 (FIG. 2) of the colorimeter 3 passes through the light receiving optical system 12 and is divided into an optical axis extending to the spectroscopic unit 16 by the branch mirror 13 and an optical axis extending to the optical viewfinder 10. The second digital camera 4 is detachably attached to a mount portion provided in the optical viewfinder 10 so that the optical axis extending to the optical viewfinder 10 and the optical axis of the second digital camera 4 coincide. .

  The second digital camera 4 captures the relay image 22 through the optical viewfinder 10 and generates image data indicating the relay image 22. As described above, the second digital camera 4 is arranged at a location where the light L1 that has passed through the light receiving optical system 12 passes, images the measurement location SP, and shows a second image 90 including an image of the measurement location SP. Generate image data.

  Image data indicating the second image 90 (relay image 22) is transmitted to the colorimeter 3 by the IF unit 40. The control processing unit 17 uses the IF unit 19 to process the first color information indicating the color of the measurement spot SP measured by the colorimeter 3 and the image data indicating the second image 90 using the IF unit 19. Send to 5.

  The communication between the second digital camera 4 and the colorimeter 3 may be as follows. A first electrode connected to the IF unit 19 is disposed on a mount unit provided in the optical viewfinder 10. The second digital camera 4 is provided with a second electrode that contacts the first electrode when the second digital camera 4 is attached to the mount. Using the first electrode and the second electrode, communication between the second digital camera 4 and the colorimeter 3 (for example, image data indicating the second image 90 is measured from the second digital camera 4. Send to total 3).

  The information processing apparatus 5 will be described. In addition to the display unit 30, the information processing apparatus 5 includes a control processing unit 50, a storage unit 60, an operation unit 70, and an IF unit 80.

  The control processing unit 50 includes a CPU and its peripheral circuits, and includes a corresponding location specifying unit 51, a position information calculation unit 52, a correction coefficient calculation unit 53, a correction unit 54, and a display control unit 55 as functional blocks. .

  The corresponding location specifying unit 51 specifies the corresponding location 37 by searching for corresponding points using the first image 31 and the second image 90 shown in FIGS. 2 and 3. For example, the corresponding location specifying unit 51 cuts out an image including the measurement location image 91 from the second image 90, sets the cut-out image as a reference window, and a reference window and a reference window that are images cut out from the first image 31. And the corresponding portion 37 is specified.

  As will be described later, the position information calculation unit 52 calculates the position information of the corresponding portion 37 using the result of the corresponding point search.

  The correction coefficient calculation unit 53 is included in the first color information indicating the color of the measurement location SP measured by the colorimeter 3 and the image data indicating the first image 31 and indicates the color of the corresponding location 37. The color correction coefficient is calculated using the second color information.

  The correction unit 54 corrects the color of the first image 31 using the correction coefficient calculated by the correction coefficient calculation unit 53.

  The display control unit 55 causes the display unit 30 to display the first image 31 output from the first digital camera 2.

  The IF unit 80 is an interface used to communicate with the IF unit 39 of the first digital camera 2 and the IF unit 19 of the colorimeter 3. Note that an aspect in which the IF unit 80 communicates via the IF unit 19 of the colorimeter 3 without directly communicating with the IF unit 39 of the first digital camera 2 is also possible.

  The storage unit 60 includes a RAM and a nonvolatile memory, and includes a position information storage unit 61 as a functional block. The position information storage unit 61 stores the position information calculated by the position information calculation unit 52.

  From the image data indicating the first image 31 transmitted from the first digital camera 2, the first color information indicating the color of the measurement point SP transmitted from the colorimeter 3, and from the colorimeter 3 The transmitted image data indicating the second image 90 is received by the IF unit 80, and the control processing unit 50 performs control to store them in the storage unit 60. In addition to these data and information, the storage unit 60 stores various calibration data, various correction coefficients, various parameters, information about the first digital camera 2, information about the second digital camera 4, and the like.

  The operation unit 70 is an apparatus that performs an operation that the measurer inputs to the information processing apparatus 5. Examples of the operation unit 70 include a personal computer keyboard, a mouse, and a controller having a cross key.

  The display unit 30 is a display device such as an LCD (Liquid Crystal Display), and may have a touch panel function.

  The operation of the color measurement system 1a according to the first embodiment will be described mainly with reference to FIGS. FIG. 6 is a flowchart for explaining the operation.

  Referring to FIG. 4, the second digital camera 4 is removed from the mount portion provided in the optical viewfinder 10. Light L is incident on the light receiving optical system 12, and an image 20 is formed by the light receiving optical system 12. A relay image 22 of the image 20 is formed in the optical viewfinder 10.

  The measurer looks at the relay image 22 through the eyepiece 11 and aligns the aim of the colorimeter 3 with the measurement point SP. When the aim of the colorimeter 3 is set to the measurement spot SP, the relay image 22 is constituted by the image of the measurement spot SP and the surrounding image. Note that the optical viewfinder 10 and the like are adjusted in advance so that the center of the relay image 22 becomes the image 91 (FIG. 3) of the measurement location when the aim of the colorimeter 3 is set to the measurement location SP. Accordingly, in the second image 90 photographed by the second digital camera 4, the measurement location image 91 is located at the center of the second image 90 as described with reference to FIG. 3.

  The measurer operates the first digital camera 2 to photograph the subject 100 (step S1). Thereby, the first digital camera 2 generates image data indicating the first image 31 which is a color image including the image of the measurement spot SP. Since the range captured by the first digital camera 2 only needs to include the range captured by the second digital camera 4, the entire subject 100 may be captured, and the subject including the measurement location SP A part of 100 may be photographed.

  The first digital camera 2 transmits image data indicating the first image 31 to the information processing apparatus 5 using the IF unit 39 (step S2). The IF unit 80 of the information processing device 5 receives the transmitted image data indicating the first image 31. The control processing unit 50 stores the image data received by the IF unit 80 in the storage unit 60. The display control unit 55 reads the image data indicating the first image 31 stored in the storage unit 60 and displays the first image 31 on the display unit 30 as shown in FIG. 2 (step S3). ).

  The measurer attaches the second digital camera 4 to the mount portion provided in the optical viewfinder 10, and operates the second digital camera 4 to photograph the measurement location SP (step S4). Accordingly, the second digital camera 4 generates image data indicating the second image 90 (FIG. 3) that is an image including the image 91 of the measurement location.

  The second digital camera 4 transmits screen data indicating the second image 90 to the colorimeter 3 using the IF unit 40. The IF unit 19 of the colorimeter 3 receives screen data indicating the transmitted second image 90. The control processing unit 17 stores the image data in the storage unit 18.

  The measurer operates the colorimeter 3 to cause the colorimeter 3 to measure the color of the measurement spot SP (step S5).

  The control processing unit 17 causes the storage unit 18 to store first color information indicating the color of the measurement spot SP measured by the colorimeter 3. The control processing unit 17 reads the first color information and the screen data indicating the second image 90 from the storage unit 18 at a predetermined timing, and transmits them to the information processing device 5 using the IF unit 19. (Step S6).

  The IF unit 80 of the information processing apparatus 5 receives the transmitted first color information and screen data indicating the second image 90. The control processing unit 50 stores them in the storage unit 60.

  The corresponding portion 37 (FIG. 2) is a portion corresponding to the measurement portion SP in the first image 31, as already described. Therefore, the corresponding location 37 is the same as the image 91 (FIG. 3) of the measurement location. The corresponding location specifying unit 51 specifies the corresponding location 37 by searching for corresponding points using the first image 31 and the second image 90. A general corresponding point search can be used for this specification.

  More specifically, the corresponding location specifying unit 51 cuts out a rectangular image including the measurement location image 91 from the second image 90 shown in FIG. 3 (step S7). This clipped image is referred to as a reference window. As described above, since the image 91 of the measurement location is adjusted in advance so as to be positioned at the center of the second image 90, a rectangular area in a predetermined range including the center of the second image 90 is cut out. The selected image becomes the reference window.

  The corresponding part specifying unit 51 sets a reference window, which is a window having the same size as the reference window, at an arbitrary position of the first image 31 transmitted in step S2, and the similarity between the reference window and the reference window is set. It is determined whether the degree is high (step S8). A reference window having a high similarity to the reference window is a window corresponding to the reference window.

  When the shooting magnification is different between the first digital camera 2 and the second digital camera 4, the control processing unit 50 sets the shooting magnification of the image indicated by the image data generated by one camera to the other. The magnification correction is performed on the image data generated by one camera so as to coincide with the photographing magnification of the image indicated by the image data generated by the camera. The storage unit 60 stores in advance information on the shooting magnification of each of the first digital camera 2 and the second digital camera 4. The control processing unit 50 is stored in the storage unit 60 when image data generated by one camera is transmitted to the IF unit 80 or for searching for corresponding points (steps S7 and S8). When the image data generated by one camera is read, the magnification correction can be performed based on the information of the photographing magnification stored in the storage unit 60.

  When it is determined that the degree of similarity is low (No in step S8), the corresponding part specifying unit 51 returns to step S7 and, for example, one pixel horizontally or vertically on the first image 31 (FIG. 2) or a predetermined number The reference window is set by shifting the number of pixels. The corresponding location specifying unit 51 determines whether the similarity between the reference window and the standard window is high (step S8).

  In this way, the corresponding location specifying unit 51 obtains a reference window having a high similarity with the standard window. When a reference window having a high degree of similarity with the reference window is obtained (Yes in step S8), the position information calculation unit 52 calculates the coordinates on the first image 31 for the center of gravity of the reference window. This coordinate is the coordinate of the center of gravity of the corresponding portion 37 (FIG. 2), and is position information of the corresponding portion 37. As described above, the position information calculation unit 52 calculates position information indicating where the corresponding portion 37 is on the first image 31. Then, the position information calculation unit 52 stores the position information in the position information storage unit 61. As described above, the position information of the corresponding portion 37 is calculated and stored (step S9).

  The display control unit 55 uses the position information of the corresponding portion 37 to display the first image 31 so that the corresponding portion 37 is positioned at the center point 33 of the display unit 30 as shown in FIG. Step S10). The center point 33 is the position of the optical axis 101 of the first digital camera 2. Therefore, when the first image 31 displayed on the display unit 30 is used as the EVF of the colorimeter 3, a finder image in which the parallax deviation is corrected can be obtained. When the operation unit 70 is operated and a command for enlarging or reducing the first image 31 is input, the display control unit 55 performs the first operation with the corresponding portion 37 positioned at the center point 33 of the display unit 30. The image 31 is enlarged or reduced for display.

  The center point 33 is an intersection of the x axis 34 and the y axis 35 displayed on the display unit 30. This means that the display control unit 55 causes the display unit 30 to display the first image 31 including the mark indicating the corresponding portion 37. Therefore, the measurer can visually recognize the position of the measurement point SP.

  The correction coefficient calculation unit 53 reads the position information calculated in step S9 from the position information storage unit 61, and calculates the area of the corresponding portion 37 on the first image 31 (in other words, the range of the corresponding portion 37). (Step S11). The position information indicates the position of the corresponding portion 37, that is, the coordinates of the center of gravity of the corresponding portion 37 on the first image 31.

  The correction coefficient calculation unit 53 uses the pixel data in the range of the corresponding portion 37 calculated in step S11 included in the image data indicating the first image 31, and the pixel included in the range of the corresponding portion 37 is red. The average value, green average value, and blue average value are calculated. Next, the correction coefficient calculation unit 53 estimates the spectrum signal S1 using the average value. Then, the correction coefficient calculation unit 53 applies the first color information (spectrum signal S2) indicating the color of the measurement location SP stored in the storage unit 60 and the spectrum signal S1 to the following equation to correct it. The coefficient C is calculated (step S12).

C = S2 / S1
The correction coefficient C is used for the following purposes, for example. The correction unit 54 corrects the screen data indicating the first image 31 stored in the storage unit 60 using the correction coefficient C. The display control unit 55 causes the display unit 30 to display the first screen using the corrected screen data.

  The main effects of the first embodiment will be described. As shown in FIG. 2, due to the difference in parallax caused by the difference between the optical axis 103 of the colorimeter 3 and the optical axis 101 of the first digital camera 2, the measurer can measure the measurement spot SP in the first image 31. It is difficult to understand where the corresponding portion 37 corresponding to the above is on the first image 31. According to the color measurement system 1a according to the first embodiment, as described in step S7 and step S8, the corresponding portion 37 is specified by the corresponding point search. Therefore, data such as the base length of the optical axis 103 of the colorimeter 3 and the optical axis 101 of the first digital camera 2, the angle of view of the colorimeter 3, and the angle of view α of the first digital camera 2 are stored. Even if it does not exist, the corresponding location 37 can be specified.

  (1) and (2) can be realized by utilizing the fact that the corresponding portion 37 is specified. (1) According to the color measurement system 1a according to the first embodiment, as described in step S11 and step S12, information indicating the color of the corresponding location 37 and the color of the measurement location SP measured by the colorimeter 3 are shown. Using the information, a correction coefficient can be calculated and the color of the first image 31 can be corrected. (2) According to the color measurement system 1a according to the first embodiment, as described in step S10, using the position information, as shown in FIG. 7, the corresponding portion 37 is located at the center point 33 of the display unit 30. The first image 31 can be controlled to be positioned. The center point 33 is the position of the optical axis 101 of the first digital camera 2. Therefore, when the first image 31 displayed on the display unit 30 is used as the EVF of the colorimeter 3, a finder image in which the parallax shift is corrected can be obtained.

  The first embodiment has the following modifications. FIG. 8 is a schematic diagram of the color measurement system 1b according to the first modification. The difference from the colorimetric system 1 a according to the first embodiment shown in FIG. 2 is that the first digital camera 2 is attached to the colorimeter 3 outside the colorimeter 3. A pedestal 110 is provided in the casing of the colorimeter 3, and the first digital camera 2 is fixed to the pedestal 110. As a result, the first digital camera 2 is attached to the colorimeter 3.

  FIG. 9 is a schematic diagram of a color measurement system 1c according to a second modification. Differences from the color measurement system 1a according to the first embodiment shown in FIG. 2 are as follows.

  In the color measurement system 1c, the first digital camera 2 is attached to the color meter 3 in the same manner as the color measurement system 1b according to the first modification.

  The colorimeter 3 of the color measurement system 1c is provided with an EVF 111 instead of the optical viewfinder 10. For this reason, the second digital camera 4 is built in the colorimeter 3, and the second digital camera 4 is arranged at a location where the light L1 described with reference to FIG. 4 can be received.

  In the color measurement system 1c, a portable terminal (for example, a smartphone or a tablet terminal) is used as the information processing apparatus 5. Accordingly, wireless communication is used for communication between the information processing device 5 and the first digital camera 2 and communication between the information processing device 5 and the colorimeter 3.

  FIG. 10 is a block diagram illustrating a configuration of a color measurement system 1d according to the third modification. The color measurement system 1d according to the third modification is different from the color measurement system 1a according to the first embodiment shown in FIG. 4 in a method of specifying the corresponding portion 37 (FIG. 2).

  As described in the color measurement system 1a according to the first embodiment, when the aim of the colorimeter 3 is set to the measurement location SP, the center of the second image 90 (FIG. 3) is the image 91 of the measurement location. As described above, the optical viewfinder 10 and the like are adjusted in advance. That is, the colorimeter 3 is adjusted so that the image 91 of the measurement location is located at the center of the second image 90. In the third modification, the corresponding portion 37 is specified on the assumption of this.

  In the color measurement system 1d according to the third modification, the storage unit 60 of the information processing apparatus 5 includes a template storage unit 62. The template storage unit 62 stores in advance a template indicating an image of a characteristic portion of the subject 100 including the measurement location SP.

  In the first image 31 (FIG. 2), an image corresponding to the image of the characteristic portion is a first image, and in the second image 90 (FIG. 3), an image corresponding to the image of the characteristic portion is a second image. To do. The corresponding location specifying unit 51 reads the template stored in the template storage unit 62 and searches for the first image and the second image using the template. Next, the corresponding location specifying unit 51 arranges the first image 31 and the second image 90 so that the first image and the second image obtained as a result of the search overlap, and this arrangement is performed. The location of the first image 31 corresponding to the center of the second image 90 in the state is identified as the corresponding location 37.

  According to the third modification, the corresponding portion 37 can be specified using the characteristic portion of the subject 100.

  FIG. 11 is a schematic diagram of a color measurement system 1e according to a fourth modification. The color measurement system 1e according to the fourth modification is different from the color measurement system 1a according to the first embodiment shown in FIG. 2 as follows.

  The color measurement system 1e according to the fourth modification includes a projection unit 112 that projects a predetermined pattern onto the measurement location SP. For example, a laser pointer can be used for the projection unit 112. The predetermined pattern may be any shape that can identify an image of the predetermined pattern in the first image 31 and the second image 90 (FIG. 3) (for example, a cross pattern).

  The predetermined pattern is photographed by the first digital camera 2 in a state where the predetermined pattern is projected onto the measurement spot SP by the projection unit 112. Thereby, the first digital camera 2 generates image data indicating the first image 31 including an image of a predetermined pattern.

  The predetermined pattern is photographed by the second digital camera 4 in a state where the predetermined pattern is projected onto the measurement spot SP. Thereby, the second digital camera 4 generates image data indicating the second image 90 including an image of a predetermined pattern.

  The corresponding location specifying unit 51 specifies the corresponding location 37 in the same manner as the color measurement system 1a according to the first embodiment. Briefly, the corresponding part specifying unit 51 cuts out an image including an image of a predetermined pattern from the second image 90, and uses the cut-out image as a reference window as a reference window that is an image cut out from the first image 31. The corresponding portion 37 is specified by pattern matching with the reference window and specifying an image of a predetermined pattern on the first image 31.

  According to the fourth modification, the corresponding point search is performed using the predetermined pattern projected on the measurement location SP, so that the corresponding location 37 can be specified even if the subject 100 is plain.

  FIG. 12 is a schematic diagram of a color measurement system 1f according to a fifth modification. The color measurement system 1f according to the fifth modification is different from the color measurement system 1a according to the first embodiment shown in FIG. 2 as follows.

  In the color measurement system 1f according to the fifth modification, the corresponding part specifying unit 51 (FIG. 4) performs a setting on a setting area 38 that is set in advance as an area in which the corresponding point search is executed in the first image 31. Perform corresponding point search. The color measurement system 1 f according to the fifth modification includes an input unit that inputs the setting area 38 on the first image 31. The operation unit 70 (FIG. 4) is used as an input unit. That is, the setting area 38 is set on the first image 31 displayed on the display unit 30 by using the cursor 36 that can be moved by the operation unit 70. When the display unit 30 has a touch panel function, the display unit 30 can be used as an input unit. In this case, the measurement area 38 is set by touching the display unit 30.

  According to the fifth modification, the corresponding point search target is not the entire first image 31 but the setting area 38. Accordingly, since the range to be searched for corresponding points can be narrowed down, the time required for specifying the corresponding points 37 can be shortened.

  FIG. 13 is a block diagram showing a configuration of a color measurement system 1g according to the sixth modification. The color measurement system 1g according to the sixth modification is different from the color measurement system 1a according to the first embodiment shown in FIG. 4 in that the control processing unit 50 of the information processing apparatus 5 includes a setting area setting unit 56. is there. The color measurement system 1g according to the sixth modified example sets a setting area 38 on the first image 31 in the same manner as the color measurement system 1f according to the fifth modified example (FIG. 12). In the color measurement system 1g according to the sixth modification, the setting area 38 is automatically set.

  FIG. 14 is a schematic diagram illustrating a state in which the setting area 38 is automatically set by the setting area setting unit 56. The setting area setting unit 56 uses a value (first color information) in a predetermined color system indicating the color of the measurement spot SP measured by the colorimeter 3 in the pixels constituting the first image 31. A pixel having a color whose difference is equal to or smaller than a predetermined value is extracted. The extracted pixels are indicated by crosses. Then, the setting area setting unit 56 sets a predetermined area including the extracted pixels as the setting area 38. FIG. 14 shows a state where a plurality of setting areas 38 are set.

  The corresponding location specifying unit 51 performs a corresponding point search for each setting area 38.

  According to the sixth modification, the setting area 38 can be automatically set using the color value of the measurement spot SP measured by the colorimeter 3.

  FIG. 15 is a block diagram showing a configuration of a color measurement system 1h according to the seventh modification. The color measurement system 1h according to the seventh modified example automatically sets the setting area 38 on the first image 31 in the same manner as the color measurement system 1g according to the sixth modified example (FIG. 13). In the color measurement system 1h according to the seventh modification, as described with reference to FIG. 8, the measurement point SP is photographed by the first digital camera 2 with the first digital camera 2 attached to the colorimeter 3. Thus, the setting area 38 is automatically set.

  Referring to FIG. 8, a pedestal 110 is provided in the casing of the colorimeter 3. The pedestal 110 functions as an attachment portion that can attach the first digital camera 2 to the colorimeter 3.

  Referring to FIG. 15, the storage unit 60 of the information processing device 5 includes a positional relationship information storage unit 63. The positional relationship information storage unit 63 stores positional relationship information indicating the relative positional relationship between the colorimeter 3 and the first digital camera 2 attached to the pedestal 110. Referring to FIG. 8, for example, in a state where the first digital camera 2 is attached to the colorimeter 3, the optical axis 101 of the first digital camera 2 is directly above the optical axis 103 of the colorimeter 3. Suppose it is located. The positional relationship information is information indicating that the optical axis 101 of the first digital camera 2 is located immediately above the optical axis 103 of the colorimeter 3.

  The control processing unit 50 of the information processing device 5 includes a setting area setting unit 57. The setting area setting unit 57 sets the setting area 38 using the positional relationship information stored in the positional relationship information storage unit 63. When the optical axis 101 of the first digital camera 2 is positioned directly above the optical axis 103 of the colorimeter 3, an area having a predetermined width including the y axis 35 (FIG. 2) is set in the first image 31. Region 38 is formed. Further, for example, when the optical axis 101 of the first digital camera 2 is positioned directly beside the optical axis 103 of the colorimeter 3, the first image 31 has a predetermined width including the x-axis 34 (FIG. 2). The area becomes the setting area 38.

  According to the seventh modification, the setting area 38 can be automatically set.

  Next, a second embodiment will be described. When the subject 100 is plain, there is a possibility that the corresponding location 37 (FIG. 2) cannot be specified by the corresponding point search using the first image 31 (FIG. 2) and the second image 90 (FIG. 3). . In the second embodiment, the corresponding portion 37 is specified using the chart 113 (FIG. 17). This will be described in detail below.

  FIG. 16 is a schematic diagram of a colorimetric system 1i according to the second embodiment. The difference from the color measurement system 1 a according to the first embodiment shown in FIG. 2 is that a display device 114 that displays a chart 113 at the position of the subject 100 is installed. The display device 114 is installed before or after measuring the color of the measurement point SP of the subject 100.

  FIG. 17 is a schematic diagram of the chart 113. The chart 113 is an image displayed on the display device 114. A flat panel display such as a liquid crystal display can be used as the display device 114.

  The chart 113 includes a black mark 115 and a white background 116. The position of the mark 115 on the chart 113 is determined so that the position of the mark 115 is the same as the position of the measurement spot SP. That is, in the XYZ orthogonal coordinate system in which the direction of the optical axis 103 of the colorimeter 3 is the Z direction, the mark 115 is at the same position as the position of the measurement point SP. In the XYZ orthogonal coordinate system, it is only necessary that the mark 115 is located at a position where at least the X coordinate value and the Y coordinate value coincide with the position of the measurement location SP. That is, the mark 115 may be displaced in the Z direction with respect to the measurement point SP.

  The mark 115 is photographed by the first digital camera 2 under the same conditions (position of the first digital camera 2, angle of view α, etc.) as the conditions under which the measurement point SP is photographed. Accordingly, the first digital camera 2 generates image data indicating the third image 117 that is a color image including the image of the mark 115 (that is, the image 118 of the mark). In FIG. 16, a third image 117 is displayed on the display unit 30. The third image 117 is different from the first image 31 (FIG. 2) in that a chart image 119 is shown instead of the subject image 32.

  The mark 115 is photographed by the second digital camera 4 under the same conditions that the measurement spot SP is photographed by the second digital camera 4. Accordingly, the second digital camera 4 generates image data indicating the fourth image 121 including the image of the mark 115 (that is, the image 122 of the mark). FIG. 18 is a schematic diagram of the fourth image 121. The fourth image 121 is different from the second image 90 (FIG. 3) in that the chart image 119 (FIG. 16) including the mark image 122 instead of a part of the subject image 32 including the measurement point SP. ) Is part of it.

  The corresponding location specifying unit 51 specifies the corresponding location 37 by searching for corresponding points using the third image 117 and the fourth image 121. That is, the corresponding part specifying unit 51 cuts out the mark image 118 from the third image 117 and the mark image 122 from the fourth image 121. A mark image 118 cut out from the third image 117 corresponds to the reference window. A mark image 122 cut out from the fourth image 121 corresponds to the reference window.

  The corresponding part specifying unit 51 determines whether or not the difference in luminance between the cut mark images 118 and 122 is equal to or less than a predetermined value. If the corresponding part specifying unit 51 determines that the difference in luminance is larger than a predetermined value, the position where the mark image 118 is cut out in the third image 117 is shifted (that is, the position where the reference window is set). The mark image 118 is cut out from the third image 117. The cut mark image 118 is used as a reference window, and it is determined whether or not the difference in luminance between the reference window and the standard window is equal to or smaller than a predetermined value. This is repeated until the difference in brightness is determined to be equal to or less than a predetermined value.

  When the corresponding part specifying unit 51 determines that the difference in luminance is equal to or less than a predetermined value, the mark image 118 (reference window) cut out from the third image 117 is cut out from the fourth image 121. It is determined that the mark corresponds to the mark image 122 (reference window). This means that the mark image 118 corresponds to the measurement point SP. Therefore, in the first image 31 (FIG. 2), the location corresponding to the position of the mark image 118 of the third image 117 is the corresponding location 37 (FIG. 2).

  The corresponding part specifying unit 51 sets a part corresponding to the position of the mark image 118 on the third image 117 as the corresponding part 37 in the first image 31 that has been taken or has already been taken. .

  According to the second embodiment, since the corresponding portion 37 is specified using the chart 113 having the mark 115, the corresponding portion 37 can be specified even when the subject 100 is plain. In addition, since the black mark 115 formed on the white background is used as the chart 113 and the corresponding portion 37 is specified using the luminance, it is not necessary to use a color camera as the second digital camera 4, and a monochrome camera should be used. Can do.

  The chart 113 is not limited to an image displayed on the display device 114. For example, white paper on which black marks 115 are drawn can be used as the chart 113.

  A modification of the second embodiment will be described. FIG. 19 is a schematic diagram of a color measurement system 1j according to a modification of the second embodiment. FIG. 20 is a schematic diagram of a chart 113 used in a modification of the second embodiment. The chart 113 used in this modified example includes a mark 115 having a plurality of regions having different densities and a white background 116.

  In the modified example, the corresponding part specifying unit 51 uses the mark 115 template stored in advance, and the mark image 118 included in the third image 117 and the mark image included in the fourth image 121. Search 122 (FIG. 21). The corresponding part specifying unit 51 uses the mark images 118 and 122 obtained as a result of the search, and uses the mark image 118 included in the third image 117 and the mark image 122 included in the fourth image 121. The third image 117 and the fourth image 121 are arranged so that. The corresponding location specifying unit 51 specifies the location of the third image 117 corresponding to the center of the fourth image 121 in this arrangement state, and the first image 31 (FIG. 2) corresponding to the specified location. The location is identified as the corresponding location 37.

  The optical viewfinder 10 and the like are adjusted in advance so that the center of the fourth image 121 becomes the center of gravity of the mark image 122 when the aim of the colorimeter 3 is set to the measurement point SP. That is, the colorimeter 3 is adjusted in advance so that the mark image 122 is positioned at the center of the fourth image 121. In this modified example, the corresponding portion 37 is specified on the assumption of this.

  According to the modification, the corresponding portion 37 is specified using the mark 115 configured by a plurality of regions having different densities, so that the monochrome camera can be used as the second digital camera 4.

  In the second embodiment and its modification, the corresponding points are searched using the mark 115 of the chart 113, and the corresponding points are not searched using the second image 90. Therefore, the second digital camera 4 does not photograph the measurement point SP.

  Next, a third embodiment will be described. In the third embodiment, the color of the measurement point SP measured by the colorimeter 3 is used for the corresponding point search. FIG. 22 is a schematic diagram of a colorimetric system 1k according to the third embodiment. The difference from the color measurement system 1 a according to the first embodiment shown in FIG. 2 is that the second digital camera 4 is not provided. The color measurement system 1k according to the third embodiment searches for corresponding points using the chart 113 in the same manner as the color measurement system 1i (FIG. 16) according to the second embodiment.

  FIG. 24 is a schematic diagram of the chart 113. The chart 113 is an image displayed on the display device 114. A difference from the chart 113 shown in FIG. 17 is that the mark 115 is a chromatic color (for example, blue). This is because in the third embodiment, the corresponding points are searched using the color of the mark 115. Since the corresponding portion 37 is specified using the color of the mark 115, the color and shape of the mark 115 are not particularly limited.

  FIG. 23 is a schematic diagram illustrating a state in which the chart 113 illustrated in FIG. 24 is arranged in the color measurement system 1k according to the third embodiment. The position at which the chart 113 is arranged is the same as that of the colorimetric system 1i according to the second embodiment.

  The measurer uses the optical finder 10 of the colorimeter 3 to look at the mark 115 (FIG. 24), and aim the aim of the colorimeter 3 to the mark (that is, the mark 115 on the optical axis 103 of the colorimeter 3). To be located). Then, the colorimeter 3 is operated to measure the color of the mark 115.

  The mark 115 is photographed by the first digital camera 2 under the same conditions (position of the first digital camera 2, angle of view α, etc.) as the conditions under which the measurement point SP is photographed. Accordingly, the first digital camera 2 generates image data indicating the third image 117 that is a color image including the image of the mark 115. In FIG. 23, a third image 117 is displayed on the display unit 30. The third image 117 is different from the first image (FIG. 22) in that a chart image 119 is shown instead of the subject image 32.

  In FIG. 22, the measurement spot SP is not located on the optical axis 101 of the first digital camera 2, but when the first image 31 is taken with the measurement spot SP located on the optical axis 101, FIG. 23, the mark 115 is positioned on the optical axis 101 and the third image 117 is photographed.

  The corresponding location specifying unit 51 uses the color information included in the image data indicating the third image 117 to identify the mark image 118 and the background shown in FIG. The corresponding location specifying unit 51 cuts out the mark image 118 from the third image 117. The corresponding location specifying unit 51 has a value in a predetermined color system indicating the color of the image 118 of the cut out mark, and a value in the predetermined color system indicating the color of the mark 115 measured by the colorimeter 3. It is determined whether the difference from (reference value) is equal to or less than a predetermined value.

  If the corresponding part specifying unit 51 determines that the difference between these values (color value difference) is larger than a predetermined value, the position of the mark image 118 in the third image 117 is shifted, A mark image 118 is cut out from the third image 117. It is determined whether or not the difference between the value indicating the color of the cut-out mark image 118 and the reference value is equal to or less than a predetermined value. The process is repeated until the difference between the value indicating the color of the cut mark image 118 and the reference value is determined to be equal to or less than a predetermined value.

  If the difference between the value indicating the color of the cut-out mark image 118 and the reference value is equal to or less than a predetermined value, the corresponding portion specifying unit 51 determines the first corresponding to the position of the center of gravity of the mark image 118. The location of one image 31 is identified as the corresponding location 37 (FIG. 22).

  According to the third embodiment, since the corresponding portion 37 is specified using the color of the mark 115 measured by the colorimeter 3, the second digital camera 4 is unnecessary.

  A modification of the third embodiment will be described. FIG. 25 is a schematic diagram of a chart 113 used in this modification. The difference from the chart 113 shown in FIG. 24 is that the chart 113 further includes marks 131 and 133. The marks 131 and 133 are used for determining the inclination of the first image 31.

  The mark 131 is a chromatic (for example, red) rectangle, and the mark 133 is a chromatic (for example, yellow) rectangle. Since the inclination of the first image 31 is determined using the color information of the marks 131 and 133, the colors and shapes of the marks 131 and 133 are not particularly limited, but the colors of the marks 115, 131, and 133 are different from each other. It is preferable.

  In the chart 113, an inclination of a line (reference line) passing through the marks 131, 115, and 133 is determined in advance. The third image 117 photographed by the first digital camera 2 is a color image including images of marks 115, 131, and 133. The corresponding location specifying unit 51 specifies locations corresponding to the marks 131 and 133 in the first image 31 by the same method as the method for specifying the corresponding location 37 using the mark 115 described above. The corresponding location specifying unit 51 determines that the first image 31 is not inclined if the lines passing through the locations corresponding to 115, 131, and 133 in the first image 31 coincide with the reference line. If they do not match, it is determined that the first image 31 is tilted.

1a, 1b, 1c, 1d, 1e, 1f, 1g, 1h, 1i, 1j, 1k Color measuring system 2 First digital camera 3 Colorimeter 4 Second digital camera 5 Information processing apparatus 10 Optical viewfinder 13 Branch mirror 30 Display unit 31 First image 37 Corresponding part 51 Corresponding part specifying part 52 Position information calculating part 55 Display control part 56, 57 Setting area setting part 61 Position information storage part 70 Operation part 90 Second image 100 Subject 101 First Optical axis 103 of the second digital camera Optical axis 117 of the second digital camera Third image 121 Fourth image SP Measurement location

Claims (14)

A color measuring device for measuring the color of the measurement location;
A first digital camera that captures the measurement location and generates image data indicating a first image that is a color image including an image of the measurement location;
In the first image, a location corresponding to the measurement location is set as a corresponding location, and a corresponding location search unit for specifying the corresponding location by searching for corresponding points;
A colorimetric system comprising: a position information calculation unit that calculates position information indicating which position on the first image the corresponding part specified by the corresponding part specifying unit is located. The colorimetric device includes a light receiving optical system through which light from the measurement point passes, and a branching unit that branches light that has passed through the light receiving optical system into a first direction and a second direction, Measure the color of the measurement location using light branched in the second direction,
The color measurement system includes: a second digital camera that captures the measurement location using light branched in the first direction and generates image data indicating a second image including an image of the measurement location. In addition,
The colorimetric system according to claim 1, wherein the corresponding part specifying unit specifies the corresponding part by searching for a corresponding point using the first image and the second image.   The corresponding location specifying unit cuts out an image including the image of the measurement location from the second image, uses the cut out image as a reference window, and a reference window that is an image cut out from the first image, the reference window, The color measurement system according to claim 2, wherein the corresponding portion is specified by pattern matching. The color measurement system further includes a template storage unit that stores a template indicating an image of a characteristic part of a subject including the measurement location,
The color measurement device is adjusted so that the image of the measurement location is centered in the second image,
In the first image, the corresponding location specifying unit defines an image corresponding to the image of the characteristic portion as the first image, and an image corresponding to the image of the characteristic portion in the second image as the second image. The first image and the second image are searched using the template, and the second image when the first image and the second image obtained as a result of the search are overlapped with each other is searched. The colorimetric system according to claim 2, wherein a location of the first image corresponding to the center of the image is specified as the corresponding location. The color measurement system further includes a projection unit that projects a predetermined pattern on the measurement location,
The first digital camera captures the predetermined pattern and generates image data indicating the first image including the image of the predetermined pattern;
The second digital camera captures the predetermined pattern, generates image data indicating the second image including the image of the predetermined pattern,
The corresponding location specifying unit cuts out an image including the image of the predetermined pattern from the second image, uses the cut out image as a reference window, and a reference window that is an image cut out from the first image, the reference window, The colorimetric system according to claim 2, wherein the corresponding portion is specified by pattern matching and specifying the image of the predetermined pattern on the first image.   The said corresponding location specific | specification part performs the said corresponding point search with respect to the setting area | region preset as an area | region where the said corresponding point search is performed in a said 1st image. The color measurement system described in the section.   The colorimetric system according to claim 6, further comprising an input unit that inputs the setting area on the first image.   In the color measurement system, a difference between a color in the pixel constituting the first image and a value in a predetermined color system indicating a color of the measurement location measured by the color measurement device is equal to or less than a predetermined value. The colorimetric system according to claim 6, further comprising a setting area setting unit that extracts pixels having the colors of colors and sets a predetermined area including the extracted pixels as the setting area. The color measurement device includes a housing having an attachment portion to which the first digital camera can be attached.
The color measurement system includes:
A positional relationship information storage unit that stores positional relationship information indicating a relative positional relationship between the color measurement device and the first digital camera attached to the attachment unit;
The color measurement system according to claim 6, further comprising: a setting area setting unit that sets the setting area using the positional relationship information. The colorimetric device includes a light receiving optical system through which light from the measurement point passes, and a branching unit that branches light that has passed through the light receiving optical system into a first direction and a second direction, Measure the color of the measurement location using light branched in the second direction,
The colorimetry system includes at least an XYZ orthogonal coordinate system in which the optical axis direction of the colorimetry device is a Z direction, and a second digital camera disposed at a location where the light branched in the first direction can be received. A chart having a mark in which the X coordinate value and the Y coordinate value coincide with the position of the measurement location,
The first digital camera captures the mark, generates image data indicating a third image that is a color image including the image of the mark,
The second digital camera captures the mark and generates image data indicating a fourth image including an image of the mark;
The corresponding location specifying unit cuts out the image of the mark from the third image and the fourth image, and if the difference in luminance of the cut out image of the mark is equal to or less than a predetermined value, The colorimetric system according to claim 1, wherein a location on the first image corresponding to the position of the mark image on the third image is the corresponding location. The colorimetric device includes a light receiving optical system through which light from the measurement point passes, and a branching unit that branches light that has passed through the light receiving optical system into a first direction and a second direction, Measure the color of the measurement location using light branched in the second direction,
The colorimetry system includes at least an XYZ orthogonal coordinate system in which the optical axis direction of the colorimetry device is a Z direction, and a second digital camera disposed at a location where the light branched in the first direction can be received. A chart having a mark having a X coordinate value and a Y coordinate value that coincide with the position of the measurement location and having a plurality of regions having different densities;
The first digital camera captures the mark, generates image data indicating a third image that is a color image including the image of the mark,
The second digital camera captures the mark and generates image data indicating a fourth image including an image of the mark;
The colorimetric device is adjusted in advance so that the image of the mark is centered in the fourth image,
The corresponding location specifying unit includes the third image and the fourth image so that the image of the mark included in the third image overlaps the image of the mark included in the fourth image. The colorimetric system according to claim 1, wherein a position of the first image corresponding to a center of the fourth image is specified as the corresponding position. In the XYZ orthogonal coordinate system in which the optical axis direction of the color measurement device is the Z direction, the color measurement system includes a chart having a mark in which at least the X coordinate value and the Y coordinate value coincide with the position of the measurement location. Further comprising
The color of the mark is measured by the color measuring device,
The first digital camera captures the mark, generates image data indicating a third image that is a color image including the image of the mark,
The corresponding location specifying unit cuts out the image of the mark from the third image, the value in a predetermined color system indicating the color of the cut out image of the mark, and the mark measured by the colorimetric device If the difference from the value in the predetermined color system indicating the color of the mark is equal to or less than a predetermined value, the position on the first image corresponding to the position of the image of the mark on the third image The colorimetric system according to claim 1, wherein the location is the corresponding location. The color measurement system includes:
A display unit;
The color measurement system according to claim 1, further comprising: a display control unit configured to display the first image including a mark indicating the corresponding location on the display unit.   The color measurement system includes a first color information indicating the color of the measurement location measured by the color measurement device and a second color indicating the color of the corresponding location, which is included in the image data indicating the first image. The color measurement system according to claim 1, further comprising a correction coefficient calculation unit that calculates a color correction coefficient using the color information.

Images