JP2019036189A - Image correction device, image correction system, image correction program, and cell manufacturing method - Google Patents

Abstract

To solve the problem that it is sometimes difficult to appropriately evaluate an observation object depending on a color of the observation object and a color of a background of the observation object when the observation object is evaluated by using a color pickup image.SOLUTION: An image correction device is provided with: an acquisition part which acquires a color image in which a first object irradiated with light, and a second object which is different from the first object, contains pigments, and irradiated with the light are imaged by a color imaging part; and a correction part which corrects a pixel value of the color image to be acquired by the acquisition part based on at least one spectral characteristic of a spectral characteristic of the light, or a characteristic of sensitivity of the color imaging part, and spectral reflection characteristics of pigments contained in the second object.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image correction apparatus, an image correction system, an image correction program, and a cell manufacturing method.

2. Description of the Related Art Conventionally, a technique for acquiring a color captured image obtained by capturing an object to be observed and evaluating the object to be observed based on the acquired color captured image is known (Patent Document 1).
When evaluating an observation object using a color captured image, it may be difficult to appropriately evaluate the observation object depending on the color of the observation object and the background color of the observation object.

JP 2007-163350 A

  In order to solve the above-described problem, an embodiment of the present invention includes a first object irradiated with light and a second object that is different from the first object, includes a pigment, and is irradiated with light. The second object includes an acquisition unit that acquires a color image captured by the color imaging unit, at least one spectral characteristic of light spectral characteristics or spectral characteristics of sensitivity of the color imaging unit, and the second object And a correction unit that corrects the pixel value of the color image acquired by the acquisition unit based on the spectral reflection characteristics of the dye to be obtained.

  Moreover, one embodiment of the present invention is an image correction system including the above-described image correction apparatus, and a color imaging unit that images a first object and a second object.

  One embodiment of the present invention provides a computer with a first object irradiated with light, a second object different from the first object, including a pigment, and irradiated with light. The acquisition step of acquiring a color image captured by the color imaging unit, at least one spectral characteristic of the spectral characteristic of light, or the spectral characteristic of the sensitivity of the color imaging unit, and the pigment contained in the second object An image correction program for executing a correction step of correcting a pixel value of a color image acquired by an acquisition step based on spectral reflection characteristics.

  Further, according to one embodiment of the present invention, a color image obtained by imaging a culture procedure for culturing cells in a medium containing a pigment, cells irradiated with light, and a medium irradiated with light by a color imaging unit The pixel value of the color image acquired by the acquisition procedure is obtained based on at least one of the acquisition procedure, the spectral characteristic of light, or the spectral characteristic of the sensitivity of the color imaging unit, and the spectral reflection characteristic of the dye. A cell manufacturing method comprising: a correction procedure for correction; and a determination procedure for determining whether or not the state of cells cultured by the culture procedure can be shipped based on the color image corrected by the correction procedure.

It is a schematic diagram which shows an example of the culture environment of the cell cultured by the culture medium containing a pigment | dye. It is a schematic diagram which shows an example of the outline | summary of the image correction system in this embodiment. It is a graph which shows an example of the light source spectral characteristic in this embodiment. It is a graph which shows an example of the sensitivity spectral characteristic in this embodiment. It is a graph which shows an example of the detection spectral characteristic in this embodiment. It is a graph which shows an example of the correction | amendment spectral characteristic in this embodiment. It is a graph which shows an example of the spectral characteristic of phenol red in this embodiment, and the light source spectral characteristic of white illumination. It is a graph which shows an example of the short wavelength side correction information in this embodiment, long wavelength side correction information, and predetermined wavelength information. It is a graph which shows an example of the image spectral characteristic in this embodiment. It is a flowchart which shows an example of operation | movement of the image correction apparatus in this embodiment. It is a graph which shows an example of FR spectral reflection characteristic in this embodiment, a light source spectral characteristic, and a red sensitivity spectral characteristic. It is a graph which shows an example of the short wavelength side correction information in this embodiment, long wavelength side correction information, and predetermined wavelength information.

[About medium containing phenol red]
First, cell culture will be described with reference to FIG. FIG. 1 is a schematic diagram showing an example of a culture environment EC of cells C cultured in a medium M that is a medium containing a pigment. As shown in FIG. 1, when the cell C is cultured, the culture medium M may be used as a nutrient source for the cell C. Specifically, in order to culture the cell C, a culture environment EC in which the petri dish S is filled with the medium M may be used. The medium M is desired to maintain a hydrogen ion index (hereinafter, pH: optimal hydrogen) that is optimal for the growth of the cells C to be cultured. In addition, the medium M may contain a pigment for confirming the pH of the medium M. In this example, a case where the medium M contains phenol red as a pigment will be described.

Phenol red is generally used as a pH indicator for confirming the pH of the medium M. Phenol red changes its color based on changes in pH. Specifically, phenol red shows yellow when acidic and red when weakly alkaline. That is, when the medium M contains phenol red, the pH of the medium M can be determined based on the color.
However, since phenol red is contained in the medium M, the color of the color image obtained by imaging the medium M and the cells C cultured in the medium M with an imaging device or the like is affected by phenol red. That is, when phenol red is contained in the medium M, it is difficult to determine the pigment inherent to the cells C cultured in the medium M.
In the embodiment, a case will be described in which the imaging target is a cell C and a medium M containing phenol red.

[First Embodiment]
Hereinafter, the first embodiment will be described with reference to the drawings. First, the configuration of the image correction system 1 according to the present embodiment will be described with reference to FIG.
FIG. 2 is a schematic diagram illustrating an example of an overview of the image correction system 1 in the present embodiment. The image correction system 1 includes an imaging device 20, an image correction device 10, a display device 30, and a light source device 40.

The light source device 40 is a device that irradiates light to an imaging target. In this example, a case where the light source device 40 irradiates the imaging target with the white light L will be described.
The imaging device 20 includes a color imaging unit 210 and a transmission unit 220.
The color imaging unit 210 includes a control unit 211. The control unit 211 includes a WB correction unit 212 and a detection unit 213 as functional units.
The detection unit 213 includes a color sensor CC (not shown), and detects reflected light of light irradiated on the imaging target. That is, the detection unit 213 detects the reflected light of the white light L irradiated to the imaging target. The color sensor CC detects the reflected light of the white light L irradiated to the imaging target with characteristics according to the performance. Thereby, the detection part 213 detects the reflected light of the white light L irradiated to the culture medium M containing the cell C and phenol red. The detection unit 213 detects reflected light based on the characteristics of the white light L and the characteristics of the color sensor CC. Hereinafter, details of the characteristics of the white light L and the characteristics of the color sensor CC will be described.

  In this example, the case where the detection unit 213 detects the reflected light of the white light L that is the light source irradiated to the imaging target is described, but the present invention is not limited to this. The detection unit 213 may detect the transmitted light of the light source irradiated to the imaging target.

[Characteristics of white light L]
In this example, the case where the light source device 40 is LED (Light Emitting Diode) illumination will be described. When the light source device 40 is LED lighting, the white light L is realized by mixing red, green, and blue light. Here, the intensity of light of white light, which is natural light, is distributed without being biased to a wavelength in the visible light band from approximately 400 nm to 700 nm. The intensity of light is a physical quantity indicating the brightness of light emitted from the light source. On the other hand, when the light source device 40 is LED illumination, the white light L is biased in the light intensity distribution, unlike the white light that is natural light. In the case where the light source device 40 is LED illumination, for example, the white light L has a light intensity at a certain wavelength smaller than the light intensity at another wavelength. For example, the white light L has a light intensity in the vicinity of 480 nm.

Here, the spectral characteristics of light will be described. The spectral characteristic of light is a characteristic indicating the intensity distribution of light for each wavelength of light as a percentage. More specifically, the spectral characteristic of light is a relative ratio of the light intensity for each wavelength, with the maximum value of the light intensity being 100% of the light intensity for each wavelength of light. It is the characteristic shown.
Here, the spectral characteristic of the light emitted by the white light L is referred to as a light source spectral characteristic λ. That is, the light source spectral characteristic λ represents the intensity of light for each wavelength in a relative ratio, with the value having the maximum light intensity being 100% of the intensity of light for each wavelength included in the white light L. It is a characteristic.

Hereinafter, the light source spectral characteristic λ will be described with reference to FIG.
FIG. 3 is a graph showing an example of the light source spectral characteristic λ in the present embodiment.
In the graph of FIG. 3, the horizontal axis indicates the wavelength of light, and the vertical axis indicates the relative ratio of the intensity of the light source spectral characteristic λ (arbitrary unit: hereinafter, ARB.unit). In FIG. 3, the light source spectral characteristic λ is indicated by a waveform Wλ.
In this example, the case where the white light L has the light source spectral characteristic λ shown in the graph of FIG. 3 will be described. In this example, the light source spectral characteristic λ of the white light L is a light source having a maximum light intensity near 400 nm and a minimum light intensity near 480 nm. Further, the intensity of the white light L increases near 450 nm and 540 nm, and the light intensity decreases from near 540 nm to around 700 nm.

  In addition, although the case where the white light L was irradiated to the cell C and the culture medium M containing phenol red which are imaging subjects was demonstrated here, it is not restricted to this. The light source irradiated to the imaging target may not be the white light L, and light of any wavelength may be used as the light source as long as the light is suitable for acquiring the color image CI of the imaging target.

[Characteristics of color sensor CC]
The color sensor CC detects light incident on the color sensor CC. Specifically, the color sensor CC includes a conversion unit. The color sensor CC converts incident light incident on the color sensor CC into an electrical signal via a conversion unit. This conversion unit is, for example, a photodiode, a CCD (Charge-Coupled Device) image sensor, or a C-MOS (Complementary-metal-oxide-semiconductor field-effect transistor) image sensor. Here, a value obtained by measuring an electric signal converted by the conversion unit included in the color sensor CC as a current value is referred to as a photocurrent. That is, the color sensor CC detects incident light by measuring the photocurrent of incident light incident on the color sensor CC. Here, the ratio between the incident light amount that is the amount of incident light incident on the color sensor CC and the photocurrent measured by converting the incident light amount into an electrical signal via the conversion unit is expressed as a light receiving sensitivity LS. Called.
The color sensor CC includes a spectroscopic unit that splits light incident on the color sensor CC into red, green, and blue. The spectroscopic unit is, for example, a color filter or a prism. Further, the color sensor CC includes a conversion unit that converts incident light split into red, green, and blue into an electric signal for each color. Thereby, the color sensor CC converts the incident light that has been split into red, green, and blue by the spectroscopic unit into an electrical signal for each color via the conversion unit. That is, since the conversion unit is different for each color, the light receiving sensitivity LS is different for each color. Here, the red light receiving sensitivity LS of the color sensor CC is referred to as a red light receiving sensitivity RLS. The green light receiving sensitivity LS of the color sensor CC is referred to as green light receiving sensitivity GLS. The blue light receiving sensitivity LS of the color sensor CC is referred to as blue light receiving sensitivity BLS. Hereinafter, when the red light receiving sensitivity RLS, the green light receiving sensitivity GLS, and the blue light receiving sensitivity BLS are not particularly distinguished, they are collectively referred to as the light receiving sensitivity LS.

Next, the spectral characteristics of the light receiving sensitivity will be described. The spectral characteristic of the light receiving sensitivity is a characteristic indicating the distribution of the light receiving sensitivity for each wavelength of incident light incident on a certain light receiving element as a percentage. Specifically, the spectral characteristic of the light receiving sensitivity is a relative ratio of the light receiving sensitivity for each wavelength, with the maximum value of the light receiving sensitivity being 100% of the light receiving sensitivity for each wavelength of incident light incident on the light receiving element. It is the characteristic shown by. Here, the spectral characteristics of the light-receiving sensitivity LS, referred to as sensitivity spectral characteristics _{R SC.} The sensitivity spectral characteristic _RSC is a characteristic that indicates the light reception sensitivity LS for each wavelength in a relative ratio with the maximum value of the light reception sensitivity LS being 100% of the light reception sensitivity LS for each wavelength of light. The color sensor CC detects incident light in the characteristic indicated by the sensitivity spectral characteristic _RSC .

The light reception sensitivity LS includes a red light reception sensitivity RLS, a green light reception sensitivity GLS, and a blue light reception sensitivity BLS. Thus, the sensitivity spectral characteristics R _SC, include red sensitive spectral characteristics RR _SC showing the spectral characteristics of the red light receiving sensitivity LS. Further, the sensitivity spectral characteristic R _SC includes a green sensitivity spectral characteristic GR _SC indicating the spectral characteristic of the green light receiving sensitivity LS. Furthermore, the sensitivity spectral characteristics R _SC, include blue sensitivity spectral characteristics BR _SC showing the spectral characteristics of the blue light sensitivity LS.
That is, the color sensor CC detects incident light in the characteristics indicated by the red sensitivity spectral characteristic RR _SC , the green sensitivity spectral characteristic GR _SC, and the blue sensitivity spectral characteristic BR _SC . Hereinafter, when the red sensitivity spectral characteristic RR _SC , the green sensitivity spectral characteristic GR _SC, and the blue sensitivity spectral characteristic BR _SC are not particularly distinguished, they are collectively referred to as the sensitivity spectral characteristic R _SC .

The sensitivity spectral characteristic _RSC will be described below with reference to FIG.
Figure 4 is a graph showing an example of a sensitivity spectral characteristics R _SC in this embodiment.
In the graph of FIG. 4, the horizontal axis indicates the wavelength of light, and the vertical axis indicates the relative ratio of the light receiving sensitivity LS (arbitrary unit: hereinafter ARB.unit).
Blue sensitivity spectral characteristics _{R SC} of the color sensor CC is a blue sensitivity spectral characteristics _{BR SC.} In FIG. 4, the blue sensitivity spectral characteristic BR _SC is indicated by the waveform WBR _SC . The color sensor CC is a sensor that detects blue incident light between 410 nm and 510 nm, and detects the maximum light receiving sensitivity LS in the vicinity of 460 nm.

Also, the green sensitive spectral characteristics _{R SC} of the color sensor CC, a green sensitive spectral characteristics _{GR SC.} In FIG. 4, the green sensitivity spectral characteristic GR _SC is indicated by the waveform WGR _SC . The color sensor CC is a sensor that detects green incident light between 490 nm and 590 nm, and detects the maximum light receiving sensitivity LS near 540 nm.
Also, the red sensitive spectral characteristics _{R SC} of the color sensor CC, a red sensitive spectral characteristics _{RR SC.} In FIG. 4, the red sensitivity spectral characteristic RR _SC is indicated by the waveform WRR _SC . The color sensor CC is a sensor that detects red incident light between 550 nm and 650 nm, and detects the maximum light receiving sensitivity LS near 600 nm.

Next, returning to FIG. 2, the light detected by the detection unit 213 will be described. Detector 213, the reflected light of the imaging object white light L characteristics showing the light source spectral characteristics λ is is irradiated is detected by the characteristics shown sensitivity spectral characteristics R _SC of the color sensor CC. Here, the spectral characteristics of the light detecting unit 213 detects referred detected spectral characteristics D _SC. The detection spectral characteristic _DSC is represented by the formula (1).

Detection unit 213, the characteristic shown by the detection spectral characteristics D _SC, white light L detects reflected light of the imaging object is irradiated. Detection unit 213, a detection information that indicates the reflected light of the imaging object white light L detected in the characteristic represented by the detected spectral characteristics D _SC is irradiated, it is supplied to the WB correction section 212.
Hereinafter, the detection spectral characteristic _DSC will be described with reference to FIG.
Figure 5 is a graph showing an example of the detection spectral characteristics D _SC in this embodiment.
In the graph of FIG. 5, the horizontal axis represents the wavelength of light and the ordinate, the relative proportions of the detected spectral characteristics D _SC (arbitrary unit: Arbitrary Unit: hereinafter, ARB.Unit) shows a.
The detection spectral characteristic _DSC includes a red detection spectral characteristic RD _SC for red, a green detection spectral characteristic GD _SC for green, and a blue detection spectral characteristic BD _SC for blue. In FIG. 5, the blue detection spectral characteristic BD _SC is indicated by the waveform WBD _SC . The green detection spectral characteristic GD _SC is indicated by the waveform WGD _SC . Further, the red detection spectral characteristic RD _SC is indicated by the waveform WRD _SC .
The blue detection spectral characteristic BD _SC indicated by the waveform WBD _SC is a characteristic for detecting incident light having a wavelength from 410 nm to 510 nm, and is a characteristic for detecting incident light with a light receiving sensitivity LS of about 75% in the vicinity of 450 nm. The green detection spectral characteristic GD _SC indicated by the waveform WGD _SC is a characteristic for detecting incident light having a wavelength from 490 nm to 590 nm, and is a characteristic for detecting incident light with a light receiving sensitivity LS of about 50% near 540 nm. . The red detection spectral characteristic RD _SC indicated by the waveform WRD _SC is a characteristic for detecting incident light having a wavelength from 550 nm to 650 nm, and is a characteristic for detecting incident light with a light receiving sensitivity LS of about 40% near 590 nm. .

[White balance correction]
In this example, a case where the imaging apparatus 20 performs white balance correction on detection information detected by the detection unit 213 will be described. Note that the imaging apparatus 20 may not perform white balance correction.
The WB correction unit 212 acquires detection information detected by the detection unit 213. The WB correction unit 212 performs white balance correction on the detection information detected by the detection unit 213. The white balance correction performed by the WB correction unit 212 is expressed by equations from Equation (2) to Equation (7).

Equation (2) is an equation for calculating the integrated value of the red detection spectral characteristics RD _SC. Further, Equation (3) is an equation for calculating the integrated value of the blue detected spectral characteristics BD _SC. Further, Equation (4) is an equation for calculating the integrated value of the green detection spectral characteristics GD _SC. In this example, white balance correction, will be described which is performed based on the integrated value of the green detection spectral characteristics GD _SC. White balance correction based on the integral value of the green detection spectral characteristics GD _SC is represented by the formula (3).

The spectral characteristics after white balance correction WB correction unit 212 is performed, referred to as corrected spectral characteristics _{C SC.} The corrected spectral characteristic C _SC includes a red corrected spectral characteristic RC _SC , a green corrected spectral characteristic GC _SC, and a blue corrected spectral characteristic BC _SC .
Detection unit 213, a cell C, and the reflected light of the white light L irradiated to the medium M containing phenol red to detect the characteristic indicated by the detected spectral characteristics D _SC by the color sensor CC. WB correction unit 212, the detection information detecting unit 213 detects the characteristic indicated by the detected spectral characteristics D _SC, performs white balance correction. The WB correction unit 212 performs white balance correction on the detection information in the characteristic indicated by the corrected spectral characteristic _CSC . The color imaging unit 210 captures the detection information subjected to white balance correction by the WB correction unit 212 as a color image CI.

Hereinafter, the corrected spectral characteristic _CSC will be described with reference to FIG.
Figure 6 is a graph showing an example of a correction spectral characteristics C _SC in this embodiment.
In the graph of FIG. 6, the horizontal axis represents the wavelength of light and the ordinate, the relative proportions of the correction spectral characteristics C _SC (arbitrary unit: Arbitrary Unit: hereinafter, ARB.Unit) shows a.
In this example, a case where the blue correction spectral characteristic BC _SC is indicated by the waveform WBC _SC will be described. In this example, a case where the green correction spectral characteristic GC _SC is indicated by the waveform WGC _SC will be described. In this example, a case where the red correction spectral characteristic RC _SC is indicated by the waveform WRC _SC will be described.
The blue correction spectral characteristic BC _SC indicated by the waveform WBC _SC is a characteristic for detecting incident light having a wavelength from 450 nm to 540 nm, and is a characteristic for detecting incident light with a light receiving sensitivity LS of about 98% near 450 nm. The green corrected spectral characteristic GC _SC indicated by the waveform WGC _SC is a characteristic for detecting incident light having a wavelength from 450 nm to 590 nm, and is a characteristic for detecting incident light with a light receiving sensitivity LS of about 50% near 540 nm. The red corrected spectral characteristic RC _SC indicated by the waveform WRC _SC is a characteristic for detecting incident light having a wavelength from 550 nm to 650 nm, and is a characteristic for detecting incident light with a light receiving sensitivity LS of about 50% near 580 nm.

  Next, returning to FIG. 2, the imaging device 20 will be described. The color imaging unit 210 supplies the transmission unit 220 with a color image CI obtained by imaging the cell C that is the imaging target irradiated with the white light L that is a light source and the medium M containing phenol red. The transmission unit 220 supplies the color image CI to the image correction apparatus 10.

  The image correction apparatus 10 includes a control unit 110 and a storage unit 120. The storage unit 120 stores in advance information (correction reference information) indicating a wavelength that is a reference for correction. The control unit 110 corrects the color image CI based on the correction reference information stored in the storage unit 120. Hereinafter, the correction reference information will be described with reference to FIG.

FIG. 7 is a graph showing an example of the spectral characteristic of the reflected light of phenol red and the light source spectral characteristic λ of the white light L in the present embodiment.
In the graph of FIG. 7, the horizontal axis represents the wavelength of light and the ordinate, the relative proportions of the light source spectral characteristics λ and FR spectral reflection characteristic FR _SC (arbitrary unit: Arbitrary Unit: hereinafter, ARB.Unit) a Show.
FR spectral reflection characteristic FR _SC is a spectral distribution of reflected light obtained when a certain medium containing phenol red is irradiated with white light having a continuous spectral distribution at each wavelength in the visible light region.
In FIG. 7, the FR spectral reflection characteristic FR _SC is indicated by the waveform WFR _SC . Specifically, the FR spectral reflection characteristic FR _SC is a characteristic in which the light intensity is 20% or less between 400 nm and 500 nm. The FR spectral reflection characteristic FR _SC is a characteristic in which the light intensity increases to around 65% from 500 nm to 560 nm. The FR spectral reflection characteristic FR _SC is a characteristic in which the light intensity decreases to near 0% between 560 nm and 620 nm. Since the light source spectral characteristic λ has been described above, the description thereof will be omitted.

In the present embodiment, the correction reference information, and the FR spectral reflection characteristics FR _SC, and the inflection point of the light source spectral characteristics lambda, is information that is based on the intersection.
Specifically, in the present embodiment, the correction reference information includes FR inflection point wavelength information IPFR that is information indicating the wavelength of the inflection point of the waveform WFR _SC indicating the FR spectral reflection characteristic FR _SC . The correction reference information includes light source inflection point wavelength information IPλ, which is information indicating the wavelength of the inflection point of the waveform Wλ indicating the light source spectral characteristic λ. Further, the correction reference information includes FR light source intersection wavelength information ICP which is information indicating the wavelength of the intersection of the waveform WFR _SC indicating the FR spectral reflection characteristic FR _SC and the waveform Wλ indicating the light source spectral characteristic λ.

The FR inflection point wavelength information IPFR will be described with reference to FIG. Here, the inflection point of the FR spectral reflection characteristics _{FR SC,} referred to as FR inflection point PFR. As shown in FIG. 7, in this example, the FR inflection point PFR of the waveform WFR _SC indicating the FR spectral reflection characteristic FR _SC is the FR inflection point PFR1 near 500 nm and the FR inflection point PFR2 near 560 nm. The case will be described. That is, in this example, the correction reference information includes FR inflection point wavelength information IPFR1 indicating 500 nm that is the wavelength of the FR inflection point PFR1. The correction reference information includes FR inflection point wavelength information IPFR2 indicating 560 nm which is the wavelength of the FR inflection point PFR2.

  Next, the light source inflection point wavelength information IPλ will be described. Here, the inflection point of the light source spectral characteristic λ is referred to as λ inflection point Pλ. As shown in FIG. 7, in this example, the λ inflection point Pλ of the waveform Wλ indicating the light source spectral characteristic λ is λ inflection point Pλ1 near 450 nm, λ inflection point Pλ2 near 480 nm, and λ near 540 nm. The case of the inflection point Pλ3 will be described. That is, in this example, the correction reference information includes light source inflection point wavelength information IPλ1 indicating 450 nm that is the wavelength of the λ inflection point Pλ1. The correction reference information includes light source inflection point wavelength information IPλ2 indicating 480 nm which is the wavelength of the λ inflection point Pλ2. The correction reference information includes light source inflection point wavelength information IPλ3 indicating 540 nm which is the wavelength of the λ inflection point Pλ3.

Next, the FR light source intersection wavelength information ICP will be described. Here, the intersection of the waveform WFR _SC indicating the FR spectral reflection characteristic FR _SC and the waveform Wλ indicating the light source spectral characteristic λ is referred to as an FR light source intersection CP. As shown in FIG. 7, in this example, the FR light source intersection CP of the waveform WFR _SC and the waveform Wλ is the FR light source intersection CP1 near 420 nm, the FR light source intersection CP2 near 470 nm, and the FR light source intersection CP3 near 500 nm. A case where the light source intersection point CP4 near 550 nm and the FR light source intersection point CP5 near 570 nm will be described.
That is, in this embodiment, the correction reference information includes FR light source intersection wavelength information ICP1 indicating 420 nm that is the wavelength of the FR light source intersection CP1. The correction reference information includes FR light source intersection wavelength information ICP2 indicating 470 nm which is the wavelength of the FR light source intersection CP2. The correction reference information includes FR light source intersection wavelength information ICP3 indicating 500 nm that is the wavelength of the FR light source intersection CP3. The correction reference information includes FR light source intersection wavelength information ICP4 indicating 550 nm which is the wavelength of the FR light source intersection CP4. The correction reference information includes FR light source intersection wavelength information ICP5 indicating 570 nm, which is the wavelength of the FR light source intersection CP5.

Next, returning to FIG. 2, the control unit 110 will be described. The control unit 110 includes an acquisition unit 111, a correction value calculation unit 112, a correction unit 113, and an output unit 114 as functional units.
The acquisition unit 111 acquires a color image CI from the imaging device 20. The acquisition unit 111 supplies the acquired color image CI to the correction value calculation unit 112 and the correction unit 113.

  The correction value calculation unit 112 calculates a correction matrix D. The correction matrix D is a coefficient matrix for reducing the influence of phenol red. The correction matrix D is expressed by Equation (8) and Equation (9).

A correction matrix D correction value calculating unit 112 is calculated, the spectral characteristics calculated by the correction spectral characteristics C _SC, referred to as an image spectral characteristics m _SC. The image spectral characteristic m _SC includes a red image spectral characteristic Rm _SC , a green image spectral characteristic Gm _SC, and a blue image spectral characteristic Bm _SC . The correction value calculation unit 112 reads information indicating a wavelength that is a reference for correction among the correction reference information stored in the storage unit 120. The correction value calculation unit 112 calculates a correction matrix D in which the image spectral characteristic _mSC is a minimum value based on information indicating a wavelength that is a reference for correction.
Hereinafter, information indicating a wavelength that is a correction reference included in the correction reference information will be described.

Here, the information indicating the wavelength that is the correction reference included in the correction reference information is the predetermined wavelength information ITH. In the present embodiment, the predetermined wavelength information ITH is FR inflection point wavelength information IPFR. The correction value calculation unit 112 calculates a correction matrix D having a minimum image spectral characteristic m _SC in the short wavelength side correction information IS indicating a wavelength shorter than the predetermined wavelength information ITH with reference to the predetermined wavelength information ITH. . Further, the correction value calculation unit 112 calculates the correction matrix D having the minimum image spectral characteristic m _SC in the long wavelength side correction information IL longer than the predetermined wavelength information ITH with reference to the predetermined wavelength information ITH. That is, the correction value calculation unit 112 uses the predetermined wavelength information ITH as a reference, and the correction matrix having the minimum image spectral characteristic m _{SC at the} wavelength indicated by the two information of the short wavelength side correction information IS and the long wavelength side correction information IL. D is calculated.

  In this example, the case where the predetermined wavelength information ITH is the FR inflection point wavelength information IPFR and the information indicating the wavelength of the inflection point having the largest change among the FR inflection point wavelength information IPFR will be described. To do. That is, in this example, a case will be described in which the predetermined wavelength information ITH is FR inflection point wavelength information IPFR2, which is information indicating the wavelength of the FR inflection point PFR2.

  In this example, the case where the short wavelength side correction information IS is the FR light source intersection wavelength information ICP will be described. Further, in this example, a case will be described in which the short wavelength side correction information IS is FR light source intersection wavelength information ICP that exists on the longer wavelength side than the FR inflection point PFR that exists on the shortest wavelength side. That is, in this example, the case where the short wavelength side correction information IS is FR light source intersection wavelength information ICP3 which is information indicating the wavelength of the FR light source intersection CP3 will be described.

  In this example, the case where the long wavelength side correction information IL is the FR light source intersection wavelength information ICP will be described. In this example, a case will be described in which the long wavelength side correction information IL is information indicating the wavelength of the intersection existing on the long wavelength side of the predetermined wavelength information ITH. That is, in this example, the case where the long wavelength side correction information IL is the FR light source intersection wavelength information ICP5 will be described.

  Although the case where the predetermined wavelength information ITH is the FR inflection point wavelength information IPFR2 has been described here, the present invention is not limited to this. The predetermined wavelength information ITH may be any inflection point among the light source inflection point wavelength information IPλ and the FR inflection point wavelength information IPFR. For example, when correction is performed using the light source as a reference, the predetermined wavelength information ITH may be the light source inflection point wavelength information IPλ.

  Although the case where the short wavelength side correction information IS is the FR light source intersection wavelength information ICP3 has been described here, the present invention is not limited to this. The short wavelength side correction information IS may be any intersection of the FR light source intersection wavelength information ICP as long as it is information indicating a wavelength shorter than the wavelength indicated by the predetermined wavelength information ITH.

  Although the case where the long wavelength side correction information IL is the FR light source intersection wavelength information ICP5 has been described here, the present invention is not limited thereto. The long wavelength side correction information IL may be any intersection of the FR light source intersection wavelength information ICP as long as it is information indicating a wavelength longer than the wavelength indicated by the predetermined wavelength information ITH.

Hereinafter, the short wavelength side correction information IS, the long wavelength side correction information IL, and the predetermined wavelength information ITH will be described with reference to FIG.
FIG. 8 is a graph showing an example of the short wavelength side correction information IS, the long wavelength side correction information IL, and the predetermined wavelength information ITH in the present embodiment.
In the graph of FIG. 8, the horizontal axis represents the wavelength of light and the ordinate, the relative proportions of the light source spectral characteristics λ and FR spectral reflection characteristic FR _SC (arbitrary unit: Arbitrary Unit: hereinafter, ARB.Unit) a Show.
As described above, in this example, the case where the predetermined wavelength information ITH is the FR inflection point wavelength information IPFR2 indicating the wavelength of the FR inflection point PFR2 will be described. The case where the short wavelength side correction information IS is the FR light source intersection wavelength information ICP3 indicating the wavelength of the FR light source intersection CP3 will be described. The case where the long wavelength side correction information IL is the FR light source intersection wavelength information ICP5 indicating the wavelength of the FR light source intersection CP5 will be described.
As shown in FIG. 8, in this example, the predetermined wavelength information ITH is 560 nm. In this example, the short wavelength side correction information IS is 500 nm. In this example, the long wavelength side correction information IL is 570 nm.
The correction value calculation unit 112 reads the FR light source intersection wavelength information ICP3 from the storage unit 120 as the short wavelength side correction information IS. Further, the correction value calculation unit 112 reads the FR light source intersection wavelength information ICP5 from the storage unit 120 as the long wavelength side correction information IL.
The correction value calculation unit 112 calculates a correction matrix D in which the image spectral characteristic m _SC is the minimum value at the wavelengths indicated by the short wavelength side correction information IS and the long wavelength side correction information IL.

Hereinafter, with reference to FIG. 9, the image spectral characteristic m _SC when the correction value calculation unit 112 corrects the pixel value of the color image CI based on the short wavelength side correction information IS and the long wavelength side correction information IL. Will be described.
Figure 9 is a graph showing an example of an image spectral characteristics m _SC in this embodiment.
In the graph of FIG. 9, the horizontal axis represents the wavelength of light and the ordinate, the relative proportions of the image spectral characteristics m _SC (arbitrary unit: Arbitrary Unit: hereinafter, ARB.Unit) shows a.
In FIG. 9, the blue image spectral characteristic Bm _SC is indicated by the waveform WBm _SC . The green image spectral characteristic Gm _SC is indicated by the waveform WGm _SC . The red image spectral characteristic Rm _SC is indicated by the waveform WRm _SC . Correction value calculation section 112, a short-wavelength-side correction information IS, in the long wavelength side correction information IL and wavelength indicated by the image spectral characteristics m _SC calculates the correction matrix D is minimal. In this example, the correction value calculation unit 112 has a wavelength near 500 nm indicated by the FR light source intersection wavelength information ICP3 that is the short wavelength side correction information IS, and 570 nm indicated by FR light source intersection wavelength information ICP5 that is the long wavelength side correction information IL. , The correction matrix D having the minimum image spectral characteristic m _SC is calculated. As a result, the image spectral characteristic m _SC decreases in the vicinity of 500 nm indicated by the FR light source intersection wavelength information ICP3 and at 570 nm indicated by the FR light source intersection wavelength information ICP5.

Next, returning to FIG. 2, the correction value calculation unit 112 will be described. The correction value calculation unit 112 supplies the image spectral characteristic m _SC that is the minimum value to the correction unit 113.
Correcting unit 113, the characteristic represented by the image spectral characteristics m _SC obtained from the correction value calculating unit 112 corrects the pixel value of the color image CI acquired from the acquisition unit 111. The correction unit 113 supplies the corrected color image CI to the output unit 114.
The output unit 114 acquires the color image CI corrected by the correction unit 113. The output unit 114 supplies the acquired color image CI to the display device 30.
The display device 30 displays the color image CI acquired from the image correction device 10.

Thereby, the image correction apparatus 10 of this embodiment acquires the color image CI by which the cell C which is the imaging target irradiated with the white light L and the culture medium M containing phenol red which is the pigment P are captured. It includes an acquiring unit 111, a light source spectral characteristics lambda, and a correcting unit 113 for correcting the pixel value of the color image CI based on the FR spectral reflection characteristics _{FR SC.} The correcting unit 113 corrects the pixel value of the color image CI based on the FR light source intersection wavelength information ICP. The FR light source intersection wavelength information ICP is information indicating the wavelength of the FR light source intersection CP, which is the intersection of the waveform Wλ indicating the light source spectral characteristic λ and the waveform WFR _SC indicating the FR spectral reflection characteristic FR _SC . The correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS and the long wavelength side correction information IL based on the predetermined wavelength information ITH. The short wavelength side correction information IS and the long wavelength side correction information IL are either of the FR light source intersection wavelength information ICP.

The predetermined wavelength information ITH of the present embodiment is the FR inflection point wavelength information IPFR that is information indicating the wavelength of the FR inflection point PFR that is the inflection point of the waveform WFR _SC indicating the FR spectral reflection characteristic FR _SC . Either.
The correcting unit 113 corrects the color image CI based on the long wavelength side correction information IL indicating the wavelength of the intersection on the long wavelength side from the predetermined wavelength information ITH. The correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS indicating the wavelength of the intersection on the short wavelength side from the predetermined wavelength information ITH.

Hereinafter, the operation of the image correction apparatus 10 will be described with reference to FIG. FIG. 10 is a flowchart showing an example of the operation of the image correction apparatus 10 in the present embodiment.
The acquisition unit 111 acquires a color image CI from the imaging device 20 (step S100). The acquisition unit 111 supplies the acquired color image CI to the correction value calculation unit 112 and the correction unit 113 (step S110).
The correction value calculation unit 112 acquires the color image CI from the acquisition unit 111 (step S120). The correction value calculation unit 112 reads the short wavelength side correction information IS and the long wavelength side correction information IL from the storage unit 120 (step S130). The correction value calculation unit 112 calculates the correction matrix D having the minimum image spectral characteristic m _{SC at the} wavelength indicated by the short wavelength side correction information IS and the long wavelength side correction information IL (step S140). The correction value calculation unit 112 supplies the calculated image spectral characteristic m _SC to the correction unit 113 (step S150).
The correction unit 113 acquires the color image CI from the acquisition unit 111 (step S160). Correction unit 113 acquires the image spectral characteristic _{m SC} correction value calculating unit 112 is calculated (step S170). Correcting unit 113 corrects the color image CI based on the acquired image spectral characteristics _{m SC} (step S180). The correction unit 113 supplies the corrected color image CI to the output unit 114 (step S190).
The output unit 114 acquires the color image CI from the correction unit 113 (step S200). The output unit 114 supplies the acquired color image CI to the display device 30 (step S210).

[Second Embodiment]
Next, a second embodiment will be described. This embodiment is different from the first embodiment in the information included in the correction reference information. Accordingly, the present embodiment is different from the first embodiment in the wavelength indicated by the long wavelength side correction information IL.
In the present embodiment, the correction reference information, and the FR spectral reflection characteristics FR _SC, a light source spectral characteristics lambda, the inflection point between the sensitivity spectral characteristics R _SC, the information based on the intersection. In this example, among the sensitivity spectral characteristics R _SC, a case will be described in which information about the red sensitivity spectral characteristics RR _SC is included in the correction reference information.
Specifically, in the present embodiment, the correction reference information includes the FR inflection point wavelength information IPFR and the red sensitivity change which is information indicating the wavelength of the inflection point of the waveform WRR _SC indicating the red sensitivity spectral characteristic RR _SC. The music point information IPR is included. Further, the correction reference information includes FR red sensitivity intersection information CPRI1 indicating the wavelength of the intersection of the waveform WFR _SC indicating the FR spectral reflection characteristic FR _SC and the waveform WRR _SC indicating the red sensitivity spectral characteristic RR _SC . The correction reference information includes FR light source intersection wavelength information ICP which is information indicating the wavelength of the intersection of the waveform WFR _SC indicating the FR spectral reflection characteristic FR _SC and the waveform Wλ indicating the light source spectral characteristic λ.

Hereinafter, the correction reference information in the present embodiment will be described with reference to FIG.
FIG. 11 is a graph showing an example of the FR spectral reflection characteristic FR _SC , the light source spectral characteristic λ, and the red sensitivity spectral characteristic RR _SC in the present embodiment.
In the graph of FIG. 11, the horizontal axis represents the wavelength of light, and the vertical axis represents the relative proportion of the FR spectral reflection characteristic FR _SC , the light source spectral characteristic λ, and the red sensitivity spectral characteristic RR _SC (arbitrary unit: ARB.unit) is shown below.
In this example, a case where the FR spectral reflection characteristic FR _SC , the light source spectral characteristic λ, and the red sensitivity spectral characteristic RR _SC are the characteristics shown in FIG. 11 will be described.
Here, the inflection point of the red sensitivity spectral characteristics RR _SC, referred to as the red sensitivity inflection point PR. As shown in FIG. 11, in this example, the case where the red sensitivity inflection point PR of the waveform WRR _SC indicating the red sensitivity spectral characteristic RR _SC is a red sensitivity inflection point PR1 near 650 nm will be described. Thereby, in this example, the correction reference information includes red sensitivity inflection point information IPR1 indicating 650 nm which is the wavelength of the red sensitivity inflection point PR1. The correction reference information includes FR inflection point wavelength information IPFR1 and FR inflection point wavelength information IPFR2. Since the FR inflection point wavelength information IPFR1 and the FR inflection point wavelength information IPFR2 have been described above, description thereof will be omitted.

Here, the intersection of the waveform WFR _SC indicating the FR spectral reflection characteristic FR _SC and the waveform WRR _SC indicating the red sensitivity spectral characteristic RR _SC is referred to as an FR red sensitivity intersection CPR. As shown in FIG. 11, in this example, a case where the FR red sensitivity intersection CPR of the waveform WFR _SC and the waveform WRR _SC is the FR red sensitivity intersection CPR1 near 570 nm will be described. Thereby, in this embodiment, the correction reference information includes FR red sensitivity intersection information CPRI1 indicating 565 nm which is the wavelength of the FR red sensitivity intersection CPR1.

  In this example, the case where the predetermined wavelength information ITH is the FR inflection point wavelength information IPFR and the information indicating the wavelength of the inflection point having the largest change among the FR inflection point wavelength information IPFR will be described. To do. That is, in this example, a case will be described in which the predetermined wavelength information ITH is FR inflection point wavelength information IPFR2, which is information indicating the wavelength of the FR inflection point PFR2.

  In this example, the case where the short wavelength side correction information IS is the FR light source intersection wavelength information ICP will be described. The case where the short wavelength side correction information IS is the FR light source intersection wavelength information ICP existing on the long wavelength side from the FR inflection point PFR existing on the shortest wavelength side will be described. That is, in this example, the case where the short wavelength side correction information IS is FR light source intersection wavelength information ICP3 which is information indicating the wavelength of the FR light source intersection CP3 will be described.

  In this example, the case where the long wavelength side correction information IL is the FR red sensitivity intersection information CPRI will be described. Further, a case will be described in which the long wavelength side correction information IL is information indicating the wavelength of the intersection existing on the long wavelength side from the predetermined wavelength information ITH. That is, in this example, a case will be described in which the long wavelength side correction information IL is FR red sensitivity intersection information CPRI1 which is information indicating the wavelength of the FR red sensitivity intersection CPR1.

  Although the case where the predetermined wavelength information ITH is the FR inflection point wavelength information IPFR2 has been described here, the present invention is not limited to this. The predetermined wavelength information ITH may be any inflection point among the red sensitivity inflection point information IPR and the FR inflection point wavelength information IPFR. For example, when correction is performed based on the sensitivity of the color sensor CC of the imaging device 20, the predetermined wavelength information ITH may be red sensitivity inflection point information IPR.

  Although the case where the long wavelength side correction information IL is the FR red sensitivity intersection information CPRI1 has been described here, the present invention is not limited to this. The long wavelength side correction information IL may be any intersection of the FR red sensitivity intersection information CPRI as long as it is information indicating a wavelength longer than the wavelength indicated by the predetermined wavelength information ITH.

Hereinafter, the short wavelength side correction information IS, the long wavelength side correction information IL, and the predetermined wavelength information ITH will be described with reference to FIG.
FIG. 12 is a graph showing an example of the short wavelength side correction information IS, the long wavelength side correction information IL, and the predetermined wavelength information ITH in the present embodiment.
In the graph of FIG. 12, the horizontal axis indicates the wavelength of light, and the vertical axis indicates the relative proportion of the FR spectral reflection characteristic FR _SC , the light source spectral characteristic λ, and the red sensitivity spectral characteristic RR _SC (arbitrary unit: ARB.unit) is shown below.
As described above, in this example, the case where the predetermined wavelength information ITH is the FR inflection point wavelength information IPFR2 indicating the wavelength of the FR inflection point PFR2 will be described. The case where the short wavelength side correction information IS is the FR light source intersection wavelength information ICP3 indicating the wavelength of the FR light source intersection CP3 will be described. A case will be described in which the long wavelength side correction information IL is FR red sensitivity intersection information CPRI1 indicating the wavelength of the FR red sensitivity intersection CPR1.
As shown in FIG. 12, in this example, the predetermined wavelength information ITH is 560 nm. In this example, the short wavelength side correction information IS is 500 nm. In this example, the long wavelength side correction information IL is 570 nm.
The correction value calculation unit 112 reads the FR light source intersection wavelength information ICP3 from the storage unit 120 as the short wavelength side correction information IS. Further, the correction value calculation unit 112 reads FR red sensitivity intersection information CPRI1 from the storage unit 120 as the long wavelength side correction information IL.
The correction value calculation unit 112 calculates a correction matrix D in which the image spectral characteristic m _SC is the minimum value at the wavelengths indicated by the short wavelength side correction information IS and the long wavelength side correction information IL.

Thereby, the image correction apparatus 10 of this embodiment acquires the color image CI by which the cell C which is the imaging target irradiated with the white light L and the culture medium M containing phenol red which is the pigment P are captured. An acquisition unit 111 is provided. The image correction apparatus 10 includes a light source spectral characteristics lambda, and sensitivity spectral characteristics _{R SC,} the correction unit 113 for correcting the pixel value of the color image CI based on the FR spectral reflection characteristics _{FR SC.} The correcting unit 113 corrects the pixel value of the color image CI based on the FR light source intersection wavelength information ICP. The correcting unit 113 corrects the pixel value of the color image CI based on the FR red sensitivity intersection information CPRI. The FR red sensitivity intersection information CPRI is information indicating the wavelength of the FR red sensitivity intersection CPR, which is the intersection of the waveform WR _SC indicating the sensitivity spectral characteristic R _SC and the waveform WFR _SC indicating the FR spectral reflection characteristic FR _SC . The correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS and the long wavelength side correction information IL with reference to the predetermined wavelength information ITH. The short wavelength side correction information IS is one of the FR light source intersection wavelength information ICP. The long wavelength side correction information IL is one of the FR red sensitivity intersection information CPRI.

The correction unit 113 corrects the pixel value of the color image CI using any one of the wavelengths indicated by the FR red sensitivity intersection information CPRI1 as the long wavelength side correction information IL. The red sensitivity spectral characteristic RR _SC is a spectral characteristic indicating the red sensitivity of the color sensor CC included in the imaging device 20.

[Modification 1: About medium containing alizarin yellow R]
In the first and second embodiments described above, the imaging device 20 has described the case where the cell C and the medium M containing phenol red are imaged. However, the present invention is not limited to this. The imaging device 20 may capture a color image CI between an object A, which is an object, and an object B, which is an object different from the object A and includes a dye P that is a certain dye. For example, a color image CI of the medium M containing cells C and alizarin yellow R as the dye P may be taken. Hereinafter, as a first modification of the first and second embodiments, a case where the imaging target is a cell C and a medium M containing alizarin yellow R as the dye P will be described.

For the first embodiment in the modification 1, the imaging device 20, cells C and, detecting the spectral characteristics of the reflected light by the color sensor CC of the white light L irradiated to the medium M containing Alizarin Yellow R D _SC It detects in the characteristic which shows. WB correction unit 212, the detection information detecting unit 213 detects the characteristic indicated by the detected spectral characteristics D _SC, performs white balance correction. The WB correction unit 212 performs white balance correction on the detection information in the characteristic indicated by the corrected spectral characteristic _CSC . The color imaging unit 210 captures the detection information subjected to white balance correction by the WB correction unit 212 as a color image CI. The color imaging unit 210 supplies the transmission unit 220 with a color image CI obtained by imaging the cell C that is the imaging target irradiated with the white light L that is a light source and the culture medium M containing alizarin yellow R. The transmission unit 220 supplies the color image CI to the image correction apparatus 10.

The image correction apparatus 10 includes a control unit 110 and a storage unit 120. The storage unit 120 stores in advance information (correction reference information) indicating a wavelength that is a reference for correction. The control unit 110 corrects the color image CI based on the correction reference information stored in the storage unit 120.
For the first embodiment in the modification 1, the correction reference information, and AY spectral reflection characteristic AY _SC, and the inflection point of the light source spectral characteristics lambda, is information that is based on the intersection. The AY spectral reflection characteristics AY _SC, to a medium containing Alizarin yellow R, the spectral distribution of the resulting reflected light when irradiated with white light with a continuous spectral distribution in each wavelength in the visible light region.

Specifically, in the first embodiment in the first modification, the correction reference information is information indicating the wavelength of the AY inflection point PAY that is the inflection point of the waveform WAY _SC indicating the AY spectral reflection characteristics AY _SC. Some AY inflection point wavelength information IPA is included. The correction reference information includes light source inflection point wavelength information IPλ, which is information indicating the wavelength of the inflection point of the waveform Wλ indicating the light source spectral characteristic λ. The correction reference information includes AY light source intersection wavelength information ICPA, which is information indicating the wavelength of the intersection of the waveform WAY _SC indicating the AY spectral reflection characteristic AY _SC and the waveform Wλ indicating the light source spectral characteristic λ.

The image correction apparatus 10 according to the first embodiment in Modification 1 is a color image in which a cell C that is an imaging target irradiated with white light L and a medium M that contains alizarin yellow R that is a dye P are captured. An acquisition unit 111 that acquires a CI is provided. The image correction apparatus 10 includes a light source spectral characteristics lambda, the correction unit 113 for correcting the pixel value of the color image CI based on the AY spectral reflection characteristic AY _SC. The correcting unit 113 corrects the pixel value of the color image CI based on the AY light source intersection wavelength information ICPA. The AY light source intersection wavelength information ICPA is information indicating the wavelength of the AY light source intersection CPA that is the intersection of the waveform Wλ indicating the light source spectral characteristic λ and the waveform WAY _SC indicating the AY spectral reflection characteristic AY _SC . The correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS and the long wavelength side correction information IL with reference to the predetermined wavelength information ITH. The short wavelength side correction information IS and the long wavelength side correction information IL are any of the AY light source intersection wavelength information ICPA.

The correcting unit 113 corrects the pixel value of the color image CI based on the long wavelength side correction information IL indicating the wavelength of the intersection on the long wavelength side with respect to the predetermined wavelength information ITH. The correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS indicating the wavelength of the intersection on the short wavelength side from the predetermined wavelength information ITH.
The predetermined wavelength information ITH of the first embodiment in the first modification is any one of the AY inflection point wavelength information IPA. The AY inflection point wavelength information IPA is information indicating the wavelength of the AY inflection point PAY, which is the inflection point of the waveform WAY _SC indicating the AY spectral reflection characteristic AY _SC .
The short wavelength side correction information IS and the long wavelength side correction information IL of the first embodiment in Modification 1 are the intersection of the waveform Wλ indicating the light source spectral characteristic λ and the waveform WAY _SC indicating the AY spectral reflection characteristic AY _SC. Is one of the AY light source intersection wavelength information ICPA, which is information indicating the wavelength of.

In the case of the second embodiment in the first modification, the information included in the correction reference information is different from that in the first embodiment in the first modification. Accordingly, the second embodiment in the first modification differs from the first embodiment in the first modification in the wavelength indicated by the long wavelength side correction information IL.
In the second embodiment in the modification 1, the correction reference information, and AY spectral reflection characteristic AY _SC, a light source spectral characteristics lambda, the inflection point between the sensitivity spectral characteristics R _SC, the information based on the intersection. In this example, among the sensitivity spectral characteristics R _SC, a case will be described in which information about the red sensitivity spectral characteristics RR _SC is included in the correction reference information. In the second embodiment in the first modification, the correction reference information includes AY inflection point wavelength information IPA. The correction reference information includes red sensitivity inflection point information IPR that is information indicating the wavelength of the inflection point of the waveform WRR _SC indicating the red sensitivity spectral characteristic RR _SC . The correction reference information includes AY red sensitivity intersection information ICPAR indicating the wavelength of the intersection of the waveform WAY _SC indicating the AY spectral reflection characteristic AY _SC and the waveform WRR _SC indicating the red sensitivity spectral characteristic RR _SC . Further, the correction reference information includes AY light source intersection wavelength information ICPA which is information indicating the wavelength of the intersection of the waveform WAY _SC indicating the AY spectral reflection characteristic AY _SC and the waveform Wλ indicating the light source spectral characteristic λ.
In the second embodiment in the first modification, a case will be described in which the long wavelength side correction information IL is AY red sensitivity intersection information ICPAR.

As a result, the image correction apparatus 10 according to the second embodiment in Modification 1 images the cell C that is the imaging target irradiated with the white light L and the culture medium M containing the alizarin yellow R that is the dye P. An acquisition unit 111 for acquiring the color image CI. The image correction apparatus 10 includes a light source spectral characteristics lambda, and AY spectral reflection characteristic _{AY SC,} a correction unit 113 that corrects the pixel value of the color image CI based on the red sensitivity spectral characteristics _{RR SC.} The correcting unit 113 corrects the pixel value of the color image CI based on the AY light source intersection wavelength information ICPA. The correcting unit 113 corrects the pixel value of the color image CI based on the AY red sensitivity intersection information ICPAR.
Specifically, the correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS and the long wavelength side correction information IL with reference to the predetermined wavelength information ITH.

The correcting unit 113 corrects the pixel value of the color image CI based on the long wavelength side correction information IL indicating the wavelength of the intersection on the long wavelength side with respect to the predetermined wavelength information ITH. The correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS indicating the wavelength of the intersection on the short wavelength side from the predetermined wavelength information ITH.
The predetermined wavelength information ITH of the second embodiment in the first modification is any one of the AY inflection point wavelength information IPA. The AY inflection point wavelength information IPA is information indicating the wavelength of the AY inflection point PAY, which is the inflection point of the waveform WAY _SC indicating the AY spectral reflection characteristic AY _SC .
The short wavelength side correction information IS of the second embodiment in the first modification is any one of the AY light source intersection wavelength information ICPA. The AY light source intersection wavelength information ICPA is information indicating the wavelength of the intersection of the waveform Wλ indicating the light source spectral characteristic λ and the waveform WAY _SC indicating the AY spectral reflection characteristic AY _SC .
The long wavelength side correction information IL of the second embodiment in the first modification is any one of the AY red sensitivity intersection information ICPAR. The AY red sensitivity intersection information ICPAR is information indicating the wavelength of the intersection of the waveform WRR _SC indicating the red sensitivity spectral characteristic RR _SC and the waveform WAY _SC indicating the AY spectral reflection characteristic AY _SC .

That is, the correcting unit 113 corrects the pixel value of the color image CI using any one of the wavelengths indicated by the AY red sensitivity intersection information ICPAR as the long wavelength side correction information IL. The red sensitivity spectral characteristic RR _SC is a spectral characteristic indicating the red sensitivity of the color sensor CC included in the imaging device 20.

[Modification 2: Electronic component EP]
In the first and second embodiments described above, the imaging device 20 has described the case where the cell C and the medium M containing phenol red are imaged. However, the present invention is not limited to this. The imaging device 20 may capture a color image CI between an object A, which is an object, and an object B, which is an object different from the object A and includes a dye P that is a certain dye. For example, the imaging device 20 may capture the color image CI of the electronic component EP and the electronic substrate PCB including the solder resist ink dye using the solder resist green ink as the dye P. Hereinafter, as a second modification of the first and second embodiments, a case where the imaging target is an electronic component EP and an electronic substrate PCB including a solder resist ink pigment as the pigment P will be described.

In the case of the first embodiment in the second modification, the imaging device 20 detects the reflected light of the white light L irradiated to the electronic component EP and the electronic substrate PCB containing the solder resist ink pigment by the color sensor CC. detecting the characteristics indicated by the characteristic _{D SC.} WB correction unit 212, the detection information detecting unit 213 detects the characteristic indicated by the detected spectral characteristics D _SC, performs white balance correction. The WB correction unit 212 performs white balance correction on the detection information in the characteristic indicated by the corrected spectral characteristic _CSC . The color imaging unit 210 captures the detection information subjected to white balance correction by the WB correction unit 212 as a color image CI. The color imaging unit 210 supplies the transmission unit 220 with a color image CI obtained by imaging the electronic component EP that is an imaging target irradiated with the white light L that is a light source and the electronic substrate PCB containing the solder resist ink pigment. The transmission unit 220 supplies the color image CI to the image correction apparatus 10.

The image correction apparatus 10 includes a control unit 110 and a storage unit 120. The storage unit 120 stores in advance information (correction reference information) indicating a wavelength that is a reference for correction. The control unit 110 corrects the color image CI based on the correction reference information stored in the storage unit 120.
For modification 2, the correction reference information includes an ink dye spectral reflection characteristic I _SC, the inflection point of the light source spectral characteristics lambda, is information that is based on the intersection. The ink dye spectral reflection characteristic I _SC, the solder resist to the electronic board PCB containing ink dyes, the spectral of the reflected light obtained when irradiated with white light with a continuous spectral distribution in each wavelength in the visible light region Distribution.

Specifically, in the first embodiment in the second modification, the correction reference information includes ink dye inflection point wavelength information IPI. Ink dye inflection point wavelength information IPI is information indicating a wavelength of an ink dye inflection point PI is the inflection point of the waveform WI _SC showing the ink dye spectral reflection characteristic I _SC. The correction reference information includes light source inflection point wavelength information IPλ, which is information indicating the wavelength of the inflection point of the waveform Wλ indicating the light source spectral characteristic λ. The correction reference information includes ink dye light source intersection wavelength information ICPK. Ink dye source intersection wavelength information ICPK is information showing a waveform WI _SC showing the ink dye spectral reflection characteristic I _SC, the wavelength of the ink dye source intersection CPK is an intersection of the waveform Wλ of a light source spectral characteristics lambda.

The image correction apparatus 10 according to the first embodiment in the second modification uses a color image CI obtained by imaging an electronic component EP that is an imaging target irradiated with white light L and an electronic substrate PCB containing a solder resist ink pigment. An acquisition unit 111 for acquisition is provided. The image correction apparatus 10 includes a light source spectral characteristics lambda, the correction unit 113 for correcting the pixel value of the color image CI based on the ink dye spectral reflection characteristic I _SC. The correcting unit 113 corrects the pixel value of the color image CI based on the ink dye light source intersection wavelength information ICPK. Ink dye source intersection wavelength information ICPK is information showing the waveforms Wλ of a light source spectral characteristics lambda, the wavelength of the ink dye source intersection CPK is an intersection of the waveform WI _SC showing the ink dye spectral reflection characteristic I _SC. The correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS and the long wavelength side correction information IL with reference to the predetermined wavelength information ITH. The short wavelength side correction information IS and the long wavelength side correction information IL are any of the ink dye light source intersection wavelength information ICPK.

The correcting unit 113 corrects the pixel value of the color image CI based on the long wavelength side correction information IL indicating the wavelength of the intersection on the long wavelength side with respect to the predetermined wavelength information ITH. The correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS indicating the wavelength of the intersection on the short wavelength side from the predetermined wavelength information ITH.
The predetermined wavelength information ITH of the first embodiment in the second modification is any one of the ink dye light source intersection wavelength information ICPK. Ink dye source intersection wavelength information ICPK is information indicating a wavelength of an ink dye inflection point PI is the inflection point of the waveform WI _SC showing the ink dye spectral reflection characteristic I _SC.
The short wavelength side correction information IS and the long wavelength side correction information IL of the first embodiment in Modification 2 are either one of them. Ink dye source intersection wavelength information ICPK is information showing the waveforms Wλ of a light source spectral characteristics lambda, the wavelength of the ink dye source intersection CPK is an intersection of the waveform WI _SC showing the ink dye spectral reflection characteristic I _SC.

In the case of the second embodiment in the second modification, the information included in the correction reference information is different from that in the first embodiment in the second modification. Accordingly, the second embodiment in the second modification differs from the first embodiment in the second modification in the wavelength indicated by the long wavelength side correction information IL.
In a second embodiment of the second modification, correction reference information is an ink dye spectral reflection characteristic I _SC, a light source spectral characteristics lambda, the inflection point between the sensitivity spectral characteristics R _SC, the information based on the intersection . In this example, a case will be described in which the information regarding the green sensitivity spectral characteristic GR _SC is included in the correction reference information among the sensitivity spectral characteristics R _SC . Specifically, in the second embodiment in Modification 2, the ink reference inflection point wavelength information IPI is included in the correction reference information. The correction reference information includes green sensitivity inflection point information IPG that is information indicating the wavelength of the inflection point of the waveform WGR _SC indicating the green sensitivity spectral characteristic GR _SC . Further, the correction reference information includes ink dye green sensitivity intersection wavelength information ICPIG indicating the wavelength of the intersection of the waveform WI _SC indicating the ink dye spectral reflection characteristic I _SC and the waveform WGR _SC indicating the green sensitivity spectral characteristic GR _SC. It is. The correction reference information includes ink dye light source intersection wavelength information ICPK.
In the second embodiment in Modification 2, a case will be described in which the long wavelength side correction information IL is ink dye green sensitivity intersection wavelength information ICPIG.

As a result, the image correction apparatus 10 according to the second embodiment in Modification 2 captures an image of the electronic component EP that is the imaging target irradiated with the white light L and the electronic substrate PCB containing the solder resist ink pigment. An acquisition unit 111 that acquires an image CI is provided. The image correction apparatus 10 includes a light source spectral characteristics lambda, and ink dye spectral reflection characteristic I _SC, and a correcting unit 113 for correcting the pixel value of the color image CI based on the green sensitivity spectral characteristics GR _SC. The correcting unit 113 corrects the pixel value of the color image CI based on the ink dye light source intersection wavelength information ICPK. The correcting unit 113 corrects the pixel value of the color image CI based on the ink dye green sensitivity intersection wavelength information ICPIG.
Specifically, the correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS and the long wavelength side correction information IL with reference to the predetermined wavelength information ITH. The short wavelength side correction information IS and the long wavelength side correction information IL are either ink dye light source intersection wavelength information ICPK or ink dye green sensitivity intersection wavelength information ICPIG.

The correcting unit 113 corrects the pixel value of the color image CI based on the long wavelength side correction information IL indicating the wavelength of the intersection on the long wavelength side with respect to the predetermined wavelength information ITH. The correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS indicating the wavelength of the intersection on the short wavelength side from the predetermined wavelength information ITH.
The predetermined wavelength information ITH of the second embodiment in the second modification is any one of the ink dye light source intersection wavelength information ICPK. Ink dye source intersection wavelength information ICPK is information indicating a wavelength of an ink dye inflection point PI is the inflection point of the waveform WI _SC showing the ink dye spectral reflection characteristic I _SC.
The short wavelength side correction information IS of the second embodiment in Modification 2 is any one of the ink dye light source intersection wavelength information ICPK. A waveform Wλ showing an ink dye source intersection wavelength information ICPK source spectral characteristics lambda, is information indicating a wavelength of an ink dye source intersection CPK is an intersection of the waveform WI _SC showing the ink dye spectral reflection characteristic I _SC.
The long wavelength side correction information IL of the second embodiment in Modification 2 is one of the wavelengths indicated by the ink dye green sensitivity intersection wavelength information ICPIG. The ink dye green sensitivity intersection wavelength information ICPIG is information indicating the wavelength of the intersection of the waveform WGR _SC indicating the green sensitivity spectral characteristic GR _SC and the waveform WI _SC indicating the ink dye spectral reflection characteristic I _SC .

That is, the correction unit 113 corrects the pixel value of the color image CI using any one of the wavelengths indicated by the ink dye green sensitivity intersection wavelength information ICPIG as the long wavelength side correction information IL. The green sensitivity spectral characteristic GR _SC is a spectral characteristic indicating the green sensitivity of the color sensor CC included in the imaging device 20.

In the first embodiment, the second embodiment, the first modification, and the second modification described above, objects corresponding to the cell C that is the imaging target of the imaging device 20 and the electronic component EP are collectively referred to as an object A. . Further, the culture medium M that is an imaging target of the imaging device 20 and the electronic substrate PCB are collectively referred to as an object B. The phenol red, alizarin yellow R contained in the medium M, and the solder resist ink dye contained in the electronic substrate PCB are collectively referred to as the dye P. Moreover, the white light L irradiated to the imaging target is referred to as a light source SL. Hereinafter, the first embodiment will be described in the case where the names of the constituent elements are the object A, the object B, the dye P, and the light source SL.
Imaging device 20 detects the object A, the characteristic indicated by the detected spectral characteristics D _SC light reflected by the color sensor CC source SL to be irradiated to the object B containing a dye P. Correcting unit 113, WB correction unit 212, the detection information detecting unit 213 detects the characteristic indicated by the detected spectral characteristics _{D SC,} performs white balance correction. The WB correction unit 212 performs white balance correction on the detection information in the characteristic indicated by the corrected spectral characteristic _CSC . The color imaging unit 210 captures the detection information subjected to white balance correction by the WB correction unit 212 as a color image CI. The color imaging unit 210 supplies the transmission unit 220 with a color image CI obtained by imaging the object A that is an imaging target irradiated with the light source SL and the object B containing the dye P. The transmission unit 220 supplies the color image CI to the image correction apparatus 10.

The image correction apparatus 10 includes a control unit 110 and a storage unit 120. The storage unit 120 stores in advance information (correction reference information) indicating a wavelength that is a reference for correction. The control unit 110 corrects the color image CI based on the correction reference information stored in the storage unit 120.
Correction reference information, and the dye spectral reflection characteristic P _SC is the spectral characteristics of the dye P, a inflection point of the optical spectral characteristics SL _SC is a spectral characteristic of a light source SL, is information that is based on the intersection. The dye spectral reflection characteristic _PSC is a spectral distribution of reflected light obtained when the object B containing the dye P is irradiated with white light having a continuous spectral distribution at each wavelength in the visible light region. Further, the light spectral characteristic SL _SC is a characteristic normalized with respect to 100% as a value having the maximum light intensity among the light intensity for each wavelength of the light source SL.

More specifically, the correction reference information, include dyes inflection point wavelength information IPP is information indicating the wavelength of the dye inflection point PP is the inflection point of the waveform WP _SC showing the dye spectral reflection characteristic P _SC It is. The correction reference information includes optical inflection point wavelength information IPSL _SC indicating the wavelength of the inflection point of the waveform WSL _SC indicating the optical spectral characteristic SL _SC . The correction to the reference information, the waveform _{WP SC} showing the dye spectral reflection characteristic _{P SC,} dye light intersection information indicating the wavelength of the dye light intersection CPL is an intersection of the waveform _{WSL SC} showing the optical spectral characteristic _{SL SC} Wavelength information ICPL is included.

Accordingly, the image correction apparatus 10 includes an acquisition unit 111 that acquires a color image CI obtained by imaging an object A that is an imaging target irradiated with the light source SL and an object B that contains the dye P. The image correction apparatus 10 comprises an optical spectral characteristic _{SL SC,} a correction unit 113 that corrects the pixel value of the color image CI based on the dye spectral reflection characteristic _{P SC.} The correcting unit 113 corrects the pixel value of the color image CI based on the dye light intersection wavelength information ICPL. Specifically, the correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS and the long wavelength side correction information IL with reference to the predetermined wavelength information ITH. The short wavelength side correction information IS and the long wavelength side correction information IL are either of the dye light intersection wavelength information ICPL.

The correction unit 113 includes long-wavelength correction information IL that indicates the wavelength of the intersection on the longer wavelength side than the predetermined wavelength information ITH, and short-wavelength correction information IS that indicates the wavelength of the intersection on the shorter wavelength side than the predetermined wavelength information ITH. Based on the above, the pixel value of the color image CI is corrected.
Predetermined wavelength information ITH is the wavelength corresponding to the dye inflection point wavelength information IPP is information indicating the wavelength of the dye inflection point PP is the inflection point of the waveform WP _SC showing the dye spectral reflection characteristic P _SC.
The short wavelength side correction information IS, the long wavelength side correction information IL, among the wavelength of the dye light intersection wavelength information ICPL indicating dye light intersection CPL is an intersection of the waveform WP _SC showing the dye spectral reflection characteristic P _SC, Either.

In the case of the second embodiment, the information included in the correction reference information is different from that of the first embodiment. Accordingly, the second embodiment in the second modification differs from the first embodiment in the second modification in the wavelength indicated by the long wavelength side correction information IL.
In the second embodiment, the correction reference information, and the dye spectral reflection characteristic P _SC, the optical spectral characteristics SL _SC, and the inflection point of the sensitivity spectral characteristics R _SC, the information based on the intersection. Specifically, in the second embodiment, the correction reference information includes information indicating a dye inflection point wavelength information IPP, the inflection point of the sensitivity spectral characteristics R _SC. Here, it referred to as a sensitivity inflection point PR _SC collectively inflection point of sensitivity spectral characteristics R _SC. Further, the information indicating the wavelength sensitivity inflection point _{PR SC} called sensitivity inflection point wavelength information _{IPR SC.} That is, the correction reference information includes pigment inflection point wavelength information IPP and sensitivity inflection point wavelength information IPR _SC .
Here, it referred to a waveform indicating the dye spectral reflection characteristic P _SC, an intersection of the waveform indicating the sensitivity spectral characteristics R _SC and dye sensitivity intersection CPC. Information indicating the wavelength of the dye sensitivity intersection CPC is referred to as dye sensitivity intersection wavelength information ICPC. In the second embodiment, the correction reference information includes dye sensitivity intersection wavelength information ICPC. The correction reference information includes dye light intersection wavelength information ICPL.

Thereby, the image correction apparatus 10 of the second embodiment acquires the acquisition unit 111 that acquires the color image CI obtained by imaging the object A that is the imaging target irradiated with the light source SL and the object B containing the dye P. Prepare. The image correction apparatus 10 comprises an optical spectral characteristic _{SL SC,} and the dye spectral reflection characteristic _{P SC,} a correction unit 113 that corrects the pixel value of the color image CI based on the sensitivity spectral characteristics _{R SC.} The correcting unit 113 corrects the pixel value of the color image CI based on the dye light intersection wavelength information ICPL. The correction unit 113 corrects the pixel value of the color image CI based on the dye sensitivity intersection wavelength information ICPC.
Specifically, the correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS and the long wavelength side correction information IL with reference to the predetermined wavelength information ITH.

The correcting unit 113 corrects the pixel value of the color image CI based on the long wavelength side correction information IL indicating the wavelength of the intersection on the long wavelength side with respect to the predetermined wavelength information ITH. The correction unit 113 corrects the pixel value of the color image CI based on the short wavelength side correction information IS indicating the wavelength of the intersection on the short wavelength side from the predetermined wavelength information ITH.
Predetermined wavelength information ITH is the wavelength corresponding to the dye inflection point wavelength information IPP is information indicating the wavelength of the dye inflection point PP is the inflection point of the waveform WP _SC showing the dye spectral reflection characteristic P _SC.
The short wavelength side correction information IS, of dye light intersection wavelength information ICPL indicating dye light intersection wavelength of CPL is an intersection of the waveform WP _SC showing the dye spectral reflection characteristic P _SC, either.
Long wavelength side correction information IL, a waveform illustrating the dye spectral reflection characteristic P _SC, an intersection of the waveform indicating the sensitivity spectral characteristics R _SC of dye sensitivity intersection wavelength information ICPC indicating the wavelength of the dye sensitivity intersection CPC, either is there.

That is, the correction unit 113 corrects the pixel value of the color image CI using any one of the wavelengths indicated by the dye sensitivity intersection wavelength information ICPC as the long wavelength side correction information IL. Further, the sensitivity spectral characteristic _RSC is a spectral characteristic indicating the sensitivity of the color sensor CC provided in the imaging device 20.

As described above, the image correction apparatus 10 includes the acquisition unit 111 and the correction unit 113. The acquisition unit 111 acquires a color image CI in which the object A irradiated with the light source SL and the object B including the dye P are captured by the imaging device 20. Based on at least one spectral characteristic of the light spectral characteristic SL _SC or the sensitivity spectral characteristic R _SC and the dye spectral reflection characteristic P _{SC of the} dye P included in the object B, the correcting unit 113 may The pixel value of the color image CI to be acquired is corrected. That is, the image correction apparatus 10 corrects the pixel value of the color image CI based on the light spectral characteristic SL _SC or the sensitivity spectral characteristic R _SC of the color sensor CC included in the imaging device 20 and the dye spectral reflection characteristic P _SC. . Thereby, the image correction apparatus 10 can perform correction to reduce the influence of the dye P contained in the object B. Thereby, the pigment originally possessed by the object A can be quantitatively evaluated.

The correcting unit 113 corrects the pixel value of the color image CI based on the intersection of the light spectral characteristic SL _SC or the sensitivity spectral characteristic R _SC and the dye spectral reflection characteristic P _SC . In other words, the image correction apparatus 10 performs color based on the wavelength indicated by the point where the light spectral characteristic SL _SC or the sensitivity spectral characteristic R _SC of the color sensor CC included in the imaging device 20 and the dye spectral reflection characteristic P _SC are related to each other. The pixel value of the image CI is corrected. Thereby, the pigment originally possessed by the object A can be quantitatively evaluated with higher accuracy.

The correction unit 113, the optical spectral characteristic SL _SC, or the sensitivity spectral characteristics R _SC, of the intersection of the dye spectral reflection characteristic P _SC, the long wavelength side of a wavelength at the intersection of the long wavelength side of the predetermined wavelength information ITH The color image CI is corrected based on the correction information IL. The correction unit 113 also includes short wavelength correction information indicating an intersection on the short wavelength side of the predetermined wavelength information ITH among the intersections of the light spectral characteristic SL _SC or the sensitivity spectral characteristic R _SC and the dye spectral reflection characteristic P _SC. The color image CI is corrected based on the IS. In other words, the image correction apparatus 10 has the pixel value of the color image CI at two points where the light spectral characteristic SL _SC or the sensitivity spectral characteristic R _SC of the color sensor CC included in the imaging device 20 and the dye spectral reflection characteristic P _SC are related. Correct. Thereby, the pigment originally possessed by the object A can be quantitatively evaluated with higher accuracy.

The correction unit 113, the dye inflection point wavelength information IPP indicating the wavelength of the dye inflection point PP is the inflection point of the waveform WP _SC showing the dye spectral reflection characteristic P _SC with a predetermined wavelength information ITH. The correction unit 113 corrects the color image CI based on the short wavelength side correction information IS and the long wavelength side correction information IL with reference to the predetermined wavelength information ITH. That is, the image correction apparatus 10 relates the light spectral characteristic SL _SC or the sensitivity spectral characteristic R _SC of the color sensor CC included in the imaging apparatus 20 with respect to the point where the influence of the dye P is large, and the dye spectral reflection characteristic P _SC. The pixel value of the color image CI is corrected at the two points. Thereby, the pigment originally possessed by the object A can be quantitatively evaluated with higher accuracy.

The predetermined wavelength information ITH, a dye inflection point wavelength information IPP indicating the wavelength corresponding to the inflection point of the waveform WP _SC showing the dye spectral reflection characteristic P _SC. That is, the image correction apparatus 10 corrects the pixel value of the color image CI with reference to a point where the influence of the dye P is large. Thereby, the pigment originally possessed by the object A can be quantitatively evaluated with higher accuracy.

The correction unit 113 includes a waveform _{WSL SC} showing the optical spectral characteristics _{SL SC,} dye light intersection wavelength information ICPL indicating the wavelength of the dye light intersection CPL is an intersection of the waveform _{WP SC} showing the dye spectral reflection characteristic _{P SC} Among them, the pixel value of the color image CI is corrected by using one of them as the short wavelength side correction information IS. That is, the image correction device 10 includes an optical spectral characteristic _{SL SC,} to the pixel value of the corrected color image CI to suppress the rise of the waveform _{WP SC} showing the dye spectral reflection characteristic _{P SC} based on the dye spectral reflection characteristic _{P SC} Do it. Thereby, the pigment originally possessed by the object A can be quantitatively evaluated with higher accuracy.

The correction unit 113 includes a waveform _{WSL SC} showing the optical spectral characteristics _{SL SC,} dye light intersection wavelength information ICPL indicating the wavelength of the dye light intersection CPL is an intersection of the waveform _{WP SC} showing the dye spectral reflection characteristic _{P SC} Among them, the pixel value of the color image CI is corrected using any one of them as the long wavelength side correction information IL. In other words, the image correction apparatus 10 reduces the dye P based on the light spectral characteristic SL _SC and the dye spectral reflection characteristic P _SC and corrects the pixel value of the color image CI in consideration of the brightness of the color image CI. To do. Thereby, the pigment originally possessed by the object A can be quantitatively evaluated with higher accuracy.

The correction unit 113, sensitivity spectral characteristics _{R SC} are shown waveforms _{WRR SC,} waveform _{WGR SC,} and a waveform _{WBR SC,} dye sensitivity intersection wavelength information ICPC is the intersection of the waveform _{WP SC} showing the dye spectral reflection characteristic _{P SC} The pixel value of the color image CI is corrected using any one of the indicated wavelengths as the long wavelength side correction information IL. That is, the image correction apparatus 10 includes a sensitivity spectral characteristics R _SC, by reducing the detection of the dye P by the color sensor CC based on the dye spectral reflection characteristic P _SC, color image correction to reduce the effects of dye P This is performed for the CI pixel value. Thereby, the pigment originally possessed by the object A can be quantitatively evaluated with higher accuracy.

Also, the sensitivity spectral characteristics R _SC, a red sensitive spectral characteristics RR _SC of spectral characteristics of the red sensitivity of the color sensor CC of the imaging device 20. That is, when the dye P is a tendency of the red, the image correction apparatus 10 includes a sensitivity spectral characteristics R _SC, by reducing the detection of the dye P by the color sensor CC based on the dye spectral reflection characteristic P _SC, dyes Correction for reducing the influence of P is performed on the pixel values of the color image CI. Thereby, the pigment originally possessed by the object A can be quantitatively evaluated with higher accuracy.

  The object A is a cell. That is, the pigment inherent in the cell can be quantitatively evaluated with higher accuracy.

Moreover, the object B is the culture medium M and contains phenol red as the pigment P.
Here, when phenol red is contained in the medium M for culturing the cells C, the color of the medium M may be different depending on the culture period of the cells C. Specifically, when the cell C is alkaline during the culture period of the cell C, the medium M turns red. Moreover, when the cell C is acidic during the culture period of the cell C, the medium M becomes yellow. Therefore, the hue of the cell C indicated by the color image CI may include the amount of change in phenol red. In the conventional technique, when a medium contains a pigment, it may be difficult to quantitatively evaluate the color of the cell even if the cell and the medium can be distinguished.
According to the image correction apparatus 10 of the present embodiment, it is possible to quantitatively evaluate the pigment inherent in cells cultured in a medium containing phenol red.

  In addition, each part with which the image correction apparatus 10 in said embodiment is provided may be implement | achieved by exclusive hardware, and may be implement | achieved by memory and a microprocessor.

  Each unit included in the image correction apparatus 10 includes a memory and a CPU (central processing unit), and the program for realizing the function of each unit included in the image correction apparatus 10 is loaded into the memory and executed. May be realized.

  Further, a program for realizing the function of each unit included in the image correction apparatus 10 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed, thereby executing processing. You may go. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.
Note that the requirements of the above-described embodiments can be combined as appropriate. Some components may not be used. In addition, as long as it is permitted by law, the disclosure of all published publications relating to the detection device and the like described in this specification is incorporated as part of the description of the text.

1 ... image correction system, 10 ... image correction apparatus, 20 ... imaging device, A ... object, B ... object, P ... dyes, P _{SC ...} dye spectral reflection characteristics, SL _{SC ...} optical spectral characteristic, R _{SC ...} sensitivity spectral characteristics , CI ... Color image

Claims (14)

A color image obtained by imaging a first object irradiated with light and a second object different from the first object, including a pigment and irradiated with the light, by a color imaging unit An acquisition unit for acquiring
The acquisition unit acquires based on at least one of the spectral characteristics of the light or the spectral characteristics of the sensitivity of the color imaging unit and the spectral reflection characteristics of the dye included in the second object. An image correction apparatus comprising: a correction unit that corrects pixel values of the color image. The correction unit is
The image correction apparatus according to claim 1, wherein the pixel value is corrected based on an intersection between the characteristic curve of the spectral characteristic and the characteristic curve of the spectral reflection characteristic. The correction unit is
The image correction apparatus according to claim 2, wherein the pixel value is corrected based on a long wavelength side intersection of a predetermined wavelength and a short wavelength side intersection of the predetermined wavelength among the intersections. The correction unit is
The wavelength indicated by the inflection point of the characteristic curve of the spectral reflection characteristic is set to the predetermined wavelength. Among the intersections, the long wavelength side intersection on the long wavelength side of the predetermined wavelength and the short wavelength side short wavelength of the predetermined wavelength The image correction apparatus according to claim 3, wherein the pixel value is corrected based on a wavelength side intersection. The predetermined wavelength is
The image correction apparatus according to claim 3, wherein the wavelength is a wavelength corresponding to an inflection point of the characteristic curve of the spectral reflection characteristic. The correction unit is
The said pixel value is correct | amended based on the 1st intersection which is the said short wavelength side intersection among the intersections of the characteristic curve of the spectral characteristic of the said light, and the characteristic curve of the said spectral reflection characteristic. The image correction apparatus according to claim 5. The correction unit is
The pixel value is corrected based on a second intersection that is the long wavelength side intersection among the intersections of the characteristic curve of the spectral characteristic of the light and the characteristic curve of the spectral reflection characteristic. The image correction apparatus according to claim 6. The correction unit is
The pixel value is corrected based on a third intersection which is the long wavelength side intersection among the intersections of the spectral characteristic curve of the sensitivity and the characteristic curve of the spectral reflection characteristic. The image correction apparatus according to any one of claims 7 to 9. The spectral characteristic of the sensitivity is
The image correction apparatus according to claim 1, wherein the spectral characteristics of red sensitivity of the color imaging unit. The first object is
The image correction apparatus according to claim 1, wherein the image correction apparatus is a cell. The second object is
The image correction apparatus according to any one of claims 1 to 10, which is a medium for culturing cells and contains phenol red as the pigment. An image correction apparatus according to any one of claims 1 to 11,
The color imaging unit for imaging the first object and the second object;
An image correction system comprising: On the computer,
A color image obtained by imaging a first object irradiated with light and a second object different from the first object, including a pigment and irradiated with the light, by a color imaging unit An acquisition step to acquire,
Acquired by the acquisition step based on at least one of the spectral characteristics of the light or the spectral characteristics of the sensitivity of the color imaging unit and the spectral reflection characteristics of the dye contained in the second object. An image correction program for executing a correction step of correcting a pixel value of the color image. A culture procedure for culturing cells in a medium containing a dye;
An acquisition procedure in which the cells irradiated with light and the medium irradiated with light acquire a color image captured by a color imaging unit;
The pixel value of the color image acquired by the acquisition procedure is corrected based on at least one of the spectral characteristics of the light or the spectral characteristics of the sensitivity of the color imaging unit and the spectral reflection characteristics of the dye. Correction procedure;
Based on the color image corrected by the correction procedure, a determination procedure for determining whether or not the state of the cells cultured by the culture procedure can be shipped;
A cell production method comprising:

Images