JP2014216735A - Imaging device and imaging system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device capable of, in the case of imaging a color image by using an imaging part constituted of a visible light pixel having sensitivity in a visible light region and a near-infrared light region and a near-infrared region pixel having sensitivity in the near-infrared light region, performing processing such that a luminance level becomes higher at a central part and gradually becomes lower in a peripheral part in a vicinity of high-light.SOLUTION: An imaging device for imaging a subject includes: an imaging part having a visible light region pixel having sensitivity in a visible light region and a near-infrared light region and a near-infrared region pixel having sensitivity in the near-infrared light region; a luminance signal generation part for generating a luminance signal by using the signal output of the visible light region pixel and the signal output of the near-infrared region pixel; and a saturation degree detection part for detecting a saturation degree by using the signal output of the visible light region pixel and the signal output of the near-infrared region pixel. The luminance signal generation part generates the luminance signal in accordance with the saturation degree detected by the saturation degree detection part.

Description

  The present invention relates to an imaging apparatus and an imaging system.

  As a background art of this technical field, there is Patent Document 1. In this publication, “the signals SR, SG, and SB output from the solid-state imaging device 10 include charges due to light in the infrared region as noise. Therefore, these signals SR, SG, and SB are used as they are in color. When the image is configured, correct color reproducibility cannot be obtained.In the configuration of the present embodiment, the signal processing unit 14 outputs the output signal based on the output signal SIR from the pixel provided with the near infrared light filter. It is possible to perform processing for removing components in the near-infrared light region from SR, SG, and SB. "

JP 2008-92247 A

  The amount of light is low when a color image is picked up using an imaging unit consisting of a visible light pixel having sensitivity in the visible light region and near infrared light region and a near infrared region pixel having sensitivity in the near infrared light region. It is preferable that the location has a low luminance level and the location where the light quantity is high has a high luminance level. For example, the amount of light in the center is high and the pixel level is saturated, the amount of light gradually decreases in the periphery, and the pixel level does not saturate.In the vicinity of a place called highlight, the luminance level is higher in the center, and in the periphery It is preferable to gradually lower.

  In patent document 1, when the process which removes the unnecessary wavelength component of a near-infrared-light range is implemented, R '= (SR-SIR), G' = from SR pixel, SG pixel, SB pixel, SIR pixel (SG−SIR), B ′ = (SB−SIR), and the luminance signal Y is obtained by Y = k1 * R ′ + k2 * G ′ + k3 * B ′ (k1, k2, and k3 are arbitrary coefficients). At this time, in the method of Patent Document 1, when the amount of light is gradually increased, SR, SG, and SB are saturated before SIR. Therefore, there is a phenomenon that the luminance signal Y decreases near the center of the highlight. There is room for improvement.

  The present invention provides an imaging apparatus that suppresses the occurrence of a phenomenon in which a luminance signal decreases near the center of a highlight.

The following is a brief description of an outline of typical inventions disclosed in the present application.
(1) An imaging device that captures an image of a subject, the imaging unit having a visible light region pixel having sensitivity in a visible light region and a near infrared light region, and a near infrared region pixel having sensitivity in a near infrared light region A luminance signal generation unit that generates a luminance signal using the signal output of the visible light region pixel and the signal output of the near infrared region pixel, the signal output of the visible light region pixel, and the signal output of the near infrared region pixel A saturation level detection unit that detects a saturation level using the luminance signal generation unit, and the luminance signal generation unit generates the luminance signal according to the saturation level detected by the saturation level detection unit. It is an imaging device.
(2) An imaging unit having a visible light region pixel having sensitivity in the visible light region and near infrared light region, and a near infrared region pixel having sensitivity in the near infrared light region, and a signal output of the visible light region pixel A saturation detection unit that detects saturation using the signal output of the near-infrared pixel, and the signal output of the visible light region pixel and the near-red according to the saturation detected by the saturation detection unit An imaging device having a luminance signal generation unit that generates a luminance signal using a signal output of an outer region pixel, a display device that displays an image output from the imaging device, the imaging device, and the display device An imaging system comprising: a system control device that performs the above-described operation.

  According to the present invention, it is possible to provide an imaging apparatus that suppresses the occurrence of a phenomenon in which the luminance signal decreases near the center of the highlight.

It is a figure which shows the 1st Example of the imaging device which concerns on this invention. It is a figure which shows the 2nd Example of the imaging device which concerns on this invention. It is a figure which shows the characteristic of the pixel level with respect to each light quantity of (R + I) * (G + I) * (B + I) * (I). It is a figure which shows the control characteristic of the luminance signal level with respect to light quantity. It is a figure which shows the pixel structure of an image pick-up element. It is a figure which shows an example of the spectral characteristic with respect to the wavelength of the light of each pixel. It is a figure which shows the imaging system 600 using the imaging device which concerns on this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a diagram showing a first embodiment of an imaging apparatus according to the present invention.
The imaging apparatus 100 includes a lens 101, an imaging unit 102, a synchronization unit 103, a white balance (WB) unit 104, a luminance signal generation unit 115, a luminance gamma unit 110, a saturation detection unit 111, and a color difference. The signal generation unit 112, the color difference gamma unit 113, and the control unit 114 are appropriately used.

The lens 101 is a lens that forms an image of light coming from a subject.
The imaging unit 102 includes a visible light region pixel having sensitivity in the visible light region and near infrared light region, and a near infrared region pixel having sensitivity only in the near infrared light region. Each pixel performs photoelectric conversion and A / D conversion on the light imaged by the lens 101, and outputs a signal from each pixel, which is a digital image.

  The synchronization unit 103 performs interpolation processing on the signal from each pixel output from the imaging unit 102 to generate and output a color image signal.

  The WB unit 104 adds the gain corresponding to the color temperature of the light source to the image signal output from the synchronization unit 103, and outputs the image signal.

  The luminance signal generation unit 115 calculates and outputs a luminance signal from the image signal output from the WB unit 104. The luminance signal generation unit 115 includes a first luminance coefficient output unit 105, a second luminance coefficient output unit 106, a first luminance signal product / sum unit 107, a second luminance signal product / sum unit 108, and a luminance signal synthesis unit 109. Are used as appropriate.

  The first luminance coefficient output unit 105 sets the luminance coefficient output from the control unit 114 and outputs it to the first luminance signal product-sum unit 107.

  The second luminance coefficient output unit 106 sets the luminance coefficient output from the control unit 114 and outputs it to the second luminance signal product-sum unit 108.

  The first luminance signal product-sum unit 107 performs a product-sum operation on the image signal output from the WB unit 104 and the first luminance coefficient output from the first luminance coefficient output unit 105, and outputs a first luminance signal.

  The second luminance signal product-sum unit 108 performs a product-sum operation on the image signal output from the WB unit 104 and the second luminance coefficient output from the second luminance coefficient output unit 106, and outputs a second luminance signal.

  The luminance signal synthesis unit 109 outputs the first luminance signal output from the first luminance signal product-sum unit 107 and the second luminance signal output from the second luminance signal product-sum unit 108 from the saturation detection unit 111. A combined luminance signal is output by combining in accordance with the output saturation.

  The luminance gamma unit 110 performs gamma processing on the combined luminance signal output from the luminance signal combining unit 109 and outputs the combined luminance signal after the gamma processing to the outside of the imaging unit 100.

  The saturation detection unit 111 detects and outputs the saturation of the image signal output from the WB unit 104.

  The color difference signal generation unit 112 generates and outputs color difference signals Pr and Pb from the image signal output from the WB unit 104.

  The color difference gamma unit 113 performs gamma processing on the color difference signal output from the color difference signal generation unit 112 and outputs the color difference signal after the gamma processing to the outside of the imaging apparatus 100.

  The control unit 114 controls the entire imaging apparatus 100, and based on a control signal input from the outside of the imaging apparatus 100, the lens 101, the imaging unit 102, the synchronization unit 103, the WB unit 104, the luminance gamma unit 110, the saturation degree. The detection unit 111, the color difference signal generation unit 112, the color difference gamma unit 113, and the luminance signal generation unit 115 are appropriately controlled. Further, the control unit 114 outputs the luminance coefficient to the first luminance coefficient output unit 105 and the second luminance coefficient output unit 106.

  According to the present embodiment, with the above configuration, as described later, the luminance signal synthesis unit 109 is controlled according to the saturation detected by the saturation detection unit 111, so that the luminance near the center of the highlight is increased. It is possible to provide the imaging apparatus 100 that suppresses the occurrence of a phenomenon in which the signal decreases.

  Next, the details of the imaging unit 102 in the present embodiment will be described. FIG. 4 is a diagram illustrating an example of a pixel configuration of an image sensor used in the imaging unit 102. On the same image sensor, the (R + I) pixel 401 which is a visible light region pixel having sensitivity in the red region (R) of the visible light region and the near-infrared light region (I), and the green region (G of the visible light region) ) And a (G + I) pixel 402 that is a visible light region pixel having sensitivity in the near-infrared light region (I), and an (I) pixel 403 that is a near-infrared pixel having sensitivity in the near-infrared light region (I). And four types of pixels of (B + I) pixel 404 which is a visible light region pixel having sensitivity in the visible light blue region (B) and near-infrared light region form a unit configuration of 2 × 2 pixels. The unit structure is repeatedly arranged in the vertical and horizontal directions, and is configured as shown in FIG.

  FIG. 5 shows the sensitivity characteristic with respect to the wavelength of light of each pixel shown in FIG. 4, that is, the spectral characteristic. As described above, the (R + I) pixel 401 is close to the red region (R) in the visible light region. It has sensitivity in the infrared light region (I), the (G + I) pixel 402 has sensitivity in the green region (G) of the visible light region and the near infrared light region (I), and the (I) pixel 403 has the near infrared region. It has sensitivity in the light region (I), and the (B + I) pixel 404 indicates that it has sensitivity in the blue region (B) of the visible light region and the near infrared light region.

  When obtaining a luminance signal, the component of the near-infrared light region (I) may be an unnecessary wavelength component from the viewpoint of reproducibility of sensitivity characteristics with respect to the luminance of human eyes. In such a case, assuming that the sensitivity to the near-infrared light region (I) included in each pixel in FIG. 5 is almost the same, for example, from the visible light region pixel (R + I) pixel to the near-infrared pixel ( If I) is subtracted, a signal having sensitivity only in the red region (R) can be obtained. The same applies to the green region (G) and the blue region (B). Even if the near-infrared pixel (I) included in each pixel has a different sensitivity, the near-infrared pixel (I) can be adjusted by adjusting a coefficient (a luminance coefficient described later) for subtraction. Can be reduced.

Next, a specific operation of the imaging apparatus 100 according to the present embodiment will be described. The image signal output from the WB unit 104 exists for each color. As shown in FIG. 1, the pixel level of the image signal at a certain coordinate is (R + I), (G + I), (I), (B + I). write. At this time, the first luminance signal Y1 output from the first luminance signal product-sum unit 107 is calculated as in the following (Equation 1).
(Expression 1) Y1 = kr1 × (R + I) + kg1 × (G + I)
+ Kb1 × (B + I) + ki1 × (I)
Here, kr1, kg1, kb1, ki1 are arbitrary coefficients (the luminance coefficient of Y1) set in the first luminance coefficient output unit 105. The above equation (Equation 1) becomes the following equation (Equation 2) by the equation modification.
(Expression 2) Y1 = kr1 × ((R + I) − (I))
+ Kg1 × ((G + I) − (I))
+ Kb1 × ((B + I) − (I))
+ (Kr1 + kg1 + kb1 + ki1) × (I)
In other words, (kr1 + kg1 + kb1 = −ki1) is equivalent to removing unnecessary wavelength components when obtaining the luminance signal. Regarding kr1, kg1, kb1, for example, ITU-R BT. Coefficients can be set in the RGB-luminance signal conversion formula based on standards such as 709. For example, by setting as in the following (Equation 3), when any of (R + I), (G + I), and (B + I) is not saturated, an unnecessary wavelength component in the near infrared light region appears in Y1. Can be prevented.
(Equation 3) kr1 = 0.2126, kg1 = 0.7152,
kb1 = 0.0722, ki1 = −1.0
The second luminance signal Y2 output from the second luminance signal product-sum unit 108 is calculated as shown in the following (Equation 4).
(Expression 4) Y2 = kr2 × (R + I) + kg2 × (G + I)
+ Kb2 × (B + I) + ki2 × (I)
Here, kr2, kg2, kb2, ki2 are arbitrary coefficients (the luminance coefficient of Y2) set in the second luminance coefficient output unit 106. However, the Y2 luminance coefficient is constrained such that ki2 ≧ 0) so as not to cause the adverse effects described later. For example, kr2 = kr1, kg2 = kg1, kb2 = kb1, ki2 = 0 is set. Specifically, for example, the following (Equation 5) is set.
(Equation 5) kr2 = 0.2126, kg1 = 0.7152,
kb2 = 0.0722, ki1 = 0.0
3A and 3B are diagrams illustrating examples of control characteristics of the luminance signal level with respect to the light amount in the present embodiment. In this example, as shown in FIG. 3A, it is assumed that the pixel level is high in the order of (R + I), (G + I), (B + I), and (I), and that saturation occurs quickly when the amount of light is increased quickly.

  In FIG. 3B, the characteristic of the first luminance signal Y1 is like a broken line 312. That is, when the light quantity is gradually increased from 0, the luminance signal level increases in proportion to the light quantity in the sections (a) and (b) where the light quantity is low, but in the sections (c) and (d) where the light quantity is high. In the interval (e) where the signal level is lowered and all the pixels are saturated, the luminance signal level becomes zero. For this reason, when there is a highlight in the subject, a phenomenon occurs in which the first luminance signal Y1 decreases near the center of the highlight, and the first luminance signal Y1 is used as input to the luminance gamma unit 110 as it is. In some cases, the bright part actually looks dark. This detriment occurs because the luminance coefficient of the first luminance signal Y1 includes a negative value.

  On the other hand, the characteristic of the second luminance signal Y2 is as shown by a broken line 311 in FIG. 3B. That is, when the light amount is gradually increased from 0, the luminance signal level monotonously increases in the sections (a), (b), and (c), and the section (d) in which the pixels (R + I), (G + I), and (B + I) are saturated. ) (E) is the maximum luminance level. In this case, even if there is a highlight in the subject, a phenomenon that the luminance signal is not reduced near the center of the highlight does not occur. However, this Y2 includes an unnecessary wavelength component in the infrared light region.

  Therefore, in this embodiment, in order to take advantage of both advantages, Y1 from which unnecessary wavelength components in the near-infrared light region are removed and Y2 in which the luminance signal does not decrease near the center of the highlight are synthesized. A saturation detection unit 111 and a luminance signal synthesis unit 109 are introduced. In this embodiment, the degree of saturation means the height of the pixel level of the WB unit 104 output as the amount of light increases.

  As shown in FIG. 1, the saturation detection unit 111 receives four colors (R + I), (G + I), (B + I), and (I), and determines the saturation α according to, for example, the pixel level of (I) pixels. . The saturation degree α is a value between 0.0 and 1.0 indicating the saturation degree of the target pixel. The higher the saturation level is, the more the target pixel is saturated.

For example, the saturation degree of the visible light region pixel corresponding to the increase in the amount of light can be reflected in the luminance by setting the calculation formula of the saturation α to the following (Equation 6).
(Equation 6) α = f1 (R + I) + f2 (G + I) + f3 (B + I)
(Where f1 to f3 are monotonically increasing functions)
In addition, for example, by calculating the saturation degree α as follows (Equation 7), an increase in the amount of light is detected even in a section where the amount of light is high and the visible light region pixel is saturated (section (d)). The brightness can be reflected.
(Expression 7) α = f4 (I) (where f4 is a monotonically increasing function)
Further, for example, by setting the calculation formula of the saturation α to the following (Equation 8), the degree of saturation of the visible light region pixel corresponding to the increase in the light amount and the increase in the light amount after the visible light region pixel is saturated. Both can be detected and reflected in luminance.
(Equation 8) α = f1 (R + I) + f2 (G + I) + f3 (B + I) + f4 (I)
Further, for example, by setting the equation for calculating the saturation α to the following (Equation 9), the degree of saturation of the visible light region pixel corresponding to the increase in the amount of light can be obtained by a simple equation and reflected in the luminance. it can.
(Equation 9) α = Max ((R + I), (G + I), (B + I))
(However, Max is a function for obtaining the maximum value of three values)
The luminance signal synthesis unit 109 calculates the following (Equation 10).
(Equation 10) Y = (1−α) × Y1 + α × Y2
The above equation (Equation 10) is a calculation for internally dividing the luminance signal Y1 and the luminance signal Y2 based on the ratio of α.

  A broken line 313 in FIG. 3 indicates the luminance level of the combined luminance signal Y output from the luminance signal combining unit 109. This luminance signal Y has a small amount of unnecessary wavelength components in the near-infrared light region in the section (a) where the light amount is low, and monotonically increases in the sections (a) to (d). It is possible to suppress the occurrence of a phenomenon that the luminance signal decreases near the portion.

FIG. 2 is a diagram showing a second embodiment of the imaging apparatus according to the present invention.
The imaging apparatus 200 includes a lens 101, an imaging unit 102, a synchronization unit 103, a WB unit 104, a luminance signal generation unit 202, a luminance gamma unit 110, a saturation detection unit 111, and a color difference signal generation unit 112. The color difference gamma unit 113 and the control unit 114 are appropriately used.

  The lens 101, imaging unit 102, synchronization unit 103, WB unit 104, luminance gamma unit 110, saturation detection unit 111, color difference signal generation unit 112, color difference gamma unit 113, and control unit 114 in FIG. In the present embodiment, the description will be omitted as appropriate, and the luminance signal generation unit 202 different from FIG. 1 will be mainly described.

  The luminance signal generation unit 202 calculates and outputs a luminance signal from the image signal output from the WB unit 104. The luminance signal generation unit 202 is configured by appropriately using the first luminance coefficient output unit 105, the first luminance signal product-sum unit 107, and the luminance signal synthesis unit 201. The first luminance coefficient output unit 105 and the first luminance signal product-sum unit 107 in FIG. 2 are the same as those in FIG.

  The luminance signal combining unit 202 outputs the first luminance signal output from the first luminance signal product-sum unit 107 and the image signal output from the WB unit 104 according to the saturation level output from the saturation level detection unit 111. Are combined to output a combined luminance signal.

  According to the present embodiment, by controlling the luminance signal synthesis unit 201 according to the saturation detected by the saturation detection unit 111, the occurrence of a phenomenon that the luminance signal decreases near the center of the highlight is suppressed. The image pickup apparatus 200 can be provided.

  Further, in FIG. 2 of the present embodiment, the second luminance coefficient output unit 106 and the second signal product-sum unit 108 are reduced and the luminance signal synthesis unit 201 is simplified as compared with the configuration of FIG. 1 of the first embodiment. Therefore, the imaging apparatus 200 can be provided with a smaller circuit scale than in the case of FIG.

Next, a specific operation of the imaging apparatus 200 according to the present embodiment will be described. In the present embodiment, as in the case of the first embodiment, the first luminance signal Y1 output from the first luminance signal product-sum unit 107 is calculated as shown in the following (Equation 11).
(Equation 11) Y1 = kr1 × (R + I) + kg1 × (G + I)
+ Kb1 × (B + I) + ki1 × (I)
Specifically, for example, with respect to the luminance coefficient of Y1, as in the case of the first embodiment, all of (R + I), (G + I), and (B + I) are set by the following (Equation 12). When not saturated, it is possible to prevent unnecessary wavelength components in the near infrared light region from appearing in Y1.
(Equation 12) kr1 = 0.2126, kg1 = 0.7152,
kb1 = 0.0722, ki1 = −1.0
As in the case of the first embodiment, the saturation detection unit 111 receives four colors (R + I), (G + I), (B + I), and (I), and, for example, (I) the saturation α according to the pixel level of the pixel To decide. The saturation degree α is a value between 0.0 and 1.0 indicating the saturation degree of the target pixel. The higher the saturation level is, the more the target pixel is saturated.

The luminance signal synthesis unit 201 performs the following calculation (Equation 13).
(Equation 13) Y = Y1 + α × (I)
In FIG. 2, unlike the case of FIG. 1, (I) of the image signal output from the WB unit 104 is input to the luminance signal combining unit 201 instead of the outputs of the second luminance coefficient output unit 106 and the second luminance integrating unit 108. It has come to be.

  Also in the imaging apparatus according to the present embodiment, as in the first embodiment, the luminance level of the luminance signal Y output from the luminance signal combining unit 201 is near red in the section (a) where the light amount is low as indicated by the broken line 313. There are few unnecessary wavelength components in the outside light region, and the monotonous increase in the sections (a) to (d) does not cause a phenomenon that the luminance signal decreases near the center of the highlight.

  Therefore, according to the imaging apparatus according to the present embodiment, in addition to the suppression of the luminance signal decrease, as described above, the luminance signal synthesis unit 201 is also simplified, so that the circuit scale is reduced as compared with the case of FIG. It is possible to provide an imaging device that also has an effect.

  Further, as a modification of the present embodiment, in this embodiment, ki1 = 0 is fixed, and a calculation formula for the saturation α is set so that the saturation α decreases monotonously as the amount of light increases. The same effect can be obtained. In this case, since the term ki1 × (I) can be removed from the first luminance signal product-sum unit 107, the imaging apparatus 200 can be provided with a smaller circuit scale.

FIG. 6 is a diagram showing an imaging system 600 using the imaging apparatus according to the present invention.
The imaging system 600 is configured using the imaging device 100, the display device 101, and the system control unit 602.

  The imaging apparatus 100 is the same as the imaging apparatus 100 illustrated in FIG. 1 of the first embodiment, but may be configured using the imaging apparatus 200 illustrated in FIG. 2 of the second embodiment.

The display device 601 is a color image display device such as a liquid crystal monitor that displays a luminance signal and a color difference signal output from the imaging unit 100. There is no limitation as long as it has an image display function, such as a personal computer or a monitor television having an interface connectable to the imaging apparatus 100. Further, transmission of a signal from the imaging apparatus 100 to the display apparatus 601 may be wired or wireless.
The system control unit 602 controls the imaging device 100 and the display device 601. The system control unit 602 may be integrated with the display device by a personal computer or the like.

  According to the present embodiment, with respect to the luminance signal output from the imaging device 100, it is possible to display on the display device 601 a good-looking image that does not cause a phenomenon that the luminance signal decreases near the center of the highlight. An imaging system can be provided.

  As described above, according to the imaging device and the imaging system described in each embodiment, the imaging device and the imaging system that can be processed so that the luminance level is higher in the central portion and the luminance level is gradually lower in the peripheral portion in the vicinity of the highlight. An imaging system can be provided.

  In addition, this invention is not limited to an above-described Example, Various modifications are included. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Further, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.

  In addition, each of the above-described configurations may be configured such that some or all of them are configured by hardware, or are implemented by executing a program by a processor. Further, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.

DESCRIPTION OF SYMBOLS 100 Imaging device 101 Lens 102 Imaging part 103 Synchronization part 104 WB part 105 1st luminance coefficient output part 106 2nd luminance signal product-sum part 107 1st luminance coefficient output part 108 2nd luminance signal product-sum part 109 Luminance signal synthesis part DESCRIPTION OF SYMBOLS 110 Brightness gamma part 111 Saturation degree detection part 112 Color difference signal generation part 113 Color difference gamma part 114 Control part 200 Imaging device 201 Brightness signal composition part 202 Brightness signal generation part 301 Section (a)
302 Section (b)
303 Section (c)
304 Section (d)
305 Section (e)
311 Light intensity-luminance signal level characteristic 312 of the first luminance signal Y1 Light intensity-luminance signal level characteristic 313 of the second luminance signal Y2 Light intensity-luminance signal level characteristic 401 of the combined luminance signal Y 401 (R + I) pixel 402 (G + I) pixel 403 ( I) Pixel 404 (B + I) Pixel 600 Imaging system 601 Display device 602 System controller

Claims (9)

An imaging device for imaging a subject,
An imaging unit having a visible light region pixel having sensitivity in a visible light region and a near infrared light region, and a near infrared region pixel having sensitivity in a near infrared light region;
A luminance signal generation unit that generates a luminance signal using the signal output of the visible light region pixel and the signal output of the near infrared region pixel;
A saturation detector that detects saturation using the signal output of the visible light region pixel and the signal output of the near infrared region pixel;
Comprising
The imaging apparatus according to claim 1, wherein the luminance signal generation unit generates the luminance signal in accordance with a saturation level detected by the saturation level detection unit. The imaging apparatus according to claim 1,
The luminance signal generator is
A first luminance signal generation unit that generates a first luminance signal using the signal output of the visible light region pixel and the signal output of the near infrared region pixel;
A second luminance signal generation unit that generates a second luminance signal using the signal output of the visible light region pixel and the signal output of the near infrared region pixel;
According to the saturation, the first luminance signal generated by the first luminance signal generation unit and the second luminance signal generated by the second luminance signal generation unit are combined, and the luminance A luminance signal synthesizer for generating a signal;
An imaging apparatus comprising: The imaging apparatus according to claim 1,
The luminance signal generator is
A first luminance signal generation unit that generates a first luminance signal using the signal output of the visible light region pixel and the signal output of the near infrared region pixel;
A luminance signal combining unit that generates the luminance signal by combining the first luminance signal generated by the first luminance signal generation unit and the output signal from the near-infrared pixel according to the degree of saturation; ,
An imaging apparatus comprising: The imaging apparatus according to claim 2,
Furthermore, a control unit for setting the luminance coefficient is provided,
The luminance coefficient output from the control unit when generating the first luminance signal includes a negative value,
An imaging apparatus, wherein the luminance coefficient output from the control unit when generating the second luminance signal does not include a negative value. The imaging apparatus according to any one of claims 1 to 4,
The said saturation detection part makes the value based on the said near infrared region pixel in a local area | region the said saturation, The imaging device characterized by the above-mentioned. The imaging apparatus according to any one of claims 1 to 4,
The said saturation detection part makes the value based on the said visible light area pixel in a local area | region the said saturation, The imaging device characterized by the above-mentioned. An imaging unit having a visible light region pixel having sensitivity in a visible light region and a near infrared light region, and a near infrared region pixel having sensitivity in a near infrared light region;
A saturation detector that detects saturation using the signal output of the visible light region pixel and the signal output of the near infrared region pixel;
A luminance signal generation unit that generates a luminance signal using the signal output of the visible light region pixel and the signal output of the near infrared region pixel according to the saturation detected by the saturation detection unit,
An imaging device having
A display device for displaying an image output by the imaging device;
A system control device for controlling the imaging device and the display device;
An imaging system comprising: The imaging system according to claim 7,
The luminance signal generation unit of the imaging device is
A first luminance signal generation unit that generates a first luminance signal using the signal output of the visible light region pixel and the signal output of the near infrared region pixel;
A second luminance signal generation unit that generates a second luminance signal using the signal output of the visible light region pixel and the signal output of the near infrared region pixel;
According to the saturation, the first luminance signal generated by the first luminance signal generation unit and the second luminance signal generated by the second luminance signal generation unit are combined, and the luminance A luminance signal synthesizer for generating a signal;
An imaging system comprising: The imaging apparatus according to claim 7,
The luminance signal generation unit of the imaging device is
A first luminance signal generation unit that generates a first luminance signal using the signal output of the visible light region pixel and the signal output of the near infrared region pixel;
A luminance signal combining unit that generates the luminance signal by combining the first luminance signal generated by the first luminance signal generation unit and the output signal from the near-infrared pixel according to the degree of saturation; ,
An imaging system comprising:

Images