JP2014233038A - Camera apparatus and imaging method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a camera apparatus, which acquires a color image by performing color estimation based on an image of invisible light, capable of performing precise color estimation even when the output of light changes.SOLUTION: The camera apparatus includes: plural light sources each of which outputs plural invisible light beams each having different wavelengths; an imaging section that takes an image of a subject irradiated with plural invisible light beams of different wavelengths; a color estimation section that estimates a color image by estimating a color based on the strength of the plural invisible light beams of different wavelengths in an obtained image data; a monitoring section that monitors the output strength from plural light sources; and a correction section that corrects the color estimation operation of the color estimation section based on a piece of information from the monitoring section.

Description

  The present invention relates to a camera device and an imaging method for imaging a subject by irradiating the subject with invisible light.

  2. Description of the Related Art Conventionally, there are camera devices such as a night vision camera that can capture an invisible light image such as infrared light and convert it into a visible light image so that a subject can be seen in the dark.

  Conventionally, a technique is known that irradiates a subject with invisible light of a plurality of wavelengths, receives reflected light of the invisible light, and estimates the color of the subject from the difference in reflectance of each wavelength (for example, a patent) Reference 1). And a camera device that obtains a color image of a subject in the dark using this technique has been proposed.

  Such a camera device includes a plurality of light sources that output invisible light of a plurality of wavelengths, a photographing unit that captures images of invisible light of a plurality of wavelengths, and an invisible image into color images by estimating colors. A color estimation unit for conversion.

JP 2011-050049 A

  In the above-described camera device, when the output of a plurality of light sources decreases due to secular change or the like, there is a problem that the color estimation error becomes large and the color of the color image becomes inaccurate.

  When a plurality of types of light sources having different element materials are used, the degree of secular change is different for each type of light source. For this reason, when a long time passes, the ratio of the invisible light of a plurality of wavelengths irradiated on the subject from the camera device changes. When the ratio of the invisible light to be irradiated changes, the ratio of the invisible light having a plurality of wavelengths reflected from the subject is affected, which causes a color estimation error.

  The light output change may occur not only due to the secular change of the light emitting element but also due to, for example, deterioration of the optical system (lens or protective filter or the like) through which the emitted light passes or cloudiness.

  An object of the present invention is to enable highly accurate color estimation even when a change in light output occurs in a camera device that obtains a color image by performing color estimation from an invisible light image.

  A camera device according to an aspect of the present invention includes a plurality of light sources that respectively output a plurality of different wavelengths of invisible light, an imaging unit that images a subject irradiated with the plurality of different wavelengths of invisible light, A color estimator for estimating a color image by estimating a color from intensities of the invisible light of the plurality of different wavelengths in the captured image data, a monitoring unit for monitoring output intensities of the plurality of light sources, and the monitoring And a correction unit that corrects the color estimation operation of the color estimation unit based on information from the unit.

  An imaging method according to an aspect of the present invention outputs a plurality of different wavelengths of invisible light to a subject, monitors an output intensity of the output invisible light, and the plurality of different wavelengths of invisible light Based on the information of the monitored output intensity, the irradiated subject is imaged, the color is estimated from the invisible light intensities of the plurality of different wavelengths in the captured image data, and the color image is estimated. The color estimation processing operation is corrected.

  According to the present invention, accurate color estimation can be performed even when the output change of the light source occurs.

Configuration diagram of camera device of Embodiment 1 Side view showing a specific example of the irradiation unit in the first embodiment Graph showing the light output intensity degradation characteristics Flowchart showing the procedure of color estimation processing in the first embodiment Flowchart showing the procedure of output monitoring and correction processing in the first embodiment Graph showing the relationship between color and reflectance of invisible light FIG. 10 is a diagram illustrating an example of updating a color conversion table according to the first embodiment. Flowchart showing the procedure of color estimation processing in the second embodiment Flowchart showing the procedure of output monitoring & correction processing in the second embodiment Configuration of Camera Device of Embodiment 3 The perspective view (A) and internal perspective view (B) which show the specific example of arrangement | positioning of the output sensor in Embodiment 3.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Note that the embodiments can be used with each other as long as they do not contradict each other.

(Embodiment 1)
FIG. 1 is a configuration diagram of a camera apparatus according to Embodiment 1 of the present invention. FIG. 2 is a side view showing a specific example of the irradiation unit.

  As illustrated in FIG. 1, the camera device 100 according to Embodiment 1 includes a control unit 101, an irradiation unit 150, and an imaging unit (corresponding to a camera unit) 200.

  In FIG. 1, the first emission unit 102, the second emission unit 103, and the third emission unit 104 correspond to a plurality of light sources. The control unit 101 and the output sensors 112, 113, and 114 function as a monitoring unit. The control unit 101 also functions as a correction unit that corrects the operation of the color estimation process.

  The irradiation unit 150 is configured to irradiate a region to be imaged including the subject 10 with invisible light.

  As illustrated in FIG. 1, the irradiation unit 150 includes a first emission unit 102, a second emission unit 103, a third emission unit 104, an illumination optical unit 105, and a plurality of sets of output sensors 112 to 114. ing.

  The first emitting unit 102, the second emitting unit 103, and the third emitting unit 104 each output a plurality of invisible lights having different wavelengths. The first emission unit 102, the second emission unit 103, and the third emission unit 104 are, for example, a combination of an infrared LED (light emitting diode) that outputs infrared rays and / or an ultraviolet LED that outputs ultraviolet rays.

  Below, the 1st output part 102, the 2nd output part 103, and the 3rd output part 104 are demonstrated as a structure which each outputs the light of the wavelengths IR1, IR2, and IR3 of three infrared regions. .

  The first emission unit 102 may be configured by a single light emitting element, or may have a plurality of light emitting elements that output invisible light having the same wavelength. The same applies to the second emission unit 103 and the third emission unit 104.

  The illumination optical unit 105 is an optical system that irradiates a region to be imaged with invisible light output from the first emission unit 102, the second emission unit 103, and the third emission unit 104. The illumination optical unit 105 includes the lens 105a shown in FIG.

  The output sensors 112 to 114 detect the output intensities of invisible light having a plurality of wavelengths from the first emission unit 102, the second emission unit 103, and the third emission unit 104, respectively.

  Here, as shown in FIG. 2, a case where the first emission unit 102, the second emission unit 103, and the third emission unit 104 are made of board-mounted LEDs will be described as one specific example. To do. The first emission unit 102, the second emission unit 103, and the third emission unit 104 are mounted on a substrate 140 in the apparatus housing 300 (see FIG. 11A).

  The output sensors 112 to 114 are optical sensors that can detect the amount of invisible light received, such as photodiodes. Among these, the output sensor 112 is disposed at a location where the leakage light of the first emitting unit 102 is irradiated. Specifically, the output sensor 112 is mounted on the substrate 140 and in the vicinity of the first emitting unit 102.

  With such an arrangement, part of the light output from the first emission unit 102 is detected by the output sensor 112 as leakage light.

  Similarly, the output sensors 113 and 114 are disposed at locations where the leakage light of the second emission unit 103 and the third emission unit 104 is irradiated.

  The imaging unit 200 is configured to capture and capture an image of the subject 10 irradiated with invisible light.

  As illustrated in FIG. 1, the imaging unit 200 includes an imaging optical unit 201, a sensor unit 202, a data processing unit 203, and a color estimation unit 204.

  The imaging optical unit 201 is an optical system that collects light incident from the imaging target region and forms an image on the sensor unit 202. The imaging optical unit 201 includes, for example, an imaging lens 201A (see FIG. 11A).

  The sensor unit 202 includes a light receiving element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor), and converts an image composed of invisible light having a plurality of wavelengths into an electrical signal. The electrical signal is converted into imaging data and sent to the data processing unit 203.

  The data processing unit 203 obtains image data of invisible light having a plurality of wavelengths by performing predetermined image processing such as gain adjustment and exposure adjustment on the imaging data output from the sensor unit 202. The data processing unit 203 outputs the acquired image data to the color estimation unit 204.

  The color estimation unit 204 estimates the color of each pixel based on the image data of a plurality of wavelengths sent from the data processing unit 203. Further, the color estimation unit 204 generates and outputs color display data from the three-wavelength image data according to the color estimation result.

  The color estimation unit 204 stores therein a color estimation table and performs color estimation based on the color estimation table. Although the details will be described later, the color estimation table is, for example, a lookup table in which the intensity (or ratio of intensity) of reflected light of three wavelengths is associated with the color. The color estimation unit 204 stores a plurality of types of color estimation tables corresponding to various output intensities of the first emission unit 102, the second emission unit 103, and the third emission unit 104. ing.

  Note that the plurality of types of color estimation tables may be stored in the control unit 101 or another memory instead of being stored in the color estimation unit 204. Further, the color estimation unit 204 stores only the color estimation table to be used, and the control unit 101 rewrites the color estimation table of the color estimation unit 204 when it is necessary to change the color estimation table to be used. May be.

  The control unit 101 controls the irradiation unit 150 to output non-visible light having a plurality of wavelengths. Specifically, the control unit 101 outputs a drive signal having a predetermined duty ratio to each of the first emission unit 102, the second emission unit 103, and the third emission unit 104, and determines a predetermined value from each of them. It controls so that the light output of intensity | strength may be performed. The light output control by the control unit 101 is not limited to duty control.

  The control unit 101 inputs detection signals from the output sensors 112 to 114. Based on these detection signals, the control unit 101 can determine the output changes of the first emission unit 102, the second emission unit 103, and the third emission unit 104.

  The control unit 101 further controls the imaging unit 200. For example, the control unit 101 outputs a timing signal to the sensor unit 202, the data processing unit 203, and the color estimation unit 204, and synchronizes the processing timing among them.

  The control unit 101 further monitors whether or not the output intensity of the invisible light output from the irradiation unit 150 has changed, and corrects the processing operation of the color estimation unit 204 when the change has occurred. I do. Details of this processing will be described later.

  The control unit 101 further receives control information from the outside, and starts or ends each control described above based on the control information.

    Note that a display device such as a monitor that displays display data may be provided in the camera apparatus 100, or may be connected to the camera apparatus via a communication network so as to be communicable.

  In the present embodiment, the camera device 100 is configured as a single device. However, the camera device 100 is connected via a communication network except for the irradiation of non-visible light to the subject and the image of the irradiated subject. The present invention can also be realized by a personal computer equipped with an application for performing the color estimation processing of the present embodiment or a dedicated set-top box.

[Light output intensity reduction characteristics]
FIG. 3 is a graph showing a decrease characteristic of the light output intensity.

  As shown in FIG. 3, even when the first emission unit 102, the second emission unit 103, and the third emission unit 104 are driven under the same conditions, the output intensity of light decreases due to secular change. come.

  Moreover, the 1st output part 102, the 2nd output part 103, and the 3rd output part 104 output the infrared light of three types of wavelengths IR1-IR3, respectively using a different material. For this reason, as shown in FIG. 3, the degree of change with time of each output intensity of the three types of wavelengths IR1 to IR3 is different.

[Color estimation processing]
FIG. 4 is a flowchart illustrating a procedure of color estimation processing according to the first embodiment. FIG. 6 is a graph showing the relationship between color and reflectance of invisible light. FIG. 7 is a diagram illustrating an example of updating the color conversion table according to the first embodiment.

  The color estimation process in FIG. 4 is executed by the color estimation unit 204 every time one frame of image data is acquired, for example.

  When the color estimation process is started, the color estimation unit 204 uses the color conversion table to calculate the color of each pixel from the image data of three wavelengths of invisible light for one frame sent from the data processing unit 203. Estimation is performed (step S1).

  Here, a specific example of the color estimation method will be described.

  As shown in FIG. 6, the reflectance of a plurality of infrared wavelengths IR1, IR2, and IR3 varies depending on the color of the object. For example, in a pixel, when the light output of IR1 to IR3 is constant, the reflected light of IR1 is 10%, the reflected light of IR2 is 35%, and the reflected light of IR3 is 50%. It can be estimated as blue. If the reflected light of IR1 is 90%, the reflected light of IR2 is 90%, and the reflected light of IR3 is 90%, the pixel can be estimated to be red. Therefore, the color of the object can be estimated from the intensity of the reflected infrared wavelengths IR1, IR2, and IR3, or the ratio of the intensity. Here, the determination is made based only on the reflection characteristics of red, blue, and green, but in practice, various colors can be estimated based on the same concept.

  As shown in FIG. 7A, the color estimation table includes one “calculated value” calculated from the intensities (or intensity ratios) of reflected light of three wavelengths and “color data” representing colors. It is a lookup table that is associated.

The “calculated value” in the color estimation table is, for example, a value indicated by the function F in the following equation 1. The function F is a function having as variables the intensities of a plurality of infrared wavelengths IR1, IR2, and IR3 or intensity ratios “I _IR1 , I _IR2 , I _IR3 ” in one pixel. The function F is designed to show different values when the intensity ratios of the infrared wavelengths IR1, IR2, and IR3 are different, for example. In addition, the function F is designed so that the function value is close when the color of the estimation result is close.

F = F (I _IR1 , I _IR2 , I _IR3 ) (Formula 1)

  The “color data” in the color estimation table is not particularly limited, but is color difference data obtained by removing luminance data from RGB data representing the intensity of the three primary colors. The color difference data is data composed of two values (referred to as a first color difference value and a second color difference value in FIG. 7) representing a general color difference signal.

  The color estimation table may indicate the relationship between all calculated values and all color data. Further, the color estimation table may indicate only the relationship between a part of calculated values obtained by thinning the middle and a part of the color data.

  In the former case where all the relationships are shown, the color estimation unit 204 first obtains a calculated value using the function F from the intensities of the plurality of infrared wavelengths IR1, IR2, IR3 in the target pixel. Next, the color estimation unit 204 completes the estimation of the color of the target pixel by extracting color data corresponding to the calculated value from the color estimation table.

  On the other hand, in the latter case in which only a part of the relationship is shown, the color estimation unit 204 obtains the calculated value, finds the calculated value nearest to the front and rear from the color estimation table, and Extract color data. Next, the color estimation unit 204 estimates color data intermediate between these two color data as the color of the target pixel.

  Note that this color estimation method is an example, and the color estimation method is not limited to this specific example.

  In the color estimation process in step S1, the color estimation unit 204 executes the color estimation process for all pixels in one frame.

  When the color estimation is completed, the color estimation unit 204 reflects the color estimation result and generates display data for a one-frame color image (step S2). Then, the color estimation unit 204 outputs this to the outside of the apparatus and ends one color estimation process.

  The color estimation unit 204 repeatedly generates the color moving image data from the non-visible moving image data by repeatedly executing the color estimation processing of FIG. 4 on the image data of a plurality of frames.

[Output monitoring & correction processing]
FIG. 5 is a flowchart showing a procedure of output monitoring & correction processing in the first embodiment. FIG. 7 is a diagram illustrating an example of updating the color conversion table according to the first embodiment.

  The output monitoring and correction process in FIG. 5 is executed by the control unit 101. The execution timing of the output monitoring & correction process can be set variously, for example, every time one frame of image data is acquired, every time a plurality of frames of image data are acquired, every predetermined number of days, and the like.

  In the initial state, the control unit 101 sets initial output intensities of the first emission unit 102, the second emission unit 103, and the third emission unit 104 to initial output reference values (Ref_IR1, Ref_IR2, Ref_IR3). Hold as.

  When the output monitoring & correction process is started, the control unit 101 first acquires output intensities (IR1 output value, IR2 output value, IR3 output value) of the output sensors 112 to 114 (step S3).

  Next, the control unit 101 compares the acquired output intensity with the output reference value for whether there is any change in each output intensity (step S4). This comparison may be made such that small differences that do not affect color estimation are ignored.

  As a result of the comparison, if it is determined that there is no change in the output intensity, the control unit 101 ends the output monitoring and correction process without updating the color estimation table (step S5). In step S5, the control unit 101 does not perform any processing.

  On the other hand, if it is determined that the output intensity is changed as a result of the comparison, the control unit 101 first updates the output reference value for the next comparison (step S6). That is, the control unit 101 sets the value of the output intensity determined to be varied as a new output reference value.

  Subsequently, the control unit 101 updates the color estimation table used by the color estimation unit 204 according to the change in output intensity (step S7).

  For example, when the output of the wavelength IR1 decreases by 5%, even if the subject 10 has the same color, the ratio of the reflected light of the wavelength IR1 from the subject 10 decreases accordingly. In this case, it is possible to reduce the color estimation error by correcting the calculated value of the color estimation table by the decrease in the ratio of the wavelength IR1.

  Therefore, the control unit 101 updates the color estimation table used by the color estimation unit 204 to a color estimation table corresponding to the output intensity variation of each wavelength. For example, the color estimation table in FIG. 7A is changed to the color estimation table in FIG. Then, the output monitoring & correction process is terminated.

  As described above, according to the camera device 100 of the first embodiment, output fluctuations occur in the first emission unit 102, the second emission unit 103, and the third emission unit 104 due to the update of the color estimation table. Even if it occurs, the color estimation unit 204 can accurately perform color estimation.

  Further, according to the camera device 100 of the first embodiment, the output sensors 112 to 114 are provided in the device housing 300 with the first emission unit 102, the second emission unit 103, and the third emission unit. 104 is disposed at a location where the leaked light reaches. With this configuration, in the first embodiment, in particular, it is possible to accurately monitor a decrease in output due to aging of the first emission unit 102, the second emission unit 103, and the third emission unit 104.

(Embodiment 2)
The camera apparatus 100 according to the second embodiment is different from the first embodiment in the color estimation method and the color estimation correction method, and the other configurations are the same as those in the first embodiment. Detailed description of the same configuration as that of the first embodiment is omitted.

[Color estimation processing]
FIG. 8 is a flowchart showing the procedure of color estimation processing in the second embodiment.

The color estimation unit 204 according to the second embodiment obtains an estimated color of each pixel using a color estimation calculation formula (step S11). The color estimation calculation formula is not particularly limited, but is expressed as the following formula 2. The color estimation calculation formula uses color data (Cb, Cr) from values “I _IR1 , I _IR2 , I _IR3 ” indicating the intensities or intensity ratios of a plurality of infrared wavelengths IR1, IR2, IR3 in each pixel. This is the expression to be obtained. The color data is color difference data obtained by removing luminance data from RGB data indicating the intensity of the three primary colors, for example.

Cb = f1 (a × I _IR1 , b × I _IR2 , c × I _IR3 )
Cr = f2 (a * _IIR1 , b * _IIR2 , c * _IIR3 ) (Formula 2)
Here, f1 is a function having “a × I _IR1 , b × I _IR2 , c × I _IR3 ” as three variables, and f2 is “a × I _IR1 , b × I _IR2 , c × I _IR3 ”. The functions, a, b, and c, which are three variables, are three constant parameters.

  After estimating the color of each pixel, the color estimation unit 204 generates display data for a color image of one frame based on the color estimation result, and outputs this to the outside of the apparatus (step S12).

[Output monitoring & correction processing]
FIG. 9 is a flowchart illustrating a procedure of output monitoring and correction processing according to the second embodiment. The initial reference values in FIG. 9 and steps S13, S14, and S16 are the same as the initial reference values and steps S3, S4, and S6 in FIG. 5 (Embodiment 1).

  In the second embodiment, if it is determined in step S14 that there is no change in output, the control unit 101 ends the output monitoring and correction processing as it is without updating the parameters of the color estimation calculation formula (step S15).

  On the other hand, if it is determined in step S14 that there is an output fluctuation, the control unit 101 updates the parameters of the color estimation calculation formula according to the output fluctuation after the process of step S16 (step S17). Then, the output monitoring & correction process ends.

  For example, when the output intensity of the first emitting unit 102 decreases by 5%, the parameter is updated by multiplying the parameter a in Expression 2 by a magnification that compensates for the decrease in intensity (for example, multiplying by 100/95). .

  As described above, according to the camera device 100 of the second embodiment, the first emission unit 102, the second emission unit 103, and the third emission unit 104 are updated by updating the parameters of the color estimation calculation formula. Even when output fluctuation occurs, the color estimation unit 204 can accurately perform color estimation.

  In the second embodiment, the configuration in which the parameter in the color estimation calculation formula is updated according to the light output variation is shown as an example. However, the color estimation calculation formula itself is modified and updated according to the light output variation. It is good.

(Embodiment 3)
The camera device 100 according to the third embodiment is configured to monitor the output changes of the first emission unit 102, the second emission unit 103, and the third emission unit 104 in the first or second embodiment. It is something different. Other configurations, color estimation processing, and output monitoring & correction processing of the third embodiment are the same as those described in the first or second embodiment. Detailed description of the same configuration is omitted.

  FIG. 10 is a configuration diagram of the camera apparatus 100 according to the third embodiment. FIG. 11A is a perspective view showing a specific arrangement example of output sensors in Embodiment 3, and FIG. 11B is an internal perspective view thereof.

  As shown in FIG. 10, the camera device 100 according to the third embodiment includes a plurality of output sensors that respectively detect output intensities of the first emission unit 102, the second emission unit 103, and the third emission unit 104. 115. Each output of the plurality of output sensors 115 is individually input to the control unit 101. The control unit 101 and the plurality of output sensors 115 function as a monitoring unit that monitors changes in the output intensity of light.

  The output sensor 115 is an optical sensor that can detect the amount of received invisible light, such as a photodiode. The plurality of output sensors 115 are output from the first emission unit 102, the second emission unit 103, and the third emission unit 104, and are irradiated with light leakage light or diffused light that has passed through the illumination optical unit 105. It is arranged in each place.

  Here, as shown in FIGS. 11A and 11B, the first emitting unit 102, the second emitting unit 103, and the third emitting unit 104 are arranged so as to surround the imaging lens 201A. The case will be described as a specific example. Here, the imaging lens 201A is a component of the imaging optical unit 201 in FIG.

  In this specific example, a protective filter 320 that transmits invisible light is provided outside the first emission unit 102, the second emission unit 103, and the third emission unit 104. In addition, a cover 310 that protrudes toward the light emission side and surrounds the periphery of the protective filter 320 is provided at the emission port of the invisible light. The protection filter 320 is a component of the illumination optical unit 105 in FIG.

  In the case of such a configuration, the plurality of output sensors 115 can be disposed on the inner peripheral side of the cover 310 as shown in FIGS.

  The plurality of output sensors 115 are divided into three sets, the first set of output sensors 115 is arranged in the vicinity of the first emission unit 102, and the second set of output sensors 115 is in the vicinity of the second emission unit 103. The third output sensor 115 is arranged in the vicinity of the third emitting unit 104.

  With such an arrangement, leakage light or diffusion of invisible light of each wavelength emitted from the first emission unit 102, the second emission unit 103, and the third emission unit 104 and passing through the illumination optical unit 105. The intensity of light is detected by three sets of output sensors 115.

  Invisible light irradiated on the subject 10 due to a decrease in output due to aging of the first emission unit 102, the second emission unit 103, and the third emission unit 104, or clouding of the illumination optical unit 105, etc. Assume that the intensity has changed. In this case, this change can be determined from the detection signals of the three sets of output sensors 115.

  As described above, according to the camera device 100 of the third embodiment, the plurality of output sensors 115 receive the invisible leakage light or diffused light that has passed through the illumination optical unit 105 and detect the light intensity. With this configuration, it is possible to accurately monitor a decrease in output due to aging of the first emission unit 102, the second emission unit 103, and the third emission unit 104, deterioration of the illumination optical unit 105, and the like. Can do.

  Then, when there is a change in output of the emitted light, the color estimation is accurately performed by correcting the color estimation processing operation.

  The embodiments of the present invention have been described above.

  In the above embodiment, an LED is used as the light source. However, the light source is not limited to the LED, and light emission from a phosphor excited by a laser, laser, LED, or the like, a high-pressure mercury lamp, etc. Any light source that emits light of a desired wavelength is applicable.

  In the above-described embodiment, the process of estimating color difference data excluding luminance is described as the color estimation process. However, the color estimation process may be a process of estimating RGB data including luminance.

  Further, in the above embodiment, the configuration in which the irradiation unit 150, the control unit 101, and the imaging unit 200 are integrated has been described as an example. However, the control unit 101 and the color estimation unit 204 may be configured separately from other components and connected by a wired or wireless transmission path. Further, the control unit 101 and the color estimation unit 204 can be configured on a general-purpose computer as a functional module made of software.

  The present invention can be used for a camera device such as a night vision camera.

DESCRIPTION OF SYMBOLS 100 Camera apparatus 101 Control part 102 1st output part 103 2nd output part 104 3rd output part 105 Illumination optical part 105a Lens 112,113,114,115 Output sensor 140 Substrate 150 Irradiation part 200 Imaging part 201 Imaging optical Unit 201A imaging lens 202 sensor unit 203 data processing unit 204 color estimation unit 300 device housing 310 cover 320 protection filter

Claims (6)

A plurality of light sources each outputting a plurality of different wavelengths of invisible light,
An imaging unit that images a subject irradiated with invisible light of the plurality of different wavelengths;
A color estimation unit that estimates a color image by estimating a color from the invisible light intensities of the plurality of different wavelengths in the captured image data;
A monitoring unit for monitoring output intensities of the plurality of light sources;
A correction unit that corrects the color estimation operation of the color estimation unit based on information from the monitoring unit;
A camera apparatus comprising: A lookup table associating intensities and colors of the plurality of different wavelengths of invisible light;
The color estimation unit
Color estimation based on the lookup table;
The correction unit is
Updating the lookup table according to a change in output intensity of the plurality of light sources;
The camera device according to claim 1. The color estimation unit
Calculate the color from the invisible light intensity of the plurality of different wavelengths according to the calculation formula,
The correction unit is
Updating the calculation formula according to a change in output intensity of the plurality of light sources;
The camera device according to claim 1. The monitoring unit
It has an output sensor arranged at a position where the leakage light of the light source reaches in the device casing,
Monitoring the output intensity based on the output of the output sensor;
The camera device according to claim 1. The monitoring unit
An output sensor that detects light output from the light source to the outside of the device;
Monitoring the output intensity based on the output of the output sensor;
The camera device according to claim 1. Output multiple invisible lights of different wavelengths to the subject,
Monitoring the output intensity of the output invisible light;
Imaging a subject irradiated with invisible light of the plurality of different wavelengths,
Estimating the color from the invisible light intensity of the plurality of different wavelengths in the captured image data, estimating a color image,
Correcting the color estimation processing operation based on the monitored output intensity information;
Shooting method.

Images