JP6010723B2 - Image photographing apparatus and image photographing method - Google Patents

Description

The present invention relates to an image capturing apparatus and an image capturing method that can form a color image of a subject from infrared rays reflected by the subject or infrared rays emitted from the subject.

Conventionally, a pseudo color scale display has been used as a method of forming a color image of an object by irradiating an object in the dark with infrared rays. That is, the intensity level of the infrared intensity distribution obtained from the infrared rays reflected from the subject is divided into a plurality of intensity level sections, and a color image is formed by assigning an appropriate color to each intensity level section. It was displayed as an image.

However, when the pseudo color scale display is performed, a certain intensity level section is compared with a gray scale display (monochrome display) that displays an image in gray shades or a monochrome color scale display that displays in shades of a single color or a primary color. Although it is effective for the purpose of extraction, since image information has not increased, there are many cases where it is unnatural and difficult to see.

In the field of astronomy, on the other hand, infrared rays emitted from stars and nebulae have been used to form multiple infrared images using multiple infrared bandpass filters, and the resulting infrared images are represented by appropriate multiple colors. Color images have been formed.

However, since this composite color image is a color that is completely unrelated to the image by visible light, it often appears unnatural. Also, satellites that do not emit infrared light cannot be photographed.

On the other hand, conventionally, a single color infrared photograph and a normal visible light photograph are synthesized to form a composite color photograph.

However, this composite color photograph is also unrelated to the actual color scheme. For this reason, it looks fantastic or artistic at first glance, but it is not realistic, so it looks unnatural and can only be taken during the day with sunlight.

On the other hand, a monochrome video camera, a light source that emits red, blue, and green light, a control circuit that controls the light source to emit red, blue, and green light sequentially, and the light source includes red, blue, and blue light. In addition, a color still image capturing apparatus has been proposed that includes a capture and synthesis circuit that sequentially captures and synthesizes the output video signals of the video camera when green light is emitted and combines them into a color video signal. (For example, refer to Patent Document 1).

However, the color still image capturing apparatus of Patent Document 1 relates to the visible light region, and does not target infrared rays. In addition, the color still image capturing apparatus disclosed in Patent Document 1 displays an image in the same color as the color of irradiated visible light and performs additive color mixing. At least in this respect, one of the inventions disclosed below is disclosed. This is different from the aspect and one embodiment of the present invention.

On the other hand, it has an X-ray source that generates X-rays, a two-dimensional X-ray detector that detects X-rays transmitted through the subject, and a patient bed, and the X-ray source can be rotated continuously in synchronization with the movement of the patient bed In the X-ray CT apparatus that can scan the subject in a spiral manner, the X-ray CT apparatus has energy conversion means that can change the energy characteristics of the X-rays irradiated to the subject in the slice direction, and spiral scanning using the energy change means By doing this, the same slice position can be measured with multiple X-rays with different effective energies. By interpolating the obtained data between the data measured with the same effective energy, an image with any effective energy, any effective energy can be obtained. An X-ray CT apparatus capable of obtaining a difference between energy images has been proposed (see, for example, Patent Document 2).

However, the X-ray CT apparatus of Patent Document 2 relates to the X-ray region and does not target infrared rays. Further, the X-ray CT apparatus of Patent Document 2 is an X-ray transmission image photographing apparatus, which is different from the present invention. Further, the color composite image obtained by the X-ray CT apparatus of Patent Document 2 has a completely different color from the natural color so as to improve the visibility, and at least in this respect, the book disclosed below. One aspect of the invention and one embodiment of the present invention are different.

On the other hand, in a wavelength selection type liquid crystal camera device that extracts a specific subject image by converting the optical image obtained by the photographing operation into an optical image for each wavelength region, it has an optical bandpass filter function, and its central wavelength is A liquid crystal filter that can be changed by voltage, a single image sensor that photoelectrically converts a light image in a wavelength range selected by the liquid crystal filter to generate a video signal, and two different wavelengths output from the image sensor There has been proposed a wavelength selection type liquid crystal camera device comprising an image calculation unit that calculates a signal level difference between images and generates a video signal based on an absolute value of the difference (for example, , See Patent Document 3).

However, the wavelength selective liquid crystal filter of Patent Document 3 can only transmit one wavelength region at a time, and does not correspond to the present invention. Further, the wavelength selective liquid crystal camera device of Patent Document 3 aims to improve visibility by detecting a signal level difference between two images having different wavelengths and visualizing the image. At least in this respect, The present invention is different from one aspect of the present invention and one embodiment of the present invention.

Further, in Patent Document 3, in the wavelength selective liquid crystal camera device that extracts a specific subject image by converting an optical image obtained by a photographing operation into an optical image for each wavelength region, and having an optical bandpass filter function, And the liquid crystal filter whose center wavelength can be changed by voltage, and separating the optical image of each wavelength region selected by this liquid crystal filter into a red (R) region, a green (G) region, and a blue (B) region, A color imaging device that performs photoelectric conversion to generate an R color video signal, a G color video signal, and a B color video signal, and each of an R color video signal, a G color video signal, and a B color video signal output from the color imaging device For each of the R, G, and B colors, a signal level difference is calculated for each pixel having the same spatial coordinates, and an R color video signal and a G color video signal are calculated based on the absolute value of the difference. , Generate B color video signal A color image computation unit, and a color video signal synthesis unit that synthesizes the R color video signal, the G color video signal, and the B color video signal output from the color image computation unit to generate a composite color video signal. A wavelength selective liquid crystal camera device characterized by this is also proposed.

However, this liquid crystal filter of Patent Document 3 separates a light image into a red (R) region, a green (G) region, and a blue (B) region, and the target light is visible light. However, it does not correspond to one aspect of the present invention and one embodiment of the present invention disclosed below.

On the other hand, an infrared camera that receives infrared rays radiated or reflected from an object and obtains an infrared spectrum image, and correspondence data of color and infrared spectrum radiant intensity or infrared spectrum reflectance for the object in advance. Based on the storage device for storing and the corresponding data, the color at each position of the infrared spectrum image is determined from the value of the infrared spectrum radiant intensity or infrared spectrum reflectance at each position of the infrared spectrum image. And a second processing unit for artificially coloring each position of the image of the object based on the color information obtained by the first processing unit. An infrared color image forming apparatus characterized by the above has been proposed (see, for example, Patent Document 4).

However, the infrared color image forming apparatus of Patent Document 4 needs to prepare and measure in advance the correspondence data between the actual color of the object in the visible light region and the infrared spectrum radiant intensity or infrared spectrum reflectance. Precise visual and infrared spectral spectroscopy measurements of the subject are essential. At least in this respect, the present invention does not require such correspondence data, a storage device for storing the correspondence data, and a time-consuming color specification based on comparison with the correspondence data.

On the other hand, a night vision color characterized in that a color image signal is output by irradiating the subject with infrared rays and ultraviolet rays, and judging the color from the infrared image signal and the ultraviolet image signal obtained by photographing the subject. Cameras have been proposed (see, for example, Patent Document 5 and Patent Document 6).

However, although the night vision color camera of Patent Document 5 requires irradiation with ultraviolet rays, the present invention differs at least in that it does not require such ultraviolet irradiation.

On the other hand, a plurality of optical filters that selectively transmit or reflect different infrared wavelength ranges in the optical system, and a plurality of imaging means that respectively capture infrared light images obtained by the plurality of optical filters, There has been proposed an infrared imaging device including signal processing means for forming image information from imaging signals obtained by a plurality of imaging means (see, for example, Patent Document 7).

However, the infrared imaging device of Patent Document 7 is an imaging device that targets only infrared rays, and does not describe the relationship with imaging under visible light. In addition, a color specification completely unrelated to the image by visible light is performed. In addition, subjects that do not emit infrared light cannot be photographed. That is, it is not disclosed to reproduce the color of a subject under visible light by imaging using infrared irradiation.

On the other hand, in an infrared imaging device using an infrared solid-state imaging device in which at least two types of infrared detectors having different detection wavelengths are arranged in a two-dimensional array, infrared images are displayed on a color display, and infrared rays having different detection wavelengths are displayed. There has been proposed an infrared imaging device characterized in that an output signal from a detector is displayed corresponding to a different pigment on a color display (see, for example, Patent Document 8).

However, the infrared imaging device of Patent Document 8 is an imaging device that targets only infrared rays, and does not describe the relationship with imaging under visible light. Further, the color is completely unrelated to the image by visible light. In addition, subjects that do not emit infrared light cannot be photographed. It has not been disclosed to reproduce the color of a subject under visible light by imaging with infrared irradiation.

On the other hand, an infrared light source having a light emission distribution in the infrared region, an imaging lens, a CCD sensor in which light receiving elements having light receiving sensitivity in the infrared region and the visible region are arranged in a matrix, and visible light in a specific wavelength region, respectively And an infrared imaging device comprising a plurality of color filters that transmit infrared light in a specific wavelength region and are attached to each of the light receiving elements, wherein the infrared light transmitting filter excludes visible light and transmits infrared light; Imaging signal generation means for generating an imaging signal based on infrared light incident on the image sensor, digital conversion means for converting the imaging signal into a digital signal, and a digital signal converted by the digital conversion means temporarily. There has been proposed an infrared imaging device characterized in that it has a memory that holds it automatically (see, for example, Patent Document 9).

However, the infrared imaging device of Patent Document 9 requires an infrared transmission filter that transmits visible light except visible light.

On the other hand, an imaging unit that images a subject, generates a plurality of color signals based on a visible light component from the subject, and generates an infrared luminance signal based on an infrared component from the subject; generated by the imaging unit There has been proposed an imaging device including color image generation means for generating a color image based on each color signal and infrared luminance signal (for example, see Patent Document 10).

However, the image pickup apparatus of Patent Document 10 combines an image picked up with visible light and an image picked up with infrared light to pick up an image, and color image pickup in the dark is difficult.

On the other hand, an image of the current traffic scene is taken by a camera that reacts outside the range of the visible spectrum, and the image is reproduced in the visible spectrum using an optical display device in the vehicle, particularly at night, bad weather, fog, etc. In the method of improving the field of view in the vehicle at the time of, the type of the object included in the traffic scene photographed by the camera is automatically identified, and the object identified according to the type is detected in daylight. There has been proposed a method for improving the field of view in a vehicle, characterized in that it is displayed on the optical system display device with brightness and / or color corresponding to the typical brightness and / or color it has (for example, , See Patent Document 11).

However, since the method and apparatus for improving the field of view in the vehicle of Patent Document 11 must identify all types of objects included in a video image, there is a problem that the burden of image processing becomes very large. . In addition, the display is monochrome or monochrome pseudo-color, which is uncomfortable.

On the other hand, illumination means capable of selectively illuminating a subject with white illumination light in the visible light region and illumination light including light in a wavelength region other than the visible light region, and transmitting light in different wavelength regions within the visible light region A mosaic filter having a multi-transmission characteristic that transmits light in a wavelength region other than the visible light region, and the mosaic filter is mounted on a light receiving surface and illuminated by the illumination unit. An endoscope provided with a solid-state imaging device that captures the captured subject image, and the mosaic filter for each pixel of an image corresponding to an output signal read from the solid-state imaging device by capturing the subject image And an endoscope apparatus characterized by comprising means for obtaining a color image by assigning a desired color corresponding to each of the various filters (for example, , See Patent Document 12.).

However, the endoscope apparatus of Patent Document 12 is capable of detecting a color tone difference of each part of an object to be observed, which is difficult to identify with a general visible region image, and performing pseudo color display. Reproducing the color of a subject under visible light by imaging by infrared irradiation is not disclosed.

On the other hand, a spectroscopic optical unit that receives radiated light in all wavelength regions radiated from the subject sample and separates the radiated light into n (n ≧ 3) component lights having different center wavelengths, The component light is photoelectrically converted to generate n electrical signals respectively corresponding to the n component lights, and the n pseudo electrical colors of the sample are processed by processing the n electrical signals. An image processing unit for generating an image and calculating a numerical value defined based on a color system for performing color display of the pseudo color image, and an image output unit for outputting the pseudo color image and / or the numerical value And the image processing unit independently applies each of m (m ≧ 3) sensitivity functions to one signal group composed of the n electrical signals, Corresponding to sensitivity function Image signal generation processing means for generating pseudo color basic image signals, and vector conversion processing for generating three pseudo color image signals by performing vector conversion by applying a matrix M to the m pseudo color basic image signals Means for synthesizing the three pseudo color image signals to generate the pseudo color image, and calculating the numerical value defined based on the color system using the three pseudo color image signals And the m sensitivity functions are the differences to be observed in the physical state or chemical state that occur between the subjects constituting the subject group to which the subject sample belongs. , And is determined on the basis of a correlation between waveform differences between spectral spectra of the subjects constituting the subject group, and the matrix M is a matrix for bringing the optimum sensitivity characteristics close to each other, and is determined so as to minimize the color reproduction error that occurs when the three pseudo color image signals are generated as a result. A system capable of measuring chromaticity in visible and invisible regions has been proposed (see, for example, Patent Document 13).

However, the system capable of measuring the chromaticity in the visible and invisible regions of Patent Document 13 uses the invisible color value and the color display of the pseudo color image to obtain desired information to be acquired from the subject sample. Since the evaluation is performed by comparison, it is necessary to prepare a standard sample, and it is necessary to finely divide the spectrum over a wide wavelength range, which causes a problem that the burden of image processing becomes very large.

JP-A-8-65690 JP 2004-236915 A JP 2000-152254 A JP 2002-171519 A JP 2001-36916 A JP 2005-45559 A JP-A-62-208784 JP-A-4-86075 JP 2006-109120 A JP 2006-148690 A JP 2003-78908 A JP-A-4-357926 JP 2004-77143 A

An object of the present invention is to form a color image having a natural color scheme as much as possible even in the dark.

In order to achieve the above object, an aspect of the present invention includes an irradiation unit, an imaging unit, and a color setting unit, and the irradiation unit irradiates a subject with infrared rays having different wavelength intensity distributions. The image of the subject is captured by each infrared ray having a different wavelength intensity distribution reflected by the subject to form image information representing the respective image, and the color setting unit is configured so that the formed image information is Disclosed is an image photographing apparatus characterized in that color information for representing each represented image with a different single color is set in the image information.

Note that, in general, various color spaces can be defined, thereby enabling various color specifications. Among them, the RGB color system using the three primary colors “R”, “G”, and “B” is a typical example. In the RGB color system, light having a wavelength of 700 nm may be defined as a primary color “R”, light having a wavelength of 546.1 nm may be defined as a primary color “G”, and light having a wavelength of 435.8 nm may be defined as a primary color “B”. However, in many display devices other than a special display device such as a laser projector, it is difficult to display such a fixed wavelength, so that “R”, “ G ”and“ B ”may be set or defined as appropriate. That is, the expressions “R”, “G”, and “B” have a specific wavelength intensity distribution as well as the case of representing a primary color or a single color of a specific wavelength, respectively, and the appearances are “R”, “G” ”And“ B ”may each represent a primary color or a single color approximated to each of the three primary colors.

In general, a pyramidal cell which is a human visual cell is a cell having a center wavelength of about 564 nm and a wavelength range of about 400 nm to about 680 nm, or a cell having sensitivity in the “R wavelength region”, or a center wavelength of about 534 nm. A cell having sensitivity in the green wavelength region or “G wavelength region” of about 400 nm to 650 nm and a cell having sensitivity in the blue wavelength region or “B wavelength region” of about 370 nm to 530 nm in the central wavelength of about 420 nm. There are three types. Then, it is assumed that a person visually recognizes colors corresponding to “R”, “G”, and “B” with these three types of cells. In addition, since there are individual differences in these wavelength ranges, strict definition is difficult.

Further, visible light from the subject is separated into “R wavelength region”, “G wavelength region”, and “B wavelength region” by a colored glass filter or the like, and an image in each wavelength region is taken. Then, the brightness of the image by the “R wavelength region” is represented by “R”, the brightness of the image by the “G wavelength region” is “G”, and the brightness of the image by the “B wavelength region” is represented by “B”. These three color-coded images may be displayed as a color image by so-called additive color mixing in which the three primary colors of light are superimposed and displayed.

Also, CMY color display can be performed in which “C” (Cyan), “M” (Magenta), and “Y” (Yellow) are displayed as the three primary colors. This is often used when expressing the brightness of an image by applying ink or the like having a specific color density to white paper or the like, and is referred to as subtractive color mixing because colors are mixed in a manner that blocks light.

Note that RGBB color display or CMYBk (key) or CMYK (Key) color display in which B (Black) is added to RGB color display or CMY color display is also preferably used.

In each aspect of the present invention, the color specification means expressing the brightness of an image under visible light or the in-plane intensity distribution of a specific physical quantity with the brightness of the color. However, as described above, there are cases where colors are expressed by primary colors or single colors, and there are cases where colors are displayed in multiple colors by additive color mixing or subtractive color mixing for color images or color display. Note that the primary color or single color may consist of a specific wavelength or have a specific wavelength intensity distribution.

On the other hand, infrared rays can be light or electromagnetic waves having a wavelength invisible to human eyes of about 750 nm or more according to a relative visibility curve which is an international standard of human eye sensitivity. However, since the wavelength sensitivity of the human eye varies among individuals, strict line drawing is difficult, and the wavelength may vary depending on circumstances.

Infrared rays are generally invisible rays that are invisible to human eyes. However, even light that belongs to the infrared category may be visible to some people if the intensity is very high.

“R” or “R wavelength region” may be a color or light having a central wavelength of about 640 nm, and “G” or “G wavelength region” may be a color or light having a central wavelength of about 530 nm. The “B wavelength region” may be a color or light having a center wavelength of about 435 nm.

The “R” or “R wavelength region” may be a color or light having a wavelength range of about 625 nm to 740 nm, and the “G” or “G wavelength region” may be a color or light having a wavelength range of about 500 nm to 565 nm, "B" or "B wavelength region" may be a color or light having a wavelength range of about 450 nm to 485 nm.

“R” or “R wavelength region” may be a color or light having a wavelength range of about 570 nm to 750 nm, and “G” or “G wavelength region” may be a color or light having a wavelength range of about 480 nm to 570 nm. “B” or “B wavelength region” may be a color or light having a wavelength range of about 400 nm to about 480 nm.

As described above, it is difficult to strictly distinguish “R”, “G”, “B”, “R wavelength region”, “G wavelength region”, and “B wavelength region”. Can also vary. Light and light mean the same thing.

As another aspect of the present invention, in any one of the aspects described above, the irradiation unit further converts infrared light having a different wavelength intensity distribution into LED (light emitting diode) or infrared LED and LD (laser diode) or The structure produced | generated by the infrared rays which any one or more of infrared LD radiates | emits is disclosed.

As still another aspect of the present invention, in any one of the aspects described above, the imaging unit may further include a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal Organic Semiconductor) image sensor, or an APD (Avalanche Photodiode) sensor. Solid-state imaging devices such as image dissectors, iconoscopes, image orthicons, vidicons, sachicons, planbicons, new cosmons, carnicons, trinicons, HARPs (High-gain Avalanche Rushing Amorphous)
(Photoconductor), magnetic focus type image intensifier, electric field focus type image intensifier, imaging tube or imaging plate such as microchannel plate, or bolometer system imaging element such as MEMS (Micro Electro Mechanical System) bolometer, or A configuration using a pyroelectric imaging element is disclosed.

The image sensor is preferably composed of a single element system such as Si or Ge, or a solid-state image sensor using a compound system such as SiGe, InAs, InSb, PbS, PbSe, InGaAs, or HgCdTe.

As still another aspect of the present invention, in any one of the above aspects, the imaging unit further discloses a configuration including a lens, a diaphragm, a filter, and the like.

The color specification setting is to set in advance what color the brightness of the image is to display when displaying the image. The color setting can be set, for example, by setting the transmission timing of the image information or image signal, or by sequentially corresponding the image information or image signal to the reference trigger. Also, setting by separately generating color information or color setting signal, setting by superimposing color information or color setting signal on image information or image signal, setting by address in memory It can also be performed by setting or labeling or flagging in signal processing.

Further, as yet another aspect of the present invention, an irradiation unit, an imaging unit, a color specification setting unit, and a control processing unit are provided, the imaging unit sends an imaging operation start signal to the control processing unit, and the control processing unit Based on the imaging operation start signal, an irradiation operation start instruction signal is sent to the irradiation unit, and further, a colorimetric setting operation start instruction signal is sent to the color specification setting unit, and the irradiation unit receives the irradiation operation start instruction signal The imaging unit irradiates the subject with infrared rays having different wavelength intensity distributions, and the imaging unit images the images of the subject by the infrared rays having different wavelength intensity distributions reflected by the subject. Image information to be represented is formed and sent to the color setting unit, and the color setting unit displays each of the images represented by the formed image information with different single colors based on the color setting operation start instruction signal. It discloses an image capturing apparatus according to claim to set the color specification information to the image information.

In each aspect of the present invention, information is a thing or the contents or state of a thing or a thing, and its notification. Information is preferably conveyed by signals. As such, information and signals may mean the same thing.

Furthermore, as another aspect of the present invention, an irradiation unit, an imaging unit, a color specification setting unit, and a control processing unit are provided, and the control processing unit sends an irradiation operation start instruction signal to the irradiation unit, and further starts an imaging operation. An instruction signal is sent to the imaging unit, a colorimetric setting operation start instruction signal is further sent to the colorimetric setting unit, and the irradiation unit applies infrared rays having different wavelength intensity distributions based on the irradiation operation start instruction signal. The image capturing unit captures images of the subject by infrared rays having different wavelength intensity distributions reflected by the subject based on the imaging operation start instruction signal, and represents image information representing each image. The color specification setting unit displays each of the images represented by the formed image information with different single colors based on the color setting operation start instruction signal. It discloses an image capturing apparatus according to claim to set the color specification information because the image information.

Further, as another aspect of the present invention, it further includes an irradiation unit, an imaging unit, a color specification setting unit, and a control processing unit, and the irradiation unit sends an irradiation operation start signal to the control processing unit, and further different wavelength intensity distributions. The control processing unit sends an imaging operation start instruction signal to the imaging unit based on the irradiation operation start signal, and further transmits a color setting operation start instruction signal to the color setting unit. The imaging unit captures images of the subject by infrared rays having different wavelength intensity distributions reflected by the subject, forms image information representing each image, and sends the image information to the color specification setting unit. The color setting unit sets color information for displaying each image represented by the formed image information with a different single color in the image information based on the color setting operation start instruction signal. It discloses an image capturing apparatus according to claim and.

Further, as yet another aspect of the present invention, it further includes an irradiation unit, an imaging unit, a color specification setting unit, and a control processing unit, the color specification setting unit sends a color specification setting operation start signal to the control processing unit, The control processing unit sends an irradiation operation start instruction signal to the irradiation unit based on the color specification setting operation start signal, further sends an imaging operation start instruction signal to the imaging unit, and the irradiation unit performs the irradiation operation. Based on the start instruction signal, the subject is irradiated with infrared rays having different wavelength intensity distributions, and the imaging unit receives the respective infrared rays having different wavelength intensity distributions reflected by the subject based on the imaging operation start instruction signal. The image of the subject is captured and image information representing each image is formed and sent to the color specification setting unit. The color specification setting unit converts each of the images represented by the formed image information into different single colors. Yo The color specification information for color discloses an imaging apparatus and sets the image information.

As another aspect of the present invention, in any one of the above aspects, the image processing apparatus further includes a display unit, the control processing unit further sends a display operation start instruction signal to the display unit, and the display unit A configuration is disclosed in which, based on an operation start instruction signal, each of the images represented by the image information in which the color information is set is displayed in color according to the color information.

As another aspect of the present invention, in any one of the above aspects, the image processing unit further includes an image storage unit, and the control processing unit further sends an image storage operation start instruction signal to the image storage unit, and the image storage unit Discloses a configuration for storing the image information in which the color specification information is set based on the image storage operation start instruction signal.

As still another aspect of the present invention, in any one of the aspects described above, the image storage unit further starts the image storage operation using the image information set with the color specification information stored in the image storage unit. The display unit sends to the display unit based on the instruction signal, and the display unit receives the image information in which the color specification information is set and the color information stored in the image storage unit based on the display operation start instruction signal. A configuration is disclosed in which an image represented by image information in which color information that is one or both of the set image information is set is displayed in a color according to the color information.

In another aspect of the present invention, in any one of the aspects described above, it is preferable that the separation irradiation unit further notifies the side that has transmitted the irradiation operation start instruction signal that the irradiation operation start instruction signal has been received.

In another aspect of the present invention, in any one of the aspects described above, it is preferable that the imaging unit further notifies the side that has transmitted the imaging operation start instruction signal that the imaging operation start instruction signal has been received.

In another aspect of the present invention, in any one of the above aspects, the color specification specifying unit further notifies the side that has sent the color setting operation start instruction signal that the color setting operation start instruction signal has been received. Is preferred.

In another aspect of the present invention, in any one of the aspects described above, it is preferable that the control processing unit further notifies the imaging unit that the imaging operation start signal has been received.

Furthermore, as another aspect of the present invention, in any one of the above aspects, one or more of the irradiation operation start instruction signal, the imaging operation start signal, and the color specification setting operation start instruction signal are further transmitted by infrared rays. It is preferable to send.

According to still another aspect of the present invention, in any one of the above aspects, any one or more of the irradiation operation start instruction signal, the imaging operation start instruction signal, and the color specification setting operation start instruction signal are infrared rays. It is preferable to send by.

Furthermore, as another aspect of the present invention, in any one of the aspects described above, any one or more of the irradiation operation start signal, the imaging operation start instruction signal, and the color setting operation start instruction signal are infrared rays. It is preferable to send.

Furthermore, as another aspect of the present invention, in any one of the above aspects, one or more of the irradiation operation start instruction signal, the imaging operation start instruction signal, and the color specification setting operation start signal are further infrared. It is preferable to send.

As still another aspect of the present invention, in any one of the aspects described above, a configuration is further disclosed in which one or more of the display operation start instruction signal and the image storage operation start instruction signal are transmitted by infrared rays.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable that any one or more of various operation start signals and various operation start instruction signals be transmitted wirelessly.

As another aspect of the present invention, in any one of the aspects described above, the irradiation unit may further superimpose the irradiation operation start signal on any one or a plurality of infrared rays having different wavelength intensity distributions. preferable.

As another aspect of the present invention, in any one of the above aspects, the imaging unit further includes a wavelength detection unit, and the wavelength detection unit is any one of the infrared rays having the different wavelength intensity distributions. Alternatively, it is preferable to measure one or a plurality of wavelengths of each of infrared rays having a plurality of wavelengths and different wavelength intensity distributions reflected by the subject to detect an operation state of the irradiation unit.

As another aspect of the present invention, in any one of the above aspects, the imaging unit further includes an information generation unit, and generates a composite signal and / or a component signal from the imaging operation start signal and the image information. It is preferable.

As another aspect of the present invention, in any one of the aspects described above, the control processing unit further includes an information separation unit, and the composite signal and / or the component signal are converted into the imaging operation start signal and the image information. It is preferable to separate any one or more. The component signal is a video signal or image information that can be used by decomposing the luminance signal, synchronization signal, and color signal that constitute the image, and the composite signal is the luminance signal, color signal, and synchronization that constitute the image. It is a composite synchronization signal or image information that combines signals so that even one signal line can be handled.

As another aspect of the present invention, in any one of the aspects described above, the image conversion unit further includes an image conversion unit, and the image conversion unit is stored in the image information in which the color specification information is set and the image storage unit. An operation using any one or more of the four arithmetic operations of addition, subtraction, multiplication and division, exponential function, logarithmic function, and arbitrary function for any one or more of the image information set with the color specification information The structure which forms the image information or the image converted by applying is disclosed.

As another aspect of the present invention, in any one of the above aspects, the imaging unit further generates an imaging operation start signal, further includes an information generation unit, and the information generation unit includes the imaging operation start signal. And the structure which produces | generates the synthetic | combination information which synthesize | combined the said image information so that separation | separation was possible is disclosed.

As still another aspect of the present invention, in any one of the above aspects, the control processing unit further includes an information separation unit, and the information separation unit is configured to extract the imaging operation start signal and the image information from the composite information. The structure which isolate | separates any one or more of these is disclosed.

As another aspect of the present invention, in any one of the aspects described above, the color specification setting unit further has a wavelength range or a center wavelength on the shortest wavelength side among images represented by the formed image information. Colorimetric information for coloring the first image captured by infrared rays having a wavelength intensity distribution by “R” is set to image information representing the first image, and the captured image other than the first image is captured. Disclosed is a configuration in which color information for displaying an image other than “R” is set in the formed image information other than the image information representing the first image.

Further, as yet another aspect of the present invention, a separation unit, an imaging unit, and a color specification setting unit are provided, the separation unit separates light rays from a subject into infrared rays having different wavelength intensity distributions, and the imaging unit includes The image of the subject is captured by each of the infrared rays to form image information, and the color setting unit has a wavelength intensity distribution in which a wavelength range or a center wavelength is on the shortest wavelength side among the captured images Color information for color-representing the first image captured by infrared rays having R by “R” is set as image information representing the first image, and the captured image other than the first image is set as the image information Disclosed is an image photographing apparatus characterized in that color information for coloration other than “R” is set in the formed image information other than the image information representing the first image.

As another aspect of the present invention, in any one of the aspects described above, the color specification setting unit has a wavelength intensity distribution in which a wavelength range or a center wavelength is on the shortest wavelength side in the captured image. Color information for displaying the first image captured by the first infrared by “R” is set to image information representing the first image, and the wavelength range or the center wavelength is next to the first infrared. Color information for color-coding a second image captured by infrared rays having a wavelength intensity distribution on the short wavelength side by “G” is set as image information representing the second image, and the first image and Disclosed is an image photographing apparatus characterized in that color information for color-coding the captured third image other than the second image by “B” is set to image information representing the third image. .

Further, as another aspect of the present invention, a separation unit, an imaging unit, and a color specification setting unit are provided, the separation unit separates a light beam from a subject into light beams having different wavelength intensity distributions, and the imaging unit includes: The image of the subject is captured by the light beams having the different wavelength intensity distributions to form image information, and the color setting unit includes visible light having an “R wavelength region” among the captured images. And color information for displaying the first image captured by infrared rays having a wavelength intensity distribution closest to the “R wavelength region” by “R” is set as image information representing the first image, Colorimetric information for coloring the captured image other than the first image by colors other than “R” is set in the formed image information other than the image information representing the first image. Open the image capture device To.

As still another aspect of the present invention, in any one of the above aspects, the color specification setting unit may include visible light having “R wavelength region” and “R wavelength region” in the captured image. The color information for displaying the first image captured by the first infrared ray having the closest wavelength intensity distribution by “R” is set to the image information representing the first image, and has the “G wavelength region”. Color information for displaying a second image captured by visible light and infrared light having a wavelength intensity distribution closest to the first infrared by “G” is set as image information representing the second image. The color information for expressing the captured third image other than the first image and the second image by “B” is set to image information representing the third image. An image capturing device is disclosed.

As another aspect of the present invention, in any one of the above aspects, the first image is further represented by “R”, the second image is represented by “B”, and the third image is represented by “ It is preferable to display the color by “G”.

As another aspect of the present invention, in any one of the above aspects, the first image is further represented by “G”, the second image is represented by “B”, and the third image is represented by “ You may color by "R".

As another aspect of the present invention, in any one of the above aspects, the first image is further represented by “G”, the second image is represented by “R”, and the third image is represented by “ The color may be represented by “B”.

As another aspect of the present invention, in any one of the above aspects, the first image is further represented by “B”, the second image is represented by “R”, and the third image is represented by “ The color may be indicated by “G”.

As another aspect of the present invention, in any one of the above aspects, the first image is further represented by “B”, the second image is represented by “G”, and the third image is represented by “ You may color by "R".

As another aspect of the present invention, in any one of the above aspects, the predetermined color may be any one or more of a single color or primary color of “R”, “G”, and “B”, or It is preferable to use a suitable different single color or primary color, or a combination thereof.

Furthermore, as another aspect of the present invention, in any one of the above aspects, the separation unit may further include one or more bandpass filters having different transmission wavelength intensity distributions or different reflection wavelength intensity distributions, one or more It is preferable to use one or a plurality of dichroic plate filters or one or a plurality of dichroic prism filters.

The three-plate filter constituted by the dichroic prism includes three prisms, and is a composite prism (so-called Philips type dichroic prism) that emits light from the first and second dichroic prisms by two internal reflections, respectively. A composite prism (so-called Sony type dichroic prism) that emits from the first dichroic prism with two internal reflections and emits from the second dichroic prism with one internal reflection, three right triangular prisms and one isosceles A regular prismatic composite prism (so-called cascade type dichroic prism), a regular prismatic composite prism (so-called cross dichroic prism, or X) having four right isosceles triangular prisms and having an X-shaped joint surface. Cube), and a two triangular pyramid and two quadrangular pyramid, and the like cubic composite prism (so-called Z cube) having an optical path of the three-dimensional and a bonding surface with Z-shaped edges.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the separation portion is further configured using a glass filter, a plastic filter, a liquid crystal filter, or the like.

As another aspect of the present invention, in any one of the above aspects, the imaging unit further includes a plurality of pixels, and the separation unit is attached to each of the plurality of pixels. To do.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the bandpass plate filter has a lens shape.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the entrance of the dichroic prism filter is formed into a lens shape.

As another aspect of the present invention, in any one of the above aspects, it is preferable that the imaging unit further includes a plurality of imaging units, and the start of the operations of the plurality of imaging units is synchronized.

As yet another aspect of the present invention, in any one of the aspects described above, it is preferable that the start of the operations of the plurality of imaging units is further synchronized by Genlock or a similar means.

As still another aspect of the present invention, in any one of the above aspects, it is preferable to shoot by cutting any one or more of ultraviolet rays, visible rays, and infrared rays.

Further, as another aspect of the present invention, in any one of the above aspects, the image display device further includes a display unit, and the display unit displays each of the images represented by the image information in which the color specification information is set according to the color specification information. A configuration for displaying in color is disclosed.

As another aspect of the present invention, in any one of the above aspects, the display unit further color-codes each of the images represented by the image information in which the color specification information is set according to the color specification information. It is preferable to display the images at different times.

As yet another aspect of the present invention, in any one of the above aspects, the image capturing apparatus further discloses a configuration in which the display unit continuously displays the different images and displays a color image.

As still another aspect of the present invention, in any one of the aspects described above, the image capturing apparatus further discloses a configuration in which the display unit additively mixes the different images to display a color image.

As still another aspect of the present invention, in any one of the aspects described above, the image capturing apparatus further discloses a configuration in which the display unit subtractively mixes the different images to display a color image.

As still another aspect of the present invention, in any one of the above aspects, the image capturing device may further include a light emitting display device such as a cathode ray tube monitor or a liquid crystal monitor, a transmissive display device or a reflective display device, or It is preferable that it is composed of printed matter.

In general, a cathode ray tube monitor or a liquid crystal monitor, which is a display unit, displays a subject image based on image information in which color information is set, and a color image based on additive color mixing using “R”, “G”, and “B”. It is preferable to display.

Moreover, it is preferable that the display by printing displays the image of the subject by the image information in which the color information is set, and the color image by subtractive color mixture using “C”, “M”, and “Y”.

As still another aspect of the present invention, in any one of the above aspects, an image storage unit is further provided, and the image storage unit discloses a configuration for storing image information in which the color specification information is set.

The image storage unit is preferably configured using a video decoder, video encoder, FPGA, PLD, CPLD, DSP, SDRAM, field memory, frame memory, SAMPLE & HOLD circuit, latch circuit, or the like.

Further, as yet another aspect of the present invention, in any one of the above aspects, the irradiating unit further discloses a configuration in which each of the infrared rays is irradiated with an intensity modulation with a phase difference.

As still another aspect of the present invention, in any one of the above aspects, the irradiating unit further discloses a configuration in which each of the infrared rays is intensity-modulated at a different frequency to irradiate the subject.

As still another aspect of the present invention, in any one of the aspects described above, the irradiating unit further discloses a configuration in which each of the infrared rays is irradiated to the subject in a substantially different time range.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable to modulate the intensity of infrared rays having different wavelength intensity distributions by blinking one or more of LEDs and LDs.

As yet another aspect of the present invention, in any one of the above aspects, it is preferable to modulate the intensity of infrared rays having different wavelength intensity distributions by causing one or more of LEDs and LD to emit light in a pulsed manner. .

As another aspect of the present invention, in any one of the aspects described above, an infrared ray having a different wavelength intensity distribution is converted into a waveform such as a rectangular wave, a sine wave, a cosine wave, a triangular wave, a sawtooth wave, or a combined wave thereof. It is preferable that the intensity is modulated to a wave shape such as those waveforms having a duty ratio or a bias or a composite wave.

As yet another aspect of the present invention, in any one of the above aspects, it is preferable to irradiate a subject with infrared rays having different wavelength intensity distributions after intensity modulation with an open / close slit or a chopper.

As yet another aspect of the present invention, infrared rays having different wavelength intensity distributions that are intensity-modulated by adding a time difference to each single pulsed infrared ray irradiation of infrared rays having different wavelength intensity distributions. It is preferable to irradiate the subject.

According to still another aspect of the present invention, infrared rays having different wavelength intensity distributions, which are modulated in phase by adding a time difference to each of a plurality of pulsed infrared irradiations of infrared rays having different wavelength intensity distributions, are used as subjects. Is preferably irradiated.

According to still another aspect of the present invention, the difference in phase between infrared rays having different wavelength intensity distributions having different wavelength intensity distributions and intensity modulated with phase differences is 0.1 second or less. Is preferred.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that infrared rays having different wavelength intensity distributions are formed by infrared LEDs and / or infrared lamps and infrared filters.

Examples of the infrared filter include an infrared bandpass filter having various transmission wavelength bands, a combination of an infrared long wavelength transmission filter and an infrared short wavelength transmission filter.

As still another aspect of the present invention, in any one of the above aspects, it is preferable to form infrared rays having different wavelength intensity distributions by wavelength modulation or polarization modulation of infrared LEDs and / or infrared LDs. Note that wavelength modulation and polarization modulation are preferably performed electromagnetically.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the infrared LED and / or the infrared LD emit light in a wavelength range of about 750 nm to about 1200 nm.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the infrared LED and / or the infrared LD emit light at a center wavelength in a wavelength range of about 750 nm to about 1200 nm.

As still another aspect of the present invention, it is preferable that infrared rays having different wavelength intensity distributions are emitted by a plurality of infrared light sources.

As still another aspect of the present invention, it is preferable that infrared rays having different wavelength intensity distributions are emitted by dividing one or more infrared light sources into a plurality of portions.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the operation of the irradiation unit and the operation of the imaging unit start in synchronization.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the operation of the irradiation unit, the operation of the imaging unit, and the operation of the color specification setting unit start in synchronization.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the operation of the irradiation unit and the operation of the imaging unit start at a predetermined time interval.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the operation of the irradiation unit, the operation of the imaging unit, and the operation of the color setting unit start at predetermined time intervals.

As still another aspect of the present invention, in any one of the above aspects, the imaging unit further detects each of infrared rays having different wavelength intensity distributions that are intensity-modulated at different frequencies and reflected by the subject. A configuration for separately capturing images is disclosed.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable that the operation of the irradiation unit and the operation of the imaging unit are periodically started at a frequency of 10 Hz or more.

According to still another aspect of the present invention, in any one of the above aspects, the operation of the irradiation unit, the operation of the imaging unit, and the operation of the color specification setting unit are periodically started at a frequency of 10 Hz or more. Is preferred. This is because, if different images are continuously displayed at a frequency of 10 Hz or more, it will appear as a color still image or a color moving image to the human eye.

As another aspect of the present invention, in any one of the above aspects, the display unit further includes image information in which the color specification information is set and the color specification information stored in the image storage unit. A configuration is disclosed in which an image represented by image information in which color information that is one or both of the image information is set is displayed in a color according to the color information.

As still another aspect of the present invention, in any one of the above aspects, the display unit further color-codes each image represented by the image information in which the color information is set according to the color information, and simultaneously A configuration to be displayed is disclosed.

As another aspect of the present invention, in any one of the above aspects, the operation of the irradiation unit, the operation of the imaging unit, the operation of the color specification setting unit, and the operation of the storage unit start in synchronization. It is preferable.

As another aspect of the present invention, in any one of the above aspects, the operation of the irradiation unit, the operation of the imaging unit, the operation of the color specification setting unit, and the operation of the storage unit are performed at predetermined time intervals. It is preferable to start.

According to still another aspect of the present invention, in any one of the above aspects, the irradiation unit, the imaging unit, the control processing unit, the color specification setting unit, the image storage unit, the image conversion unit, and the image It is preferable that any one or more of the display units are integrated.

As another aspect of the present invention, in any one of the aspects described above, the control processing unit, the irradiation unit, the imaging unit, the color specification setting unit, the image storage unit, the image conversion unit, and the image It is preferable that any one or more of the display units are on-chip.

According to still another aspect of the present invention, in any one of the above aspects, the irradiation unit, the imaging unit, the control processing unit, the color specification setting unit, the image storage unit, the image conversion unit, and the image Any one or more of the display units further includes a density adjustment unit, and the density adjustment unit is set with the image information in which the color specification information is set and the color specification information stored in the image storage unit. It is preferable to adjust one or more of lightness or density, contrast, and gamma correction parameters of any one or more of the image information and the converted image information.

According to still another aspect of the present invention, in any one of the aspects described above, the color specification setting unit or the control processing unit includes an RGB video signal, an NTSC video signal, a PAL video signal, a SECAM video signal, and other composites. A signal output unit that outputs one or more of a video signal, a YC separation signal, an S video signal, an SDI signal, other component video signals, an MPEG digital video signal, an Ethernet video signal, and other digital video signals; It is preferable to provide.

According to still another aspect of the present invention, in any one of the aspects described above, any one or more of the irradiation unit, the imaging unit, the color specification setting unit, and the control processing unit is an RGB video signal, NTSC. Video signals, PAL video signals, SECAM video signals, other composite video signals, YC separation signals, S video signals, SDI signals, other component video signals, MPEG digital video signals, Ethernet video signals, and other digital video signals It is preferable to output one or more of the above.

According to still another aspect of the present invention, in any one of the above aspects, the subject is irradiated with infrared rays having different wavelength intensity distributions and the infrared rays have different wavelength intensity distributions reflected by the subject. An image photographing method is disclosed, in which image information representing each image is formed by capturing the images, and each of the images represented by the formed image information is represented by different single colors.

Furthermore, as yet another aspect of the present invention, among the captured images, a first image captured by infrared rays having a wavelength intensity distribution having a wavelength range or center wavelength on the shortest wavelength side is “R”. And displaying the captured image other than the first image with a color other than “R”.

Furthermore, as yet another aspect of the present invention, a first image captured by a first infrared ray having a wavelength intensity distribution having a wavelength range or center wavelength on the shortest wavelength side among the captured images is further described as “ R ”, and a second image captured by the second infrared having a wavelength intensity distribution whose wavelength range or center wavelength is on the short wavelength side next to the first infrared is represented by“ G ”. Disclosing to color the captured image other than the first image and the second image by a color other than “B”.

According to still another aspect of the present invention, in any one of the above aspects, the second image is further represented by “B”, and images other than the first image and the second image are represented by “G”. It is preferable to color.

As another aspect of the present invention, in any one of the above aspects, the different single color may be one or more of “R”, “G”, and “B”, or an appropriate different single color or It is preferable to use primary colors and combinations thereof.

As another aspect of the present invention, in any one of the above aspects, the first image is further represented by “R”, and the captured image other than the first image is represented by “G” and “ It is preferable that the color is represented by any one or a plurality of “B”, or an appropriate different single color or primary color, or a combination thereof.

As another aspect of the present invention, in any one of the above aspects, the different single color or primary color may be any one or more of “C”, “M”, and “Y”, or may be appropriately different. It is preferable to use a single color or primary color, or a combination thereof.

Furthermore, as another aspect of the present invention, in any one of the above aspects, an appropriate two monochromatic, two primary colors or “R”, “G”, and “B” obtained by additively mixing the color-coded image. It is preferable to form a color image according to any two of the above.

Furthermore, as another aspect of the present invention, in any one of the above aspects, an appropriate two single color, two primary colors or “C”, “M”, and “Y” obtained by subtractively subtracting the color-coded image from each other. It is preferable to form a color image according to any two of the above.

Further, according to still another aspect of the present invention, in any one of the above aspects, according to an appropriate three monochromatic color, primary color, or “R”, “G”, and “B” obtained by additive color mixing of the color-coded image. It is preferable to form a color image.

Further, according to still another aspect of the present invention, in any one of the aspects described above, the color image is further subtracted and mixed by appropriate three single colors, three primary colors, or “C”, “M”, and “Y”. It is preferable to form a color image.

According to still another aspect of the present invention, in any one of the above aspects, the RGB color image is further converted into a converted color image by RGBB color, index color, CMY color, CMYK color, or other different color display. It is preferable.

As another aspect of the present invention, in any one of the aspects described above, any one of four arithmetic operations of addition, subtraction, multiplication, and division, an exponential function, a logarithmic function, and an arbitrary function is further added to the image. Alternatively, it is preferable to form a converted image by applying a calculation using a plurality.

Further, as another aspect of the present invention, in any one of the above aspects, the captured image, the captured image, a two-color or two-primary color image, a three-color or three-primary color image, an RGB color It is preferable to store one or more of an image, a CMY color image, a converted image, and a converted color image.

Further, as another aspect of the present invention, in any one of the above aspects, the captured image, the captured image, a two-color or two-primary color image, a three-color or three-primary color image, an RGB color It is preferable to display one or more of an image, a CMY color image, a converted image, and a converted color image.

Furthermore, as another aspect of the present invention, in any one of the above aspects, the color-coded image, two-color or two-primary color image, three-color or three-primary color image, RGB color image, or converted It is preferable to adjust one or more of color balance, hue, brightness or density, contrast, and gamma correction parameters of one or more colors of the image and the converted color image, respectively.

As still another aspect of the present invention, in any one of the above aspects, it is preferable to irradiate a subject with infrared rays having two, three, four or more different wavelength intensity distributions.

Further, as another aspect of the present invention, in any one of the above aspects, it is disclosed that each of infrared rays having different wavelength intensity distributions is subjected to intensity modulation with a phase difference and irradiated to the subject.

Further, as yet another aspect of the present invention, in any one of the above aspects, it is disclosed that the infrared light having the different wavelength intensity distribution is further subjected to intensity modulation at a different frequency to irradiate the subject.

As still another aspect of the present invention, in any one of the above aspects, it is disclosed that the subject is irradiated with infrared rays having different wavelength intensity distributions in different time ranges. That is, it is preferable that the respective infrared rays are not irradiated substantially simultaneously.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the irradiation operation and the imaging operation are further started in synchronization.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable that the irradiation operation, the imaging operation, and the color specification execution are started in synchronization.

As still another aspect of the present invention, infrared rays from a subject are separated into infrared rays having different wavelength intensity distributions, and images of the subject are picked up by the respective infrared rays having different wavelength intensity distributions. The first image captured by infrared rays having a wavelength intensity distribution with the wavelength range or the center wavelength being on the shortest wavelength side is represented by “R”, and the captured image other than the first image is displayed. An image photographing method is disclosed in which the color is represented by colors other than “R”.

Furthermore, as yet another aspect of the present invention, among the captured images, a first image captured by a first infrared ray having a wavelength intensity distribution having a wavelength range or center wavelength on the shortest wavelength side is “R”. The second image captured by the second infrared having a wavelength intensity distribution having a wavelength range or center wavelength on the short wavelength side next to the first infrared is colored by “G”, and the first An image photographing method is disclosed in which an image other than the image and the second image is represented by “B”.

As still another aspect of the present invention, in any one of the above aspects, the second image is further represented by “B”, and images other than the first image and the second image are represented by “G”. It is preferable to color.

Further, as another aspect of the present invention, in any one of the above aspects, the subject may be irradiated with infrared rays having one wavelength intensity distribution and infrared rays having two or more different wavelength intensity distributions. preferable.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the irradiation operation and the imaging operation are further started in synchronization.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable that the irradiation operation, the imaging operation, and the color specification execution are started in synchronization.

Further, as yet another aspect of the present invention, light rays from a subject are separated into light rays having different wavelength intensity distributions, and images of the subject are picked up by the respective light rays having different wavelength intensity distributions. Visible light having the “R wavelength region” and the “R”
The first image captured by infrared rays having the wavelength intensity distribution closest to the “wavelength region” is represented by “R”, and the captured image other than the first image is represented by other than “R”. An image photographing method characterized by the above is disclosed.

As still another aspect of the present invention, among the captured images, a visible ray having an “R wavelength region” and a first infrared ray having a wavelength intensity distribution closest to the “R wavelength region” are captured. The first image is represented by “R”, and the second image captured by the visible light having “G wavelength region” and the second infrared having a wavelength intensity distribution close to the first infrared is represented by “G”. Then, an image photographing method is disclosed, in which an image other than the first image and the second image is represented by “B”.

According to still another aspect of the present invention, in any one of the above aspects, the second image is further represented by “B”, and images other than the first image and the second image are represented by “G”. It is preferable to color.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable that a subject is further irradiated with light rays having one, two, or three or more different wavelength intensity distributions.

As another aspect of the present invention, in any one of the above aspects, it is disclosed that a light beam having the different wavelength intensity distribution is further subjected to intensity modulation with a phase difference and irradiated onto the subject.

Further, as yet another aspect of the present invention, in any one of the above aspects, it is disclosed that each of the light beams having different wavelength intensity distributions is subjected to intensity modulation at different frequencies to irradiate the subject.

Further, as still another aspect of the present invention, in any one of the above aspects, it is disclosed to irradiate the subject with light beams having different wavelength intensity distributions in different time ranges. That is, it is preferable that the respective infrared rays are not irradiated substantially simultaneously.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the irradiation operation and the imaging operation are further started in synchronization.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable that the irradiation operation, the imaging operation, and the color specification execution are started in synchronization.

As still another aspect of the present invention, in any one of the above aspects, the captured image is preferably displayed in a color.

As still another aspect of the present invention, in any one of the aspects described above, the captured image is preferably stored.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that one or both of the captured image and the stored image are displayed in color.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that one or both of the captured image and the stored image are color-coded and displayed simultaneously.

As another aspect of the present invention, in any one of the aspects described above, one or both of the captured image and the stored image may be color-coded and displayed in different time ranges. preferable.

As yet another aspect of the present invention, in any one of the above aspects, the light beam from the subject may be either a light beam reflected by the subject, a light beam transmitted through the subject, or a light beam emitted from the subject, or It is preferable that there is a plurality.

In general, the light beam or light includes one or more of ultraviolet rays, visible rays, and infrared rays.

As still another aspect of the present invention, in any one of the above aspects, it is preferable to use one or more of ultraviolet rays, visible rays, and infrared rays.

As still another aspect of the present invention, it is preferable to use sunlight in any one of the above aspects.

As still another aspect of the present invention, in any one of the above aspects, it is preferable to use light from the moon.

As yet another aspect of the present invention, in any one of the above aspects, it is preferable to use light rays from space such as stars and nebulae.

As still another aspect of the present invention, it is preferable to use an incandescent lamp in any one of the above aspects.

As still another aspect of the present invention, in any one of the above aspects, it is preferable to further use a fluorescent light beam.

As still another aspect of the present invention, in any one of the above aspects, it is preferable to use ultraviolet rays, visible rays, or infrared rays as bias light.

As yet another aspect of the present invention, in any one of the aspects described above, it is preferable that the color CCD camera as the imaging unit is further used during the day and the monochrome CCD camera as the imaging unit is used at night. Note that the switching is preferably performed based on measuring brightness using a light detection element, an illuminance meter, a solar cell, or the like.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable to use a monochrome CCD camera as the imaging unit both in the daytime and at night.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable to use a color CCD camera as the image pickup unit for both daytime and nighttime.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable to use a color CCD camera as the imaging unit using infrared illumination at night.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the color CMOS camera as the imaging unit is further used during the day and the monochrome CMOS camera as the imaging unit is used at night. Note that the switching is preferably performed based on measuring the brightness with a light detection element, an illuminance meter, a solar cell, or the like.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable to use a monochrome CMOS camera that is the imaging unit for both daytime and nighttime.

As still another aspect of the present invention, in any one of the aspects described above, it is preferable to use a color CMOS camera as the imaging unit both in the daytime and at night.

As still another aspect of the present invention, in any one of the above aspects, it is preferable that the infrared cut filter is used during the day and the infrared cut filter is not used at night. Note that the switching is preferably performed based on measuring the brightness with a light detection element, an illuminance meter, a solar cell, or the like.

As another aspect of the present invention, in any one of the above aspects, in the case of a color CCD or a color CMOS camera as the imaging unit, RGB components are combined into one as in an NTSC video signal. It is preferable to collectively form one image.

As still another aspect of the present invention, in any one of the above aspects, it is preferably used for monitoring or security of a night vision camera or the like.

As another aspect of the present invention, in any one of the above aspects, it is preferably used as night vision goggles or night vision glasses.

As still another aspect of the present invention, in any one of the above aspects, the color image display may be performed in a monochrome image display.

As yet another aspect of the present invention, in any one of the above aspects, a plurality of irradiation units may be fixedly installed at a plurality of locations, and image capturing may be performed using an imaging unit and a color setting unit integrated so as to be portable. Good. In this case, the irradiating unit appears to be independent, but an image capturing unit, a color setting unit, a control processing unit, and the like are separately required for image capturing according to the present invention.

In still another aspect of the present invention, in any one of the above aspects, the irradiation unit, the imaging unit, the color setting unit, the control processing unit, etc. can be used indoors such as a ceiling, or in a vehicle such as an automobile, train, ship or airplane. It may be installed on the ship or in the cabin.

As still another aspect of the present invention, in any one of the above aspects, an irradiation unit, an imaging unit, a color specification setting unit, a control processing unit, etc. Good.

As still another aspect of the present invention, in any one of the above aspects, an irradiation unit, an imaging unit, a color specification setting unit, a control processing unit, and the like may be installed in a building such as a house or a building.

As still another aspect of the present invention, in any one of the above aspects, an irradiation unit, an imaging unit, a color specification setting unit, a control processing unit, and the like may be further incorporated in the fluorescent lamp.

According to still another aspect of the present invention, the color of the subject is obtained by irradiating a subject including an adherent member that reflects infrared rays having a predetermined wavelength intensity distribution, and imaging the infrared ray reflected by the subject. It is preferable to obtain an image.

According to still another aspect of the present invention, in any one of the above aspects, an infrared ray is irradiated on a subject including an adherent member that reflects infrared rays having a predetermined wavelength intensity distribution, and the infrared ray reflected by the subject is imaged. By doing so, it is preferable to obtain a color image of the subject that is the same as or approximate to the color of the subject under white light in the visible light range.

As yet another aspect of the present invention, an irradiation unit, a separation unit, an imaging unit, and a color specification setting unit are provided. The irradiation unit irradiates a subject with infrared rays, and the separation unit emits infrared rays reflected by the subject. Separating the infrared rays having different wavelength intensity distributions, the image pickup unit picks up an image of the subject by each infrared ray and forms image information, and the color setting unit sets the formed image information There is provided an image photographing apparatus characterized in that color information for representing each represented image with a different single color is set in the image information.

As yet another aspect of the present invention, a separation unit, an imaging unit, and a color specification setting unit are provided, the separation unit separates light rays from a subject into light rays having different wavelength intensity distributions, and the imaging units are respectively The image of the subject is captured by the light beams having the different wavelength intensity distributions to form image information, and the color specification setting unit is configured to color each of the images represented by the formed image information with different single colors. An image photographing apparatus is provided in which the color information is set in the image information.

As yet another aspect of the present invention, image information representing each image obtained by separating infrared rays from a subject into infrared rays having different wavelength intensity distributions and capturing images of the subjects with the respective infrared rays having different wavelength intensity distributions. The image photographing method is characterized in that each of the images represented by the formed image information is represented by different single colors.

As yet another aspect of the present invention, the subject is irradiated with infrared rays, the infrared rays reflected by the subject are separated into infrared rays having different wavelength intensity distributions, and each of the infrared rays having different wavelength intensity distributions There is provided an image photographing method characterized in that images are captured to form image information representing the respective images, and each of the images represented by the formed image information is represented by different single colors.

As yet another aspect of the present invention, a light beam from a subject is separated into light beams having different wavelength intensity distributions, and images of the subject are captured by respective infrared rays having different wavelength intensity distributions to represent the respective images. There is provided an image photographing method characterized in that image information is formed and each of the images represented by the formed image information is represented by different single colors.

As yet another aspect of the present invention, light rays from a subject are separated into light rays having different wavelength intensity distributions, images of the subject are picked up by the respective light rays having different wavelength intensity distributions, and the picked-up images Among them, a first image captured by visible light having “R wavelength region” and infrared light having a wavelength intensity distribution closest to the “R wavelength region” is represented by “R”, and “B wavelength region” is defined. A second image captured by an infrared ray having a wavelength intensity distribution closest to the “R wavelength region” and an infrared ray having a wavelength intensity distribution closest to the “R wavelength region” is represented by “B”, and the first image and An image capturing method is provided, wherein the captured image other than the second image is color-coded by “G”.

According to still another aspect of the present invention, there is provided an image photographing method characterized in that a color image that is the same as or approximate to the color of a subject under white light in a visible light range is obtained from an image captured by infrared rays from the subject. provide.

As yet another aspect of the present invention, a color image that is the same as or similar to the color of a subject under white light in the visible light range is captured by an infrared image that is reflected by the subject by irradiating the subject with infrared rays. An image capturing method is provided.

As yet another aspect of the present invention, an infrared image reflected on the human skin by irradiating the human skin with an infrared color image that is the same as or similar to the color of the human skin under white light in the visible light range. An image capturing method is provided, which is obtained from an image captured by the method.

As yet another aspect of the present invention, the imaging unit further includes a silicon image sensor, and a color image that is the same as or similar to the color of the subject under white light in the visible light range is captured by infrared rays from the subject. There is provided an image photographing apparatus characterized in that it is obtained more.

As yet another aspect of the present invention, the imaging unit further includes a silicon image sensor, and irradiates the subject with infrared light on a color image that is the same as or similar to the color of the subject under white light in the visible light range, and the subject An image photographing apparatus is provided, which is obtained from an image picked up by infrared rays reflected by the light.

As yet another aspect of the present invention, a separation unit, an imaging unit, and a color specification setting unit are provided, the separation unit separates a light beam from a subject into light beams having different wavelength intensity distributions, and the imaging unit further includes: A silicon image sensor that captures images of the subject with light beams having different wavelength intensity distributions to form image information, and the color specification setting unit includes a most visible light region of the captured images. A first image captured by infrared light having a wavelength distribution close to 1 is represented by “R”, and the infrared light having a wavelength distribution close to the visible light region is next to the wavelength distribution of the infrared light used for capturing the first image. The captured second image is represented by “B”, and the third image captured by infrared light having a wavelength distribution close to the visible light region next to the wavelength distribution of infrared light used for capturing the second image is represented by “ By "G" Color imaging and synthesizing the first image, the second image, and the third image to obtain a color image that is the same as or approximate to the color of the subject under white light in the visible light range Providing equipment.

As yet another aspect of the present invention, a subject having an adherent member that reflects infrared rays having a predetermined wavelength intensity distribution is irradiated with infrared rays, and the color of the subject is obtained from an image captured by infrared rays reflected by the subject. Provided is an image photographing method characterized by obtaining an image.

As yet another aspect of the present invention, a subject having an adherent member that reflects infrared rays having a predetermined wavelength intensity distribution is irradiated with infrared rays, and an image captured by the infrared rays reflected by the subject is more visible. There is provided an image photographing method characterized by obtaining a color image of the subject that is the same as or similar to the color of the subject under white light.

According to the image photographing device and the image photographing method of the present invention, it is possible to form a more natural color image of a subject in infrared rays. In addition, compared with the conventional monochrome display or gray scale display, single color scale display or pseudo color scale display, the color image obtained by the image capturing apparatus and the image capturing method according to the present invention has a large amount of information. Yes. For this reason, as one effect, a more natural and easy-to-view color image can be provided.

It is a figure which shows the structure of the image imaging device and image imaging method which concern on one Embodiment of this invention. 1 is a schematic diagram of a configuration of an image capturing device according to an embodiment of the present invention. It is a schematic diagram of the structure of the image imaging device which concerns on another one Embodiment of this invention. It is a figure which shows the relationship of the wavelength of the infrared rays in one Embodiment of this invention, an ultraviolet-ray, and visible light. In one Embodiment of this invention, it is an example figure of wavelength intensity distribution at the time of using three infrared LED which radiates | emits the infrared rays which each have different wavelength intensity distribution. In one Embodiment of this invention, it is an example figure at the time of using three infrared rays LD which radiate | emits the infrared rays which each have different wavelength intensity distribution. It is a schematic diagram of the structure of the image imaging device which concerns on another one Embodiment of this invention. In one Embodiment of this invention, it is an example figure of the wavelength intensity distribution of three different infrared rays isolate | separated and formed by the isolation | separation part. In one Embodiment of this invention, it is an example figure which isolate | separated the light ray from a to-be-photographed object into the light ray which has three different wavelength intensity distribution by the separation part. In one Embodiment of this invention, it is an example figure which isolate | separated the light ray from a to-be-photographed object into the light ray which has three different wavelength intensity distribution by the separation part. In one Embodiment of this invention, it is an example figure which isolate | separated the light ray from a to-be-photographed object into the light ray which has three different wavelength intensity distribution by the separation part. 1 is a schematic diagram of a configuration of Embodiment 1 of an image capturing device and an image capturing method according to the present invention. It is a timing chart in Example 1 of an image photographing device and an image photographing method according to the present invention. It is a timing chart in Example 1 of the imaging device and method by this invention. It is a schematic diagram of a structure of Example 2 of the image capturing device and the image capturing method according to the present invention. It is a timing chart in Example 2 of the imaging device and method by this invention. It is a timing chart in Example 2 of the imaging device and method by this invention. It is a schematic diagram of a structure of Example 3 of the image capturing device and the image capturing method according to the present invention. It is a schematic diagram of a structure of Example 4 of the image capturing device and the image capturing method according to the present invention. It is an example figure of the reflective characteristic of the 1st and 2nd dichroic plate filter of Example 4 of the imaging device by the present invention and the imaging method. It is a schematic diagram of a structure of Example 5 of the image capturing device and the image capturing method according to the present invention. It is a schematic diagram of a structure of Example 6 of the image capturing device and the image capturing method according to the present invention. It is a schematic diagram of a structure of Example 7 of the image capturing device and the image capturing method according to the present invention. It is a schematic diagram of a structure of Example 8 of the image capturing device and the image capturing method according to the present invention. It is a schematic diagram of a structure of Example 9 of the image capturing device and the image capturing method according to the present invention. It is the photograph by Experimental example 1 which concerns on one Embodiment of this invention. It is the photograph by Experimental example 1 which concerns on one Embodiment of this invention. It is the photograph by Experimental example 1 which concerns on one Embodiment of this invention. It is measurement data by Experimental example 2 which concerns on one Embodiment of this invention. It is measurement data by Experimental example 2 which concerns on one Embodiment of this invention. It is a photograph by Experimental example 3 which concerns on one Embodiment of this invention. It is an example of the filter characteristic of Example 10 of the image capturing device and the image capturing method in one embodiment of the present invention. It is a figure showing the light reception sensitivity of the silicon image sensor of Example 10 of the image photographing device and the image photographing method in one embodiment of the present invention. It is a figure showing the detection rate of Example 10 of the imaging device and the imaging method in one embodiment of the present invention. It is an example figure of the filter characteristic of Example 11 of the image capturing device and the image capturing method in one embodiment of the present invention. It is a figure showing the detection rate of Example 11 of the imaging device and the imaging method in one embodiment of the present invention. It is an example of the filter characteristic of Example 12 of the image capturing device and the image capturing method in one embodiment of the present invention. It is a figure showing an example of the filter characteristic of Example 13 of the imaging device and the imaging method in one embodiment of the present invention, and the light reception sensitivity of a silicon image sensor. It is a figure showing an example of the filter characteristic of Example 14 of the imaging device and the imaging method in one embodiment of the present invention, and the light reception sensitivity of a silicon image sensor. It is a figure showing an example of the filter characteristic of Example 15 of the image photographing device and the image photographing method in one embodiment of the present invention, and the light receiving sensitivity of the silicon image sensor. It is a figure showing an example of the filter characteristic of Example 16 of the imaging device and the imaging method in one embodiment of the present invention, and the light reception sensitivity of a silicon image sensor. It is a figure showing an example of the filter characteristic of Example 17 of the image photographing device and the image photographing method in one embodiment of the present invention, and the light receiving sensitivity of the silicon image sensor.

Embodiments and examples related to the present invention will be described below with reference to the drawings. However, the present invention is not limited to the contents described below. Moreover, the same code | symbol is attached | subjected to the part with the same definition, and description may not be repeated.

(Outline of the present invention)
An outline of the present invention will be described.

An image capturing apparatus according to an embodiment of the present invention includes an irradiation unit and an imaging unit. The irradiation unit irradiates the subject with infrared rays having different wavelength intensity distributions. Here, “infrared rays having different wavelength intensity distributions” mean infrared rays having different wavelength ranges or center wavelengths. The imaging unit captures an infrared image of the subject with each infrared ray having a different wavelength intensity distribution reflected by the subject.

For example, it is assumed that the wavelengths of infrared rays irradiated by the irradiation unit are λ1, λ2, and λ3. In this case, the imaging unit forms an infrared ray reflected from the subject and having a wavelength of λ1 on an imaging surface for imaging an optical image such as a CCD image sensor, and an in-plane intensity distribution of the infrared ray having a wavelength of λ1 on the imaging surface. To get. This in-plane intensity distribution is called an object image or infrared image by infrared rays having a wavelength of λ1. Usually, such an in-plane intensity distribution can be expressed by a two-dimensional distribution function. Therefore, when a two-dimensional position is represented by coordinates (x, y), the intensity of infrared rays having a wavelength of λ1 in a certain section in the imaging surface having the center or center of gravity position (x, y) is represented by I1 (x , Y). Similarly, the imaging unit forms an infrared ray having a wavelength of λ2 reflected from the subject on the imaging surface, and acquires an in-plane intensity distribution of the infrared ray having a wavelength of λ2 on the imaging surface. The intensity of infrared light having a wavelength of λ2 at the position (x, y) is represented as I2 (x, y). The imaging unit forms an infrared ray having a wavelength of λ3 reflected from the subject on the imaging surface, and acquires an in-plane intensity distribution of the infrared ray having a wavelength of λ3 on the imaging surface. The intensity of the infrared ray having the wavelength of λ3 at the position (x, y) is represented as I3 (x, y).

I1 (x, y), I2 (x, y), I3 (x, y), and the like can be displayed as two-dimensional array data. By using such an expression format, it is possible to store image information in a memory and transmit / receive as image signals.

Note that the imaging unit may acquire I1 (x, y), I2 (x, y), and I3 (x, y) at the same time, or may acquire them at different times. For example, by simultaneously irradiating infrared rays having wavelengths of λ1, λ2, and λ3 and separating the infrared rays of the respective wavelengths with a filter, I1 (x, y), I2 (x, y), and I3 (x, y) are obtained. Can be acquired at the same time. Further, by shifting the time for irradiating infrared rays having wavelengths λ1, λ2, and λ3, I1 (x, y), I2 (x, y), and I3 (x, y) can be sequentially acquired at different times. .

Since the infrared image corresponds to the in-plane intensity distribution of colorless infrared rays on the imaging surface, when the infrared image is displayed on a display device such as a liquid crystal display device according to the intensity, monochrome, mono color or pseudo color according to the infrared intensity Is displayed.

However, generally, when the infrared wavelength is different, the infrared reflectance of the subject is different. As described above, when the subject is irradiated with infrared rays having a plurality of different wavelengths, even if the subject is at the same position, I1 ( The values of x, y), I2 (x, y) and I3 (x, y) will be different. Therefore, the values of I1 (x, y), I2 (x, y), and I3 (x, y) are made to correspond to different monochromatic lightness / density according to a certain natural law, respectively, under the visible light of the subject. It is one of the objects of the present embodiment to reproduce the color at and to obtain a color image of the subject.

Various methods for expressing colors are known. For example, when a color is expressed by the brightness of each of “R”, “G”, and “B”, the value of I1 (x, y) is the brightness of the “R” component, and the value of I2 (x, y) is By assuming that the value of I3 (x, y) is proportional to the brightness of the “G” component and the brightness of the “B” component, respectively, and by adding and mixing each brightness obtained by setting an appropriate proportionality coefficient, , The color in the section at position (x, y) is determined. A color image can be obtained by determining the color in each section across the plane.

More specifically, for example, the brightness R, G, and B of each of the “R”, “G”, and “B” components of a certain section in the display screen are
R = αI1 (x, y) (1)
G = βI2 (x, y) (2)
B = γI3 (x, y) (3)
Can be expressed. Here, α, β, and γ are proportional coefficients for converting each of the infrared intensities I1 (x, y), I2 (x, y), and I3 (x, y) into R, G, and B, respectively. It is.

In this way, for the image information I1 (x, y), I2 (x, y), and I3 (x, y), the color of a certain section in the display screen is expressed by equations (1) to (3). This is sometimes referred to as color expression according to the information represented by the equations (1) to (3), and α, β and γ may be referred to as color information. Further, R, G, and B in the equations (1) to (3) may be referred to as image information in which color specification information is set.

Of course, the value of I1 (x, y) corresponds to the lightness of “R”, the value of I2 (x, y) corresponds to the lightness of “G”, and the value of I3 (x, y) corresponds to the lightness of “B”. Is an example, and in general, color representation by various colors is possible. Therefore, if the image information is | I>, the color information is H, and the image information in which the color information is set is | C>, for example,
| C> = H | I> (4)
here,
| C> = (R, G, B) (5)

| I> ^T = (I1 (x, y), I2 (x, y), I3 (x, y)) (7). Note that V ^T represents a transposed vector of the vector V with respect to the vector V.

The previous I1 (x, y) value corresponds to the lightness of “R”, the value of I2 (x, y) corresponds to the lightness of “G”, and the value of I3 (x, y) corresponds to the lightness of “B”. Corresponds to zero off-diagonal terms on the right side of equation (6). In that case,
(R, G, B) = (α1I1 (x, y), β2I2 (x, y), γ3I3 (x, y))
(8)
= (ΑI1 (x, y), βI2 (x, y), γI3 (x, y))
(9)
Can be expressed. Here, Expression (8) or (9) is expressed in the same way as Expressions (1) to (3) in another form. In addition, as described above, in general, it is possible to display colors with various colors, but it can also be said that this corresponds to the case where the off-diagonal term on the right side of Equation (6) is not zero. .

Note that the above is an expression relating to the color specification of a two-dimensional image using a three-dimensional vector and a 3 × 3 matrix, but the same can be described for the color specification of a three-dimensional image.

Note that the number and size of a certain section in the imaging surface and a certain section in the display screen can be variously set. However, the larger the number of sections or the smaller the size, the higher the resolution or resolution of the image. Get better.

In one aspect of the present invention, color information is set in the image information, so that the image information can be displayed as a color image and reproduced by printing or the like.

As will be described later, when λ1 <λ2 <λ3, the brightness of “R” mainly depends on the value of I1 (x, y), that is, on the right side of Equation (6), it is compared with the diagonal term. The inventors of the present application have found that when the off-diagonal term is made small or almost zero, the color of the subject under visible light can be reproduced well.

Note that the brightness of the “R” component of the image information for which the color information is set depends mainly on the value of I1 (x, y), and that an infrared image having a wavelength of λ1 is represented by “R”. There is a case to do. The same applies to the “G” component and the “B” component.

FIG. 1 shows a configuration of an image photographing apparatus according to an embodiment of the present invention. As shown in FIG. 1, the image capturing apparatus includes an irradiation unit 1, an imaging unit 2, and a color specification setting unit 3. The irradiation unit 1 irradiates the subject 4 with infrared rays 5 having different wavelength intensity distributions. The imaging unit 2 captures an image of the subject 4 with each of the infrared rays 6 having different wavelength intensity distributions reflected by the subject 4, and forms image information 7 representing each image. The color specification setting unit 3 sets color information for displaying each of the images represented by the formed image information 7 with different single colors in the image information 7.

The infrared rays 5 having different wavelength intensity distributions may be irradiated at different times so that the infrared rays having the respective wavelength intensity distributions are not irradiated substantially simultaneously. When the infrared rays having different wavelength intensity distributions may be irradiated at the same time, the time length is shorter than the time length of the infrared rays having one wavelength intensity distribution. Is also short. Moreover, the infrared rays 5 having different wavelength intensity distributions may be irradiated simultaneously. In this case, the reflected infrared rays 6 having different wavelength intensity distributions are separated using a filter or the like.

In addition, even if the infrared rays 5 having different wavelength intensity distributions may be irradiated simultaneously, the infrared rays 5 having different wavelength intensity distributions may be irradiated to the subject 4 with intensity modulation at different frequencies. In this case, the reflected infrared rays 6 having different wavelength intensity distributions are separated by detecting and separating each of the infrared rays 6 having different wavelength intensity distributions that are modulated at different frequencies and reflected by the subject 4. Is done.

For the transmission of the image information 7, an analog signal or a digital signal may be used, and information representing each image is stored and transmitted in a separable manner. Note that there may be stored signal information related to display timing such as image brightness information or luminance information and brightness information start position, imaging start time, and screen vertical synchronization. In the case of a digital signal, for example, the header information of the image information 7 may include information indicating the start position and size of information representing each image.

Each image represented by the image information 7 indicates the intensity distribution of the reflected infrared rays 6. For this reason, if each image represented by the image information 7 is displayed as it is on a display or printing, it is displayed in a single color or a mono color. Here, the single color means that it is expressed by the brightness / density of only one color. For example, a position where the intensity of the reflected infrared ray 6 is high is expressed by bright red, and a position where the intensity of the infrared ray 6 is weak is expressed by dark red. In this case, a monochromatic expression in red is obtained. Therefore, a single color image can be obtained by setting in the image information 7 information indicating which color of each image represented by the image information 7 is to be expressed.

For example, images obtained as a result of irradiating a subject with first, second, and third infrared rays having three different wavelength intensity distributions are defined as a first image, a second image, and a third image, respectively. In this case, for example, information representing that the first image is represented by a single color of red, the second image is represented by a single color of green, and the third image is represented by a single color of blue. It can be called information.

In addition, the color information may indicate that a single color of a different color is used for each image without designating which color of the single color to express. In some cases, a plurality of images may be represented by a single color of the same color. For example, the color specification information may indicate that the first image and the third image are expressed by a single color of the same color, and the second image is expressed by a single color of a different color. The information content of the color information can be changed later.

In addition, when the color information is set in the image information 7 by the color setting unit 3, that is, the color setting is performed, the color of the brightness of the image is displayed in advance when the image is displayed. Setting at the transmission timing of the image information 7, setting by sequentially corresponding the image information 7 to the reference trigger, setting by separately generating the color setting signal, The color information can be set by superimposing the color setting information on the image information 7, set by an address in the memory, or set by labeling or flagging in signal processing. Embedding can also be performed by including color specification information as part of the header information of the image information 7.

FIG. 2 is a diagram illustrating a configuration of an image capturing device according to another embodiment of the present invention. As shown in FIG. 2, the present invention further includes a display unit 9, and the display unit 9 displays each of the different images according to the image information 8 in which the color information is set by using a predetermined color. Also good. That is, the image photographing device according to the present embodiment further includes the display unit 9 in the image photographing device according to the above-described embodiment. The display unit 9 displays each of the images represented by the image information 7 in the expression specified by the color information by the image information 8 formed by setting the color information to the image information 7. In addition, when there are a plurality of images represented by the image information 7, they may be displayed on the display unit 9 at the same time, or may be displayed at different times. When the images are displayed at different times, it is preferable to shorten the display time so that humans do not recognize that images of a plurality of colors are displayed separately. For example, one image is displayed for 1/24 second and the next image is displayed. In this manner, the display unit 9 uses a predetermined single color, for example, “R”, “G”, and “B”, based on the image information 8, and the subject imaged by each infrared ray having different wavelength intensity distribution If different images are displayed in color and continuously displayed at high speed, an RGB color image is apparently displayed.

In addition, the image capturing apparatus according to the present embodiment may further include an image storage unit 10. In this case, the image storage unit 10 may store the image information 8.

In the image capturing device according to the present embodiment, the display unit 9 may display either one or both of the image information 8 and the image information 11 stored in the image storage unit 10. In this case, the displayed image is displayed according to the color information set in the image information 8 or the image information 11. Or you may display according to the color information different from the color information set to image information, such as displaying the image information 11 according to the color information set to the image information 8. FIG. Further, the image information 8 or the image information 11 may be displayed in color according to the color information newly set by the user or the like.

The display unit 9 may simultaneously display a total of three images from one or both of the image information 8 and the image information 11. In that case, if the display unit 9 simultaneously displays images included in the image information using predetermined colors, for example, “R”, “G”, and “B”, an RGB color image can be displayed.

FIG. 3 shows a configuration of an image capturing apparatus according to another embodiment of the present invention. As shown in FIG. 3, the image apparatus according to the present embodiment includes an irradiation unit 1, an imaging unit 2, a color specification setting unit 3, and a control processing unit 12. The imaging unit 2 sends an imaging operation start signal 13 to the control processing unit 12. Based on the imaging operation start signal 13, the control processing unit 12 sends an irradiation operation start instruction signal 14 to the irradiation unit 1, and further sends a color setting operation start instruction signal 15 to the color setting unit 3. The irradiation unit 1 irradiates the subject 4 with infrared rays 5 having different wavelength intensity distributions based on the irradiation operation start instruction signal 14, and the imaging unit 2 reflects the reflected infrared rays 6 having different wavelength intensity distributions reflected by the subject 4. Images of the subject 4 are captured, and image information 7 representing each image is formed and sent to the color setting unit 3. The color setting unit 3 sets color information in the image information 7 based on the color setting operation start instruction signal 15.

Note that the image apparatus according to the present embodiment may further include a display unit 9. In this case, the control processing unit 12 further sends a display operation start instruction signal 16 to the display unit 9, and the display unit 9 is represented by the image information 8 in which the color information is set based on the display operation start instruction signal 16. Each image to be displayed may be displayed in a color according to the color information.

Note that the image apparatus according to the present embodiment may further include an image storage unit 10. In this case, the control processing unit 12 further sends an image storage operation start instruction signal 17 to the image storage unit 10, and the image storage unit 10 may store the image information 8 based on the image storage operation start instruction signal 17. Good.

In the image apparatus according to the present embodiment, the image storage unit 10 further displays the image information 11 in which the color information stored in the image storage unit 10 is set based on the image storage operation start instruction signal 17. Based on the display operation start instruction signal 16, the display unit 9 may display one or more of the image information 8 and the image information 11 in a color according to the color information.

Further, the color specification setting unit 9 “R” a first image captured by infrared rays having a wavelength intensity distribution having a wavelength range or center wavelength on the shortest wavelength side among the images represented by the formed image information. Is set to image information representing the first image, and the color information used to color a captured image other than the first image using a color other than “R” is set to the first image. If it is set to the formed image information other than the image information representing, it is possible to display a color close to that of a captured image by visible light.

Further, the irradiation unit 1 can form image information suitable for moving image display by irradiating the subject 4 with intensity modulation of each of the infrared rays 5 with a phase difference.

Further, the irradiation unit may irradiate the subject 4 by modulating the intensity of each of the infrared rays 5 at different frequencies.

Further, when the irradiation unit 1 irradiates the subject 4 with the infrared rays 5 so that each of the infrared rays 5 is not irradiated substantially simultaneously, the color separation is improved.

The display unit 9 further displays each of the images represented by any one of the image information 8 in which the color information is set and the image information 11 in which the color information stored in the image storage unit 10 is set according to the color information. When color is displayed and displayed at the same time, flicker is reduced.

Further, different single colors may be combined with any two or more of “R”, “G”, and “B”.

In addition, the subject is irradiated with infrared rays having different wavelength intensity distributions, and images of subjects with different infrared intensity distributions reflected by the subjects are captured to form image information representing the respective images. Each of the images represented by the image information may be represented by different single colors.

In addition, among the captured images, the first image captured with infrared rays having a wavelength intensity distribution having a wavelength range or center wavelength on the shortest wavelength side is represented by “R”, and other than the first image The captured image may be represented by a color other than “R”.

Further, different single colors may be combined colors of two or more of “R”, “G”, and “B”.

FIG. 4 shows an example in which infrared rays having different wavelength intensity distributions are composed of three different wavelength distributions. Infrared rays having different wavelength intensity distributions may be composed of two or four or more different wavelength intensity distributions.

Infrared rays having different wavelength intensity distributions may be partially overlapped with each other as shown in FIG. Alternatively, there may be no overlap. Further, the different wavelength intensity distributions may have a rectangular wave shape, a Gaussian distribution shape, or a Lorentz distribution shape. Alternatively, it may have a distribution shape, asymmetric distribution, or arbitrary distribution shape.

FIG. 4 also shows the wavelength relationship with ultraviolet light and visible light, but infrared light is located on the longer wavelength side than visible light. The visible rays of purple, blue, green, and red are generally indicated as “V”, “B”, “G”, and “R”, respectively, and ultraviolet rays and infrared rays are indicated as “UV” and “IR”, respectively. And generally displayed. X-rays are located on the shorter wavelength side than ultraviolet rays. Radio waves such as microwaves are located on the longer wavelength side than infrared rays.

Infrared rays or wavelength-modulated infrared rays having such different wavelength intensity distributions are infra-red lamps such as incandescent lamps and other infrared lamps that emit infrared light such as plasma light emission and infrared LED (light emitting diode). It can be generated by a path filter. Moreover, you may produce | generate combining an infrared cut filter in order to remove visible light.

Examples of the infrared bandpass filter include an infrared bandpass filter having various transmission wavelength bands and a combination of a long wavelength transmission filter and a short wavelength transmission filter. A wavelength selective liquid crystal filter or the like may be used.

In addition, a heating element such as an incandescent lamp, a plasma emitting light such as a fluorescent lamp, an infrared lamp emitting infrared rays such as an infrared LED, and a wavelength selective liquid crystal filter with a shutter function may be used.

Further, intensity modulation may be performed by an open / close slit, a chopper, or a shutter.

Further, infrared rays having different wavelength intensity distributions may be formed by using a plurality of LEDs or infrared LEDs that emit infrared rays having different wavelength intensity distributions. FIG. 5 shows an example of the wavelength intensity distribution when three infrared LEDs emitting infrared rays having different wavelength intensity distributions are used.

Further, infrared rays having different wavelength intensity distributions may be formed by using a plurality of LDs (laser diodes) or infrared LDs that emit light beams having different wavelengths. FIG. 6 shows an example in which three infrared LDs that emit infrared rays having different wavelength intensity distributions are used. Since the infrared LD has a narrow emission wavelength range, the wavelength intensity distributions generally do not overlap as shown in FIG.

In addition, you may combine infrared LED and infrared LD.

The intensity may be modulated by blinking the infrared LED or infrared LD.

Note that the intensity modulation may be performed by causing the infrared LED or the infrared LD to emit light while being changed in pulses in time.

In addition, infrared LED or infrared LD, wave shape such as rectangular wave, sine wave, cosine wave, triangular wave, sawtooth wave, their combined wave, their waveform with duty ratio and bias or wave shape such as synthetic wave The intensity may be modulated.

Note that the intensity of emitted light may be modulated by changing the power supplied to the infrared LED or the infrared LD. Alternatively, intensity modulation may be performed by apparently blinking using an open / close slit, chopper, or liquid crystal shutter.

Note that infrared rays having different wavelength intensity distributions may be formed by wavelength-modulating infrared LEDs or infrared LDs. The wavelength modulation may be performed electromagnetically. Further, intensity modulation may be performed.

Note that infrared rays having different wavelength intensity distributions may be generated by a plurality of infrared light sources.

Note that infrared rays having different wavelength intensity distributions may be generated by dividing one or more infrared light sources into a plurality of pieces.

For imaging, a solid-state imaging device using a single element system such as Si or Ge, SiGe, InAs, InSb, PbS, PbSe, InGaAs, or HgCdTe can be used. On the other hand, the long wavelength side of the sensitivity wavelength region of Si is up to around 1200 nm. Therefore, infrared rays having different wavelength intensity distributions may be generated from about 750 nm to about 1200 nm.

In addition, infrared LED thru | or infrared LD can be light-emitted also in the wavelength range in the wavelength range of about 750 nm to about 1600 nm. Therefore, when infrared rays or LDs emit light in the wavelength range of about 750 nm to about 1200 nm to generate infrared rays having different wavelength intensity distributions, compatibility with an imaging device using Si as a solid-state imaging device is good.

In the case of InSb, the sensitivity wavelength region is around 1 μm to 6 μm. Therefore, infrared rays having different wavelength intensity distributions may be generated from the infrared wavelength region therebetween.

In the case of HgCdTe, the sensitivity wavelength region is around 6 μm to 16 μm. Therefore, infrared light having different wavelength intensity distributions may be generated from the infrared wavelength region therebetween, and so on.

Note that the irradiation operation and the imaging operation can also be performed in synchronization.

Note that the irradiation operation, the imaging operation, and the image information forming operation can be performed in synchronization. Furthermore, the operation of setting the color information can be performed in synchronization.

FIG. 7 shows a configuration of an image capturing apparatus according to another embodiment of the present invention. As shown in FIG. 7, the image capturing apparatus according to the present embodiment includes a separation unit 18, an imaging unit 2, and a color specification setting unit 3. The separation unit 18 separates the light beam 19 from the subject 4 into infrared rays having different wavelength intensity distributions. The imaging unit 2 captures an image of the subject 4 with each infrared ray to form image information 7. The color specification setting unit 3 is a table for color-representing a first image captured by infrared rays having a wavelength intensity distribution having a wavelength range or center wavelength closest to the shortest wavelength side among the captured images. The color information is set to the image information 7 representing the first image, and the color information for displaying the captured image other than the first image by other than “R” is the image information other than the image information 7 representing the first image. Is set in the formed image information 7.

FIG. 8 shows an example in which a light beam from a subject is separated into infrared rays having three different wavelength intensity distributions by a separation unit. In addition, you may isolate | separate into the infrared rays which have two or four or more different wavelength intensity distribution.

As shown in FIG. 8, the imaging unit can capture three images of the subject by the first infrared ray, the second infrared ray, and the third infrared ray having three different wavelength intensity distributions separated and formed by the separation unit. I can do it.

Here, the subject generally has a specific infrared reflection characteristic or a specific infrared light emission characteristic for each location of the subject in the infrared region. Thereby, the images of the subject imaged by infrared rays having different wavelength intensity distributions are different from each other. Accordingly, if these different images are displayed separately with different colors or single colors, a color image having a much larger amount of information can be displayed as compared with the single color scale display or the pseudo color scale display.

Further, various objects or various mixtures having forms such as solid, liquid, and gas are assumed as the subject. In this case, a portion that reflects or emits the “R wavelength region” of visible light at each location of the subject may tend to reflect or emit infrared light having a wavelength intensity distribution in a wavelength region close to the “R wavelength region”. Found by the present inventor. Further, the inventors of the present application also found that a portion that does not reflect or emit “R wavelength region” of visible light tends not to reflect or emit infrared light having a wavelength intensity distribution in a wavelength region close to “R wavelength region”. It was done.

Therefore, among the three different images captured by the first infrared ray, the second infrared ray, and the third infrared ray having three different wavelength intensity distributions, the wavelength range or the central wavelength has a wavelength intensity distribution having the shortest wavelength side. Color information for setting the first infrared color by “R” and color other than the first image by “R” is set. When color display is performed in accordance with the color information and reproduction such as display is performed, an infrared color image of a subject that is the same as or similar to a color image obtained by imaging using visible light can be captured.

Note that color information is set such that the first image is represented by “R”, the second image by the second infrared is represented by “G”, and the third image by the third infrared is represented by “B”. In addition, RGB infrared images can be taken.

Note that the color information is set such that the first image is represented by “R”, the second image by the second infrared is represented by “B”, and the third image by the third infrared is represented by “G”. In addition, RGB infrared images can be taken.

Note that color information that sets the color of the first image by “G”, the color of the second image by “B”, and the color of the third image by “R” may be set.

Note that color information that sets the color of the first image by “G”, the color of the second image by “R”, and the color of the third image by “B” may be set.

Note that color information that sets the color of the first image by “B”, the color of the second image by “R”, and the color of the third image by “G” may be set.

Note that color information that sets the color of the first image by “B”, the color of the second image by “G”, and the color of the third image by “R” may be set.

Note that the image capturing apparatus according to the present embodiment illustrated in FIG. 7 may further include a separation unit 18, an imaging unit 2, and a color specification setting unit 3. In this case, the separation unit 18 separates the light beam 19 from the subject 4 into light beams having different wavelength intensity distributions. The imaging unit 2 forms an image information 7 by capturing an image of the subject 4 with light beams having different wavelength intensity distributions. The color specification setting unit represents, by “R”, a first image captured by visible light having “R wavelength region” and infrared light having a wavelength intensity distribution closest to “R wavelength region”. The color information for coloring is set to image information representing the first image, and the color information for representing a captured image other than “R” other than “R” represents the first image. You may set to the formed image information other than image information.

FIG. 9 shows an example in which the light beam from the subject is separated into three light beams having different wavelength intensity distributions by the separation unit. In addition, it is not limited to three, You may isolate | separate into the light ray which has a 2 or 4 or more different wavelength intensity distribution. FIG. 9 also shows an example of the transmittance of the infrared cut filter. As shown in FIG. 9, the infrared cut filter cuts or blocks infrared rays and transmits one or more visible rays and ultraviolet rays.

Further, as shown in FIG. 9, the imaging unit captures three different images of the subject by the first light beam, the second light beam, and the third light beam having three different wavelength intensity distributions separated and formed by the separation unit. I can do it. Then, among the three different images, color information for representing the first image by the “R wavelength region” and the first infrared by “R” is set as image information representing the first image, and “G The color information for displaying the second image by the wavelength region and the second infrared by “G” is set to the image information representing the second image, and the third image by the “B wavelength region” and the third infrared is set. Is set to image information representing the third image. Thus, when color display is performed according to the color information and reproduction such as display is performed, visible light and infrared color images of the subject that are the same as or similar to the image obtained by imaging using visible light can be captured.

In addition, when an infrared cut filter as shown in FIG. 9 is used, imaging with visible light can also be performed.

FIG. 10 shows that the first light beam is composed of the “R wavelength region” and the first infrared light, the second light beam is composed of the “B wavelength region” and the second infrared light, and the third light beam is composed of the “G wavelength region” and the third infrared light. An example is shown. In this case as well, when display or the like is reproduced, a visible light and infrared color image of the subject that is the same as or similar to an image obtained by imaging using visible light can be captured.

The first light beam is composed of the “G wavelength region” and the first infrared light, the second light beam is composed of the “B wavelength region” and the second infrared light, and the third light beam is composed of the “R wavelength region” and the third infrared light. Also good.

The first light beam is composed of the “G wavelength region” and the first infrared light, the second light beam is composed of the “R wavelength region” and the second infrared light, and the third light beam is composed of the “B wavelength region” and the third infrared light. Also good.

The first light beam is composed of the “B wavelength region” and the first infrared light, the second light beam is composed of the “R wavelength region” and the second infrared light, and the third light beam is composed of the “G wavelength region” and the third infrared light. Also good.

The first light beam is composed of the “B wavelength region” and the first infrared light, the second light beam is composed of the “G wavelength region” and the second infrared light, and the third light beam is composed of the “R wavelength region” and the third infrared light. Also good.

In addition, as shown in FIG. 11, you may permeate | transmit the wavelength range which "R wavelength area" and 1st infrared rays continued. Thereby, a brighter image can be taken.

When the first light beam is composed of the “R wavelength region” and the first infrared light, the second light beam is composed of the “G wavelength region” and the second infrared light, and the third light beam is composed of the “B wavelength region” and the third infrared light. , The wavelength range in which the “R wavelength range” and the wavelength range of the first infrared ray are continuous may be transmitted.

The imaging unit may further include a plurality of pixels, and the separation unit may be attached to each of the plurality of pixels.

Infrared rays from the subject are separated into infrared rays having different wavelength intensity distributions, and an image of the subject is taken by each infrared ray having different wavelength intensity distributions. Among the taken images, the wavelength range or the center wavelength is the shortest wavelength. The first image captured by infrared rays having the wavelength intensity distribution on the side may be represented by “R”, and the captured image other than the first image may be represented by other than “R”.

A light beam from a subject is separated into light beams having different wavelength intensity distributions, and an image of the subject is captured by each light beam having different wavelength intensity distributions. A visible light beam having an “R wavelength region” among the captured images. In addition, the first image captured by infrared rays having the wavelength intensity distribution closest to the “R wavelength region” is represented by “R”, and the captured image other than the first image is represented by other than “R”. Also good.

[Example 1]
FIG. 12 shows Embodiment 1 of an image capturing device and an image capturing method according to the present invention. As shown in FIG. 12, the CCD camera 2-2 which is an imaging unit uses an NTSC video signal 20 on which the 0th image information and the first imaging operation start signal are superimposed, as an information separation unit 12 constituting the control processing unit 12. -2. The information separation unit 12-2 separates the odd / even field signal 21 serving as the imaging operation start signal from the NTSC video signal 20. Then, the data is sent to the control processor 12-3 constituting the control processor 12.

Next, the control processing processor 12-3 sends a first irradiation operation start instruction signal 14-2-1 to the irradiation switching unit 1-2 configuring the irradiation unit 1. The irradiation switching unit 1-2 emits the first infrared LED 1-3-1 and irradiates the subject 4 with the first infrared 5-2-1.

The CCD camera 2-2 captures the first image from the first infrared ray 6-2-1 reflected by the subject 4 to generate first image information, and the first image information and the second imaging operation start signal are received. The superimposed NTSC video signal 20 is sent to the information separation unit 12-2 and the color specification setting unit 3. The information separator 12-2 separates the odd / even field signal 21 from the NTSC video signal 20 and sends it to the control processor 12-3. The control processor 12-3 sends the first color specification setting instruction signal 15-2-1 to the color specification setting unit 3. The color specification setting unit 3 sends the first image information in the NTSC video signal 20 to the display unit 9 as image information 8-2-1 that enables color display using the first color. The display unit 9 displays the first image with the first color.

In the NTSC video signal 20, when the main part of the image information and the main part of the imaging operation start signal are shifted in time, the image information is obtained from the NTSC video signal 20 sent to the color setting unit 3. It is not always necessary to separate them. However, the image information can also be separated from the NTSC video signal 20.

Next, the control processor 12-3 sends a second irradiation operation start instruction signal 14-2-2 to the irradiation switching unit 1-2 configuring the irradiation unit 1. The irradiation switching unit 1-2 causes the second infrared LED 1-3-2 to emit light and irradiates the subject 4 with the second infrared ray 5-2-2.

Further, the CCD camera 2-2 captures a second image from the second infrared ray 6-2-2 reflected by the subject 4 to generate second image information, and the second image information and the third imaging operation start signal are received. The superimposed NTSC video signal 20 is sent to the information separation unit 12-2 and the color specification setting unit 3. The information separator 12-2 separates the odd / even field signal 21 from the NTSC video signal 20 and sends it to the control processor 12-3. The control processor 12-3 sends the second color specification setting instruction information 15-2-2 to the color specification setting unit 3. The color setting unit 3 sends the second image information in the NTSC video signal 20 to the display unit 9 as image information 8-2-2 that enables color display by the second color. The display unit 9 displays the second image with the second color.

Next, the control processing processor 12-3 sends a third irradiation operation start instruction signal 14-2-3 to the irradiation switching unit 1-2 configuring the irradiation unit 1. The irradiation switching unit 1-2 causes the third infrared LED 1-3-3 to emit light and irradiates the subject 4 with the third infrared ray 5-2-3.

Further, the CCD camera 2-2 captures a third image from the third infrared ray 6-2-3 reflected by the subject 4, generates third image information, and the third image information and the 0th imaging operation start signal are received. The superimposed NTSC video signal 20 is sent to the information separation unit 12-2 and the color specification setting unit 3. The information separator 12-2 separates the odd / even field signal 21 from the NTSC video signal 20 and sends it to the control processor 12-3. The control processor 12-3 sends the third color setting instruction information 15-2-3 to the color setting unit 3, and the color setting unit 3 converts the third image information in the NTSC video signal 20 into the third color information. It is sent to the display unit 9 as image information 8-2-3 that can be represented by three colors. The display unit 9 displays the third image with the third color. By such an operation, the image of the subject 4 expressed by the first to third colors can be displayed on the display unit 9.

The lens 2-3 forms infrared rays 6-2-1 to 6-2-3 on the imaging surface or pixels of the CCD camera 2-2.

Note that the first to third colors may correspond to “R”, “G”, and “B”, respectively. Alternatively, the first to third colors can correspond to “R”, “B”, and “G”, respectively. Alternatively, the first to third colors may correspond to “G”, “B”, and “R”, respectively. Alternatively, the first to third colors may correspond to “G”, “R”, and “B”, respectively. Alternatively, the first to third colors may correspond to “B”, “R”, and “G”, respectively. Alternatively, the first to third colors may correspond to “B”, “G”, and “R”, respectively.

Note that a camera with simultaneous transfer specifications for all pixel signals, such as a CCD camera, can be used for the imaging unit. The CCD camera may be a monochrome CCD camera or a color CCD camera. Further, if the CMOS camera has the all-pixel signal simultaneous transfer specification, it can be handled in the same way as a CCD camera. If each pixel is provided with a memory, all pixel signal simultaneous transfer specifications can be achieved.

Note that an RGB color monitor can be used for the display unit 9. In addition, the image information 8-2-1 to 8-2-3 that can be displayed in color can be reconstructed into an NTSC video signal using an RGB encoder and displayed on an NTSC video color monitor.

FIG. 13 shows a timing chart of Embodiment 1 of the image capturing device and the image capturing method according to the present invention. In FIG. 13, in order from the top, the vertical synchronization signal, the odd and even field signal, the first irradiation time range, the second irradiation time range, the third irradiation time range, the first image display time range, the second image display time range, A three-image display time range is shown. In the first irradiation time range, the second irradiation time range, the third irradiation time range, the first image display time range, the second image display time range, and the third image display time range, the time to rise from the horizontal line along the vertical line , Indicates the start time of each range, and the time descending vertically from the horizontal line along the vertical line indicates the end time.

As shown in FIG. 13, the first to third infrared rays are irradiated to the subject in the first to third irradiation time ranges according to the odd and even field signals, respectively, and the first to third image display time ranges are respectively changed from the first to third image display time ranges. A third image is displayed. At this time, the first image is displayed with the first color, the second image is displayed with the second color, and the third image is displayed with the third color. An infrared image of the subject can be displayed in the first to third colors. If the first color, the second color, and the third color are “R”, “G”, and “B”, they can be displayed in RGB color.

Although the vertical synchronization signal is also shown in FIG. 13, a vertical synchronization signal that can be separated by the information separation unit may be used instead of the odd / even field signal.

In FIG. 13, generally, the frequency of the vertical synchronizing signal in the NTSC video signal is about 60 Hz, and the frequency of the rectangular wave of the odd-even field signal is about 30 Hz. In this case, the first to third images are alternately and repeatedly displayed at a frequency of about 20 Hz, and are recognized as a color image by human eyes. If the subject and the imaging unit are not moving relatively, they are displayed as a color still image, and if they are moving, a color moving image is displayed.

In FIG. 13, the duty ratio of each irradiation time range is set as irradiation: non-irradiation = 1: 2. The phase difference is set so that each irradiation is performed in different time ranges. This improves color separation. However, it is possible to obtain a color image without necessarily doing so. Each rectangular wave may not be a strict rectangular wave.

In FIG. 13, the first to third images are displayed with a time delay of one field compared to the first to third irradiations. That is, for example, in the first irradiation time range, the third image one field before is displayed on the color monitor.

In FIG. 13, one odd field or one even field of odd and even fields is used as one operation unit for irradiation operation and image display operation. However, a plurality of fields may be used as one operation unit. One frame including one odd field may be used as one operation unit, and a plurality of frames may be used as one operation unit.

A normal NTSC video signal is interlaced at a field rate of 60 Hz or a frame rate of 30 Hz, but the same operation may be performed by increasing the field rate or the frame rate, or a non-interlaced display such as progressive scan may be performed. . As the display rate is increased, a color still image or color moving image with less flicker is obtained.

FIG. 14 is a timing chart in the case of a camera having a pixel signal sequential readout specification such as a CMOS camera as an imaging unit in the image capturing apparatus and the image capturing method according to the present embodiment. In FIG. 14, as in FIG. 13, in order from the top, the vertical synchronization signal, the odd / even field signal, the first irradiation time range, the second irradiation time range, the third irradiation time range, the first image display time range, the second An image display time range and a third image display time range are shown.

The subject is sequentially irradiated with the first to third infrared rays in synchronization with the odd field signal or even field signal of the NTSC video signal. That is, as shown in FIG. 14, the first infrared field is irradiated into the first odd field of the NTSC video signal, the second infrared field is irradiated into the next second odd field, and the third infrared field is irradiated into the third odd field. , The first infrared ray is emitted in the fourth odd field, the second infrared ray is emitted in the fifth odd field, and so on. In the even field, the first to third infrared rays are not irradiated to the subject.

The odd field may be replaced with the even field. Alternatively, a plurality of fields may be set as one operation unit. Alternatively, one frame or a plurality of frames may be set as one operation unit.

In FIG. 14, the duty ratio of each irradiation time range is irradiation: non-irradiation = 1: 5, the first to third infrared irradiations are performed in different time ranges, and the field at the time of irradiation and the field of inverse parity are used. The non-irradiation time range is set in. When all pixel signals are read out during the non-irradiation time range, color separation is improved. However, it is possible to obtain a color image without necessarily doing so. Note that the respective infrared irradiation time ranges may overlap. In this case, color separation generally decreases.

Similarly, the first to third colors may correspond to “R”, “G”, and “B”, respectively.

The CMOS camera may be a monochrome CMOS camera or a color CMOS camera.

Further, the same operation may be performed by switching the infrared irradiation for each of a plurality of even fields or a plurality of odd frames. The same operation may be performed by switching the infrared irradiation by increasing the field or frame rate.

The above is an example in the case of an NTSC video signal, but a video signal of another standard such as a PAL signal may be used.

The above is an example applicable to the “R”, “G”, and “B” color specifications. It can also be applied when two single colors are used. That is, when the wavelength range or the center wavelength of the first infrared ray is shorter than that of the second infrared ray, “R”, “G” or “R” “B” in order of irradiation of the first and second infrared rays. When assigned, a color image that is the same as or approximate to the image information obtained by imaging using visible light is obtained. Note that “G”, “B”, “G”, “R”, “B”, “R”, or “B”, “G” may be assigned in this order.

Further, in the case of RGB color specification, if the wavelength range of infrared rays or the center wavelength is assigned in the order of “R”, “G”, “B” or “R”, “B”, “G”, the display is reproduced. In this case, a color image that is the same as or approximate to the image information obtained by imaging using visible light is obtained. Note that “G”, “B”, “R”, “G”, “R”, “B”, “B”, “R”, “G”, or “B”, “G”, and “R” may be assigned in this order.

One or more of the control processing unit, the irradiation unit, the imaging unit, and the color specification unit, that is, one or more of the control processing unit, the irradiation unit, the imaging unit, and the color specification unit are stabilized by a PLL (Phase Lock Loop). May be.

[Example 2]
FIG. 15 shows Embodiment 2 of an image capturing device and an image capturing method according to the present invention. In FIG. 15, components other than the color specification setting unit 3, the image storage unit 10, and the display unit 9 are omitted. As shown in FIG. 15, the image storage unit 10 further includes an A / D (Analog Digital) converter 22, an image memory 23, and a D / A (Digital Analog) converter 24.

Here, the color specification setting unit 3 sequentially displays the first to third image information 8-2-1 to 18-2-3 in which the color specification information is set for each field through the display unit 9 and the image storage unit 10. It sends to the A / D converter 22 which comprises. The A / D converter 22 converts the first to third image information 8-2-1 to 8-2-2 into digital data, and sequentially converts the first to third digital image information 25-1 to 25-3 into an image memory. 23. The image memory 23 stores the first to third digital image information 25-1 to 25-3.

Next, the image memory 23 sends the first to third digital image information 25-1 to 25-3 to the D / A converter 24. The D / A converter 24 converts the first to third digital image information 25-1 to 25-3 into analog signals and stores the first to third image information 11 stored in the image storage unit in which the color information is set. 2-1 to 11-2-3 are sent to the display unit 9.

Here, the display unit 9 includes first image information 11-2-1 and second image information 11-2-2, respectively.
And the third image information 8-2-3, the first, second and third images are respectively displayed in the first, second and third colors and displayed simultaneously.

Next, the display unit 9 uses the second image information 11-2-2, the third image information 11-2-3, and the first image information 8-2-1, respectively, for the second, third, and first images. Are respectively displayed in the second, third and first colors and displayed simultaneously.

Next, the display unit 9 uses the third image information 11-2-3, the first image information 11-2-1, and the second image information 8-2-2, respectively, to generate the third, first, and second images. Are respectively displayed in the third, first and second colors and displayed simultaneously. By such an operation, it is possible to display a color image of a subject with less flicker.

As in the first embodiment, “R”, “G”, and “B” can be used as the first to third colors, respectively.

Note that a camera with simultaneous transfer specifications for all pixel signals, such as a CCD camera, can be used for the imaging unit. A CMOS camera with a pixel signal sequential transfer specification may be used. The CCD camera may be a monochrome CCD camera or a color CCD camera. The CMOS camera may be a monochrome CMOS camera or a color CMOS camera. If the CMOS camera has the all-pixel signal simultaneous transfer specification, it can be handled in the same way as a CCD camera. If each pixel is provided with a memory, it is possible to make the CMOS camera have all pixel signal simultaneous transfer specifications.

The image storage unit can be configured using a video decoder, video encoder, FPGA, PLD, CPLD, DSP, SDRAM, field memory, frame memory, recursive filter, and the like.

FIG. 16 shows a timing chart of Embodiment 2 of the image capturing device and the image capturing method according to the present invention. FIG. 16 is an example in the case of using a camera with all pixel signal simultaneous transfer specifications such as a CCD camera. In FIG. 16, from the top, the vertical synchronization signal, the odd-even field signal, the first irradiation time range, the second irradiation time range, the third irradiation time range, the first image display time range, the second image display time range, 3 image display time range, first image display time range by first image information set with color specification information stored in image storage unit, second image information set with color specification information stored in image storage unit 2 shows a second image display time range, and a third image display time range by the third image information in which the color information stored in the image storage unit is set.

As shown in FIG. 16, for example, the first image based on the first image information in which the color specification information stored in the image storage unit is set, and the second image information in which the color specification information stored in the image storage unit is set. The third image based on the second image and the third image information in which the color information is set is represented by the first, second, and third colors and displayed simultaneously. By such an operation, an infrared image of a subject with less flickering can be displayed.

FIG. 17 shows a timing chart in the case of using a pixel signal sequential transfer specification camera such as a CMOS camera in the second embodiment of the image capturing apparatus and method according to the present invention. In FIG. 17, from the top, the vertical synchronization signal, the odd and even field signal, the first irradiation time range, the second irradiation time range, the third irradiation time range, the first image display time range, the second image display time range, 3 image display time range, first image display time range by first image information set with color specification information stored in image storage unit, second image information set with color specification information stored in image storage unit 2 shows a second image display time range, and a third image display time range by the third image information in which the color information stored in the image storage unit is set. Similarly, an infrared image of a subject with less flicker can be displayed by the operation shown in FIG.

[Example 3]
FIG. 18 shows Embodiment 3 of an image capturing device and an image capturing method according to the present invention. As illustrated in FIG. 18, the separation units 32-1 to 32-3 are arranged on the pixels 31-1-1 to 31-1-4 and 31-n-1 to 31-n-4 of the imaging unit, respectively. Are configured to be respectively deposited. Here, “n” represents a positive integer.

In FIG. 18, a light beam from a subject is imaged on an imaging surface composed of a plurality of pixels, and is separated into a plurality of light beams as shown in FIG. −1 transmits the “R wavelength region” and the first light beam including the first infrared ray, and the second separation unit 32-2 transmits the “G wavelength region” and the second light beam including the second infrared ray, The third separation unit 32-3 transmits the third light beam including the “B wavelength region” and the third infrared ray. The first images picked up by the pixels 31-1-1 to 31-n-1 are color-coded by “R”, and the pixels 31-1-2 to 31-n-2 and the pixels 31-1-3 are displayed. The second image captured by 31-n-3 is displayed by “G”, and the third image captured by pixels 31-1-4 to 31-n-4 is displayed by “B”. To do. Thereby, a color image of the subject can be obtained.

In FIG. 18, in order to form a light ray from a subject on a pixel and separate it into light rays as shown in FIG. The first light beam including the “R wavelength region” and the first infrared ray is transmitted, and the second separation unit 32-2 transmits the third light beam including the “G wavelength region” and the third infrared ray, and the third separation unit 32- 3 may transmit a “B wavelength region” and a second light beam including a second infrared ray. The first images picked up by the pixels 31-1-1 to 31-n-1 are color-coded by “R”, and the pixels 31-1-2 to 31-n-2 and the pixels 31-1-3 are displayed. The second image captured by 31-n-3 is displayed by “G”, and the third image captured by pixels 31-1-4 to 31-n-4 is displayed by “B”. May be. Thereby, a color image of the subject can also be obtained.

Note that there are many such combinations, and imaging may be performed with combinations other than those described above.

In addition, for example, the pixels 31-1-3 to 31-n-3 can be used to capture a color image of a subject without attaching a separation unit or by attaching a member that transmits white light. . There are many such combinations, and imaging may be performed with combinations other than those described above.

[Example 4]
FIG. 19 shows Embodiment 4 of an image capturing device and an image capturing method according to the present invention. As shown in FIG. 19, the separation unit includes two dichroic plate filters. For example, in order to obtain a subject image by separating the light rays from the subject into a plurality of light rays as shown in FIG. 9, the light rays from the subject are incident on the first dichroic plate filter, and the first dichroic plate filter is The first image picked up by reflecting the “R wavelength region” and the first light beam including the first infrared ray is represented by “R”. Further, the transmitted light beam is incident on the second dichroic plate filter, and the second dichroic plate filter reflects the second light beam including the “G wavelength region” and the second infrared ray to obtain the imaged second image as “G”. Color by. The third image captured from the transmitted “B wavelength region” and the third light beam including the third infrared light is represented by “B”. A color image of the subject can be obtained by displaying in such a color.

Note that there are many such combinations, and imaging may be performed with combinations other than those described above.

FIG. 20 shows an example of reflection characteristics of the first and second dichroic plate filters according to the fourth embodiment of the image capturing device and the image capturing method of the present invention. As shown in FIG. 20, not only the first dichroic plate filter but also the second dichroic plate filter, the infrared region and the visible light region in the reflection wavelength band may be continuous.

Because the first light beam including the “R wavelength region” and the first infrared ray is reflected by the first dichroic plate filter, the “R wavelength region” and the first infrared ray are reflected on the second light beam reflected by the second dichroic plate filter. The first light beam that is included is not included. Further, the third light beam transmitted through the second dichroic plate filter does not include the “R wavelength region” and the first light beam including the first infrared ray, and the “G wavelength region” and the second light beam including the second infrared ray.

An imaging unit can be installed at a position where the first to third light rays reach.

If a glass material such as BK7 is used for the dichroic plate filter, almost no ultraviolet rays are transmitted. Further, an ultraviolet cut filter may be provided on the incident port side of the first dichroic plate filter, or an ultraviolet cut filter, a color filter, or a trimming filter may be provided on the incident port side of the imaging unit.

[Example 5]
FIG. 21 shows Embodiment 5 of an image capturing device and an image capturing method according to the present invention. As shown in FIG. 21, a composite prism including three dichroic prism filters is used as the separation unit.

In FIG. 21, in order to obtain the image of the subject by separating the light rays from the subject into, for example, the light rays as shown in FIG. 9, the light rays from the subject are incident on the first dichroic prism filter, and the “R wavelength region” is obtained. The first light beam including the first infrared ray is reflected twice by the inner surface of the first dichroic prism filter and emitted to the outside, and the captured first image is represented by “R”. Further, the transmitted light beam is incident on the second dichroic prism filter, and the second light beam including the “G wavelength region” and the second infrared ray is reflected twice by the inner surface of the second dichroic prism filter and emitted to the outside. The second image is represented by “G”. Further, the transmitted light beam is incident on the third dichroic prism filter, and the third light beam including the “B wavelength region” and the third infrared ray is emitted to the outside without being reflected by the inner surface of the third dichroic prism filter. The third image is represented by “B”. A color image of the subject can be obtained by displaying in such a color.

An imaging unit can be installed at a position where the first to third light rays reach.

Note that there are many such combinations, and imaging may be performed with combinations other than those described above.

If a glass material such as BK7 is used for the dichroic prism filter, almost no ultraviolet rays are transmitted. Further, a color filter or a trimming filter may be provided on the exit side of each dichroic prism filter or on the entrance side of the imaging unit.

[Example 6]
FIG. 22 shows Embodiment 6 of an image capturing device and an image capturing method according to the present invention. As shown in FIG. 22, infrared LED groups 51-1 to 51-3 individually configured by first to third infrared LEDs 50-1 to 50-3 that emit first to third infrared rays are It is arranged in a circle on the surface. A CCD camera 52 with a lens is disposed at the center. The color specification setting unit and the control processing unit are arranged inside the case 53.

Here, the first to third infrared rays are irradiated to the subject from the infrared LED groups 51-1 to 51-3, and the CCD camera 52 captures an image of the subject from the first to third infrared rays reflected by the subject.

22 is an example in which the infrared LEDs 50-1 to 50-3 are individually grouped into three infrared LED groups 51-1 to 51-3 and arranged in three places. The infrared LEDs 50-1 to 50-3 may be mixedly arranged or randomly arranged.

[Example 7]
FIG. 23 shows Embodiment 7 of an image capturing device and an image capturing method according to the present invention. As shown in FIG. 23, an infrared LED group 54 composed of first to third infrared LEDs 50-1 to 50-3 that radiate first to third infrared rays is arranged in a circle on the surface of a case 55, and the lens The attached CCD camera 52 is enclosed in another case 56. Further, a color specification setting unit and a control processing unit are arranged inside the case 55. In addition, if an RGB encoder is incorporated, a reconstructed NTSC video signal can be output.

Here, the subject is irradiated with infrared rays from the infrared LED group 54, and the CCD camera 52 takes an image of the subject from the first to third infrared rays reflected by the subject. The CCD camera 52 may not be put in the case.

Here, the NTSC video signal from the CCD camera 52 is sent into the case 55 through the cable 57, and an operation is performed based on the NTSC signal received by the color specification setting unit and the control processing unit in the case 55, and the RGB video signal or A reconstructed NTSC video signal is output from cable 58 and sent to the monitor. Electric power is supplied by the cable 59 and the cable 60, respectively.

[Example 8]
FIG. 24 shows Embodiment 8 of the image capturing device and the image capturing method according to the present invention. As shown in FIG. 24, the infrared LED group 54 is circularly arranged on the surface of the case 62, and a CCD camera 52 with a lens is enclosed in another case 63.

Here, the subject is irradiated with infrared rays from the infrared LED group 54, and the CCD camera 52 takes an image of the subject from the first to third infrared rays reflected by the subject. Although the control processing unit is arranged inside the case 62, the infrared sensor 61 receives the irradiation operation start signal superimposed on the infrared rays emitted from the infrared LED group 54 and is arranged inside the case 63. The image is sent to another control processing unit, and the imaging operation is started. The color setting unit is included in the case 63. If the RGB encoder is built in the case 63, a reconstructed NTSC video signal can be output from the cable 64. An RGB video signal may be output. Electric power is supplied by the cable 59 and the cable 60, respectively.

[Example 9]
FIG. 25 shows Embodiment 9 of an image capturing device and an image capturing method according to the present invention. A first to third infrared ray is irradiated on the subject 4 from a case 65 including a control processing unit and an irradiating unit installed on an upper part of the ceiling or the like, and the first to third infrared rays reflected by the subject 4 are used for the case 66. The infrared sensor, the control processing unit, the imaging unit, and the color specification setting unit included in the unit perform predetermined operations. In addition, the infrared ray exit side of the case 65 is formed of a member that transmits infrared rays.

[Experiment 1]
FIG. 26 shows Experimental Example 1 for explaining the color specification and additive color mixture of the image capturing apparatus and the image capturing method according to the present invention. Here, FIG. 26A-1 is a first image captured by irradiating the first infrared, and FIG. 26A-2 is a second image captured by irradiating the second infrared, FIG. 26 (a-3
) Is a third image captured by irradiating the third infrared ray. Each image shows the intensity of reflected infrared rays and is displayed in gray scale. The first image, the second image, and the third image are images of the same subject, but are different because the infrared reflection characteristics differ depending on the wavelength.

The first infrared ray was generated by an LED that radiates a central wavelength of 780 nm and an average power of about 5.7 mW. The second infrared ray was generated by an LED emitting a center wavelength of 870 nm and an average power of about 6.1 mW. The third infrared ray was generated by an LED emitting a center wavelength of 940 nm and an average power of about 4.5 mW. The full width at half maximum of the wavelength intensity distribution was about 50 nm. The distance between the irradiation unit and the subject was about 30 cm, and the distance between the imaging unit and the subject was about 20 cm. The subject illuminance in the visible light region was approximately 0 lux.

26 (a-1-2) is a first image in which FIG. 26 (a-1) is color-coded by “R”, and FIG. 26 (a-2-2) is FIG. -2) is a second image displayed with "B" in color, and FIG. 26 (a-3-2) is a third image displayed with "G" in FIG. 26 (a-3). It is. In FIG. 26, the intensity of each reflected infrared ray is shown on a monocolor scale based on the brightness of each single color.

FIG. 27 (b-1) shows a color image obtained by additively mixing FIGS. 26 (a-1-2), 26 (a-2-2), and 26 (a-3-2). FIG. 27B-1 shows an infrared color image having single colors “R”, “G”, and “B”.

FIG. 27B-2 is a gray image obtained by adding the brightness of each corresponding position in the images of FIGS. 26A-1, 26A-2, and 26A-3. It is a scale image. That is, it corresponds to an image obtained by conventional infrared imaging.

FIG. 27B-3 shows the image of FIG. 27B-2 on a conventional pseudo color scale.

FIG. 27B-4 shows a color image captured by a conventional color CCD camera under illumination of about 450 lux.

As shown in FIG. 27, as compared with each of FIG. 26 or FIG. 27 (b-2) and FIG. 27 (b-3), FIG. 27 (b-1) is clearer and has a larger amount of information. Is the closest to FIG. 27 (b-4).

FIG. 28 shows Experimental Example 1 in the case where the color specification method is variously changed. Here, FIG. 28A shows an infrared color image obtained by additively mixing the first to third images in the order of “R”, “G”, and “B”. FIG. 28B shows an infrared color image obtained by additively mixing the first to third images in the order of “R”, “B”, and “G”. FIG. 28C shows an infrared color image obtained by additively mixing the first to third images in the order of “G”, “B”, and “R”. FIG. 28D shows an infrared color image obtained by additively mixing the first to third images in the order of “G”, “R”, and “B”. FIG. 28E shows an infrared color image in which the first to third images are color-coded in the order of “B”, “R”, and “G” and additively mixed. FIG. 28F shows an infrared color image obtained by additively mixing the first to third images in the order of “B”, “G”, and “R”. Here, it can be seen that FIG. 28 (a) or FIG. 28 (b) has a color close to that of FIG. 27 (b-4).

Each image in FIG. 27B-1 and FIG. 28 can be displayed as a moving image on a monitor, and can also be recorded as a moving image with a frame rate of 30 fps. At that time, when the frame rate was lowered to 10 fps by using a recursive filter, a moving image with less flicker could be obtained. It is also possible to obtain a moving image of substantially 30 fps using a recursive filter.

Further, when other subjects were imaged by the image capturing apparatus and the image capturing method according to the present invention, the color specification conditions in FIGS. 27 (b-1) and 28 (b) are the color specifications in FIG. 28 (a). There was a tendency to better reproduce the color of the subject under the visible line.

In that case, I was able to reproduce the skin color of human faces and hands well, and the color of the hair was also able to be reproduced naturally in black. The gloss of the metal was also well reproduced.

Furthermore, when corrections were made by adjusting parameters such as color balance, hue, brightness, contrast, and gamma correction, it was possible to match the color image of the subject under visible light. In addition, the image can be displayed with the color emphasized by image processing such as taking a difference between the images.

Hereinafter, a description of the principle of the present invention will be added. Each substance exhibits a unique color or spectrum. Its color or spectrum is determined by the reflectance, absorption or transmission of the material. In terms of electronic properties, the reflectance, absorption rate, or transmittance depends on the interaction between the charge on the surface of the substance or in the substance and photons. When the fundamental absorption edge or interband transition energy level specific to a substance is in the visible light range, it exhibits a reflectance, absorption rate, or transmittance that changes in the visible light range. Recognized.

In addition, when chemically synthesizing a pigment that is a base of a paint or pigment exhibiting a certain color, the absorption edge or band transition energy level is increased or decreased by exchanging atoms or molecules with the substrate, or impurities are mixed. The absorption band or the transition energy level between the bands is added, and thereby a dye exhibiting a desired color can be synthesized.

Here, for example, in the case of an optical filter composed of a uniform material, the color of light transmitted through the filter is determined by the transmittance of the material, and the color of light reflected from the filter is determined by the reflectance of the material. . On the other hand, in the case of a filter containing fine particles in a transparent medium, the transmitted light and reflected light are included not only in the irregular reflection of the fine particle surface but also in the transmitted light and reflected light. Often referred to as rate and diffuse reflectance. In the case of a filter containing fine particles in a non-transparent medium, the wavelength intensity distribution (color) of light transmitted through the filter is determined by the transmittance of the medium, the reflectance of the fine particles, and the diffuse reflectance.

There is a typical long wavelength transmission filter in which fine particles of semiconductor or metal are dispersed in glass. For example, when CdS is mixed with glass and heat treatment is performed, CdS fine particles having a uniform size are generated in the glass. Due to the exciton confinement effect, the position of the absorption edge of the CdS fine particles changes depending on the size of the fine particles. The size of the fine particles can be controlled by the heat treatment conditions.

In the case of paints or pigments, the reflectance of the material to be applied, the reflectance and transmittance of the medium constituting the paint or pigment (because there is reflection depending on the material to be applied), the fine particles constituting the paint or pigment The color of paint or pigment is determined by the reflectance and diffuse reflectance.

[Experiment 2]
FIG. 29 shows an example of the relative reflectance of materials made of the same resin base material and exhibiting blue “B”, green “G”, and red “R”, respectively. As can be seen in FIG. 29, wavelength regions with high reflectivity corresponding to “B”, “G”, and “R” can be seen in the visible light region. Corresponding to On the other hand, a structure having a specific reflectance is also seen in the infrared region.

Here, comparing the shapes of the intensity distributions of the reflectance in the wavelength region of 375 nm to 1100 nm in the curves “B” and “G”, it can be seen that they are in a relationship of shapes that are almost parallel to each other. This is considered to be an example showing the above-described “increase / decrease or shift of the absorption edge or interband transition energy level”. In addition, it can be seen that the structure in the visible light region and the structure in the infrared region are moved in parallel.

FIG. 30 shows a diagram in which data obtained by multiplying the data represented by each curve in FIG. 29 by the data representing the light receiving sensitivity example of the silicon photodetector in FIG. 33 is normalized by each maximum value. That is, FIG. 30 shows a case where reflected light when a white light is irradiated on a material exhibiting blue “B”, green “G”, and red “R” is detected by a silicon photodetector, and each signal is detected at each maximum value. Corresponds to the normalized relative detection rate.

As shown in FIG. 30, the material exhibiting red “R” has a wavelength region with a high relative detection rate in “IR1”, and the material exhibiting green “G” has a high relative detection rate in “IR3”. It can be seen that a material having a wavelength region and exhibiting blue “B” has a wavelength region with a high relative detection rate in “IR2”.

Therefore, a material having a wavelength region with a high relative detection rate in “IR1” exhibits red “R”, a material having a wavelength region with a high relative detection rate in “IR2” exhibits blue “B”, and “IR3” It can be estimated that a material having a wavelength region with a high relative detection rate exhibits a green “G”. That is, the result of visible reflection measurement, that is, the color of the material can be estimated by infrared reflection measurement.

That is, in the infrared rays from the subject, an image obtained by imaging infrared rays corresponding to “IR1” is represented by “R”, an image obtained by imaging infrared rays corresponding to “IR2” is represented by “B”, and “IR3” The color of the material under the visible line can be reproduced by displaying the image obtained by imaging the infrared ray corresponding to “G” with “G”.

Also, an image obtained by irradiating the subject with infrared light corresponding to “IR1” and imaging light reflected from the subject is represented by “R”, and the subject is irradiated with infrared light corresponding to “IR2” and reflected from the subject. An image obtained by capturing light is represented by “B”, and an image obtained by irradiating the subject with infrared light corresponding to “IR3” and reflected from the subject is represented by “G”. You can reproduce the color of the material.

[Experiment 3]
FIG. 31 (a) is an image of symbols and characters drawn using green, red, and blue paints on black paper as an object under the light of a fluorescent lamp that mainly emits visible light. (B) shows the same subject imaged and displayed by the image photographing apparatus according to the present invention under substantially the same conditions as in FIGS. 27 (b-1) and 28 (b).

Comparing FIG. 31 (a) and FIG. 32 (b), it is possible to obtain a color image that is the same as or similar to an image obtained by imaging a subject using visible light by imaging with the imaging apparatus according to the present invention. I understand that. That is, it can be seen that the color of the subject under visible light can be reproduced by imaging with the imaging apparatus according to the present invention using infrared irradiation.

[Example 10]
In order to detect the intensity of each infrared ray as shown in FIG. 4, FIG. 5, or FIG. 8, it is possible to devise a combination of an optical filter and a detector. As an example of the combination, FIG. 32 shows three long-wavelength transmission filters, and FIG. 33 shows an example of light receiving sensitivity of the silicon photodetector used in this embodiment. Further, FIG. 34 shows data obtained by normalizing the data obtained by multiplying the data representing each curve in FIG. 32 and the data representing the curve in FIG. 33 with each maximum value. Also in this case, it can be seen that each detected infrared intensity is separated into an infrared wavelength range similar to FIG. 4, FIG. 5 or FIG.

[Example 11]
FIG. 35 shows another example of the optical filter. Here, “B”, “G”, and “R” are transmitted in the visible light region, respectively, and “second infrared”, “third infrared”, and “first infrared” are transmitted in the infrared region, respectively. An example of a filter is shown. Further, FIG. 36 shows a diagram obtained by multiplying the data representing the respective curves in FIG. 35 by the data representing the curves in FIG. 33 and normalizing the maximum peak structure value in the infrared region.

[Example 12]
FIG. 37 shows an example of measuring the transmittance of another optical filter. Examples of filters that transmit “B” and “second infrared”, “G” and “third infrared”, and “R” and “first infrared”, respectively. Here, the case where “R” and “first infrared” are continuous is shown. In addition, an example of the transmittance of the infrared cut filter (IR-cut) is also shown. The infrared cut filter is preferably used when only a visible light region is transmitted and a visible light image is captured.

[Examples 13 to 17]
38 to 42 show examples of combinations of light receiving sensitivities of each optical filter and a silicon image sensor as a photodetector. Each optical filter may be switched depending on the photographing conditions.

Since the present invention can capture, display, and store color still images and color moving images of subjects in the dark, it can be used for surveillance or security as a camera such as a night vision camera.

DESCRIPTION OF SYMBOLS 1 Irradiation part 1-2 Irradiation switching part 1-3-1-3 1st-3rd infrared LED
2 Imaging unit 2-2 CCD camera 2-3 Lens 3 Color setting unit 4 Subject 5 Infrared ray 6 Infrared ray 5-2-1-3 First to third infrared rays 6-2-1-3 First to third infrared rays 7 Image information 8 Image information 8-2-1 to 1-3 First to third image information 9 Display unit 10 Image storage unit 11 Image information 11-2-1 to 1-3 First to third image information 12 Control processing unit 12-2 Information separation unit 12-3 Control processor 13 Imaging operation start signal 14 Irradiation operation start instruction signal 14-2-1 to First to third irradiation operation start instruction signal 15 Colorimetric setting operation start instruction signal 15-2-1 -3 First to third color setting operation start instruction signal 16 Display operation start instruction signal 17 Storage operation start instruction signal 18 Separation unit 19 Ray 20 NTSC video signal 21 Odd / even field signal 22 A / D converter 23 Image memory 24 D / Converter 25-1-3 First to third digital image information 31-1-1 to 4-31-n-1-4 Pixel 32-1-3 First to third separation unit 50-1-3-1 To 3rd infrared LED
51-1 to 3rd infrared LED group 52 CCD camera 53 case 54 infrared LED group 55 case 56 case 57 cable 58 cable 59 cable 60 cable 61 infrared sensor 62 case 63 case 64 cable 65 case 66 case

Claims (9)

An irradiation unit, an imaging unit, and a color specification setting unit are provided,
The irradiation unit irradiates a subject with infrared rays having different wavelength intensity distributions and visible rays having an “R wavelength region”;
The imaging unit captures an image of the subject by one or both of infrared rays having different wavelength intensity distributions reflected by the subject and visible rays having an “R wavelength region” reflected by the subject. To form image information representing each image,
The color specification setting unit sets color information for displaying each image represented by the formed image information with a different single color in the image information, wherein the color information is set as the image information. Is represented by | C>.
| C> = H | I>,
| C> = (R, G, B),
| I> T = (I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y))
Here, I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y) are images representing the captured images. Where (x, y) is an in-plane position of each image, n is an integer, and H is the color information represented by a 3 × n matrix, R, G, and B are the lightness of each of the three primary colors “R”, “G”, and “B” represented by | C>,
Further, the I1 (x, y) is reflected by the infrared ray having the wavelength intensity distribution on the shortest wavelength side among the respective infrared rays having different wavelength intensity distributions reflected by the subject and the “reflected by the subject”. Image information captured by visible light having an “R wavelength region” or image information captured by visible light having the “R wavelength region” reflected by the subject, and R is the I1 (x, y The image photographing apparatus is characterized in that the H is set so as to be dependent on (). An irradiation unit, an imaging unit, and a color specification setting unit are provided,
The irradiation unit irradiates the subject with infrared rays having different wavelength intensity distributions and visible rays having different wavelength intensity distributions,
The imaging unit displays an image of the subject by one or both of each infrared ray having different wavelength intensity distribution reflected by the subject and each visible ray having different wavelength intensity distribution reflected by the subject. To form image information representing each image,
The color specification setting unit sets color information for displaying each image represented by the formed image information with a different single color in the image information, wherein the color information is set as the image information. Is represented by | C>.
| C> = H | I>,
| C> = (R, G, B),
| I> T = (I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y))
Here, I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y) are images representing the captured images. Where (x, y) is an in-plane position of each image, n is an integer, and H is the color information represented by a 3 × n matrix, R, G, and B are the lightness of each of the three primary colors “R”, “G”, and “B” represented by | C>,
Furthermore, the infrared rays having the wavelength intensity distribution on the shortest wavelength side among the respective infrared rays having different wavelength intensity distributions reflected by the subject and “R” reflected by the subject are reflected by I1 (x, y). Image information captured by visible light having a “wavelength region” or image information captured by visible light having the “R wavelength region” reflected by the subject, and R is the I1 (x, y) The image photographing apparatus is characterized in that the H is set so as to depend on. An irradiation unit, a separation unit, an imaging unit and a color specification setting unit are provided.
The irradiation unit irradiates a subject with infrared rays having different wavelength intensity distributions;
The separation unit separates visible light from the subject into visible light having different wavelength intensity distributions,
The imaging unit captures an image of the subject with each infrared ray having a different wavelength intensity distribution reflected by the subject and each visible ray having the different wavelength intensity distribution to form image information,
The color specification setting unit sets color information for displaying each image represented by the formed image information with a different single color in the image information, wherein the color information is set as the image information. Is represented by | C>.
| C> = H | I>,
| C> = (R, G, B),
| I> T = (I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y))
Here, I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y) are images representing the captured images. Where (x, y) is an in-plane position of each image, n is an integer, and H is the color information represented by a 3 × n matrix, R, G, and B are the lightness of each of the three primary colors “R”, “G”, and “B” represented by | C>,
Further, the infrared light having a wavelength intensity distribution on the shortest wavelength side among the respective infrared rays having different wavelength intensity distributions reflected by the subject, and the separated different wavelength intensity distributions. Image information captured by visible light having “R wavelength region” in visible light having a wavelength difference, or visible light having “R wavelength region” in visible light having different wavelength intensity distributions. An image photographing apparatus, wherein the image information is taken and the H is set so that the R depends on the I1 (x, y). An irradiation unit, a separation unit, an imaging unit and a color specification setting unit are provided.
The irradiation unit irradiates the subject with infrared rays having different wavelength intensity distributions and visible rays including “R wavelength region”,
The separation unit separates visible light from the subject into visible light having different wavelength intensity distributions, wherein the visible light from the subject is irradiated by the irradiation unit and reflected by the subject. Including visible light including "R wavelength region",
The imaging unit captures an image of the subject by imaging one or both of infrared rays having different wavelength intensity distributions reflected by the subject and visible rays having different wavelength intensity distributions. Form the
The color specification setting unit sets color information for displaying each image represented by the formed image information with a different single color in the image information, wherein the color information is set as the image information. Is represented by | C>.
| C> = H | I>,
| C> = (R, G, B),
| I> T = (I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y))
Here, I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y) are images representing the captured images. Where (x, y) is an in-plane position of each image, n is an integer, and H is the color information represented by a 3 × n matrix, R, G, and B are the lightness of each of the three primary colors “R”, “G”, and “B” represented by | C>,
Further, the I1 (x, y) is determined in the visible light from the subject within the visible light having an “R wavelength region” and the respective infrared rays having different wavelength intensity distributions reflected by the subject. Image information captured by infrared light having a wavelength intensity distribution on the shortest wavelength side, or image information captured by visible light having an “R wavelength region” in the visible light from the subject, and R An image photographing apparatus, wherein the H is set so as to depend on the I1 (x, y). A separation unit, an imaging unit, and a color specification setting unit;
The separation unit separates light rays from the subject into infrared rays having different wavelength intensity distributions,
The imaging unit captures an image of the subject with each of the infrared rays to form image information,
The color specification setting unit sets color information for displaying each image represented by the formed image information with a different single color in the image information, wherein the color information is set as the image information. Is represented by | C>.
| C> = H | I>,
| C> = (R, G, B),
| I> T = (I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y))
Here, I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y) are images representing the captured images. Where (x, y) is an in-plane position of each image, n is an integer, and H is the color information represented by a 3 × n matrix, R, G, and B are the lightness of each of the three primary colors “R”, “G”, and “B” represented by | C>,
Further, the I1 (x, y) is image information captured by infrared rays having a wavelength intensity distribution on the shortest wavelength side among the separated infrared rays having different wavelength intensity distributions, and R is the I1 ( x is set to be dependent on x, y),
The image capturing apparatus further includes an irradiation unit that irradiates the subject with one or both of infrared rays and visible rays. A separation unit, an imaging unit, and a color specification setting unit;
The separation unit separates light rays from the subject into light rays having different wavelength intensity distributions,
The imaging unit captures an image of the subject with light beams having different wavelength intensity distributions to form image information,
The color specification setting unit sets color information for displaying each image represented by the formed image information with a different single color in the image information, wherein the color information is set as the image information. Is represented by | C>.
| C> = H | I>,
| C> = (R, G, B),
| I> T = (I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y))
Here, I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y) are images representing the captured images. Where (x, y) is an in-plane position of each image, n is an integer, and H is the color information represented by a 3 × n matrix, R, G, and B are the lightness of each of the three primary colors “R”, “G”, and “B” represented by | C>,
Further, the I1 (x, y) is converted into a visible ray having an “R wavelength region” and a ray having an infrared ray having a wavelength intensity distribution on the shortest wavelength side among the separated rays having different wavelength intensity distributions. The captured image information is set, and the H is set so that the R depends on the I1 (x, y).
The image capturing apparatus further includes an irradiation unit that irradiates the subject with one or both of infrared rays and visible rays.   The image capturing apparatus according to claim 3, wherein the imaging unit includes a plurality of pixels, and the separation unit is attached to each of the plurality of pixels. Irradiate the subject with infrared rays having different wavelength intensity distributions,
Here, the subject has a member that reflects a first infrared ray among infrared rays having different wavelength intensity distributions,
Capturing image of the subject by each infrared ray having different wavelength intensity distribution reflected by the subject to form image information representing each image;
Color information for displaying each of the images represented by the formed image information by different single colors is set in the image information. Here, the image information in which the color information is set is represented by | C>. ,
| C> = H | I>,
| C> = (R, G, B),
| I> T = (I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y))
Here, I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y) are images representing the captured images. Where (x, y) is an in-plane position of each image, n is an integer, and H is the color information represented by a 3 × n matrix, R, G, and B are the lightness of each of the three primary colors “R”, “G”, and “B” represented by | C>,
Further, I1 (x, y) is image information captured by the first infrared ray among the respective infrared rays having different wavelength intensity distributions reflected by the subject, and the R, G, and B A method of photographing an image, characterized in that the H is set so that any one or two of the above depends on the I1 (x, y). Separating rays from the subject into rays with different wavelength intensity distributions,
Taking an image of the subject with light rays having different wavelength intensity distributions to form image information,
Color information for displaying each of the images represented by the formed image information by different single colors is set in the image information. Here, the image information in which the color information is set is represented by | C>. ,
| C> = H | I>,
| C> = (R, G, B),
| I> T = (I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y))
Here, I1 (x, y), I2 (x, y), I3 (x, y),..., In (x, y) are images representing the captured images. Where (x, y) is an in-plane position of each image, n is an integer, and H is the color information represented by a 3 × n matrix, R, G, and B are the lightness of each of the three primary colors “R”, “G”, and “B” represented by | C>,
Further, the I1 (x, y) is converted into a visible ray having an “R wavelength region” and a ray having an infrared ray having a wavelength intensity distribution on the shortest wavelength side among the separated rays having different wavelength intensity distributions. Image information captured or image information captured by visible light having an “R wavelength region” in the visible light from the subject, and the R depends on I1 (x, y). An image photographing method characterized by setting H.