JPWO2007077915A1 - Imaging device, display device, and imaging / display device - Google Patents

Abstract

An imaging / display apparatus capable of accurately reproducing the positional relationship between a plurality of images and displaying them on a single display screen with different imaging conditions, types of images, and shapes of the imaging target. Solid-state imaging for black and white is used as an imaging unit, using an illumination light source that projects light with different wavelengths (including not only visible light but also invisible light) in a predetermined order as imaging illumination unit. The element 2 is used, and a backlight type monochrome liquid crystal display element 24 capable of switching the light color of the backlight 24 in synchronization with switching of the light color of the light source is used as a display of the display device 20. Then, when the illumination light source 12 emits light of a certain wavelength, the backlight 24 when the liquid crystal display element 22 displays the video signal of the observation image (imaged object image) by the light by the solid-state image sensor 2. The color is set in advance to a color corresponding to the color emitted by the light source 12. [Selection] Figure 1

Description

  The present invention relates to an imaging device, a display device, and an imaging / display device including the imaging device and the display device.

  As the imaging / display device, the applicant of the present invention proposes as a color imaging / color display device that captures reflected light from a subject of illumination light and displays the captured image in color on the display device in real time according to Japanese Patent Application No. 2005-323987. There is what I did. A typical example of this color imaging / color display device uses, for example, an illumination light source that switches and projects primary color light in a predetermined order as illumination means, and uses a monochrome solid-state imaging device as imaging means, and displays the display device. As a backlight type monochrome liquid crystal display device capable of switching the light color of the backlight to the same primary color, for example, in synchronism with the switching of the light color of the light source, the illumination light source is a certain primary color light, for example. The color of the backlight when the image signal from the solid-state image sensor of the subject image by the light is displayed by the liquid crystal display element becomes the primary color emitted by the light source.

The invention according to the above-mentioned patent application can be used in various technical fields. An endoscope or the like, which is one of the fields of application, is inserted into the digestive system, such as the esophagus, through the mouth or the colonic discharge system. It is inserted through the anus to visually grasp the internal situation and make a diagnosis, which greatly contributes to the early detection of disease states.
The trend of technology in the endoscope is described below. The latest endoscopes use a solid-state image sensor as an imaging means. Previously, a monochrome image was captured, and the monochrome image was reproduced on a display and monitored. In many cases, however, there is an increasing number of cases where a color image is taken and a color image is reproduced and monitored on a display. Examples thereof are introduced in JP 09-037236 A, JP 06-331906 A, and the like.

  In the technique introduced in Japanese Patent Application Laid-Open No. 09-037236, a color solid-state image sensor is used as a solid-state image sensor, and a color image signal output from the solid-state image sensor is processed by a color video processor. The color video signal output from the video processor is reproduced on a color monitor, and the reproduced image is observed.

  On the other hand, in the technology introduced by Japanese Patent Laid-Open No. 06-331906, a solid-state image sensor for black and white is used as a solid-state image sensor, and illumination light of the three primary colors red (R), green (G), and blue (B) is used. Irradiating sequentially for each color, shifting the time sequentially, picking up the image of the object to be picked up in sequence for each primary color with the solid-state image sensor, and processing the image signal output from the solid-state image sensor with a surface sequential color display processing device A video signal is created and played back on a color monitor. Incidentally, in this technique, it is possible to reproduce and display a black and white image to be captured.

According to the technique described in the above Japanese Patent Application Laid-Open No. 09-037236 and the like, it is necessary to use a color solid-state image sensor as a solid-state image sensor, and when comparing a monochrome solid-state image sensor and a color solid-state image sensor of the same chip size, Since the monochrome solid-state imaging device has a higher resolution, there is a problem that it is difficult to improve the resolution with a small size.
On the other hand, according to one embodiment of the invention of Japanese Patent Application No. 2005-323987, the color of the illumination light can be set to, for example, red (R), green (G), blue (B), red when imaged by the imaging means. (R), green (G), blue (B),... Are sent to the display device without subjecting the output signal of the imaging means to processing for obtaining a normal color video signal. Since the display backlight color is changed according to the change in the color of the illumination light for imaging, such as R, G, B, R, G, B,... A shift in color reproduction cannot occur between imaging and display reproduction, and there is no room for color breakup.

Therefore, it is not necessary to provide a special complicated circuit to eliminate the color breakup of the moving image, and the color breakup of the moving image is eliminated without providing such a complicated circuit.
To summarize the above, the solid-state imaging device can be drastically reduced in size, and there is no attenuation of light in the display, and a highly sensitive reproduced image can be obtained. A moving image without color breakup can be obtained without providing a complicated circuit. Therefore, even if the image of the imaged object changes rapidly, a clean image with normal color reproduction can be obtained and can be realized at a low price. In addition, simplification and cost reduction of the electronic circuit can be achieved.
The invention of the Japanese Patent Application No. 2005-323987 has various other aspects and can enjoy various effects.
Japanese Patent Application No. 2005-323987 JP 09-037236 A Japanese Patent Laid-Open No. 06-331906 JP 2002-17862 A

By the way, it can be said that the technique of Japanese Patent Application No. 2005-323987 of patent document 1 is excellent in various aspects among the said background art. However, this technique is intended to display an image as faithfully as possible or within an allowable limit so that it can be recognized visually by one object until it gets tired. Is going to get.
Therefore, it was not possible to obtain a plurality of types of display at the same time.

However, according to the inventor of the present application, not only can an image that can be visually recognized of one object to be imaged be displayed, but also another type of image or shape related to the image can be expressed on one display screen. Then, for example, it has been recognized that it is extremely useful for medical care, confirmation of the internal state of a structure, etc., but the technology of Patent Document 1 cannot contribute to this.
For example, when examining the blood flow of a human body or the like, if the situation on the surface of the skin or organ and the blood flow inside it are displayed on the same display screen while faithfully reproducing the positional relationship between the two, It can be said that it is easy to diagnose and easy to treat such as surgery while viewing the display screen.

Further, a technique has been developed in which only cancer tumors that are not visible to the naked eye by illuminating the cancer tumor with fluorescence without damaging the others, but the technique of Japanese Patent Application No. 2005-323987 is also difficult to use.
This is because when a patient holds a special drug that collects only in the cancer tissue, the drug concentrates in the cancer tissue, and light of a specific band wavelength (for example, blue) is present in the vicinity of the cancer tissue. (Purple light) causes a phenomenon in which only the cancer tissue emits light of a specific band of wavelengths (for example, red light), where the cancer tissue can be distinguished from normal tissue. Although it is not possible to display both the cancer tissue and the background skin and organ in which it exists on one screen, it is difficult to recognize the positional relationship of the cancer tissue to the skin and organ. Because.

  The present invention has been made in order to solve such a problem, and is a novel imaging capable of capturing an image of a subject and displaying different conditions, types of images, and shapes of the subject on a single display screen. An object is to provide a display device and an imaging device and a display device that can be used therefor.

The imaging apparatus according to claim 1 is an illumination light source capable of switching and irradiating a plurality of types of imaging illumination light (colors) to the imaging target, and observation by light from the light source from the imaging target. It has at least image forming means for forming an image and black and white image pickup means for picking up an observation image formed by the image forming means.
The imaging apparatus according to claim 2 is the imaging apparatus according to claim 1, wherein the plurality of types of imaging irradiation light to be irradiated by switching the illumination light source is a primary color or a complementary color and / or a plurality of colors among these. It is characterized by being mixed white and other mixed colors, infrared light and / or ultraviolet light.
The imaging apparatus according to claim 3 includes one or a plurality of imaging means for forming an observation image of the imaging target, and a black and white imaging means for imaging an observation image from the imaging target formed by the imaging means. The image pickup device has at least color image pickup means for picking up an observation image from the image pickup body formed by the image forming means.

The display device according to claim 4 includes at least a backlight type display unit that receives a video signal and reproduces an image, and a backlight capable of switching and irradiating the display unit with a plurality of types of display illumination light. The operation of reproducing one frame image composed of a plurality of fields for reproducing different images of different image pickup objects or different images of the same image pickup object under different conditions is repeated. .
According to a fifth aspect of the present invention, in the display device according to the fourth aspect, the display means comprises a liquid crystal display element.

  An imaging / display apparatus according to a sixth aspect of the present invention combines an illumination light source capable of switching and irradiating a plurality of types of imaging illumination light to the object to be imaged, and an observation image by light from the light source from the imaged object. An imaging device having at least a monochrome imaging means for imaging an imaging image formed by the imaging means and an observation image formed by the imaging means; a backlight type display means for receiving an image signal and reproducing an image; and the display means A plurality of fields having at least a backlight capable of switching and illuminating a plurality of types of display illumination light, and reproducing different images of different imaging targets or the same imaging target under different conditions in a predetermined order A display device configured to repeat the operation of reproducing one frame image consisting of the above, and switching the imaging illumination light and switching the display illumination light. Characterized by comprising as performed by field switching and substantially synchronized.

  The imaging / display apparatus according to claim 7 is one or a plurality of imaging means for forming an observation image of the imaging target, and a monochrome imaging means for imaging an observation image from the imaging target formed by the imaging means. And an imaging device having at least color imaging means for imaging an observation image from the imaging target imaged by the imaging means, a backlight type display means for receiving an image signal and reproducing the image, and the display means A plurality of fields having at least a backlight capable of switching and illuminating a plurality of types of display illumination light, and reproducing different images of different imaging targets or the same imaging target under different conditions in a predetermined order At least a display device configured to repeat the operation of reproducing one frame image consisting of: a display device for reproducing an observation image captured by the black and white imaging means; When, characterized by comprising as repeating frame operation for displaying a field for reproducing an observation image captured by the color image pickup means in a predetermined order at a predetermined period.

The imaging / display apparatus according to claim 8 is the imaging / display apparatus according to claim 6 or 7, wherein the plurality of types of imaging irradiation light to be irradiated by switching the illumination light source are primary colors, complementary colors, or the like. It is characterized by white light or other mixed colors obtained by mixing a plurality of colors, and infrared light and / or ultraviolet light.
The imaging / display apparatus according to a ninth aspect is the imaging / display apparatus according to the sixth, seventh, or eighth aspect, wherein the display means includes a liquid crystal display element.
The imaging / display device according to claim 10 is the imaging / display device according to claim 6, 7, 8 or 9, wherein the imaging means and the display device include the number of pixels in the vertical direction and the number of pixels in the horizontal direction. It is characterized by the fact that they are the same.

  According to the imaging apparatus of claim 1, an illumination light source capable of switching and irradiating a plurality of types of imaging illumination light, an imaging means for forming an image by light from the light source from the imaging object, and 6. A display device according to claim 4 or 5, which has a black and white image pickup means for picking up the formed image, that is, a display device capable of switching the display illumination light of the backlight of the display means. In combination, the imaging / display device described in claims 6 to 9 to be described later can be configured.

According to the imaging apparatus of claim 2, the imaging illumination light to be irradiated by switching the illumination light source is a primary color or a complementary color and / or a white or other mixed color thereof, that is, visible light and infrared light. And since it is ultraviolet light, that is, invisible light, it is possible to capture both an image of the object to be imaged by visible light and an image of invisible light.
Therefore, by combining with the display device described in claims 4 and 5 to be described later, not only the imaging / display device described in claims 6 to 9 described later can be configured, but also, for example, the surface of a human body or the like Alternatively, an internal visible light image and, for example, a temperature distribution, blood flow, or an image of a special fluorescent substance in the blood flow are displayed on the same display screen in a form that accurately reproduces the positional relationship between both images. be able to. This greatly contributes to medical care.
In addition, it greatly contributes to the analysis of the internal structure of buildings and various members.
According to the imaging apparatus of the third aspect, since the monochrome imaging means and the color imaging means are provided as the imaging means, invisible light such as infrared light or ultraviolet light is used as imaging illumination light by the monochrome imaging means. An image can be picked up and displayed in an arbitrary color, and a color image of the background can be picked up and displayed by the color photographing means.

According to the display device of claim 4, it is possible to switch and irradiate the color of the display illumination light of the backlight, and different images of different imaging objects or the same imaging object under different conditions in a predetermined order. Since the operation of reproducing one frame image composed of a plurality of fields to be reproduced at is repeated, by combining the imaging device according to claims 1 to 3, imaging illumination light when imaged by the imaging means, By switching the display illumination light in synchronization with the display device and setting the relationship between the imaging illumination light and the display illumination light in advance, a plurality of types of images under different conditions on the same screen. Can be displayed in a form that accurately reproduces the positional relationship between the two images.
According to the display device of the fifth aspect, since the display means is composed of a liquid crystal display element, the device can be reduced in size and the price can be reduced.

According to a sixth aspect of the present invention, there is provided the imaging device of the first aspect and the display device of the fourth aspect, wherein the switching of the imaging illumination light and the switching of the display illumination light is performed in the field. Since it is performed almost in synchronization with the switching, by setting the relationship (combination) between the illumination light for imaging and the illumination light for display in advance, a plurality of types of images under different conditions can be displayed on the same screen. The positional relationship between both images can be displayed in a form that accurately reproduces.
According to a seventh aspect of the present invention, there is provided the imaging device of the third aspect and the display device of the fourth aspect, wherein the switching of the imaging illumination light and the switching of the display illumination light is performed in the field. Since the switching is performed substantially in synchronization with the switching, for example, it is possible to capture the image of the object to be imaged with the black and white imaging unit and to capture the color image of the object to be captured with the color imaging unit.

According to the imaging / display apparatus of claim 8, the imaging illumination light to be irradiated by switching the illumination light source is a primary color or a complementary color and / or a white or other mixed color thereof, that is, visible light and infrared. Since it is light and / or ultraviolet light, that is, invisible light, it is possible to capture both an image of the object to be imaged by visible light and an image of invisible light. Therefore, it is possible to make medical examinations accurately and clearly by using non-visible light for the detection of the affected area. Furthermore, it is possible to make treatments such as surgery while looking at the display screen accurately and clearly. It becomes possible.
According to the display device of the ninth aspect, since the display means is composed of a liquid crystal display element, the device can be reduced in size and the price can be reduced.
According to the imaging / display device of claim 10, since the imaging means and the display device have the same number of pixels in the vertical direction and the number of pixels in the horizontal direction, the pixels in the vertical direction of the imaging means. Signal processing such as thinning out or interpolation of image signals for matching is required when the number and the number of pixels in the horizontal direction do not match the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the display means. Disappear.
Therefore, the signal processing circuit, the signal processing program, etc. can be simplified.

The embodiment of the imaging apparatus of the present invention basically enables switching of the color (wavelength) of the illumination light for imaging, provided one monochrome imaging means as imaging means, and further provided imaging means. However, both black and white imaging means and color imaging means may be provided as imaging means.
The illumination light for imaging may be primary colors such as red, blue, and green, may be complementary colors such as magenta, cyan, and yellow, or may be a mixed color (including white) of these. .
Moreover, not only visible light but infrared light (including far infrared light and near infrared light) or ultraviolet light (including far ultraviolet light and near ultraviolet light) may be used. Furthermore, it is possible to provide a field that uses external light instead of imaging illumination light.

Then, if imaging is performed using infrared light, temporal changes in the brain and muscles can be measured during daily activities by near infrared spectroscopy. Therefore, for example, an image obtained by using visible light of the color of the object to be picked up by using light such as red, blue, and green, or a black and white image using external light as a light source, and the brain and muscles by using the infrared light. It is possible to capture an image showing the movement of the image while accurately maintaining the positional relationship between the images.
Moreover, if imaging is performed using ultraviolet light, cancer detection using a fluorescent substance as an index can be performed. To explain this in detail, if a subject takes a special drug (for example, 5-aminorepric acid) that collects only in the cancer tissue, and the ultraviolet light is applied to the part with cancer, only the cancer tissue emits red light This phenomenon is used for medical treatment such as examination and surgery.

Specifically, ultraviolet light is irradiated in one of a plurality of fields constituting one frame, and the field image captured at that time is used as an image showing cancer tissue, and the image of the other field is used as the background image. If this is done, the background and the cancer tissue can be imaged while maintaining their positional relationship accurately.
In the embodiment of the display device of the present invention, the display element is basically a backlight type, and the color of light of the backlight can be switched. As the display element, a liquid crystal display element is optimal.

  The imaging / display device of the present invention is basically a combination of the imaging device of the present invention and the display device of the present invention. It is not always necessary that the colors of the imaging illumination light and the display illumination light match between the field in the imaging device and the field in the display device in one frame. For example, it is possible that the imaging illumination light in the first field in one frame is ultraviolet light and the display illumination light is red. By doing so, the cancer tissue is displayed, and in the fields after the second field in one frame, the imaging illumination light and the display illumination light match to display the background of the cancer tissue. It becomes possible.

In the imaging / display apparatus of the present invention, it is preferable that the imaging means and the display apparatus have the same number of pixels in the vertical direction and the same number of pixels in the horizontal direction. This is because if the number of pixels in the vertical direction and the number of pixels in the horizontal direction are different between the imaging means and the display device, the captured image signal cannot be reproduced as it is on the display screen, and thinning and compensation are performed. However, if the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the image pickup means and the display device are the same, the image signal is thinned out or interpolated. This is because signal processing is not necessary, and a signal processing circuit, a signal processing program, and the like can be simplified.
The light source may be provided at the distal end of an endoscope or an airway securing device having an imaging / display device, or provided at the base (original) side, and the light emitted from it may be guided by, for example, glass fiber. Means may be used to guide light to the distal end of an endoscope, an airway securing device, etc., and exit to the front side.
The imaging / display device of the present invention is not limited to an endoscope or an airway securing device, but irradiates illumination light, images the reflected light, and displays the captured image in color on the display device in real time. Can be widely applied to the device. For example, an insertion tube inserted in a small cavity of a building or a natural object to visually grasp the inside is an application example other than an endoscope and an airway securing device.

Hereinafter, the details of the present invention will be described based on illustrated embodiments.
FIG. 1 is a basic configuration diagram showing an imaging / display apparatus 1a according to one embodiment. In this embodiment, the cancer tissue is used for imaging and display. The background is a normal color image, and the cancer tissue is displayed in a specific color, for example, yellow.
Reference numeral 2 denotes a solid-state image sensor, which is a monochrome solid-state image sensor. That is, it is a solid-state imaging device without a color separation color filter, and even if it is a charge transfer type (so-called CCD type) solid-state imaging device, other amplification type solid-state imaging device, MOS type solid-state imaging device, or CMOS type solid-state imaging device It may be an image sensor.
This solid-state image sensor is a black-and-white solid-state image sensor, and since there is no color separation color filter, spectral attenuation is small.

An imaging lens 4 is provided on the front side of the solid-state imaging device 2 and forms an image of an object to be imaged, for example, an image of a portion (not shown) where a cancer tissue exists on the imaging surface of the solid-state imaging device 2. To play a role.
Reference numeral 6 denotes an insertion tube such as an endoscope (in the case of an airway securing device, the insertion body is equivalent to this), 6a is a distal end, 6b is a base portion (original side portion), and the solid-state imaging device 2 is connected to the insertion tube 6 It is arranged on the tip side.
Reference numerals 8, 8,... Are illumination optical fibers disposed along the insertion tube 6 on the outside thereof, and light from an imaging object irradiation light source (12) to be described later is transmitted along the insertion tube 6 to the base portion. The light is guided from the 6b side to the distal end 6a side, and the illumination light is irradiated to the distal end side of the insertion tube 6.

Reference numeral 10 denotes a wiring group that connects the solid-state imaging device 2 and the internal circuit 14. The wiring 10 a that drives the solid-state imaging device 2 and an internal circuit (14) that describes a video signal output from the solid-state imaging device 2. ) To the transmission line 10a.
Reference numeral 12 denotes a light source for irradiating the imaging target, which generates imaging illumination light. Specifically, it includes four light emitting diodes, a red light emitting diode LEDr, a green light emitting diode LEDg, a blue light emitting diode LEDb, and an ultraviolet light emitting diode LEDu, and illumination for imaging from a timing controller (18) described later. In response to the light switching signal (: color switching signal), the light-emitting diode LED of the color corresponding to the switching signal (ultraviolet light is invisible light but is expressed as if there is color for convenience) is lit Let
The light source 12 emits light from the light emitting diodes LEDr, LEDg, LEDb, LEDu to the base side end faces of the optical fiber groups 8, 8,.

An internal circuit 14 sends various signals for driving it to the solid-state image pickup device 2 and receives a video signal output from the solid-state image pickup device 2. The liquid crystal display element driving circuit (20) (20) includes an element driving and signal processing circuit 16 and a timing controller 18.
The element driving and signal processing circuit 16 may need to perform simple processing such as timing adjustment by amplifying, shaping, delaying, etc. the signal from the solid-state imaging device 2, but in particular a color television video signal (for example, NTSC). , PAL or SECAM-type video signal) is not necessary, and the circuit configuration may be simple. Therefore, the element driving and signal processing circuit 16 can be inexpensive.

The timing controller 18 sends a signal for controlling the driving timing to the light source 12, the element driving and signal processing circuit 16, and a backlight light source (28) to be described later. The specific operation of the timing controller 18 will be described later.
Reference numeral 20 denotes a display device, and reference numeral 22 denotes a backlight type liquid crystal display element constituting the main part thereof. This liquid crystal display element is a monochrome type and does not include a color separation color filter. Therefore, there is no possibility that light contributing to display is attenuated by the color filter.
A backlight 24 of the liquid crystal display element 22 receives light from the backlight light source (28) and irradiates the liquid crystal display element 22 from behind. A liquid crystal display element driving circuit 26 processes the video signal from the element driving and signal processing circuit 16 and sends the processed video signal to the liquid crystal display element 22, and receives timing control with respect to the processing of the video signal by the timing controller 18.
The number of pixels in the vertical direction of the liquid crystal display element 22 is equal to the number of pixels in the vertical direction of the black and white solid-state image sensor 2, and the number of pixels in the horizontal direction is equal to the number of pixels in the horizontal direction of the black and white solid-state image sensor 2. Can be said to be preferable. This is because signal processing such as thinning out or interpolation of the image signal for adjusting the mismatch of the number of pixels is not necessary.
Therefore, the signal processing circuit, the signal processing program, etc. can be simplified.

Reference numeral 28 denotes a light source for backlight, and four light emitting means (for example, light emitting diodes) 28r, 28g, and 28b for emitting light of red, green, blue, and different fourth colors (for example, yellow). 28y, and in accordance with the light source color switching signal from the timing controller 18, the primary color light emitting means (for example, diodes) 28r, 28g, 28b, 28y corresponding to the switching signal are turned on.
Next, the operation of the timing controller 18 will be specifically described. For example, the red light emitting diode LEDr is turned on at a certain timing, and the solid-state imaging device 2 is started to image one field in synchronization therewith. Therefore, a start signal for starting the operation is sent to the element driving and signal processing circuit 16.
When the element driving and signal processing circuit 16 receives the start signal, the element driving and signal processing circuit 16 functions to start the imaging operation of one field for 1/240 second in the solid-state imaging device 2.

On the other hand, the timing controller 18 sends a signal for turning on the red light emitting means 28r to the backlight source 28 in response to the timing when the video signal of the one field from the solid-state imaging device 2 starts to come. Irradiates red backlight light and sends a signal for displaying one field to the liquid crystal display element 22.
Therefore, the liquid crystal display element 22 is in a state of displaying a red signal of the imaging target.
The imaging and display of the imaging target image with red light continues for 1/240 second. This is the behavior of the red field.

When the red field is imaged and displayed, the green field is imaged and displayed in exactly the same manner. Briefly speaking, imaging and display are performed by switching the light-emitting diode LED of the light source 12 for irradiating the imaging object to the green light-emitting diode LEDg and switching to the light-emitting means 28g of the backlight light source 28. This green field also takes place in 1/240 seconds.
Next, when this green field is imaged and displayed, the blue field is imaged and displayed in exactly the same manner. That is, imaging and display are performed by switching the light-emitting diode LED of the light source for illuminating the imaging subject 12 to the blue light-emitting diode LEDb and switching to the blue light-emitting means 28b of the backlight light source 28. This blue field is also done in 1 / 240th of a second.

Next, imaging with ultraviolet light and display with, for example, yellow are performed. The imaging with ultraviolet light is for emitting only the cancer tissue of the human body. That is, a phenomenon in which a test subject has previously taken a special drug (for example, 5-aminorepric acid) that collects only in the cancer tissue, and when the cancerous part is irradiated with ultraviolet light, only the cancer tissue emits red light. Therefore, in order to make use of this for diagnosis and treatment, imaging with ultraviolet light is performed in the fourth field. Then, since only the cancer tissue generates red light, it is imaged by the imaging device as an image showing the cancer tissue.
On the other hand, on the display device side, an image showing this cancer tissue is displayed with visible light, for example, yellow. This color is selected because it has a relatively strong contrast with red or close to the background color of the cancer tissue, and is not necessarily yellow. Any color that can easily distinguish the cancer tissue from its background is acceptable.
Accordingly, since the optimum color of the display light indicating the cancer tissue differs depending on the color of the part of the human body where the cancer tissue exists, the color may be switched.

These four-field operations, that is, the operation of 1/60 second as one cycle, display the color and cancer tissue of each part of the imaging target for each pixel. Repeated during operation.
Therefore, according to the imaging / display device 1a, each pixel of the monochrome solid-state imaging device 2 captures the color and cancer tissue of the portion corresponding to the pixel of the imaging target in a period of 1/60, etc. Can be displayed by the monochrome liquid crystal display element 22.

Therefore, at the same resolution, color imaging can be performed with the solid-state imaging device 2 smaller than the conventional solid-state imaging device, and color images can be displayed with the monochrome liquid crystal display element 22. This means that since no color separation color filter is required for the solid-state imaging device 2 and the liquid crystal display device 22, attenuation of light can be avoided in the imaging and display stages, that is, in two stages. It also means that the price of 22 can be low.
In addition, when the solid-state imaging device 2 having the same chip size is used, the resolution can be increased to 3 to 4 times.
And cancer tissue can also be displayed in the form which reproduces the positional relationship between it with the background accurately.
Therefore, it greatly contributes to both diagnosis and treatment in medicine.

2 (A) to 2 (D) and FIGS. 3 (E) to (H) show schematic configurations of other examples (Examples 2 to 9) of the present invention. 2 and 3, a is a diagnosis target part that is an object to be imaged, b is a light source for imaging, c is an imaging lens that is imaging means, d is a monochrome liquid crystal display element that is imaging means, and e is an internal circuit , F are liquid crystal display elements constituting display means, and g is a light source for backlight.
(A) FIG. 2 (A) shows an example (second example) in which diagnosis is performed by infrared spectroscopy.
In the present embodiment, the operation of one field is repeated in 1/240 second, and the operation of forming an image of one frame with four fields is repeated.

The imaging light source b generates red in the first field, green in the second field, blue in the third field, and infrared light (for example, near-infrared light having a wavelength of 760 nm or 840 nm) in the fourth field.
Further, the display light source g constituting the backlight operates to generate red in the first field, green in the second field, blue in the third field, and yellow in the fourth field, for example.
According to the present embodiment, color imaging and color display are performed on the background of the site to be examined, and the diagnostic object itself is imaged with infrared light, for example, displayed in yellow.

(B) FIG. 2 (B) shows another example (third example) in which diagnosis is performed by infrared spectroscopy.
In the present embodiment, the operation of one field is repeated in 1/120 second, and the operation of constructing an image of one frame with two fields is repeated.
The imaging light source b emits white light (white light can be obtained by simultaneously lighting red, blue, and green light emitting diodes) in the first field, and infrared light (for example, wavelength) in the second field. 760 nm or 840 nm near infrared light).
In addition, the display light source g that forms a backlight operates to generate white in the first field and yellow, for example, in the second field.
According to the present embodiment, the background of the examination target part is captured in black and white and displayed in black and white, and the diagnosis target itself is captured with infrared light, for example, displayed in yellow.

(C) FIG. 2C shows one embodiment (fourth embodiment) for detecting cancer tissue by ultraviolet light.
In the present embodiment, the operation of one field is repeated in 1/240 second, and the operation of forming an image of one frame with four fields is repeated.
When performing detection according to this example, it is necessary to take a special drug (for example, 5-aminorepric acid) that is collected only in cancer tissues in advance by the subject.

The imaging light source b generates red in the first field, green in the second field, blue in the third field, and ultraviolet light in the fourth field.
Further, the display light source g constituting the backlight operates to generate red in the first field, green in the second field, blue in the third field, and yellow in the fourth field, for example.
According to this example, a special drug (color imaging and color display of the background of the site to be examined, color imaging of the diagnostic object itself, in this example the red light generated when the cancer tissue is irradiated with ultraviolet light, and The image is displayed in yellow, for example.

(D) FIG.2 (D) shows another Example (5th Example) which detects the cancer tissue by ultraviolet light.
In this embodiment, the background is imaged and displayed in black and white on the same principle as the method shown in FIG. 2B, and the cancer tissue is reflected light using ultraviolet light as imaging display light. Red light is imaged, and an image showing cancer tissue is displayed in, for example, yellow.

(E) FIG. 3E shows an embodiment (sixth embodiment) in which a black and white image and an incomplete color image are captured and displayed. Specifically, in one field, black-and-white imaging / display is performed, in another field, the image is captured in one color, for example, red, and also displayed in red, and in another field, another color, for example, green is displayed. An image is taken and displayed in green as well.
In this example, in terms of color reproduction, it is incomplete in that the display of the blue component is not performed, but due to the nature of the imaged object, the observation purpose may be sufficiently achieved without one color component. In such a case, it is possible to accurately perform a diagnosis without performing complete color reproduction. However, in order to grasp the exact shape, position, size, etc. of the affected part, it may be preferable that the contour can be clearly recognized, and for this purpose, display of a monochrome image is appropriate.
Therefore, one frame is composed of three fields, and one field is used for monochrome imaging and display, and the other two fields are used for incomplete color imaging and display using red and green.

(F) FIG. 3F shows an example (seventh example) in which the example applied to the near infrared spectroscopy shown in FIG. 2B is further developed. In this embodiment, two types of infrared light having different wavelengths are used as the infrared light used for spectroscopy. In this example, the wavelength of one infrared light is 760 nm and the wavelength of the other infrared light is 840 nm. It is.
In the first field, both the imaging illumination light and the display illumination light are white. In the second field, the imaging illumination light is infrared light having a wavelength of 760 nm, the display illumination light is red, for example, the third field. The imaging illumination light is infrared light having a wavelength of 840 nm, and the display illumination light is blue, for example.

According to this embodiment, the background is captured and displayed in black and white, an image of near-infrared spectroscopy using infrared light with a wavelength of 760 nm and an image of near-infrared spectroscopy using infrared light with a wavelength of 840 nm are captured, and a wavelength of 760 nm is captured. An image based on infrared light can be displayed in red, and an image based on infrared light having a wavelength of 840 nm can be displayed in blue.
It should be noted that it is not always necessary to change the display colors of an image using infrared light having a wavelength of 760 nm and an image using infrared light having a wavelength of 840 nm to be red or blue, and other colors such as cyan and yellow may be used. Needless to say.
Since the spectrum is analyzed by two infrared lights having different wavelengths, more detailed diagnosis, observation and analysis can be performed.
In this embodiment as well, it goes without saying that the background may be captured and displayed as a color image instead of being captured and displayed as a monochrome image.

(G) FIG. 3G shows an example (eighth example) in which a diagnosis with infrared light and a diagnosis with ultraviolet light can be performed simultaneously.
In this embodiment, the first field displays both the imaging illumination light and the display illumination light in red, the second field displays both the imaging illumination light and the display illumination light in green, and the third field displays the imaging illumination light. The illumination light for imaging is also blue, the illumination light for imaging in the fourth field is infrared light, the illumination light for display is red, for example, the illumination light for imaging is ultraviolet light in the fifth field, and the illumination light for display is blue, for example One frame is constituted by these five fields.
According to the present embodiment, the background is imaged and displayed as a color image, the image by infrared light and the image by ultraviolet light are captured, the image by infrared light is red, and the image by ultraviolet light is blue. Display is possible, and the positional relationship between the background and the image by infrared light and ultraviolet light is accurately reproduced as it is.

(H) FIG. 3 (H) is an embodiment (a ninth embodiment) obtained by modifying the embodiment shown in FIG. 3 (G). First, the imaging illumination light is switched between red, blue, and green. The color image is emitted by irradiation, and the captured image of the color is stored in the memory of the internal circuit e. This can be done by a one-frame operation consisting of three fields.
Next, infrared light is irradiated as imaging display light in the first field, the light is converted into ultraviolet light in the second field, an image of one frame consisting of these two fields is captured, and stored in the memory of the internal circuit e. Remember.

Then, the image taken in the memory is read out, sent to the liquid crystal display element f for reproduction, and the color of the display illumination light generated by the backlight g is switched. In this display operation, one frame is constituted by five fields, a background is displayed by the first to third fields, and a captured image with infrared light as display illumination light is displayed by the fourth field. For example, the image is displayed in red, and the captured image using the ultraviolet light as display illumination light is displayed in blue, for example, in the fifth field.
This display includes a color image indicating the background stored in the memory of the internal circuit e as described above, a captured image using infrared light as display illumination light, and a captured image using ultraviolet light as display illumination light. This is done by reading from the memory in the order of the above fields.

The imaging and storing operation in this embodiment is performed once every predetermined time (for example, approximately 1 second) set in advance, and the image displayed on the liquid crystal display element f is displayed for the predetermined time (for example, 1). Updated every second).
As described above, the present invention can also be implemented in such a manner that the captured image is temporarily stored by using the memory provided in the internal circuit e and the image read from the memory is displayed on the liquid crystal display element f.

FIG. 4 shows an embodiment (tenth embodiment) using a color image pickup device and a monochrome image pickup device as the image pickup means.
In the drawing, reference numeral c1 denotes a first lens, which forms an image of the imaging subject a on the imaging surface of the color imaging element d1. The color image sensor d1 has a color separation color filter h on the surface as a matter of course. c2 is a second lens that forms an image of the imaging target a on the imaging surface of the monochrome imaging element d2. As a matter of course, the image pickup element d2 does not have the color separation color filter h on the surface.

In this embodiment, one frame is composed of two fields. For example, color imaging / color display is performed in one field, and, for example, ultraviolet light (or infrared light) is used for imaging illumination in another field. Imaging is performed as light, and display is performed using, for example, red light (which may be another color) as illumination light for display. That is, imaging data is sent from the color imaging element d1 to the liquid crystal display element f via the internal circuit e, and then imaging data is sent from the monochrome imaging element d2 to the liquid crystal display element f via the internal circuit e. This cycle is repeated. The display light source g is controlled so as to change the color of the display illumination light in accordance with the image data sent to the liquid crystal display element f.
The present invention can also be implemented in such an embodiment.

  INDUSTRIAL APPLICABILITY The present invention is widely applied to an imaging / display apparatus that can capture an image of an object to be captured and display different types of images and shapes of the object to be captured on a single display screen in real time, and an imaging apparatus and a display apparatus that can be used therefor. In addition to being compatible with endoscopes and airway securing devices, it irradiates illumination light, captures the reflected light, and colors the captured image on the display device display in real time. Or it is widely compatible with imaging / display devices that display in black and white. For example, an object that visually grasps the inside by placing an insertion tube in a small cavity of a building or natural object, etc., other than an endoscope or an airway securing device A good example of suitability for

1 is a configuration diagram illustrating an imaging / display apparatus according to a first embodiment of the present invention. (A)-(D) is a schematic block diagram which shows the imaging and display apparatus of the 2nd-5th Example of this invention. (G)-(J) is a schematic block diagram which shows the imaging and the display apparatus of the 6th-9th Example of this invention. It is a block diagram which shows the imaging and display apparatus of the 10th Example of this invention.

Explanation of symbols

1a, 1b, 1c Imaging / display device 2 Solid-state imaging device 4 Imaging lens 6 Insertion tube 8 Insertion tube (or insertion body)
DESCRIPTION OF SYMBOLS 12 Light source for illumination 14 Internal electronic circuit 16 Element drive and signal processing circuit 18 Timing controller 20 Display apparatus 22 Liquid crystal display element 24 Backlight 28 Backlight light source 30 Optical fiber group a Image pick-up object b Light source (Generates illumination light for imaging) light source)
c Imaging lens (imaging means)
d, d2 monochrome image sensor d1 color image sensor h color separation color filter e internal circuit f display element g backlight light source (light source for generating display illumination light)

Claims (10)

An illumination light source capable of switching and irradiating a plurality of types of illumination light for imaging on the imaging object;
Imaging means for forming an observation image by light from the light source from the imaging target,
Monochrome imaging means for capturing an observation image formed by the imaging means;
An image pickup apparatus comprising: The plurality of types of imaging irradiation light to be irradiated by switching the illumination light source is primary color or complementary color and / or white or other mixed colors obtained by mixing a plurality of these colors, infrared light and / or ultraviolet light. The imaging apparatus according to claim 1, wherein: One or a plurality of imaging means for forming an observation image of the imaging target;
Monochrome imaging means for capturing an observation image from the imaged object imaged by the imaging means;
Color image pickup means for picking up an observation image from the image pickup body formed by the image forming means;
An image pickup apparatus comprising: A backlight type display means for receiving an image signal and reproducing an image;
A backlight capable of switching and irradiating a plurality of types of display illumination light to the display means;
Comprising at least
A display characterized by repeating the operation of reproducing one frame image composed of a plurality of fields for reproducing different images of different image pickup objects or different images of the same image pickup object under different conditions in a predetermined order. apparatus. The display device according to claim 4, wherein the display unit includes a liquid crystal display element. Illumination light source capable of switching and irradiating a plurality of types of imaging illumination light onto the imaging target, imaging means for imaging an observation image by the light from the light source from the imaging target, and the imaging means An imaging device having at least black and white imaging means for imaging an observation image formed by
At least a backlight type display means for receiving an image signal and reproducing an image, and a backlight capable of switching and irradiating a plurality of types of display illumination light to the display means, and having different imaging objects or the same object. A display device configured to repeat an operation of reproducing one frame image composed of a plurality of fields for reproducing different images under different conditions of the imaging body in a predetermined order;
Comprising at least
The imaging / display apparatus characterized in that the switching of the illumination light for photographing and the switching of the illumination light for display are performed substantially in synchronization with the switching of the field. One or a plurality of imaging means for forming an observation image of the imaging target, a black and white imaging means for imaging an observation image from the imaging target formed by the imaging means, and the imaging means An imaging apparatus having at least color imaging means for imaging an observation image from the imaging target;
At least a backlight type display means for receiving an image signal and reproducing an image, and a backlight capable of switching and irradiating a plurality of types of display illumination light to the display means, and having different imaging objects or the same object. A display device configured to repeat an operation of reproducing one frame image composed of a plurality of fields for reproducing different images under different conditions of the imaging body in a predetermined order;
An imaging / display device comprising at least
The display device repeats a frame operation in which a field for reproducing an observation image captured by the black and white imaging unit and a field for reproducing an observation image captured by the color imaging unit are displayed in a predetermined order at a predetermined cycle. An imaging / display device characterized by being configured as described above. The plurality of types of imaging irradiation light to be irradiated by switching the illumination light source are primary color, complementary color, or a mixed color of white or other mixed colors, infrared light and / or ultraviolet light. The imaging / display apparatus according to claim 6 or 7, The imaging / display apparatus according to claim 6, 7 or 8, wherein the display means comprises a liquid crystal display element. The imaging / display device according to claim 6, 7, 8, or 9, wherein the imaging means and the display device have the same number of vertical pixels and the same number of horizontal pixels. .

Images