JPH08191442A - Monitoring image display device - Google Patents

Abstract

PURPOSE: To reduce a work load on the operator and to enhance the monitor capability (object find-out capability) by displaying a fusion image having various characteristic points of plural images received by plural image pickup devices onto a single monitor screen. CONSTITUTION: Plural detectors 5, 6,... are provided with an optical sensor detecting a light of a different wavelength respectively and with plural image pickup devices 1, 2,... converting the detected light of each wavelength into an image signal and detect image information signals 7, 8,... specific to each wavelength from the image signals 3, 4,... outputted from the plural image pickup devices 1, 2,.... An image fusion device 9 selectively superimposes the image information signals 7, 8,... specific to each wavelength detected by the detectors 5, 6,... and the image signals 3, 4,... outputted from the plural image pickup devices 1, 2,... to generate a fusion image signal 10. A monitor 11 displays the fusion image outputted by an image fusion device 9.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a surveillance image display device applied to, for example, a surveillance system for finding a predetermined target.

[0002]

2. Description of the Related Art FIG. 3 is a block diagram showing an example of a conventional monitoring image display device of this type. In FIG. 3, 31
Is a visible image pickup device with a built-in visible sensor, 32 is an infrared image pickup device with a built-in infrared sensor, and 33 is an image pickup device with a built-in other sensor X (other image pickup devices are not shown). Reference numeral 34 is a visible image signal, 35 is an infrared image signal, and 36 is another image signal. The visible image signal 34, the infrared image signal 35, and the other image signal 36 are sent to the monitor A, the monitor B, and the monitor C, respectively, and each image is displayed on each of the monitors A to C. The operator has tried to discover a predetermined target, for example, by monitoring all the images on the monitors A to C at substantially the same time.

[0003]

In the conventional apparatus, since the operator needs to monitor the plurality of monitors A to C at almost the same time, the workload for finding the target is excessive. Further, since the target finding work is performed while comparing a plurality of monitors, the time required for the target finding tends to be long, and the possibility of erroneous finding is high.

An object of the present invention is to provide a single fused image having feature points of a plurality of images captured by a plurality of image capturing devices without displaying the plurality of images captured by the plurality of image capturing devices on a plurality of monitor screens. , Can be displayed on a single monitor screen, light operator workload,
Moreover, it is to provide a monitoring image display device having high monitoring capability (target finding capability).

[0005]

In order to solve the above problems and achieve the object, the multi-spectral image fusion display device of the present invention is configured as follows. (1) The monitoring image display device of the present invention includes a plurality of image pickup devices each including an optical sensor capable of detecting light of a different wavelength, and converting the detected light of each wavelength into an image signal, respectively. Of a plurality of detection devices for detecting image information specific to each wavelength from each image signal output from the image capturing device, image information specific to each wavelength detected by each detection device, and output from the plurality of imaging devices It is characterized by further comprising: an image fusion device for selectively superimposing the image information to be generated to generate a fusion image; and a monitor for displaying the fusion image output by the image fusion device. (2) The monitoring image display device of the present invention includes a visible image pickup device that captures an image of the outside world with a visible sensor and converts it into an image signal, and an infrared ray that captures the same image as the above image with an infrared sensor and converts it into an image signal. An imaging device, an edge information detection device that detects edge information indicating a contour line from a visible image output by the visible imaging device, and a hot point that detects a hot point indicating a high temperature portion from the infrared image output by the infrared imaging device Select a detection device, a visible image output by the visible imaging device, an infrared image output by the infrared imaging device, an edge information image output by the edge information detection device, and a hot point image output by the hot point detection device. Image fusion device for generating a fusion image by superimposing the image dynamically and fusion image output by the image fusion device It is characterized by comprising a monitor that.

[0006]

As a result of taking the above measures (1) and (2), the following effects occur. (1) In the monitoring image display device of the present invention, the light of each wavelength captured by each photosensor in each imaging device is converted into an image signal, and these image signals are unique to each wavelength and effective. Only image information is extracted. That is, only the advantages possessed by each sensor are effectively utilized. Then, the effective image information unique to each of the detected wavelengths and the image signal are selectively overlapped to form one integrated image information which can be displayed on a single monitor. Therefore, the operator only needs to monitor the single monitor, and the workload of the operator monitoring work is significantly reduced. (2) In the monitoring image display device of the present invention, both the visible light captured by the visible sensor in the visible imaging device and the infrared light captured by the infrared sensor in the infrared imaging device are both converted into image signals. . Then, the edge information detection device detects the edge information indicating the contour line which is the scene understanding information from the visible image output by the visible imaging device, and the hot point detection device,
From the infrared image output by the infrared imaging device, a hot point indicating a high temperature part, which is heat source information, is detected. The visible image, the infrared image, the edge information image, and the hot point image are selectively overlapped in the image fusion device, and it is difficult to grasp from the infrared image and the scene understanding information and the visible image. For example, a fusion image in which the heat source information that has been camouflaged is combined is generated. The generated fusion image can be displayed on a single monitor. Thus, the operator can monitor the image including the scene understanding information and the heat source information only by observing the fused image displayed on the single monitor, and the workload of the operator monitoring work is significantly reduced. become.

[0007]

【Example】

(First Embodiment) FIG. 1 is a block diagram showing the arrangement of a monitoring image display apparatus, that is, a multispectral image fusion display apparatus according to the first embodiment of the present invention. As shown in FIG. 1, the visible image signal 3 obtained by the visible image pickup device 1 is output to the edge information detection device 5 and the image fusion device 9.
The infrared image signal 4 obtained by the infrared imaging device 2 is output to the hot point detection device 6 and the image fusion device 9.

The edge information detecting device 5 performs differential processing such as filtering and arithmetic processing on the input visible image signal 3, and then performs a binarization processing by providing a fixed threshold value to obtain a differential binary value. Image (edge information)
Is what you get. By performing such a process, a boundary portion (for example, a boundary portion between foreign matters such as a horizontal line, a horizon line, and a ridgeline) on the image where the brightness changes drastically is extracted.

The hot point detection device 6 obtains a binary image (hot point) by performing a binarization process on the input infrared image signal 4 with a constant threshold value and removing noise. ing. By performing such processing, only the high temperature portion of the infrared image in which the high temperature portion is represented by high brightness is extracted.

Both the edge information signal 7 detected by the edge information detecting device 5 and the hot point information signal 8 detected by the hot point detecting device 6 are output to the image fusing device 9.

The image fusion device 9 includes a visible image signal 3 output by the visible image pickup device 1, an infrared image signal 4 output by the infrared image pickup device 2, an edge information signal 7 output by the edge information detection device 5, and This is a device for selectively superimposing the hot point information signal 8 output from the hot point detection device 6 and generating a fusion image signal 10. The generated fusion image signal 10 is output to the monitor 11. The image fusing device 9 is provided with a designation input terminal 12 for selectively designating images to be overlaid, so that arbitrary images can be combined.

FIG. 2 is a block diagram for explaining the operation of the above embodiment. The external information captured by the visible image pickup device 1, that is, the visible image signal 3 is subjected to a differentiation process and a noise removal process in an edge information detection device 5 to obtain an edge information signal 7
Becomes The external information captured by the infrared imaging device 2, that is, the infrared image signal 4 is binarized by the hot point detection device 6 to extract a high-luminance portion, and becomes a hot point information image 8.

Visible image signal 3 input to the image fusion device 9
And the hot point information signal 8 are added by the adder 21 incorporated in the image fusion device 9. That is, the hot-point information signal 8 is added to the visible image signal 3 to perform so-called overwriting, and a fusion image signal 10A indicating a fusion image with an emphasis on the visible image is obtained. The fusion image signal 10A is sent to the monitor 11.

A supplementary description will be given of the fused image signal 10A. If only the visible image signal 3 from the visible image device 1 is used, for example, it is difficult to detect a moving high temperature object. However, by superimposing the hot point information signal 8 from the hot point detection device 6 on the visible image signal 3, it is possible to accurately capture a moving high temperature object. Even when the moving high-temperature object is traveling on the ground where the temperature is high, for example, the boundary between the ground portion and the moving object can be clearly discriminated by the visible image signal 3, so that the high-temperature disturbance caused by the high-temperature ground is high. It will not be adversely affected.

Similarly, the infrared image signal 4 and the edge information signal 7 input to the image fusing device 9 are added by the adder 22 incorporated in the image fusing device 9. That is, the edge information signal 7 is added to the infrared image signal 4 to perform so-called overwriting, and a fusion image signal 10B indicating a fusion image with emphasis on the infrared image is obtained. The fused image signal 10B is sent to the monitor 11.

A supplementary description will be given of the fused image signal 10B. If there is only the infrared image signal 4 from the infrared image device 2, the boundary between the two becomes unclear unless there is a temperature difference between the sky and the mountain, for example. Therefore, for example, even if an automobile exists at the foot of a mountain, the infrared image signal 4 of the engine unit can be obtained, but it cannot be determined that the target object is an automobile only by this. Of course, the relative positional relationship with the surrounding area is also unknown. However, when the edge information signal 7 obtained by the edge information detection device 5 is superposed on the infrared image information 4, it becomes clear that there is a hot point at the foot of the mountain,
From the relative positional relationship, it can be determined that an automobile exists there.

(Modification) As shown by the dotted line in FIG. 1, a plurality of image pickup devices each provided with an optical sensor capable of detecting light of another different wavelength and converting the detected light of each wavelength into an image signal. (None of them are shown) and a plurality of detectors (none of which are shown) for detecting image information specific to each wavelength from the image signals output by the plurality of image pickup devices may be included. .

(Summary of Embodiments) The following is a summary of the configuration and operational effects of the surveillance image display device, that is, the multispectral image fusion display device shown in the embodiments. [1] The multispectral image fusion display device of the present embodiment includes a plurality of image pickup devices 1 and 2 each including an optical sensor capable of detecting light of different wavelengths and converting the detected light of each wavelength into an image signal. , And a plurality of detection devices 5, 6, which detect image information signals 7, 8 ... Peculiar to each wavelength from the image signals 3, 4 ... Output by the plurality of imaging devices 1, 2 ,. , And image information signals 7 and 8 peculiar to each wavelength detected by the detection devices 5 and 6 and image information signals 3 and 4 output from the plurality of imaging devices 1, 2 ,. Image signal 1 by selectively superposing
The image fusion device 9 for generating 0 and the monitor 11 for displaying the fusion image output by the image fusion device 9 are provided.

In the multi-spectral image fusion display device, the light of each wavelength captured by each photosensor in each of the image pickup devices 1, 2, ... Is converted into image signals 3, 4 ,. , 4 ... Only the effective image information signals 7, 8 ... Are extracted for each wavelength. That is, only the advantages of each sensor are effectively utilized. The detected image information signals 7 and 8 peculiar to each wavelength and the image signals 3 and 4 are selectively overlapped to form an integrated image information signal 10. It can be displayed on one monitor 11.
Therefore, the operator only needs to monitor the single monitor, and the workload of the operator monitoring work is significantly reduced. [2] The multi-spectral image fusion display device of this embodiment includes a visible image pickup device 1 that captures an image of the external world by a visible sensor and converts it into an image signal 3, and an image that is the same as the image of the external world captured by an infrared sensor. An infrared image pickup device 2 for converting into a signal 4, an edge information detection device 5 for detecting an edge information signal 7 indicating a contour line from a visible image signal 3 output by the visible image pickup device 1, and an output of the infrared image pickup device 2. A hot point detection device 6 for detecting a hot point indicating a high temperature portion from the infrared image signal 4, a visible image signal 3 output by the visible image pickup device 1, an infrared image signal 4 output by the infrared image pickup device 2, and the edge information. The edge information image signal 7 output by the detection device 5 and the hot point information signal 8 output by the hot point detection device 6 are selectively An image fusion device 9 for generating a fusion image to fit it, is characterized by comprising a monitor 11 for displaying the fused image signal 10 by the image fusion device 9 outputs.

In the multispectral image fusion display device, the visible light captured by the visible sensor in the visible image pickup device 1 and the infrared light captured by the infrared sensor in the infrared image pickup device 2 are both image signals 3, 4. Is converted to. Then, the edge information detection device 5 detects the edge information signal 7 indicating the outline which is the scene understanding information from the visible image signal 3 output by the visible image pickup device 1, and the hot point detection device 6 also detects the infrared image pickup device 2. A hot point indicating a high temperature portion, which is heat source information, is detected from the infrared image signal 4 output by the. The visible image signal 3, the infrared image signal 4, the edge information signal 7, and the hot point information signal are selectively superposed on each other in the image fusion device 9, and it is difficult to understand the scene from the infrared image signal 4. A fusion image signal 10 is generated by combining the information and the visible image signal 3 with heat source information that has been camouflaged and is difficult to grasp. Generated fusion image signal 1
0 can be displayed on a single monitor 11. Thus, the operator only has to monitor the image displayed on the single monitor, which significantly reduces the workload of operator monitoring work. [3] The multi-spectral image fusion display device of the present embodiment is characterized in that it is provided with means (terminal 12 etc.) for selectively designating images to be superimposed by the image fusion device 9.

In the above multi-spectral image fusion display device, the type of each image to be fusion-formed with the image to be monitored can be selectively designated according to the purpose of use of the device, so that an effective and desired fusion image is produced. It is possible to perform system monitoring, etc., and perform appropriate monitoring suitable for the purpose of use.

[0022]

According to the present invention, one fusion having each feature point of a plurality of images captured by a plurality of image pickup devices without displaying a plurality of images by a plurality of image pickup devices on a plurality of monitor screens. An image can be displayed on a single monitor screen, the workload of the operator is light, and a monitoring image display device with high monitoring capability (target finding capability) can be provided.

[Brief description of drawings]

FIG. 1 is a block diagram showing the configuration of a multi-spectral image fusion display device according to a first embodiment of the present invention.

FIG. 2 is a block diagram for explaining the operation of the first embodiment of the present invention.

FIG. 3 is a block diagram showing an example of a conventional monitoring image display device.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Visible imaging device 2 ... Infrared imaging device 3 ... Visible image signal 4 ... Infrared image signal 5 ... Edge information detection device 6 ... Hot point detection device 7 ... Edge information signal 8 ... Hot point information signal 9 ... Image fusion device 10 ... Fusion image signal

Claims (2)

[Claims] 1. A plurality of image pickup devices, each of which is provided with an optical sensor capable of detecting light of a different wavelength, and converts the detected light of each wavelength into an image signal, and images output by the plurality of image pickup devices. From the signal, a plurality of detection devices that detect image information unique to each wavelength, image information unique to each wavelength detected by each detection device, and image information output from the plurality of imaging devices are selectively selected. An image fusion device for superimposing a fusion image on the above, and a monitor for displaying the fusion image outputted by the image fusion device. 2. A visible image pickup device that captures an image of the outside world by a visible sensor and converts it into an image signal; an infrared image pickup device that captures the same image as the image by an infrared sensor and converts it into an image signal; An edge information detection device that detects edge information indicating a contour line from a visible image output by the device, a hot point detection device that detects a hot point indicating a high temperature portion from the infrared image output by the infrared imaging device, and the visible imaging A visible image output by the device, an infrared image output by the infrared imaging device, an edge information image output by the edge information detection device, and a hot point image output by the hot point detection device are selectively overlapped. An image fusing device that also generates a fused image, and a monitor that displays the fused image output by the image fusing device , Monitoring image display apparatus being characterized in that comprises a.