JPH01289390A - Picture superimposing device - Google Patents

Abstract

PURPOSE:To superimpose a picture without changing the directions of the respective light axes of an infrared camera and an optical camera with respect to a subject by making a subject size on the image pickup surface of the infrared camera conform to the subject size on the image pickup surface of the optical camera with the regulation of the zoom lens of the optical camera. CONSTITUTION:The title device consists of an image formation area selector means 11 to select an arbitrary area from an image formation area on the image pickup surface of an optical camera 5, and a size regulating means to make the size of an subject 1 on the image pickup surface of an infrared camera 4 conform to the size of the subject 1 on the image pickup surface of the optical camera. Since the visual field of the optical camera 5 is set larger than the visual field of the infrared camera 4, the visible picture can be reduced and superimposed on the infrared picture while the infrared picture on a TV monitor 7 is being observed. Thus, the picture can be superimposed without changing the respective light axes of the infrared camera and the optical camera with respect to the subject.

Description

[Detailed Description of the Invention] [Summary] Regarding an image superimposing device that displays a visible light image superimposed on an infrared image displayed on an infrared imaging device, each optical axis of an infrared camera and a visible camera with respect to a subject is The purpose of the present invention is to provide a dual-lens image superimposition device that can superimpose images without changing the direction of the image, and is equipped with an infrared camera that images the same subject on different optical axes, and a visible camera with a zoom lens. In a two-lens image superimposition device in which the field of view of the visible camera is set larger than the field of view of the infrared camera, an imaging area selection means for selecting an arbitrary area from the imaging area on the imaging surface of the visible camera; The image forming apparatus includes a size adjusting means that matches the size of the subject on the imaging surface of the camera with the size of the subject on the imaging surface of the visible camera by adjusting the zoom lens of the visible camera.

[Industrial application field]

The present invention relates to an image superimposing device that displays a visible light image superimposed on an infrared image displayed on an infrared imaging device.

Infrared imaging devices detect infrared rays emitted according to the temperature of the subject and display images as temperature patterns, and are used for industrial purposes (power equipment maintenance inspection, IC, etc.) as non-contact temperature observation devices or night vision devices. Thermal design and inspection of printed boards, etc., and building diagnosis.

It is used for intruder monitoring, fire alarm, rescue) and medical purposes (diagnosis of blood circulation disorders, pain, cancer, etc.).

In these applications, infrared images display temperature patterns, which are different from so-called visible images (images seen by the human eye), making it difficult to determine where the subject is looking (especially when the subject is visible). There was a problem that the parts were far apart or had a complicated shape). As a means to solve this problem, there is a method of separately providing a visible camera and displaying a visible image superimposed on an infrared image to assist in identification.

[Conventional technology]

FIG. 6 shows a block diagram of a conventional single-lens image superimposing device. In the figure, 1 is a subject, and 2 is a wavelength selective filter that optically separates visible light and infrared light on the same optical axis.The visible light contained in the incident light is reflected and the visible light contained in the incident light is reflected. Infrared light is transmitted and separated. 3 is a reflecting mirror, 4 is an infrared camera, 5 is a visible camera, 6 is an addition circuit that adds the video signals output from each camera while synchronizing them, and 7 is a T that displays the added composite video signal as a superimposed image.
V monitor is shown.

FIG. 7 shows a block diagram of a conventional twin-lens image superimposing device. In the figure, blocks with the same symbols as in FIG. 6 indicate the same parts. In the figure, 8 and 8' indicate optical axis setting stands for adjusting the optical axis viewing angles of the infrared camera 4 and the visible camera 5, respectively. The infrared camera 4 and the visible camera 5 are arranged close to each other, and each observes the same subject 1 from different optical axes.

FIG. 8 is a diagram showing parallax in the two-lens system.

The angle θ (parallax) formed by the optical axis between the image cameras, the viewing angle θV of the visible camera, and the viewing angle θr of the infrared camera are made equal so that the visible image v2 and the infrared image R2 match at the distance L2 to the subject. Suppose you set it. In this state, if you observe a subject closer to you or farther away, the visible/infrared image will have V l/Rt due to the parallax θ, as shown in the figure.

Vz/R: A deviation occurs as shown in +. In the conventional method, the optical axis setting table 8 shown in FIG. 7 is used as a means to correct this deviation.
The parallax θ was adjusted each time using 8° so that the viewing angles of both cameras were equal.

[Problem to be solved by the invention]

The single-lens image superimposition device shown in FIG. 6 has the advantage of reducing parallax, but has the disadvantage of being expensive and large because it requires a visible/infrared separation optical system. In addition, the twin-lens image superimposition device shown in Fig. 7 has an hour wheel configuration, which is suitable for miniaturization, and is inexpensive, but on the other hand, it suffers from parallax as explained in Fig. 8 because it observes with different optical axes. It is large, and it is necessary to constantly adjust the orientation of both cameras using optical axis setting tables 8, 8' in accordance with the distance to the subject, which has the disadvantage of being complicated.

The present invention has been made in view of the above-mentioned conventional drawbacks, and an object of the present invention is to provide a twin-lens image superimposition device that can superimpose images without changing the directions of the optical axes of an infrared camera and a visible camera with respect to the subject. shall be.

[Means to solve the problem]

FIG. 1 is a block diagram showing the principle configuration of the present invention.

A two-lens type image that includes an infrared camera 4 that images the same subject 1 on different optical axes and a visible camera 5 with a zoom lens 9, and the field of view of the visible camera 5 is set to be larger than the field of view of the infrared camera 4. In the superimposing device, an imaging area selection means 11 for selecting an arbitrary area from the imaging area on the imaging surface of the visible camera 5, the size of the subject 1 on the imaging surface of the infrared camera 4, and the visible camera 5
and a size adjusting means for adjusting the zoom lens 9 of the visible camera 5 to match the size of the subject I on the imaging surface of the image capturing surface.

FIG. 3 is a block diagram of an embodiment of the present invention. Image tube 10
The imaging area JZ selection means 11 includes a horizontal/vertical deflection voltage generation circuit 12 that controls the amplitude and offset voltage of each horizontal/vertical deflection voltage of the image pickup tube 10; The infrared camera control circuit 13 supplies a synchronization signal to the vertical deflection voltage generation circuit 12.

FIG. 4 is a block diagram of another embodiment of the invention. The imaging area selection means 11 includes a visible camera 5 with a zoom lens including the infrared camera 4 and a solid-state image sensor 19, and a frame memo 5 for digitizing and storing the output of the visible camera 5; an operation section 16 that reads out an area to be read out from the memory 15 in accordance with the imaging screen of the infrared camera 4; a frame memory control section 17; a D/A converter 18 that converts the read data from the frame memory 15 into analog; It comprises an infrared camera control circuit 13 that supplies a synchronization signal to the frame memory control section 17.

[For production]

Since the field of view of the visible camera 5 is set to be larger than the field of view of the infrared camera 4, while observing the infrared image on the TV monitor 7, the visible image is reduced and superimposed on the infrared image. A synchronization signal from the infrared camera control circuit 13 is used to combine the video signals of both cameras using an adder circuit.

In the case of FIG. 3, the vertical and horizontal screen sizes of the image pickup screen output by the visible camera 5 can be freely controlled by varying the amplitude of the horizontal/vertical deflection voltage of the image pickup tube 10, and the center position of the screen is set by the offset voltage. It can be set by varying . As a result, the visible image of the subject is aligned while observing the infrared image on the TV monitor, and the size of the subject is adjusted by adjusting the zoom lens 9.

In the case of FIG. 4, the visible video signal output from the visible camera 5 is A/D converted and stored in the frame memory 15, and the frame memo is continuously output from January 5 through the operation unit 16 and frame memory control unit 17. The area is set to match the imaging screen of the infrared camera 4, and the size of the subject is determined by the zoom lens 9.
Adjust to match.

〔Example〕

Embodiments of the present invention will be described in detail below with reference to the drawings.

Note that, in order to make the explanation of the configuration and operation easier to understand, the same parts are given the same reference numerals throughout all the figures, and repeated explanation thereof will be omitted.

FIG. 1 is a block diagram showing the configuration of the present invention.

In the figure, 9 is a zoom lens provided in the visible camera 5, 10 is an imaging tube built into the visible camera 5, and 11 is an imaging area for selecting an arbitrary area from the imaging area on the imaging surface of the visible camera 5. Indicates selection means.

The infrared camera 4 and the visible memo 5 are placed close to each other, and each observes the same subject 1 from different optical axes.

FIG. 2 shows a diagram illustrating the principle of the present invention, which will be explained below with reference to FIG. 1. In the present invention, the visible camera 5 has an image pickup tube 1.
0, the viewing angle θV of the visible camera 5 is set wider than the viewing angle θr of the infrared camera 4 as shown in the figure, and each distance ML
Visible image imaging area at t, Lz, Li'h, Vt,
Infrared image capturing area RI+Rz at Vx.

Ensure that all R1 are included. Visible image capturing areas V,, V2. By providing means for selecting and reading out the regions corresponding to the infrared image capturing regions R+, lh, and Ih from V, images from both cameras can be superimposed without parallax and without changing the optical axis direction.

FIG. 3 shows a block diagram of an embodiment of the invention. In the figure, the imaging area selection means 11 of FIG.
It consists of a horizontal/vertical deflection voltage generation circuit 12 that controls the amplitude and offset voltage of each vertical deflection voltage, and an infrared camera control circuit 13 that supplies a synchronization signal to the horizontal/vertical deflection voltage generation circuit 12.

The horizontal/vertical deflection voltage generation circuit 12 provides horizontal/vertical deflection of the image pickup tube 10.
It applies a deflection voltage to each vertical deflection electrode, and is composed of a horizontal deflection voltage generation circuit 12a and a vertical deflection voltage generation circuit 12b, each of which is equipped with a variable amplitude volume and a variable offset voltage volume. ing. These circuit outputs can freely control the vertical and horizontal screen sizes, and the horizontal, vertical, and vertical movement of the center position of the screen size can be set by varying the horizontal/vertical offset voltages. As a result, the visible image of the subject is aligned while observing the infrared image on the TV monitor, and the size of the subject is adjusted by adjusting the zoom lens 9.

The infrared video signal output from the infrared camera 4 includes a horizontal/vertical synchronization signal necessary for displaying an image on the TV monitor 7, and the visible video signal output from the visible camera 5 is also added using the synchronization signal. The addition signal in circuit 6 is synchronized.

FIG. 5 shows an explanatory diagram of image alignment according to the present invention.

+3> The figure shows an infrared image screen, where ■ is the display position of the gray scale and color scale, ■ is the display position of the infrared image, and ■ is the display position of text information, where the temperature range and other code explanations are displayed. ■ indicates the subject.

(Figure bl shows the screen of the visible image (before correction), and the frame (■) indicated by a broken line indicates the position of the infrared image range corresponding to the infrared image display position (■) in the infrared image in Figure 81.

When superimposing an infrared image and a visible image, it is necessary to modify and superimpose the visible image (b) on the infrared image display position (3). Comparing the two figures, the object (2) in the visible image (bl) is shifted downward from the object (2) in the infrared image display position, so it is necessary to move it upward.

(C) is a diagram showing the modification order of visible images. In the figure, ■ indicates the area to be moved, and excluding the positional deviation on the screen, it almost matches the relative position of the subject ■ within the infrared image display position ■, and the amount of movement A is required to correct the deviation.
can be easily moved by adjusting the variable offset volume of the vertical deflection voltage generating circuit 12b shown in FIG.

Horizontal movement of the area (2) to be moved is possible by adjusting the offset variable volume in the horizontal deflection voltage generating circuit 2a in Figure 3, and the horizontal frame width can be adjusted by adjusting the amplitude variable volume. Can be adjusted to fit any frame width.

However, even if the objects are superimposed in this manner, the objects still differ in size due to the difference between the viewing angle θV of the visible camera 5 and the viewing angle θr of the infrared camera 4 and the parallax θ. In order to correct this, the zoom lens 9 is adjusted to match the size. If the zoom lens 9 is made electric, the image superimposition time will be further shortened.

FIG. 4 shows a block diagram of another embodiment of the invention. In the figure, the imaging area selection means 1 shown in FIG. an operation unit 16 for reading data in accordance with the image capturing screen; a frame memory control unit 17; and a D for converting read data from the frame memory 15 into analog data.
It consists of an /A converter 18 and an infrared camera control circuit 13 that supplies a synchronization signal to the frame memory control section 17.

14 is an A/D converter that digitizes the visible video signal output by the visible camera 5; 15 is a frame memory that stores data output from the A/D converter 14; 16 is a four-input and readout condition for the frame memory 15; The operating section 17 is a frame memory control section that performs address control corresponding to the setting conditions of the operating section 16, and utilizes the synchronization signal output by the infrared camera control circuit 13 both during writing and during continuous output. Reference numeral 18 denotes a D/A converter for converting the data read from the frame memory 15 into a visible video signal. The visible camera 5 also includes an infrared camera control circuit 13.
It operates in synchronization with the infrared camera 4 by the synchronization signal outputted by the infrared camera 4.

The image alignment in FIG. 4 will be explained with reference to FIG. In order to move the desired area ■ to the infrared image range ■, conversely, use the keyboard, etc. of the operation unit 16 to start reading the address corresponding to the 8 read start positions in the frame memory 15 from point 0. You can set it using . The data stored in the frame memory 15 can be read and the position of the subject (2) can be moved freely by designating an address.

However, as explained in FIG. 3, if this continues, the viewing angle θV of the visible camera 5 and the viewing angle θ
The size of the object differs due to the difference in r and the parallax θ. In order to correct this, image superimposition becomes possible by adjusting the zoom lens 9 and matching the sizes. It goes without saying that this embodiment can also be applied to the visible camera 5 having the image pickup tube 10.

〔Effect of the invention〕

As is clear from the above description, according to the present invention, image shift due to parallax, which is a drawback of the two-lens system, can be electrically corrected using a simple circuit without changing the optical axis of the camera, and is inexpensive and compact. , and a visible/infrared image superimposition device with good operability can be provided.

[Brief explanation of the drawing]

Fig. 1 is a block diagram showing the principle configuration of the present invention, Fig. 2 is a diagram explaining the principle of the invention, Fig. 3 is a block diagram of an embodiment of the invention, and Fig. 4 is a block diagram of another embodiment of the invention. 5 is an explanatory diagram of image combining according to the present invention, FIG. 6 is a block diagram of a conventional single-lens image superimposing device, FIG. 7 is a block diagram of a conventional twin-lens image superimposing device, and FIG. The figures show the parallax in the two-lens system, Figures 1 and 2.
In the figure and FIG. 3, ■ is a subject, 4 is an infrared camera, 5 is a visible camera, 9 is a zoom lens, 10 is an image pickup tube, 11 is an imaging area selection means, 12 is a horizontal/vertical deflection voltage generation circuit, 13 is an infrared camera control circuit, 14 is an A/D
15 is a frame memory, 16 is an operation section, 17 is a frame memory control section, 18 is a D/A converter, and 19 is a solid-state image sensor.

Claims (3)

[Claims] (1) Equipped with an infrared camera (4) that images the same subject (1) on different optical axes and a visible camera (5) with a zoom lens (9), the field of view of the visible camera (5) is In a two-lens image superimposition device set to be larger than the field of view of the camera, the imaging area selection means (11) selects an arbitrary area from the imaging area on the imaging surface of the visible camera (5), and the infrared camera (4) The size of the object (1) on the imaging surface of the visible camera (5) and the size of the object (1) on the imaging surface of the visible camera (5) are calculated using the zoom lens (9) of the visible camera (5). An image superimposing device comprising: size adjusting means for adjusting the size to match the size. (2) A visible camera (5) having an image pickup tube (10); Claim (1) comprising: a vertical deflection voltage generating circuit (12); and an infrared camera control circuit (13) supplying a synchronizing signal to the horizontal/vertical deflection voltage generating circuit (12). ). (3) The imaging area selection means (11) includes a visible camera (
Frame memory (5) that digitizes and stores the output of
15), and an operation unit (
16), a frame memory control unit (17), and a D that converts read data from the frame memory (15) into analog.
/A converter (18) and the frame memory control section (
The infrared camera control circuit (17) supplies a synchronization signal to the infrared camera control circuit (17).
Claim (1) characterized in that it consists of 3).
The image superimposition device described.