RU2786356C1 - Dual-spectrum video surveillance system - Google Patents

Abstract

FIELD: television.

SUBSTANCE: present invention relates to the field of multispectral television and pertains to a dual-spectrum video surveillance system. System comprises a mirror-lens objective with a first and a second matrix photodetectors. Optical filters for the visible and infrared spectral regions are included in front of the first and second matrix photodetectors. Mechanical adjustment units for adjusting the relative positioning of the first and the second matrix photodetectors in six degrees of freedom are also included in the mirror lens objective for each matrix photodetector. Additionally, a unit for digitally spatially aligning individual elements of the image in the visible and infrared regions is included between the output of the matrix photodetectors and the video processor, and a video signal switch is included between the video processor and the video monitoring apparatus.

EFFECT: higher accuracy of elementwise combination of two multispectral images in a single resulting image and higher reliability and effectiveness of video surveillance and analysis of objects.

3 cl, 2 dwg

Description

The invention relates to the field of multispectral television and can be used for video surveillance of objects in the surrounding space and image analysis. It provides for the joint formation of television and thermal imaging by recording and converting the reflected and radiated radiant flux in the visible and infrared regions of the spectrum into image signals. It can be used in guidance systems, surveillance and flight systems, in robotics, vision systems for solving the problems of video surveillance of objects in the daytime and at night.

To observe objects on the earth's surface from aircraft (LA), various optoelectronic systems (OES) are used, each of which has its own advantages and disadvantages, determined by the methods and devices used for recording and converting the reflected or radiated radiant flux from objects into image signals and methods their processing. The amount of radiant energy reflected or radiated from the earth's surface primarily depends on the amount of energy received from the Sun, which is the natural basic source of radiation.

The idealized radiation spectrum of the Sun, as the main source of the radiant flux J(λ), which is directed at the objects of the material world of the Earth, includes gamma rays and the radiant flux of the ultraviolet (UV), visible (VI) and infrared (IR) regions of the spectrum. As is known, the main energy flux of solar radiation falls on the VI and near UV and IR regions of the spectrum in the ratio 40:10:50. Almost all (99.9%) of the radiant energy that came from the Sun to the earth's surface falls on the spectral region from 0.3 to 3.0 microns, with a predominance in the visible region of the spectrum (maximum about 0.55 microns). The Earth, having accumulated solar energy, itself becomes a source of radiation in the wavelength range λ=3.0-40 µm with a maximum in the range λ=8-14 µm [1].

The advantages of the near-IR region of the spectrum (1.0-2.5 µm) for conducting video surveillance at night are known, which include: a high level of natural night illumination at a wavelength of λ=1.6 µm, a high level of target contrast, increased transparency atmosphere and a number of other factors. It should be noted that in the wavelength range of 1.4-1.7 μm, the transparency of the atmosphere increases significantly and, by more than an order of magnitude (compared to the VI region of the spectrum), the brightness of atmospheric haze decreases. Therefore, the radiant flux in this wavelength range passes better through certain types of smoke, dust, and fog, which makes it possible to provide a greater probability of detection, selection, and identification of observed objects.

The atmosphere significantly attenuates and spectrally transforms solar radiation due to scattering and absorption by gas molecules, water vapor, and solid particles. Thus, the radiation spectrum of the Earth's surface has two maxima during the day - one at a wavelength of about 0.55 microns, due to reflected solar radiation, and the second - at a wavelength of about 10.0 microns, due to the Earth's own thermal radiation. This suggests that, along with the reflectivity of the radiant flux, most objects of the material world, due to their natural or artificial heating, themselves emit a radiant flux F _rad (λ) in the thermal part of the IR region of the spectrum.

As is known, at night the radiation spectrum of the earth's surface changes, only the maximum in the region of intrinsic radiation remains, and in the region of reflection the maximum disappears. The range of 3.0-5.0 µm is typical for registration of the emitted radiant flux, for example, during fires, since this corresponds to the temperature of burning objects. The range of 8.0-14.0 µm is typical for registration of the radiant flux of heated (cooled) natural objects on the Earth's surface or artificial objects having a different temperature compared to the background objects. Thus, the observation of objects at night can be carried out by registering the radiant flux in the thermal part of the IR region of the spectrum in the spectral regions of 3-5 µm and 8-14 µm.

An important characteristic of the visual perception of objects of optical images is the contrast sensitivity of the eye - the ability to distinguish some objects against the background of others [1], due to their unequal brightness, which is determined by the radiative or reflective properties of the observed objects in a given space and spectral interval.

There are various options for determining the contrast of objects k _i in optical images, for example,

where B _i and B _j - brightness values i and j - observed objects, while the contrast value can take values in the range 0<k ₁ ≤1.

Usually the object of interest (selection object) is observed against the background of another object. Each of them can have a certain brightness, color and reflectivity. The difference between the object of observation and the background will be recorded by the human visual analyzer if the contrast in brightness between them exceeds a certain threshold value

ε - contrast sensitivity threshold of the eye, is assumed to be equal to 0.01≤ε≤0.02.

According to (2), the distinction of one object against the background of another is possible if the contrast between them is higher than the minimum allowable contrast. Thus, when observing objects in images, an important place is occupied by the minimum value of the brightness increment that can be detected by the human visual apparatus.

At low contrast values, the observed image is considered low-contrast. Low-contrast images are typical for objects with minimal reflectivity, low illumination, or a large distance from the place of their observation. Therefore, a reliable and high-quality solution to the problems of observation and analysis

images, primarily due to the possibility of obtaining contrast images.

Naturally, various types of applied optoelectronic, television (TV) and thermal imaging (TPV) systems and devices are used to monitor the state and control of certain objects on the earth's surface and their movement in space. They register a radiant (light) flux within a wide spectral region from λ ₁ to λ _n . The principles of forming video signals using separate black-and-white, color and spectral-zonal TV cameras, as well as using TPR cameras for visual analysis of object images, are reflected in the literature [1].

For the formation of black-and-white and color TV images, registration of the light flux in the VI region of the spectrum is used. In the transmitting path of the TV system, image signals are formed and processed, and in the receiving path they are displayed on the screen of video control devices in the form of black-and-white or color images.

Spectrozonal TV images can be formed by registering a radiant (light) flux in the UV, VI and IR regions of the spectrum. The information content of such images can be much higher (tens of times) compared to color RGB images, and especially when distinguishing objects of the earth's surface that have the same spatial features (in shape, size, etc.).

Today, there is a large class of thermal imaging devices in which matrix photodetectors (MPDs) operating in broadcast TV format are used to register the radiant flux from objects, which makes such systems in some cases indispensable for observing objects on the earth's surface at night, even in black - white form. The generated signals can be presented in analog or digital format.

For a complete solution of problems, taking into account the "transparency windows" of the atmosphere, it is necessary to register the radiant flux of objects on the underlying surface of the Earth in various spectral regions of the optical region of the spectrum:

- VI section of the spectrum 0.38-0.76 microns;

- near IR ₁ part of the spectrum 0.76-2.5 microns;

- IR ₂ parts of the spectrum 3.0-5.0 µm;

- IR ₃ parts of the spectrum 8.0-14.0 µm.

Thus, for video surveillance of objects using OES operating in TV format, it is preferable to use two ranges of registration of the radiant flux. The first one includes the registration of the reflected radiant flux in the VI and near IR ₁ regions of the spectrum, and the second includes the registration in the daytime of the partially reflected radiant flux in the IR ₂ region of the spectrum and the intrinsic thermal radiation of objects from the IR ₂ or IR ₃ regions of the spectrum under poor conditions visibility or at night. In the first range, a separate registration in (VI+IR ₁ ) sections of the spectrum can also be carried out.

Based on the number of spectral sections (zones) of registration of the radiant (light) flux, all signal sources of multi-spectral images using the vertical TV scanning method can be divided into two main classes of spectral-zonal systems:

1. Two-channel systems.

2. Multichannel systems.

This classification reflects the technical and information composition of such systems, which provide for the formation of two or more signals of multispectral TV images of the observed space, due to the registration of the radiant flux in various sections (zones) of the optical spectrum, including UV, VI and IR regions of the spectrum As TV signal sensors images, CCDs, CMOS photodetectors or other converters of the radiant (light) flux into an electrical image signal can be used, while they can be single-signal, two-signal or multi-signal.

The use of two different spectral sections (zones) of registration, including the VI and IR regions of the spectrum in video surveillance systems, will ensure their round-the-clock use, as well as increase the detectivity of objects. In this regard, the methods and schemes for constructing the input link of spectral-zonal cameras that record the radiant flux in different spectral regions, including the VI and IR regions of the spectrum, can be different.

There are single-channel, two-channel and multi-channel schemes of the input optical-electronic path of the OES for recording and converting the radiant flux and generating signals of multispectral TV images [2, 3].

For example, with a single-channel input circuit, one lens (O), an optical filter (OF), and a matrix photodetector (MPD) are used, which form one autonomous channel in which an image signal is formed, due to the registration of the radiant flux in a specific spectral region. There may be several such autonomous channels.

The disadvantage of this method and the scheme itself for constructing the input link is manifested in the following. When building a two-spectrum video surveillance system, the input radiant flux, which is reflected from the observed objects, for example, in the MI region of the spectrum, must be projected onto the working surface of the matrix photodetector (MFD) through the first lens, and the radiated flux of the middle or far IR region of the spectrum must be passed through another lens. That is, with such a scheme for constructing the input optoelectronic link, two separate lenses are used in the camera.

Due to the fact that the center of the optical axis of these lenses will be spaced apart in space by a certain value ΔХ or ΔУ, the location of object images in the formed images of the VI and thermal IR regions of the spectrum will also be shifted to each other by a certain value Δх or Δу.

This circumstance, when performing the operation of combining two multispectral images into one single one, does not allow for element-by-element exact alignment of two separate images in the synthesized image along the raster. Due to this, the quality of visual perception and analysis of objects in such images will deteriorate and the reliability of performing operations for automatic analysis of objects will not be ensured.

In this regard, to eliminate this drawback, mirror-lens objectives are often used, which can split the input radiant flux of different spectral sections into several streams, while the optical axis for all individual MFPs remains the same. Known patent sources reflecting the methods of splitting the input radiant flux using mirror-lens lenses.

So, for example, in the patent [4], a two-channel mirror-lens objective is considered, which splits the input radiant flux into two streams. In its composition, it contains a mirror-lens channel for the HI region of the spectrum with an image intensifier tube and a lens channel for the IR region of the spectrum. Due to the use of a dichroic mirror, the overall and mass characteristics are improved and the effective

relative aperture of the mirror-lens channel, leading to an improvement in the quality of the formed image.

According to the description, the patent [5] reflects a two-channel optical-electronic system that can be used for homing heads, optoelectronic systems for detection, recognition and auto-tracking, in particular, as part of the on-board equipment of various aircraft. The system contains the first channel and the second, coaxial to the first and installed in front of it. A distinctive feature of this patent is that a spectrum-splitting coating is applied to the convex surface of the secondary mirror, reflecting spectral radiation in the spectral region of the IR region of the spectrum Δλ ₁ = 8-12.5 μm and transmitting the reflected light flux in the VI region of the spectrum Δλ ₂ -0.4 -0.7 µm. The achieved result is an increase in image quality, an increase in the luminosity of the second channel to the luminosity of the first channel, ensuring the athermality of both channels, simplifying the design and reducing the overall weight characteristics.

A two-channel optical-electronic system is also known [6], in which each of the channels contains a lens and an MFP installed on its optical axis, while the lens of the first opto-electronic channel is made of a mirror-lens with central shielding, and the second opto-electronic channel is installed in front of the first, having a common optical axis with it, characterized in that the diameter of each of the components of the second optoelectronic channel does not exceed the diameter of the central shielding zone of the lens of the first optoelectronic channel. The salient feature of this patent is that

- both optical-electronic channels can be television;

- both optical-electronic channels can be thermal imaging;

- the first optical-electronic channel can be television, and the second can be thermal imaging.

There is also a patent [7], which considers a high-aperture mirror-lens objective. The separation of the radiant flux of the VI and IR range is carried out on a common aspherical surface, which has a special coating that reflects the radiant flux of the IR region of the spectrum and transmits the radiant flux of the VI region of the spectrum. A distinctive feature of this invention is an increase in the aperture ratio of the lens and the possibility of observing the same object in different spectral ranges without increasing the dimensions.

The disadvantage is that a large number of optical elements (lenses, mirrors) are used to form a radiant flux for the first and second channels for generating TV image signals. There is no preliminary mechanical adjustment of the location of the MFP for combining images of the VI and IR regions of the spectrum in order to obtain a single resulting (synthesized) image for subsequent visual analysis and automatic registration.

As the closest analogue of the claimed invention in terms of the totality of the main features and operations on signals, an integrated television-thermal imaging system is adopted, the block diagram of which is presented in [8]. The use of two different spectral regions of registration - VI and IR spectral regions in an integrated television-thermal imaging video surveillance system will ensure their round-the-clock use, as well as increase the detectivity of objects.

On page 116 (Fig. 2) of this work, it is shown that the system uses a single two-channel mirror-lens objective. In the system, the separation of the radiant flux of the VI and IR regions of the spectrum is carried out on a known common aspherical surface, which has a special coating that reflects the radiant flux of the IR region of the spectrum and transmits the radiant flux of the VI region of the spectrum. The formation of signals of multi-spectral images of the VI and IR regions of the spectrum is carried out using the corresponding MFP, which have spectral sensitivity to the VI region of the spectrum and the IR region of the spectrum. The image signals are fed to a video processor (VP), where they are digitally processed and a single image is synthesized.

A distinctive feature of this solution is an increase in the aperture ratio of the lens and the possibility of observing the same object in different spectral ranges (VI and IR regions of the spectrum) without increasing the dimensions. At the same time, the disadvantage of this integrated tele-thermal imaging system is that when the requirement of coaxial location of the first and second MFP, which form the imaging signals of the VI and IR regions of the spectrum, is met, the MFP is not aligned with each other relative to a single optical axis of the mirror-lens objective.

This solution does not provide for such an important operation, which is associated with the preliminary combination of multispectral images obtained in the VI and IR regions of the spectrum to form a single resulting image. Misregistration of images will lead to fatigue of the work of the observer (operator) and, as a result, to a deterioration in the quality of the analysis of the synthesized image. To eliminate this shortcoming, it is necessary to provide for separate units and operations associated with the alignment of the formed multispectral images of the VI and IR regions of the spectrum with each other.

To do this, it is advisable to first perform a preliminary alignment of multispectral images in the transmitting camera (signal source) mechanically, by changing the position of each MFP relative to each other along the three freedom axes X, Y, Z, the possible rotation of each MFP along the X and Y axes of freedom and around the common optical axis Z, and then the final alignment of multi-spectral images is carried out electronically, in the path of image signal processing of the VI and IR regions of the spectrum.

As is known from mechanics, the number of degrees of freedom of motion of a rigid body corresponds to the number of possible independent linear and angular displacements of the body. A body that is unrestricted in its movements (it can move in any direction) is called free. The movement of a free body (for our case MFP) is possible in three main directions - along the X, Y, Z coordinate axes, as well as around these three axes, and it has 6 degrees of freedom of movement.

EFFECT: increased accuracy of element-by-element alignment of two multi-spectral images in a single resulting image with the possibility of changing the spectral sections (zones) of radiant flux registration to increase the reliability and efficiency of video surveillance and object analysis.

To achieve the technical result, a two-spectrum video surveillance system is proposed, containing in the general design a mirror-lens lens with the first and second matrix photodetectors, which have the same optical line of sight and form the first and second optoelectronic channels for registering and converting the radiant flux into visible and infrared image signals. areas of the spectrum, where the output of the first and second matrix photodetectors are connected to the inputs of the video processor, the common output of which is connected to the input of the video monitoring device that displays the synthesized image based on images of the visible and infrared regions of the spectrum, in which optical filters are additionally introduced in front of the first and second matrix photodetectors, transmitting a radiant flux of a certain wavelength with a width of Δλ ₁ and Δλ ₂ and their location in the visible and infrared regions of the spectrum, as well as for each matrix photodetector installed on an autonomous stationary In addition, blocks of mechanical adjustment of the position of both the first and second matrix photodetectors are additionally introduced into the design of the mirror-lens lens to change their position relative to each other in three main directions - along the coordinate axes X, Y, Z, as well as around these three axes on a certain angle, in addition, between the outputs of the signal processing unit of matrix photodetectors and the input of the video processor, a block for spatial alignment of individual image elements of the VI and IR regions is electronically introduced, in addition, a video signal switch is introduced between the video processor and the video control device.

In this two-spectrum video surveillance system, the listed mechanical adjustments of the position of the first and second matrix photodetectors can be used, including their rotation through a certain angle around the common optical axis of the mirror-lens objective. To change the width of the area (zone) registration of the radiant flux Δλ ₁ and Δλ _{2 of} the first and second channels of image signal formation, optical filters with different spectral characteristics are used, by changing them, for example, mechanically.

By achieving an increase in the accuracy of combining multispectral images in a single resulting image in this two-spectral system, it will be possible to use MFPs in which the total number of photosensitive elements corresponds to standard, high and ultra-high definition when forming signals of multispectral images. For the latter case, misregistration of images is the most critical.

In FIG. 1 shows a block diagram of a two-spectrum video surveillance system. It contains: in the general design, a mirror-lens lens with the first and second matrix photodetectors 1, which includes a spherical fairing 2, spherical mirrors 3, consisting of two spaced mirrors 3_one and 3₂, lens for VI region of the spectrum 4_one, IR lens 4₂, optical filter for VI spectral region 5_one, optical filter for IR 5₂, the first "light-to-signal" converter for the VI region of the spectrum 6_one, the second "radiant flux-signal" converter for the IR region of the spectrum 6₂ (hereinafter referred to as matrix photodetectors), mechanical adjustment blocks 7_one and 7₂ the positions of both the first and second matrix photodetectors (MFDs) in six degrees of freedom and having a common optical axis in a mirror-lens objective.

In addition, the system (Fig. 1) contains a clock generator 8, two blocks of digital signal processing 9 ₁ and 9 ₂ , a block for spatial alignment of multispectral images electronically 10, a video processor 11, a signal switching block 12, a video information display block 13, a block for automatic recording of video information 14, control unit 15, optical filter unit 16.

The clock generator 8 generates the necessary line, frame pulses and control pulses of a given duration and frequency, which are used to scan (read) image signals in the MFP 6 ₁ and 6 ₂ , for digital signal processing in blocks 9 and other blocks of the system 10 and 11. As TV signal sensors 6 ₁ and 6 ₂ can be used CCD sensors, CMOS photodetectors or other

radiant flux converters into image signals.

In a two-spectrum video surveillance system (Fig. 1), the total input radiant flux F(λ), reflected or radiated from objects with a wavelength from λ ₁ to λ _n , which includes the VI and IR spectral regions, passing the spherical fairing 2 of the mirror-lens lens 1 , is processed through two optical-electronic channels. This is through the first channel for registering the light flux and forming the image signal U ₁ (t) for the VI region of the spectrum and through the second channel for registering the radiant flux and forming the image signal U ₂ (t) for the IR region of the spectrum.

In the first channel, the light flux through the lens 4 ₁ passes the first optical filter (OF ₁ ) 5 ₁ and is projected onto the working surface of the first MFP 6 ₁ . The spectral characteristic (SH) f ₁ (λ) of the first OF ₁ generally covers the entire spectral region of the VI spectrum region Δλ _wi from 0.38 to 0.76 μm. It should be noted that a smaller width of the registration zone can be used and, at the same time, its possible other location in the VI region of the spectrum, when Δλ ₁ <Δλ _vi . As a result of the conversion of the light flux at the output of the MFP 6 ₁ is formed the first image signal U ₁ (t) for the VI region of the spectrum.

In the second channel, the radiant flux reflected from the spherical mirrors 3, arranged in a certain way, passes the lens 4 ₂ and the second optical filter (OP ₂ ) 5 ₂ , after which it is projected onto the working surface of the second MFP 6 ₂ . SH F ₂ (X) of the second OF ₂ in the first case covers the spectral region of the thermal IR region of the spectrum with a width of Δλ _ik2 from 3.0 to 5.0 µm or, in another case, with a width of Δλ _ik3 from 8.0 to 14.0 µm . It should be noted that a smaller width of the registration zone can be used and, at the same time, its possible other location in the IR regions of the spectrum, when Δλ ₂ <Δλ _ik2 or Δλ ₂ <Δλ _ik3 . As a result of the conversion of the radiant flux at the output of the MFP 6 ₂ is formed by the second image signal U ₂ (t) for IR ₂ or IR ₃ regions of the spectrum.

After performing these operations, the generated video signals U ₁ (t) and U ₂ (Y) are converted into digital form in signal processing units 8 ₁ and 8 ₂ . In these blocks, the preliminary amplification of signals takes place, their conversion into digital form with the formation of binary signals in a multi-bit code. Digital signal correction (gamma correction, aperture correction) and other types of digital video signal processing are carried out.

From the output of blocks 8 ₁ and 8 ₂ , the video signals are fed to the inputs of the video processor 11 for digital signal processing, from the output of which the video signals are fed to the inputs of the video signal switching unit 12 and then fed to the inputs of the video information display unit 13 and the automatic video information recording unit 14.

The video processor 11 can implement various algorithms for separate and joint signal processing of multispectral images. With separate signal processing, the fact can be taken into account that, by the amount of general distinguishing information obtained in images, there can be two characteristic situations in which for daytime there is a priority for TV images of the VI spectral region, and for nighttime - a priority for TPR images of the IR regions of the spectrum.

The most important issue, if it is necessary to synthesize two multispectral images, is the formation of a combined (resulting) image. Useful information necessary for making a decision by an observer (operator) can be distributed between images of two spectral sections. In this case, the operator is forced to analyze the images of the VI and IR regions of the spectrum and compare them with each other, which can lead to delays in making a decision.

For this reason, it is advisable to display on the screen of the display device also a combined image synthesized from two original multispectral images obtained in the VI and IR regions of the spectrum. In addition to reducing the amount of data, the goal of synthesis is to create new images that are more convenient in terms of perception / analysis by a person / machine, as well as for further image processing tasks, such as segmentation and selection of objects, their capture, etc.

From block 15, control signals are fed to the inputs of blocks 7, 10-13, 16, which set the algorithm for processing video signals, as well as various options for supplying the generated video signals to the inputs of the video information display unit, as well as to the input of the automatic video information recording unit 14. The signal from the output of the block 14 can be fed to the actuating device. The presence of block 14 allows you to solve special problems associated with the automatic detection and recognition of objects in the field of view of a two-spectrum video surveillance system.

Alignment of multi-spectral images in the system (Fig. 1) is initially carried out mechanically, by using blocks 7 ₁ and 7 ₂ , by changing the position of each MFP relative to each other along the three axes X, Y, Z, the implementation of the possible rotation of each MFP along the X axes and Y, as well as the possible rotation of each MFP around a common optical Z-axis.

The final alignment of multispectral images is carried out electronically, in the image signal processing path of the VI and IR regions of the spectrum, by using block 10, where the raster of one image is shifted relative to another in the horizontal and vertical directions and element-by-element alignment of images.

In FIG. Figure 2 shows the general arrangement of the design of a mirror-lens objective with the first and second matrix photodetectors and the path of rays during registration of the radiant flux in the VI and IR regions of the spectrum. The designations of the input link, elements and nodes of the mirror-lens objective are the same as shown in Fig. one.

The layout of the reflex lens provides for the use of a common spherical fairing 2 and coaxially arranged lens objective 4 ₁ with OF 5 ₁ and MFP 6 ₁ for the optoelectronic channel of the VI spectral region and a reflex lens 3.4 ₂ with OF 5 ₂ and MFP 6 ₂ for the optical-electronic channel in the IR region of the spectrum. Such a scheme of a mirror-lens objective makes it possible to ensure the alignment of the optical axes for the channels of the VI and IR spectral regions, as well as to obtain good optical characteristics with a fairly compact design. Structurally, the optical-electronic channel of the VI region of the spectrum is located on the outer side of the spherical mirror (counter-mirror) 3 ₁ .

The presence of separate lenses 5 ₁ and 5 ₂ in each optical-electronic channel allows you to select the characteristics of the MFP and lenses in such a way as to ensure the equality of the instantaneous fields of view in the channels of the VI and IR regions of the spectrum.

Adjustment of images with an accuracy of an image element (pixel) formed in the channels of the VI and IR regions of the spectrum is provided due to the coaxiality of the structure, as well as preliminary adjustment of the position of the MFP 6 ₁ and 6 ₂ using blocks 7 ₁ and 7 ₂ , by changing the position of each MFP relative to each other in three main directions - along the coordinate axes X, Y, Z, and also around these three axes.

The ability to variably select the characteristics of the MFP for the VI region of the spectrum allows you to choose the MFP with a larger format than the MFP for the IR region of the spectrum. This feature makes it possible to provide additional electronic alignment of rasters with pixel accuracy for two multispectral images in the electronic alignment unit 10 (Fig. 1).

In addition, due to the introduction of new optical elements into the design of the mirror-lens lens, in the form of OF 5 ₁ and 5 ₂ , it provides for the possibility of changing the width and location of the registration zone of the radiant flux reflected or radiated from objects and thereby makes it possible to increase the visibility of objects and the information content of the generated multispectral images. This is due to the fact that a reliable and high-quality solution to the problems of observation and analysis of objects, first of all, depends on the possibility of obtaining contrast images for various object/background combinations. This can be achieved, depending on the conditions of observation of objects, using, for example, certain OFs.

The presence of the switch 12 allows you to select the necessary image signals obtained by registering a radiant flux in the VI and IR regions of the spectrum, as well as in the process of generating a synthesized multispectral image to solve the tasks of visual or automatic analysis of video information generated using a two-spectrum video surveillance system.

Sources

1. Sagdullaev Yu.S., Kovin S.D. Perception and analysis of multispectral images. M.: "Sputnik +", 2016. - 251 p.

2. RF patent No. 2546982. The method of forming and displaying signals of color, spectral-zonal and thermal imaging images / Kovin S.D., Sagdullaev Yu.S. - publ. 04/10/2015 Bull. No. 1.

3. RF patent No. 2543985. The method of forming signals of television images of different parts of the spectrum / Kovin S.D., Sagdullaev Yu.S. - publ. 03/10/2015 Bull. No. 7.

4. RF patent for the invention No. 2256205. Two-channel mirror lens (options)./Zhuravlev P.V., Kosolapoe G.I., Khatsevich T.N. Published: 10.07.2005 Bull. No. 19.

5. RF patent for invention No. 2606699. Two-channel optical-electronic system / Sokolsky M.N., Efremov V.A., Lapo L.M.. Published: 10.01.2017 Bull. No. 1.

6. RF patent for utility model No. 44836. Two-channel optical-electronic system / Tarasov V.V., Zdobnikov A.E., Sukhoruchenko A.N. Published on 27.03.2005, Bull. No. 9.

7. RF patent for the invention No. 2091834. A high-aperture mirror-lens objective. / Lebedeva G.Ya., Garbul A.A., Berezansky V.M., and others. Published on September 27, 1997.

8. Berezansky V.M. Integrated tele-thermal imaging systems // Proceedings of the scientific and technical conference "Systems of observation, monitoring and remote sensing of the Earth". - M.: MNTORES them. A.S. Popova, 2006, pp. 113-122.

Claims (3)

1. A two-spectrum video surveillance system containing in the general design a mirror-lens lens with the first and second matrix photodetectors that have the same optical line of sight and form the first and second optoelectronic channels for registering and converting the radiant flux into image signals of the visible and infrared regions of the spectrum, a video processor and a video control device that displays a synthesized image based on images of the visible and infrared regions of the spectrum, characterized in that optical filters are additionally introduced in front of the first and second matrix photodetectors that transmit a radiant flux of a certain wavelength with a width of Δλ ₁ and Δλ ₂ and their location in the visible and infrared regions of the spectrum, as well as for each matrix photodetector, blocks of mechanical adjustment of the position of both the first and second matrix photodetectors are additionally introduced into the design of the mirror-lens lens to change their position about relative to each other in three main directions - along the coordinate axes X, Y, Z, as well as around these three axes, in addition, between the outputs of the signal processing unit of matrix photodetectors and the input of the video processor, a block for spatial alignment of individual image elements of the visible and infrared regions of the spectrum is introduced by an electronic way, and between the video processor and the video control device, a video signal switch is introduced. 2. A two-spectrum video surveillance system according to claim 1, characterized in that the width of the radiant flux registration zone Δλ ₁ and Δλ ₂ for the first and second optoelectronic channels for forming image signals is changed by using the first and second optical filters with different spectral characteristics. 3. A two-spectrum video surveillance system according to claim 1, characterized in that the registration of the reflected and radiated radiant flux from objects is carried out using the first and second matrix photodetectors, in which the total number of photosensitive elements corresponds to the standard, high and ultra-high definition signal formation of multispectral images.

Images