CN116659680A - An Infrared Aerial Camera Supporting Different Speed Image Motion Compensation Function - Google Patents

Abstract

The application provides an infrared aerial camera supporting an abnormal speed image motion compensation function, which comprises an inertial navigation system, a reconnaissance management system, a camera controller, an infrared detector light shield, an infrared array CCD detector optical system, an electronic shutter, a micro-scanning quick reflector, an infrared array CCD detector supporting the abnormal speed image motion compensation function, an infrared abnormal speed image motion compensation time sequence control and driving module, an infrared array CCD driving module, an environment control module, an infrared non-uniformity correction module, an infrared signal processing module, a digital signal transmission module and a ground processing and developing system. The infrared aerial camera supporting the different-speed image motion compensation function can realize the aerial different-speed image motion compensation on the premise of not additionally increasing system hardware equipment, and can reduce the quality, volume, power consumption and cost of an imaging system.

Description

An Infrared Aerial Camera Supporting Different Speed Image Motion Compensation Function

technical field

The present application relates to the field of aerospace technology, in particular to an infrared aerial camera supporting the function of image motion compensation at different speeds.

Background technique

During the reconnaissance process, the reconnaissance plane needs to fly at high speed and low altitude in order to avoid the surveillance of the enemy's radar. Low-altitude and high-speed flight greatly improves the aircraft's own battlefield survivability and in-depth reconnaissance and surveillance capabilities, but at this time, serious image motion will appear on the target surface of aerial imaging, resulting in blurred aerial imaging. The existence of image motion greatly affects the imaging quality of the camera. The resolution of the aerial image is significantly reduced. When there is image motion, the outline of the captured target is not clear, there is a large or small transition area between the target and the surrounding background, which expands with the increase of image motion, and when the transition area reaches a certain level, it will cause adjacent The images of the two targets overlap each other and cannot even be distinguished. When the aircraft is flying forward, due to the adjustment of the aircraft's own attitude (such as sideways flight) or the adjustment of the pitch angle of the aerial camera lens, the aerial camera is in the squint working state shown in Figure 1. The schematic diagram on the target surface is shown in Figure 1. It is characterized in that the direction of the image motion of the pixels on the target surface is the same, but the amount of image motion in different pixel areas is different. This type of image motion is called differential image motion. It is of great technical and tactical significance for aerial cameras to perform squint work, so differential image motion plays an important role in aerial image motion.

Driven by the digital environment, the digitization of photogrammetry is developing rapidly. Due to the development of large-scale CCD devices, high dynamic positioning and attitude determination technology, and the advantages of digital aerial cameras, the digitization of aerial photography has never been more difficult. There is no doubt that aerial cameras that will gradually replace film as a carrier. Aviation digital cameras have important uses and broad application prospects in both military and civilian fields. In terms of national economy, my country is vigorously developing high-altitude earth observation technology. The high-resolution area array CCD aerial camera has played an important role in map aviation, resource survey and disaster assessment, and its advantages over film aerial cameras have been obvious. reflect. In the field of national defense and security, high-resolution area array CCD aerial cameras have important strategic significance in the aspects of strike effect reconnaissance, battlefield reconnaissance and target dynamic monitoring, and providing reconnaissance intelligence support for troops.

The domestic aerial camera image motion compensation method at different speeds uses mechanical, optical, image, and electronic image motion compensation methods. The mechanical optical compensation system will greatly increase the weight and volume of the aerial camera. The image image motion compensation method is a kind of post-compensation method. method cannot be real-time. The above technologies seriously restrict the development of my country's aviation technology.

With the development of science and technology and the maturity of optical imaging technology, high-resolution and real-time transmission infrared cameras have gradually formed an equipment system. The features and imaging targets are more intuitive, easy to interpret, can quickly and accurately identify targets, and have higher accuracy, reliability and timeliness. Therefore, they are an important part of the aerial imaging equipment system, but currently The reported aerial camera does not support the differential image motion compensation function.

Contents of the invention

In view of this, in order to solve the above technical problems, the present application provides an infrared aerial camera with a different speed image motion compensation function.

An infrared aerial camera that supports image motion compensation at different speeds, including an inertial navigation system, a reconnaissance management system, a camera controller, an infrared detector hood, an infrared area array CCD detector optical system, an electronic shutter, and a micro-scanning fast mirror , Support variable speed image motion compensation function Infrared area array CCD detector, infrared image motion compensation timing control and drive module, infrared area array CCD drive module, environmental control module, infrared non-uniformity correction module, infrared signal processing module, Digital signal transmission module, ground processing and development system;

The infrared detector hood is connected with the infrared area array CCD detector optical system, the infrared area array CCD detector optical system is connected with the electronic shutter, and the micro-scanning fast reflector is connected with the infrared The optical system of the area array CCD detector is connected, and the electronic shutter is connected with the infrared area array CCD detector that supports different speed image motion compensation function;

The inertial navigation system is connected to the reconnaissance management system, the reconnaissance management system is connected to the camera controller, and the camera controller is connected to the infrared area array CCD detector that supports variable speed image motion compensation function. connect;

The camera controller is also connected with the infrared variable speed image motion compensation timing control and driving module, the infrared variable speed image motion compensation timing control and driving module, the infrared area array CCD driving module, and the environment control module It is connected with the infrared area array CCD detector supporting the variable speed image motion compensation function, and the infrared area array CCD detector supporting the variable speed image motion compensation function is connected with the infrared non-uniformity correction module, and the infrared non-uniformity The calibration module is connected to the infrared signal processing module, the infrared signal processing module is connected to the digital signal transmission module, and the digital signal transmission module is connected to the ground processing and development system.

Further, the infrared detector supporting the variable-speed image motion compensation function includes four areas, and each area includes:

Multiple sets of infrared photosensitive units;

A plurality of charge speed drive modules, which correspond to the multiple sets of infrared photosensitive units, and the charge speed drive modules are used to control the charge transfer speed of the infrared photosensitive units;

A plurality of refrigeration units, which correspond to the multiple groups of infrared photosensitive units, and the refrigeration units are used to stabilize the infrared photosensitive units at a low temperature and suitable temperature;

A shift register, which is used to read out the charge containing infrared scene information in the infrared photosensitive unit after exposure, and the charge readout method of the infrared photosensitive unit containing infrared scene information after the four regions are exposed by the shift register is as follows: read out in parallel.

Further, the inertial navigation system transmits information such as aircraft altitude, speed, and camera focal length to the reconnaissance management system, and the reconnaissance management system determines working parameters according to the working parameters transmitted by the inertial navigation system, and the camera controller is used to send work instructions and working parameters and task parameters, control the electronic shutter for exposure, and send an infrared vertical timing control command to the infrared variable speed image motion compensation timing control and driving module, and the infrared area array CCD driving module is used to drive the Support the work of the infrared detector with the function of image motion compensation at different speeds, the environmental control module is used to stably support the infrared aerial camera with the function of image motion compensation at different speeds to work at a suitable working temperature, and the micro-scanning fast mirror is used to control the emission and reception The direction of the optical axis is used to correct the arrival direction of the light beam. The optical system of the infrared area array CCD detector collects optical signals. Different speed image motion compensation function The infrared detector converts the optical signal into an electrical signal, and inputs the signal after image motion compensation to the infrared non-uniformity correction module for non-uniformity correction, and the infrared data processing module converts the infrared The signal corrected by the non-uniformity correction module is processed and input to the digital signal transmission module, and the ground processing and development system receives, processes and displays the image signal transmitted by the digital signal transmission module.

Further, the inertial navigation system is developed using a DSP chip, the reconnaissance management system is developed using an embedded microcomputer, and the camera controller is developed using a single-chip microcomputer.

Further, the infrared detector shading cover is a mechanical shading cover, the micro-scanning fast mirror is a custom-made device, the infrared area array CCD detector optical system is an integrated optical system, and the support for different speed image motion compensation function The area array CCD detector is an integrated detector, the infrared differential image motion compensation timing control and drive module is developed by FPGA, the infrared area CCD drive module is an integrated drive module, and the environment control module uses a DSP chip develop.

Further, the infrared non-uniformity correction module is developed using a DSP chip, the infrared signal processing module is developed using a dedicated development board, the digital signal transmission module is developed using a dedicated chip, and the ground processing and development system uses a high-performance industrial control machine development.

Compared with the prior art, the beneficial effects of the present application are:

The infrared aerial camera of the present application that supports variable-speed image motion compensation can realize aerial variable-speed image motion compensation without adding additional system hardware equipment, and can reduce the quality, volume, power consumption, and cost of the imaging system.

Description of drawings

The drawings described here are used to provide a further understanding of the application and constitute a part of the application. The schematic embodiments and descriptions of the application are used to explain the application and do not constitute an improper limitation to the application. In the attached picture:

Figure 1 is a schematic diagram of the principle of aerial variable speed image motion and a schematic diagram of variable speed image motion on the target surface provided by the embodiment of the present application;

FIG. 2 is a schematic diagram of the composition of an infrared aerial camera supporting a different speed image motion compensation function provided by the embodiment of the present application;

FIG. 3 is a diagram of the internal structure of an infrared area array CCD detector supporting a variable speed image motion compensation function provided by an embodiment of the present application.

Detailed ways

In order to facilitate the understanding of the present application, the present application will be described more fully below with reference to the relevant drawings. Preferred embodiments of the application are shown in the accompanying drawings. However, the present application can be embodied in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure of the application more thorough and comprehensive.

It should be noted that when an element is referred to as being “fixed” to another element, it can be directly on the other element or there can also be an intervening element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or intervening elements may also be present.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. The terms used herein in the specification of the application are only for the purpose of describing specific embodiments, and are not intended to limit the application.

Causes of allometric image motion:

During the reconnaissance process, the reconnaissance plane needs to fly at high speed and low altitude in order to avoid the surveillance of the enemy's radar. High-speed and low-altitude flight greatly improves the aircraft's own battlefield survivability and in-depth reconnaissance and surveillance capabilities, but at this time, serious image motion will appear on the target surface of aerial imaging, resulting in blurred aerial imaging and affecting the effect of aerial reconnaissance.

When the aircraft is flying forward, due to the adjustment of the aircraft's own attitude (such as sideways flight) or the adjustment of the pitch angle of the aerial camera lens, the aerial camera is in the squint working state shown in Figure 1. The schematic diagram on the target surface is shown in Figure 1. When the area array CCD camera is tilted to take pictures, because the aircraft is tilted, in the single ground area, the forward image movement speed of the near point target on the image plane is the same as the forward image movement speed of the far point. Compared with the image moving speed, the direction is the same, but the magnitude is different. The forward image motion speed with equal direction and different size is defined as differential image motion.

The invention provides a dual-band infrared aerial camera supporting the function of image motion compensation at different speeds.

Example 1:

Please refer to Figure 2, the infrared aerial camera that supports differential image motion compensation includes the following parts:

Inertial navigation system, reconnaissance management system, camera controller, infrared detector hood, infrared area array CCD detector optical system, electronic shutter, micro-scanning fast mirror, infrared area array CCD detector that supports different speed image motion compensation, Different speed image motion compensation timing generator, infrared area array CCD driver module, environmental control module, infrared non-uniformity correction module, infrared signal processing module, digital signal transmission module, ground processing and development system.

Specifically, the inertial navigation system is connected to the reconnaissance management system through the ASM bus, the reconnaissance management system is connected to the camera controller through the RS232 interface, the camera controller is connected to the electronic shutter, infrared differential image motion compensation timing control and drive module, and supports different Speed image motion compensation function The infrared area array CCD detector is connected through the RS232 interface, the infrared detector hood is connected with the infrared area array CCD detector optical system through a mechanical interface, the infrared area array CCD detector is electrically connected with the electronic shutter, and the electronic The shutter is electrically connected with the infrared area array CCD detector supporting the variable speed image motion compensation function. The area array CCD drive module is electrically connected with the infrared area array CCD detector supporting the variable speed image motion compensation function, and the environment control module is connected with the infrared area array CCD detector supporting the variable speed image motion compensation function through the RS232 interface, which supports the variable speed image motion compensation Function The infrared area array CCD detector is connected to the infrared non-uniformity correction module through the 3-Wire interface, the infrared non-uniformity correction module is connected to the infrared signal processing module through the RS232 interface, and the infrared signal processing module is connected to the digital signal transmission module through The SDI interface is connected, and the digital signal transmission module is connected with the ground processing and development system through the network interface.

Please refer to Figure 3. The infrared detector that supports the variable speed image motion compensation function is an area array CCD detector, which can capture infrared light with a wavelength range of 1-14μm. The number of pixels is 1536*1546, and the size of a single pixel is 20um* 20um; the entire detector is divided into four areas, each area is composed of two-dimensionally arranged photosensitive units, and there is a shift register in the lower part of each area, the number of pixels in each area is 384*384, and each area will be 384 The columns are divided into 4 groups on average, each group can independently control the moving speed, and each independent area compensates for different speed image motion. There is a charge speed control module on the upper side of each column of photosensitive units in each area to control the charge transfer speed of each column. . There is a refrigeration unit inside each column of photosensitive units in each area, which is responsible for cooling each column of photosensitive units. After the exposure is over, the shift register will read out the charge of the infrared light scene in sequence, and the readout method of the four areas is parallel readout.

It should be noted that the inertial navigation system transmits information such as aircraft altitude, speed, and camera focal length to the reconnaissance management system. Working mode, array size, number of longitudinal groups in the array, pixel size, camera controller is used to send working instructions such as shooting on, shooting off, power on, power off, single shooting, continuous shooting and other commands and working parameters such as focal length value, The flight height, flight speed and mission parameters control the electronic shutter for exposure, and send infrared vertical sequence control commands to the infrared variable-speed image motion compensation sequence control and drive module to control the transfer speed of each group of vertical charges, which can realize variable-speed image motion compensation . The infrared area array CCD driver module is used to generate horizontal drive and vertical drive to drive the infrared detector that supports the function of different speed image motion compensation; the environment control module is used to stably support the function of different speed image motion compensation. The infrared aerial camera works at a suitable working temperature , The micro-scanning fast mirror is used to control the direction of the emitting and receiving optical axis, and correct the direction of the beam arrival. The infrared area array CCD detector optical system collects optical signals, and the infrared hood is used to protect and support the infrared image motion compensation function of different speeds. Detector, supporting different speed image motion compensation function The infrared detector converts the optical signal into an electrical signal, and inputs the signal after image motion compensation to the infrared non-uniformity correction module for non-uniformity correction, and the infrared data processing module converts the infrared non-uniformity Process the signal corrected by the calibration module, such as signal amplification, correlated double sampling, analog-to-digital conversion, input to the digital signal transmission module through the SDI interface, and input to the ground processing and development system through the network interface to receive, process, and display digital signals The image signal transmitted by the transmission module.

The inertial navigation system is developed by DSP chip TMS320C6678, the reconnaissance management system is developed by embedded microcomputer RK3288, the camera controller is developed by single-chip microcomputer STM32F103ZET6, the infrared detector hood is a mechanical hood, and the infrared array CCD detector optical system is customized integration The optical system, the micro-scanning fast mirror is a customized device, and supports the function of variable-speed image motion compensation. The area array CCD detector is an integrated detector. The timing control and drive module of infrared variable-speed image motion compensation is developed using FPGA ZYNQ7020, and the infrared area array CCD The drive module is a customized integrated drive module, the environmental control module is developed by using DSP chip TMS320C6678, the infrared non-uniformity correction module is developed by using DSP chip TMS320C6678, the infrared signal processing module is developed by using a special development board Jetson Xavier NX, and the digital signal transmission module is developed by a special The chip GV8500-CNE3 is developed, the ground processing and development system uses Lenovo's high-performance industrial computer as hardware, and VS2010 develops the upper computer display and control software.

The infrared aerial camera of the present application that supports variable-speed image motion compensation can realize aerial variable-speed image motion compensation without adding additional system hardware equipment, and can reduce the quality, volume, power consumption, and cost of the imaging system.

The above descriptions are only examples of the present application, and are not intended to limit the present application. For those skilled in the art, various modifications and changes may occur in this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.

Claims (6)

1. An infrared aerial camera that supports different speed image motion compensation functions, is characterized in that, comprises inertial navigation system, reconnaissance management system, camera controller, infrared detector hood, infrared area array CCD detector optical system, electronic shutter , micro-scanning fast mirror, infrared area array CCD detector supporting variable speed image motion compensation function, infrared variable speed image motion compensation timing control and drive module, infrared area array CCD drive module, environmental control module, infrared non-uniformity correction module , infrared signal processing module, digital signal transmission module, ground processing and development system; The infrared detector hood is connected with the infrared area array CCD detector optical system, the infrared area array CCD detector optical system is connected with the electronic shutter, and the micro-scanning fast reflector is connected with the infrared The optical system of the area array CCD detector is connected, and the electronic shutter is connected with the infrared area array CCD detector that supports different speed image motion compensation function; The inertial navigation system is connected to the reconnaissance management system, the reconnaissance management system is connected to the camera controller, and the camera controller is connected to the infrared area array CCD detector that supports variable speed image motion compensation function. connect; The camera controller is also connected with the infrared variable speed image motion compensation timing control and driving module, the infrared variable speed image motion compensation timing control and driving module, the infrared area array CCD driving module, and the environment control module It is connected with the infrared area array CCD detector supporting the variable speed image motion compensation function, and the infrared area array CCD detector supporting the variable speed image motion compensation function is connected with the infrared non-uniformity correction module, and the infrared non-uniformity The calibration module is connected to the infrared signal processing module, the infrared signal processing module is connected to the digital signal transmission module, and the digital signal transmission module is connected to the ground processing and development system. 2. The infrared aerial camera supporting the different-speed image motion compensation function according to claim 1, wherein the infrared detector supporting the different-speed image motion compensation function comprises four regions, each region comprising: Multiple sets of infrared photosensitive units; A plurality of charge speed drive modules, which correspond to the multiple sets of infrared photosensitive units, and the charge speed drive modules are used to control the charge transfer speed of the infrared photosensitive units; A plurality of refrigeration units, which correspond to the multiple groups of infrared photosensitive units, and the refrigeration units are used to stabilize the infrared photosensitive units at a low temperature and suitable temperature; A shift register, which is used to read out the charge containing infrared scene information in the infrared photosensitive unit after exposure, and the charge readout method of the infrared photosensitive unit containing infrared scene information after the four regions are exposed by the shift register is as follows: read out in parallel. 3. The infrared aerial camera supporting the image motion compensation function at different speeds according to claim 1, wherein the inertial navigation system transmits information such as aircraft altitude, speed, and camera focal length to the reconnaissance management system, and the reconnaissance management system The working parameters are determined according to the working parameters transmitted by the inertial navigation system, and the camera controller is used to send working instructions, working parameters and task parameters, control the electronic shutter for exposure, and provide timing control to the infrared differential image motion compensation Send infrared vertical timing control commands with the drive module, the infrared area array CCD drive module is used to drive the infrared detector that supports different speed image motion compensation function, and the environment control module is used to stably support the different speed image motion compensation function The infrared aerial camera works at a suitable working temperature. The micro-scanning fast reflector is used to control the direction of the emission and reception optical axes, and correct the direction of beam arrival. The optical system of the infrared area array CCD detector collects optical signals, so The infrared hood is used to protect the infrared detector that supports the function of image motion compensation at different speeds, and the infrared detector that supports the function of image motion compensation at different speeds converts optical signals into electrical signals, and inputs the signal after image motion compensation to the The infrared non-uniformity correction module performs non-uniformity correction, the infrared data processing module processes the signal corrected by the infrared non-uniformity correction module, and inputs it to the digital signal transmission module, and the ground processing and The development system receives, processes and displays the image signal transmitted by the digital signal transmission module. 4. The infrared aerial camera supporting the image motion compensation function at different speeds according to claim 3, wherein the inertial navigation system is developed using a DSP chip, the reconnaissance management system is developed using an embedded microcomputer, and the camera The controller is developed using a single-chip microcomputer. 5. The infrared aerial camera supporting the image motion compensation function at different speeds according to claim 3, wherein the infrared detector shading cover is a mechanical shading cover, and the micro-scanning fast mirror is a custom-made device, and the The optical system of the infrared area array CCD detector is an integrated optical system, the area array CCD detector supporting the function of differential image motion compensation is an integrated detector, and the timing control and driving module of the infrared differential image motion compensation is developed by FPGA , the infrared area array CCD drive module is an integrated drive module, and the environment control module is developed using a DSP chip. 6. The infrared aerial camera supporting the image motion compensation function at different speeds according to claim 3, wherein the infrared non-uniformity correction module is developed using a DSP chip, and the infrared signal processing module is developed using a dedicated development board, The digital signal transmission module is developed with a dedicated chip, and the ground processing and development system is developed with a high-performance industrial computer.