KR20200081841A - Signal processing system for aircraft - Google Patents

Abstract

The present invention relates to a signal processing system for airplanes for securing flight safety sight. More specifically, the signal processing system (1) for airplanes for securing flight safety sight includes: a flight information input means (100) comprising a binocular infrared camera part (110), and a flight status sensor part (120) confirming the flight status of an airplane (H); a flight information signal processing means (200) processing information on the flight status and images transmitted in real time from the flight information input means (100) such that a pilot and a ground operator can confirm flight information of the airplane (H) through a flight information safety output means (300) during flight; and the flight information safety output means (300) outputting the information on the flight status and the images processed through the flight information signal processing means (200) through a screen which can be instantly and visually confirmed by the pilot and the ground operator and a notification which can be acoustically confirmed. Therefore, as accurate distances with geographical features and object movement information are provided to the pilot and the ground operator in real time through visual forward images of the airplane (H) and various sensors, a collision with a moving object and a geographical feature can be prevented during flight in bad weather or daytime and nighttime conditions, and thus the safe flight of the airplane (H) can be promoted. Accordingly, as the safety flight of the airplane (H) is promoted during flight in bad weather or daytime and nighttime conditions, an accident caused by a collision with a geographical feature can be prevented, and thus, casualties and damage to the airplane (H) can be considerably reduced.

Description

Signal processing system for aircraft to secure flight safety field of view

The present invention relates to a signal processing system for an aircraft for securing a flight safety field of view, and more specifically, by processing a real-time incoming signal from a flight information input means based on a binocular infrared camera, through flight information safety output means, 3 It relates to a signal processing system for an aircraft to secure a flight safety field of view that promotes the safety of operations by detecting and outputting terrain features and obstacles that interfere with the flight in dimension, thereby ensuring the field of view of a pilot and a ground operator during flight. .

When operating an aircraft, due to sudden bad weather such as fog and rain, it is difficult to secure a safety view of the pilot, and there are times when the operation is performed depending only on the instrument of the aircraft.

This, of course, has limitations for safe operation, maximizing the seriousness of the risk of flight accidents.

Therefore, in order to prevent a flight accident, a safety system capable of securing a field of view of a pilot and a ground operator is necessary in any situation.

Conventionally, there is a technique for securing a forward field of view using a monocular camera, but in general, an image output through the monocular camera has a problem that accurate information related to an object cannot be obtained.

Therefore, there is a need for a separate signal processing system that solves the above-described problems and applies both binocular camera technologies to the safety system to simultaneously align terrain features and obstacles.

In other words, a safety system incorporating a technology for visualizing a forward visual image and signals by various sensors, providing accurate distance and object movement information, and a technology for visualizing should be provided to pilots and ground operators.

Accordingly, as a prior art related to an aircraft signal processing system for securing a flight safety field of view, as shown in Figure 7 (a),

Republic of Korea Patent Registration No. 10-1281272, "Pedestrian protection method and device using a far-infrared stereo camera" (hereinafter referred to as'prior art 1'),

Based on the calibrated far-infrared stereo camera, an image acquisition unit that acquires an image, a pedestrian recognition unit that recognizes a pedestrian through the acquired image, and a collision with the recognized pedestrian based on the recognized distance information and the vehicle's speed information A collision avoidance control unit that controls a braking device to avoid collision with a recognized pedestrian when it is determined that there is a collision risk determination unit and a collision hazard that determines the danger, accurately distinguishes the pedestrian from the background, and recognizes the pedestrian , It relates to a pedestrian protection device using a far-infrared stereo camera to determine the danger of collision with a recognized pedestrian, and to control the vehicle to avoid collision with a pedestrian who is at risk of collision.

As another prior art, as shown in Figure 7 (b),

With "Infrared stereo camera image processing device" of Republic of Korea Patent Publication No. 10-2018-00540655 (hereinafter referred to as'prior art 2'),

It includes an infrared image sensor positioned close to the front of the wearable device in the interior of the wearable device to obtain an image in front of the wearable device and a processor for processing the image obtained from the infrared image sensor, the front or rear surface of the wearable device It relates to an infrared stereo camera including a processing board disposed to face the wearable device.

As described above, the prior art 1 to the prior art 2 are technologies for processing and providing an image using an infrared stereo camera, and the present invention and the technical field are similar.

However, the prior art 1 to the prior art 2 are different from the technical features of the present invention for processing and processing image information and outputting it to a pilot and a ground operator.

That is, the present invention, the problem to be solved (the object of the invention), the solution means for solving this and the effect will be different, there will be differences in technical characteristics.

Republic of Korea Registered Patent Publication No. 10-1281272 (2013.06.26.) Republic of Korea Patent Publication No. 10-2018-0054066 (2018.05.24.)

Thus, the present invention has been devised to solve the above-mentioned conventional problems,

The purpose of the present invention is to provide a signal processing system for an aircraft that is designed to ensure that the aircraft can fly safely by preventing sudden collisions with terrain features by securing the visibility of the pilot and ground operators during sudden bad weather or during day and night flight. .

In particular, the purpose is to ensure safe flight of the aircraft by allowing 3D images and various flight information to be output in real time to pilots and ground operators.

Another object of the present invention is to ensure that the image photographed using a binocular infrared camera is provided to the pilot and the ground operator through the flight information safety output means, various flight information is overlaid together on the basis of the 3D image of the terrain feature. The purpose of the present invention is to provide a signal processing system for an aircraft that allows accurate information about an aircraft in flight to be transmitted by being output.

That is, an object of the present invention is to provide a signal processing system for an aircraft that can prevent an accident such as a collision with a topographical object in any flight environment during flight.

The present invention for achieving the above object was devised to achieve the problem to be solved,

In the signal processing system for aircraft to secure a flight safety field of view,

A flight information input means formed of a binocular infrared camera unit and a flight status sensor unit that checks the flight status of the aircraft;

In flight, flight information signal processing means for processing and processing video and flight status information in real time from the flight information input means so that pilots and ground operators can check flight information of the aircraft through the flight information safety output means. ;

Flight information safety output means for outputting the information of the image and flight status processed and processed by the flight information signal processing means to a pilot and a ground operator immediately and visually, and an audible confirmation notification. It consists of,

Provides pilots and ground operators with real-time visual forward images of aircraft and accurate distances from terrain features by various sensors, and object movement information. By preventing the collision, it is characterized in that it promotes the safe flight of the aircraft.

On the other hand, prior to this specification, the terms or words used in the claims of the patent registration should not be construed as being limited to ordinary or dictionary meanings, and the inventors have to use terms to explain their own inventions in the best way. Based on the principle that can be appropriately defined, it should be interpreted as a meaning and a concept consistent with the technical idea of the present invention.

Therefore, the embodiments shown in the embodiments and drawings described in this specification are only the most preferred embodiments of the present invention, and do not represent all of the technical spirit of the present invention, and thus can replace them at the time of application. It should be understood that there may be equivalents and variations.

According to the present invention as described above in the above configuration and operation,

During sudden bad weather or during day and night flight, the sight of the pilot and ground operator is secured to prevent collision with terrain features, so that the aircraft can fly safely.

In particular, by allowing 3D images and various flight information to be output in real time to pilots and ground operators, safe flight of the aircraft is made by providing accurate information.

That is, in real time, it detects obstacles that may interfere with terrain features and aircraft flight, obtains spatial information (distance, location) during flight, and provides a stabilized image to assist aircraft flight.

In addition, the image photographed using the binocular infrared camera is provided to the pilot and the ground operator through the flight information safety output means, but the flight information is overlaid together and output based on the 3D image of the terrain feature. It ensures accurate information about the aircraft in use.

That is, the attitude, speed, and altitude information of the aircraft acquired by the flight information input means is overlaid on the 3D image base so that accidents such as collision with terrain features can be prevented in advance in any flight environment during flight of the aircraft. do.

In addition, the development of core technologies and products for binocular cameras will improve the source and applied technologies in the field of infrared cameras, create new markets and jobs, replace imports and reduce costs, and realize a society of respect for life by minimizing human damage.

More specifically,

In technical terms,

Based on the binocular infrared camera technology for miniaturized aircraft, it can have the ripple effect of technological development from land, marine, automotive, and special purpose personal firearms.

In addition, it is possible to protect the life and environment by significantly reducing the incidence of accidents in the aircraft during flight by applying innovative technology.

On the economic (industrial) side,

It can create a new market for binocular infrared cameras for military use (aircraft, land equipment, personal firearms, etc.) and civilian use (ships, automobiles) that are not currently applied.

Since the pilot and the aircraft are protected due to the prevention of aircraft accidents in flight occurring at a frequency of 1 [times] or more in 2 [years], maintenance and management costs can be significantly reduced.

On the social side,

As an accident risk avoidance technology, it is possible to significantly reduce the social cost of preventing aircraft accidents during flight,

Depending on the situation, it can be used as a rescue equipment that can respond to various disasters, thereby minimizing human damage.

In other words, it is a very effective invention that is applied to the search and rescue activities of the victims, such as mountain and marine, forest fire, etc.

1 shows a schematic diagram of a signal processing system for an aircraft for securing a safety field of view according to the present invention.
Figure 2 shows the configuration of the signal processing system for an aircraft for securing the flight safety field of the present inventors.
3 is a view showing an embodiment in which a signal processing system for an aircraft for securing a safety field of view of the present inventor is applied to an aircraft.
4 is a flow chart showing the signal processing sequence of the flight information signal processing means among the components of the aircraft signal processing system for securing the flight safety view of the present inventor.
Figure 5 shows an embodiment of an image output through the flight information safety output means, among the components of the aircraft signal processing system for securing the flight safety field of the present inventors.
6 is a view showing another embodiment of an image output through the flight information safety output means, among the components of the aircraft signal processing system for securing the flight safety view of the present inventor.
7 shows a representative view of the prior art for a signal processing system for an aircraft for securing a safety field of view according to the present inventor.

Hereinafter, with reference to the accompanying drawings will be described in detail the function, configuration and operation of the aircraft signal processing system for securing the safety field of view of the present inventors.

1 shows a schematic diagram of a signal processing system for an aircraft for securing a flight safety field of the present inventor, FIG. 2 is a configuration diagram of a signal processing system for an aircraft for securing a flight safety field of the present inventor, and FIG. 3 is a inventor It shows an embodiment in which a signal processing system for an aircraft for securing a flight safety field of view is applied to an aircraft.

1 to 3, the present invention,

In the signal processing system for aircraft (1) for securing the safety field of flight,

Flight information input means 100 formed by a binocular infrared camera unit 110 and the flight status sensor unit 120 for confirming the flight status of the aircraft (H);

During flight, the pilot and the ground operator can check the flight information input in real time from the flight information input means 100 and flight status information so that the flight information of the aircraft H can be checked through the flight information safety output means 300. Flight information signal processing means for processing, processing (200);

Flight information safety output that outputs the processed and processed image and flight status information by the flight information signal processing means 200 through a screen that can be immediately and visually checked by a pilot and ground operator, and audiblely. Consists of 300;

Provides pilots and ground operators with real-time visual forward images of aircraft (H) and accurate distances from topographical objects by various sensors, and object movement information. By preventing collision with the object, it is characterized in that it promotes the safe flight of the aircraft (H).

In other words, the present invention, when using the aircraft (H) in bad weather, day, night environment, pilots and ground operators, using the binocular infrared camera 110, obstacles that can interfere with the three-dimensional terrain and flight Along with the detected information, various signals obtained from the flight status sensor unit 120 are fused, processed, and processed, and output to a screen so that pilots and ground operators can instantly check in real time, safe for sudden flight environment changes. It is a signal processing system for aircrafts that can ensure visibility.

When explaining the present invention in more detail,

Flight information input means 100 for acquiring a variety of information required during flight using a binocular infrared camera and a variety of sensors,

A binocular infrared camera unit 110 that photographs in real time the topography of the aircraft H and the obstacles that may interfere with flight;

Consisting of; flight status sensor unit 120 for acquiring the flight status of the aircraft (H) in real time by the sensor;

The binocular infrared camera unit 110,

Detects front features and obstacles with infrared rays to acquire left and right image information,

Flight status sensor unit 120,

Flight attitude sensor module 121 consisting of an accelerometer sensor and a gyro sensor, a digital magnetic field compass, and a GPS of 5[Hz] of 72[channel];

Altimeter sensor module 122 consisting of a barometric altimeter, an altimeter, and a GPS altimeter;

It consists of; laser distance measurement sensor module 123 for measuring a range of up to 5 [Km] of the aircraft (H), to obtain information about the flight state (flight posture, altitude, terrain features and distance from obstacles) .

On the other hand, the flight information signal processing means 200 for processing and processing the information obtained through the flight information input means 100,

A frame grabber module 210 that stores the image input from the flight information input means 100 in a special image storage memory and processes it as infrared image data of both eyes;

A non-uniformity correction module 220 that corrects and corrects an imbalance of an image photographed from the binocular infrared camera unit 110;

A stereo processing module 230 composed of a left/right balancer (L/R balancer), a left/right sequencer (L/R sequencer), a clock generator, and various communication interfaces;

A power supply control module 240 made of high-quality power required by the detector power supply and Bias, TEC (Thermal Electric Clooer) power supply, FPGA (Field Programmable Gate Array), power of other electronic components, and the binocular infrared camera unit 110;

Communication control module 250, which is made of various communication blocks and enables data transmission with the flight information input means 100 and the flight information safety output means 300;

A data fusion module 260 that fuses with navigation information based on signals coming from various sensors of the flight information input means 100;

An image overlay module 270 that overlays the information of the data fusion module 260 on the stereo infrared image processed by the frame grabber module 210;

Consisting of a binocular infrared camera unit 110, the one-eye image processing module 280 for processing a three-dimensional image as a two-dimensional image when the failure;

The flight information safety output means 300 processes and processes signals for overall flight information from the flight information input means 100 so that pilots and ground operators can easily check them.

At this time, the non-uniformity correction module 220 receives a digital signal from the front end and performs a key function of correcting and processing the non-uniformity of the image.

The non-uniformity correction module 220 implements a detector non-uniformity, offset, and gain correction functions, and the basic concept is shown in [Table 1] below.

[Table 1]

[Table 1] above, simply functions to adjust the offset, but in each pixel processing, the offset and gain adjustment for each frame is different for each left infrared camera. The functions of the module 111 and the right infrared camera module 112 are adapted to be fast.

In addition, although the non-uniformity correction module 220 has a simple configuration such as a field programmable gate array (FPGA) and a memory in terms of circuit configuration, many circuits are actually incorporated.

For example, by using a video image processor, etc., many image quality can be improved internally, and various image filters can be applied and compensated to bring fidelity of disparity data to one side.

As the main function configuration of the non-uniformity correction module 220, it is preferable that the non-uniformity processing of the image, bad & dead pixel replacement, fixed pattern noise reducer.

In addition, the stereo processing module 230 is configured with a Synchronized function that requires the functions of the binocular infrared camera unit 110, and is constructed with a DSP (Digital Signal Processor) based processor for performing this.

In addition, there is a clock generator (Clock Generator) to support the synchronization (Synchronized) function, it is possible to generate a variety of Sync signals and control signals, and communication reference signals that require the function of the binocular infrared camera unit 110.

In addition, the power control module 240 is composed of a variety of power filters and power types. In the maximum load state, a noise filter is operated, thereby supplying power with minimal influence of ambient noise. Allow the problem to operate in the optimal state considered.

In addition, various communication noises are removed to minimize the influence of ambient noise of the binocular infrared camera, and to facilitate maintenance and repair, standardization and compatibility are prepared to be maintained.

On the other hand, the flight information safety output means 300 to output the information processed and processed by the flight information signal processing means 200 to the pilot and the ground operator,

A flight value sensor module 121, an altimeter sensor module 122, and a sensor value output module 310 that outputs information obtained from the laser distance measurement sensor module 123 to a screen;

A spatial information output module 320 that matches the image obtained from the binocular infrared camera unit 110 and outputs it to the screen;

An overlay output module 330 for overlaying the information output to the sensor value output module 310 and the spatial information output module 320;

Based on the information output through the sensor value output module 310 and the spatial information output module 320, when an obstacle that can interfere with flight is recognized, a visual and audible notification is output to avoid it. , Generating a notification generating output module 340;

Notification generating output module 340,

An automatic tracking module 341 that tracks obstacles with movement;

It is composed of; object detection module 342 for detecting an obstacle without movement;

The pilot and ground operators should be provided with various and accurate information required for safe flight.

In summary, the present invention, due to the above, flight information input means 100, flight information signal processing means 200, flight information safety output means 300, due to,

During flight, it provides pilots and ground operators with distance information of obstacles detected in the area of interest and relative safety distances and time information according to the avoided distances of detected obstacles, so that they can complete the task of safe flight.

On the other hand, Figure 4 shows a simplified flow chart of the signal processing sequence of the flight information signal processing means 200 of the components of the aircraft signal processing system 1 for securing the safety field of view of the present inventors, Figure 5 is a flight It shows an embodiment of the image output through the information safety output means (300).

In this case, (a) of FIG. 5 is before various flight information is overlaid on an image output to the pilot and the ground operator, and (b) is an embodiment of a screen that is finally output to the pilot and the ground operator.

In addition, Figure 6 shows another embodiment of the image output through the flight information safety output means 300 of the components of the aircraft signal processing system (1) for securing the flight safety field of the present inventors.

At this time, Figure 6 (a) is an embodiment of the screen output to the aircraft (H) to which the present invention is applied, (b) is a prior art, that is, the screen output to the aircraft (H) before the present invention is applied It is an example for.

For reference, in the present invention, the term "severe weather" means rain, snow, fog, haze, and the like.

In addition, if the description of the present invention is further attached,

The communication block is composed of various communication blocks. For example, data transmission with the flight information input means 100, flight information signal processing means 200, and flight information safety output means 300 & camera control, RS170 It can be composed of Analog Video Out, UART, and other interfaces for testing.

As described above, the present invention is not limited to the described embodiments, and it is obvious to those skilled in the art that various modifications and modifications can be made without departing from the spirit and scope of the present invention.

Therefore, since it may be implemented in various other forms without departing from the technical spirit or main features, the embodiments of the present invention are merely illustrative in all respects and should not be interpreted limitedly and can be implemented in various modifications.

The present invention relates to a signal processing system for an aircraft for securing a flight safety field of view, manufacturing work (camera and gimbal for photographing terrain) and sales, software related to processing and processing signals from various sensors It can be applied to contribute to the promotion of various industries, such as the industry and the aircraft industry to which these systems are applied.

In addition, it can be applied to contribute to the promotion of industrial fields such as the unmanned aerial vehicle industry and robot field, land, marine, automotive equipment, and special-purpose personal equipment.

1: Signal processing system for aircraft to secure flight safety vision
100: flight information input means 110: binocular infrared camera unit
120: flight status sensor unit 121: flight attitude sensor module
122: altimeter sensor module 123: laser distance measurement sensor module
200: flight information signal processing means 210: frame grabber module
220: non-uniformity correction module 230: stereo processing module
240: power control module 250: communication control module
260: data fusion module 270: video overlay module
280: single-eye image processing module
300: flight information safety output means 310: sensor value output module
320: spatial information output module 330: overlay output module
340: notification generating output module 341: automatic tracking module
342: object detection module
H: Aircraft

Claims (1)

In the signal processing system for aircraft (1) for securing the safety field of flight,
Flight information input means 100 formed by a binocular infrared camera unit 110 and the flight status sensor unit 120 for confirming the flight status of the aircraft (H);
In flight, the pilot and the ground operator process real-time images and flight status information from the flight information input means 100 so that the flight information safety output means 300 can check the flight information of the aircraft H. , Flight information signal processing means for processing (200);
Flight information safety output that outputs the processed and processed image and flight status information by the flight information signal processing means 200 through a screen that can be immediately and visually checked by a pilot and ground operator, and audiblely. Consists of 300;
Provides pilots and ground operators with real-time visual forward images of aircraft (H) and accurate distances from topographical objects by various sensors, and object movement information. A signal processing system for an aircraft to secure a safety field of view for flight, characterized in that it promotes safe flight of the aircraft (H) by preventing collision with an object.

Images