CN111199510A

CN111199510A - High-instantaneity universal image processing platform suitable for unmanned combat system

Info

Publication number: CN111199510A
Application number: CN201911386946.5A
Authority: CN
Inventors: 蒋沅嵩; 夏平; 张家俊; 张希栋
Original assignee: Wuhan Huazhong Tianqin Defense Technology Co ltd
Current assignee: Wuhan Huazhong Tianqin Defense Technology Co ltd
Priority date: 2019-12-29
Filing date: 2019-12-29
Publication date: 2020-05-26

Abstract

The embodiment of the invention provides a high-instantaneity universal image processing platform suitable for an unmanned combat system, which utilizes the characteristics of strong parallel processing capability of an FPGA (field programmable gate array), large number of IO (input/output) pins and rich integrated soft core resources and the characteristics of strong operation processing capability of a DSP (digital signal processor). The FPGA is responsible for image acquisition, display, external communication control and image preprocessing, and due to the characteristic of FPGA parallel processing, the work is synchronously expanded, so that the real-time performance of image tracking is improved. The DSP focuses on the realization of the image processing algorithm, the image processing operation flow cannot be interrupted by other tasks, the tracking processing time is shortened, and the tracking real-time performance is improved. The DSP can also receive external information through a network, such as target recognition and decision results of an artificial intelligence platform, so that the tracking stability and accuracy are further improved.

Description

High-instantaneity universal image processing platform suitable for unmanned combat system

Technical Field

The embodiment of the invention relates to the technical field of image processing, in particular to a high-instantaneity universal image processing platform suitable for an unmanned combat system.

Background

An image processing platform in the unmanned operating system is required to have the characteristics of small volume, high integration level and high real-time performance. In order to improve the real-time performance of image processing, there are very strict requirements on the transmission delay of a data link and the time consumption of an image processing algorithm. In order to shorten the research and development period, the whole image processing platform is required to accord with the design idea of modularization and generalization.

With the popularization of artificial intelligence algorithms, it has become a trend to combine traditional tracking processing algorithms with artificial intelligence recognition algorithms. However, because the artificial intelligence algorithm platform has a large volume and large power consumption, if the artificial intelligence algorithm platform is integrated into an image processing platform, the design of space and heat dissipation is difficult.

Disclosure of Invention

The embodiment of the invention provides a high-instantaneity universal image processing platform suitable for an unmanned combat system, the operation result of an artificial intelligence recognition and decision system is introduced into the image processing platform through communication interfaces such as a network, and the stability and the accuracy of target tracking are further improved by combining a tracking processing algorithm of the image processing platform.

The embodiment of the invention provides a high-instantaneity general image processing platform suitable for an unmanned combat system, which comprises a Field Programmable Gate Array (FPGA) module and a Digital Signal Processing (DSP) module;

the FPGA module is used for collecting an image source, analyzing the image source and transmitting the image source to the DSP module through the SRIO high-speed serial interface;

and the DSP module is used for receiving the image data, then performing operation and performing data interaction with an external processing module.

Further, the DSP module is specifically configured to write the image data into an image buffer in the DDR3 read/write controller through the DDR3 read/write controller, and read the image data in the DDR3 read/write controller for operation as required.

Furthermore, the DSP module is also used for carrying out data interaction with an external processing module through a network, and improving the stability and the accuracy of target tracking by introducing the operation result of the external processing module and combining the tracking processing algorithm of the DSP module; the external processing module comprises an artificial intelligence recognition and decision-making system.

Furthermore, the FPGA module and the DSP module are interconnected through an FMC standard connector.

Furthermore, the FPGA module and the DSP module respectively comprise a storage unit, a power supply unit, a clock unit, a reset unit and a network port unit.

Further, the DSP module also comprises a DSP core and a DDR3 image cache unit; the DSP core is integrated with an image processing algorithm and used for performing image data operation, and the DDR3 image cache unit is used for storing image data.

The high-instantaneity general image processing platform suitable for the unmanned combat system provided by the embodiment of the invention utilizes the characteristics of strong parallel processing capability of an FPGA (field programmable gate array), large number of IO (input/output) pins and rich integrated soft core resources and the characteristics of strong operation processing capability of a DSP (digital signal processor). The FPGA is responsible for image acquisition, display, external communication control and image preprocessing, and due to the characteristic of FPGA parallel processing, the work is synchronously expanded, so that the real-time performance of image tracking is improved. The DSP focuses on the realization of the image processing algorithm, the image processing operation flow cannot be interrupted by other tasks, the tracking processing time is shortened, and the tracking real-time performance is improved. The DSP can also receive external information through a network, such as target recognition and decision results of an artificial intelligence platform, so that the tracking stability and accuracy are further improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.

FIG. 1 is a block diagram of a core module circuit of an image processing platform according to an embodiment of the present invention;

FIG. 2 is a diagram illustrating an exemplary application of a core module and a mating interface module of an image processing platform according to an embodiment of the present invention;

fig. 3 is a block diagram of a flow chart of an image processing algorithm provided according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.

With the popularization of artificial intelligence algorithms, it has become a trend to combine traditional tracking processing algorithms with artificial intelligence recognition algorithms. However, because the artificial intelligence algorithm platform has a large volume and large power consumption, if the artificial intelligence algorithm platform is integrated into an image processing platform, the design of space and heat dissipation is difficult. But the operation result of the artificial intelligence recognition and decision system can be introduced into the image processing platform through communication interfaces such as a network and the like, and the stability and the accuracy of target tracking are further improved by combining the tracking processing algorithm of the image processing platform.

Therefore, the embodiment of the present invention provides a high real-time general image processing platform suitable for an unmanned combat system, which utilizes the characteristics of a Field Programmable Gate Array (FPGA) that the parallel processing capability is strong, the number of IO pins is large, and the integrated soft core resource is rich, and the characteristics of a Digital Signal Processor (DSP) that the DSP has a strong operation processing capability. The FPGA is responsible for image acquisition, display, external communication control and image preprocessing, and due to the characteristic of FPGA parallel processing, the work is synchronously expanded, so that the real-time performance of image tracking is improved. The DSP focuses on the realization of the image processing algorithm, the image processing operation flow cannot be interrupted by other tasks, the tracking processing time is shortened, and the tracking real-time performance is improved. The DSP can also receive external information through a network, such as target recognition and decision results of an artificial intelligence platform, so that the tracking stability and accuracy are further improved. The following description and description will proceed with reference being made to various embodiments.

Fig. 1 to fig. 3 illustrate a high real-time general image processing platform suitable for an unmanned combat system according to an embodiment of the present invention, which includes an FPGA (field programmable gate array) module and a DSP (digital signal processing) module;

Fig. 1 is a block diagram of a core module circuit of an image processing platform according to an embodiment of the present invention, in this embodiment, as an optimal implementation manner, an image processing architecture of FPGA + multi-core DSP is selected, the FPGA module is responsible for acquiring, preprocessing, and displaying an image source, and the DSP module is dedicated to implementing a complex algorithm of image processing and performs data interaction with an artificial intelligence recognition and decision system through a network; the characteristics of strong parallel processing capability of the FPGA module, large number of IO pins and rich integrated soft core resources and the characteristics of strong operation processing capability of the DSP module are utilized. The FPGA module is responsible for image acquisition, display, external communication control and image preprocessing, and due to the parallel processing characteristic of the FPGA module, the work is synchronously expanded, so that the real-time performance of image tracking is improved. The DSP module is focused on realizing the image processing algorithm, the image processing operation flow cannot be interrupted by other tasks, the tracking processing time is shortened, and the tracking real-time performance is improved.

On the basis of the above embodiment, the DSP module is specifically configured to write the image data into an image buffer in the DDR3 read/write controller through the DDR3 read/write controller, and read the image data in the DDR3 read/write controller for operation according to the requirement.

In this embodiment, as a preferred implementation, the DSP module may perform data interaction with other processing modules through a network. The FPGA module and the DSP module can perform data caching in the external storage module when processing image data. Fig. 3 is a flow chart of the implementation of the image processing algorithm, after the analysis of the source data is completed, the FPGA module is directly transmitted to the DSP module end through the SRIO high-speed serial interface, and the transmission delay on the link is extremely low. After receiving the image data, the DSP module writes the data into an image buffer in the external DDR3 through the DDR3 read/write controller, and then reads the data from the DDR3 to the kernel for operation as required. Because the DSP module is provided with a plurality of kernels, the processing speed can be further improved in a cooperative processing mode.

On the basis of the above embodiments, the DSP module is further configured to perform data interaction with an external processing module through a network, and improve stability and accuracy of target tracking by introducing an operation result of the external processing module and combining a tracking processing algorithm of the DSP module itself; the external processing module comprises an artificial intelligence recognition and decision-making system.

In this embodiment, as a preferred implementation, the DSP module can perform data interaction with other processing modules (such as an artificial intelligence recognition and decision system) through a network, and by introducing operation results of the other processing modules and combining with a tracking processing algorithm of the DSP module, stability and accuracy of target tracking can be further improved.

On the basis of the above embodiments, the FPGA module and the DSP module are interconnected through an FMC standard connector.

In this embodiment, as a preferred implementation, the DSP module may perform data interaction with other processing modules through a network. The FPGA module and the DSP module can perform data caching in the external storage module when processing image data. The core module and the interface module are interconnected through an FMC standard connector, and a communication protocol is formulated according to an FMC (FPGA mezzanineCoard, FPGA middle layer board card) standard.

On the basis of the above embodiments, the FPGA module and the DSP module each include a storage unit, a power supply unit, a clock unit, a reset unit, and a network port unit.

In this embodiment, as a preferred implementation, fig. 1 includes a core component of the image processing platform, which is composed of an FPGA module, a DSP module, and necessary power supply, clock, and reset modules.

On the basis of the above embodiments, the DSP module further includes a DSP core and a DDR3 image cache unit; the DSP core is integrated with an image processing algorithm and used for performing image data operation, and the DDR3 image cache unit is used for storing image data.

The size of the board card is 3U, the requirement of miniaturization in an unmanned combat system is met, the design mode of the core module and the interface module is adopted, different interface modules are matched according to actual conditions for use, the universality of the platform is improved, and the research and development period is shortened;

fig. 2 is a schematic diagram of a specific application of a core module and an interface module of an image processing platform according to an embodiment of the present invention, in which a video encoder and a video decoder are integrated on the interface module, an appropriate interface module is selected according to a specific video source type, a specific video source number, and a specific display interface number, and data interaction is performed between the core module and the interface module through an FMC interface. The decoder and the encoder required by the acquisition and display of the video are controlled by the FPGA module. The FPGA module is also responsible for sending the video data after the preprocessing to the DSP module through a high-speed serial bus interface, and the DSP module only needs to be concentrated on realizing the image processing algorithm flow and cannot be interrupted by other tasks, so that the tracking real-time performance is improved. The DSP module can perform data interaction with other processing modules (such as an artificial intelligence recognition and decision system) through a network, and the stability and the accuracy of target tracking can be further improved by introducing the operation results of the other processing modules and combining the tracking processing algorithm of the DSP module

In summary, the high-real-time-performance general image processing platform applicable to the unmanned combat system provided by the embodiment of the invention utilizes the characteristics of strong parallel processing capability of the FPGA module, large number of IO pins and rich integrated soft core resources and the characteristics of strong operation processing capability of the DSP. The FPGA module is responsible for image acquisition, display, external communication control and image preprocessing, and due to the parallel processing characteristic of the FPGA module, the work is synchronously expanded, so that the real-time performance of image tracking is improved. The DSP focuses on the realization of the image processing algorithm, the image processing operation flow cannot be interrupted by other tasks, the tracking processing time is shortened, and the tracking real-time performance is improved. The DSP can also receive external information through a network, such as target recognition and decision results of an artificial intelligence platform, so that the tracking stability and accuracy are further improved.

It should be noted that the terms "first" and "second" in the embodiments of the present invention are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a system, product or apparatus that comprises a list of elements or components is not limited to only those elements or components but may alternatively include other elements or components not expressly listed or inherent to such product or apparatus. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.

Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.

Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims

1. A high real-time general image processing platform suitable for unmanned combat systems is characterized by comprising a Field Programmable Gate Array (FPGA) module and a Digital Signal Processing (DSP) module;

2. The high-instantaneity general image processing platform suitable for the unmanned combat system as claimed in claim 1, wherein the DSP module is specifically configured to write image data into an image buffer in a DDR3 read/write controller through a DDR3 read/write controller, and read the image data in the DDR3 read/write controller for operation as required.

3. The high-instantaneity general image processing platform suitable for the unmanned combat system as claimed in claim 1, wherein the DSP module is further configured to perform data interaction with an external processing module through a network, and to improve stability and accuracy of target tracking by introducing an operation result of the external processing module in combination with a tracking processing algorithm of the DSP module itself; the external processing module comprises an artificial intelligence recognition and decision-making system.

4. The high real-time versatile image processing platform for unmanned combat systems as claimed in claim 1, wherein said FPGA module and said DSP module, said FPGA module and said interface module are interconnected by FMC standard connectors.

5. The high-instantaneity universal image processing platform suitable for unmanned combat systems according to claim 1, wherein the FPGA module and the DSP module each comprise a storage unit, a power supply unit, a clock unit, a reset unit and a network interface unit.

6. The high real-time generic image processing platform for unmanned combat systems as claimed in claim 2, wherein said DSP module further comprises a DSP core and a DDR3 image cache unit; the DSP core is integrated with an image processing algorithm and used for performing image data operation, and the DDR3 image cache unit is used for storing image data.