CN208636879U - A kind of unmanned plane common image processing systems - Google Patents

A kind of unmanned plane common image processing systems Download PDF

Info

Publication number
CN208636879U
CN208636879U CN201821175288.6U CN201821175288U CN208636879U CN 208636879 U CN208636879 U CN 208636879U CN 201821175288 U CN201821175288 U CN 201821175288U CN 208636879 U CN208636879 U CN 208636879U
Authority
CN
China
Prior art keywords
image processing
fpga
board
printed board
interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201821175288.6U
Other languages
Chinese (zh)
Inventor
王长杰
唐林波
王亚男
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Institute Of Technology Leike Aerospace Information Technology Co ltd
Original Assignee
BEIJING POLYTECHNIC LEIKE ELECTRONIC INFORMATION TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING POLYTECHNIC LEIKE ELECTRONIC INFORMATION TECHNOLOGY Co Ltd filed Critical BEIJING POLYTECHNIC LEIKE ELECTRONIC INFORMATION TECHNOLOGY Co Ltd
Priority to CN201821175288.6U priority Critical patent/CN208636879U/en
Application granted granted Critical
Publication of CN208636879U publication Critical patent/CN208636879U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The utility model discloses a kind of unmanned plane common image processing systems, including FPGA, image processing board and printed board;The input/output interface connector of RS422, RS232, RS485 that promising FPGA is provided and the input interface connector of HDMI, SDI is arranged in printed board;FPGA is attached with image processing board by PCIE, SRIO, GPIO, UART, SPI interface;FPGA and image processing board are mounted in printed board, FPGA is connected by each interface connector in printed board with printed board, RS422 or RS485 or RS232 the input/output interface connector of printed board are connect with external system for flight control computer, HDMI the or SDI input interface connector of printed board is connect with external camera, the upgrading of system entirety can be realized by the upgrading of single hardware for the utility model, interface is abundant, and scalability is stronger.

Description

A kind of unmanned plane common image processing systems
Technical field
The utility model relates to air vehicle technique fields, and in particular to a kind of general image applied on unmanned plane is handled System.
Background technique
Extensive use with image processing techniques in unmanned plane field, unmanned plane image processing system design complexities day Benefit increases, and usually can all carry out image procossing using specific image processing board system in specific image processing system, but with Requirement to the accuracy and real-time of image procossing is increasingly stringent, update of hardware and upgrading are constantly accelerated, traditional figure As processing board system has not been well positioned to meet, image processing algorithm complexity, which increasingly increases, hardware update is increasingly accelerated is wanted It asks, therefore designs the image procossing that a kind of processing speed is fast, the big rate of memory capacity is fast, data throughout is big, versatile System has become the demand of unmanned plane image processing system.
Currently, traditional image processing board system generally uses the framework of FPGA+DSP, to realize stronger processing energy Power just needs the concatenation of a large amount of processor chips, and the quantity of processor chips, which increases, must occupy bigger space and quality, But existing unmanned plane image processing system is just towards small-sized intelligent development, the availability of traditional image processing system and Practicability can no longer meet status.
Traditional unmanned plane image processing system carries out memory expansion using Flash, SRAM or SDRAM etc., due to this A little memories have the shortcomings that memory capacity is low or transmission rate is low, can not be competent at high-volume image data in field of image processing High speed storing.
Traditional unmanned plane image processing system is carried out using parallel bus or universal serial bus resource between processor Interconnection, since the transmission rate of these bus protocols is low, so that data throughout is small between processor, reduces the real-time of system Property.
Traditional unmanned plane image processing system is set in PCB design just for specific image procossing template Count interface, the not no Interface design of generic Extensible, do not consider generally processor chips with can with other a series of chip chambers Compatible pin package, if you need to carry out board upgrading, it is necessary to redesign circuit, extend the design cycle and improve design Cost.
In conclusion the board volume of traditional image procossing board is big, the small rate of memory capacity is low, number between processor , board poor universality small according to handling capacity has been unable to satisfy algorithm complexity in unmanned plane image processing process and has increasingly increased data Measure the status increasingly increased.
Utility model content
In view of this, the present invention provides a kind of unmanned plane common image processing systems, can overcome traditional nothing Man-machine image processing system chip type is single, and the disadvantage that scalability is not strong, system update upgrading is complicated passes through single hardware Upgrading the upgrading of system entirety can be realized, interface is abundant, and scalability is stronger.
The technical scheme for implementing the utility model is as follows:
A kind of unmanned plane common image processing systems, including programmable gate array (Field-Programmable Gate Array, FPGA), image processing board and printed board;
The input/output interface connector of RS422, RS232, RS485 that promising FPGA is provided is arranged in printed board, and The input interface connector of HDMI, SDI;
FPGA is attached with image processing board by PCIE, SRIO, GPIO, UART, SPI interface;
FPGA and image processing board are mounted in printed board, and FPGA passes through each interface connector in printed board and printed board It is connected, RS422 or RS485 or RS232 the input/output interface connector of printed board are connect with external system for flight control computer, HDMI the or SDI input interface connector of printed board is connect with external camera.
Further, the printed board is additionally provided with the external memory interface provided for image processing board, which uses External memory is connected in image processing board.
Further, the printed board is additionally provided with the gigabit ethernet interface provided for image processing board, which uses Host computer outside image processing board connection.
Further, the printed board is additionally provided with the HDMI output interface connector provided for image processing board, this connects Mouth connector is for the display outside image processing board connection.
Further, the printed board is additionally provided with HDMI, SDI the output interface connector provided for FPGA, the interface Connector is for the display outside FPGA connection.
Further, the printed board is additionally provided with the usb interface connector provided for image processing board, interface connection Device is for the mouse and keyboard outside image processing board connection.
Further, the FPGA uses the Airtix-7 family chip of Xilinx company, and described image processing board uses NVDIA JETSON TX2 module.
Further, the FPGA carries out memory expansion using DDR3.
The utility model has the advantages that
One, the utility model is on the basis of meeting high-performance image processing capacity using a piece of FPGA and TX2's Framework reduces volume, the quality of unmanned plane image processing system, improves the image procossing energy of unmanned plane image processing system Power.
Two, it is single to overcome traditional image processing board plateform system chip type for the utility model, scalability is strong, The complicated disadvantage of system update upgrading be can be realized by the upgrading of single hardware and be so that the utility model versatility is stronger The upgrading for entirety of uniting, interface is abundant, and scalability is stronger, so that the utility model has in terms of system upgrade, correcting Very big flexibility, shortens the design cycle, reduces design cost.
Three, the utility model FPGA and image processing board are interconnected using high-speed serial bus, overcome conventional process The slow disadvantage of parallel bus or universal serial bus transmission rate between device, so that the data between each processor of the utility model gulp down The amount of spitting is big, improves the real-time of system.
Four, the utility model FPGA uses DDR3 and carries out memory expansion, overcomes traditional flash, SRAM or SDRAM Processor uses or extension bring memory capacity is low, the low disadvantage of transmission rate, so that the utility model is in data storage side Face has the characteristics that memory capacity is big, memory rate is fast.
Five, the utility model is communicated with host computer using gigabit ethernet interface, overcome traditional serial ports, USB, PCI, The protocol interfaces bring transmission rate such as PCIe, 100 m ethernet is slow or transmission range is short or both the shortcomings that having concurrently, so that this Utility model has the characteristics that long transmission distance, transmission rate are fast when communicating with earth station, improves the real-time of system.
Detailed description of the invention
Fig. 1 is Tthe utility model system structure chart.
Fig. 2 is the utility model interface connection schematic diagram.
Specific embodiment
With reference to the accompanying drawings and examples, the utility model is described in detail.
The utility model provides a kind of general image processing board plateform system based on FPGA for master control core, entire plate Card connects image processing board using a piece of fpga chip as master control core, uses DDR3 and carries out memory expansion, FPGA is supported SRIO, PCIe bus protocol, input interface and output interface equipped with HDMI, SDI, RS422, RS232, RS485 input and it is defeated Outgoing interface and GPIO, UART, SPI interface;Image processing board uses NVDIA JETSON TX2 module, is connected to expansible External memory and gigabit ethernet interface, PCIE interface, HDMI display interface, USB interface and GPIO, UART, SPI connect Mouthful;It is interconnected between image processing module and FPGA using high-speed serial bus, supports SRIO, PCIe bus protocol, in addition two UART interface, SPI interface and several GPIO mouthfuls are also supported between person;The unmanned plane general image processing board of the utility model The installation site of fpga chip, image processing module plate in the printed board of plateform system, for respectively other serial cores can be placed The compatibility position of piece, printed board provide the input interface connector and output interface connector of HDMI, SDI for FPGA, RS422, RS232, RS485 output and input interface connector and GPIO, UART, SPI interface and SRIO, PCIe interface connect Device is connect, external memory is provided for image processing module and gigabit ethernet interface, PCIE interface, SRIO interface, HDMI is aobvious Show interface, USB interface and GPIO, UART, SPI interface connector.
The realization of the utility model also resides in, and fpga chip uses the Airtix-7 family chip of Xilinx company;Its The general unmanned machine image procossing of the utility model manages the acquisition that the purposes in board system is progress image and transmission and letter Single image processing algorithm processing, such as binocular correction, image mosaic.
The realization of the utility model also resides in unmanned plane image processing module and uses using NVDIA JETSON TX2 module, TX2 is a high-performance, small-sized embeded processor, meets that unmanned plane image processing system is small in size, processing speed is fast It is required that while image processing module can be using compatible a variety of image processing boards, such as NVDIA Jetson TX1, NVDIA Jetson TX2, DSP etc., in use, they use unified pin signal definition, at the general image of the utility model Purposes in reason plate plateform system is to know tracking for realizing complicated image processing algorithm, such as image detection, target.
The realization of the utility model also resides in the external memory chip DDR3 that fpga chip is connected to, in the utility model General image processing board in purposes be in image processing process data storage.
The realization of the utility model also resides in FPGA and is connected to HDMI, SDI input interface, in the standard drawing of the utility model As the purposes in processing board plateform system is acquisition image.
The realization of the utility model also resides in FPGA and is connected to HDMI, SDI output interface, in the standard drawing of the utility model As the purposes in processing board plateform system is directly to export display to the image of acquisition.
The realization of the utility model also resides in FPGA and is connected to RS422, flat in the general image processing board of the utility model Purposes in platform system is connection system for flight control computer, sends control instruction to flight control system.
The realization of the utility model also resides in the gigabit Ethernet that picture processing chip is connected to, in the logical of the utility model It is output treated image with the purposes in image processing board plateform system.
The realization of the utility model also resides in picture processing chip and is connected to HDMI, at the general image of the utility model Purposes in reason plate plateform system is to be directly connected to display to show image.
The realization of the utility model also resides in picture processing chip and is connected to GPIO, UART, SPI interface, practical new at this Purposes in the general image processing board plateform system of type is the instruction transmission realized between FPGA and TX1.
The realization of the utility model also resides in the USB interface that picture processing chip is connected to, in the general of the utility model Purposes in image processing board plateform system is the common USB peripheral of connection, such as mouse, keyboard.
Embodiment 1
With reference to attached drawing 1, this example is main image by master control core, a NVDIA TX1 chip of a piece of fpga chip The basic framework of processing unit carries out PCIe interconnection using high-speed serial bus between FPGA and TX1 piece on this framework, to scheme The quick transmission of picture, picture processing chip periphery also extend SD card memory, to image data preservation and gigabit with Too network interface, to image data is transferred to earth station by treated.
With reference to attached drawing 1, the process flow of unmanned plane image processing system are as follows: FPGA connects camera by HDMI interface, into Row Image Acquisition, wherein serial ports is converted to HDMI interface by protocol conversion chip by FPGA;The original image of acquisition is passed through PCIe interface is sent to TX1, and TX1 handles image, and image after processing is exported by network interface, and network interface connection is without line chart Transmission module, by treated, image information is sent to earth station to wireless image module, and the control instruction of TX1 output passes through UART and passes Defeated to arrive FPGA, control instruction is sent to flight control system by RS422 interface by FPGA, and wherein FPGA is connected by protocol conversion chip Connect RS422 interface.
With reference to attached drawing 2, the FPGA and camera of the utility model are interconnected using HDMI interface, are mainly used for acquiring image.
It with reference to attached drawing 2, is interconnected between the FPGA and TX1 of the utility model using high-speed serial bus, supports PCIe total Wire protocol is mainly used for FPGA to TX1 high-speed transfer image data, and PCIe3.0 interface is transmitted using four path parallel in this example, Every channel rate is 1GB/s, four-way total 4GB/s, message transmission rate 4GB/s, considerably beyond Traditional parallel bus or is led to With 100,000,000 grades of rate of universal serial bus.
With reference to attached drawing 2, the TX1 and display of the utility model are interconnected by HDMI, are mainly used for image processing algorithm volume Code, debugging display interface.
With reference to attached drawing 2, the TX1 and mouse, keyboard of the utility model are interconnected by USB interface, are mainly used for image procossing Algorithm routine coding, debugging.
With reference to attached drawing 2, the TX1 of the utility model and earth station are mainly used for handle by wireless transmission interface inter-link Video image afterwards is shown.
With reference to attached drawing 2, the TX1 and SD card memory of the utility model are interconnected by SD card interface, are mainly used for picture number According to storage.
Since then, the design of unmanned plane image processing system is just completed.
Embodiment 2
With reference to attached drawing 1, this example is main image by master control core, a NVDIA TX2 chip of a piece of fpga chip The basic framework of processing unit carries out PCIe interconnection using high-speed serial bus between FPGA and TX2 piece on this framework, to scheme The quick transmission of picture, picture processing chip periphery also extend SD card memory, to image data preservation and gigabit with Too network interface, to image data is transferred to earth station by treated.
With reference to attached drawing 1, the process flow of unmanned plane image processing system are as follows: FPGA connects camera by HDMI interface, into Row Image Acquisition, wherein serial ports is converted to HDMI interface by ADV7611 protocol conversion chip by FPGA;By the original graph of acquisition As being sent to TX2 by PCIe interface, TX2 handles image, and image after processing is passed through network interface and is exported, network interface connection Wireless image transmission module, by treated, image information is sent to earth station to wireless image module, and the control instruction of TX2 output passes through UART is transferred to FPGA, and control instruction is sent to flight control system by RS422 interface by FPGA, and wherein FPGA passes through protocol conversion Chip connects RS422 interface.
With reference to attached drawing 2, the FPGA and camera of the utility model are interconnected using HDMI interface, are mainly used for acquiring image.
It with reference to attached drawing 2, is interconnected between the FPGA and TX2 of the utility model using high-speed serial bus, supports PCIe total Wire protocol is mainly used for FPGA to TX2 high-speed transfer image data, and PCIe3.0 interface is transmitted using four path parallel in this example, Every channel rate is 1GB/s, four-way total 4GB/s, message transmission rate 4GB/s, considerably beyond Traditional parallel bus or is led to With 100,000,000 grades of rate of universal serial bus.
With reference to attached drawing 2, the TX2 and display of the utility model are interconnected by HDMI, are mainly used for image processing algorithm volume Code, debugging display interface.
With reference to attached drawing 2, the TX2 and mouse, keyboard of the utility model are interconnected by USB interface, are mainly used for image procossing Algorithm routine coding, debugging.
With reference to attached drawing 2, the TX2 of the utility model and earth station are mainly used for handle by wireless transmission interface inter-link Video image afterwards is shown.
With reference to attached drawing 2, the TX2 and SD card memory of the utility model are interconnected by SD card interface, are mainly used for picture number According to storage.
Since then, the design of unmanned plane image processing system is just completed.
In conclusion the above is only the preferred embodiments of the present utility model only, it is not intended to limit the utility model Protection scope.Within the spirit and principle of the utility model, any modification, equivalent replacement, improvement and so on should all wrap Containing being within the protection scope of the utility model.

Claims (8)

1. a kind of unmanned plane common image processing systems, which is characterized in that including FPGA, image processing board and printed board;
Printed board be arranged RS422, RS232, RS485 that promising FPGA is provided input/output interface connector and HDMI, The input interface connector of SDI;
FPGA is attached with image processing board by PCIE, SRIO, GPIO, UART, SPI interface;
FPGA and image processing board are mounted in printed board, and FPGA passes through each interface connector and printed board phase in printed board Even, RS422 or RS485 or RS232 the input/output interface connector of printed board are connect with external system for flight control computer, are printed HDMI the or SDI input interface connector of making sheet is connect with external camera.
2. a kind of unmanned plane common image processing systems as described in claim 1, which is characterized in that the printed board is also set up The external memory interface that promising image processing board provides, the interface connect external memory for image processing board.
3. a kind of unmanned plane common image processing systems as described in claim 1, which is characterized in that the printed board is also set up The gigabit ethernet interface that promising image processing board provides, the interface is for the host computer outside image processing board connection.
4. a kind of unmanned plane common image processing systems as described in claim 1, which is characterized in that the printed board is also set up The HDMI output interface connector that promising image processing board provides, the interface connector is for aobvious outside image processing board connection Show device.
5. a kind of unmanned plane common image processing systems as described in claim 1, which is characterized in that the printed board is also set up HDMI, SDI output interface connector that promising FPGA is provided, the interface connector is for the display outside FPGA connection.
6. a kind of unmanned plane common image processing systems as described in claim 1, which is characterized in that the printed board is also set up The usb interface connector that promising image processing board provides, the interface connector mouse external for image processing board connection with Keyboard.
7. a kind of unmanned plane common image processing systems as described in claim 1, which is characterized in that the FPGA is used The Airtix-7 family chip of Xilinx company, described image processing board use NVDIA JETSON TX2 module.
8. a kind of unmanned plane common image processing systems as described in claim 1, which is characterized in that the FPGA uses DDR3 Carry out memory expansion.
CN201821175288.6U 2018-07-24 2018-07-24 A kind of unmanned plane common image processing systems Active CN208636879U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201821175288.6U CN208636879U (en) 2018-07-24 2018-07-24 A kind of unmanned plane common image processing systems

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201821175288.6U CN208636879U (en) 2018-07-24 2018-07-24 A kind of unmanned plane common image processing systems

Publications (1)

Publication Number Publication Date
CN208636879U true CN208636879U (en) 2019-03-22

Family

ID=65738457

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201821175288.6U Active CN208636879U (en) 2018-07-24 2018-07-24 A kind of unmanned plane common image processing systems

Country Status (1)

Country Link
CN (1) CN208636879U (en)

Similar Documents

Publication Publication Date Title
CN101901200B (en) Method for realizing double advanced high-performance bus (AHB) Master interface-based on-chip direct memory access (DMA) controller
CN202084028U (en) Modularized multi-serial port expanding device
CN209044577U (en) Synthetical display control module
CN203812236U (en) Data exchange system based on processor and field programmable gate array
CN201727499U (en) Plug-in multi-parameter monitor
CN103200081A (en) Heterogeneous network environment oriented Internet of things gateway development platform
CN104794088A (en) Multi-interface bus converting expanding chip design
CN203456071U (en) LED display screen asynchronous control card and LED display screen system
CN109885526A (en) A kind of information processing platform based on OpenVPX bus
CN106027424A (en) Ethernet exchange device based on RapidIO exchange technology
CN105515673B (en) A kind of optical-fibre channel node card
CN104811643A (en) Image data high speed storage system based on SD card array
CN103616935A (en) Embedded computer mainboard
CN103617301A (en) Multi-channel data acquisition processing device based on DSP and FPGA
CN104699654A (en) Interconnection adapting system and method based on CHI on-chip interaction bus and QPI inter-chip interaction bus
CN103377170B (en) SPI high-speed bidirectional Peer Data Communication system between heterogeneous processor
CN209103281U (en) Integrated multi-bus interface module based on pci interface
CN205249246U (en) Data interchange circuit
CN203632688U (en) Multifunctional communication interface machine device based on PowerPC embedded system
CN208636879U (en) A kind of unmanned plane common image processing systems
CN101894055A (en) Method for realizing blade mainboard interface with redundancy function
CN104102601B (en) A kind of image data acquiring storage system based on FPGA
CN203167288U (en) Internet of Things gateway development platform facing heterogeneous network environments
CN202058139U (en) Serial port conversion module based on universal asynchronous receiver/transmitter (UART) serial port expansion chip
CN101950037A (en) Safety inspection system with embedded Ethernet transmission based on SOPC

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20240105

Address after: Room 101, 1st Floor, Building 1, No. 6 Yuanda Road, Haidian District, Beijing, 100097

Patentee after: Beijing Institute of Technology Leike Aerospace Information Technology Co.,Ltd.

Address before: 100081 Room 401, science and technology building, building 683, zone 2, No.5 Zhongguancun South Street, Haidian District, Beijing

Patentee before: BIT RACO ELECTRONIC INFORMATION TECHNOLOGY CO.,LTD.