CN116962634A - Unmanned aerial vehicle beyond-vision distance monitoring method and system based on wireless network communication - Google Patents
Unmanned aerial vehicle beyond-vision distance monitoring method and system based on wireless network communication Download PDFInfo
- Publication number
- CN116962634A CN116962634A CN202310831478.8A CN202310831478A CN116962634A CN 116962634 A CN116962634 A CN 116962634A CN 202310831478 A CN202310831478 A CN 202310831478A CN 116962634 A CN116962634 A CN 116962634A
- Authority
- CN
- China
- Prior art keywords
- data
- unmanned aerial
- aerial vehicle
- wireless network
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004891 communication Methods 0.000 title claims abstract description 120
- 238000012544 monitoring process Methods 0.000 title claims abstract description 42
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000005540 biological transmission Effects 0.000 claims abstract description 39
- 238000005516 engineering process Methods 0.000 claims abstract description 15
- 230000008569 process Effects 0.000 claims abstract description 13
- 238000012545 processing Methods 0.000 claims description 42
- 238000007906 compression Methods 0.000 claims description 21
- 230000006835 compression Effects 0.000 claims description 21
- 230000009471 action Effects 0.000 claims description 15
- 230000006870 function Effects 0.000 claims description 14
- 230000000007 visual effect Effects 0.000 claims description 13
- 230000001276 controlling effect Effects 0.000 claims description 10
- 238000004458 analytical method Methods 0.000 claims description 9
- 238000007781 pre-processing Methods 0.000 claims description 6
- 239000000284 extract Substances 0.000 claims description 5
- 230000001133 acceleration Effects 0.000 claims description 3
- 238000004140 cleaning Methods 0.000 claims description 3
- 230000000875 corresponding effect Effects 0.000 claims description 3
- 238000013144 data compression Methods 0.000 claims description 3
- 230000006837 decompression Effects 0.000 claims description 3
- 230000007613 environmental effect Effects 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000010223 real-time analysis Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
- H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
- H04N19/426—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements using memory downsizing methods
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43632—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
- H04N21/43635—HDMI
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/024—Guidance services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/38—Services specially adapted for particular environments, situations or purposes for collecting sensor information
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention aims to provide an unmanned aerial vehicle beyond-view distance monitoring method and system based on 4G or 5G wireless network communication, and aims to solve the problems that in the prior art, in the aspect of unmanned aerial vehicle monitoring, data transmission is slow, data transmission is greatly influenced by factors such as areas and signal intensity, and the like, and the flight state of an unmanned aerial vehicle cannot be accurately monitored. The monitoring method adopts a 4G or 5G wireless network communication technology, and can realize real-time monitoring of the unmanned aerial vehicle in the flight process, including the state and the position of the unmanned aerial vehicle and the transmission of information such as images and videos shot by the unmanned aerial vehicle. Compared with the prior art, the invention has the technical advantages of high data transmission speed, good transmission stability, no limitation of distance in transmission and higher positioning and monitoring precision of the unmanned aerial vehicle.
Description
Technical Field
The invention relates to the technical fields of network communication, computers and unmanned aerial vehicles, in particular to an unmanned aerial vehicle beyond-the-horizon monitoring method and system based on wireless network communication.
Background
Due to the high efficiency and high flexibility, the unmanned aerial vehicle can carry out tasks such as emergency, rescue and transportation in dangerous areas or places where people are difficult to reach, such as earthquake areas, oceans, fire sites and the like in a short time, has lower operation cost and maintenance cost, and is greatly supported and popularized by various industries of China. However, the unmanned plane performs bidirectional interactive control within a short distance range in a point-to-point manner at present, and has the limitations of short transmission distance, poor anti-interference capability, low use efficiency and the like. 4G or 5G wireless network communication is used as a communication mode for high-speed data transmission. If the high-speed wireless communication system is combined with an unmanned aerial vehicle, high-speed transmission of data such as high-definition video streams and images can be realized, seamless connection can be realized in the coverage area of a communication base station, and the high-speed wireless communication system is suitable for real-time monitoring and has stable connectivity, lower delay and higher reliability and safety.
Disclosure of Invention
The invention provides an unmanned aerial vehicle beyond-visual-range monitoring method and system based on wireless network communication, which aim to solve the problems that in the prior art, the data transmission speed is low, the data transmission is greatly influenced by factors such as areas and signal intensity, and the like, and the flight state of an unmanned aerial vehicle cannot be accurately monitored. The monitoring method adopts a 4G or 5G wireless network communication technology, and can realize real-time monitoring of the unmanned aerial vehicle in the flight process, including the state and the position of the unmanned aerial vehicle and the transmission of information such as images and videos shot by the unmanned aerial vehicle. Compared with the prior art, the invention has the technical advantages of high data transmission speed, good transmission stability, no limitation of distance in transmission and higher positioning and monitoring precision of the unmanned aerial vehicle.
The invention provides a wireless network communication-based unmanned aerial vehicle beyond-the-horizon monitoring method, which comprises the following steps:
1) And (3) data downlink processing: the data acquisition module acquires data information through the sensor and transmits the data information to a central processor of a monitoring center through a 4G or 5G wireless network, so as to monitor the ground in real time and process the information;
2) And (3) data uplink processing: the monitoring center sends out an instruction to the unmanned aerial vehicle through a 4G or 5G wireless network, so that the unmanned aerial vehicle executes specified actions;
3) Storing the unmanned aerial vehicle information record in a memory card of a main control module of the unmanned aerial vehicle and a central processor of a monitoring center;
4) The storage battery is used for supplying power to unmanned aerial vehicle on-board consumer, and the external power supply is used for supplying power to monitoring center consumer.
The downlink data processing process in the step 1) is specifically as follows:
1.1 Video data and other digital data are collected, and the collected data are input to a main control module for compression coding;
1.2 Compression coding is carried out on the acquired data, and the data after compression coding is written into a data cache area of a 4G or 5G wireless network communication module;
1.3 The 4G or 5G wireless network communication module extracts data of the data cache area, and transmits wireless signals to the ground server through the 4G or 5G wireless network after data modulation;
1.4 The ground 4G or 5G wireless network communication module receives data, and digital signals are input to the central processing unit after data modulation;
1.5 The central processing unit decompresses and decodes the received data and displays the data visually through data processing analysis.
In the step 1.1), video information is read through a visible light camera and an infrared camera, the flight controller and inertial navigation return digital information, and data are transmitted to a main control module of the unmanned aerial vehicle in a wired transmission mode; firstly, a main control module creates a Video Capture object through an Open CV library function, designates a camera ID to be read, and then circularly reads Video frame data by using a cv:video capture:read function and stores the Video frame data into a Cuda Mapped Memory object; secondly, preprocessing Video frame data, and writing the preprocessed Video data into a data compression encoder of a main control module by using a cv Video Writer; finally, video data of the visible light camera and the infrared camera are read and transmitted to the main control module; the digital data is read through a program written by Python, and the data is written into the master control module through a serial library of Python.
In the step 1.2), firstly, the data of visible light video and infrared video are compressed and encoded by using an H.264 video encoding algorithm, secondly, the compressed and encoded video data and digital data are converted into binary digital data by using a Huffman data encoding algorithm, and finally, the digital data are written into a data cache area of a 4G or 5G wireless network communication module by using a Python serial library;
in the step 1.3), firstly, a 4G or 5G wireless network communication module reads data in a data buffer area in a serial port communication mode, secondly, an OFDM digital modulation technology is used for modulating digital signals into analog signals, and finally, the modulated analog signals are converted into wireless signals through a communication antenna and sent out;
in step 1.4), firstly, a ground 4G or 5G wireless network module receives wireless signals through a communication antenna, converts the wireless signals into analog signals, secondly, modulates the analog signals into digital signals by using an OFDM digital modulation technology, and finally, transmits data to a ground processor in a serial port communication mode;
in step 1.5), firstly, a data decompression and decoding algorithm is realized by using an H.264 video coding algorithm, the received data is decompressed and decoded to obtain original data, secondly, operations such as data cleaning, data preprocessing, data feature extraction, data classification and the like are carried out on the decoded original data, secondly, the processed and analyzed digital data is visually displayed and video data is opened and played through an Open CV library and a visual library, and finally, a visual interface is transmitted to a display screen for display through HDMI transmission.
The data uplink processing process specifically comprises the following steps:
2.1 The ground server inputs a control instruction and inputs the control instruction into a data cache area of the 4G or 5G wireless network communication module;
2.2 The 4G or 5G wireless network communication module extracts data in the data cache area, and transmits wireless signals to the unmanned aerial vehicle through the 4G or 5G wireless network after data modulation;
2.3 A 4G or 5G wireless network communication module on the unmanned aerial vehicle receives data, and inputs digital signals to a main control module after data modulation;
2.4 The main control module analyzes and processes the input control instruction, and further controls the action of the unmanned aerial vehicle.
In the step 2.1), connection is established with a 4G or 5G wireless network communication module in a serial port communication mode, connection establishment and data transmission channel opening are realized, and a written control instruction is input into a data cache area of the 4G or 5G wireless network communication module to wait for transmission;
in step 2.2), firstly, the 4G or 5G wireless network module reads the control instruction data of the data buffer area in a serial port communication mode, secondly, an OFDM digital modulation technology is used for modulating the digital signal of the control instruction into an analog signal, and finally, the modulated analog signal is converted into a wireless signal through a communication antenna and sent out;
in the step 2.3), firstly, a 4G or 5G wireless network module on the unmanned aerial vehicle receives wireless signals through a communication antenna, converts the wireless signals into analog signals, secondly, modulates the analog signals into digital signals by using an OFDM digital modulation technology, and finally, transmits data to a main control module in a serial port communication mode;
in step 2.4), the main control module receives the control instruction input by the ground server through the serial port communication mode. And analyzing the received control instruction, extracting action information to be controlled, controlling the unmanned aerial vehicle to perform corresponding actions according to the analyzed action information, and finally confirming a control result through returned response data after the action control is finished, and confirming whether the unmanned aerial vehicle reaches a designated position, turns to a designated angle and other operations.
The invention also provides an unmanned aerial vehicle beyond visual range monitoring system based on wireless network communication, which comprises the following steps:
unmanned aerial vehicle, unmanned aerial vehicle includes data acquisition module, main control module, communication module and power module. The data acquisition module is used for acquiring data of various sensors on the unmanned aerial vehicle. The main control module is a control center on the unmanned aerial vehicle and is responsible for controlling the flight of the unmanned aerial vehicle and executing various tasks. The communication module is responsible for communicating with the ground and transmitting data and control instructions. The power module provides power support for each module on the unmanned aerial vehicle.
The monitoring center comprises a communication module, a ground server and a power module. The communication module is mainly used for carrying out data communication and control instruction transmission with the unmanned aerial vehicle. The ground server is a control center of a ground monitoring center and is responsible for controlling and monitoring the unmanned aerial vehicle. The main function of the power module is to provide power support for each module of the monitoring center.
Preferably, the data acquisition module comprises a monitoring camera, a flight controller and inertial navigation, and is installed on the unmanned aerial vehicle, the monitoring camera is used for acquiring environmental images and video data in real time, the flight controller is used for transmitting parameters such as flight attitude, altitude, speed and position of the unmanned aerial vehicle in real time, and the inertial navigation is used for transmitting parameters such as inertial navigation acceleration and angular speed in real time.
Preferably, the main control module comprises a compression encoder, a memory card and a processor, wherein the compression encoder can perform compression processing on collected video and image data and encoding processing on digital information so as to better transmit and store the collected video and image data. The storage card can store information such as videos, images and other sensor data collected by the unmanned aerial vehicle so as to facilitate subsequent data processing and analysis. The processor is responsible for processing all data, instructions and algorithms, and processing and analyzing the collected data to realize the functions of unmanned aerial vehicle such as control, navigation, image processing, calculation and decision.
Preferably, the communication module comprises 4G and 5G chips, a data modulator and a communication antenna, wherein the 4G and 5G chips are responsible for enabling the unmanned aerial vehicle to perform data communication with a ground monitoring center through a 4G or 5G wireless network. The data modulator is responsible for the conversion of digital and analog signals for transmission via an antenna to a ground control center. The communication antenna is a device for information transmission in wireless communication, and is responsible for receiving and transmitting signals, so as to ensure the stability and reliability of communication.
Preferably, the power module of the unmanned aerial vehicle adopts a storage battery to supply power for unmanned aerial vehicle-mounted equipment.
Preferably, the ground server comprises a central processor, a storage unit and a display, wherein the central processor is a core processor in the ground server and is responsible for receiving data transmitted back from the unmanned aerial vehicle, and processing and analyzing the data. The storage unit is used for storing data returned by the unmanned aerial vehicle, and the ground server can store and manage the data returned by the unmanned aerial vehicle through the storage unit so as to facilitate subsequent analysis and processing. The display is responsible for displaying the processed unmanned aerial vehicle data in a visual mode so that an operator can monitor and control in real time.
Preferably, the power module of the monitoring center adopts an external power supply mode to supply power to the system.
The invention has the beneficial effects that:
1. the invention adopts the communication technology of the 4G or 5G wireless network, can realize high data transmission speed, good transmission stability and no limitation of distance in transmission;
2. the invention adopts a 4G or 5G wireless network communication technology, and can realize the real-time monitoring of the unmanned aerial vehicle in the flight process by the monitoring center;
3. according to the invention, the storage unit and the storage card are arranged to store and backup the monitoring data information of the unmanned aerial vehicle, so that the loss of the monitoring data can be prevented.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flow chart of the beyond-the-horizon monitoring system data downstream of the present invention.
Fig. 2 is a flow chart of the data uplink of the beyond-the-horizon monitoring system of the present invention.
Fig. 3 is a schematic structural diagram of the beyond-vision monitoring system of the present invention.
Description of the embodiments
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The invention is described in further detail below with reference to the attached drawings and embodiments:
referring to fig. 1, fig. 1 is a flow chart of data downlink of the beyond-view-range monitoring system according to the present invention, which includes the following steps:
s101, collecting video data and other digital data, and inputting the collected data into a main control module for compression coding.
S102, compression encoding is carried out on the acquired data, and the data after compression encoding is written into a data cache area of a 4G or 5G wireless network communication module.
S103, the 4G or 5G wireless network communication module extracts data of the data cache area, and wireless signals are transmitted to the ground server through the 4G or 5G wireless network after data modulation.
S104, the ground 4G or 5G wireless network communication module receives data, and digital signals are input to the central processing unit after data modulation.
S105, the CPU decompresses and decodes the received data and displays the data visually through data processing analysis.
In step 101, the visible light camera and the infrared camera read video information, and the flight controller and the inertial navigation return digital information, and transmit data to the unmanned aerial vehicle main control module in a wired transmission mode.
Firstly, a main control module creates a Video Capture object through an Open CV library function, designates a camera ID to be read, and then circularly reads Video frame data by using a CV: video Capture:: read function and stores the Video frame data into a Cuda Mapped Memory object. And secondly, preprocessing Video frame data, and writing the preprocessed Video data into a data compression encoder of the main control module by using a cv:::: video Write::. Write function. Finally, video data of the visible light camera and the infrared camera are read, and the video data are transmitted to the main control module. The digital data is read by a program written by Python, and the data is written into the main control module by a serial library of Python. It should be noted that since the digital information contains a small amount of data, compression processing is not required, and only encoding processing is required.
In step 102, firstly, the data of the visible light video and the infrared video are compression coded by using an h.264 video coding algorithm, secondly, the compression coded video data and the digital data are converted into binary digital data by using a Huffman data coding algorithm, and finally, the digital data are written into a data buffer area of a 4G or 5G wireless network communication module by using a Python serial library.
In step 103, firstly, the 4G or 5G wireless network communication module reads the data in the data buffer area through serial port communication, secondly, the OFDM digital modulation technology is used to modulate the digital signal into an analog signal, and finally, the modulated analog signal is converted into a wireless signal through the communication antenna to be sent out.
In step 104, firstly, the ground 4G or 5G wireless network module receives a wireless signal through a communication antenna, converts the wireless signal into an analog signal, secondly, modulates the analog signal into a digital signal by using an OFDM digital modulation technique, and finally, transmits data to a ground processor through a serial port communication mode.
In step 104, a data decompression and decoding algorithm is implemented by using an h.264 video coding algorithm, and the received data is decompressed and decoded to obtain the original data. And secondly, performing operations such as data cleaning, data preprocessing, data characteristic extraction, data classification and the like on the decoded original data. And then, performing Open play on the processed and analyzed digital data visual display and video data through an Open CV library and a visual library. And finally, transmitting the visual interface to a display screen for display through HDMI transmission.
Referring to fig. 2, fig. 2 is a flow chart of the data uplink of the beyond-view-range monitoring system according to the present invention, which includes the following steps:
s201, the ground server inputs a control instruction, and the control instruction is input to a data cache area of the 4G or 5G wireless network communication module.
S202, the data of the data cache area is extracted by the 4G or 5G wireless network communication module, and wireless signals are transmitted to the unmanned aerial vehicle through the 4G or 5G wireless network after data modulation.
S203, the 4G or 5G wireless network communication module on the unmanned aerial vehicle receives data, and the data is modulated to input a digital signal to the main control module.
S204, the main control module analyzes and processes the input control instruction, and further controls the action of the unmanned aerial vehicle.
In step S201, a connection is established with the 4G or 5G wireless network communication module by means of serial port communication, so as to establish a connection and open a data transmission channel. And inputting the written control instruction into a data buffer area of the 4G or 5G wireless network communication module to wait for transmission.
In step S202, firstly, the 4G or 5G wireless network module reads the control instruction data in the data buffer area through serial port communication, secondly, the OFDM digital modulation technology is used to modulate the digital signal of the control instruction into an analog signal, and finally, the modulated analog signal is converted into a wireless signal through the communication antenna to be sent out.
In step S203, firstly, a 4G or 5G wireless network module on the unmanned aerial vehicle receives a wireless signal through a communication antenna, converts the wireless signal into an analog signal, secondly, modulates the analog signal into a digital signal by using an OFDM digital modulation technology, and finally, transmits data to a main control module through a serial port communication mode.
In step S204, first, the main control module receives a control instruction input by the ground server through a serial communication manner. And secondly, analyzing the received control instruction, extracting action information to be controlled, and controlling the unmanned aerial vehicle to perform corresponding actions according to the analyzed action information. And finally, after the action control is finished, confirming a control result through returned response data, and confirming whether the unmanned aerial vehicle reaches a specified position, turns to a specified angle and other operations.
Fig. 3 is a schematic diagram of an over-the-horizon monitoring system according to the present invention. The unmanned aerial vehicle beyond-sight monitoring system based on 4G or 5G wireless network communication comprises: unmanned aerial vehicle and monitoring center.
As shown in fig. 1, the data acquisition module on the unmanned aerial vehicle comprises a monitoring camera 1, a flight controller 2 and an inertial navigation 3; the main control module comprises a compression encoder 4, a memory card 5 and a processor 6; the communication module comprises 4G and 5G chips 7, a data modulator 8 and a communication antenna 9; a battery 10 of the power supply module. The communication module of the monitoring center comprises 4G and 5G chips 11, a data modulator 12 and a communication antenna 13; the ground server comprises a central processing unit 14, a storage unit 15 and a display 16; an external power supply 17 of the power supply module.
In the specific implementation process, the data acquisition module on the unmanned aerial vehicle is used for acquiring data of various sensors on the unmanned aerial vehicle; the main control module is a control center on the unmanned aerial vehicle and is responsible for controlling the flight of the unmanned aerial vehicle and executing various tasks, and controlling the action of the unmanned aerial vehicle according to a preset algorithm and a control instruction so as to ensure the safe flight of the unmanned aerial vehicle; the communication module is responsible for communicating with the ground and transmitting data and control instructions; the main function of the power module is to provide power support for each module on the unmanned aerial vehicle. The communication module of the monitoring center has the main functions of carrying out data communication and control instruction transmission with the unmanned aerial vehicle; the ground server is a control center of a ground monitoring center and is responsible for controlling and monitoring the unmanned aerial vehicle; the main function of the power module is to provide power support for each module of the monitoring center.
It should be noted that: the monitoring center controls the unmanned aerial vehicle to monitor the scene through a 4G or 5G wireless network.
Referring to fig. 3, a monitoring camera of the data acquisition module acquires environmental images and video data in real time. The flight controller transmits parameters such as flight attitude, altitude, speed, position and the like of the unmanned aerial vehicle in real time. Inertial navigation transmits parameters such as inertial navigation acceleration, angular velocity and the like in real time.
Referring to fig. 3, a compression encoder in the main control module may perform compression processing on the acquired video and image data and encoding processing of digital information for better transmission and storage. The storage card can store information such as videos, images and other sensor data collected by the unmanned aerial vehicle so as to facilitate subsequent data processing and analysis. The processor is responsible for processing all data, instructions and algorithms, and processing and analyzing the collected data to realize the functions of unmanned aerial vehicle such as control, navigation, image processing, calculation and decision.
Referring to fig. 3, the 4G and 5G chips in the communication module are responsible for data communication between the unmanned aerial vehicle and the ground monitoring center through a 4G or 5G wireless network. The data modulator is responsible for the conversion of digital and analog signals for transmission over the antenna to the ground control center. A communication antenna is a device for information transmission in wireless communication, which is responsible for receiving and transmitting signals, ensuring stability and reliability of communication.
Referring to fig. 3, the power module of the unmanned aerial vehicle employs a battery to supply power.
Referring to fig. 3, the central processor in the ground server is the core processor in the ground server, which is responsible for receiving data returned from the drone, and for data processing and analysis. Through central processing unit, ground server can carry out real-time analysis and processing to unmanned aerial vehicle data that send back to realize the real-time supervision and the control to unmanned aerial vehicle. The storage unit is used for storing data returned by the unmanned aerial vehicle, and the ground server can store and manage the data returned by the unmanned aerial vehicle through the storage unit so as to facilitate subsequent analysis and processing. The display is responsible for displaying the processed unmanned aerial vehicle data in a visual mode so that an operator can monitor and control in real time.
Referring to fig. 3, a power module of the monitoring center adopts an external power supply to supply power to the system.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for the equipment examples, what has been described above is merely a preferred embodiment of the invention, which, since it is substantially similar to the method examples, is described relatively simply, as relevant to the description of the method examples. The foregoing is merely illustrative of specific embodiments of the present invention, and the scope of the invention is not limited thereto, since modifications and substitutions will be readily made by those skilled in the art without departing from the spirit of the invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.
Claims (9)
1. The unmanned aerial vehicle beyond visual range monitoring method based on wireless network communication is characterized by comprising the following steps of:
1) And (3) data downlink processing: the data acquisition module acquires data information through the sensor and transmits the data information to a central processor of a monitoring center through a 4G or 5G wireless network, so as to monitor the ground in real time and process the information;
2) And (3) data uplink processing: the monitoring center sends out an instruction to the unmanned aerial vehicle through a 4G or 5G wireless network, so that the unmanned aerial vehicle executes specified actions;
3) Storing the unmanned aerial vehicle information record in a memory card of a main control module of the unmanned aerial vehicle and a central processor of a monitoring center;
4) The storage battery is used for supplying power to unmanned aerial vehicle on-board consumer, and the external power supply is used for supplying power to monitoring center consumer.
2. The wireless network communication-based unmanned aerial vehicle beyond-sight monitoring method according to claim 1, wherein: the downlink data processing process in the step 1) is specifically as follows:
1.1 Video data and other digital data are collected, and the collected data are input to a main control module for compression coding;
1.2 Compression coding is carried out on the acquired data, and the data after compression coding is written into a data cache area of a 4G or 5G wireless network communication module;
1.3 The 4G or 5G wireless network communication module extracts data of the data cache area, and transmits wireless signals to the ground server through the 4G or 5G wireless network after data modulation;
1.4 The ground 4G or 5G wireless network communication module receives data, and digital signals are input to the central processing unit after data modulation;
1.5 The central processing unit decompresses and decodes the received data and displays the data visually through data processing analysis.
3. The wireless network communication-based unmanned aerial vehicle beyond-view distance monitoring method according to claim 2, wherein: in the step 1.1), video information is read through a visible light camera and an infrared camera, the flight controller and inertial navigation return digital information, and data are transmitted to a main control module of the unmanned aerial vehicle in a wired transmission mode; firstly, a main control module creates a Video Capture object through an Open CV library function, designates a camera ID to be read, and then circularly reads Video frame data by using a cv:video capture:read function and stores the Video frame data into a Cuda Mapped Memory object; secondly, preprocessing Video frame data, and writing the preprocessed Video data into a data compression encoder of a main control module by using a cv Video Writer; finally, video data of the visible light camera and the infrared camera are read and transmitted to the main control module; the digital data is read through a program written by Python, and the data is written into the master control module through a serial library of Python.
4. The wireless network communication-based unmanned aerial vehicle beyond-view distance monitoring method according to claim 2, wherein: in the step 1.2), firstly, the data of visible light video and infrared video are compressed and encoded by using an H.264 video encoding algorithm, secondly, the compressed and encoded video data and digital data are converted into binary digital data by using a Huffman data encoding algorithm, and finally, the digital data are written into a data cache area of a 4G or 5G wireless network communication module by using a Python serial library;
in the step 1.3), firstly, a 4G or 5G wireless network communication module reads data in a data buffer area in a serial port communication mode, secondly, an OFDM digital modulation technology is used for modulating digital signals into analog signals, and finally, the modulated analog signals are converted into wireless signals through a communication antenna and sent out;
in step 1.4), firstly, a ground 4G or 5G wireless network module receives wireless signals through a communication antenna, converts the wireless signals into analog signals, secondly, modulates the analog signals into digital signals by using an OFDM digital modulation technology, and finally, transmits data to a ground processor in a serial port communication mode;
in step 1.5), firstly, a data decompression and decoding algorithm is realized by using an H.264 video coding algorithm, the received data is decompressed and decoded to obtain original data, secondly, operations such as data cleaning, data preprocessing, data feature extraction, data classification and the like are carried out on the decoded original data, secondly, the processed and analyzed digital data is visually displayed and video data is opened and played through an Open CV library and a visual library, and finally, a visual interface is transmitted to a display screen for display through HDMI transmission.
5. The wireless network communication-based unmanned aerial vehicle beyond-sight monitoring method according to claim 1 or 2, wherein: the data uplink processing process specifically comprises the following steps:
2.1 The ground server inputs a control instruction and inputs the control instruction into a data cache area of the 4G or 5G wireless network communication module;
2.2 The 4G or 5G wireless network communication module extracts data in the data cache area, and transmits wireless signals to the unmanned aerial vehicle through the 4G or 5G wireless network after data modulation;
2.3 A 4G or 5G wireless network communication module on the unmanned aerial vehicle receives data, and inputs digital signals to a main control module after data modulation;
2.4 The main control module analyzes and processes the input control instruction, and further controls the action of the unmanned aerial vehicle.
6. The wireless network communication-based unmanned aerial vehicle beyond-sight monitoring method of claim 5, wherein the method comprises the following steps: in the step 2.1), connection is established with a 4G or 5G wireless network communication module in a serial port communication mode, connection establishment and data transmission channel opening are realized, and a written control instruction is input into a data cache area of the 4G or 5G wireless network communication module to wait for transmission;
in step 2.2), firstly, the 4G or 5G wireless network module reads the control instruction data of the data buffer area in a serial port communication mode, secondly, an OFDM digital modulation technology is used for modulating the digital signal of the control instruction into an analog signal, and finally, the modulated analog signal is converted into a wireless signal through a communication antenna and sent out;
in the step 2.3), firstly, a 4G or 5G wireless network module on the unmanned aerial vehicle receives wireless signals through a communication antenna, converts the wireless signals into analog signals, secondly, modulates the analog signals into digital signals by using an OFDM digital modulation technology, and finally, transmits data to a main control module in a serial port communication mode;
in step 2.4), the main control module receives the control instruction input by the ground server through the serial port communication mode. And analyzing the received control instruction, extracting action information to be controlled, controlling the unmanned aerial vehicle to perform corresponding actions according to the analyzed action information, and finally confirming a control result through returned response data after the action control is finished, and confirming whether the unmanned aerial vehicle reaches a designated position, turns to a designated angle and other operations.
7. An unmanned aerial vehicle beyond visual range monitored control system based on wireless network communication, its characterized in that: the system comprises an unmanned aerial vehicle and a monitoring center which are connected through a communication module;
the unmanned aerial vehicle comprises a data acquisition module, a main control module, a communication module and a power supply module, wherein the data acquisition module is used for acquiring data of various sensors on the unmanned aerial vehicle, the main control module is a control center on the unmanned aerial vehicle and is responsible for controlling the flight of the unmanned aerial vehicle and executing various tasks, the communication module is responsible for communicating with the ground and transmitting data and control instructions, and the power supply module provides power support for each module on the unmanned aerial vehicle;
the monitoring center comprises a communication module, a ground server and a power module, wherein the communication module is used for carrying out data communication and control instruction transmission with the unmanned aerial vehicle; the ground server is a control center of a ground monitoring center and is responsible for controlling and monitoring the unmanned aerial vehicle; the main function of the power module is to provide power support for each module of the monitoring center.
8. The wireless network communication-based unmanned aerial vehicle beyond-sight monitoring system of claim 7, wherein: the data acquisition module comprises a monitoring camera, a flight controller and inertial navigation, and is arranged on the unmanned aerial vehicle, wherein the monitoring camera is used for acquiring environmental images and video data in real time, the flight controller is used for transmitting flight attitude, altitude, speed and position parameters of the unmanned aerial vehicle in real time, and the inertial navigation is used for transmitting inertial navigation acceleration and angular speed parameters in real time; the main control module comprises a compression encoder, a memory card and a processor, wherein the compression encoder carries out compression processing on collected video and image data and encoding processing on digital information; the storage card can store video, images and other sensor data information acquired by the unmanned aerial vehicle; the processor is responsible for processing all data, instructions and algorithms, and processing and analyzing the collected data. The communication module comprises 4G and 5G chips, a data modulator and a communication antenna, wherein the 4G and 5G chips are responsible for carrying out data communication between the unmanned aerial vehicle and a ground monitoring center through a 4G or 5G wireless network; the data modulator is responsible for converting digital signals and analog signals and transmitting the signals to a ground control center through an antenna; the communication antenna is an information transmission device and is responsible for receiving and transmitting signals; the unmanned aerial vehicle's power module adopts the battery to carry out the power supply to unmanned aerial vehicle airborne equipment.
9. The wireless network communication-based unmanned aerial vehicle beyond-sight monitoring system of claim 7, wherein: the ground server comprises a central processor, a storage unit and a display, wherein the central processor is a core processor in the ground server and is used for receiving data transmitted back from the unmanned aerial vehicle and performing data processing and analysis; the storage unit is used for storing data returned by the unmanned aerial vehicle, and the ground server stores and manages the data returned by the unmanned aerial vehicle through the storage unit; the display displays the processed unmanned aerial vehicle data in a visual mode; the power module of the monitoring center adopts an external power supply mode to supply power to the system.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310831478.8A CN116962634A (en) | 2023-07-07 | 2023-07-07 | Unmanned aerial vehicle beyond-vision distance monitoring method and system based on wireless network communication |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310831478.8A CN116962634A (en) | 2023-07-07 | 2023-07-07 | Unmanned aerial vehicle beyond-vision distance monitoring method and system based on wireless network communication |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116962634A true CN116962634A (en) | 2023-10-27 |
Family
ID=88461298
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310831478.8A Pending CN116962634A (en) | 2023-07-07 | 2023-07-07 | Unmanned aerial vehicle beyond-vision distance monitoring method and system based on wireless network communication |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116962634A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117970942A (en) * | 2024-01-30 | 2024-05-03 | 深圳市海科技术有限公司 | Unmanned aerial vehicle flight control system and control method with visual synchronization |
-
2023
- 2023-07-07 CN CN202310831478.8A patent/CN116962634A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117970942A (en) * | 2024-01-30 | 2024-05-03 | 深圳市海科技术有限公司 | Unmanned aerial vehicle flight control system and control method with visual synchronization |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112581590B (en) | Unmanned aerial vehicle cloud edge terminal cooperative control method for 5G security rescue networking | |
| CN112714281A (en) | Unmanned aerial vehicle carries VR video acquisition transmission device based on 5G network | |
| CN116962634A (en) | Unmanned aerial vehicle beyond-vision distance monitoring method and system based on wireless network communication | |
| CN106341667A (en) | UAV (Unmanned Aerial Vehicle) based 3D panorama video remote monitoring system and image acquisition control method thereof | |
| CN102695041A (en) | Unmanned plane load device with real-time wireless high resolution image transmission function | |
| CN209216150U (en) | A kind of intelligence mine car management system | |
| CN209767682U (en) | Intelligent patrol trolley based on 5G network and VR live broadcast | |
| CN112435454A (en) | Unmanned aerial vehicle system, unmanned aerial vehicle control method, device, equipment and medium | |
| CN111695541A (en) | Unmanned aerial vehicle forest fire prevention system and method based on machine vision | |
| CN108234950A (en) | Based on the Chuan Zai lookouts and monitoring system for being tethered at unmanned plane | |
| CN102523432A (en) | Intelligent vehicle-mounted monitoring system based on third generation (3G) | |
| CN114003058B (en) | Intelligent inspection system and method for wearing safety helmet | |
| CN113206967A (en) | Unmanned aerial vehicle high-definition video data transmission system and method based on 5G network | |
| CN115200554A (en) | Unmanned aerial vehicle photogrammetry supervision system and method based on picture recognition technology | |
| WO2024125281A1 (en) | Vehicle image data processing method and device | |
| CN108769571B (en) | Unmanned aerial vehicle video processing system based on collaborative computer system | |
| CN114202886A (en) | Mine blasting safety monitoring and early warning system | |
| CN109561409A (en) | A kind of control system for pilotless automobile | |
| CN116824480A (en) | Monitoring video analysis method and system based on deep stream | |
| CN115797824A (en) | Unmanned aerial vehicle power construction violation identification method and device based on artificial intelligence | |
| Niu et al. | Design of data transmission system of human-autonomous devices for UAV inspection of transmission line status | |
| CN205490926U (en) | Emergent command system of on -vehicle large screen | |
| CN213008793U (en) | Real-time fire-fighting patrol system of unmanned aerial vehicle | |
| CN114326764A (en) | Rtmp transmission-based smart forestry unmanned aerial vehicle fixed-point live broadcast method and unmanned aerial vehicle system | |
| CN116797716A (en) | Real-time acquisition method, device and system for mapping model |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |