WO2020154959A1

WO2020154959A1 - Multi-load image transmission method, control system, control terminal, unmanned aerial vehicle, and server

Info

Publication number: WO2020154959A1
Application number: PCT/CN2019/073938
Authority: WO
Inventors: 王景正; 郑德恩
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2019-01-30
Filing date: 2019-01-30
Publication date: 2020-08-06
Also published as: CN111279690A

Abstract

The present invention provides a multi-load image transmission method, a control system, a control terminal, an unmanned aerial vehicle, and a server. The multi-load image transmission method comprises: in response to a load selection instruction, transmitting an image transmission acquisition instruction for turning on a load device on the unmanned aerial vehicle to the unmanned aerial vehicle or the server, wherein the image transmission acquisition instruction is used for indicating the unmanned aerial vehicle to open the mobile data network transmission channel of the corresponding load (S202); and sending, by the unmanned aerial vehicle or the server, image data acquired by the corresponding load on the unmanned aerial vehicle (S204). According to the technical solution of the present invention, by using a mobile data network to perform image transmission, the present invention can release a limit to an image data transmission distance, achieves real-time image transmission within a super remote distance, and provides more possibilities for the working scene of the industrial application of the unmanned aerial vehicle.

Description

Multi-load image transmission method, control system, control terminal, drone and server

Technical field

The invention relates to the field of control technology, in particular to a multi-load image transmission method, a control system, a control terminal, an unmanned aerial vehicle and a server.

Background technique

Most of the current UAV image transmission technology is based on private wireless network modules for transmission, such as radio, WIFI or other private wireless network module links. However, in the process of industrial application, due to the rich use scenarios and the complex drone operating environment, the image transmission technology based on the private wireless network module has the following shortcomings:

(1) The communication distance is limited by the power of the wireless network module, and it is not possible to perform ultra-long-distance image transmission, such as remote control and airplane image transmission under the distance between provinces and cities;

(2) The private wireless network link has serious interference in the complex network environment of the city and cannot truly realize the ideal communication distance. The actual available communication distance is usually far less than the limit distance under the condition of no interference in the network;

(3) Since the private wireless network module is usually a point-to-point transmission model, it is often only possible to realize one machine for one control (one drone to one remote control), and it is impossible to realize the real-time transmission of image data in the case of multiple terminals.

Summary of the invention

The embodiment of the present invention provides a multi-load image transmission method, control system, control terminal, unmanned aerial vehicle, and server to remove the limitation of image data transmission distance, realize ultra-long distance real-time image transmission and control of one machine with multiple controls It provides more possibilities for the working scenarios of drones in the industry.

In order to achieve the foregoing objective, the first aspect of the embodiments of the present invention provides a multi-load image transmission method for controlling a terminal, including:

In response to the load selection instruction, sending an image transmission acquisition instruction to turn on the load device in the drone to the drone or server, where the image transmission acquisition instruction is used to instruct the drone to open the mobile data network transmission channel of the corresponding load;

The image data acquired by the corresponding load on the drone sent by the drone or the server is received through a mobile data network.

The technical solution of the second aspect of the present invention provides a multi-load image transmission method for drones, the drone includes a drone body and a plurality of load devices arranged on the drone body, The multi-load image transmission method includes:

Receive the image transmission acquisition instruction issued by the server or control terminal;

Opening the mobile data network transmission channel of the corresponding load in the multiple load devices according to the image transmission acquisition instruction;

The image data corresponding to the corresponding load is sent to the server or the control terminal through a mobile data network.

The technical solution of the third aspect of the present invention provides a multi-load image transmission method for a server, including:

Receive the image transmission acquisition command sent by the control terminal to turn on the load equipment in the drone;

Sending the image transmission acquisition instruction to the drone to instruct the drone to open a mobile data network transmission channel corresponding to the load;

The image data sent by the drone corresponding to the above corresponding load device is received through a mobile data network, and the image data is sent to the control terminal through the mobile data network.

The technical solution of the fourth aspect of the present invention provides a control system, including a control terminal and an unmanned aerial vehicle, wherein:

In response to the load selection instruction, the control terminal sends an image transmission acquisition instruction to turn on the load device in the drone to the drone;

The drone opens the mobile data network transmission channel corresponding to the load according to the received image transmission acquisition instruction;

The drone sends the image data corresponding to the corresponding load to the control terminal through a mobile data network.

The technical solution of the fifth aspect of the present invention provides a control terminal, including: a remote control device, a display device, and a processor, wherein the processor is used for:

The technical solution of the sixth aspect of the present invention provides an unmanned aerial vehicle, which includes an unmanned aerial vehicle body, a plurality of load devices arranged on the unmanned aerial vehicle body, and a processor, wherein the processor is used for:

The technical solution of the seventh aspect of the present invention provides a server, including a processor, configured to:

The technical solution of the eighth aspect of the present invention provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the multi-load image transmission method as provided in the first aspect of the embodiment of the present invention is implemented. Steps, implementing the steps of the multi-load image transmission method provided in the second aspect of the embodiment of the present invention, or implementing the steps of the multi-load image transmission method provided in the third aspect of the embodiment of the present invention.

The multi-load image transmission method, control system, control terminal, drone, and server provided by the embodiments of the present invention adopt a mobile data network for multi-load image transmission, and have the following advantages:

(1) The mobile data network has a high network coverage. Where there is a mobile data network, the real-time image transmission function of the drone's airborne equipment can be realized, which greatly increases the application range of the drone;

(2) Since the mobile data network is connected to the public network, any control terminal that is authenticated by the drone that is connected to the mobile data network can obtain real-time images as long as it can send instructions to request image transmission to the drone. Data enables ultra-long distance image transmission between the control terminal and the drone; for example, the remote control and the drone are separated in two places in different provinces and cities, and image data transmission can also be realized.

(3) The data communication model based on the mobile data network is usually not a point-to-point communication model, so the drone can be sent at once, and multiple authenticated control terminals can receive image data, which improves the drone and control terminal Ease of use.

(4) The image transmission channel of the mobile data network can also be used as the backup image transmission link of the private wireless network image transmission channel. When the performance of the private wireless network is poor, the signal interference is serious, and the image transmission quality is low, it will automatically switch to the mobile data network. The image transmission channel can realize more reliable image transmission and grasp the current dynamics of the UAV in real time.

The additional aspects and advantages of the present invention will become apparent in the following description, or be understood through the practice of the present invention.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings used in the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, other drawings may be obtained based on these drawings without creative labor.

FIG. 1 shows a schematic structural block diagram of an unmanned aerial vehicle system according to an embodiment of the present invention;

2 shows a schematic flowchart of a multi-load image transmission method running on a control terminal according to an embodiment of the present invention;

FIG. 3 shows a schematic flowchart of a multi-load image transmission method running on a drone according to an embodiment of the present invention;

Figure 4 shows a schematic flowchart of a control system according to an embodiment of the present invention;

Figure 5 shows a schematic flowchart of a specific embodiment of the present invention;

Figure 6 shows a structural block diagram of a control system according to an embodiment of the present invention;

Figure 7 shows a structural block diagram of a control system according to another specific embodiment of the present invention;

Figure 8 shows a structural diagram of a control terminal according to an embodiment of the present invention;

Fig. 9 shows a structural diagram of an unmanned aerial vehicle according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

It should be noted that when a component is referred to as being "fixed to" another component, it can be directly on the other component or a central component may also exist. When a component is considered to be "connected" to another component, it can be directly connected to another component or a centered component may exist at the same time.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field of the present invention. The terms used in the specification of the present invention herein are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The term "and/or" as used herein includes any and all combinations of one or more related listed items.

Hereinafter, some embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.

FIG. 1 is a schematic architecture diagram of an unmanned aerial vehicle system 10 according to an embodiment of the present invention. The UAV system 10 may include a control terminal 110 of the UAV and the UAV 120. Wherein, the drone 120 may be a single-rotor or multi-rotor drone.

The drone 120 may include a power system 102, a control system 104, and a fuselage. Wherein, when the drone 120 is specifically a multi-rotor drone, the fuselage may include a center frame and one or more arms connected to the center frame, and the one or more arms extend radially from the center frame. The drone may also include a tripod, wherein the tripod is connected to the fuselage for supporting the drone when it is landing.

The power system 102 may include one or more motors 1022, and the motors 1022 are used to provide power to the drone 120, and the power enables the drone 120 to realize movement of one or more degrees of freedom.

The control system 104 may include a controller 1042 and a sensing system 1044. The sensing system 1044 is used to measure the status information of the UAV 120 and/or the information of the environment in which the UAV 120 is located, where the status information may include attitude information, position information, remaining power information, and the like. The information of the environment may include the depth of the environment, the atmospheric pressure of the environment, the humidity of the environment, the temperature of the environment, and so on. The sensing system 1044 may include, for example, at least one of sensors such as a barometer, a gyroscope, an ultrasonic sensor, an electronic compass, an inertial measurement unit, a visual sensor, a global navigation satellite system, and a barometer. For example, the global navigation satellite system may be a global positioning system (Global Positioning System, GPS).

The controller 1042 is used to control various operations of the drone. For example, the controller 1042 can control the movement of the drone, and for another example, the controller 1042 can control the sensor system 1044 of the drone to collect data.

In some embodiments, the drone 120 may include a photographing device 1064. The photographing device 1064 may be, for example, a device for capturing images such as a camera or a video camera. The photographing device 1064 may communicate with the controller 1042, and is configured in the controller 1042. Shooting under control, the controller 1042 can also control the drone 120 according to the image captured by the camera 1064.

In some embodiments, the drone 120 further includes a pan/tilt 106, the pan/tilt 106 may include a motor 1062, the pan/tilt 106 is used to carry the camera 1064, and the controller 1042 may control the movement of the pan/tilt 106 through the motor. It should be understood that the pan-tilt 106 may be independent of the drone 120 or a part of the drone 120. In some embodiments, the camera 1064 may be fixedly connected to the body of the drone 120.

The UAV 120 also includes a transmission device 108. Under the control of the controller 1042, the transmission device 108 can send data collected by the sensing system 1044 and/or the camera 1064 to the control terminal 110. The control terminal 110 may include a transmission device (not shown), the transmission device of the control terminal may establish a wireless communication connection with the transmission device 108 of the drone 120, and the transmission device of the control terminal may receive data sent by the transmission device 108. In addition, control The terminal 110 may also send a control instruction to the drone 120 through a transmission device configured by itself.

The control terminal 110 may include a control device 1102 and a display device 1104. The control device 1102 can control various operations of the control terminal. For example, the control device 1102 can control the transmission device to receive the data sent by the drone 120 through the transmission device 108; for another example, the control device 1102 can control the display device 1104 to display the sent data, where the data can include the data captured by the camera 1064. Environment image, posture information, location information, power information, etc.

It can be understood that the control terminal in the foregoing part may include one or more processors, where the one or more processors may work individually or in cooperation.

It should be understood that the aforementioned naming of the components of the UAV system is only for identification purposes and should not be understood as a limitation to the embodiments of the present invention.

The embodiment of the present invention provides a multi-load image transmission method. Fig. 2 is a flowchart of a multi-load image transmission method provided by an embodiment of the present invention. The multi-load image transmission method described in this embodiment can be applied to a control terminal. As shown in Figure 2, the method in this embodiment may include:

S202: In response to the load selection instruction, send an image transmission acquisition instruction to turn on the load device in the drone to the drone or server, where the image transmission acquisition instruction is used to instruct the drone to start mobile data network transmission of the corresponding load aisle.

Specifically, the execution subject of the foregoing multi-load image transmission method may be a remote control device. The remote control device may be a component of the control terminal, that is, the control terminal includes a remote control device. In some cases, a part of the remote control device can be installed on the control terminal, and a part of the remote control device can be installed on the drone. The control terminal also includes a display device, which is electrically connected with the remote control device to display a corresponding program interface, wherein the display device may be a touch display device. It should also be noted that the remote control device and the display device may be separated and communicate in a wired or wireless manner, and the two may also be integrated.

UAVs usually have more multi-load applications. In this case, the mobile data network image transmission needs to select multiple loads on the current drone, and select the image data of one load device to transmit to the control terminal. As mentioned earlier, by responding to the load selection instruction, the UAV or server sends the image transmission acquisition instruction to turn on the load device in the drone, that is, multiple load devices are selected to make the selected one or more load devices The mobile data network transmission channel of the corresponding load is turned on, and the image data captured by the corresponding load is transmitted through the mobile network; the image transmission acquisition instruction is used to instruct the drone to open the mobile data network transmission channel of the corresponding load , That is, the mobile data network is used as the transmission channel to carry out the image transmission from the drone to the control terminal, or the mobile data network is used as the transmission channel to carry out the image transmission from the server to the control terminal, so as long as there is a mobile network, it can be Realize the ultra-long-distance image transmission from the UAV to the control terminal, or the ultra-long-distance image transmission from the server to the control terminal, realize the ultra-long-distance transmission of the image transmission, and expand the application range of the UAV.

S204: Receive the image data acquired by the corresponding load on the drone and sent by the drone or the server through a mobile data network.

Specifically, the drone or the server sends the image data acquired by the drone corresponding to the load to the control terminal, and the control terminal receives the acquired image data through the mobile data network. During the data transmission process, because the mobile network is used for transmission, It can reduce the interference of multiple private networks, and can also transmit multiple drones to the control terminal at the same time, which improves the transmission speed of image transmission and the reliability of data transmission.

In the multi-load image transmission method provided by the embodiment of the present invention, by using a mobile data network transmission channel to transmit image data, image data can be transmitted in a variety of scenarios, even between the drone and the control terminal, the server and the control The distance between the terminals is extremely long, and stable and reliable data transmission can also be realized. And due to the wide coverage of the mobile network, it can also enable users to obtain real-time image data from the drone, or after a certain interval of time, Obtaining image data in a certain period of time from the server in a remote place has greatly improved the convenience of using the UAV system, and during the transmission process, interference can also be reduced, and the stability and reliability of data transmission can be improved.

Among them, the mobile data network includes but is not limited to the 4G network standard of TD-LTE or FDD-LTE, the 3G network standard of EVDO, WCDMA, TD-SCDMA or CDMA, and can also be the mobile phone network standard such as the 5G network standard that will be officially used in the future. .

It is understandable that when opening the mobile data network transmission channel, in order to improve the confidentiality of data, the image data can be encrypted first, and then the encrypted image data can be sent through the mobile data network.

Optionally, in the multi-load image transmission method, before the receiving the image data acquired by the corresponding load on the drone sent by the drone or the server, the method further includes: determining The network mode of signal transmission; the corresponding image transmission channel is opened according to the network mode to receive the image data. Specifically, the mobile network covers a large area, but there are also places where the coverage is not available or the signal is weak. Therefore, the mobile network transmission channel may not be used in all cases. By first determining the network mode used for signal transmission before receiving the image data acquired by the corresponding load on the drone sent by the drone or the server, it is possible to determine which network modes exist in the current environment , And according to the specific conditions of these network modes, determine which network mode in the current environment is more suitable for signal transmission, and open the corresponding image transmission channel according to the network mode to receive the image data to ensure the transmission speed And transmission effect. For example, if the distance between the control terminal and the drone is very good, and the Bluetooth effect is very good, you can directly use the Bluetooth mode for signal transmission to quickly obtain data; or at home, if wifi is installed, the control terminal can be directly from the server The image data is obtained through the transmission of the wifi network; or outdoors, and the drone is far away from the control terminal, as long as it is within the coverage of the mobile network, the mobile network can be used as the data transmission channel. This improves the convenience and reliability of the UAV system.

Optionally, in the above-mentioned multi-load image transmission method, the determining the network mode used for signal transmission specifically includes: determining the network mode used by the control terminal for signal transmission; and the network mode is a private wireless network mode In the case of, if the strength of the private wireless network mode is less than the first preset strength, the network mode of the control terminal is switched to the mobile data network mode; in the case that the network mode is the mobile data network mode, If the strength of the mobile data network mode is less than the second preset strength, the network mode of the remote control terminal is switched to the private wireless network mode. Specifically, as mentioned earlier, there may be multiple network modes in the environment in some scenarios, such as Bluetooth, wifi, radio and other private wireless network modes, and mobile network modes; in this case, various network The signal strength of the modes is compared, and the network mode with the strong signal is used for image transmission to improve the transmission speed and the reliability and stability of the transmission. For example, when the preset network mode is the private wireless network mode, if the strength of the private wireless network mode is less than the first preset strength, it means that the signal of the private wireless network mode is weak, and the control terminal can be The network mode is switched to the mobile data network mode with stronger signal, so as to ensure the transmission speed and transmission reliability and stability; if the strength of the private wireless network mode is greater than the first preset strength, the private wireless network mode is If the signal is strong, the private wireless network mode can be used for signal transmission directly; if the network mode is the mobile data network mode, if the strength of the mobile data network mode is less than the second preset strength, It shows that the strength of the mobile data network mode is weak. At this time, the network mode of the control terminal can be switched to the private wireless network mode with stronger signal, so as to ensure the transmission speed and transmission reliability and stability; if the mobile network mode is If the strength is greater than the first preset strength, it indicates that the signal in the mobile network mode is stronger, and in this case, the mobile network mode can be used for signal transmission directly.

Optionally, in the multi-load image transmission method, the determining the network mode used for signal transmission specifically includes: determining the network mode used by the control terminal for signal transmission; in the network mode, it is a private wireless network In the case of mobile data network mode, if the mobile data network mode is detected, the network mode of the control terminal is switched to the mobile data network mode; or when the network mode is the mobile data network mode, if the private network mode is detected In the wireless network mode, the network mode of the control terminal is maintained as the mobile data network mode. Specifically, when determining the network mode used by the control terminal for signal transmission, the mobile data network mode is preferred, that is, regardless of whether the preset network mode is a private wireless network mode or a mobile data network mode, as long as the mobile data network mode can be detected , The mobile data network mode is adopted, so that the mobile data network mode can be used for ultra-long-distance transmission and one-to-many transmission mode to improve the convenience and stability of the UAV system.

Optionally, in the multi-load image transmission method, the determining the network mode for signal transmission specifically includes: detecting whether there is a mobile communication card in the network card slot in the control terminal, and generating a detection result; When the detection result is yes, determine the communication strength corresponding to the mobile communication card; when the communication strength is greater than a third preset strength, determine that the network mode of the control terminal is the mobile data network mode. Specifically, to use the mobile data network mode, you first need to have a mobile communication card in the control terminal, so that you can enter the mobile data network and use the mobile data network; therefore, when determining the network mode for signal transmission, first check the control terminal If there is a mobile communication card in the mobile communication card, if the detection result is yes, it means that the control terminal can use the mobile data network; further, determine the communication strength corresponding to the mobile communication card, and when the communication strength is greater than the third preset strength, It is determined that the network mode of the control terminal is the mobile data network mode, that is, the mobile data network mode is used for signal transmission when the signal of the mobile data network mode is sufficiently strong, so as to ensure the transmission speed and the stability and reliability of the transmission; If the communication strength is less than the third preset strength, it indicates that the signal of the mobile data network mode is weak. If the mobile data network is used as the transmission channel at this time, the ultra-long-distance transmission effect is often not guaranteed.

Optionally, in the multi-load image transmission method, before the response to the load selection instruction, the method further includes: determining a plurality of load devices corresponding to the drone; and displaying the multi-load device through the display device of the control terminal. Load attribute list of a load device; receiving a load selection instruction corresponding to any one of the load devices in the load attribute list displayed by the display device, wherein the load attribute list includes interface information of each load device, Network protocol, operating parameters and network mode. Specifically, drones usually have more multi-load applications. In this case, mobile data network image transmission needs to select multiple loads on the current drone, and select the image data of a device to transmit to the control terminal ; In order to select the load corresponding to the selection instruction to transmit data to the control terminal according to the load attribute status displayed on the load attribute list, so as to ensure that the load can access the mobile data network for data transmission.

It can be understood that the multiple load devices may be video acquisition devices (for example, cameras), light source devices (for example, lighting), or radio devices (for example, microphones).

Further, the sending the image transmission acquisition instruction to turn on the load device in the drone to the drone or the server specifically includes: determining corresponding loads in the multiple load devices according to the load selection instruction; The image transmission acquisition instruction of the mobile data network transmission channel corresponding to the load; the image transmission acquisition instruction is sent to the drone or the server through the remote control device of the control terminal. Specifically, in most cases, the drone may have multiple load devices, so first determine the corresponding load of the multiple load devices according to the load selection instruction, so as to facilitate the generation of the corresponding load according to the specific load. The image transmission acquisition instruction of the mobile data network transmission channel of the mobile data network can be used to send the image transmission acquisition instruction to the drone or the server through the remote control device of the control terminal to ensure the correctness of the image transmission acquisition instruction and avoid erroneous transmission. It is understandable that the remote control device can directly send the image transmission acquisition instruction to the drone, or indirectly send the image transmission acquisition instruction to the drone through the server relay.

Optionally, the multi-load image transmission method further includes: decoding the image data, and displaying the decoded image data. Specifically, under normal circumstances, the data stream output by the load generally has its own specific encoding, especially the mobile data network bandwidth changes significantly, so it is necessary to do a bandwidth adaptive encoding before sending, and the drone is responsible for receiving the data stream. Then decode and encode to ensure the accuracy of data transmission. At the same time, when encoding, the bit rate of the video stream will adapt to the bandwidth of the current mobile data network to effectively reduce the transmission of higher bit rate videos due to poor network The stuttering improves transmission efficiency and reduces the delay of real-time transmission.

Among them, preferably, the code rate is selected to be controlled below 200 kps.

Further, the decoding the image data and displaying the decoded image data specifically includes: receiving the image data through a remote control device of the control terminal; sending the image data by the remote control device To the display device of the control terminal; perform a decoding operation on the image data through the display device, and display the decoded image data through the display device. Specifically, the image data is transmitted in the form of encoding during the data transmission process, that is, the image data captured by the load device is first stored in the H264 video stream. Before the drone is sent to the control terminal, the H264 data is adjusted according to the bandwidth of the mobile data. The video stream is decoded and re-encoded to send the re-encoded image data to the control terminal. Therefore, after the remote control device receives the image data transmitted in the encoded form, the image data is sent from the remote control device to the control terminal. The display device of the terminal; the image data is decoded through the display device, so that these codes can be displayed to the user through the display device in an intuitive and the same form as the original recorded image, which improves the user's use The convenience of using the machine system.

Among them, it should be noted that the remote control device and the display device can be connected in a wired or wireless manner, and the remote control device and the display device can also be integrated.

It can be understood that the image data can be transmitted transparently between the payload and the drone body. At this time, there is no need to encode first, and then decode it on the drone body. When the drone body obtains the image data of the payload, it directly Corresponding to the bandwidth of the mobile data network transmission channel of the load, the coding rate is determined according to the bandwidth, and then the image data is encoded and transmitted to the server or control terminal.

In addition, it is also possible to directly communicate with the server or control terminal through the load, determine the coding rate according to the bandwidth of the mobile data network transmission channel corresponding to the load, and transmit the image data to the server or control terminal after encoding.

The embodiment of the present invention provides another multi-load image transmission method. FIG. 3 is a flowchart of another multi-load image transmission method provided in an embodiment of the present invention. The multi-load image transmission method described in this embodiment can be applied to drones; as shown in FIG. 3, the multi-load image transmission method in this embodiment includes:

S302: Receive an image transmission acquisition instruction issued by the server or the control terminal.

Specifically, the execution subject of the multi-load image transmission method in this embodiment may be a drone. Wherein, the drone includes the drone body and multiple load devices set on the drone body, and whether it is the image data on the server or the image data on the control terminal, it actually comes from The drone is photographed by the load on the drone. Therefore, after the drone is photographed and stored on the drone, the data can be transmitted to the server or control terminal. That is, the drone receives the image sent by the server or the control terminal. Pass the get command.

For example, send a command to open the mobile data network image transmission to the drone on the APP of a control terminal such as a mobile phone. This command will carry the user to select the type of camera/load to be opened, and the command is received by the drone. Or, the command sent by the APP is passed to the remote control, and the remote control sends the command to the server through the mobile data network module (when the private wireless network exists, this command can also be sent through the private wireless network); the server then transfers the command Give the drone.

S304: Turn on the mobile data network transmission channel of the corresponding load among the multiple load devices according to the image transmission acquisition instruction.

Specifically, among multiple load devices, only the image data taken by one or a few of the load devices may be needed. Therefore, it is first necessary to turn on the movement data of the corresponding load in the multiple load devices according to the image transmission acquisition instruction. The network transmission channel, that is, the mobile data network is used to transmit the data in the corresponding load device, which can realize ultra-long-distance data transmission and ensure the stability and reliability of the transmission process.

Understandably, when there are multiple load devices in the corresponding load, when image data transmission is performed, the image data collected by multiple load devices can be combined first, and then the combined image data can be transmitted. The image data collected by each load device can also be transmitted separately.

For example, after receiving a command, the drone searches for a matching camera/load type from the currently mounted camera/load device; after finding a matching camera/load type, it opens the corresponding mobile data network transmission channel and closes it at the same time And release other existing mobile data network image transmission channel resources to reduce resource waste.

S306: Send image data corresponding to the corresponding load to the server or the control terminal through a mobile data network.

Specifically, the image data corresponding to the corresponding load is sent to the server or the control terminal through the mobile data network, so that as long as the drone is in a place covered by the mobile network, it can send the image data to the server or the control terminal. Sending the image data corresponding to the corresponding load greatly expands the use range of the drone. Even at ultra-long distances, the image data can be sent to the server or the control terminal in real time, thereby improving the unmanned The machine is convenient to use, and during the transmission process, there is little interference and the data is stable and reliable.

Optionally, the multi-load image transmission method, before the sending image data corresponding to the corresponding load to the server or the control terminal through a mobile data network, further includes: determining the corresponding load The bandwidth of the mobile data network transmission channel; the code rate of encoding is determined according to the bandwidth; the video stream obtained through the corresponding load is coded at the code rate to generate image data. Specifically, the bandwidth of the mobile data network transmission channel has a great impact on the stability and reliability of data transmission, and the bandwidth of the mobile data network may change significantly due to network abnormalities, so it is necessary to do a bandwidth adaptation before sending Encoding, that is, first determining the bandwidth of the mobile data network transmission channel of the corresponding load, thereby facilitating the determination of a suitable bit rate according to the bandwidth, and encoding the video stream obtained through the corresponding load according to the bit rate to generate Image data, which is more conducive to the data transmission of the mobile network, and improves the reliability and stability of the transmission.

Further, the encoding the acquired video stream at the bit rate to generate image data specifically includes: sending the video stream acquired by the corresponding load to the drone body; the drone body pairing After the video stream is decoded, the decoded video stream is encoded according to the bit rate to generate image data. Specifically, since the image is taken by the payload device, it is necessary to send the video stream obtained by the payload to the drone body, and then the drone body decodes the video stream, and then according to the The code rate encodes the decoded video stream, so that the code rate of the video stream adapts to the bandwidth of the current mobile data network, so as to reduce the delay of real-time transmission, and at the same time reduce the possibility of jams during the video transmission process Enhance the stability and reliability of data transmission.

Among them, preferably, the code rate is less than 200 kps.

Optionally, the encoding the acquired video stream at the bit rate to generate image data specifically includes: generating image data from the video stream through the corresponding load according to the bit rate. Specifically, the video stream is directly generated according to the code rate and the corresponding load is used to generate image data, that is, the corresponding load directly generates image data of the corresponding code rate according to the bandwidth. This can simplify the encoding process, increase the encoding speed, and further improve Data transfer speed.

Optionally, before the opening of the mobile data network transmission channel corresponding to the load in the plurality of load devices according to the image transmission acquisition instruction, the method further includes: determining all the load devices mounted on the drone body Load equipment; generate a load attribute list according to the load attributes of all the load equipment, and send the load attribute list to the control terminal; receive a load equipment corresponding to any load attribute in the load attribute list sent by the control terminal The load selection instruction of the load selection instruction, and determine that the load device corresponding to the load selection instruction is the corresponding load; determine the network mode for signal transmission; open the image transmission channel of the corresponding load according to the network mode to receive the image Data, wherein the load attribute includes: interface information, network protocol, operating parameters, and network mode of each load device. Specifically, since UAVs generally have multiple loads, the load attributes of each load may be the same or different, that is, the interface information, network protocol, operating parameters, and network mode of each load may have unique settings. Certainly, during data transmission, the required network mode will also be different. For example, some loads can only be used for data transmission through private wireless network mode, and some loads can be used in private wireless network mode and mobile data network mode. Switch, therefore, by determining all the load devices mounted on the drone body, and generating a load attribute list according to the load attributes of all the load devices, and sending the load attribute list to the control terminal This is beneficial for the control terminal to select the corresponding load according to the specific needs and the attributes of each load, and issue the corresponding load selection instruction, so that the drone can determine that the load device corresponding to the load selection instruction is the corresponding load Further, according to the attributes of the corresponding load, the corresponding signal transmission network mode can be determined to ensure the transmission speed and transmission stability.

Further, the determining the network mode used for signal transmission specifically includes: determining the network mode in which the corresponding load is used for signal transmission; if the network mode is a private wireless network mode, if the private wireless network If the strength of the mode is less than the first preset strength, the network mode of the corresponding load is switched to the mobile data network mode; if the network mode is the mobile data network mode, if the strength of the mobile data network mode is less than The second preset intensity is to switch the network mode of the corresponding load to the private wireless network mode. Specifically, the network mode of signal transmission is finally determined according to the signal strength of the drone, which helps to ensure the stability and reliability of data transmission and increase the transmission speed. For example, when the preset network mode is the private wireless network mode, if the strength of the private wireless network mode is less than the first preset strength, it means that the signal of the private wireless network mode is weak, and the control terminal can be The network mode is switched to the mobile data network mode with stronger signal, so as to ensure the transmission speed and transmission reliability and stability; if the strength of the private wireless network mode is greater than the first preset strength, the private wireless network mode is If the signal is strong, the private wireless network mode can be used for signal transmission directly; if the network mode is the mobile data network mode, if the strength of the mobile data network mode is less than the second preset strength, It shows that the strength of the mobile data network mode is weak. At this time, the network mode of the control terminal can be switched to the private wireless network mode with stronger signal, so as to ensure the transmission speed and transmission reliability and stability; if the mobile network mode is If the strength is greater than the first preset strength, it indicates that the signal in the mobile network mode is stronger, and in this case, the mobile network mode can be used for signal transmission directly.

Optionally, the determining the network mode used for signal transmission specifically includes: determining the network mode in which the corresponding load is used for signal transmission; if the network mode is a private wireless network mode, if mobile data is detected Network mode, the network mode of the corresponding load is switched to the mobile data network mode; or when the network mode is the mobile data network mode, if the private wireless network mode is detected, the corresponding load The network mode of the mobile data network mode is maintained. Specifically, when determining the network mode used by the control terminal for signal transmission, the mobile data network mode is preferred, that is, regardless of whether the preset network mode is a private wireless network mode or a mobile data network mode, as long as the mobile data network mode can be detected , The mobile data network mode is adopted, so that the mobile data network mode can be used for ultra-long-distance transmission and one-to-many transmission mode to improve the convenience and stability of the UAV system.

The embodiment of the present invention provides yet another method for multi-load image transmission. Fig. 4 is a flowchart of another method for multi-load image transmission provided by an embodiment of the present invention. The multi-load image transmission method described in this embodiment can be applied to a server; as shown in FIG. 4, the multi-load image transmission method in this embodiment includes:

S402: Receive an image transmission acquisition instruction sent by the control terminal to turn on the load device in the drone.

Specifically, the execution subject of the multi-load image transmission method in this embodiment may be a server. Understandably, the storage space of the load on the drone is limited (memory and hard disk capacity). Therefore, after shooting and storing the image data on the drone, the data can be transmitted to the server for long-term large-capacity Therefore, before the transmission, the server first receives the image transmission acquisition instruction issued by the control terminal to turn on the load equipment in the drone.

S404: Send the image transmission acquisition instruction to the drone to instruct the drone to open a mobile data network transmission channel corresponding to the load.

Specifically, among multiple load devices, only the image data taken by one or a few of the load devices may be needed. Therefore, firstly, when the control terminal sends to the drone, the server is used for transfer. Control operations are recorded to provide data reference for later error correction or improvement. It is necessary to open the mobile data network transmission channel of the corresponding load in the multiple load devices according to the image transmission acquisition instruction, that is, use the mobile data network to transfer the corresponding load The data in the device is transmitted, which can realize ultra-long-distance data transmission and ensure the stability and reliability of the transmission process.

S406: Receive the image data sent by the drone corresponding to the corresponding load device through the mobile data network, and send the image data to the control terminal through the mobile data network.

Specifically, the server receives the image data corresponding to the corresponding load device sent by the drone through the mobile data network, and sends the image data to the control terminal through the mobile data network, so that as long as the Wherever the mobile network covers, the image data taken by the drone can be transmitted to the server for storage, and when the user needs it, the historical image data for a certain period of time in the past can be downloaded from the server, which greatly expands the drone’s The scope of use increases the amount of image data saved, thereby improving the convenience of drone use and the reproducibility of image data.

Optionally, in the multi-load image transmission method, when the number of the control terminal is multiple, the number of the drone is one, and at least two image transmission instructions issued by the control terminal are received The multi-load image transmission method further includes: determining the load device corresponding to each control terminal; determining the first image transmission instruction with the earliest receiving time among the plurality of image transmission instructions, and determining the first image The load device corresponding to the transmission instruction; in the process of sending the image data of the load device corresponding to the first image transmission instruction to the control terminal, it is determined that the first image transmission instruction is The second image transmission instruction with the same controlled load device; the image data of the load device corresponding to the first image transmission instruction is sent to the control terminal corresponding to each second image transmission instruction. Specifically, the first image transmission instruction is the instruction with the earliest receiving time among the multiple image transmission instructions. Generally speaking, the response time to the first image transmission instruction is also the earliest. Therefore, when determining the second image transmission instruction When the image data corresponding to the first image transmission command can be transmitted at the same time; since the second image transmission command corresponds to the same load device as the first image transmission command, the image data corresponding to the second image transmission command is the same as the first image transmission command. The image data corresponding to one image transmission instruction is also the same. Therefore, the image data of the load device corresponding to the first image transmission instruction can be directly sent to the control terminal corresponding to each second image transmission instruction, and there is no need to download from the load device. The video stream is obtained on the upper side to perform repeated encoding and decoding operations, thereby simplifying the process of image data transmission, improving transmission speed and transmission efficiency, and realizing the purpose of one load device corresponding to multiple control terminals.

For example, when the first control terminal is connected through the mobile data network and needs to request the image transmission of a certain load on the drone, the first image transmission instruction to open a certain load can be sent to the drone through the mobile data network; When the second terminal or the Nth terminal needs to view the real-time image transmission of the drone, it will directly send an instruction to the server, and the server will determine whether it is the first control terminal and determine the mobile data network of the drone according to the judgment. Whether to open the image transmission, decide whether to send the instruction to open the mobile data network image transmission to the drone again; at this time, the server can distribute the image data to multiple terminal devices according to the actual situation of the connected terminal. Realize the display of one machine and multiple terminals of image transmission.

When the number of terminals is three, as shown in Figure 5, after the server starts, the image transmission request of the three terminals (terminal 1, terminal 2 and terminal 3) is first received, and it is judged whether the received image transmission request is the first An image transmission request, when the judgment result is yes, the terminal currently requested is considered as Terminal 1. At this time, an instruction is sent to the drone to request to open the mobile data network image transmission, and the image data is sent to Terminal 1. If the result is no, it is considered that the currently requested terminal is terminal 2 or 3, and the current image data (that is, the image data requested by terminal 1) is distributed to terminal 2 or 3.

Optionally, in the multi-load image transmission method, when the number of drones is multiple and the number of control terminals is one, the multi-load image transmission method further includes: determining each of the The network mode used by drones for signal transmission; determine multiple drones with the same network mode, and acquire image data of each of the multiple drones; receive multiple images Data, and send a plurality of the image data to the control terminal. Specifically, when multiple drones correspond to one control terminal, by acquiring the image data of each of the multiple drones with the same network mode, it is convenient to jointly save the data on the drones with the same network mode. The image data is then transmitted to the control terminal, which is conducive to the optimization of the transfer through the server, simplifies the workload of the drone and the control terminal, and improves the convenience of the control terminal to view multiple drone screens, and to the scene of multiple drones. Control of the company.

For example, the control terminal shown in Figure 7 can query the UAV equipment currently using the mobile data network from the server, or the UAV equipment with the mobile data network module but not the corresponding image transmission; if the UAV has been For mobile data network image transmission, the corresponding image data is directly pulled from the server to reduce the workload of the drone; if the drone has not opened the mobile data network image transmission, but the mobile data network link is unblocked, you can use The method of sending control instructions allows the drone to open the mobile data network image transmission; the control terminal can also realize the synchronization of all the drone equipment with the permission to the remote control center and display it in real time, so that the control center can monitor the unmanned Control of the machine site.

Optionally, the sending the image data to the control terminal specifically includes: sending the image data to a display device of the control terminal, so that the image data is decoded and combined by the display device. Display the decoded image data; or send the image data to the remote control device of the control terminal, and send the image data to the display device of the control terminal through the remote control device, so that the display device can The image data is decoded and the decoded image data is displayed. Specifically, the image data is directly sent to the display device of the control terminal, or the image data is indirectly sent to the display device through the remote control device, so as to facilitate the decoding of the image data through the display device and display the decoded image data , So that users can intuitively see the images taken by the drone from the display device.

The embodiment of the present invention provides a control system. FIG. 6 is a structural diagram of the control system provided by the embodiment of the present invention. The control system described in this embodiment includes a control terminal and an unmanned aerial vehicle, wherein, in response to a load selection instruction, the control terminal sends an image transmission acquisition instruction to turn on the load device in the unmanned aerial vehicle; The drone opens the mobile data network transmission channel of the corresponding load according to the received image transmission acquisition instruction; the drone sends image data corresponding to the corresponding load to the control terminal through the mobile data network.

Further, the control system further includes a server electrically connected to the control terminal and the drone, and the server is configured to receive the image transmission acquisition instruction issued by the control terminal, and use Yu sends the image transmission acquisition instruction to the drone.

Further, the server is configured to receive the image data acquired by the corresponding load sent by the drone through a mobile data network, and the server is also configured to send the image data to the control terminal through a mobile data network.

An embodiment of the present invention provides a control terminal. FIG. 8 is a structural diagram of a control terminal 1000 provided in an embodiment of the present invention. The control terminal 1000 in this embodiment includes a remote control device 1002, a display device 1004, and a processor 1006. The processor 1006 is configured to: in response to a load selection instruction, send the drone or server to turn on the drone The image transmission acquisition instruction of the medium load equipment, the image transmission acquisition instruction is used to instruct the drone to open the mobile data network transmission channel of the corresponding load; receive the data sent by the drone or the server through the mobile data network Image data acquired by the corresponding load on the drone.

Optionally, before the processor 1006 receives the image data acquired by the corresponding load on the drone sent by the drone or the server, the control terminal 1000 is further used to determine The network mode of transmission; the corresponding image transmission channel is opened according to the network mode to receive the image data.

Optionally, the processor 1006 is configured to determine a network mode used for signal transmission, and specifically configured to: determine a network mode used by the control terminal 1000 for signal transmission; when the network mode is a private wireless network mode Next, if the strength of the private wireless network mode is less than the first preset strength, the network mode of the control terminal 1000 is switched to the mobile data network mode; in the case that the network mode is the mobile data network mode, if If the strength of the mobile data network mode is greater than the second preset strength, the network mode of the remote control terminal is switched to the private wireless network mode.

Optionally, the processor 1006 is configured to determine a network mode used for signal transmission, and specifically configured to: determine a network mode used by the control terminal 1000 for signal transmission; when the network mode is a private wireless network mode If the mobile data network mode is detected, the network mode of the control terminal 1000 is switched to the mobile data network mode; or if the network mode is the mobile data network mode, if a private wireless network is detected Mode, the network mode of the control terminal 1000 is maintained as the mobile data network mode.

Optionally, the processor 1006 is configured to determine a network mode used for signal transmission, and is specifically configured to: detect whether there is a mobile communication card in the network card slot of the control terminal 1000, and generate a detection result; in the detection result If yes, determine the communication strength corresponding to the mobile communication card; when the communication strength is greater than the third preset strength, determine that the network mode of the control terminal 1000 is the mobile data network mode.

Further, before the processor 1006 responds to the load selection instruction, the control terminal 1000 is further configured to: determine multiple load devices corresponding to the drone; and display multiple load devices through the display device 1004 of the control terminal 1000 Load attribute list of load equipment; receiving load selection instructions corresponding to any one of the load equipment in the load attribute list displayed by the display device 1004, wherein the load attribute list includes interface information of each load equipment, Network protocol, operating parameters and network mode.

Further, the processor 1006 sends an image transmission acquisition instruction for turning on a load device in the drone to the drone or a server, which is specifically used to: determine corresponding loads in the multiple load devices according to the load selection instruction; Generate an image transmission acquisition instruction for opening the mobile data network transmission channel of the corresponding load; send the image transmission acquisition instruction to a drone or a server through the remote control device 1002 of the control terminal 1000.

Optionally, the processor 1006 is further configured to: decode the image data and display the decoded image data.

Further, the processor 1006 decodes the image data and displays the decoded image data, which is specifically configured to: receive the image data through the remote control device 1002 of the control terminal 1000; The remote control device 1002 is sent to the display device 1004 of the control terminal 1000; the image data is decoded through the display device 1004, and the decoded image data is displayed on the display device 1004.

An embodiment of the present invention provides an unmanned aerial vehicle. FIG. 9 is a structural diagram of an unmanned aerial vehicle 2000 provided in an embodiment of the present invention. The drone 2000 in this embodiment includes a drone body 2002, a plurality of load devices 2004 arranged on the drone body 2002, and a processor 2006, wherein the processor 2006 is used to: The image transmission acquisition instruction issued by the server or the control terminal; according to the image transmission acquisition instruction, the mobile data network transmission channel corresponding to the load in the plurality of load devices 2004 is opened; and the mobile data network is sent to the server or the control terminal Image data corresponding to the corresponding load.

Further, before the processor 2006 sends the image data corresponding to the corresponding load to the server or the control terminal through the mobile data network, it is further configured to: determine the mobile data network transmission of the corresponding load The bandwidth of the channel; the code rate of encoding is determined according to the bandwidth; the video stream obtained through the corresponding load is coded at the code rate to generate image data.

Further, the processor 2006 encodes the acquired video stream at the bit rate to generate image data, which is specifically configured to: send the video stream acquired by the corresponding load to the drone body 2002; After the drone body 2002 decodes the video stream, it encodes the decoded video stream according to the bit rate to generate image data.

Optionally, the processor 2006 encodes the acquired video stream at the bit rate to generate image data, which is specifically configured to: generate image data from the video stream through the corresponding load according to the bit rate.

Further, the processor 2006 is further configured to: determine to be mounted on the drone before opening the mobile data network transmission channel corresponding to the load in the plurality of load devices 2004 according to the image transmission acquisition instruction All the load devices 2004 on the main body 2002; generate a load attribute list according to the load attributes of all the load devices 2004, and send the load attribute list to the control terminal; receive the control terminal corresponding to all The load selection instruction of any load device 2004 in the load attribute list, and determine that the load device 2004 corresponding to the load selection instruction is the corresponding load; determine the network mode used for signal transmission; turn on the network mode according to the network mode The image transmission channel corresponding to the load is used to receive the image data, wherein the load attribute includes: interface information, network protocol, operating parameters, and network mode of each load device 2004.

Further, the processor 2006 determines the network mode used for signal transmission, which is specifically configured to: determine the network mode used by the corresponding load for signal transmission; if the network mode is a private wireless network mode, if If the intensity of the private wireless network mode is less than the first preset intensity, the network mode of the corresponding load is switched to the mobile data network mode; in the case that the network mode is the mobile data network mode, if the mobile data network If the intensity of the mode is greater than the second preset intensity, the network mode of the corresponding load is switched to the private wireless network mode.

Optionally, the processor 2006 determines a network mode for signal transmission, which is specifically configured to: determine a network mode for the corresponding load to be used for signal transmission; if the network mode is a private wireless network mode, if If the mobile data network mode is detected, the network mode of the corresponding load is switched to the mobile data network mode; or when the network mode is the mobile data network mode, if the private wireless network mode is detected, the The network mode of the corresponding load remains the mobile data network mode.

Optionally, the processor 2006 determines a network mode for signal transmission, which is specifically configured to: detect whether there is a mobile communication card in the network card slot in the corresponding load, and generate a detection result; when the detection result is yes , Determining the communication strength corresponding to the mobile communication card; when the communication strength is greater than a third preset strength, determining that the network mode of the corresponding load is the mobile data network mode.

An embodiment of the present invention provides a server, including a processor, the processor is configured to: receive an image transmission acquisition instruction sent by a control terminal to turn on a load device in a drone; and send the image transmission acquisition instruction to the The man-machine to instruct the drone to open the mobile data network transmission channel corresponding to the load; to receive the image data sent by the drone corresponding to the above corresponding load device through the mobile data network, and pass the mobile The data network sends the image data to the control terminal.

Further, when the number of the control terminal is multiple, the number of the drone is one, and at least two image transmission instructions issued by the control terminal are received, the processor is further configured to: determine Each of the control terminals corresponds to the load device to be controlled; determines the first image transmission instruction with the earliest receiving time among the multiple image transmission instructions, and determines the load device corresponding to the first image transmission instruction; During the process of sending the image data of the load device corresponding to a picture transmission instruction to the control terminal, determining a second picture transmission instruction that is the same as the load device controlled by the first picture transmission instruction among the plurality of picture transmission instructions; The image data of the load device corresponding to the first image transmission instruction is sent to the control terminal corresponding to each of the second image transmission instructions.

Optionally, when the number of drones is multiple and the number of control terminals is one, the processor is further configured to: determine a network mode used by each drone for signal transmission; Determine multiple drones with the same network mode, acquire image data of each of the multiple drones; receive multiple of the image data, and send multiple of the image data To the control terminal.

Further, the processor is configured to send the image data to the control terminal, and is specifically configured to: send the image data to a display device of the control terminal, so that the image data can be viewed by the display device. Decode and display the decoded image data; or send the image data to the remote control device of the control terminal, and send the image data to the display device of the control terminal through the remote control device to pass the The display device decodes the image data and displays the decoded image data.

The embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, it implements the steps of the multi-load image transmission method in the first aspect of the above-mentioned embodiment, and realizes the above-mentioned first aspect. The steps of the multi-load image transmission method in the embodiment of the second aspect or the steps of implementing the multi-load image transmission method in the above-mentioned third aspect.

Further, it can be understood that any process or method description in the flowchart or described in other ways herein can be understood as including one or more executable instructions for implementing specific logical functions or steps of the process. Modules, fragments, or parts of the code, and the scope of the preferred embodiments of the present invention includes additional implementations, which may not be in the order shown or discussed, including in a substantially simultaneous manner or in reverse according to the functions involved Order to perform functions, which should be understood by those skilled in the art to which the embodiments of the present invention belong.

The logic and/or steps represented in the flowchart or described in other ways herein, for example, can be considered as a sequenced list of executable instructions for implementing logic functions, and can be embodied in any computer-readable medium, For use by instruction execution systems, devices, or equipment (such as computer-based systems, systems including processors, or other systems that can fetch instructions from and execute instructions from instruction execution systems, devices, or equipment), or combine these instruction execution systems, devices Or equipment. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transmit a program for use by an instruction execution system, device, or device or in combination with these instruction execution systems, devices, or devices. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) with one or more wiring, portable computer disk cases (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable and editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program can be printed, because it can be done, for example, by optically scanning the paper or other medium, and then editing, interpreting, or other suitable methods when necessary. Process to obtain the program electronically and then store it in the computer memory.

It should be understood that each part of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if it is implemented by hardware, as in another embodiment, it can be implemented by any one or a combination of the following technologies known in the art: a logic gate circuit for implementing logic functions on data signals Discrete logic circuits, application-specific integrated circuits with suitable combinational logic gates, programmable gate array (PGA), field programmable gate array (FPGA), etc.

Those of ordinary skill in the art can understand that all or part of the steps carried in the method of the above-mentioned embodiments can be implemented by a program instructing relevant hardware to complete. The program can be stored in a computer-readable storage medium, and when the program is executed , Including one of the steps of the method embodiment or a combination thereof.

In addition, the functional units in each embodiment of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc.

The above are only preferred embodiments of the present invention and are not used to limit the present invention. For those skilled in the art, the present invention may have various modifications and changes. Any modification, equivalent replacement, improvement, etc., made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

A multi-load image transmission method for controlling a terminal, characterized in that it includes:

In response to the load selection instruction, sending an image transmission acquisition instruction to turn on the load device in the drone to the drone or server, where the image transmission acquisition instruction is used to instruct the drone to open the mobile data network transmission channel of the corresponding load;

Image data acquired through the corresponding load on the drone sent by the drone or the server.
The multi-load image transmission method according to claim 1, wherein before said receiving the image data acquired by the corresponding load on the drone sent by the drone or the server, the method further comprises:

Determine the network mode used for signal transmission;

Opening a corresponding image transmission channel according to the network mode to receive the image data.
The multi-load image transmission method according to claim 2, wherein said determining the network mode used for signal transmission specifically comprises:

Determining a network mode used by the control terminal for signal transmission;

In the case that the network mode is the private wireless network mode, if the strength of the private wireless network mode is less than the first preset strength, switching the network mode of the control terminal to the mobile data network mode;

In the case that the network mode is the mobile data network mode, if the strength of the mobile data network mode is less than the second preset strength, the network mode of the control terminal is switched to the private wireless network mode.
The multi-load image transmission method according to claim 2, wherein said determining the network mode used for signal transmission specifically comprises:

Determining a network mode used by the control terminal for signal transmission;

In the case that the network mode is the private wireless network mode, if a mobile data network mode is detected, the network mode of the control terminal is switched to the mobile data network mode; or

When the network mode is a mobile data network mode, if a private wireless network mode is detected, the network mode of the control terminal is maintained as the mobile data network mode.
The multi-load image transmission method according to claim 2, wherein said determining the network mode used for signal transmission specifically comprises:

Detecting whether there is a mobile communication card in the network card slot in the control terminal, and generating a detection result;

When the detection result is yes, determine the communication strength corresponding to the mobile communication card;

When the communication intensity is greater than the third preset intensity, it is determined that the network mode of the control terminal is the mobile data network mode.
The multi-load image transmission method according to any one of claims 1 to 5, wherein before the response to the load selection instruction, the method further comprises:

Determining multiple load devices corresponding to the drone;

Displaying load attribute lists of multiple load devices through the display device of the control terminal;

Receive a load selection instruction corresponding to any one of the load devices in the load attribute list displayed by the display device, wherein the load attribute list includes interface information, network protocol, operating parameters, and network mode of each load device .
The multi-load image transmission method according to claim 6, wherein the sending the image transmission acquisition instruction to turn on the load device in the drone to the drone or the server specifically includes:

Determining corresponding loads among the multiple load devices according to the load selection instruction;

Generating an image transmission acquisition instruction for opening the mobile data network transmission channel of the corresponding load;

The image transmission acquisition instruction is sent to the drone or the server through the remote control device of the control terminal.
The multi-load image transmission method according to any one of claims 1 to 5, further comprising:

The image data is decoded, and the decoded image data is displayed.
The multi-load image transmission method according to claim 8, wherein said decoding said image data and displaying said decoded image data specifically comprises:

Receiving the image data through the remote control device of the control terminal;

Sending the image data from the remote control device to the display device of the control terminal;

A decoding operation is performed on the image data by the display device, and the decoded image data is displayed by the display device.
A multi-load image transmission method for unmanned aerial vehicles, characterized in that the unmanned aerial vehicle includes a drone body and a plurality of load devices arranged on the drone body, and the multi-load image transmission method Methods include:

Receive the image transmission acquisition instruction issued by the server or control terminal;

Opening the mobile data network transmission channel of the corresponding load in the multiple load devices according to the image transmission acquisition instruction;

The image data corresponding to the corresponding load is sent to the server or the control terminal through a mobile data network.
The multi-load image transmission method according to claim 10, characterized in that before said sending the image data corresponding to the corresponding load to the server or the control terminal through a mobile data network, the method further comprises:

Determining the bandwidth of the mobile data network transmission channel corresponding to the load;

Determining the code rate of the encoding according to the bandwidth;

Encoding the video stream obtained through the corresponding load at the bit rate to generate image data.
The multi-load image transmission method according to claim 11, wherein the encoding the acquired video stream at the bit rate to generate image data specifically comprises:

Sending the video stream obtained by the corresponding load to the drone body;

After the drone body decodes the video stream, it encodes the decoded video stream according to the bit rate to generate image data.
The multi-load image transmission method according to claim 11, wherein the encoding the acquired video stream at the bit rate to generate image data specifically comprises:

According to the bit rate, image data is generated from the video stream through the corresponding load.
The multi-load image transmission method according to any one of claims 10 to 13, characterized in that, before opening the mobile data network transmission channel corresponding to the load in the plurality of load devices according to the image transmission acquisition instruction ,Also includes:

Determine all the load devices mounted on the drone body;

Generating a load attribute list according to the load attributes of all the load devices, and sending the load attribute list to the control terminal;

Receiving a load selection instruction corresponding to any load device in the load attribute list sent by the control terminal, and determining that the load device corresponding to the load selection instruction is the corresponding load;

Determine the network mode used for signal transmission;

Opening the image transmission channel of the corresponding load according to the network mode to receive the image data,

Wherein, the load attribute includes: interface information, network protocol, operating parameters, and network mode of each load device.
The multi-load image transmission method according to claim 14, wherein the determining the network mode used for signal transmission specifically comprises:

Determining a network mode used by the corresponding load for signal transmission;

In the case that the network mode is the private wireless network mode, if the strength of the private wireless network mode is less than the first preset strength, switching the network mode of the corresponding load to the mobile data network mode;

In the case that the network mode is the mobile data network mode, if the strength of the mobile data network mode is less than the second preset strength, the network mode of the corresponding load is switched to the private wireless network mode.
The multi-load image transmission method according to claim 14, wherein the determining the network mode used for signal transmission specifically comprises:

Determining a network mode used by the corresponding load for signal transmission;

In the case that the network mode is the private wireless network mode, if a mobile data network mode is detected, the network mode of the corresponding load is switched to the mobile data network mode; or

In the case that the network mode is the mobile data network mode, if a private wireless network mode is detected, the network mode of the corresponding load is maintained as the mobile data network mode.
The multi-load image transmission method according to claim 14, wherein the determining the network mode used for signal transmission specifically comprises:

Detecting whether there is a mobile communication card in the network card slot in the corresponding load, and generating a detection result;

When the detection result is yes, determine the communication strength corresponding to the mobile communication card;

When the communication intensity is greater than the third preset intensity, it is determined that the network mode of the corresponding load is the mobile data network mode.
A multi-load image transmission method for a server, characterized in that it includes:

Receive the image transmission acquisition command sent by the control terminal to turn on the load equipment in the drone;

Sending the image transmission acquisition instruction to the drone to instruct the drone to open a mobile data network transmission channel corresponding to the load;

The image data corresponding to the corresponding load device acquired by the drone is received through a mobile data network, and the image data is sent to the control terminal through the mobile data network.
The multi-load image transmission method according to claim 18, wherein the number of the control terminal is multiple, the number of the drone is one, and at least two of the control terminals are received. In the case of image transmission instructions, the multi-load image transmission method further includes:

Determine the load device corresponding to each control terminal;

Determine the first image transmission instruction with the earliest receiving time among the plurality of image transmission instructions, and determine the load device corresponding to the first image transmission instruction;

In the process of sending the image data of the load device corresponding to the first image transmission instruction to the control terminal, the first image data transmission instruction that is the same as the load device controlled by the first image transmission instruction is determined. Two image transmission instructions;

The image data of the load device corresponding to the first image transmission instruction is sent to the control terminal corresponding to each of the second image transmission instructions.
The multi-load image transmission method according to claim 18, wherein when the number of the drones is multiple and the number of the control terminal is one, the multi-load image transmission method further comprises:

Determine the network mode used by each of the drones for signal transmission;

Determine multiple drones with the same network mode, and obtain image data of each of the multiple drones;

Receiving a plurality of the image data, and sending a plurality of the image data to the control terminal.
The multi-load image transmission method according to any one of claims 18 to 20, wherein the sending the image data to the control terminal specifically includes:

Sending the image data to the display device of the control terminal to decode the image data through the display device and display the decoded image data; or

The image data is sent to the remote control device of the control terminal, and the image data is sent to the display device of the control terminal through the remote control device, so that the image data is decoded and displayed by the display device The decoded image data.
A control system, characterized in that it comprises a control terminal and a drone, wherein,

In response to the load selection instruction, the control terminal sends an image transmission acquisition instruction to turn on the load device in the drone to the drone;

The drone opens the mobile data network transmission channel corresponding to the load according to the received image transmission acquisition instruction;

The drone sends the image data corresponding to the corresponding load to the control terminal through a mobile data network.
The control system according to claim 22, further comprising:

The server is electrically connected to the control terminal and the drone, and the server is used to receive the image transmission acquisition instruction issued by the control terminal, and is also used to send the image transmission to the drone Get instructions.
The control system according to claim 23, wherein the server is configured to receive image data acquired by the corresponding load sent by the drone through a mobile data network, and the server is also configured to receive image data through a mobile data network. Sending the image data to the control terminal.
A control terminal, characterized by comprising: a remote control device, a display device, and a processor, wherein the processor is used for:

In response to the load selection instruction, sending an image transmission acquisition instruction to turn on the load device in the drone to the drone or server, where the image transmission acquisition instruction is used to instruct the drone to open the mobile data network transmission channel of the corresponding load;

The image data acquired by the corresponding load on the drone sent by the drone or the server is received through a mobile data network.
The control terminal according to claim 25, characterized in that before the processor receives the image data acquired by the corresponding load on the drone sent by the drone or the server, it also uses in

Determine the network mode used for signal transmission;

Opening a corresponding image transmission channel according to the network mode to receive the image data.
The control terminal according to claim 25, wherein the processor is configured to determine a network mode for signal transmission, and is specifically configured to:

Determining a network mode used by the control terminal for signal transmission;

In the case that the network mode is the private wireless network mode, if the strength of the private wireless network mode is less than the first preset strength, switching the network mode of the control terminal to the mobile data network mode;

In the case that the network mode is the mobile data network mode, if the strength of the mobile data network mode is greater than the second preset strength, the network mode of the remote control terminal is switched to the private wireless network mode.
The control terminal according to claim 25, wherein the processor is configured to determine a network mode for signal transmission, and is specifically configured to:

Determining a network mode used by the control terminal for signal transmission;

In the case that the network mode is the private wireless network mode, if a mobile data network mode is detected, the network mode of the control terminal is switched to the mobile data network mode; or

When the network mode is a mobile data network mode, if a private wireless network mode is detected, the network mode of the control terminal is maintained as the mobile data network mode.
The control terminal according to claim 25, wherein the processor is configured to determine a network mode for signal transmission, and is specifically configured to:

Detecting whether there is a mobile communication card in the network card slot in the control terminal, and generating a detection result;

When the detection result is yes, determine the communication strength corresponding to the mobile communication card;

When the communication intensity is greater than the third preset intensity, it is determined that the network mode of the control terminal is the mobile data network mode.
The control terminal according to any one of claims 25 to 29, wherein, before responding to the load selection instruction, the processor is further configured to:

Determining multiple load devices corresponding to the drone;

Displaying load attribute lists of multiple load devices through the display device of the control terminal;

Receive a load selection instruction corresponding to any one of the load devices in the load attribute list displayed by the display device, wherein the load attribute list includes interface information, network protocol, operating parameters, and network mode of each load device .
The control terminal according to claim 30, wherein the processor sends to the drone or the server an image transmission acquisition instruction for turning on the load device in the drone, specifically for:

Determining corresponding loads among the multiple load devices according to the load selection instruction;

Generating an image transmission acquisition instruction for opening the mobile data network transmission channel of the corresponding load;

The image transmission acquisition instruction is sent to the drone or the server through the remote control device of the control terminal.
The control terminal according to any one of claims 25 to 29, wherein the processor is further configured to:

The image data is decoded, and the decoded image data is displayed.
The control terminal according to claim 32, wherein the processor decodes the image data and displays the decoded image data, which is specifically used for:

Receiving the image data through the remote control device of the control terminal;

Sending the image data from the remote control device to the display device of the control terminal;

A decoding operation is performed on the image data by the display device, and the decoded image data is displayed by the display device.
An unmanned aerial vehicle, characterized by comprising an unmanned aerial vehicle body, a plurality of load devices arranged on the unmanned aerial vehicle body and a processor, wherein the processor is used for:

Receive the image transmission acquisition instruction issued by the server or control terminal;

Opening the mobile data network transmission channel of the corresponding load in the multiple load devices according to the image transmission acquisition instruction;

The image data corresponding to the corresponding load is sent to the server or the control terminal through a mobile data network.
The drone according to claim 34, wherein the processor is further used for sending image data corresponding to the corresponding load to the server or the control terminal via a mobile data network. :

Determining the bandwidth of the mobile data network transmission channel corresponding to the load;

Determining the code rate of the encoding according to the bandwidth;

Encoding the video stream obtained through the corresponding load at the bit rate to generate image data.
The drone of claim 35, wherein the processor encodes the acquired video stream at the bit rate to generate image data, which is specifically used for:

Sending the video stream obtained by the corresponding load to the drone body;

After the drone body decodes the video stream, it encodes the decoded video stream according to the bit rate to generate image data.
The drone of claim 35, wherein the processor encodes the acquired video stream at the bit rate to generate image data, which is specifically used for:

According to the bit rate, image data is generated from the video stream through the corresponding load.
The unmanned aerial vehicle according to any one of claims 35 to 37, wherein the processor starts the mobile data network transmission of the corresponding load in the plurality of load devices according to the image transmission acquisition instruction Before the channel, it is also used for:

Determine all the load devices mounted on the drone body;

Generating a load attribute list according to the load attributes of all the load devices, and sending the load attribute list to the control terminal;

Receiving a load selection instruction corresponding to any load device in the load attribute list sent by the control terminal, and determining that the load device corresponding to the load selection instruction is the corresponding load;

Determine the network mode used for signal transmission;

Opening the image transmission channel of the corresponding load according to the network mode to receive the image data,

Wherein, the load attribute includes: interface information, network protocol, operating parameters, and network mode of each load device.
The UAV according to claim 38, wherein the processor determines a network mode for signal transmission, which is specifically used for:

Determining a network mode used by the corresponding load for signal transmission;

In the case that the network mode is the private wireless network mode, if the strength of the private wireless network mode is less than the first preset strength, switching the network mode of the corresponding load to the mobile data network mode;

In the case that the network mode is the mobile data network mode, if the strength of the mobile data network mode is greater than the second preset strength, the network mode of the corresponding load is switched to the private wireless network mode.
The UAV according to claim 38, wherein the processor determines a network mode for signal transmission, which is specifically used for:

Determining a network mode used by the corresponding load for signal transmission;

In the case that the network mode is the private wireless network mode, if a mobile data network mode is detected, the network mode of the corresponding load is switched to the mobile data network mode; or

In the case that the network mode is the mobile data network mode, if a private wireless network mode is detected, the network mode of the corresponding load is maintained as the mobile data network mode.
The UAV according to claim 38, wherein the processor determines a network mode for signal transmission, which is specifically used for:

Detecting whether there is a mobile communication card in the network card slot in the corresponding load, and generating a detection result;

When the detection result is yes, determine the communication strength corresponding to the mobile communication card;

When the communication intensity is greater than the third preset intensity, it is determined that the network mode of the corresponding load is the mobile data network mode.
A server, characterized by comprising a processor, configured to:

Receive the image transmission acquisition command sent by the control terminal to turn on the load equipment in the drone;

Sending the image transmission acquisition instruction to the drone to instruct the drone to open a mobile data network transmission channel corresponding to the load;

The image data sent by the drone corresponding to the above corresponding load device is received through a mobile data network, and the image data is sent to the control terminal through the mobile data network.
The server according to claim 42, wherein when the number of the control terminal is multiple, the number of the drone is one, and at least two image transmission instructions issued by the control terminal are received , The processor is also used for:

Determine the load device corresponding to each control terminal;

Determine the first image transmission instruction with the earliest receiving time among the plurality of image transmission instructions, and determine the load device corresponding to the first image transmission instruction;

In the process of sending the image data of the load device corresponding to the first image transmission instruction to the control terminal, the first image data transmission instruction that is the same as the load device controlled by the first image transmission instruction is determined. Two image transmission instructions;

The image data of the load device corresponding to the first image transmission instruction is sent to the control terminal corresponding to each of the second image transmission instructions.
The server according to claim 42, wherein when the number of drones is multiple and the number of control terminals is one, the processor is further configured to:

Determine the network mode used by each of the drones for signal transmission;

Determine multiple drones with the same network mode, and obtain image data of each of the multiple drones;

Receiving a plurality of the image data, and sending a plurality of the image data to the control terminal.
The server according to any one of claims 42 to 44, wherein the processor is configured to send the image data to the control terminal, and is specifically configured to:

Sending the image data to the display device of the control terminal to decode the image data through the display device and display the decoded image data; or

The image data is sent to the remote control device of the control terminal, and the image data is sent to the display device of the control terminal through the remote control device, so that the image data is decoded and displayed by the display device The decoded image data.
A computer-readable storage medium with a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps and implementations of the multi-load image transmission method according to any one of claims 1 to 9 The steps of the multi-load image transmission method according to any one of claims 10 to 17 or the steps of implementing the multi-load image transmission method according to any one of claims 18 to 21.