WO2018177268A1

WO2018177268A1 - Device and method for performing long-distance information interaction with unmanned aerial vehicle by means of 4g network

Info

Publication number: WO2018177268A1
Application number: PCT/CN2018/080601
Authority: WO
Inventors: 胡华智; 郭尚进; 王栋
Original assignee: 亿航智能设备（广州）有限公司
Priority date: 2017-03-28
Filing date: 2018-03-27
Publication date: 2018-10-04
Also published as: CN107453798A

Abstract

The present application relates to a device and method for performing long-distance information interaction with an unmanned aerial vehicle by means of a 4G network. The device comprises: a 4G communication module provided on the unmanned aerial vehicle, the 4G communication module having various different interfaces and performing data reception and transmission with a sensor module on the unmanned aerial vehicle by means of the various different interfaces; an intelligent mobile terminal supporting the 4G network, the intelligent mobile terminal performing long-distance information interaction with the unmanned aerial vehicle by means of the 4G network and the 4G communication module and being used for transmitting related instruction data to the unmanned aerial vehicle and collecting image transmission information and flight state information returned by the unmanned aerial vehicle in real time; and a cloud side. Pictures, videos and other data shot by the unmanned aerial vehicle in the flight process are transmitted into the cloud side by means of the 4G communication module. By means of the present application, long-distance information interaction with the unmanned aerial vehicle can be realized; furthermore, the flight of the unmanned aerial vehicle is safer and more efficient; moreover, networking of the unmanned aerial vehicle can be realized; and thus, sharing of related information of the unmanned aerial vehicle and monitoring of the state of the unmanned aerial vehicle are conveniently carried out.

Description

Device and method for remote information exchange with UAV through 4G network

[0001] The present application belongs to the technical field of drones, and relates to an information interaction device and method for a drone, and particularly relates to an apparatus and method for remote information exchange with a drone through a 4G network.

Background technique

[0002] An unmanned aerial vehicle, referred to as a drone, is a rapidly developing flying device that has the advantages of mobility, rapid response, unmanned flight, and low operational requirements. UAVs are equipped with a variety of sensors to achieve real-world image transmission and high-risk area detection. They are a powerful complement to satellite remote sensing and traditional aerial remote sensing. At present, the scope of use of drones has expanded to three major areas of military, scientific research and civil use, specifically in power, communications, meteorology, agriculture, oceanography, exploration, photography, disaster prevention and mitigation, crop yield estimation, anti-drug, border patrol, law and order. The field of anti-terrorism and other fields are widely used.

[0003] Information interaction is a very important technology in drones for transmitting control commands to drones and receiving backhaul information sent back by drones. At present, most UAVs exchange information through Wi-Fi, Bluetooth, radio waves, etc., and the range of interaction is usually limited to about 1 km. In addition to the limited interaction distance, the signals of these information interaction methods are usually blocked by obstacles and have poor anti-interference ability.

[0004] The 4G network refers to the fourth generation mobile communication technology, including TD-LTE and FDD-LTE. The advantage of the 4G network is that it integrates 3G and WLAN, and its download speed can reach 100Mbps, which can quickly transmit data, high-quality audio and video, and images. At the same time, 4G network has high bandwidth, fast speed and small delay. If it can be used for information interaction with drones, it will inevitably improve the flight safety of drones and contribute to the interaction and interaction of various information. Sharing, etc. However, there are few technologies for applying 4G networks to the information exchange of drones.

In view of the above drawbacks of the prior art, there is an urgent need for a UAV information interaction apparatus and method based on a 4G network.

technical problem

Problem solution Technical solution

[0006] The purpose of the present application is to overcome the shortcomings in the prior art, and provide an apparatus and method for remote information interaction with a drone through a 4G network, which can realize long-distance information interaction with the drone. It makes the drone flight safer and more efficient. At the same time, the drone can be connected to the network, which facilitates the sharing of information about the drone and the monitoring of the state of the drone.

In order to achieve the above object, the present application provides the following technical solutions:

[0008] A device for performing remote information interaction with a drone through a 4G network, comprising:

[0009] a 4G communication module disposed on the drone, the 4G communication module having various interfaces and performing data transmission and reception with each sensor module on the drone through the various different interfaces;

[0010] an intelligent mobile terminal supporting a 4G network, wherein the smart mobile terminal can perform long-distance information interaction with the drone through the 4G network and the 4G communication module, and send the data to the drone The relevant command data thus controls the flight path of the drone and collects the map information and flight status information returned by the drone.

[0011] The device for remotely interacting with the UAV through the 4G network further includes: [0012] a cloud, the picture, video, and other data captured by the UAV during the flight can pass Said

The 4G communication module is transmitted to the cloud.

[0013] Further, the device for performing remote information exchange with the UAV through the 4G network further includes:

[0014] a personal computer, wherein the personal computer can download pictures, videos, and other data captured by the drone during the flight from the cloud through the network.

[0015] Further, wherein the different interfaces of the 4G communication module include a wired interface and a wireless connection

Hey.

[0016] Further, wherein the various different interfaces include a UART interface, a USB interface, a PCI-E interface, and a Wi-Fi interface.

[0017] Still further, wherein the sensor module on the drone includes a gyroscope, a built-in camera, an accelerometer, and a GPS unit.

[0018] In addition, the present application further provides a method for remote information interaction with a drone using the above device, which is characterized in that it comprises the following steps: [0019] 1) The intelligent mobile terminal supporting the 4G network sends relevant instruction data to the drone;

[0020] 2) The 4G communication module on the drone receives the relevant instruction data and automatically allocates different instruction data to the device through the various interfaces according to the request of the sensor module on the drone The corresponding sensor module on the drone.

[0021] wherein the method further comprises the following steps:

[0022] 3), each sensor module on the drone transmits the image transmission information and flight state information of the drone to the 4G communication module through the various interfaces, and returns through the 4G communication module Passed to the smart mobile terminal.

[0023] Further, wherein the method further includes the following steps:

[0024] 4) The pictures, videos and other data captured by the drone through the built-in camera during flight are transmitted to the smart mobile terminal through the 4G communication module.

[0025] Further, wherein the method further comprises the following steps:

[0026] 5) The pictures, videos and other data captured by the drone through the built-in camera during flight are transmitted to the cloud through the 4G communication module.

[0027] Further, wherein the method further comprises the following steps:

[0028] 6) The personal computer downloads pictures, videos and other data captured by the drone during the flight from the cloud through the network.

Moreover, the present application further provides a drone, characterized in that it has the above-mentioned means for remotely interacting with a drone through a 4G network.

[0030] Finally, the present application further provides a drone, characterized in that the above method is used for remote information interaction.

Advantageous effects of the invention

Beneficial effect

[0031] 1. It adopts 4G network to accurately control the drone, and breaks through the existing radio control technology in the industry. The drone can be controlled to fly in the place covered by the 4G network, and even the over-the-horizon flight can be realized. In theory, as long as the power is sufficient, the local drone with 4G signal can fly (fly higher and further), so that the drone can get rid of the control distance limit, and use the extensive public communication network covering the region. Work, with a rich mission load, to take advantage of the unparalleled advantages of drones in certain industries, It can provide wireless connection for logistics, agriculture, construction, insurance and other industries to better data transmission. This also makes the drone have excellent anti-interference ability. It adopts digital broadband technology and its signal is in millimeter wave. The main transmission band improves the user capacity, increases the redundancy of the UAV communication signal, and adaptively processes the dynamic network and channel change to meet the coexistence and intercommunication between different speed recording and different device users. The obstacle avoidance technology greatly improves the safety of drone flight.

[0032] 2. The 4G network provides a feasible solution for the bottleneck problem encountered by the remote communication technology of the drone, which can not only fully utilize the mobile phone base stations distributed in the city to transmit data and images, but also has a mobile phone application. The inherent advantages of seamless integration, you can use your mobile phone to check the flight status of the drone; Moreover, the 4G network data transmission delay is small, the reliability is high, as long as the signal can be connected to control the drone, 4G mobile As a mature communication method, communication can be connected to the mobile network as long as the drone is connected to the mobile network (unmanned aerial vehicles and drones, drones and control devices), basically without location restrictions.

[0033] 3, 4G communication technology has a great improvement in transmission rate, so it can realize real video transmission, which can be used for monitoring, aerial photography and rescue of drones.

Brief description of the drawing

DRAWINGS

1 is a schematic diagram of the structure of an apparatus for remotely interacting with a drone through a 4G network according to the present application.

2 is a flow chart of a method for remote information exchange between a device and a drone that performs remote information interaction with a drone through a 4G network according to the present application.

Embodiments of the invention

[0036] The present application is further described below with reference to the accompanying drawings and embodiments, and the contents of the embodiments are not to be construed as limiting the scope of the application.

1 shows a schematic configuration of an apparatus for remotely interacting with a drone through a 4G network of the present application. As shown in FIG. 1, the apparatus for remotely interacting with a drone through a 4G network of the present application includes a 4G communication module installed on the drone and an intelligent mobile terminal supporting the 4G network.

[0038] wherein, by providing a 4G communication module on the drone, the UAV can perform wireless information interaction based on the 4G network through the 4G communication module, thereby facilitating transmission and reception of various information. And because The 4G network interacts with the drone for information exchange. Therefore, as long as there is a 4G network, the information interaction distance is not limited. At the same time, the transmission data bandwidth of the 4G network is not limited, which greatly improves the information interaction capability with the drone, and can realize the real video transmission, which can be used for monitoring, aerial photography and rescue of the drone.

[0039] In the present application, the working mode of the 4G communication module may be TD-LTE and FDD-LTE, so that the drone can access a 4G network of each communication carrier, such as a 4G network of a mobile company. Unicom's 4G network, etc., makes its 4G network unrestricted. Specifically, the accessed 4G network is based on the carrier card inserted in the 4G communication module. For example, if a mobile phone uses a mobile company's card, it is connected to the mobile company's network. It can be understood that the drone can access the network through the 4G communication module to perform information transmission and reception.

[0040] In the present application, the 4G communication module has various interfaces and various sensor modules on the UAV through the various interfaces (the sensor module in FIG. 1) Sensor module B, ... sensor N) performs data transmission and reception. Preferably, the various interfaces of the 4G communication module include a wired interface and a wireless interface. More preferably, the various different interfaces include a UART interface, a USB interface, a PCI-E interface, and a Wi-Fi interface. Thus, various sensor modules on the drone, such as a gyroscope, a built-in camera, an accelerometer, and a GPS unit, etc., can be connected to the 4G communication module through different interfaces.

[0041] In the present application, since the 4G communication module and each sensor module on the drone are respectively connected by different interfaces, different data can be automatically allocated to the specific sensor module of the drone. Specifically, after the data is transmitted to the 4G communication module, according to different parts, for example, a request of a gyroscope, an accelerometer, etc., since the interface types between the respective sensor modules and the 4G communication module are different, therefore, according to the interface The type and data type automatically assign the corresponding data to the sensor module that sent the request, ensuring the independence of the data for each sensor module.

[0042] Moreover, in the present application, the smart mobile terminal can perform long-distance information interaction with the drone through the 4G network and the 4G communication module, and send relevant instructions to the drone. The data thus controls the flight path of the drone and collects the information transmitted and the flight status information returned by the drone.

[0043] Specifically, the smart mobile terminal may send related instruction data, such as takeoff, navigation, photographing, etc., to the drone through the 4G network. The relevant instruction data is received by the 4G communication module, and then the 4 The G communication module automatically allocates relevant data to each sensor module of the drone through different interfaces according to the request of each sensor module of the drone.

[0044] Moreover, various information generated in the drone, including flight status information (such as position, altitude, posture, electric quantity, etc.) of the drone itself and image transmission information, may be through the various different The interface is transmitted to the 4G communication module and transmitted externally via the 4G communication module, and is received by the smart mobile terminal.

[0045] In particular, since a 4G network is used, the transmission rate is relatively large and the transmission delay is relatively small, so that a high-definition image or video captured by the built-in camera of the drone can be sent to the smart through the 4G communication module. a mobile terminal, wherein the user of the smart mobile terminal can monitor the environment of the drone environment through the smart mobile terminal, and adjust the drone through the smart mobile terminal according to the surrounding environment of the drone Flight route.

[0046] In addition, in the present application, the apparatus for performing remote information exchange with the drone through the 4G network may further include a cloud. The information interaction between the smart mobile terminal and the 4G communication module is performed through the cloud. Thus, pictures, videos, and other data (e.g., flight status information, return information, etc.) captured by the drone during flight can be transmitted to the cloud through the 4G communication module. Thus, all the information about the drone can be stored in the cloud, facilitating the networking, storage and sharing of related information.

[0047] Similarly, the device for remotely interacting with the drone through the 4G network may further include a personal computer. The personal computer can pass through a network (the network is not limited to a 4G network, but may also be an Internet network, a local area network, etc., as long as the personal computers can be connected to each other). The drone is downloaded from the cloud during the flight process. Pictures, videos, and other data captured in the middle. In this way, the sharing of information about the drone is realized.

[0048] FIG. 2 is a flow chart showing a method for remote information exchange between a device for remote information exchange with a drone through a 4G network and a non-human machine using the present application. As shown in FIG. 2, the method of the present application includes the following steps:

[0049] First, according to the need to control the drone, the smart mobile terminal supporting the 4G network transmits relevant command data, such as take-off, navigation, and photographing, to the drone having the 4G communication module.

[0050] Second, the 4G communication module on the drone receives the relevant instruction data through the 4G network and according to The request of the sensor module on the drone automatically assigns different command data to the respective sensor modules on the drone through the various different interfaces. That is, after receiving the relevant instruction data, the 4G communication module automatically allocates corresponding instruction data to the corresponding sensor module on the drone according to the type of the relevant instruction data and the interface type, so as to implement the The control of the drone.

[0051] In the present application, the method further includes the following steps: the sensor module on the drone transmits the image transmission information and flight state information of the drone to the 4G communication through the various different interfaces. The module is returned to the smart mobile terminal through the 4G communication module. That is, the sensor module on the drone transmits the obtained flight state information (such as position, height, posture, electric quantity, etc.) and the image transmission information of the drone itself to the station through the various interfaces. The 4G communication module is sent through the 4G network through the 4G communication module, and the intelligent mobile terminal receives flight status information (such as position, altitude, posture, power, etc.) of the drone itself sent by the 4G communication module. ) and return images. In this way, the user of the smart mobile terminal is convenient to control the related information of the drone, thereby facilitating the control of the drone.

[0052] Of course, in the present application, the method may further include the following steps: the picture, video, and other data captured by the drone through the built-in camera during the flight process are transmitted to the office through the 4G communication module. Said intelligent mobile terminal. In this way, the user of the smart mobile terminal can monitor the environment around the drone through the smart mobile terminal, and monitor the flight path of the drone according to the surrounding environment while monitoring the environment of the environment surrounding the drone. Ensure the flight safety of the drone.

[0053] Moreover, in the present application, the method may further include the following steps: the picture, video, and other data captured by the drone through the built-in camera during flight are transmitted to the 4G communication module through the 4G communication module. The cloud. In this way, all the drones located in the 4G network can transmit the captured pictures, videos and other data to the cloud and store them in the cloud, thereby enabling networking of all the drones, and facilitating the drones. Sharing of information.

[0054] Finally, in the present application, the method may further include the following steps: the personal computer or the smart mobile terminal downloads, from the cloud, the picture captured by the drone during the flight, Video and other data. In this way, the control terminal of the non-UAV can also understand the relevant information of the drone, not only realize information sharing, but also facilitate information exchange. [0055] Of course, a drone having the above-described apparatus for remotely interacting with a drone through a 4G network is also within the scope of the present application.

[0056] Similarly, the drone that uses the above method for remote information interaction is also within the protection scope of the present application.

[0057] The information exchange of the drone using the apparatus and method for remote information exchange with the drone through the 4G network of the present application is not geographically restricted, and can be controlled to fly in the place covered by the 4G network, and the over-the-horizon distance Flying is of course possible, and excellent anti-jamming capability also improves the safety of drone flight. At the same time, the delay of the 4G network is small, and the operator can remotely control through the actual video feedback from the drone, which improves the accuracy of the operation.

[0058] In terms of consumption level, the drone using the apparatus and method for remote information exchange with the drone through the 4G network of the present application can be controlled to fly as long as the network covers the area, and therefore, the drone is given. Accessing the mobile data service will effectively improve the long-range flight capability of the drone, and make a technical foundation for the new functions such as drone photos transmission and live video broadcasting, and control the drone flight through the 4G network. The flight distance is no longer limited, and high-quality image and video transmission can be achieved.

[0059] At the application level, UAVs connected to 4G networks can provide enterprise customers with oil pipeline inspection, agricultural production and fire disaster monitoring, and can fully realize remote control of drones. The 4G network enables real, clear, stable and efficient transmission of video signals, which will make drones such as aerial photography, surveillance and other applications.

[0060] The above-described embodiments of the present application are merely illustrative of the present invention and are not intended to limit the embodiments of the present application. Other variations or modifications of the various forms may be made by those skilled in the art in light of the above description. It is not possible to exhaust all implementations here. Obvious changes or variations that extend to the technical solution of the present application are still within the scope of this application.

Claims

Claim

A device for remotely interacting with a drone through a 4G network, characterized in that:

a 4G communication module disposed on the drone, the 4G communication module having various interfaces and transmitting and receiving data to and from each sensor module on the drone through the various interfaces;

An intelligent mobile terminal supporting a 4G network, wherein the smart mobile terminal can perform long-distance information interaction with the drone through the 4G network and the 4G communication module, and send relevant instruction data to the drone Control the flight path of the drone and collect the information and flight status information returned by the drone.

The apparatus for remotely interacting with a drone through a 4G network according to claim 1, further comprising:

In the cloud, pictures, videos, and other data captured by the drone during the flight can be transmitted to the cloud through the 4G communication module.

The apparatus for remotely interacting with a drone through a 4G network according to claim 2, further comprising:

a personal computer, wherein the personal computer can download pictures, videos, and other data captured by the drone during the flight from the cloud through the network.

The apparatus for remotely interacting with a drone through a 4G network according to claim 3, wherein the various interfaces of the 4G communication module include a wired interface and a wireless interface.

The apparatus for remotely interacting with a drone through a 4G network according to claim 4, wherein the various interfaces include a UART interface, a USB interface, a PCI-E interface, and a Wi-Fi interface.

The apparatus for remotely communicating with a drone through a mobile network according to any one of claims 1 to 5, wherein each sensor module on the drone includes a gyroscope, a built-in camera, an accelerometer, and GPS unit.

A device for remotely communicating with a drone using the apparatus of any one of claims 1-6 The method of interaction is characterized in that it comprises the following steps:

1) The intelligent mobile terminal supporting the 4G network sends relevant instruction data to the drone;

2) The 4G communication module on the drone receives the relevant instruction data and automatically assigns different instruction data to the none through the various interfaces according to the request of each sensor module on the drone The corresponding sensor module on the human machine.

[Claim 8] The method according to claim 7, further comprising the steps of:

3), the sensor module on the drone transmits the image transmission information and flight state information of the drone to the 4G communication module through the various interfaces, and is transmitted back to the 4G communication module by the 4G communication module Intelligent mobile terminal.

[Claim 9] The method according to claim 8, further comprising the steps of:

4) The picture, video and other data captured by the drone through the built-in camera during flight are transmitted to the smart mobile terminal through the 4G communication module.

[Claim 10] The method according to any one of claims 7-9, further comprising the steps of:

5) The pictures, video and other data captured by the drone through the built-in camera during flight are transmitted to the cloud through the 4G communication module.

[Claim 11] The method according to claim 10, further comprising the steps of:

6) The personal computer downloads pictures, videos and other data captured by the drone during the flight from the cloud through the network.

[Claim 12] A drone, comprising: the apparatus for remotely interacting with a drone through a 4G network according to any one of claims 1-5.

[Claim 13] A drone, characterized in that the remote information interaction is performed by the method of any one of claims 6-11.