WO2018066744A1

WO2018066744A1 - System and method for controlling multidrone

Info

Publication number: WO2018066744A1
Application number: PCT/KR2016/012260
Authority: WO
Inventors: 조경은; 김준오; 치옥용; 국윤창
Original assignee: 동국대학교 산학협력단
Priority date: 2016-10-06
Filing date: 2016-10-28
Publication date: 2018-04-12
Also published as: KR101941643B1; KR20180038231A

Abstract

A multidrone control system according to an embodiment of the present invention comprises: a virtual drone agent for analyzing individual information of a pilot, individual information of a drone and real-time pilot monitoring information of the drone, and controlling the flight of the drone according to the analysis result; and a virtualization server for creating and managing a virtual drone agent that matches one-to-one with the drone, on the basis of previously registered drone information.

Description

Multi drone control system and method

The present invention relates to a multi-drone control system and method, and more particularly, to grasp the control data of the drone control terminal, the drone status information and the individual information of the operator to block risk factors in advance, or to operate the multi drone under limited conditions. A multi drone control system and method.

A drone, called a drone, refers to a vehicle that can carry out its mission through remote or automatic maneuvering without pilots. According to the UAV Roadmap, published by the Office of the Secretary of Defense (OSD), drones can be “flighted through autonomous or remote control using aerodynamic forces, without burning human pilots, disposable or reusable. It means a power vehicle capable of carrying a deadly or non-lethal cargo.

The launch of drones has been used for military purposes for combat and reconnaissance, but in recent years civilians have been using them in various fields such as agriculture, forest surveillance and firefighting, shipping, logistics, communications, shooting, disaster response, and research and development. It is widening.

The reason why the drone system is in the spotlight in various fields is that it can be operated remotely and additional devices can be attached to the drone. Additional devices can be selected as small as temperature or light sensors, oxygen and carbon dioxide concentration sensors, as well as GPS, cameras and ultrasound equipment. By wireless communication, drones can transmit the results of missions such as photos and videos to the ground, and the ground control system can check or adjust the sensor values measured through telemetry.

The first object of the present invention is to provide a multi-drone control system that can safely operate the drone even if the network disconnection between the control program and the drone, without changing or modifying the existing drone and control program.

The second task is to provide a multi-drone control system that blocks risk factors in advance or operates multiple drones under limited conditions, taking into account the individual information of the drone and the operator, the command of the control terminal, and the flight monitoring information of the drone in real time.

The third task is to provide a multi-drone control method for establishing a specific mesh-up network for each point of drone, virtualization server, and control terminal with low packet loss and high connection stability for the network required for the multi-drone and multi-controller environment. have.

The multi-drone control system according to an embodiment of the present invention analyzes individual operator information, individual drone information, and real-time steering monitoring information of the drone, and a virtual drone agent for controlling the flight of the drone according to the analysis result and in advance. And a virtualization server configured to generate and operate the virtual drone agent that is one-to-one matched with the drone based on registered drone information.

According to another embodiment of the present invention, the virtualization server may define a virtual space using GPS coordinates of a real space, which is a flight allowance area, and the virtual drone agent may include the drone individual information, the individual operator information, and real-time flight monitoring. The drone simulator is generated in real time based on the information and the virtual space.

The individual controller information according to another embodiment of the present invention, the personal information of the operator, whether or not the drone flight qualification, the drone flight history of the operator, the drone operation year, the number of drone operation, the accident history during the drone flight, the history of drone flight competition, It includes at least one of the drone flight test level, class, and the drone individual information, the name of the drone, the manufacturer, the performance chart, the age of the drone and whether the drone has been modified, the weight, size, number of wings, loading of the drone At least one of a pixel and an image quality of the camera, a maximum driving distance, and a battery duration.

The virtualization server according to another embodiment of the present disclosure manages the drone flight permission zone by dividing it into a flight zone for each class accessible by drone class.

The virtual drone agent according to another embodiment of the present invention receives the corresponding protocol from the virtualization server in real time according to a different command system for each drone manufacturer in order to interpret the command syntax of a plurality of commercial drones different from each other.

According to another embodiment of the present invention, the virtual drone agent, as a result of analyzing the real-time control monitoring information of the drone, the real-time location information of the drone, the flight restriction zone departure, collision with other drones, flight prohibited zone invasion, in advance Detects at least one of the pilot's immaturity that does not meet the established criteria.

According to another embodiment of the present invention, the drone includes a bridge module for converting a Bluetooth signal received from the virtual drone agent and processing it as a Wi-Fi signal, and a unit of asynchronous command sent through the Bluetooth communication from the virtual drone agent It converts the data into Wi-Fi data and sends a continuous signal until the command is completed.

According to another embodiment of the present invention, the image information obtained by the image capturing device mounted on the drone is received and stored, and further includes at least one of an external storage device and an image output device provided 1: 1 with the drone. do.

According to another embodiment of the present invention, the bridge module is connected via Wi-Fi as the first communication method, and the bridge module and the external storage device or image output device are connected via Bluetooth as the second communication method. Is connected, the bridge module directly transmits the image information to the predetermined external storage device or image output device, thereby preventing overload between the bridge module and the virtualization server.

According to another embodiment of the present invention, a drone receives a flight command from a control terminal or a virtual drone agent, transmits monitoring information of a drone to the virtual drone agent, and a software-defined network to transmit data received through the communication unit. And a controller for processing drone flights according to flight commands received from the bridge module.

The communication unit according to another embodiment of the present invention, the control terminal or the virtual drone agent is connected to the Bluetooth network, the bridge module is configured as a Bluetooth to WiFi Data converter module.

The bridge module according to another embodiment of the present invention converts one unit of asynchronous commands sent through the Bluetooth communication from the control terminal or the virtual drone agent into Wi-Fi data, and generates a continuous signal until the command is completed. Send to the controller.

Another embodiment of the present invention further includes a camera for acquiring image information, wherein the bridge module is configured to provide an external storage device or an image output device provided with the drone 1: 1 by using the image information acquired from the camera via Bluetooth. send.

According to another embodiment of the present invention, when the distance between the drone and the control terminal or the virtual drone agent is a distance of 100m or more and less than 3Km, the multi-drone is divided into a main drone and a sub drone, and the main drone is the control terminal or The virtual drone agent is connected via WiFi, and the sub drone is connected to the main drone through a mesh up asynchronous network, which is Ultra-wideband communication (UWB) -UWB (or LTE Direct-LTE Direct). Receive and share commands from the main drone.

According to another aspect of the present invention, there is provided a method for controlling a multi-drone, including: generating, by a virtualization server, a virtual drone agent matching one-to-one with a drone based on previously registered drone information, and wherein the virtual drone agent is individually controlled by a controller. Analyzing information, drone individual information, and real-time steering monitoring information of the drone, and transmitting, by the virtual drone agent, a flight control signal for controlling the flight of the drone according to an analysis result to the communication unit of the drone; and And a communication unit of the drone converts the flight control signal to the bridge module provided in the drone.

The bridge module according to another embodiment of the present invention continuously converts one unit of the asynchronous command of the Bluetooth signaling method, which is the flight control signal, into a Wi-Fi signal until the asynchronous command is completed.

According to another embodiment of the present invention, the connection between the virtual drone agent and the virtualization server is connected by inquiring a key value through a Mac address, and among WiFi / Local LAN / 3G / 4G / LTE. Connected through at least one.

The virtual drone agent according to another embodiment of the present invention further includes dynamically generating or discarding a packet relay daemon according to a connection between the virtual drone agent and the control terminal for connection or disconnection of various drones. .

The virtual drone agent according to another embodiment of the present invention further includes the step of acquiring the packet relay daemon in a time-prioritized manner when a plurality of drones simultaneously access the virtual drone agent.

According to one embodiment of the present invention, the drone can be safely operated even if a network disconnection between the control program and the drone occurs, without changing or modifying the existing drone and the control program.

In addition, according to an embodiment of the present invention, in consideration of the individual information of the drone and the operator, the command of the control terminal and the real-time monitoring flight information of the drone, it is possible to block the risk factors in advance or operate the multi-drone in limited conditions.

In addition, according to an embodiment of the present invention, to build a specific mesh-up network for each point of the drone, a virtualization server and a control terminal with low packet loss and high connection stability for building a network required for a multi-drone and a multi-pilot environment. A dynamic software defined network can be implemented.

1 is a diagram illustrating a general configuration of a multi-drone control system according to an embodiment of the present invention.

2 is a diagram illustrating a virtual space defined according to an embodiment of the present invention.

3 is a block diagram showing the configuration of a drone according to an embodiment of the present invention.

4 is an exemplary diagram for describing a communication establishment technique for a local area network according to an embodiment of the present invention.

5 is an exemplary diagram for describing a communication establishment technique for a long distance network according to an embodiment of the present invention.

6 is a diagram illustrating a schematic configuration of a dynamic software defined network according to an embodiment of the present invention.

7 is a diagram illustrating a connection method between network modules according to an exemplary embodiment of the present invention.

8 is a diagram for describing a mesh up network based video transmission method according to an embodiment of the present invention.

Before describing the embodiments of the present invention, the problems of the existing drone operation conditions are reviewed, and then the technical means adopted by the embodiments of the present invention to solve these problems will be outlined.

Due to the popularization of drones, drone-only spaces such as drone parks and drone aerodromes are created all over the country, but there is no development of a system that controls or regulates drone flight.

In addition, most of the control programs provided by commercial off-the-shelf drone makers are used via smartphones. When the smartphone is connected to the drone, the data network with the outside is completely blocked, and when the phone comes due to the nature of the phone, the network changes. Due to the loss of control as a drone control terminal has a dangerous disadvantage in drone flight operation.

Therefore, the operation of the drone of the general public currently has no choice but to rely on the qualitative common sense of the user, and there is a risk that it can be used as a tool for accidents and deliberate terrorism due to the invasion of others' privacy, the drone's flight range and fall.

Accordingly, embodiments of the present invention propose a technical means for blocking risk factors in advance or operating under limited conditions in consideration of individual information of a drone and an operator, a command of a control terminal, and flight information of a drone in real time.

In addition, embodiments of the present invention are dynamic software definition for establishing a specific mesh-up network for each point of a drone, a virtualization server, and a control terminal having a low packet loss and a high connection stability for a network required for a multi-drone and a multi-controller environment. Suggest a network.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, in the following description and the accompanying drawings, detailed descriptions of well-known functions or configurations that may obscure the subject matter of the present invention will be omitted. In addition, it should be noted that like elements are denoted by the same reference numerals as much as possible throughout the drawings.

1 is a view schematically showing the configuration of a multi-drone control system according to an embodiment of the present invention.

Referring to FIG. 1, a multi-drone control system according to an exemplary embodiment of the present invention includes a virtualization server 100 and a virtual drone agent 200.

The multi-drone control system of the present invention is difficult to implement with a single technology, and is composed of a technology set built using a convergence technology.

As shown in FIG. 2, the virtualization server 100 first defines a virtual space with respect to a real space that is a flight allowance interval, and operates the virtual drone agents 200, 210, and 230.

The virtualization server 100 directly processes the packet, and in order to define a Dynamic SDN (Software define network), the server itself is equipped with an AP Simulator (Access Point Simulator) module. Dynamic software defined networks will be described in detail below.

The virtualization server 100 receives the operator's individual information and the drone's individual information registered in advance by the drone operator and generates the drone agent 200 in real time.

The virtualization server 100 may be implemented as, for example, a cloud system, and may store the controller individual information, the drone individual information, and the flight policy information of the corresponding region, which the operator inputs when registering the drone, in the cloud server.

Here, the individual controller information may include the personal information of the operator, whether or not the drone flight qualification, the drone flight history of the operator. In addition, the individual operator information may further include at least one of the year of drone operation, the number of drone operation, accident history during drone flight, drone flight competition history, drone flight test level, grade.

The drone individual information may include registration information of the drone (including name, manufacturer, driving performance table, etc.), the age of the drone, and whether or not the drone is modified. In addition, the individual drone information may include specific drone specifications, that is, the weight, size, number of wings of the drone, the pixel and image quality of the mounted camera, the maximum driving distance, the battery duration.

The flight policy information for the region may include flight limit altitude and flight limit maximum speed.

In particular, the virtualization server 100 may divide the multi-drone into several classes according to the above-described individual controller information and individual drone information, and may operate a differential control for the flight of the control terminal and the drone according to the drone class.

In this case, the virtualization server 100 may generate a corresponding drone simulator in real time based on individual information of a drone and a pilot registered in a virtualized flight zone and real-time flight monitoring information. In addition, the drone simulator may be destroyed as the drone is withdrawn from the virtualized flight zone.

To this end, the virtualization server 100 may image and display the flight of the actual drones in the image on which the virtualized flight zone is displayed, and may display and display the individual information or real-time monitoring information of each drone together.

For example, when acrobats are operated by multi drones, a plurality of drones are divided into groups, or when a multi drone is operated for training and public / military purposes, the driving capability of the drone and the drone's specifications and performances are different. By collecting and controlling similar drones, that is, drones of the same grade, you can implement efficient and safe drone operation. At this time, the flight can be controlled by separating the multi-drone into different virtual spaces according to the class of the drone.

In addition, when operating multiple drones for long-distance flight, the drones are divided into classes based on battery duration, motor specification, maximum driving distance, and maneuverability, which are the main requirements for long-distance flight. Can operate separately.

In addition, by managing the drone flight clearance zone divided by the flight class by grade accessible by drone class, it is possible to prevent cross-run of the drone flight. Here, when the drone flight clearance zone is divided by drone class, the area adjacent to the risk factor such as the transmission tower or the dangerous building permits the flight to only the higher class drones, and the relatively safe area to fly only the lower class drones. By allowing them, you can operate multi-drones more safely and efficiently.

The drone steering terminal 400 is matched 1: 1 to the virtual drone agent 200 through the AP of the virtualization server 100. As shown in FIG. 2, a virtual space declaration service using GPS (or real time locating system (RTLS) coordinates for indoor use) is operated.

The virtual drone agent 200 converges a command sent from the pilot terminal 400 to the drone 300. The virtual drone agent 200 has a protocol defined for interpreting the command syntax of various commercial drones. To this end, the virtual drone agent 200 may receive the corresponding protocol from the virtualization server 100 in real time according to a different command system for each drone manufacturer.

In addition, the virtual drone agent 200 has A-D and D-A protocol components to convert and transmit analog and digital signals.

The virtual drone agent 200 is, for example, Parrot group (European company), DJI group (Chinese company), DIY (own or other) according to the signal according to the command Digital to Digital, Analog to Digital, Digital to Analog Convert the command data into the form.

The virtual drone agent 200 monitors the steering information, the control command data, the steering time and the real time flight, location and status of the drone 300 in real time, and monitors the real-time monitoring information in the virtualization server 100. To pass.

In addition, the virtual drone agent 200 may check the registration information of the drone 300, the controller and the individual information of the drone, etc. from the virtualization server 100.

In detail, the virtual drone agent 200 detects a departure from the restricted flight area of the drone 300, a collision with another drone, an invasion of the restricted area, and a flight control immaturity that does not meet a predetermined standard.

Herein, the flight restrictions may be set not only on the rules of flying within the virtual flight space area, but also on flight speed, flight height, and total flight distance.

The steering information of the steering terminal 400 may include steering signals such as Roll, Pitch, Yaw, Power, and the like.

The virtual drone agent 200 converges real-time location information of the drone in communication with the drone 200. The location information includes altitude, longitude, and latitude, and may be represented by coordinates. In addition, the virtual drone agent 200 is a real-time location tracking system (RTLS), a camera, GPS / navigation, a gyro sensor (Gyro), an acceleration sensor (Accelerator), etc. mounted on the drone 200 to the status information of the drone 300 Can be obtained by receiving data.

The virtual drone agent 200 controls the drone 200 to stay within the flight allowance area when the abnormal flight of the drone 200 and the abnormal control command of the control terminal 400 are detected, or stops the flight and the drone ( 200) can land. This may be an execution in accordance with a control command received from the virtualization server 100.

The drone 200 and the control terminal 400 may be designed to execute the command of the virtual drone agent 200 in preference to the command of the control terminal 400 for driving and cluster control for safety and security of the multi-drone. .

3 is a block diagram showing the configuration of a drone 300 according to an embodiment of the present invention.

Referring to FIG. 3, the drone 300 according to an embodiment of the present invention includes a control unit 310, a communication unit 320, a bridge module 330, a GPS module 340, a GYRO / ACCEL module 350, and a camera module. 360 and the subscriber identification module 370 is configured.

The controller 310 may control a plurality of hardware or software components connected to the controller 310 by driving an operating system or an application program for operating a drone of the present invention, and may perform data processing or calculation including various signals. It can control the operation of other components of the drone.

The communication unit 320, the bridge module 330, the GPS module 340, the GYRO / ACCEL module 350, the camera module 360, and the subscriber identification module 370 are controlled and the flight of the drone 300 is controlled. The controller 310 may authenticate the drone 300 through the communication unit 320 or transmit location information and monitoring information of the drone 300 to the virtualization server 100.

The controller 310 may be designed to follow the command received from the virtual drone agent 200 in preference to the control command received from the steering terminal 400 in order to safely operate the multi-drone according to the purpose of the present invention. Accordingly, it is possible to block dangerous control commands of the steering terminal 400.

The communication unit 320 receives a command from the steering terminal 400 or the virtual drone agent 200, and transmits the monitoring information of the drone to the virtual drone agent 400.

The communication unit 320 is connected to the steering terminal 400 through a normal Bluetooth network, and is connected to the bridge module 330 by 1: 1 WiFi.

The bridge module 330 processes the data received through the communication unit 320 on the basis of the software defined network (SDN) and processes the converted data. In this case, the software define network is a technology in which the software controls all the actual network functions, and the software controlling the network equipment can be modified by the designer as desired.

The bridge module 330 is a WiFi to mash network bridge. The bridge module 330 basically uses a Bluetooth network with the virtual drone agent 200, and may use ultra-wideband communication (UWB). For example, the bridge module 330 may be a module for converting data from Bluetooth to Wi-Fi.

The algorithm of the bridge module 330 uses a dynamic daemon address mapping, vision composer, which is software used to inspect the mapping data sharing with others and circuits of the network module. Include.

Normally, the drone 300 is operated to receive a continuous signal from the control terminal 400 in the structure, this method has a high probability of signal transmission failure.

Therefore, the present invention is provided with a bridge module 330 to solve this problem, by converting a unit of asynchronous command sent from the control terminal 400 to the Wi-Fi data via the bridge module 330, drone 300 The controller 310 will send a continuous signal until the command is completed.

Specifically, referring to FIG. 4, a communication establishment technology for a local area network will be described. When the distance between the virtual drone agent 200 (or the control terminal 400) and the drone 300 is within 10 m, the virtual drone agent ( 200 (or the control terminal 400) and the drone 300 is connected by Bluetooth, the drone 300 processes the data received via Bluetooth via the bridge module 330 to transmit the data to the WiFi network. The bridge module 330 may be mounted for each drone.

For example, in order to send an asynchronous command of one unit that the control terminal 400 wants to move, the command for moving 1 m in the NE direction is [N: 100, E: 100, S: 0, W: 0, H : 0, R: 90] when transmitting to the communication unit 320 only once via Bluetooth, the bridge module 330 converts the Bluetooth data into a Wi-Fi signal when the drone 300 moves 1m (100cm) in the NE direction It will send a continuous signal until.

Meanwhile, referring to FIG. 5, a communication establishment technique for a remote network will be described. In FIG. 5, one main drone 380 and several sub drones 390 are operated through an asynchronous meshup network. The main drone receives a command from the steering terminal 400 or the virtual drone agent 200, and spreads the received command to the sub drone 390 to share the command.

When the distance between the drones 300 and the steering terminal 400 or the virtual drone agent 200 is a distance of 100m or more within 3km, the steering terminal 400 or the virtual drone agent 200 and the main drone 380 is WiFi Is connected through.

The main drone 380 and the sub drone 390 are connected to a mash up asynchronous network, which is UWB-UWB (or LTE Direct-LTE Direct).

To this end, the drone 300 is equipped with a UWB communication module, sharing the location information, flight schedule between the drones.

Referring back to FIG. 3, the GPS module 340 obtains location information of the drone 300. The location information may include altitude, longitude, and latitude information.

The GYRO / ACCEL module 350 measures a change in the orientation of the drone 300 and measures dynamic forces such as acceleration, vibration, and impact of the drone 300.

The camera module 360 captures an image according to a photo or video capturing command received by the controller 310.

The subscriber identification module 370 is configured to authenticate the drone 300 to the virtualization server 100, and stores unique identification information of the drone 300 using the virtual drone agent 200.

Meanwhile, the multi-drone control system of the present invention establishes a specific mesh-up network between the virtual drone agent 200 and the drone 300 and the virtual drone agent 200 and the control terminal 400 in order to reduce packet loss and increase connection stability. For this purpose we propose a dynamic software defined network.

6 is a diagram illustrating a schematic configuration of a dynamic software defined network according to an embodiment of the present invention, and FIG. 7 is a diagram illustrating a connection method between network modules according to an embodiment of the present invention.

As the current drone or robot operation technique, WiFi or WiFi Direct network configuration method is used to secure the network dedicated and bandwidth. This network method guarantees stability in a 1: 1 connection, but has a problem due to disconnection with an external network.

In order to solve this problem, the present invention, as shown in Figure 6 and 7, by employing a plurality of different network schemes to ensure bandwidth, while detecting the presence of drones and apply the operation policy, external network Connect to create a dynamic software-defined network that can access the information you need in real time.

Referring to FIG. 6, a dynamic software defined network according to an embodiment of the present invention may be connected to a multi drone 510, a bridge module 530, a virtual drone agent 550, a virtualization server 570, and a steering terminal 590. Indicates.

In FIG. 6, the connection B between the drone 510 and the bridge module 530 needs to secure the same maximum bandwidth for high quality video as well as drone control. Therefore, it is necessary to maintain the same WiFi / WiFi-D method as before.

When the pilot terminal 590 accesses the virtual drone agent 550 to configure the connection D between the virtual drone agent 550 and the pilot terminal 590, the virtual drone agent 550 automatically generates the virtual drone agent 550. Information is acquired through connection A between the virtual server and the virtualization server 570. The information here includes individual information of the drone and individual information of the manipulator. At this time, the key value is inquired through the MAC address of the connection D between the virtual drone agent 550 and the steering terminal 590. The network method of the connection A between the virtual drone agent 550 and the virtual server 570 is not limited to WiFi / Local LAN / 3G / 4G / LTE.

According to the connection D between the virtual drone agent 550 and the steering terminal 590 to connect or disconnect multiple drones, the virtual drone agent 550 dynamically generates or discards (or retrieves) a packet relay daemon. do.

The connection C between the bridge module 530 and the virtual drone agent 550 must satisfy the following two conditions. First, the steering information is transmitted so that the delay time is within a predetermined time, and the transmission information is transmitted according to the storage location designation of the high capacity content data. Here, the steering information refers to flight monitoring information.

For the 1: N connection between the virtual drone agent 550 and the bridge module 530, the packet relay generated in the virtual drone agent 550 through the connection A between the virtual drone agent 550 and the virtualization server 570. The daemon and the bridge module 530 are connected.

When multiple drones access at the same time, the method of obtaining the packet relay daemon for the number is implemented as a time-first battle. By default it uses a Bluetooth network. The Bluetooth to WiFi Bridge is used to connect commercial off-the-shelf drones that operate as access points.

The connection D between the virtual drone agent 550 and the control terminal 590 is made through a program provided by the manufacturer, and does not require additional modification or additional program installation. Connection D is based on Wi-Fi, and WiFi-D can also be used depending on the manufacturer's switching. However, since there is no need to receive video content directly, there is no need to use a high bandwidth network (5G).

In other words, the present invention is a technology for constructing an external network together using mesh-up to use drones and control programs (or apps) provided by a manufacturer as it is, and thus are impossible in the past such as real-time broadcasting of contents generated through drones. You can also implement the content delivery method.

To this end, the dynamic software defined network architecture is introduced to build an optimized network for each bridge. The existing network already applied to off-the-shelf drones is retained, but the added network bridge modules and network switches build a new mesh-up network.

In the related art, a Wi-Fi router was used instead of a Bluetooth to WiFi bridge module as the present invention. A Wi-Fi router is a network device for connecting another wireless network to connect an external network. However, due to high packet loss rate and dropping, there is a problem that is difficult to use in reality, and above all, there is a problem that cannot be used by simultaneous users due to the limitation of bandwidth.

On the other hand, production of content is one of the main purposes of operating a multi-drone. Currently, the type of images that can be taken using a single drone is a method of recording a wide-angle image or an omnidirectional image using a 360 degree camera.

However, for the purpose of making a movie or a documentary, it is necessary to simultaneously shoot images in various directions, and large-scale image data generated at this time may cause a limitation of storage space or cause an overload of a network. Accordingly, the present invention provides a method that maintains the quality of a transmitted image and does not affect drone operation by separating video data independently through a multi-drone control technology based on a dynamic software defined network.

The present invention directly extracts the image information from the network bridge 830 for each drone control without overloading the server 810 for controlling / operating the multi-drone through network redundancy as shown in FIG. The image may be directly transmitted to the designated storage device (storage 840) or the monitor 850.

In the network composed of mesh-up, the image data received using Bluetooth of the network bridge 830 is directly transmitted to a desired device (storage server 840 or monitor 850). In this case, the images transmitted from the plurality of drones 820 are directly transmitted from the respective bridges 830 to the desired device. Therefore, the image received from each drone 820 can be distributedly processed without putting a load on a server 810 or a network that operates the multi-drone 820.

In detail, one of the Bluetooth channels of each network bridge connected from the server may be connected to a Bluetooth module of USB type, and the corresponding USB may be connected to and stored in an image device or a storage device (storage). In addition, the camera image data can be monitored. As shown in FIG. 8, a separate storage network (for example, storage) is formed instead of a server to process a large amount of multi-image information.

Although one storage is illustrated in FIG. 8, a storage device provided 1: 1 with a drone may be connected to the network bridge 830. Accordingly, the difference between the recording method in the storage device mounted on the drone and the user can monitor the image information photographed by each drone in real time, and selectively store the image information.

The network of the drone shown in FIG. 8 is connected to the network bridge 830 via Wi-Fi, and the storage device 850 is connected to the network bridge 830 via Bluetooth.

Therefore, this technology can avoid bottlenecks between the network bridge and the server, and increase the packet processing performance of the network bridge for 8K and 16K video in the future, thereby maintaining the existing system without upgrading the entire system. Can be used.

Hereinafter, a multi-drone control method based on a dynamic software defined network according to an embodiment of the present invention will be described.

First, the virtualization server generates a virtual drone agent that matches the drone one-to-one based on previously registered drone information.

Next, the virtual drone agent analyzes the individual controller information, the drone individual information, and the real-time steering monitoring information of the drone.

Next, the virtual drone agent generates a flight control signal for controlling the flight of the drone according to the analysis result and transmits it in the first communication method.

Next, one unit of the asynchronous command of the first communication method is converted into a signal of the second communication method, and the signal of the second communication method is continuously transmitted until the asynchronous command is completed.

The drone and the virtual drone agent are connected to a Bluetooth network as the first communication method, and the first communication method is converted into a Wi-Fi signal as the second communication method.

Here, the connection between the virtual drone agent and the virtualization server is connected by inquiring a key value through a Mac address, and is connected through at least one of WiFi / Local LAN / 3G / 4G / LTE.

The virtual drone agent may dynamically generate or discard a packet relay daemon according to a connection between the virtual drone agent and the control terminal for connection or disconnection of various drones.

In addition, the virtual drone agent may acquire the packet relay daemon in a time-prioritized manner when several drones access the virtual drone agent at the same time.

According to the embodiment of the present invention, it is possible to execute not only the drone operation but also the drone flight, the record storing, and the stored record through the real-time control center implemented with the virtual drone agent and the virtualization server.

In addition, the drone real name system allows the virtual drone agent and the virtual server to allow flight only when the drone is authenticated, so that it can be applied as a system to complement the drone flight system.

In addition, by using a specific mesh-up network method for each point of the virtualization server, virtual drone agent, drone communication unit and bridge module, drone operation at a remote location is possible. Such a technique can be utilized, for example, as a control center in the production of content such as a movie or a broadcast on a remote site or in an airplane operation.

In addition, it is possible to prevent drones from flying and limiting drones as well as collision between drones and operator accidents due to immaturity of other pilots, and it can be used for drone maneuvers training for non-experts.

Meanwhile, embodiments of the present invention may be implemented in computer readable codes on a computer readable recording medium. The computer-readable recording medium includes all kinds of recording devices in which data that can be read by a computer system is stored.

Examples of computer-readable recording media include those implemented in the form of a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. And functional programs, codes and code segments for implementing the present invention can be easily inferred by programmers in the art to which the present invention belongs.

The present invention has been described above with reference to various embodiments thereof. Those skilled in the art will understand that the present invention can be implemented in a modified form without departing from the essential features of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

Claims

A virtual drone agent for analyzing individual controller information, individual drone information, and real-time steering monitoring information of the drone, and controlling flight of the drone according to the analysis result; And

And a virtualization server configured to generate and operate the virtual drone agent matching one-on-one with the drone based on previously registered drone information.
The method of claim 1,

The virtualization server,

Define virtual spaces using GPS coordinates for real spaces

The virtual drone agent, and generates the corresponding drone simulator in real time based on the drone individual information, the operator individual information and real-time flight monitoring information and the virtual space.
The method of claim 1,

The controller individual information,

Include at least one of the personal information of the pilot, whether the drone is qualified to fly, the drone's experience in drone flight, the number of drones operated, the number of drones operated, the history of drones flying, the history of drone flight competitions, the level of drone flight test, and the grade,

The drone individual information, the name of the drone, the manufacturer, the performance chart, the age of the drone and whether the drone remodeling, the weight of the drone, the size, the number of wings, the pixel and image quality of the mounted camera, the maximum driving distance, the battery A multi-drone control system comprising at least one of durations.
The method of claim 1,

The virtualization server,

Multi-drone control system that manages drone flight clearance zones by graded flight zones accessible by drone class.
The method of claim 1,

The virtual drone agent,

In order to interpret the command syntax of a plurality of different commercial drones, a multi-drone control system receiving the corresponding protocol from the virtualization server in real time according to a different command system for each drone manufacturer.
The method of claim 1,

The virtual drone agent,

As a result of analyzing the drone's real-time steering monitoring information, at least one of the drone's real-time position information, flight restriction zone departure, collision with other drones, non-flight zone invasion, flight control immaturity of the controller does not meet the preset criteria To detect, multi-drone control system.
The method of claim 1,

The drone is,

And a bridge module for converting a Bluetooth signal received from the virtual drone agent to process a Wi-Fi signal, and converting one unit of asynchronous command sent through Bluetooth communication from the virtual drone agent to Wi-Fi data to complete the command. A multi-drone control system that sends out continuous signals.
The method of claim 1,

Receiving and storing the image information obtained by the image capturing device mounted on the drone, further comprising at least one of an external storage device and an image output device that is provided with the drone 1: 1, the multi-drone control system.
The method according to any one of claims 7 to 8,

The bridge module is connected to the bridge module through the Wi-Fi as the first communication method, the bridge module and the external storage device or the image output device is connected via Bluetooth as the second communication method,

And the bridge module directly transmits the image information to a predetermined external storage device or image output device, thereby preventing an overload between the bridge module and the virtualization server.
A communication unit which receives a flight command from a steering terminal or a virtual drone agent and transmits monitoring information of the drone to the virtual drone agent;

A bridge module for processing data received through the communication unit based on a software defined network (SDN) and processing the converted transmission scheme; And

And a control unit for controlling a drone flight according to a flight command received from the bridge module.
The method of claim 10,

The communication unit,

Connected to the steering terminal or the virtual drone agent via a Bluetooth network, wherein the bridge module comprises a Bluetooth to WiFi Data converter module.
The method of claim 10,

The bridge module,

And converting one unit of asynchronous commands sent through the Bluetooth communication from the control terminal or the virtual drone agent into Wi-Fi data and sending a continuous signal to the controller until the command is completed.
The method of claim 10,

Further comprising a camera for obtaining the image information,

The bridge module is a drone for transmitting the image information obtained from the camera via Bluetooth to an external storage device or an image output device provided 1: 1 with the drone.
The method of claim 10,

When the distance between the control terminal or the virtual drone agent from the drone is a distance of 100m or more within 3Km, the multi-drone is divided into a main drone and a sub drone,

The main drone is connected to the steering terminal or the virtual drone agent via WiFi,

The sub drone is connected to a mesh up asynchronous network, which is a UWB (Ultra-wideband communication) -UWB (or LTE Direct-LTE Direct) and the main drone, and receives and shares a command from the main drone. .
Generating, by a virtualization server, a virtual drone agent matching one-to-one with the drone based on previously registered drone information;

Analyzing, by the virtual drone agent, operator individual information, drone individual information, and real-time steering monitoring information of the drone;

Transmitting, by the virtual drone agent, a flight control signal for controlling the flight of the drone according to an analysis result to the communication unit of the drone; And

And a communication unit of the drone converts the flight control signal and transmits the flight control signal to a bridge module provided in the drone.
The method of claim 15,

The bridge module,

And a unit of an asynchronous command of the Bluetooth signaling method, which is the flight control signal, is continuously converted to a Wi-Fi signal until the asynchronous command is completed.
The method of claim 15,

The connection between the virtual drone agent and the virtualization server,

A method of controlling a multi-drone, connected by looking up a key value through a Mac address, and connected through at least one of WiFi / Local LAN / 3G / 4G / LTE.
The method of claim 15,

The virtual drone agent,

And dynamically generating or discarding a packet relay daemon according to a connection between the virtual drone agent and the steering terminal for connection or disconnection of various drones.
The method of claim 15,

The virtual drone agent,

If multiple drones access the virtual drone agent at the same time, further comprising acquiring the packet relay daemon in a time-prioritized manner.