KR101840820B1 - Method for generating 3-dementional augmented reality flight video - Google Patents

Abstract

Provided is a server for searching for an optimal route of an unmanned flying object, which comprises: a traffic information reception unit for receiving location information on a destination and fuselage information on an unmanned flying object from a control terminal which controls the unmanned flying object; an optimal route searching unit for searching for an optimal route from a starting point to a destination based on the location information on a destination, the fuselage information on the unmanned flying object, and environment information; a flight information reception unit for receiving flight image, which the unmanned flying object photographs, and flight information from the unmanned flying object; a flight information image generation unit for generating a flight information image based on the optimal route, the fuselage information, and the flight information; an augmented reality flight image generation unit for overlaying the generated flight information image on the flight image to generate a three-dimensional augmented reality flight image; and an augmented reality flight image transmission unit for transmitting the three-dimensional augmented reality flight image to the control terminal, wherein the fuselage information includes mission information of the unmanned flying object, and the flight information image is differently composed according to the mission information of the unmanned flying object.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and a server for generating a three-dimensional augmented reality flight image of an unmanned aerial vehicle,

The present invention relates to a method for generating a 3D ARF image of a UAV, a control terminal and a server.

Drone is a unmanned aerial vehicle that can fly and steer by induction of radio wave. At first, it was mainly used for military use, but nowadays it is used in various industrial fields such as sports relay, disaster scene shooting, exploration report, delivery service, and commercial drone market is growing very rapidly.

In 2015, the drones landed in the front yard of the White House, the drones controlled by the national shooting team collided with the Duomo Cathedral, and the safety issues arising from flying the drones came to light.

The drones are visually controllable within the visible range, but the visible distance is very short (500m on average) and there is a high risk of accidents due to the mismatch of sight between the drone and the pilot and the illusion of the pilot.

To solve these problems, FPV (First Person View) system, which shows the first person viewpoint of the drone viewpoint, has been introduced. The conventional PV system transmits an image photographed by a camera attached to a front part of a drone and receives an image of a drones view as shown in FIG. 7 through a display screen with a receiver.

Conventional FPV has been attracting attention as an essential system to perform the duties of industrial drones in the field of entertainment, such as drone racing and games, because it is able to give immersive and realistic feeling as if flying on actual drone.

However, the conventional FPV system is provided in such a manner that only the image transmitted from the front-side camera is displayed as it is or a simple numerical information is displayed on the image, so that it is necessary to confirm the information (altitude, position, speed, etc.) It is very difficult. Therefore, there is a problem that the probability of a collision or collision of a flight caused by a lack of information or ability of the pilot during the flight of the drones is still high.

In addition, the conventional FPV system merely shows images transmitted from the front-end camera as it is, but does not provide a function of searching for a path for autonomous travel.

A brief description will now be made of a conventional HUD (Head Up Display) of a manned aircraft with reference to FIG.

The conventional flight information of the manned aircraft includes information such as the aircraft attitude (for example, pitch, roll and yaw), flight direction (heading) Respectively.

In addition, the aircraft 's attitude and navigation information, such as flight path and waypoint, were not represented in the HUD and were mainly provided to the pilot on the second display.

As described above, in the case of the manned aircraft, the pilot is advantageous in securing the view of the forward direction, so clustering and binarization of information are possible like the flight image of FIG.

However, in the case of the unmanned airplane, it is difficult to secure the view of the pilot because the pilot is operated under the remote control environment, so that it is difficult to cluster and diversify the information as in the conventional flight image.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a method and an optimal path search server and system for providing 3D augmented reality flight images for safety, convenience, and efficient flight of a drones. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to an aspect of the present invention, there is provided an optimal route search server for searching an optimal route of an unmanned aerial vehicle, comprising: a control terminal controlling the unmanned air vehicle, An optimal route search unit for searching for an optimal route from a departure location to the destination based on the location information of the destination, the gas information of the unmanned air vehicle, and the environment information, A flight information generating unit for generating a flight information image based on the optimum route, the gas information, and the flight information, a flight information generating unit for generating a flight information image on the flight image, The 3D image is overlaid on the 3D image, And an augmented reality flight image transmitter for transmitting the 3D augmented reality flight image to the control terminal, wherein the airframe information includes mission information of the unmanned aerial vehicle, Wherein the navigation server is configured differently according to mission information of the unmanned aerial vehicle.

According to another aspect of the present invention, there is provided a method for generating a 3D ARF image performed by an optimal route search server, the method comprising the steps of: receiving position information of a destination and information of an unmanned aerial vehicle from a control terminal controlling the unmanned aerial vehicle Searching for an optimal route from the departure point to the destination based on the position information of the destination, the gas information of the unmanned air vehicle, and the environment information, searching for an optimal route from the unmanned air vehicle, Generating a flight information image based on the optimal route, the airframe information, and the flight information, generating a 3D ARF image by overlaying the generated flight information image on the flight image, And transmitting the 3D augmented reality flight image to the control terminal Wherein the gas information includes mission information of the unmanned aerial vehicle and the flight information image is configured differently according to mission information of the unmanned aerial vehicle .

According to any one of the above-described objects of the present invention, it is possible to provide a method, an optimal path search server, and a system for providing a 3D augmented reality flight image for safety, convenience, and efficient flight of a drones.

1 is a configuration diagram of an unmanned aerial vehicle control system according to an embodiment of the present invention.
2 is a configuration diagram of an optimal path search server according to an embodiment of the present invention.
3 is a diagram illustrating an augmented reality flight image according to an embodiment of the present invention.
4 is a view showing a flight image for a conventional manned vehicle.
5 is a flowchart illustrating a method of generating a 3D ARF according to an exemplary embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "including" an element, it is to be understood that the element may include other elements as well as other elements, And does not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by the terminal or the device may be performed in the server connected to the terminal or the device instead. Similarly, some of the operations or functions described as being performed by the server may also be performed on a terminal or device connected to the server.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of an unmanned aerial vehicle control system according to an embodiment of the present invention. Referring to FIG. 1, an unmanned aerial vehicle control system may include an optimal path search server 100 and a control terminal 110. In addition, the unmanned aerial vehicle control system may further include the unmanned aerial vehicle 120.

The optimal path search server 100, the control terminal 110 and the unmanned aerial vehicle 120 can communicate via the network. A network is a connection structure capable of exchanging information between nodes such as terminals and servers. An example of such a network 120 is an Internet, a wireless LAN (Local Area Network), a WAN But are not limited to, Wide Area Network (PAN), Personal Area Network (PAN), 3G, Long Term Evolution (LTE), Wireless Fidelity (WiFi), World Interoperability for Microwave Access (WiMAX) .

The unmanned aerial vehicle 120 is an unmanned aerial vehicle (UAV) capable of flying remotely without a pilot, and has a photographing module for photographing. In addition, the unmanned aerial vehicle 120 includes three-axis gyroscopes for measuring the rotational motion defined by yaw, pitch, and roll, three-axis acceleration sensors, three- It is equipped with magnetometers. In addition, the unmanned aerial vehicle 120 includes a GPS module and a barometric pressure sensor for measuring the translational motion state.

The UAV 120 may receive flight information including an optimal route from the optimal route search server 100 or the control terminal 110. The unmanned aerial vehicle 120 can fly based on the optimal route. The unmanned air vehicle 120 can transmit the flight image and the flight information photographed through the camera of the unmanned air vehicle 120 to the optimal route search server 100.

One example of the control terminal 110 is a wireless communication device that is guaranteed to be portable and mobility and includes a PCS (Personal Communication System), a GSM (Global System for Mobile communications), a PDC (Personal Digital Cellular), a PHS (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, CDMA (Code Division Multiple Access) -2000, W-CDMA (W-CDMA), Wibro (Wireless Broadband Internet) A handheld-based wireless communication device such as a smart card, a smart pad, a tablet PC, a VR (Virtual Reality) device, a HMD (Head Mounted Display)

The control terminal 110 can control the drones. For example, the control terminal 110 transmits the location information of the destination and the gas information of the unmanned aerial vehicle to the optimal route search server 100, and obtains the location information of the unmanned airplane based on the location information of the destination, You can request an optimal route to your destination. Alternatively, the controlling terminal 110 may directly search for and determine the path of the drones.

The control terminal 110 can receive and output the 3D augmented reality flight image from the optimal path search server 100. The control terminal 110 can control the unmanned aerial vehicle 120 through the 3D augmented reality flight image.

The optimal path search server 100 can search for and determine the flight path of the drones. The location information of the destination and the gas information of the unmanned airplane 120 are received from the control terminal 110 and are transmitted from the origin to the destination based on the location information of the destination, the gas information of the unmanned object 120, It is possible to search for the optimal path of the path.

The optimal path search server 100 may transmit the flight information including the optimal path to the control terminal 110 or the unmanned air vehicle 120 to allow the unmanned air vehicle 120 to fly through the optimal path.

The optimal route search server 100 can receive the flight image and the flight information taken by the unmanned air vehicle 120 from the unmanned air vehicle 120 while the unmanned air vehicle 120 is in flight.

The optimal path search server 100 can generate the flight information image based on the optimal path, the gas information, and the flight information.

The optimal path search server 100 can transmit the 3D enhanced reality flight image to the control terminal 110.

Hereinafter, each configuration of the optimal path search server 100 will be described in detail. 2 is a configuration diagram of an optimal path search server according to an embodiment of the present invention. 2, the optimal path search server 100 includes an environment information receiving unit 200, a flight information receiving unit 210, an optimal path searching unit 220, a flight information transmitting unit 230, a flight information receiving unit 240, A flight information image generating unit 250, an augmented reality flight image generating unit 260, and an augmented reality flight image transmitting unit 270. The flight information image generating unit 250 may include a head up display generating unit 252 and a guidance route generating unit 254. [

The environment information receiving unit 200 receives environment information from various external servers and stores the environment information. Here, the environmental information may include wind direction, wind speed, field of view, cloudiness, and magnetic field strength. For example, the environment information receiving unit 200 can receive weather data such as wind direction, wind speed, field of view, cloudiness and magnetic field strength from the weather server in real time.

In addition, the environmental information may include local altitude information (e.g., digital elevation model (DEM)) geofence information. Here, the geofence information may include information on a non-flying zone, a restricted flight zone, a military operation zone, and a flight zone. In addition, the environmental information may include ground facility information. Here, the ground facility information may include information on the height of the transmission tower, the building, and the like. For example, the environmental information receiving unit 200 can collect public data, such as a digital map, contour data, building data, etc., and store environmental information.

The flight information receiving unit 210 may receive the location information of the departure location (up / down data), the location information of the destination (up / down data), and the gas information of the unmanned air vehicle 120 from the control terminal 110. The gas information of the unmanned air vehicle 120 may include the maximum flying height of the unmanned aerial vehicle 120, the available flight time, the battery capacity, the weight of the vehicle, and the mission information. Here, the mission information may include, for example, military, logistics, exploration, emergency transport, and the like.

The optimal path searching unit 220 can search for an optimal path from the origin to the destination based on the location information of the destination, the gas information of the unmanned air vehicle 120, and environment information. Here, the terrain height information, the geofence information, the weather information, and the height information of the ground facilities included in the environment information may have predetermined priorities or different weights.

For example, the optimal path search unit 220 may search for an optimal path using a Dijkstra algorithm, considering priorities of different environment information or different weights.

According to one embodiment of the present invention, the optimal path searching unit 220 searches for a first optimum path from a source to a destination based on the terrain height information, the height of the ground facilities, and the geofence information. For example, the optimal path searching unit 220 can search for the first optimal path considering the topographic altitude information and the height of the terrestrial facilities, except for the prohibition / restriction area based on the geofence information (step 1 - consideration of terrain elevation information, height of ground facilities and geofence information).

According to another embodiment of the present invention, the optimal path searching unit 220 can search for the first optimal path considering the gas information of the unmanned aerial vehicle 120 first. Generally, there are many obstacles such as a transmission tower, a building, and a mountain over a high altitude (for example, 50 m or less) higher than a high altitude (for example, 100 m or more). Therefore, the higher the altitude, the more advantageous to search for the optimal path, and the risk that the unmanned aerial vehicle 120 collides with the obstacle can be reduced. Accordingly, the optimal path searching unit 220 can search for the optimal path at the maximum flight altitude of the unmanned aerial vehicle 120. At this time, since the battery consumption is much worse at the time of high altitude flying, the optimum path searching unit 220 may consider the battery capacity additionally.

Thereafter, the optimal path searching unit 220 determines whether or not the flight can be performed through the primary optimal route searched based on the weather information. For example, when the wind speed is equal to or greater than a predetermined value, or when the view can not be secured according to the cloudiness, the optimal path searching unit 220 can determine that the flight can not be performed through the primary optimal path. In addition, when the magnetic field strength is equal to or greater than the predetermined value, the optimal path searching unit 220 is highly likely to lose communication with the optimal path search server 100 and the control terminal 110, (Step 2 - Consider weather information).

Thereafter, the optimal path searching unit 220 determines whether or not it is possible to fly through the first optimum path based on the gas information of the unmanned aerial vehicle 120. For example, the optimal path searching unit 220 can determine whether it is possible to fly to the destination through the primary optimum path that is searched based on the battery capacity and the available flight time of the unmanned aerial vehicle 120. In addition, it is assumed that the weather is poor in the second stage and the wind speed is high. Generally, when the weight of the unmanned aerial vehicle 120 is heavy or the ability of the unmanned air vehicle 120 to fly is good, the flight stability is excellent. Accordingly, when the wind speed is high, the optimal path searching unit 220 can determine whether it is possible to fly to the destination through the first optimum path based on the weight and the flying ability of the unmanned air vehicle 120 (Step 3 - Information).

According to another embodiment of the present invention, the optimal path searching unit 220 may search for an optimal path based on the mission information of the unmanned aerial vehicle 120. [ Mission information may include, for example, military, logistics, exploration, emergency transport, and the like.

For example, when the unmanned aerial vehicle 120 is performing the first mission (for example, an urgent transportation mission), the optimal path searching unit 220 may determine the shortest path as the optimum path for quickness. For example, when the unmanned aerial vehicle 120 is performing the second mission (e.g., military, exploration), the optimal path searching unit 220 may determine a safe path as an optimal path for stability.

If it is determined that it is impossible to reach the destination through the primary optimum route retrieved in step 3, the optimal route searching unit 220 may search for the secondary optimal route and go through steps 1 to 3.

In this manner, the optimum path is searched in consideration of various environmental information and the gas information of the unmanned air vehicle 120, thereby maximizing the energy efficiency and extending the flying distance and the flying time of the unmanned air vehicle 120. [

The flight information transmitting unit 230 may transmit the flight information including the optimal route to the control terminal 110 or the unmanned aerial vehicle 120. Herein, the flight information may include a forecasted battery consumption rate, a flight expected flight time, a route distance, and the number of nodes (Wn) on the route.

The flight information receiver 240 can receive the flight image and the flight information taken by the unmanned air vehicle 120 from the unmanned air vehicle 120 while the unmanned air vehicle 120 is in flight. The flight information may include, for example, at least one of the pitch, roll, flight speed, top / longitude, remaining battery and flight altitude of the unmanned aerial vehicle. The flight information may include, for example, a first group of flight information (e.g., essential flight information, flight speed, current position / longitude, current altitude), and a second group of flight information Pitch, origin and destination route, communication sensitivity, remaining flying distance to the destination, flying distance to the current point, remaining battery, number of GPS satellites tracking the unmanned aerial vehicle 120, current direction of the unmanned air vehicle 120) . ≪ / RTI >

The flight information image generating unit 250 may generate the flight information image based on the optimal path, the gas information, and the flight information.

The augmented reality flight image generation unit 260 may generate a 3D augmented reality flight image by overlaying the flight information image generated on the flight image.

In the case of the manned aircraft, the pilots are advantageous in securing the field of view ahead, so that clustering and binarization of information are possible as in the flight image of FIG. However, in the case of the unmanned airplane, it is difficult to secure the view of the pilot because the pilot is operated under the remote control environment, so that it is difficult to cluster and diversify the information as in the conventional flight image.

Therefore, the flight image of the unmanned aerial vehicle 120 needs to be arranged differently from the flight image of the conventional manned airplane.

3, the flight information image includes the current speed 402, the roll 404, the pitch 406, the origin and destination routes 408, the communication sensitivity 410 of the unmanned aerial vehicle 120, The remaining distance to the destination 412, the distance to the current point 414, the current position / longitude 416, the remaining battery 418, the number of GPS satellites 420 tracking the unmanned air vehicle 120, A head up display (HUD) representing at least one of the current geomagnetic direction 422, the current speed 424, and the flight altitude 426 of the UAV 120. In addition, the flight information image may include a guidance path 428 indicating an optimal path.

Here, the head-up display is disposed on the side of the flight information image, and the guidance route 428 can be disposed in the center of the flight information image.

According to the present invention, in the case of the flight image of the conventional manned aircraft, the main flight information is positioned in the center of the screen, and the navigation information is binarized in the second display, The head-up display is disposed on the side of the flight information image and the guidance route 428 is disposed in the center of the flight information image in view of the remote control environment in which the pilot's vision of the pilot is difficult to secure, have.

In addition, the flight information can be unified in the control screen using the augmented reality expression technology, thereby increasing the focus concentration of the pilot, thereby improving the steering concentration. In addition, it is possible to improve pilot's information perception ability by expressing not only schematic flight information but also intuitive numbers.

The flight information image may be configured differently according to the mission information of the unmanned aerial vehicle 120.

The head-up display generating unit 252 determines the type of the flight information to be outputted to the flight information image and the arrangement of the flight information according to the mission information of the unmanned air vehicle 120, and determines the type of the determined flight information and the arrangement of the flight information Based display to generate a head-up display.

The head-up display generating unit 252 selects at least one flight information suitable for the mission information among the flight information of the second group, and determines the placement of the selected flight information among the flight information of the first group and the flight information of the second group .

For example, when the unmanned aerial vehicle 120 is performing the first mission (for example, the urgent transportation mission), the head-up display generating unit 252 generates flight information for performing the first mission among the two groups of flight information , The flying speed, the remaining flying distance to the destination, and the flying distance to the current point, and determines the arrangement of all the flying information of the first group, the selected flying speed, the remaining flying distance to the destination, And generate a head-up display based on the determined placement. In the case of the first mission, the flight speed, the remaining flying distance to the destination, and the flying distance to the current point can be displayed on the left and right, and can be larger than other flight information.

For example, when the unmanned aerial vehicle 120 is performing the second mission (e.g., military, exploration), the head-up display generating unit 252 generates flight information that is important for performing the first mission of the two groups of flight information The number of GPS satellites tracking the roll, the pitch, the communication sensitivity, the unmanned air vehicle 120, and the number of GPS satellites tracking all the flight information of the first group and the selected roll, pitch, communication sensitivity, , And generate a head-up display based on the determined placement. In the case of the second mission, rolls, pitch, communication sensitivity, and the number of GPS satellites tracking the unmanned aerial vehicle 120 can be arranged on the left and right to be visible, and larger than other flight information.

In addition, the head-up display generator 252 may update the head-up display during flight of the unmanned aerial vehicle 120. [ For example, the head-up display generating unit 252 may hide or activate some of the flight information of the second group under predetermined conditions.

For example, when the unmanned object 120 is not outputting the remaining battery 418 to the head-up display at the start of flight, if the remaining battery of the unmanned air vehicle 120 falls below a preset value, the remaining battery 418 Can be activated. For example, when the unmanned aerial vehicle 120 starts flying, the head-up display of the unmanned aerial vehicle 120 does not output the communication sensitivity 410, The communication sensitivity 410 can be output when the communication sensitivity drops below a predetermined value.

The guidance route generating unit 254 can generate the guidance route 428 indicating the optimum route. For example, the guidance route generating unit 254 determines whether or not a coordinate value for the optimal route exists, and when the coordinate value for the optimal route exists, the guidance route generating unit 254 calculates the guidance route 428 based on the coordinate value for the optimal route, Lt; / RTI >

Referring again to FIG. 2, the augmented reality flight image transmission unit 270 may transmit the augmented reality flight image to the control terminal 110.

FIG. 5 is a flowchart illustrating a method for generating a 3D ARF according to an exemplary embodiment of the present invention. Referring to FIG. The method for generating a 3D ARF image according to an embodiment shown in FIG. 5 includes steps that are processed in a time-series manner in the system shown in FIG. Therefore, even if the contents are omitted in the following description, the present invention is also applied to a method for generating a three-dimensional augmented reality flight image, which is performed according to the embodiment shown in FIG.

The optimal route search server 100 may receive the location information of the destination and the gas information of the unmanned air vehicle 120 from the control terminal 110 that controls the unmanned air vehicle 120 in step S500.

In step S510, the optimal path search server 100 may search for an optimal path from the origin to the destination based on the location information of the destination, the gas information of the unmanned air vehicle 120, and environment information.

In step S520, the optimal path search server 100 may receive the flight image and the flight information taken by the unmanned aerial vehicle 120 from the unmanned air vehicle 120. [

In step S530, the optimal path search server 100 may generate the flight information image based on the optimal path, the gas information, and the flight information.

In operation S540, the optimal path search server 100 may generate a 3D ARF image by overlaying the flight information image generated on the flight image.

In step S550, the optimal path search server 100 may transmit the 3D augmented reality flight image to the control terminal 110. [

The 3D ARF image generation method described with reference to FIG. 5 may be implemented in the form of a computer program stored in a medium or in the form of a recording medium including instructions executable by a computer such as a program module executed by a computer Can be implemented. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. The computer-readable medium may also include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: optimal path search server
110: control terminal
120: unmanned vehicle

Claims (13)

1. A route search server for searching a route of an unmanned aerial vehicle,
A flight information receiver for receiving the position information of the destination and the gas information of the unmanned aerial vehicle from the control terminal for controlling the unmanned air vehicle;
A route search unit for searching for a route from the departure point to the destination point based on the location information of the destination, the gas information of the unmanned air vehicle, and the environment information;
A flight information receiver for receiving flight images and flight information taken by the unmanned aerial vehicle from the unmanned air vehicle;
A flight information image generating unit for generating a flight information image based on the route, the gas information, and the flight information;
An augmented reality flight image generation unit for generating a 3D augmented reality flight image by overlaying the generated flight information image on the flight image; And
An ARF image transmission unit for transmitting the 3D ARF flight image to the control terminal,
Lt; / RTI >
Wherein the gas information includes mission information of the unmanned aerial vehicle,
The flight information image is configured differently according to the mission information of the unmanned aerial vehicle,
Wherein the flight information image generating unit determines the type of the flight information to be output to the flight information image and the arrangement of the flight information according to the mission type of the unmanned air vehicle, and based on the determined type of the flight information and the arrangement of the flight information A head-up display generating unit (10) for generating a head-up display (HUD)
And a route search server.
The method according to claim 1,
Wherein the flight information includes at least one of pitch, roll, flight speed, top / longitude, remaining battery, and flight altitude of the unmanned aerial vehicle.
3. The method of claim 2,
Wherein the head-up display comprises at least one of pitch, roll, flight speed, top / longitude, residual battery and flight altitude of the unmanned aerial vehicle,
Wherein the flight information image includes the head-up display and a guidance route indicating the route,
Wherein the head-up display is disposed on a side of the flight information image, and the guidance route is disposed in the center of the flight information image.
delete The method of claim 3,
Wherein the flight information image generation unit determines whether or not a coordinate value for the path exists and generates a guidance route generation unit for generating the guidance route based on a coordinate value for the route when a coordinate value for the route exists,
The route search server further comprising:
The method according to claim 1,
Wherein the environment information includes terrain height information and geo fence information, weather information, and height information of ground facilities.
The method according to claim 1,
Wherein the gas information further includes at least one of maximum flight altitude information, flightable time information, battery information, weight information, and flight capability information of the unmanned aerial vehicle.
The method according to claim 6,
The geographical altitude information, the geophone information, the weather information, the height information of the ground facility, and the gas information each have a predetermined priority,
Wherein the route search unit searches the route by considering a priority of each of the terrain height information, the geofence information, the weather information, and the height information of the terrestrial facilities using a Dijkstra algorithm. Path search server.
A method for generating a three-dimensional augmented reality flight image performed by a route search server,
Receiving location information of the destination and the gas information of the unmanned aerial vehicle from a control terminal for controlling the unmanned aerial vehicle;
Searching for a route from the departure point to the arrival point based on the position information of the destination, the gas information of the unmanned air vehicle, and the environment information;
Receiving flight images and flight information from the unmanned aerial vehicle taken by the unmanned aerial vehicle;
Generating a flight information image based on the route, the gas information, and the flight information;
Generating a 3D augmented reality flight image by overlaying the generated flight information image on the flight image; And
And transmitting the 3D enhanced reality flight image to the control terminal
Lt; / RTI >
Wherein the gas information includes mission information of the unmanned aerial vehicle,
The flight information image is configured differently according to the mission information of the unmanned aerial vehicle,
The step of generating the flight information image
Determining a type of flight information to be output to the flight information image and an arrangement of the flight information according to the mission type of the unmanned aerial vehicle; And
Generating a Head Up Display (HUD) based on the type of the determined flight information and the arrangement of the flight information
And generating a three-dimensional augmented reality flight image.
10. The method of claim 9,
Wherein the flight information comprises at least one of a pitch, roll, flight speed, stiffness / latitude, remaining battery, and flight altitude of the unmanned aerial vehicle.
11. The method of claim 10,
Wherein the head-up display comprises at least one of pitch, roll, flight speed, top / longitude, residual battery and flight altitude of the unmanned aerial vehicle,
Wherein the flight information image includes the head-up display and a guidance route indicating the route,
Wherein the head-up display is disposed on a side of the flight information image, and the guidance route is disposed in the center of the flight information image.
delete 12. The method of claim 11,
The step of generating the flight information image
Determining whether a coordinate value for the path exists; And
Generating a guidance route based on a coordinate value for the route when a coordinate value for the route exists;
And generating a three-dimensional augmented reality flight image.

Images