KR20200051359A - Aerial Shooting Platform System - Google Patents

Abstract

The present invention relates to a VR/AR-integrated aerial photographing platform system configured to store autonomous flight information of a drone capable of autonomous flight after linking the autonomous flight information to information on a space within a predetermined radius, allows the drone to start the autonomous flight through the autonomous flight information when an authorized user enters the space, and provides an image photographed during autonomous flight to the user through a VR image. The VR/AR-integrated aerial photographing platform system includes: an autonomous unmanned aerial vehicle equipped with a photographing equipment for providing an image and configured to store autonomous flight information and image photographing control information, photographs an image using the photographing equipment for providing an image in response to the video photographing control information while performing the autonomous flight according to the stored autonomous flight information when an entrance detection signal is received from the outside, and generates and transmits the photographed image as aerial photographic image information; an entry detection device configured to monitor whether or not an entry state is present into an aerial photographic service area, and generates an entry detection signal and sends the signal to the autonomous unmanned aerial vehicle when an entry is detected; an aerial photographic image management server configured to receive the aerial photographic image information received from the autonomous unmanned aerial vehicle and provides the received aerial photographic image information in real time; and an image display device configured to reproduce the aerial photographic image information received from the aerial photographing image management server in real time. Accordingly, the user experiences the same feeling as if the user went directly to the tourist site through an image of the tourist site which the user cannot directly visit.

Description

Airborne Convergence Aerial Shooting Platform System {Aerial Shooting Platform System}

The present invention relates to a VR / AR convergence aerial photography platform system, and more specifically, to link and store autonomous flight information of an unmanned aerial vehicle capable of autonomous flight to spatial information of a certain radius, and when an authorized user enters the space It relates to a VR / AR convergence aerial photography platform system that enables the unmanned aerial vehicle to start autonomous flight through autonomous flight information and provide the video captured during autonomous flight to the user as a VR image.

With the development of information and communication technology, mobile devices currently being released are configured to perform various functions as well as a simple call function. Examples of such various functions include web browsing, chatting, watching TV, navigation, games, the ability to take pictures or videos through the camera, voice storage, playback of music files through the speaker system, and display of images or videos. have.

To this end, mobile device manufacturing companies are making great efforts to develop hardware and software to provide more complex and diverse functions.

In addition, a variety of complex application software such as mobile banking, mobile coupons, transportation cards, games, and security are mounted on recently released smartphones.

In addition, the currently released smart phone is equipped with a high-spec processor and a high-resolution touch screen screen, thereby enabling the use of various multimedia functions and applications.

A drone has a dictionary meaning "low hum". Here, a variety of meanings are derived and used as a meaning such as "puncture" or "bass sound". However, recently, it is mainly used to refer to a small unmanned aerial vehicle (unmanned aerial vehicle).

Recently, a drone is equipped with a function of maintaining a balance of a gas by using a plurality of miniature propellers (rotors) mounted thereon, and mounting a camera or the like to photograph a surrounding situation.

Conventional drones are mainly used for military use such as unmanned reconnaissance and combat support, but recently, they are also used for commercial purposes such as delivery of goods.

However, to date, the use of drones has been focused on acquiring simple images, providing extremely limited experiences that users can access through drones, and thus, the utilization of unmanned aerial vehicles has not been maximized.

Accordingly, there is a need to develop a system that can maximize a user's flight experience using an unmanned aerial vehicle.

Accordingly, a conventional flight experience system and method using an unmanned aerial vehicle is disclosed in Patent No. 10-1569454.

However, in the conventional flight experience system and method using an unmanned aerial vehicle, the camera's gimbal is heavy and the aircraft is difficult to fly for a long time because the camera's angle must be adjusted in the unmanned aerial vehicle. there is a problem.

In addition, there was a problem that it was not easy for tourists to fly the aircraft.

Republic of Korea Registered Patent No. 10-1569454

The present invention was solved by solving the above-mentioned problems and taking this into consideration, and linking and storing autonomous flight information of an unmanned aerial vehicle capable of autonomous flight to a certain radius of space information is stored, and when an authorized user enters the space, the unmanned aerial vehicle is operated. A. It aims to provide a VR / AR convergence aerial photography platform system that starts autonomous flight through autonomous flight information and provides the video captured during autonomous flight to users as VR images.

In addition, the present invention is a VR / AR convergence aerial photography platform system that produces geographic information, historical information, and virtual images corresponding to certain objects as AR content and combines them with videos provided by autonomous unmanned aerial vehicles to provide them. To provide, that is the purpose.

In addition, the present invention provides a VR / AR convergence aerial photography platform system that allows a user to directly select AR content coupled to a video shot by an autonomous unmanned aerial vehicle in the early stage of service use.

In addition, the present invention is equipped with a 360-degree camera to provide a VR / AR convergence aerial photography platform system that allows users to directly adjust the direction they want to see and view them in real time.

The VR · AR convergence aerial photography platform system according to an embodiment of the present invention is equipped with imaging equipment for providing images, stores autonomous flight information and image capture control information, and stores autonomy when an entry detection signal is received from the outside. An autonomous unmanned aerial vehicle that performs an autonomous flight according to flight information, photographs an image with a photographing equipment for providing an image in response to the image capture control information, and generates and transmits the photographed image as aerial photographic image information; An entrance detection device that monitors whether there is an entry state into the aerial photography service area and generates an entry detection signal when the entry is detected, and sends it to the autonomous unmanned aerial vehicle; An aerial photographic image management server that receives aerial photographic image information received from the autonomous unmanned aerial vehicle and provides it in real time; And an image display device for reproducing aerial photographing image information received from the aerial photographing image management server in real time.

As an embodiment related to the present invention, the entry detection device provides a guide message for paying an air photographing service fee, and when an air photographing service fee is paid in response to the guide message, issues an authorization command and guides and enters the air photographing service area. It is possible to monitor whether or not the sensor enters the aerial photography service area.

As an embodiment related to the present invention, the aerial image management server provides an application download guide message for aerial image playback when an entry detection signal is input from the entrance detection device, and an application for aerial image playback in response to the guide message When the download is completed, content to be added to the aerial photographed image photographed through the autonomous unmanned aerial vehicle may be provided, and content selected by the user may be provided in combination with the aerial photographed image.

As an embodiment related to the present invention, the content to be added to the aerial photographed image is at least one of geographic information, historical information, and virtual images related to the photographed area, and may be synthesized and provided in a video.

The present invention links and stores autonomous flight information of an unmanned aerial vehicle capable of autonomous flight to spatial information of a certain radius, and when an authorized user enters the space, the unmanned aerial vehicle starts autonomous flight through autonomous flight information and autonomous flight By providing the captured image to the user as a VR image, there is an effect that allows the user to feel the same feeling as viewing a video of a tourist attraction that the user cannot directly visit. That is, so that the user can visit a place that is not directly accessible due to age, physical condition, geographical condition, weather, etc., or take a video that takes into consideration the human eye as much as possible so that the user can feel the same feeling as watching while walking. And providing it so that you can fully feel the satisfaction of the proxy.

In addition, the present invention produces geographic information, historical information, and virtual images corresponding to certain objects as AR content and combines them with videos provided by autonomous unmanned aerial vehicles to provide them with a more realistic feel. In addition, it has the effect of allowing you to watch the video with the feeling of being accompanied by a commentator.

In addition, the present invention allows the user to directly select the AR content combined with the video recorded by the autonomous unmanned aerial vehicle in the early stage of using the service, so that even if the video is provided through the same flight path and is provided, the AR content is utilized by itself. It has the effect of ensuring that only the video content of the bay is secured. For example, when you visit Palgong Mountain and go hiking, some people provide services such as butterflies flying ahead and giving them the feeling of climbing together, or when animals such as squirrels and roe deer move or play together. Users have the effect of creating their own video and making it available for sharing or selling through a site operated by the aerial photography platform service, thereby generating another profit.

In addition, the present invention has an effect of mounting a 360-degree camera so that the user can directly adjust the desired direction to see in real time.

1 is a view for explaining the configuration of a VR · AR convergence aerial photography platform system according to the present invention.
2 is an operation flowchart for explaining a method of operating a VR / AR convergence aerial photography platform system according to the present invention.

It should be noted that the technical terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. In addition, technical terms used in the present invention should be interpreted as meanings generally understood by a person having ordinary knowledge in the technical field to which the present invention belongs, unless otherwise defined in the present invention. It should not be interpreted as a meaning or an excessively reduced meaning. In addition, when the technical term used in the present invention is a wrong technical term that does not accurately represent the spirit of the present invention, it should be understood as being replaced by a technical term that can be correctly understood by those skilled in the art. In addition, the general terms used in the present invention should be interpreted as defined in the dictionary or in context before and after, and should not be interpreted as an excessively reduced meaning.

In addition, the singular expression used in the present invention includes a plural expression unless the context clearly indicates otherwise. In the present invention, terms such as “consisting of” or “comprising” should not be construed to include all of the various components, or various stages, described in the invention, including some of the components or some stages. It may or may not be construed as further comprising additional components or steps.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings, but the same or similar elements will be given the same reference numbers regardless of the reference numerals, and repeated descriptions thereof will be omitted.

1 is a view for explaining the configuration of a VR · AR convergence aerial photography platform system according to the present invention.

As shown in FIG. 1, the VR / AR convergence aerial photography platform system includes an autonomous unmanned aerial vehicle 100, an entrance detection device 200, an aerial image management server 300, an image display device 400, and an autonomous flight. It consists of an unmanned aerial vehicle control system 500 and an administrator terminal 600.

The autonomous flying unmanned aerial vehicle (100) is equipped with imaging equipment for providing images, stores autonomous flight information and video shooting control information, and when an intrusion detection signal is received from the outside, it performs video while autonomously flying according to the stored autonomous flight information. In response to the shooting control information, an image is photographed with a photographing equipment for providing an image, and the photographed image is generated and transmitted as aerial photographic image information.

The autonomous unmanned aerial vehicle 100 is equipped with a 360-degree camera, and performs aerial photography using the mounted 360-degree camera. This 360-degree camera is supported to allow the user to control the 360-degree rotation through an autonomous unmanned aerial vehicle control interface provided through an application for re-recording aerial photographs. I can see it.

The entry detection device 200 monitors whether there is an entry state into the aerial photographing service area, and when an entry is detected, generates an entry detection signal and transmits it to the autonomous unmanned aerial vehicle 100.

The entrance detection device 200 provides a guide message for paying the air photographing service fee, and when the air photographing service fee is paid in response to the guide message, issues an approval command and guides the user to enter the air photographing service area and photographs the air through the entrance detection sensor. It monitors whether it enters the service area.

The aerial image management server 300 receives the aerial image information received from the autonomous unmanned aerial vehicle and provides it in real time.

When the entrance detection signal is input from the entrance detection device 200, the aerial photography image management server 300 provides an application download guide message for aerial image playback, and when the application download for aerial image playback is completed in response to the guide message , Provides content to be added to the aerial photographed image photographed through the autonomous unmanned aerial vehicle 100, and combines the selected content through the user terminal 500 by the user to the aerial photographed image.

The application for re-use of aerial photography provides an interface for autonomous unmanned aerial vehicle coordination, and allows a user to directly control the autonomous unmanned aerial vehicle 100 using the autonomous unmanned aerial vehicle coordination interface provided through the user terminal 500. Support.

At this time, the free flight unmanned aerial vehicle 100 responds to the flight control information input through the autonomous unmanned aerial vehicle adjustment interface, and the flight control information input through the user terminal 500 during the flight is out of the flight range according to the preset flight information. In the case of sending an error message, autonomous flight is made based on pre-designated autonomous flight information.

Here, the content to be added to the aerial photographs is geographic information related to the photographing area, historical information, virtual images, and the like, and the content selected according to the user's manipulation is synthesized and provided in the video.

When the autonomous unmanned aerial vehicle 100 is photographed and moved, if there is a part that needs to be explained to the historic site or the user, the aerial image management server 300 produces AR content and combines it with the captured video, and then displays the video display device ( 400). For example, when a user visits Palgongsan in Daegu and cannot use the service directly when climbing the Palgongsan for a variety of reasons such as age, clothing, weather, etc., the application for replaying aerial photographs downloaded while passing through the entrance detection device 200 first If you select a climbing route that can go up to Gatbawi Rock through Palgongsan, the autonomous unmanned aerial vehicle 100 starts flying by reading the autonomous flying information flying along the selected climbing route, and thus, the autonomous unmanned aerial vehicle 100 in flight Is provided by photographing the surrounding image including the hiking path, and the user is provided with the video as the same content as that seen by his or her eyes through the video display device 400, that is, VR content.

In addition, the aerial image management server 300 when the autonomous unmanned aerial vehicle 100 arrives at Gatbawi, the final destination, provides AR content with a description of Gatbawi and the reason for visiting Gatbawi.

The image display device 400 reproduces aerial photographed image information received from the aerial photographed image management server in real time. Here, the image display device 400 is a goggle, a smartphone, a TV monitor, and the like.

The autonomous unmanned aerial vehicle control system 500 stores flight area information of the autonomous unmanned aerial vehicle 100 in response to identification information of the autonomous unmanned aerial vehicle 100 and identification information of the autonomous unmanned aerial vehicle 100, When the autonomous unmanned aerial vehicle 100 starts flying, a monitoring screen capable of monitoring the operation state of the autonomous unmanned aerial vehicle 100 is displayed on a screen connected to the autonomous unmanned aerial vehicle control system 500 while the autonomous unmanned aerial vehicle 100 is displayed. It is provided to the administrator terminal 600 which is divided by (100).

The autonomous unmanned aerial vehicle control system 500 sends an alarm signal to the monitoring screen of the server 500 and the manager terminal 600 when the autonomous unmanned aerial vehicle 100 is flying through the route selected by the user and then leaves the route. On the other hand, the flight control information for correcting the flight path of the autonomous unmanned aerial vehicle 100 is controlled by the autonomous unmanned aerial vehicle 100.

The autonomous unmanned aerial vehicle control system 500 notifies the user through the monitoring screen of the manager terminal 600 when the flight status of the autonomous unmanned aerial vehicle 100 is not automatically controlled, and allows the administrator to manually manage the autonomous unmanned aerial vehicle 100 ) To control the flight status.

The operation method of the VR / AR convergence aerial photography platform system configured as described above is as follows.

2 is an operation flowchart for explaining a method of operating a VR / AR convergence aerial photography platform system according to the present invention.

As illustrated in FIG. 2, when the user enters the aerial photographing service area to receive an aerial photograph using the autonomous unmanned aerial vehicle 100, the entrance detecting apparatus 200 recognizes this. And outputs a guide message so that the user can pay for the aerial photography service (S110).

The entrance detection device 200 guides the user to download an application for reproducing the aerial photographing image when the aerial photographing service fee is paid (S120).

The entrance detection device 200 determines whether to control the flight of the autonomous unmanned aerial vehicle 100 through the aerial photography replay application when the aerial photography replay application is downloaded, and the autonomous flight unmanned through the aerial photography replay application. In order to control the flight of the aircraft 100, information related to the unmanned aerial vehicle 100 is transmitted (S130).

The entrance detection device 200 monitors whether the user leaves the aerial photographing service area and checks whether it is out of flight (S140) to determine the off-state (S150), and as a result of the determination, if the user leaves the aerial photography service area, the autonomous flying unmanned aerial vehicle ( 100) to transmit flight stop information (S160), and continuously monitors whether a new user enters the aerial photography service area (S170).

Meanwhile, when the autonomous unmanned aerial vehicle 100 receives the flight control information of the autonomous unmanned aerial vehicle through the aerial image playback application, it flies in response to the received flight control information, and photographs the surroundings while flying to manage the aerial photographic image Send it to the server 300.

The aerial photographic image server 300 provides an aerial photographic image received from the autonomous unmanned aerial vehicle 100 through the image display device 400.

At this time, when the aerial photographing image management server 300 provides the aerial photographed image to the image display device 400, the AR information selected according to the user's manipulation is combined with geographic information, historical information, and virtual images related to the photographing area. do.

AR content is provided through an aerial video playback application for the user to select.

The above-described contents will be able to be modified and modified without departing from the essential characteristics of the present invention to those skilled in the art to which the present invention pertains. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the claims below, and all technical spirits within the equivalent range should be interpreted as being included in the scope of the present invention.

100: autonomous unmanned aerial vehicle
200: entry detection device
300: aerial video management server
400: video display device

Claims (4)

It is equipped with video recording equipment, and stores autonomous flight information and video shooting control information. When an ingress detection signal is received from outside, it performs autonomous flight according to the stored autonomous flight information and provides video in response to video shooting control information. An autonomous unmanned aerial vehicle that shoots an image with photographic equipment and generates and transmits the captured image as aerial photographic image information;
An entrance detection device that monitors whether there is an entry state into the aerial photography service area and generates an entry detection signal when the entry is detected, and sends it to the autonomous unmanned aerial vehicle;
An aerial photographic image management server that receives aerial photographic image information received from the autonomous unmanned aerial vehicle and provides it in real time; And
An image display device for reproducing aerial photographing image information received from the aerial photographing image management server in real time;
VR · AR convergence aerial photography platform system comprising a.
According to claim 1,
The entry detection device,
Whether to enter the aerial photography service area by providing an instruction message for payment of the aerial photography service fee, instructing the user to enter into the aerial photography service area after issuing an approval order when the aerial photography service fee is paid in response to the guide message and entering the aerial photography service area. VR · AR convergence aerial photography platform system characterized by monitoring.
According to claim 1,
The aerial image management server,
When an entry detection signal is inputted from the entry detection device, an application download guide message for aerial photograph playback is provided, and when an application download for aerial photograph playback is completed in response to the guidance message, aerial photographed through the autonomous unmanned aerial vehicle VR · AR convergence aerial photography platform system characterized by providing content to be added to the captured image and combining the content selected by the user with the aerial photography.
The method of claim 3,
The content to be added to the aerial photographed image is at least one of geographic information, historical information, and virtual images related to the photographed region, and is a VR · AR converged aerial photographic platform system characterized by being provided in a video.

Images